2024-09-21T08:52:16.127 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T08:52:16.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T08:52:16.228 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913221 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7913221' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 rgw: ec-data-pool: false frontend: beast selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9490 sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFJXR7i7zy2uVkGS4MvS7gOKllgkf/pHPhqlq2JRfLgHaDHubi4ru8UfdChoOKYZhFJ31/m6g39oNmXmmmizvP4= smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHErAU2j7WWSJ+OsNLugEanI7x97M+xPZH1mXIjctSjO0vNLkepKfbFfKU2wRgLwduj1QgD6y7wv9Kj98lHSAgc= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_21:40:05 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T08:52:16.228 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa; will attempt to use it 2024-09-21T08:52:16.229 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa/tasks 2024-09-21T08:52:16.229 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T08:52:16.231 INFO:teuthology.task.internal:Checking packages... 2024-09-21T08:52:16.250 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '9e2ac70bb7aea67d34f0d50002344abbe7803736' 2024-09-21T08:52:16.250 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T08:52:16.250 INFO:teuthology.packaging:ref: None 2024-09-21T08:52:16.251 INFO:teuthology.packaging:tag: None 2024-09-21T08:52:16.251 INFO:teuthology.packaging:branch: squid 2024-09-21T08:52:16.251 INFO:teuthology.packaging:sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:52:16.251 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T08:52:16.454 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-373.g4e45e6b4 2024-09-21T08:52:16.455 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T08:52:16.462 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T08:52:16.462 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T08:52:16.529 INFO:teuthology.task.internal:Saving configuration 2024-09-21T08:52:16.541 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T08:52:16.548 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T08:52:16.572 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913221', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 08:46:48.637407', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFJXR7i7zy2uVkGS4MvS7gOKllgkf/pHPhqlq2JRfLgHaDHubi4ru8UfdChoOKYZhFJ31/m6g39oNmXmmmizvP4='} 2024-09-21T08:52:16.595 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913221', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 08:46:48.635446', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHErAU2j7WWSJ+OsNLugEanI7x97M+xPZH1mXIjctSjO0vNLkepKfbFfKU2wRgLwduj1QgD6y7wv9Kj98lHSAgc='} 2024-09-21T08:52:16.596 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T08:52:16.603 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-21T08:52:16.604 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-21T08:52:16.604 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T08:52:16.667 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb6d83b4160>, signals=[15]) 2024-09-21T08:52:16.667 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T08:52:16.674 INFO:teuthology.task.internal:Opening connections... 2024-09-21T08:52:16.675 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-09-21T08:52:16.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:52:16.751 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2024-09-21T08:52:16.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:52:16.828 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T08:52:16.834 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-09-21T08:52:16.852 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-09-21T08:52:16.853 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-09-21T08:52:16.910 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-09-21T08:52:16.910 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-09-21T08:52:16.910 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-09-21T08:52:16.910 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-09-21T08:52:16.910 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-09-21T08:52:16.911 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-09-21T08:52:16.911 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T08:52:16.911 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-09-21T08:52:16.911 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-09-21T08:52:16.911 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T08:52:16.911 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-09-21T08:52:16.911 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T08:52:16.911 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T08:52:16.911 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T08:52:16.912 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-09-21T08:52:16.936 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2024-09-21T08:52:16.957 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2024-09-21T08:52:16.958 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-09-21T08:52:17.015 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream" 2024-09-21T08:52:17.015 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="9" 2024-09-21T08:52:17.015 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos" 2024-09-21T08:52:17.015 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora" 2024-09-21T08:52:17.015 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="9" 2024-09-21T08:52:17.015 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el9" 2024-09-21T08:52:17.015 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T08:52:17.016 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2024-09-21T08:52:17.016 INFO:teuthology.orchestra.run.smithi178.stdout:LOGO="fedora-logo-icon" 2024-09-21T08:52:17.016 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T08:52:17.016 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/" 2024-09-21T08:52:17.016 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T08:52:17.016 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T08:52:17.016 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T08:52:17.016 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-09-21T08:52:17.036 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T08:52:17.045 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T08:52:17.049 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T08:52:17.049 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-09-21T08:52:17.052 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2024-09-21T08:52:17.072 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T08:52:17.082 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T08:52:17.082 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-09-21T08:52:17.109 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2024-09-21T08:52:17.135 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T08:52:17.190 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T08:52:17.204 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T08:52:17.204 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T08:52:17.204 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T08:52:17.205 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T08:52:17.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:52:17.221 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-09-21T08:52:17.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:52:17.222 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-09-21T08:52:17.278 INFO:teuthology.orchestra.run.smithi178.stdout:5.14.0-503.el9.x86_64 2024-09-21T08:52:17.279 INFO:teuthology.task.kernel:Running kernel on smithi178: 5.14.0-503.el9.x86_64 2024-09-21T08:52:17.279 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum install -y kernel 2024-09-21T08:52:17.281 INFO:teuthology.orchestra.run.smithi044.stdout:5.14.0-503.el9.x86_64 2024-09-21T08:52:17.281 INFO:teuthology.task.kernel:Running kernel on smithi044: 5.14.0-503.el9.x86_64 2024-09-21T08:52:17.281 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum install -y kernel 2024-09-21T08:52:19.539 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-21T08:52:20.577 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.3 MB 00:01 2024-09-21T08:52:21.315 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-21T08:52:25.652 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - AppStream 5.1 MB/s | 20 MB 00:04 2024-09-21T08:52:26.624 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.5 MB 00:01 2024-09-21T08:52:28.450 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 19 kB 00:00 2024-09-21T08:52:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-21T08:52:31.828 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.5 MB 00:02 2024-09-21T08:52:34.312 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-21T08:52:34.885 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T08:52:35.191 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T08:52:36.891 INFO:teuthology.orchestra.run.smithi044.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T08:52:36.891 INFO:teuthology.orchestra.run.smithi044.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T08:52:36.981 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T08:52:36.992 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T08:52:36.992 INFO:teuthology.orchestra.run.smithi044.stdout: Package Architecture Version Repository Size 2024-09-21T08:52:36.992 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T08:52:36.992 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T08:52:36.992 INFO:teuthology.orchestra.run.smithi044.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T08:52:36.992 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-21T08:52:36.992 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T08:52:36.992 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T08:52:36.992 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T08:52:36.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T08:52:36.992 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T08:52:36.992 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T08:52:36.992 INFO:teuthology.orchestra.run.smithi044.stdout:Install 4 Packages 2024-09-21T08:52:36.993 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T08:52:36.993 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 79 M 2024-09-21T08:52:36.993 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 126 M 2024-09-21T08:52:36.993 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T08:52:37.111 INFO:teuthology.orchestra.run.smithi044.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 372 kB/s | 36 kB 00:00 2024-09-21T08:52:37.520 INFO:teuthology.orchestra.run.smithi044.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-21T08:52:37.903 INFO:teuthology.orchestra.run.smithi044.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 36 MB/s | 29 MB 00:00 2024-09-21T08:52:38.237 INFO:teuthology.orchestra.run.smithi044.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-21T08:52:38.237 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:52:38.237 INFO:teuthology.orchestra.run.smithi044.stdout:Total 63 MB/s | 79 MB 00:01 2024-09-21T08:52:38.947 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T08:52:39.336 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T08:52:39.336 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T08:52:40.334 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T08:52:40.335 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T08:52:40.588 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T08:52:42.553 INFO:teuthology.orchestra.run.smithi178.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T08:52:42.553 INFO:teuthology.orchestra.run.smithi178.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T08:52:42.643 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T08:52:42.653 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T08:52:42.653 INFO:teuthology.orchestra.run.smithi178.stdout: Package Architecture Version Repository Size 2024-09-21T08:52:42.653 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T08:52:42.653 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T08:52:42.653 INFO:teuthology.orchestra.run.smithi178.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T08:52:42.653 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-21T08:52:42.653 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T08:52:42.653 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T08:52:42.653 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T08:52:42.653 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T08:52:42.653 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T08:52:42.654 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T08:52:42.654 INFO:teuthology.orchestra.run.smithi178.stdout:Install 4 Packages 2024-09-21T08:52:42.654 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T08:52:42.654 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 79 M 2024-09-21T08:52:42.654 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 126 M 2024-09-21T08:52:42.654 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T08:52:42.880 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T08:52:43.047 INFO:teuthology.orchestra.run.smithi178.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 324 kB/s | 36 kB 00:00 2024-09-21T08:52:43.539 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T08:52:43.629 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T08:52:45.397 INFO:teuthology.orchestra.run.smithi178.stdout:(2/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 14 MB/s | 35 MB 00:02 2024-09-21T08:52:46.131 INFO:teuthology.orchestra.run.smithi178.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.9 MB/s | 16 MB 00:03 2024-09-21T08:52:46.385 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T08:52:46.526 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T08:52:48.139 INFO:teuthology.orchestra.run.smithi178.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 5.6 MB/s | 29 MB 00:05 2024-09-21T08:52:48.139 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:52:48.139 INFO:teuthology.orchestra.run.smithi178.stdout:Total 14 MB/s | 79 MB 00:05 2024-09-21T08:52:48.823 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T08:52:49.166 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T08:52:49.166 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T08:52:50.122 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T08:52:50.122 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T08:52:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T08:52:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:52:52.566 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T08:52:53.210 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T08:52:53.314 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T08:52:56.053 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T08:52:56.202 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T08:52:56.833 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:53:01.066 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T08:53:01.336 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:53:06.185 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:53:35.602 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:53:35.643 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:53:36.016 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:53:36.016 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T08:53:36.016 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T08:53:36.016 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T08:53:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:53:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T08:53:36.842 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T08:53:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T08:53:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T08:53:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T08:53:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T08:53:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T08:53:36.843 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T08:53:37.189 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T08:53:37.280 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T08:53:37.280 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T08:53:37.280 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T08:53:37.281 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T08:53:37.281 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T08:53:37.281 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T08:53:37.281 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi044.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T08:53:37.281 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T08:53:37.338 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T08:53:37.339 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T08:53:37.339 DEBUG:teuthology.orchestra.run.smithi044:> sudo rpm -qi grub2-tools 2024-09-21T08:53:37.377 INFO:teuthology.orchestra.run.smithi044.stdout:Name : grub2-tools 2024-09-21T08:53:37.377 INFO:teuthology.orchestra.run.smithi044.stdout:Epoch : 1 2024-09-21T08:53:37.377 INFO:teuthology.orchestra.run.smithi044.stdout:Version : 2.06 2024-09-21T08:53:37.377 INFO:teuthology.orchestra.run.smithi044.stdout:Release : 82.el9 2024-09-21T08:53:37.377 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: x86_64 2024-09-21T08:53:37.377 INFO:teuthology.orchestra.run.smithi044.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T08:53:37.377 INFO:teuthology.orchestra.run.smithi044.stdout:Group : Unspecified 2024-09-21T08:53:37.377 INFO:teuthology.orchestra.run.smithi044.stdout:Size : 8274670 2024-09-21T08:53:37.377 INFO:teuthology.orchestra.run.smithi044.stdout:License : GPLv3+ 2024-09-21T08:53:37.378 INFO:teuthology.orchestra.run.smithi044.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T08:53:37.378 INFO:teuthology.orchestra.run.smithi044.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T08:53:37.378 INFO:teuthology.orchestra.run.smithi044.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T08:53:37.378 INFO:teuthology.orchestra.run.smithi044.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T08:53:37.378 INFO:teuthology.orchestra.run.smithi044.stdout:Packager : builder@centos.org 2024-09-21T08:53:37.378 INFO:teuthology.orchestra.run.smithi044.stdout:Vendor : CentOS 2024-09-21T08:53:37.378 INFO:teuthology.orchestra.run.smithi044.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T08:53:37.378 INFO:teuthology.orchestra.run.smithi044.stdout:Summary : Support tools for GRUB. 2024-09-21T08:53:37.378 INFO:teuthology.orchestra.run.smithi044.stdout:Description : 2024-09-21T08:53:37.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T08:53:37.378 INFO:teuthology.orchestra.run.smithi044.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T08:53:37.378 INFO:teuthology.orchestra.run.smithi044.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T08:53:37.379 INFO:teuthology.orchestra.run.smithi044.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T08:53:37.379 INFO:teuthology.orchestra.run.smithi044.stdout:hardware devices. 2024-09-21T08:53:37.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T08:53:37.379 INFO:teuthology.orchestra.run.smithi044.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T08:53:37.379 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T08:53:37.380 INFO:teuthology.task.kernel:Updating grub on smithi044 to boot 5.14.0-508.el9.x86_64 2024-09-21T08:53:37.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T08:53:37.983 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2024-09-21T08:53:39.365 INFO:teuthology.orchestra.run.smithi044.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T08:53:39.387 INFO:teuthology.orchestra.run.smithi044.stderr:done 2024-09-21T08:53:39.391 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-09-21T08:53:39.406 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.urT0ZZhtav 2024-09-21T08:53:39.406 DEBUG:teuthology.orchestra.run.smithi044:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.urT0ZZhtav 2024-09-21T08:53:39.472 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.urT0ZZhtav 2024-09-21T08:53:39.606 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.urT0ZZhtav is 6KB 2024-09-21T08:53:39.655 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.urT0ZZhtav 2024-09-21T08:53:39.670 DEBUG:teuthology.orchestra.run.smithi044:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T08:53:39.740 INFO:teuthology.orchestra.run.smithi044.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T08:53:39.740 INFO:teuthology.orchestra.run.smithi044.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T08:53:39.740 INFO:teuthology.orchestra.run.smithi044.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T08:53:39.740 INFO:teuthology.orchestra.run.smithi044.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T08:53:39.741 DEBUG:teuthology.orchestra.run.smithi044:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T08:53:39.898 DEBUG:teuthology.orchestra.run.smithi044:> sudo shutdown -r now 2024-09-21T08:53:44.564 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:53:44.610 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:53:44.964 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:53:44.964 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T08:53:44.964 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T08:53:44.964 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T08:53:45.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:53:45.787 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T08:53:45.788 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T08:53:45.788 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T08:53:45.788 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T08:53:45.788 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T08:53:45.788 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T08:53:45.788 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T08:53:45.788 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T08:53:46.137 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T08:53:46.264 INFO:teuthology.orchestra.run.smithi178.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T08:53:46.264 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T08:53:46.264 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T08:53:46.264 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T08:53:46.264 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T08:53:46.265 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-21T08:53:46.265 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi178.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T08:53:46.265 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T08:53:46.323 INFO:teuthology.orchestra.run.smithi178.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T08:53:46.323 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T08:53:46.324 DEBUG:teuthology.orchestra.run.smithi178:> sudo rpm -qi grub2-tools 2024-09-21T08:53:46.356 INFO:teuthology.orchestra.run.smithi178.stdout:Name : grub2-tools 2024-09-21T08:53:46.356 INFO:teuthology.orchestra.run.smithi178.stdout:Epoch : 1 2024-09-21T08:53:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:Version : 2.06 2024-09-21T08:53:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:Release : 82.el9 2024-09-21T08:53:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:Architecture: x86_64 2024-09-21T08:53:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T08:53:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:Group : Unspecified 2024-09-21T08:53:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:Size : 8274670 2024-09-21T08:53:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:License : GPLv3+ 2024-09-21T08:53:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T08:53:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T08:53:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T08:53:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T08:53:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:Packager : builder@centos.org 2024-09-21T08:53:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:Vendor : CentOS 2024-09-21T08:53:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T08:53:46.358 INFO:teuthology.orchestra.run.smithi178.stdout:Summary : Support tools for GRUB. 2024-09-21T08:53:46.358 INFO:teuthology.orchestra.run.smithi178.stdout:Description : 2024-09-21T08:53:46.358 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T08:53:46.358 INFO:teuthology.orchestra.run.smithi178.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T08:53:46.358 INFO:teuthology.orchestra.run.smithi178.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T08:53:46.358 INFO:teuthology.orchestra.run.smithi178.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T08:53:46.358 INFO:teuthology.orchestra.run.smithi178.stdout:hardware devices. 2024-09-21T08:53:46.358 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T08:53:46.358 INFO:teuthology.orchestra.run.smithi178.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T08:53:46.359 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T08:53:46.359 INFO:teuthology.task.kernel:Updating grub on smithi178 to boot 5.14.0-508.el9.x86_64 2024-09-21T08:53:46.359 DEBUG:teuthology.orchestra.run.smithi178:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T08:53:47.008 INFO:teuthology.orchestra.run.smithi178.stderr:Generating grub configuration file ... 2024-09-21T08:53:48.366 INFO:teuthology.orchestra.run.smithi178.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T08:53:48.397 INFO:teuthology.orchestra.run.smithi178.stderr:done 2024-09-21T08:53:48.401 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2024-09-21T08:53:48.417 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.0dwPqraRBS 2024-09-21T08:53:48.418 DEBUG:teuthology.orchestra.run.smithi178:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0dwPqraRBS 2024-09-21T08:53:48.484 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.0dwPqraRBS 2024-09-21T08:53:48.627 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.0dwPqraRBS is 6KB 2024-09-21T08:53:48.676 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.0dwPqraRBS 2024-09-21T08:53:48.691 DEBUG:teuthology.orchestra.run.smithi178:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T08:53:48.754 INFO:teuthology.orchestra.run.smithi178.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T08:53:48.754 INFO:teuthology.orchestra.run.smithi178.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T08:53:48.754 INFO:teuthology.orchestra.run.smithi178.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T08:53:48.754 INFO:teuthology.orchestra.run.smithi178.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T08:53:48.755 DEBUG:teuthology.orchestra.run.smithi178:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T08:53:48.913 DEBUG:teuthology.orchestra.run.smithi178:> sudo shutdown -r now 2024-09-21T08:54:09.918 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T08:54:09.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-21T08:54:09.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:54:18.922 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-21T08:54:18.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-21T08:54:18.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:54:28.335 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-09-21T08:54:37.295 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-09-21T08:54:37.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-21T08:54:37.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:54:46.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-21T08:54:46.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:54:49.359 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-09-21T08:55:01.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-21T08:55:01.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:55:04.431 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-09-21T08:55:19.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-21T08:55:19.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:55:37.355 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T08:55:37.971 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-09-21T08:55:49.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-21T08:55:49.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:55:49.706 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-09-21T08:55:50.047 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-21T08:55:50.047 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T08:55:50.047 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-09-21T08:55:50.065 INFO:teuthology.orchestra.run.smithi044.stdout:5.14.0-508.el9.x86_64 2024-09-21T08:55:50.065 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T08:55:50.066 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T08:55:50.066 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T08:55:51.067 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T08:55:51.067 DEBUG:teuthology.orchestra.run.smithi044:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T08:55:51.144 INFO:teuthology.orchestra.run.smithi044.stdout:ttyS1 2024-09-21T08:55:51.163 DEBUG:teuthology.parallel:result is None 2024-09-21T08:55:55.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-21T08:55:55.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:55:56.372 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-09-21T08:55:56.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-21T08:55:56.741 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-508.el9.x86_64"... 2024-09-21T08:55:56.741 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-09-21T08:55:56.757 INFO:teuthology.orchestra.run.smithi178.stdout:5.14.0-508.el9.x86_64 2024-09-21T08:55:56.757 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T08:55:56.757 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T08:55:56.757 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T08:55:57.758 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-21T08:55:57.758 DEBUG:teuthology.orchestra.run.smithi178:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T08:55:57.848 INFO:teuthology.orchestra.run.smithi178.stdout:ttyS1 2024-09-21T08:55:57.869 DEBUG:teuthology.parallel:result is None 2024-09-21T08:55:57.869 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T08:55:57.877 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T08:55:57.877 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T08:55:57.880 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T08:55:57.898 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T08:55:57.913 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T08:55:57.921 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T08:55:57.921 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T08:55:57.939 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T08:55:57.987 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T08:55:57.994 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T08:55:57.994 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T08:55:58.005 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T08:55:58.039 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T08:55:58.051 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T08:55:58.059 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T08:55:58.071 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T08:55:58.073 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T08:55:58.079 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T08:55:58.080 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T08:55:58.095 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T08:55:58.143 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T08:55:58.151 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T08:55:58.152 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T08:55:58.163 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T08:55:58.201 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T08:55:58.262 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T08:55:58.310 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T08:55:58.389 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T08:55:58.436 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T08:55:58.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T08:55:58.503 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T08:55:58.545 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T08:55:58.603 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T08:55:58.688 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T08:55:58.731 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T08:55:58.732 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T08:55:58.799 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-09-21T08:55:58.802 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2024-09-21T08:55:58.839 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:55:58.881 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:55:59.395 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T08:55:59.403 INFO:teuthology.task.internal:Starting timer... 2024-09-21T08:55:59.403 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T08:55:59.416 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T08:55:59.424 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-21T08:55:59.424 DEBUG:teuthology.orchestra.run.smithi044:> sudo service auditd rotate 2024-09-21T08:55:59.494 INFO:teuthology.orchestra.run.smithi044.stdout:Rotating logs: 2024-09-21T08:55:59.496 DEBUG:teuthology.orchestra.run.smithi178:> sudo service auditd rotate 2024-09-21T08:55:59.561 INFO:teuthology.orchestra.run.smithi178.stdout:Rotating logs: 2024-09-21T08:55:59.564 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T08:55:59.564 DEBUG:teuthology.orchestra.run.smithi044:> /usr/sbin/getenforce 2024-09-21T08:55:59.588 INFO:teuthology.orchestra.run.smithi044.stdout:Permissive 2024-09-21T08:55:59.588 DEBUG:teuthology.orchestra.run.smithi178:> /usr/sbin/getenforce 2024-09-21T08:55:59.625 INFO:teuthology.orchestra.run.smithi178.stdout:Permissive 2024-09-21T08:55:59.625 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi044.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi178.front.sepia.ceph.com': 'permissive'} 2024-09-21T08:55:59.625 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T08:55:59.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:55:59.656 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T08:55:59.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:55:59.695 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T08:55:59.695 DEBUG:teuthology.orchestra.run.smithi044:> sudo /usr/sbin/setenforce permissive 2024-09-21T08:55:59.728 DEBUG:teuthology.orchestra.run.smithi178:> sudo /usr/sbin/setenforce permissive 2024-09-21T08:55:59.772 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T08:55:59.785 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T08:55:59.795 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T08:55:59.796 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T08:59:45.534 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2024-09-21T08:59:45.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-21T08:59:45.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:59:45.610 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-09-21T08:59:45.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-21T08:59:45.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-21T08:59:45.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:59:45.770 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-09-21T08:59:45.848 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-21T08:59:45.848 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T08:59:45.858 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T08:59:45.858 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T08:59:45.859 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:59:45.861 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T08:59:45.861 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:59:45.891 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T08:59:45.906 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T08:59:45.919 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T08:59:45.932 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: ntpd: command not found 2024-09-21T08:59:45.934 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T08:59:45.944 INFO:teuthology.orchestra.run.smithi044.stdout:506 Cannot talk to daemon 2024-09-21T08:59:45.959 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: ntpd: command not found 2024-09-21T08:59:45.960 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T08:59:45.970 INFO:teuthology.orchestra.run.smithi178.stdout:506 Cannot talk to daemon 2024-09-21T08:59:45.974 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T08:59:45.985 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T08:59:45.999 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T08:59:46.033 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:59:46.037 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:59:46.037 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-09-21T08:59:46.037 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:59:46.037 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:59:46.037 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:59:46.037 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:59:46.053 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:59:46.057 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:59:46.057 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2024-09-21T08:59:46.057 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:59:46.057 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:59:46.057 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:59:46.057 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:59:46.058 INFO:teuthology.run_tasks:Running task install... 2024-09-21T08:59:46.072 DEBUG:teuthology.task.install:project ceph 2024-09-21T08:59:46.072 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}} 2024-09-21T08:59:46.072 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'} 2024-09-21T08:59:46.072 INFO:teuthology.task.install:Using flavor: default 2024-09-21T08:59:46.077 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T08:59:46.077 INFO:teuthology.task.install:extra packages: [] 2024-09-21T08:59:46.077 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736', 'tag': None, 'wait_for_package': False} 2024-09-21T08:59:46.078 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:59:46.082 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736', 'tag': None, 'wait_for_package': False} 2024-09-21T08:59:46.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:59:46.226 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/ 2024-09-21T08:59:46.226 INFO:teuthology.task.install.rpm:Package version is 19.1.1-367.g9e2ac70b 2024-09-21T08:59:46.230 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/ 2024-09-21T08:59:46.230 INFO:teuthology.task.install.rpm:Package version is 19.1.1-367.g9e2ac70b 2024-09-21T08:59:46.336 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T08:59:46.336 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T08:59:46.336 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T08:59:46.343 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T08:59:46.343 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T08:59:46.343 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T08:59:46.364 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T08:59:46.364 DEBUG:teuthology.orchestra.run.smithi044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9e2ac70bb7aea67d34f0d50002344abbe7803736/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T08:59:46.368 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T08:59:46.369 DEBUG:teuthology.orchestra.run.smithi178:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9e2ac70bb7aea67d34f0d50002344abbe7803736/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T08:59:46.432 DEBUG:teuthology.orchestra.run.smithi044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T08:59:46.434 DEBUG:teuthology.orchestra.run.smithi178:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T08:59:46.509 DEBUG:teuthology.orchestra.run.smithi044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T08:59:46.510 DEBUG:teuthology.orchestra.run.smithi178:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T08:59:46.574 INFO:teuthology.orchestra.run.smithi044.stdout:check_obsoletes = 1 2024-09-21T08:59:46.575 INFO:teuthology.orchestra.run.smithi178.stdout:check_obsoletes = 1 2024-09-21T08:59:46.576 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum clean all 2024-09-21T08:59:46.577 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum clean all 2024-09-21T08:59:46.818 INFO:teuthology.orchestra.run.smithi178.stdout:45 files removed 2024-09-21T08:59:46.823 INFO:teuthology.orchestra.run.smithi044.stdout:45 files removed 2024-09-21T08:59:46.845 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-radosgw 2024-09-21T08:59:46.850 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-radosgw 2024-09-21T08:59:47.395 INFO:teuthology.orchestra.run.smithi178.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-09-21T08:59:47.403 INFO:teuthology.orchestra.run.smithi044.stdout:ceph packages for x86_64 325 kB/s | 84 kB 00:00 2024-09-21T08:59:47.679 INFO:teuthology.orchestra.run.smithi178.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-21T08:59:47.679 INFO:teuthology.orchestra.run.smithi044.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-21T08:59:47.938 INFO:teuthology.orchestra.run.smithi044.stdout:ceph source packages 8.6 kB/s | 1.9 kB 00:00 2024-09-21T08:59:47.963 INFO:teuthology.orchestra.run.smithi178.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-21T08:59:49.704 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.3 MB 00:01 2024-09-21T08:59:49.888 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.3 MB 00:01 2024-09-21T08:59:51.539 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-21T08:59:52.055 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-21T08:59:56.431 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-21T08:59:56.790 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.5 MB 00:01 2024-09-21T08:59:58.057 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-21T08:59:58.374 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-21T08:59:59.011 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-21T08:59:59.387 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-21T09:00:04.383 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-21T09:00:04.993 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T09:00:06.618 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:00:06.628 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:06.629 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-21T09:00:06.629 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:06.629 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:00:06.629 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 11 M 2024-09-21T09:00:06.629 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrading: 2024-09-21T09:00:06.629 INFO:teuthology.orchestra.run.smithi178.stdout: librados2 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 3.4 M 2024-09-21T09:00:06.629 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 3.2 M 2024-09-21T09:00:06.629 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-21T09:00:06.629 INFO:teuthology.orchestra.run.smithi178.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T09:00:06.629 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 5.4 M 2024-09-21T09:00:06.629 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 21 M 2024-09-21T09:00:06.629 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 25 k 2024-09-21T09:00:06.629 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T09:00:06.629 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T09:00:06.630 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T09:00:06.630 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 752 k 2024-09-21T09:00:06.630 INFO:teuthology.orchestra.run.smithi178.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T09:00:06.630 INFO:teuthology.orchestra.run.smithi178.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T09:00:06.630 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T09:00:06.630 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 506 k 2024-09-21T09:00:06.630 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T09:00:06.630 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 5.3 M 2024-09-21T09:00:06.630 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T09:00:06.630 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T09:00:06.630 INFO:teuthology.orchestra.run.smithi178.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T09:00:06.630 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 45 k 2024-09-21T09:00:06.630 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 136 k 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 161 k 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 320 k 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 301 k 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 99 k 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout:Installing weak dependencies: 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:06.631 INFO:teuthology.orchestra.run.smithi178.stdout:Install 30 Packages 2024-09-21T09:00:06.632 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrade 2 Packages 2024-09-21T09:00:06.632 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:06.632 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 60 M 2024-09-21T09:00:06.632 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:00:07.363 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:00:07.375 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:00:07.376 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-21T09:00:07.376 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:00:07.376 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:00:07.376 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 11 M 2024-09-21T09:00:07.376 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2024-09-21T09:00:07.376 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 3.4 M 2024-09-21T09:00:07.376 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 3.2 M 2024-09-21T09:00:07.376 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-21T09:00:07.376 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T09:00:07.376 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 5.4 M 2024-09-21T09:00:07.377 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 21 M 2024-09-21T09:00:07.377 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 25 k 2024-09-21T09:00:07.377 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T09:00:07.377 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T09:00:07.377 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T09:00:07.377 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 752 k 2024-09-21T09:00:07.377 INFO:teuthology.orchestra.run.smithi044.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T09:00:07.377 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T09:00:07.377 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T09:00:07.377 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 506 k 2024-09-21T09:00:07.377 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T09:00:07.377 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 5.3 M 2024-09-21T09:00:07.378 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T09:00:07.378 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T09:00:07.378 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T09:00:07.378 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 45 k 2024-09-21T09:00:07.378 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 136 k 2024-09-21T09:00:07.378 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 161 k 2024-09-21T09:00:07.378 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T09:00:07.378 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 320 k 2024-09-21T09:00:07.378 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 301 k 2024-09-21T09:00:07.378 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 99 k 2024-09-21T09:00:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T09:00:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T09:00:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T09:00:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T09:00:07.379 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2024-09-21T09:00:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T09:00:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:07.379 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:00:07.379 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:00:07.379 INFO:teuthology.orchestra.run.smithi044.stdout:Install 30 Packages 2024-09-21T09:00:07.379 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 2 Packages 2024-09-21T09:00:07.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:07.380 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 60 M 2024-09-21T09:00:07.380 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:00:07.384 INFO:teuthology.orchestra.run.smithi178.stdout:(1/32): ceph-base-19.1.1-367.g9e2ac70b.el9.x86_ 12 MB/s | 5.4 MB 00:00 2024-09-21T09:00:07.451 INFO:teuthology.orchestra.run.smithi178.stdout:(2/32): ceph-selinux-19.1.1-367.g9e2ac70b.el9.x 378 kB/s | 25 kB 00:00 2024-09-21T09:00:07.551 INFO:teuthology.orchestra.run.smithi178.stdout:(3/32): libcephfs2-19.1.1-367.g9e2ac70b.el9.x86 7.4 MB/s | 752 kB 00:00 2024-09-21T09:00:07.710 INFO:teuthology.orchestra.run.smithi178.stdout:(4/32): ceph-radosgw-19.1.1-367.g9e2ac70b.el9.x 13 MB/s | 11 MB 00:00 2024-09-21T09:00:07.735 INFO:teuthology.orchestra.run.smithi178.stdout:(5/32): libradosstriper1-19.1.1-367.g9e2ac70b.e 2.7 MB/s | 506 kB 00:00 2024-09-21T09:00:07.785 INFO:teuthology.orchestra.run.smithi178.stdout:(6/32): python3-ceph-argparse-19.1.1-367.g9e2ac 906 kB/s | 45 kB 00:00 2024-09-21T09:00:07.877 INFO:teuthology.orchestra.run.smithi178.stdout:(7/32): python3-ceph-common-19.1.1-367.g9e2ac70 1.5 MB/s | 136 kB 00:00 2024-09-21T09:00:07.969 INFO:teuthology.orchestra.run.smithi178.stdout:(8/32): librgw2-19.1.1-367.g9e2ac70b.el9.x86_64 21 MB/s | 5.3 MB 00:00 2024-09-21T09:00:07.994 INFO:teuthology.orchestra.run.smithi178.stdout:(9/32): python3-cephfs-19.1.1-367.g9e2ac70b.el9 1.3 MB/s | 161 kB 00:00 2024-09-21T09:00:08.019 INFO:teuthology.orchestra.run.smithi178.stdout:(10/32): python3-rados-19.1.1-367.g9e2ac70b.el9 6.2 MB/s | 320 kB 00:00 2024-09-21T09:00:08.045 INFO:teuthology.orchestra.run.smithi178.stdout:(11/32): python3-rbd-19.1.1-367.g9e2ac70b.el9.x 5.9 MB/s | 301 kB 00:00 2024-09-21T09:00:08.070 INFO:teuthology.orchestra.run.smithi178.stdout:(12/32): python3-rgw-19.1.1-367.g9e2ac70b.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-21T09:00:08.287 INFO:teuthology.orchestra.run.smithi178.stdout:(13/32): ceph-common-19.1.1-367.g9e2ac70b.el9.x 16 MB/s | 21 MB 00:01 2024-09-21T09:00:08.345 INFO:teuthology.orchestra.run.smithi178.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 356 kB/s | 107 kB 00:00 2024-09-21T09:00:08.379 INFO:teuthology.orchestra.run.smithi178.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 493 kB/s | 45 kB 00:00 2024-09-21T09:00:08.429 INFO:teuthology.orchestra.run.smithi178.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 446 kB/s | 160 kB 00:00 2024-09-21T09:00:08.463 INFO:teuthology.orchestra.run.smithi178.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-21T09:00:08.488 INFO:teuthology.orchestra.run.smithi178.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 721 kB/s | 42 kB 00:00 2024-09-21T09:00:08.514 INFO:teuthology.orchestra.run.smithi178.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-21T09:00:08.539 INFO:teuthology.orchestra.run.smithi178.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 713 kB/s | 36 kB 00:00 2024-09-21T09:00:08.564 INFO:teuthology.orchestra.run.smithi178.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-09-21T09:00:08.589 INFO:teuthology.orchestra.run.smithi178.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-21T09:00:08.656 INFO:teuthology.orchestra.run.smithi178.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 391 kB/s | 26 kB 00:00 2024-09-21T09:00:08.681 INFO:teuthology.orchestra.run.smithi178.stdout:(24/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.1 MB/s | 308 kB 00:00 2024-09-21T09:00:08.706 INFO:teuthology.orchestra.run.smithi178.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 968 kB/s | 49 kB 00:00 2024-09-21T09:00:08.732 INFO:teuthology.orchestra.run.smithi178.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T09:00:08.735 INFO:teuthology.orchestra.run.smithi044.stdout:(1/32): ceph-base-19.1.1-367.g9e2ac70b.el9.x86_ 4.9 MB/s | 5.4 MB 00:01 2024-09-21T09:00:08.774 INFO:teuthology.orchestra.run.smithi178.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T09:00:08.786 INFO:teuthology.orchestra.run.smithi044.stdout:(2/32): ceph-selinux-19.1.1-367.g9e2ac70b.el9.x 502 kB/s | 25 kB 00:00 2024-09-21T09:00:08.841 INFO:teuthology.orchestra.run.smithi178.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-09-21T09:00:08.886 INFO:teuthology.orchestra.run.smithi044.stdout:(3/32): libcephfs2-19.1.1-367.g9e2ac70b.el9.x86 7.4 MB/s | 752 kB 00:00 2024-09-21T09:00:08.941 INFO:teuthology.orchestra.run.smithi178.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-09-21T09:00:09.016 INFO:teuthology.orchestra.run.smithi178.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-21T09:00:09.062 INFO:teuthology.orchestra.run.smithi044.stdout:(4/32): ceph-radosgw-19.1.1-367.g9e2ac70b.el9.x 7.4 MB/s | 11 MB 00:01 2024-09-21T09:00:09.075 INFO:teuthology.orchestra.run.smithi178.stdout:(31/32): librados2-19.1.1-367.g9e2ac70b.el9.x86 15 MB/s | 3.4 MB 00:00 2024-09-21T09:00:09.095 INFO:teuthology.orchestra.run.smithi044.stdout:(5/32): libradosstriper1-19.1.1-367.g9e2ac70b.e 2.4 MB/s | 506 kB 00:00 2024-09-21T09:00:09.162 INFO:teuthology.orchestra.run.smithi044.stdout:(6/32): python3-ceph-argparse-19.1.1-367.g9e2ac 677 kB/s | 45 kB 00:00 2024-09-21T09:00:09.200 INFO:teuthology.orchestra.run.smithi178.stdout:(32/32): librbd1-19.1.1-367.g9e2ac70b.el9.x86_6 12 MB/s | 3.2 MB 00:00 2024-09-21T09:00:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:00:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:Total 23 MB/s | 60 MB 00:02 2024-09-21T09:00:09.212 INFO:teuthology.orchestra.run.smithi044.stdout:(7/32): python3-ceph-common-19.1.1-367.g9e2ac70 2.7 MB/s | 136 kB 00:00 2024-09-21T09:00:09.279 INFO:teuthology.orchestra.run.smithi044.stdout:(8/32): python3-cephfs-19.1.1-367.g9e2ac70b.el9 2.4 MB/s | 161 kB 00:00 2024-09-21T09:00:09.307 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:00:09.342 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:00:09.343 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:00:09.355 INFO:teuthology.orchestra.run.smithi044.stdout:(9/32): python3-rados-19.1.1-367.g9e2ac70b.el9. 4.2 MB/s | 320 kB 00:00 2024-09-21T09:00:09.438 INFO:teuthology.orchestra.run.smithi044.stdout:(10/32): librgw2-19.1.1-367.g9e2ac70b.el9.x86_6 14 MB/s | 5.3 MB 00:00 2024-09-21T09:00:09.464 INFO:teuthology.orchestra.run.smithi044.stdout:(11/32): python3-rbd-19.1.1-367.g9e2ac70b.el9.x 2.7 MB/s | 301 kB 00:00 2024-09-21T09:00:09.489 INFO:teuthology.orchestra.run.smithi044.stdout:(12/32): python3-rgw-19.1.1-367.g9e2ac70b.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-21T09:00:09.706 INFO:teuthology.orchestra.run.smithi044.stdout:(13/32): ceph-common-19.1.1-367.g9e2ac70b.el9.x 10 MB/s | 21 MB 00:02 2024-09-21T09:00:10.020 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:00:10.021 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:00:10.072 INFO:teuthology.orchestra.run.smithi044.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 123 kB/s | 45 kB 00:00 2024-09-21T09:00:10.098 INFO:teuthology.orchestra.run.smithi044.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 169 kB/s | 107 kB 00:00 2024-09-21T09:00:10.165 INFO:teuthology.orchestra.run.smithi044.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 237 kB/s | 160 kB 00:00 2024-09-21T09:00:10.282 INFO:teuthology.orchestra.run.smithi044.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 362 kB/s | 42 kB 00:00 2024-09-21T09:00:10.491 INFO:teuthology.orchestra.run.smithi044.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 745 kB/s | 292 kB 00:00 2024-09-21T09:00:10.516 INFO:teuthology.orchestra.run.smithi044.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 945 kB/s | 221 kB 00:00 2024-09-21T09:00:10.541 INFO:teuthology.orchestra.run.smithi044.stdout:(20/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.4 MB/s | 662 kB 00:00 2024-09-21T09:00:10.591 INFO:teuthology.orchestra.run.smithi044.stdout:(21/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 6.0 MB/s | 308 kB 00:00 2024-09-21T09:00:10.616 INFO:teuthology.orchestra.run.smithi044.stdout:(22/32): qatlib-service-24.02.0-1.el9.x86_64.rp 286 kB/s | 36 kB 00:00 2024-09-21T09:00:10.642 INFO:teuthology.orchestra.run.smithi044.stdout:(23/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 377 kB/s | 47 kB 00:00 2024-09-21T09:00:10.692 INFO:teuthology.orchestra.run.smithi044.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-09-21T09:00:10.725 INFO:teuthology.orchestra.run.smithi044.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 2.1 MB/s | 67 kB 00:00 2024-09-21T09:00:10.769 INFO:teuthology.orchestra.run.smithi044.stdout:(26/32): liboath-2.6.7-2.el9.x86_64.rpm 408 kB/s | 49 kB 00:00 2024-09-21T09:00:10.818 INFO:teuthology.orchestra.run.smithi044.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 3.9 MB/s | 191 kB 00:00 2024-09-21T09:00:10.868 INFO:teuthology.orchestra.run.smithi044.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-09-21T09:00:10.952 INFO:teuthology.orchestra.run.smithi044.stdout:(29/32): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-21T09:00:11.019 INFO:teuthology.orchestra.run.smithi044.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-09-21T09:00:11.194 INFO:teuthology.orchestra.run.smithi044.stdout:(31/32): librbd1-19.1.1-367.g9e2ac70b.el9.x86_6 13 MB/s | 3.2 MB 00:00 2024-09-21T09:00:11.311 INFO:teuthology.orchestra.run.smithi044.stdout:(32/32): librados2-19.1.1-367.g9e2ac70b.el9.x86 7.7 MB/s | 3.4 MB 00:00 2024-09-21T09:00:11.317 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:00:11.317 INFO:teuthology.orchestra.run.smithi044.stdout:Total 15 MB/s | 60 MB 00:03 2024-09-21T09:00:11.420 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:00:11.462 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:00:11.462 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:00:11.581 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:00:11.651 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T09:00:11.680 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T09:00:11.706 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T09:00:11.728 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T09:00:11.754 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T09:00:11.913 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T09:00:11.967 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T09:00:12.151 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:00:12.152 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:00:12.307 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T09:00:12.415 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 7/34 2024-09-21T09:00:12.492 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 7/34 2024-09-21T09:00:12.581 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 8/34 2024-09-21T09:00:12.609 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 9/34 2024-09-21T09:00:12.680 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 9/34 2024-09-21T09:00:12.717 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T09:00:12.761 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-argparse-2:19.1.1-367.g9e2ac70b.el9.x 11/34 2024-09-21T09:00:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 12/34 2024-09-21T09:00:12.852 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 13/34 2024-09-21T09:00:12.917 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 13/34 2024-09-21T09:00:12.951 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T09:00:13.061 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T09:00:13.094 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T09:00:13.135 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T09:00:13.167 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T09:00:13.196 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T09:00:13.232 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T09:00:13.554 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T09:00:13.608 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 22/34 2024-09-21T09:00:13.699 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 22/34 2024-09-21T09:00:13.703 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:00:13.729 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 23/34 2024-09-21T09:00:13.765 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T09:00:13.779 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T09:00:13.808 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T09:00:13.841 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T09:00:13.864 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T09:00:13.904 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T09:00:14.067 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T09:00:14.120 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T09:00:14.247 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T09:00:14.285 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 26/34 2024-09-21T09:00:14.357 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 26/34 2024-09-21T09:00:14.434 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 27/34 2024-09-21T09:00:14.463 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86 28/34 2024-09-21T09:00:14.531 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T09:00:14.568 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 7/34 2024-09-21T09:00:14.661 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 7/34 2024-09-21T09:00:14.751 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 8/34 2024-09-21T09:00:14.777 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 9/34 2024-09-21T09:00:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 9/34 2024-09-21T09:00:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T09:00:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-argparse-2:19.1.1-367.g9e2ac70b.el9.x 11/34 2024-09-21T09:00:14.988 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 12/34 2024-09-21T09:00:15.013 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 13/34 2024-09-21T09:00:15.077 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 13/34 2024-09-21T09:00:15.112 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T09:00:15.223 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T09:00:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T09:00:15.303 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T09:00:15.335 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T09:00:15.365 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T09:00:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T09:00:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T09:00:15.768 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 22/34 2024-09-21T09:00:15.869 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 22/34 2024-09-21T09:00:15.916 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 23/34 2024-09-21T09:00:15.960 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T09:00:16.467 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T09:00:16.504 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 26/34 2024-09-21T09:00:16.576 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 26/34 2024-09-21T09:00:16.656 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 27/34 2024-09-21T09:00:16.690 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86 28/34 2024-09-21T09:00:16.751 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 29/34 2024-09-21T09:00:16.792 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 29/34 2024-09-21T09:00:17.365 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 29/34 2024-09-21T09:00:17.396 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 30/34 2024-09-21T09:00:17.488 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 30/34 2024-09-21T09:00:17.488 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T09:00:17.488 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T09:00:17.488 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:17.530 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 31/34 2024-09-21T09:00:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 29/34 2024-09-21T09:00:19.119 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 29/34 2024-09-21T09:00:19.724 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 29/34 2024-09-21T09:00:19.765 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 30/34 2024-09-21T09:00:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 30/34 2024-09-21T09:00:19.858 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T09:00:19.858 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T09:00:19.858 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:19.899 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 31/34 2024-09-21T09:00:27.475 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 31/34 2024-09-21T09:00:27.475 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /sys 2024-09-21T09:00:27.475 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /proc 2024-09-21T09:00:27.475 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /mnt 2024-09-21T09:00:27.475 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /var/tmp 2024-09-21T09:00:27.475 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /home 2024-09-21T09:00:27.475 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /root 2024-09-21T09:00:27.475 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /tmp 2024-09-21T09:00:27.475 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:28.455 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 32/34 2024-09-21T09:00:28.481 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 32/34 2024-09-21T09:00:28.481 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:00:28.481 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T09:00:28.481 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T09:00:28.481 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T09:00:28.481 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:28.483 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T09:00:28.549 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T09:00:28.549 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T09:00:29.765 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T09:00:29.765 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/34 2024-09-21T09:00:29.765 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/34 2024-09-21T09:00:29.765 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/34 2024-09-21T09:00:29.765 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/34 2024-09-21T09:00:29.765 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 5/34 2024-09-21T09:00:29.765 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 6/34 2024-09-21T09:00:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 7/34 2024-09-21T09:00:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-argparse-2:19.1.1-367.g9e2ac70b.el9.x 8/34 2024-09-21T09:00:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86 9/34 2024-09-21T09:00:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 10/34 2024-09-21T09:00:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 11/34 2024-09-21T09:00:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 12/34 2024-09-21T09:00:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 13/34 2024-09-21T09:00:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T09:00:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T09:00:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T09:00:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T09:00:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T09:00:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T09:00:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T09:00:29.767 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T09:00:29.767 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T09:00:29.767 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T09:00:29.767 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T09:00:29.767 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T09:00:29.767 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T09:00:29.767 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T09:00:29.767 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T09:00:29.768 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T09:00:29.768 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T09:00:29.768 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 31/34 2024-09-21T09:00:29.768 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T09:00:29.768 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 33/34 2024-09-21T09:00:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 31/34 2024-09-21T09:00:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /sys 2024-09-21T09:00:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /proc 2024-09-21T09:00:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /mnt 2024-09-21T09:00:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /var/tmp 2024-09-21T09:00:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /home 2024-09-21T09:00:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /root 2024-09-21T09:00:30.310 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /tmp 2024-09-21T09:00:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:30.665 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T09:00:30.665 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:30.665 INFO:teuthology.orchestra.run.smithi178.stdout:Upgraded: 2024-09-21T09:00:30.666 INFO:teuthology.orchestra.run.smithi178.stdout: librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.666 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.666 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:00:30.666 INFO:teuthology.orchestra.run.smithi178.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T09:00:30.666 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.666 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.666 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.666 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.666 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T09:00:30.666 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T09:00:30.666 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T09:00:30.666 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.666 INFO:teuthology.orchestra.run.smithi178.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T09:00:30.667 INFO:teuthology.orchestra.run.smithi178.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T09:00:30.667 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T09:00:30.667 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.667 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T09:00:30.667 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.667 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T09:00:30.667 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T09:00:30.667 INFO:teuthology.orchestra.run.smithi178.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T09:00:30.667 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.667 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.667 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.667 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T09:00:30.667 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.667 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.668 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:30.668 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T09:00:30.668 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T09:00:30.668 INFO:teuthology.orchestra.run.smithi178.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T09:00:30.668 INFO:teuthology.orchestra.run.smithi178.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T09:00:30.668 INFO:teuthology.orchestra.run.smithi178.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T09:00:30.668 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:30.668 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:00:31.014 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-test 2024-09-21T09:00:31.309 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 32/34 2024-09-21T09:00:31.335 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 32/34 2024-09-21T09:00:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:00:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T09:00:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T09:00:31.336 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T09:00:31.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:31.339 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T09:00:31.428 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T09:00:31.428 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T09:00:31.594 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:00:27 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:00:31.725 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:00:31.726 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:31.726 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-21T09:00:31.726 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:31.726 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:00:31.726 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 49 M 2024-09-21T09:00:31.726 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-21T09:00:31.726 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 163 k 2024-09-21T09:00:31.726 INFO:teuthology.orchestra.run.smithi178.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T09:00:31.726 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T09:00:31.726 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:31.727 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:00:31.727 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:31.727 INFO:teuthology.orchestra.run.smithi178.stdout:Install 4 Packages 2024-09-21T09:00:31.727 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:31.727 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 49 M 2024-09-21T09:00:31.727 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 209 M 2024-09-21T09:00:31.727 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:00:32.112 INFO:teuthology.orchestra.run.smithi178.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.3 MB/s | 304 kB 00:00 2024-09-21T09:00:32.145 INFO:teuthology.orchestra.run.smithi178.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-09-21T09:00:32.203 INFO:teuthology.orchestra.run.smithi178.stdout:(3/4): libcephsqlite-19.1.1-367.g9e2ac70b.el9.x 736 kB/s | 163 kB 00:00 2024-09-21T09:00:32.668 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T09:00:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/34 2024-09-21T09:00:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/34 2024-09-21T09:00:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/34 2024-09-21T09:00:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/34 2024-09-21T09:00:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 5/34 2024-09-21T09:00:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 6/34 2024-09-21T09:00:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 7/34 2024-09-21T09:00:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-argparse-2:19.1.1-367.g9e2ac70b.el9.x 8/34 2024-09-21T09:00:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86 9/34 2024-09-21T09:00:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 10/34 2024-09-21T09:00:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 11/34 2024-09-21T09:00:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 12/34 2024-09-21T09:00:32.670 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 13/34 2024-09-21T09:00:32.670 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T09:00:32.670 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T09:00:32.670 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T09:00:32.670 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T09:00:32.670 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T09:00:32.670 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T09:00:32.670 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T09:00:32.670 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T09:00:32.670 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T09:00:32.670 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T09:00:32.670 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T09:00:32.670 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T09:00:32.670 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T09:00:32.671 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T09:00:32.671 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T09:00:32.671 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T09:00:32.671 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T09:00:32.671 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 31/34 2024-09-21T09:00:32.671 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T09:00:32.671 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 33/34 2024-09-21T09:00:33.554 INFO:teuthology.orchestra.run.smithi178.stdout:(4/4): ceph-test-19.1.1-367.g9e2ac70b.el9.x86_6 31 MB/s | 49 MB 00:01 2024-09-21T09:00:33.556 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:00:33.556 INFO:teuthology.orchestra.run.smithi178.stdout:Total 27 MB/s | 49 MB 00:01 2024-09-21T09:00:33.584 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:00:33.605 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:00:33.605 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:00:33.845 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T09:00:33.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2024-09-21T09:00:33.845 INFO:teuthology.orchestra.run.smithi044.stdout: librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.845 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.845 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:00:33.845 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T09:00:33.845 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.845 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.846 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.846 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.846 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T09:00:33.846 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T09:00:33.846 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T09:00:33.846 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.846 INFO:teuthology.orchestra.run.smithi044.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T09:00:33.846 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T09:00:33.846 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T09:00:33.846 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.846 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T09:00:33.846 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.846 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T09:00:33.847 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T09:00:33.847 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T09:00:33.847 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.847 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.847 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.847 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T09:00:33.847 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.847 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.847 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:33.847 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T09:00:33.847 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T09:00:33.847 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T09:00:33.847 INFO:teuthology.orchestra.run.smithi044.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T09:00:33.847 INFO:teuthology.orchestra.run.smithi044.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T09:00:33.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:00:33.987 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:00:33.987 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:00:34.222 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-test 2024-09-21T09:00:34.553 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:00:34.649 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T09:00:34.694 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T09:00:34.722 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/4 2024-09-21T09:00:34.817 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:00:30 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:00:34.955 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:00:34.956 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:00:34.956 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-21T09:00:34.956 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:00:34.956 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:00:34.956 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 49 M 2024-09-21T09:00:34.956 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-21T09:00:34.956 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 163 k 2024-09-21T09:00:34.956 INFO:teuthology.orchestra.run.smithi044.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T09:00:34.956 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T09:00:34.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:34.957 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:00:34.957 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:00:34.957 INFO:teuthology.orchestra.run.smithi044.stdout:Install 4 Packages 2024-09-21T09:00:34.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:34.957 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 49 M 2024-09-21T09:00:34.957 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 209 M 2024-09-21T09:00:34.957 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:00:35.299 INFO:teuthology.orchestra.run.smithi044.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-21T09:00:35.324 INFO:teuthology.orchestra.run.smithi044.stdout:(2/4): libcephsqlite-19.1.1-367.g9e2ac70b.el9.x 705 kB/s | 163 kB 00:00 2024-09-21T09:00:35.349 INFO:teuthology.orchestra.run.smithi044.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T09:00:36.633 INFO:teuthology.orchestra.run.smithi044.stdout:(4/4): ceph-test-19.1.1-367.g9e2ac70b.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-21T09:00:36.635 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:00:36.636 INFO:teuthology.orchestra.run.smithi044.stdout:Total 29 MB/s | 49 MB 00:01 2024-09-21T09:00:36.663 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:00:36.686 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:00:36.686 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:00:37.086 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:00:37.087 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:00:37.655 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:00:37.735 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T09:00:37.774 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T09:00:37.801 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/4 2024-09-21T09:00:39.355 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/4 2024-09-21T09:00:39.445 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/4 2024-09-21T09:00:42.019 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/4 2024-09-21T09:00:42.020 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/4 2024-09-21T09:00:42.020 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/4 2024-09-21T09:00:42.020 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T09:00:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T09:00:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:42.316 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:00:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T09:00:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T09:00:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:42.316 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:00:42.579 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph 2024-09-21T09:00:42.657 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/4 2024-09-21T09:00:42.744 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/4 2024-09-21T09:00:43.194 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:00:39 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:00:43.344 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:00:43.347 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:43.347 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-21T09:00:43.347 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:43.347 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:00:43.347 INFO:teuthology.orchestra.run.smithi178.stdout: ceph x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 6.5 k 2024-09-21T09:00:43.347 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-21T09:00:43.347 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 2.4 M 2024-09-21T09:00:43.347 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 1.5 M 2024-09-21T09:00:43.347 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 249 k 2024-09-21T09:00:43.348 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 4.7 M 2024-09-21T09:00:43.348 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 17 M 2024-09-21T09:00:43.348 INFO:teuthology.orchestra.run.smithi178.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T09:00:43.348 INFO:teuthology.orchestra.run.smithi178.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T09:00:43.348 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T09:00:43.348 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T09:00:43.348 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T09:00:43.348 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T09:00:43.348 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T09:00:43.348 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T09:00:43.348 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T09:00:43.348 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T09:00:43.348 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T09:00:43.349 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T09:00:43.350 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T09:00:43.350 INFO:teuthology.orchestra.run.smithi178.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T09:00:43.350 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T09:00:43.350 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T09:00:43.350 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T09:00:43.350 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:43.350 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:00:43.350 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:43.350 INFO:teuthology.orchestra.run.smithi178.stdout:Install 37 Packages 2024-09-21T09:00:43.350 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:43.351 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 30 M 2024-09-21T09:00:43.351 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 108 M 2024-09-21T09:00:43.351 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:00:44.046 INFO:teuthology.orchestra.run.smithi178.stdout:(1/37): ceph-19.1.1-367.g9e2ac70b.el9.x86_64.rp 45 kB/s | 6.5 kB 00:00 2024-09-21T09:00:44.212 INFO:teuthology.orchestra.run.smithi178.stdout:(2/37): ceph-mgr-19.1.1-367.g9e2ac70b.el9.x86_6 4.9 MB/s | 1.5 MB 00:00 2024-09-21T09:00:44.263 INFO:teuthology.orchestra.run.smithi178.stdout:(3/37): ceph-mds-19.1.1-367.g9e2ac70b.el9.x86_6 6.6 MB/s | 2.4 MB 00:00 2024-09-21T09:00:44.355 INFO:teuthology.orchestra.run.smithi178.stdout:(4/37): ceph-mgr-modules-core-19.1.1-367.g9e2ac 2.7 MB/s | 249 kB 00:00 2024-09-21T09:00:44.480 INFO:teuthology.orchestra.run.smithi178.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-21T09:00:44.739 INFO:teuthology.orchestra.run.smithi178.stdout:(6/37): ceph-osd-19.1.1-367.g9e2ac70b.el9.x86_6 32 MB/s | 17 MB 00:00 2024-09-21T09:00:44.772 INFO:teuthology.orchestra.run.smithi178.stdout:(7/37): python3-cryptography-36.0.1-4.el9.x86_6 4.2 MB/s | 1.2 MB 00:00 2024-09-21T09:00:44.815 INFO:teuthology.orchestra.run.smithi178.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-21T09:00:44.856 INFO:teuthology.orchestra.run.smithi178.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 912 kB/s | 106 kB 00:00 2024-09-21T09:00:44.923 INFO:teuthology.orchestra.run.smithi178.stdout:(10/37): ceph-mon-19.1.1-367.g9e2ac70b.el9.x86_ 5.4 MB/s | 4.7 MB 00:00 2024-09-21T09:00:44.949 INFO:teuthology.orchestra.run.smithi178.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 933 kB/s | 125 kB 00:00 2024-09-21T09:00:44.974 INFO:teuthology.orchestra.run.smithi178.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-09-21T09:00:45.041 INFO:teuthology.orchestra.run.smithi178.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 521 kB/s | 35 kB 00:00 2024-09-21T09:00:45.066 INFO:teuthology.orchestra.run.smithi178.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-21T09:00:45.091 INFO:teuthology.orchestra.run.smithi178.stdout:(15/37): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-21T09:00:45.117 INFO:teuthology.orchestra.run.smithi178.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-21T09:00:45.142 INFO:teuthology.orchestra.run.smithi178.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-21T09:00:45.167 INFO:teuthology.orchestra.run.smithi178.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 552 kB/s | 42 kB 00:00 2024-09-21T09:00:45.181 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/4 2024-09-21T09:00:45.181 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/4 2024-09-21T09:00:45.181 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/4 2024-09-21T09:00:45.182 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T09:00:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-21T09:00:45.243 INFO:teuthology.orchestra.run.smithi178.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 5.3 MB/s | 172 kB 00:00 2024-09-21T09:00:45.268 INFO:teuthology.orchestra.run.smithi178.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 434 kB/s | 43 kB 00:00 2024-09-21T09:00:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:(22/37): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-09-21T09:00:45.319 INFO:teuthology.orchestra.run.smithi178.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 212 kB/s | 11 kB 00:00 2024-09-21T09:00:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 896 kB/s | 23 kB 00:00 2024-09-21T09:00:45.377 INFO:teuthology.orchestra.run.smithi178.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 834 kB/s | 19 kB 00:00 2024-09-21T09:00:45.403 INFO:teuthology.orchestra.run.smithi178.stdout:(26/37): python3-jaraco-classes-3.2.1-5.el9.noa 162 kB/s | 18 kB 00:00 2024-09-21T09:00:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-21T09:00:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-21T09:00:45.478 INFO:teuthology.orchestra.run.smithi178.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-09-21T09:00:45.492 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T09:00:45.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:45.492 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:00:45.492 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:45.492 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:45.492 INFO:teuthology.orchestra.run.smithi044.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T09:00:45.492 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T09:00:45.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:45.492 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:00:45.504 INFO:teuthology.orchestra.run.smithi178.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-21T09:00:45.529 INFO:teuthology.orchestra.run.smithi178.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-21T09:00:45.554 INFO:teuthology.orchestra.run.smithi178.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-21T09:00:45.579 INFO:teuthology.orchestra.run.smithi178.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-21T09:00:45.605 INFO:teuthology.orchestra.run.smithi178.stdout:(34/37): python3-tempora-5.0.0-2.el9.noarch.rpm 475 kB/s | 36 kB 00:00 2024-09-21T09:00:45.630 INFO:teuthology.orchestra.run.smithi178.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 804 kB/s | 20 kB 00:00 2024-09-21T09:00:45.656 INFO:teuthology.orchestra.run.smithi178.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T09:00:45.692 INFO:teuthology.orchestra.run.smithi178.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.7 MB/s | 427 kB 00:00 2024-09-21T09:00:45.697 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:00:45.697 INFO:teuthology.orchestra.run.smithi178.stdout:Total 13 MB/s | 30 MB 00:02 2024-09-21T09:00:45.804 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph 2024-09-21T09:00:45.851 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:00:45.891 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:00:45.891 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:00:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:00:46.357 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:00:46.423 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:00:42 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:00:46.565 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:00:46.568 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:00:46.568 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-21T09:00:46.568 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:00:46.568 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:00:46.569 INFO:teuthology.orchestra.run.smithi044.stdout: ceph x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 6.5 k 2024-09-21T09:00:46.569 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-21T09:00:46.569 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 2.4 M 2024-09-21T09:00:46.569 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 1.5 M 2024-09-21T09:00:46.569 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 249 k 2024-09-21T09:00:46.569 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 4.7 M 2024-09-21T09:00:46.569 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 17 M 2024-09-21T09:00:46.569 INFO:teuthology.orchestra.run.smithi044.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T09:00:46.570 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T09:00:46.570 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T09:00:46.570 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T09:00:46.570 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T09:00:46.570 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T09:00:46.570 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T09:00:46.571 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T09:00:46.571 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T09:00:46.571 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T09:00:46.571 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T09:00:46.571 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T09:00:46.571 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T09:00:46.571 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T09:00:46.571 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T09:00:46.572 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T09:00:46.572 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T09:00:46.572 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T09:00:46.572 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T09:00:46.572 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T09:00:46.572 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T09:00:46.572 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T09:00:46.572 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T09:00:46.572 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T09:00:46.573 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T09:00:46.573 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T09:00:46.573 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T09:00:46.573 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T09:00:46.573 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T09:00:46.573 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T09:00:46.573 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T09:00:46.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:46.574 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:00:46.574 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:00:46.574 INFO:teuthology.orchestra.run.smithi044.stdout:Install 37 Packages 2024-09-21T09:00:46.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:46.575 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 30 M 2024-09-21T09:00:46.575 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 108 M 2024-09-21T09:00:46.575 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:00:47.059 INFO:teuthology.orchestra.run.smithi044.stdout:(1/37): ceph-19.1.1-367.g9e2ac70b.el9.x86_64.rp 50 kB/s | 6.5 kB 00:00 2024-09-21T09:00:47.293 INFO:teuthology.orchestra.run.smithi044.stdout:(2/37): ceph-mgr-19.1.1-367.g9e2ac70b.el9.x86_6 4.2 MB/s | 1.5 MB 00:00 2024-09-21T09:00:47.377 INFO:teuthology.orchestra.run.smithi044.stdout:(3/37): ceph-mds-19.1.1-367.g9e2ac70b.el9.x86_6 5.3 MB/s | 2.4 MB 00:00 2024-09-21T09:00:47.427 INFO:teuthology.orchestra.run.smithi044.stdout:(4/37): ceph-mgr-modules-core-19.1.1-367.g9e2ac 4.9 MB/s | 249 kB 00:00 2024-09-21T09:00:47.578 INFO:teuthology.orchestra.run.smithi044.stdout:(5/37): ceph-mon-19.1.1-367.g9e2ac70b.el9.x86_6 9.1 MB/s | 4.7 MB 00:00 2024-09-21T09:00:47.711 INFO:teuthology.orchestra.run.smithi044.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 893 kB/s | 253 kB 00:00 2024-09-21T09:00:47.729 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:00:47.795 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T09:00:47.811 INFO:teuthology.orchestra.run.smithi044.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-21T09:00:47.836 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T09:00:47.853 INFO:teuthology.orchestra.run.smithi044.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 4.5 MB/s | 1.2 MB 00:00 2024-09-21T09:00:47.864 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T09:00:47.904 INFO:teuthology.orchestra.run.smithi044.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-21T09:00:47.929 INFO:teuthology.orchestra.run.smithi044.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 1.1 MB/s | 135 kB 00:00 2024-09-21T09:00:47.935 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T09:00:47.963 INFO:teuthology.orchestra.run.smithi044.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-21T09:00:47.988 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T09:00:48.037 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T09:00:48.130 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T09:00:48.196 INFO:teuthology.orchestra.run.smithi044.stdout:(12/37): ceph-osd-19.1.1-367.g9e2ac70b.el9.x86_ 19 MB/s | 17 MB 00:00 2024-09-21T09:00:48.207 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T09:00:48.222 INFO:teuthology.orchestra.run.smithi044.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 645 kB/s | 188 kB 00:00 2024-09-21T09:00:48.257 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T09:00:48.272 INFO:teuthology.orchestra.run.smithi044.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-21T09:00:48.292 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T09:00:48.297 INFO:teuthology.orchestra.run.smithi044.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 515 kB/s | 172 kB 00:00 2024-09-21T09:00:48.322 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T09:00:48.322 INFO:teuthology.orchestra.run.smithi044.stdout:(16/37): python3-markupsafe-1.1.1-12.el9.x86_64 277 kB/s | 35 kB 00:00 2024-09-21T09:00:48.348 INFO:teuthology.orchestra.run.smithi044.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-21T09:00:48.356 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T09:00:48.373 INFO:teuthology.orchestra.run.smithi044.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 552 kB/s | 42 kB 00:00 2024-09-21T09:00:48.390 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T09:00:48.430 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T09:00:48.432 INFO:teuthology.orchestra.run.smithi044.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-21T09:00:48.457 INFO:teuthology.orchestra.run.smithi044.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-21T09:00:48.473 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T09:00:48.482 INFO:teuthology.orchestra.run.smithi044.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 399 kB/s | 43 kB 00:00 2024-09-21T09:00:48.508 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T09:00:48.516 INFO:teuthology.orchestra.run.smithi044.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-21T09:00:48.544 INFO:teuthology.orchestra.run.smithi044.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 173 kB/s | 11 kB 00:00 2024-09-21T09:00:48.556 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T09:00:48.561 INFO:teuthology.orchestra.run.smithi044.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 408 kB/s | 18 kB 00:00 2024-09-21T09:00:48.586 INFO:teuthology.orchestra.run.smithi044.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 935 kB/s | 23 kB 00:00 2024-09-21T09:00:48.588 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T09:00:48.612 INFO:teuthology.orchestra.run.smithi044.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 389 kB/s | 19 kB 00:00 2024-09-21T09:00:48.657 INFO:teuthology.orchestra.run.smithi044.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.8 MB/s | 358 kB 00:00 2024-09-21T09:00:48.669 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T09:00:48.679 INFO:teuthology.orchestra.run.smithi044.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 213 kB/s | 20 kB 00:00 2024-09-21T09:00:48.696 INFO:teuthology.orchestra.run.smithi044.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 553 kB/s | 46 kB 00:00 2024-09-21T09:00:48.721 INFO:teuthology.orchestra.run.smithi044.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2024-09-21T09:00:48.755 INFO:teuthology.orchestra.run.smithi044.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 280 kB/s | 16 kB 00:00 2024-09-21T09:00:48.780 INFO:teuthology.orchestra.run.smithi044.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-21T09:00:48.797 INFO:teuthology.orchestra.run.smithi044.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 894 kB/s | 36 kB 00:00 2024-09-21T09:00:48.816 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T09:00:48.822 INFO:teuthology.orchestra.run.smithi044.stdout:(34/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 976 kB/s | 90 kB 00:00 2024-09-21T09:00:48.847 INFO:teuthology.orchestra.run.smithi044.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 805 kB/s | 20 kB 00:00 2024-09-21T09:00:48.881 INFO:teuthology.orchestra.run.smithi044.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T09:00:48.906 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T09:00:48.907 INFO:teuthology.orchestra.run.smithi044.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-21T09:00:48.911 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:00:48.911 INFO:teuthology.orchestra.run.smithi044.stdout:Total 13 MB/s | 30 MB 00:02 2024-09-21T09:00:48.958 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T09:00:48.996 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T09:00:49.045 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T09:00:49.068 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:00:49.100 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T09:00:49.113 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:00:49.113 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:00:49.293 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T09:00:49.342 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T09:00:49.420 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T09:00:49.508 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T09:00:49.542 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T09:00:49.616 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:00:49.616 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:00:49.657 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T09:00:49.822 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-367.g9e2ac70b.el9.n 32/37 2024-09-21T09:00:49.860 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 33/37 2024-09-21T09:00:49.886 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 33/37 2024-09-21T09:00:49.887 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:00:49.887 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T09:00:49.887 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T09:00:49.887 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T09:00:49.887 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:50.998 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:00:51.068 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T09:00:51.114 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T09:00:51.153 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T09:00:51.230 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T09:00:51.270 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T09:00:51.303 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T09:00:51.328 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 34/37 2024-09-21T09:00:51.355 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 34/37 2024-09-21T09:00:51.355 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:00:51.355 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T09:00:51.355 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T09:00:51.355 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T09:00:51.355 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:51.399 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T09:00:51.484 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T09:00:51.531 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T09:00:51.565 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T09:00:51.595 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T09:00:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T09:00:51.680 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T09:00:51.731 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T09:00:51.772 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T09:00:51.795 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 35/37 2024-09-21T09:00:51.814 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T09:00:51.819 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 35/37 2024-09-21T09:00:51.819 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:00:51.819 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T09:00:51.819 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T09:00:51.819 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T09:00:51.820 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:51.873 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T09:00:51.912 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T09:00:51.989 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T09:00:52.046 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 36/37 2024-09-21T09:00:52.070 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 36/37 2024-09-21T09:00:52.070 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:00:52.070 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T09:00:52.070 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T09:00:52.070 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T09:00:52.070 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:52.141 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T09:00:52.159 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 37/37 2024-09-21T09:00:52.234 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T09:00:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T09:00:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T09:00:52.396 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T09:00:52.460 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T09:00:52.659 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T09:00:52.717 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T09:00:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T09:00:52.898 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T09:00:52.932 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T09:00:53.057 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T09:00:53.220 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-367.g9e2ac70b.el9.n 32/37 2024-09-21T09:00:53.259 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 33/37 2024-09-21T09:00:53.286 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 33/37 2024-09-21T09:00:53.286 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:00:53.286 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T09:00:53.286 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T09:00:53.286 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T09:00:53.287 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:53.774 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 37/37 2024-09-21T09:00:53.774 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/37 2024-09-21T09:00:53.774 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/37 2024-09-21T09:00:53.774 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/37 2024-09-21T09:00:53.774 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/37 2024-09-21T09:00:53.774 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 5/37 2024-09-21T09:00:53.774 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-367.g9e2ac70b.el9.n 6/37 2024-09-21T09:00:53.775 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T09:00:53.775 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T09:00:53.775 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T09:00:53.775 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T09:00:53.775 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T09:00:53.775 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T09:00:53.775 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T09:00:53.775 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T09:00:53.775 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T09:00:53.775 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T09:00:53.775 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T09:00:53.775 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T09:00:53.775 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T09:00:53.776 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T09:00:53.776 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T09:00:53.777 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T09:00:53.777 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T09:00:53.778 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T09:00:53.778 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T09:00:53.779 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T09:00:53.779 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T09:00:53.779 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T09:00:53.779 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T09:00:53.779 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T09:00:53.779 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T09:00:53.779 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T09:00:53.779 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T09:00:53.780 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T09:00:53.780 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T09:00:53.780 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T09:00:54.784 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T09:00:54.784 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:54.784 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:00:54.784 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:54.784 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:54.784 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:54.784 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:00:54.784 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:54.784 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:54.784 INFO:teuthology.orchestra.run.smithi178.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T09:00:54.785 INFO:teuthology.orchestra.run.smithi178.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T09:00:54.785 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T09:00:54.785 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T09:00:54.785 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T09:00:54.785 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T09:00:54.785 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T09:00:54.785 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T09:00:54.785 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T09:00:54.785 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T09:00:54.785 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T09:00:54.785 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T09:00:54.785 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T09:00:54.785 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T09:00:54.786 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T09:00:54.786 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T09:00:54.786 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T09:00:54.786 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T09:00:54.786 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T09:00:54.786 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T09:00:54.786 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T09:00:54.786 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T09:00:54.786 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T09:00:54.786 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T09:00:54.786 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T09:00:54.786 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T09:00:54.786 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T09:00:54.787 INFO:teuthology.orchestra.run.smithi178.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T09:00:54.787 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T09:00:54.787 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T09:00:54.787 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T09:00:54.787 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:54.787 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:00:54.818 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 34/37 2024-09-21T09:00:54.847 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 34/37 2024-09-21T09:00:54.847 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:00:54.847 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T09:00:54.847 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T09:00:54.847 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T09:00:54.847 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:55.156 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-base 2024-09-21T09:00:55.511 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 35/37 2024-09-21T09:00:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 35/37 2024-09-21T09:00:55.536 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:00:55.536 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T09:00:55.536 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T09:00:55.536 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T09:00:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:55.741 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:00:51 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:00:55.778 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 36/37 2024-09-21T09:00:55.803 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 36/37 2024-09-21T09:00:55.803 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:00:55.803 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T09:00:55.803 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T09:00:55.803 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T09:00:55.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:55.829 INFO:teuthology.orchestra.run.smithi178.stdout:Package ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:00:55.870 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 37/37 2024-09-21T09:00:55.873 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:00:55.874 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-21T09:00:55.874 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:00:55.950 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install cephadm 2024-09-21T09:00:56.527 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:00:52 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:00:56.658 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:00:56.659 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:56.659 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-21T09:00:56.659 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:56.659 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:00:56.659 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 765 k 2024-09-21T09:00:56.659 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:56.659 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:00:56.660 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:56.660 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-21T09:00:56.660 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:56.660 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 765 k 2024-09-21T09:00:56.660 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 771 k 2024-09-21T09:00:56.660 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:00:56.921 INFO:teuthology.orchestra.run.smithi178.stdout:cephadm-19.1.1-367.g9e2ac70b.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-21T09:00:56.922 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:00:56.922 INFO:teuthology.orchestra.run.smithi178.stdout:Total 2.8 MB/s | 765 kB 00:00 2024-09-21T09:00:56.922 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:00:56.928 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:00:56.928 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:00:56.934 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:00:56.934 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:00:57.007 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:00:57.462 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T09:00:57.550 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T09:00:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 37/37 2024-09-21T09:00:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/37 2024-09-21T09:00:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/37 2024-09-21T09:00:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/37 2024-09-21T09:00:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/37 2024-09-21T09:00:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 5/37 2024-09-21T09:00:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-367.g9e2ac70b.el9.n 6/37 2024-09-21T09:00:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T09:00:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T09:00:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T09:00:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T09:00:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T09:00:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T09:00:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T09:00:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T09:00:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T09:00:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T09:00:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T09:00:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T09:00:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T09:00:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T09:00:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T09:00:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T09:00:57.919 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T09:00:58.120 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T09:00:58.121 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:58.121 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:00:58.121 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:00:58.121 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:58.121 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:00:58.317 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T09:00:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T09:00:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:58.626 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:00:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:00:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:00:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T09:00:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T09:00:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T09:00:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T09:00:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T09:00:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T09:00:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T09:00:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T09:00:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T09:00:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T09:00:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T09:00:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T09:00:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T09:00:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T09:00:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T09:00:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T09:00:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T09:00:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T09:00:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T09:00:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T09:00:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T09:00:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T09:00:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T09:00:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T09:00:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T09:00:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T09:00:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T09:00:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T09:00:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T09:00:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T09:00:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T09:00:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:00:58.629 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:00:58.915 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:00:54 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:00:58.989 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-base 2024-09-21T09:00:59.054 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:00:59.061 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:59.061 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repo Size 2024-09-21T09:00:59.061 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:59.061 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:00:59.062 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 145 k 2024-09-21T09:00:59.062 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:59.062 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:00:59.062 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:00:59.062 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-21T09:00:59.062 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:59.062 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 145 k 2024-09-21T09:00:59.062 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 436 k 2024-09-21T09:00:59.062 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:00:59.252 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-immutable-object-cache-19.1.1-367.g9e2ac70 737 kB/s | 145 kB 00:00 2024-09-21T09:00:59.252 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:00:59.252 INFO:teuthology.orchestra.run.smithi178.stdout:Total 732 kB/s | 145 kB 00:00 2024-09-21T09:00:59.253 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:00:59.260 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:00:59.260 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:00:59.322 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:00:59.323 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:00:59.472 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:00:59.528 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.e 1/1 2024-09-21T09:00:59.554 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.e 1/1 2024-09-21T09:00:59.554 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:00:59.554 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T09:00:59.554 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:00:59.594 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:00:59.686 INFO:teuthology.orchestra.run.smithi044.stdout:Package ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:00:59.732 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:00:59.733 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-09-21T09:00:59.733 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:00:59.804 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install cephadm 2024-09-21T09:01:00.409 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:00.518 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.e 1/1 2024-09-21T09:01:00.518 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:00.518 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:01:00.518 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:01:00.518 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:00.518 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:00.544 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:01:00.545 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-21T09:01:00.545 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:00.545 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:01:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 765 k 2024-09-21T09:01:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:00.545 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:01:00.545 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:00.545 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-09-21T09:01:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:00.546 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 765 k 2024-09-21T09:01:00.546 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 771 k 2024-09-21T09:01:00.546 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:01:00.747 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr 2024-09-21T09:01:00.812 INFO:teuthology.orchestra.run.smithi044.stdout:cephadm-19.1.1-367.g9e2ac70b.el9.noarch.rpm 2.8 MB/s | 765 kB 00:00 2024-09-21T09:01:00.812 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:00.813 INFO:teuthology.orchestra.run.smithi044.stdout:Total 2.8 MB/s | 765 kB 00:00 2024-09-21T09:01:00.813 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:01:00.819 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:01:00.819 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:01:00.825 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:01:00.825 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:01:00.903 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:01:01.350 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:00:57 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:01.406 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T09:01:01.440 INFO:teuthology.orchestra.run.smithi178.stdout:Package ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:01:01.482 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:01.483 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-21T09:01:01.483 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T09:01:01.555 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T09:01:01.882 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T09:01:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T09:01:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:02.125 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:01:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:02.125 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:01:02.134 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:02.269 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:02.270 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:02.270 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-21T09:01:02.270 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:02.270 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:01:02.271 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 3.6 M 2024-09-21T09:01:02.271 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-21T09:01:02.271 INFO:teuthology.orchestra.run.smithi178.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T09:01:02.271 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 32 k 2024-09-21T09:01:02.271 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 16 k 2024-09-21T09:01:02.271 INFO:teuthology.orchestra.run.smithi178.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T09:01:02.271 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T09:01:02.271 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T09:01:02.271 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T09:01:02.271 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T09:01:02.271 INFO:teuthology.orchestra.run.smithi178.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T09:01:02.271 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T09:01:02.271 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T09:01:02.272 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:02.272 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:01:02.272 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:02.272 INFO:teuthology.orchestra.run.smithi178.stdout:Install 12 Packages 2024-09-21T09:01:02.272 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:02.272 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 8.7 M 2024-09-21T09:01:02.272 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 105 M 2024-09-21T09:01:02.272 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:01:02.350 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T09:01:02.755 INFO:teuthology.orchestra.run.smithi178.stdout:(1/12): ceph-grafana-dashboards-19.1.1-367.g9e2 211 kB/s | 32 kB 00:00 2024-09-21T09:01:02.780 INFO:teuthology.orchestra.run.smithi178.stdout:(2/12): ceph-prometheus-alerts-19.1.1-367.g9e2a 94 kB/s | 16 kB 00:00 2024-09-21T09:01:02.964 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:03.014 INFO:teuthology.orchestra.run.smithi178.stdout:(3/12): ceph-mgr-dashboard-19.1.1-367.g9e2ac70b 8.7 MB/s | 3.6 MB 00:00 2024-09-21T09:01:03.102 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:01:03.103 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:03.103 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repo Size 2024-09-21T09:01:03.103 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:03.103 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:01:03.103 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 145 k 2024-09-21T09:01:03.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:03.103 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:01:03.103 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:03.103 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-09-21T09:01:03.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:03.104 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 145 k 2024-09-21T09:01:03.104 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 436 k 2024-09-21T09:01:03.104 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:01:03.297 INFO:teuthology.orchestra.run.smithi178.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.0 MB/s | 863 kB 00:00 2024-09-21T09:01:03.310 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-immutable-object-cache-19.1.1-367.g9e2ac70 705 kB/s | 145 kB 00:00 2024-09-21T09:01:03.311 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:03.311 INFO:teuthology.orchestra.run.smithi044.stdout:Total 699 kB/s | 145 kB 00:00 2024-09-21T09:01:03.312 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:01:03.320 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:01:03.320 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:01:03.347 INFO:teuthology.orchestra.run.smithi178.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-21T09:01:03.373 INFO:teuthology.orchestra.run.smithi178.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 773 kB/s | 19 kB 00:00 2024-09-21T09:01:03.386 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:01:03.386 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:01:03.439 INFO:teuthology.orchestra.run.smithi178.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-21T09:01:03.465 INFO:teuthology.orchestra.run.smithi178.stdout:(8/12): python3-protobuf-3.14.0-13.el9.noarch.r 393 kB/s | 269 kB 00:00 2024-09-21T09:01:03.499 INFO:teuthology.orchestra.run.smithi178.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.4 MB/s | 144 kB 00:00 2024-09-21T09:01:03.524 INFO:teuthology.orchestra.run.smithi178.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 8.0 MB/s | 188 kB 00:00 2024-09-21T09:01:03.538 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:01:03.558 INFO:teuthology.orchestra.run.smithi178.stdout:(11/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.3 MB/s | 1.0 MB 00:00 2024-09-21T09:01:03.583 INFO:teuthology.orchestra.run.smithi178.stdout:(12/12): python3-repoze-lru-0.7-16.el9.noarch.r 261 kB/s | 31 kB 00:00 2024-09-21T09:01:03.586 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:03.586 INFO:teuthology.orchestra.run.smithi178.stdout:Total 6.6 MB/s | 8.7 MB 00:01 2024-09-21T09:01:03.611 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.e 1/1 2024-09-21T09:01:03.635 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:01:03.639 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.e 1/1 2024-09-21T09:01:03.639 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:01:03.639 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T09:01:03.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:03.652 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:01:03.652 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:01:03.868 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:01:03.868 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:01:04.400 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:01:04.475 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T09:01:04.519 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T09:01:04.537 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.e 1/1 2024-09-21T09:01:04.537 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:04.538 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:01:04.538 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:01:04.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:04.538 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:01:04.566 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T09:01:04.596 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T09:01:04.696 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T09:01:04.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-mgr 2024-09-21T09:01:04.841 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T09:01:04.932 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T09:01:04.979 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T09:01:05.004 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T09:01:05.035 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-367.g9e2ac70b.el9. 10/12 2024-09-21T09:01:05.372 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:01 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:05.465 INFO:teuthology.orchestra.run.smithi044.stdout:Package ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:01:05.509 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:01:05.510 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-09-21T09:01:05.511 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:01:05.587 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T09:01:06.095 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-367.g9e2ac70b.el9 11/12 2024-09-21T09:01:06.128 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noar 12/12 2024-09-21T09:01:06.191 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:02 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:06.328 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:01:06.330 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-21T09:01:06.330 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:06.330 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:01:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 3.6 M 2024-09-21T09:01:06.330 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-21T09:01:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T09:01:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 32 k 2024-09-21T09:01:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 16 k 2024-09-21T09:01:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T09:01:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T09:01:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T09:01:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T09:01:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T09:01:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T09:01:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T09:01:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T09:01:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:06.331 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:01:06.331 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:06.331 INFO:teuthology.orchestra.run.smithi044.stdout:Install 12 Packages 2024-09-21T09:01:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:06.332 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 8.7 M 2024-09-21T09:01:06.332 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 105 M 2024-09-21T09:01:06.332 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:01:06.805 INFO:teuthology.orchestra.run.smithi044.stdout:(1/12): ceph-grafana-dashboards-19.1.1-367.g9e2 220 kB/s | 32 kB 00:00 2024-09-21T09:01:06.831 INFO:teuthology.orchestra.run.smithi044.stdout:(2/12): ceph-prometheus-alerts-19.1.1-367.g9e2a 97 kB/s | 16 kB 00:00 2024-09-21T09:01:06.964 INFO:teuthology.orchestra.run.smithi044.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.0 MB/s | 269 kB 00:00 2024-09-21T09:01:07.023 INFO:teuthology.orchestra.run.smithi044.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-21T09:01:07.123 INFO:teuthology.orchestra.run.smithi044.stdout:(5/12): ceph-mgr-dashboard-19.1.1-367.g9e2ac70b 7.7 MB/s | 3.6 MB 00:00 2024-09-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi044.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.0 MB/s | 548 kB 00:00 2024-09-21T09:01:07.182 INFO:teuthology.orchestra.run.smithi044.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 334 kB/s | 19 kB 00:00 2024-09-21T09:01:07.225 INFO:teuthology.orchestra.run.smithi044.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 3.4 MB/s | 144 kB 00:00 2024-09-21T09:01:07.249 INFO:teuthology.orchestra.run.smithi044.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-21T09:01:07.274 INFO:teuthology.orchestra.run.smithi044.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-21T09:01:07.316 INFO:teuthology.orchestra.run.smithi044.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 13 MB/s | 2.0 MB 00:00 2024-09-21T09:01:07.324 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noar 12/12 2024-09-21T09:01:07.324 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-367.g9e2ac70b.el9 1/12 2024-09-21T09:01:07.324 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noar 2/12 2024-09-21T09:01:07.324 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-367.g9e2ac70b.el9. 3/12 2024-09-21T09:01:07.324 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T09:01:07.324 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T09:01:07.324 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T09:01:07.325 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T09:01:07.325 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T09:01:07.325 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T09:01:07.325 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T09:01:07.325 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T09:01:07.626 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T09:01:07.626 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:07.626 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:01:07.626 INFO:teuthology.orchestra.run.smithi178.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T09:01:07.627 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:07.627 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:07.627 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:07.627 INFO:teuthology.orchestra.run.smithi178.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T09:01:07.627 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T09:01:07.627 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T09:01:07.627 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T09:01:07.627 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T09:01:07.627 INFO:teuthology.orchestra.run.smithi178.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T09:01:07.627 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T09:01:07.627 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T09:01:07.627 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:07.627 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:07.900 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T09:01:07.966 INFO:teuthology.orchestra.run.smithi044.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 862 kB/s | 863 kB 00:01 2024-09-21T09:01:07.972 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:07.972 INFO:teuthology.orchestra.run.smithi044.stdout:Total 5.3 MB/s | 8.7 MB 00:01 2024-09-21T09:01:08.026 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:01:08.046 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:01:08.046 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:01:08.252 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:01:08.252 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:01:08.479 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:04 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:08.612 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:08.613 INFO:teuthology.orchestra.run.smithi178.stdout:====================================================================================== 2024-09-21T09:01:08.613 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-21T09:01:08.613 INFO:teuthology.orchestra.run.smithi178.stdout:====================================================================================== 2024-09-21T09:01:08.613 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:01:08.613 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 7.4 M 2024-09-21T09:01:08.614 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-21T09:01:08.614 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T09:01:08.614 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T09:01:08.614 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T09:01:08.614 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T09:01:08.614 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T09:01:08.614 INFO:teuthology.orchestra.run.smithi178.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T09:01:08.614 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T09:01:08.614 INFO:teuthology.orchestra.run.smithi178.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T09:01:08.614 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T09:01:08.614 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T09:01:08.614 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T09:01:08.614 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:08.614 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:01:08.615 INFO:teuthology.orchestra.run.smithi178.stdout:====================================================================================== 2024-09-21T09:01:08.615 INFO:teuthology.orchestra.run.smithi178.stdout:Install 12 Packages 2024-09-21T09:01:08.615 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:08.615 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 38 M 2024-09-21T09:01:08.615 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 212 M 2024-09-21T09:01:08.615 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:01:08.798 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:01:08.876 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T09:01:08.920 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T09:01:08.975 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T09:01:09.013 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T09:01:09.105 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T09:01:09.246 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T09:01:09.345 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T09:01:09.394 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T09:01:09.421 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T09:01:09.453 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-367.g9e2ac70b.el9. 10/12 2024-09-21T09:01:09.474 INFO:teuthology.orchestra.run.smithi178.stdout:(1/12): ceph-mgr-diskprediction-local-19.1.1-36 16 MB/s | 7.4 MB 00:00 2024-09-21T09:01:09.582 INFO:teuthology.orchestra.run.smithi178.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 303 kB/s | 33 kB 00:00 2024-09-21T09:01:09.733 INFO:teuthology.orchestra.run.smithi178.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 20 MB/s | 3.0 MB 00:00 2024-09-21T09:01:09.799 INFO:teuthology.orchestra.run.smithi178.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 274 kB/s | 18 kB 00:00 2024-09-21T09:01:09.875 INFO:teuthology.orchestra.run.smithi178.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 515 kB/s | 38 kB 00:00 2024-09-21T09:01:09.933 INFO:teuthology.orchestra.run.smithi178.stdout:(6/12): libquadmath-11.5.0-2.el9.x86_64.rpm 205 kB/s | 191 kB 00:00 2024-09-21T09:01:10.025 INFO:teuthology.orchestra.run.smithi178.stdout:(7/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 33 MB/s | 4.9 MB 00:00 2024-09-21T09:01:10.075 INFO:teuthology.orchestra.run.smithi178.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-21T09:01:10.159 INFO:teuthology.orchestra.run.smithi178.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-09-21T09:01:10.184 INFO:teuthology.orchestra.run.smithi178.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.3 MB/s | 250 kB 00:00 2024-09-21T09:01:10.426 INFO:teuthology.orchestra.run.smithi178.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 61 MB/s | 16 MB 00:00 2024-09-21T09:01:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-367.g9e2ac70b.el9 11/12 2024-09-21T09:01:10.609 INFO:teuthology.orchestra.run.smithi178.stdout:(12/12): libgfortran-11.5.0-2.el9.x86_64.rpm 498 kB/s | 801 kB 00:01 2024-09-21T09:01:10.611 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:10.611 INFO:teuthology.orchestra.run.smithi178.stdout:Total 19 MB/s | 38 MB 00:01 2024-09-21T09:01:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noar 12/12 2024-09-21T09:01:10.971 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:01:10.996 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:01:10.997 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:01:11.425 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:01:11.426 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:01:11.971 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noar 12/12 2024-09-21T09:01:11.971 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-367.g9e2ac70b.el9 1/12 2024-09-21T09:01:11.971 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noar 2/12 2024-09-21T09:01:11.971 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-367.g9e2ac70b.el9. 3/12 2024-09-21T09:01:11.971 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T09:01:11.971 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T09:01:11.972 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T09:01:11.972 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T09:01:11.972 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T09:01:11.972 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T09:01:11.972 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T09:01:11.972 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T09:01:12.188 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:01:12.260 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T09:01:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T09:01:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:12.300 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:01:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T09:01:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T09:01:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T09:01:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T09:01:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T09:01:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T09:01:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T09:01:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T09:01:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T09:01:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:12.301 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:01:12.302 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T09:01:12.397 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T09:01:12.434 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T09:01:12.515 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T09:01:12.617 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T09:01:12.649 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T09:01:12.733 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T09:01:13.123 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:09 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:13.262 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:01:13.263 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-09-21T09:01:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-21T09:01:13.264 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-09-21T09:01:13.264 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:01:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 7.4 M 2024-09-21T09:01:13.264 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-21T09:01:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T09:01:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T09:01:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T09:01:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T09:01:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T09:01:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T09:01:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T09:01:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T09:01:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T09:01:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T09:01:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T09:01:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:13.265 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:01:13.265 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-09-21T09:01:13.265 INFO:teuthology.orchestra.run.smithi044.stdout:Install 12 Packages 2024-09-21T09:01:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:13.266 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 38 M 2024-09-21T09:01:13.266 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 212 M 2024-09-21T09:01:13.266 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:01:13.377 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T09:01:13.486 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T09:01:13.683 INFO:teuthology.orchestra.run.smithi044.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-21T09:01:13.725 INFO:teuthology.orchestra.run.smithi044.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.4 MB/s | 801 kB 00:00 2024-09-21T09:01:13.750 INFO:teuthology.orchestra.run.smithi044.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-21T09:01:13.792 INFO:teuthology.orchestra.run.smithi044.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 440 kB/s | 18 kB 00:00 2024-09-21T09:01:13.834 INFO:teuthology.orchestra.run.smithi044.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 926 kB/s | 38 kB 00:00 2024-09-21T09:01:14.068 INFO:teuthology.orchestra.run.smithi044.stdout:(6/12): ceph-mgr-diskprediction-local-19.1.1-36 14 MB/s | 7.4 MB 00:00 2024-09-21T09:01:14.201 INFO:teuthology.orchestra.run.smithi044.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-21T09:01:14.468 INFO:teuthology.orchestra.run.smithi044.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.0 MB/s | 3.0 MB 00:00 2024-09-21T09:01:14.552 INFO:teuthology.orchestra.run.smithi044.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-21T09:01:14.725 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T09:01:15.077 INFO:teuthology.orchestra.run.smithi044.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.0 MB/s | 4.9 MB 00:01 2024-09-21T09:01:15.385 INFO:teuthology.orchestra.run.smithi044.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.3 MB/s | 5.1 MB 00:01 2024-09-21T09:01:15.743 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T09:01:15.773 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac7 12/12 2024-09-21T09:01:18.406 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac7 12/12 2024-09-21T09:01:18.406 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac7 1/12 2024-09-21T09:01:18.406 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T09:01:18.406 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T09:01:18.406 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T09:01:18.406 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T09:01:18.406 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T09:01:18.406 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T09:01:18.406 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T09:01:18.407 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T09:01:18.407 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T09:01:18.407 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T09:01:18.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T09:01:18.791 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:18.791 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:01:18.791 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:18.791 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T09:01:18.791 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T09:01:18.791 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T09:01:18.791 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T09:01:18.791 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T09:01:18.792 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T09:01:18.792 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T09:01:18.792 INFO:teuthology.orchestra.run.smithi178.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T09:01:18.792 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T09:01:18.792 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T09:01:18.792 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T09:01:18.792 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:18.792 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:18.835 INFO:teuthology.orchestra.run.smithi044.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-21T09:01:18.836 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:18.837 INFO:teuthology.orchestra.run.smithi044.stdout:Total 6.9 MB/s | 38 MB 00:05 2024-09-21T09:01:19.201 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr-rook 2024-09-21T09:01:19.209 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:01:19.237 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:01:19.237 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:01:19.697 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:01:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:01:19.788 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:15 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:19.921 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:19.923 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:19.923 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-21T09:01:19.923 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:19.923 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:01:19.923 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 49 k 2024-09-21T09:01:19.923 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-21T09:01:19.923 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T09:01:19.923 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T09:01:19.923 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T09:01:19.923 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T09:01:19.924 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T09:01:19.924 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T09:01:19.924 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T09:01:19.924 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T09:01:19.924 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T09:01:19.924 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T09:01:19.924 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T09:01:19.924 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T09:01:19.924 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:19.924 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:01:19.924 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:19.924 INFO:teuthology.orchestra.run.smithi178.stdout:Install 13 Packages 2024-09-21T09:01:19.924 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:19.925 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 2.2 M 2024-09-21T09:01:19.925 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 26 M 2024-09-21T09:01:19.925 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:01:20.123 INFO:teuthology.orchestra.run.smithi178.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 158 kB/s | 19 kB 00:00 2024-09-21T09:01:20.140 INFO:teuthology.orchestra.run.smithi178.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 185 kB/s | 26 kB 00:00 2024-09-21T09:01:20.157 INFO:teuthology.orchestra.run.smithi178.stdout:(3/13): ceph-mgr-rook-19.1.1-367.g9e2ac70b.el9. 317 kB/s | 49 kB 00:00 2024-09-21T09:01:20.266 INFO:teuthology.orchestra.run.smithi178.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-09-21T09:01:20.291 INFO:teuthology.orchestra.run.smithi178.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-09-21T09:01:20.325 INFO:teuthology.orchestra.run.smithi178.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 914 kB/s | 54 kB 00:00 2024-09-21T09:01:20.359 INFO:teuthology.orchestra.run.smithi178.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-21T09:01:20.383 INFO:teuthology.orchestra.run.smithi178.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-21T09:01:20.409 INFO:teuthology.orchestra.run.smithi178.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 172 kB/s | 14 kB 00:00 2024-09-21T09:01:20.443 INFO:teuthology.orchestra.run.smithi178.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-21T09:01:20.468 INFO:teuthology.orchestra.run.smithi178.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-21T09:01:20.490 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:01:20.493 INFO:teuthology.orchestra.run.smithi178.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 3.7 MB/s | 90 kB 00:00 2024-09-21T09:01:20.535 INFO:teuthology.orchestra.run.smithi178.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-21T09:01:20.537 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:20.538 INFO:teuthology.orchestra.run.smithi178.stdout:Total 3.6 MB/s | 2.2 MB 00:00 2024-09-21T09:01:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T09:01:20.601 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:01:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T09:01:20.616 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:01:20.616 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:01:20.706 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:01:20.707 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:01:20.712 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T09:01:20.760 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T09:01:20.960 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T09:01:20.992 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T09:01:21.078 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T09:01:21.222 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:01:21.401 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T09:01:21.470 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T09:01:21.525 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T09:01:21.562 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T09:01:21.603 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T09:01:21.715 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T09:01:21.769 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T09:01:21.825 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T09:01:21.880 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T09:01:21.891 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T09:01:22.608 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T09:01:22.669 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T09:01:22.702 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T09:01:22.751 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T09:01:22.780 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 13/13 2024-09-21T09:01:23.206 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T09:01:23.609 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 13/13 2024-09-21T09:01:23.610 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 1/13 2024-09-21T09:01:23.610 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T09:01:23.610 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T09:01:23.610 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T09:01:23.610 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T09:01:23.610 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T09:01:23.610 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T09:01:23.610 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T09:01:23.610 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T09:01:23.610 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T09:01:23.610 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T09:01:23.610 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T09:01:23.930 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T09:01:23.930 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:23.930 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:01:23.930 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:23.931 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T09:01:23.931 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T09:01:23.931 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T09:01:23.931 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T09:01:23.931 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T09:01:23.931 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T09:01:23.931 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T09:01:23.931 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T09:01:23.931 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T09:01:23.931 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T09:01:23.931 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T09:01:23.931 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T09:01:23.931 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:23.931 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:24.217 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T09:01:24.281 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T09:01:24.307 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac7 12/12 2024-09-21T09:01:24.800 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:20 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:24.932 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:24.932 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:24.933 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-21T09:01:24.933 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:24.933 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:01:24.933 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 146 k 2024-09-21T09:01:24.933 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-21T09:01:24.933 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T09:01:24.933 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T09:01:24.933 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T09:01:24.933 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T09:01:24.933 INFO:teuthology.orchestra.run.smithi178.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T09:01:24.934 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:24.934 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:01:24.934 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:24.934 INFO:teuthology.orchestra.run.smithi178.stdout:Install 6 Packages 2024-09-21T09:01:24.934 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:24.934 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 7.0 M 2024-09-21T09:01:24.934 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 33 M 2024-09-21T09:01:24.935 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:01:25.345 INFO:teuthology.orchestra.run.smithi178.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-09-21T09:01:25.395 INFO:teuthology.orchestra.run.smithi178.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-21T09:01:25.420 INFO:teuthology.orchestra.run.smithi178.stdout:(3/6): ceph-mgr-cephadm-19.1.1-367.g9e2ac70b.el 695 kB/s | 146 kB 00:00 2024-09-21T09:01:25.446 INFO:teuthology.orchestra.run.smithi178.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T09:01:25.488 INFO:teuthology.orchestra.run.smithi178.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-21T09:01:25.571 INFO:teuthology.orchestra.run.smithi178.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-21T09:01:25.573 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:25.574 INFO:teuthology.orchestra.run.smithi178.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-21T09:01:25.644 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:01:25.655 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:01:25.655 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:01:25.755 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:01:25.756 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:01:26.053 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:01:26.211 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T09:01:26.264 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T09:01:26.784 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T09:01:26.860 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac7 12/12 2024-09-21T09:01:26.860 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac7 1/12 2024-09-21T09:01:26.860 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T09:01:26.860 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T09:01:26.860 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T09:01:26.860 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T09:01:26.860 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T09:01:26.860 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T09:01:26.860 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T09:01:26.860 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T09:01:26.860 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T09:01:26.860 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T09:01:26.867 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T09:01:26.931 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T09:01:26.960 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 6/6 2024-09-21T09:01:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T09:01:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:27.267 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:01:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T09:01:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T09:01:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T09:01:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T09:01:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T09:01:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T09:01:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T09:01:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T09:01:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T09:01:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T09:01:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T09:01:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:27.268 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:01:27.638 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-mgr-rook 2024-09-21T09:01:27.851 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 6/6 2024-09-21T09:01:27.851 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/6 2024-09-21T09:01:27.851 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T09:01:27.851 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T09:01:27.852 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T09:01:27.852 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T09:01:28.131 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T09:01:28.131 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:28.131 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:01:28.131 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:28.131 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T09:01:28.131 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T09:01:28.131 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T09:01:28.132 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T09:01:28.132 INFO:teuthology.orchestra.run.smithi178.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T09:01:28.132 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:28.132 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:28.243 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:24 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:28.380 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:01:28.382 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:28.382 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-21T09:01:28.382 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:28.382 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:01:28.382 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 49 k 2024-09-21T09:01:28.382 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-21T09:01:28.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T09:01:28.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T09:01:28.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T09:01:28.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T09:01:28.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T09:01:28.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T09:01:28.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T09:01:28.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T09:01:28.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T09:01:28.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T09:01:28.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T09:01:28.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T09:01:28.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:28.383 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:01:28.383 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:28.383 INFO:teuthology.orchestra.run.smithi044.stdout:Install 13 Packages 2024-09-21T09:01:28.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:28.384 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 2.2 M 2024-09-21T09:01:28.384 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 26 M 2024-09-21T09:01:28.384 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:01:28.387 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-fuse 2024-09-21T09:01:28.658 INFO:teuthology.orchestra.run.smithi044.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 217 kB/s | 19 kB 00:00 2024-09-21T09:01:28.684 INFO:teuthology.orchestra.run.smithi044.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 226 kB/s | 26 kB 00:00 2024-09-21T09:01:28.742 INFO:teuthology.orchestra.run.smithi044.stdout:(3/13): ceph-mgr-rook-19.1.1-367.g9e2ac70b.el9. 286 kB/s | 49 kB 00:00 2024-09-21T09:01:28.767 INFO:teuthology.orchestra.run.smithi044.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-21T09:01:28.793 INFO:teuthology.orchestra.run.smithi044.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-21T09:01:28.834 INFO:teuthology.orchestra.run.smithi044.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 806 kB/s | 54 kB 00:00 2024-09-21T09:01:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 482 kB/s | 32 kB 00:00 2024-09-21T09:01:28.893 INFO:teuthology.orchestra.run.smithi044.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 8.3 MB/s | 220 kB 00:00 2024-09-21T09:01:28.919 INFO:teuthology.orchestra.run.smithi044.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 168 kB/s | 14 kB 00:00 2024-09-21T09:01:28.944 INFO:teuthology.orchestra.run.smithi044.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.4 MB/s | 279 kB 00:00 2024-09-21T09:01:28.969 INFO:teuthology.orchestra.run.smithi044.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-21T09:01:28.970 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:24 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:29.019 INFO:teuthology.orchestra.run.smithi044.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 8.3 MB/s | 1.0 MB 00:00 2024-09-21T09:01:29.044 INFO:teuthology.orchestra.run.smithi044.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 894 kB/s | 90 kB 00:00 2024-09-21T09:01:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:29.047 INFO:teuthology.orchestra.run.smithi044.stdout:Total 3.3 MB/s | 2.2 MB 00:00 2024-09-21T09:01:29.104 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:29.105 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:29.105 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-21T09:01:29.105 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:29.105 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:01:29.105 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 896 k 2024-09-21T09:01:29.105 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-21T09:01:29.105 INFO:teuthology.orchestra.run.smithi178.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T09:01:29.106 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:29.106 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:01:29.106 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:29.106 INFO:teuthology.orchestra.run.smithi178.stdout:Install 2 Packages 2024-09-21T09:01:29.106 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:29.106 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 976 k 2024-09-21T09:01:29.106 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 2.9 M 2024-09-21T09:01:29.107 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:01:29.113 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:01:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:01:29.130 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:01:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:01:29.229 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:01:29.356 INFO:teuthology.orchestra.run.smithi178.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 627 kB/s | 80 kB 00:00 2024-09-21T09:01:29.531 INFO:teuthology.orchestra.run.smithi178.stdout:(2/2): ceph-fuse-19.1.1-367.g9e2ac70b.el9.x86_6 2.9 MB/s | 896 kB 00:00 2024-09-21T09:01:29.532 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:29.532 INFO:teuthology.orchestra.run.smithi178.stdout:Total 2.2 MB/s | 976 kB 00:00 2024-09-21T09:01:29.543 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:01:29.564 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:01:29.564 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:01:29.645 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:01:29.645 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:01:29.762 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:01:29.855 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:01:29.937 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T09:01:29.983 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T09:01:29.998 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T09:01:30.047 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/2 2024-09-21T09:01:30.055 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T09:01:30.089 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T09:01:30.149 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T09:01:30.257 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T09:01:30.367 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T09:01:30.417 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T09:01:30.748 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/2 2024-09-21T09:01:30.748 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/2 2024-09-21T09:01:31.024 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T09:01:31.024 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:31.025 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:01:31.025 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T09:01:31.025 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:31.025 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:31.199 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T09:01:31.246 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T09:01:31.280 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T09:01:31.281 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-volume 2024-09-21T09:01:31.329 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T09:01:31.357 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 13/13 2024-09-21T09:01:31.880 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:27 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:32.017 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:32.018 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:32.018 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-21T09:01:32.018 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:32.018 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:01:32.018 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 285 k 2024-09-21T09:01:32.018 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:32.018 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:01:32.018 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:32.018 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-21T09:01:32.018 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:32.019 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 285 k 2024-09-21T09:01:32.019 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 1.3 M 2024-09-21T09:01:32.019 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:01:32.121 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 13/13 2024-09-21T09:01:32.121 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 1/13 2024-09-21T09:01:32.121 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T09:01:32.121 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T09:01:32.121 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T09:01:32.121 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T09:01:32.121 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T09:01:32.121 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T09:01:32.121 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T09:01:32.121 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T09:01:32.121 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T09:01:32.121 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T09:01:32.121 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T09:01:32.235 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-volume-19.1.1-367.g9e2ac70b.el9.noarch.rpm 1.3 MB/s | 285 kB 00:00 2024-09-21T09:01:32.236 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:32.236 INFO:teuthology.orchestra.run.smithi178.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-21T09:01:32.237 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:01:32.245 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:01:32.245 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:01:32.272 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:01:32.273 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:01:32.473 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T09:01:32.473 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:32.473 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:01:32.473 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:32.473 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T09:01:32.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T09:01:32.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T09:01:32.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T09:01:32.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T09:01:32.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T09:01:32.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T09:01:32.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T09:01:32.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T09:01:32.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T09:01:32.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T09:01:32.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T09:01:32.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:32.474 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:01:32.488 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:01:32.554 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T09:01:32.570 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T09:01:32.570 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:01:32.571 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T09:01:32.571 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:32.740 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T09:01:33.350 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:29 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:33.488 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:01:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:33.489 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-21T09:01:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:01:33.489 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 146 k 2024-09-21T09:01:33.489 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-21T09:01:33.489 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T09:01:33.489 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T09:01:33.490 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T09:01:33.490 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T09:01:33.490 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T09:01:33.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:01:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:Install 6 Packages 2024-09-21T09:01:33.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:33.490 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 7.0 M 2024-09-21T09:01:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 33 M 2024-09-21T09:01:33.491 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:01:33.589 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T09:01:33.589 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:33.589 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:01:33.589 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:33.589 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:33.589 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:33.884 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install librados-devel 2024-09-21T09:01:34.488 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:30 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:34.624 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:34.624 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:34.624 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repo Size 2024-09-21T09:01:34.624 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:34.624 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:01:34.625 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 127 k 2024-09-21T09:01:34.625 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:34.625 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:01:34.625 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:34.625 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-21T09:01:34.625 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:34.625 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 127 k 2024-09-21T09:01:34.626 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 456 k 2024-09-21T09:01:34.626 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:01:34.832 INFO:teuthology.orchestra.run.smithi178.stdout:librados-devel-19.1.1-367.g9e2ac70b.el9.x86_64. 614 kB/s | 127 kB 00:00 2024-09-21T09:01:34.833 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:34.833 INFO:teuthology.orchestra.run.smithi178.stdout:Total 610 kB/s | 127 kB 00:00 2024-09-21T09:01:34.833 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:01:34.839 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:01:34.839 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:01:34.903 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:01:34.903 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:01:35.055 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:01:35.162 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:35.579 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:35.838 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:35.838 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:35.838 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:01:35.839 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:01:35.839 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:35.839 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:36.066 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install libcephfs2 2024-09-21T09:01:36.671 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:32 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:36.762 INFO:teuthology.orchestra.run.smithi178.stdout:Package libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:01:36.806 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:36.807 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-21T09:01:36.807 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:36.885 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install libcephfs-devel 2024-09-21T09:01:37.470 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:37.602 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:37.603 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:37.603 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repo Size 2024-09-21T09:01:37.603 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:37.603 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:01:37.603 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 32 k 2024-09-21T09:01:37.603 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:37.603 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:01:37.603 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:37.603 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-21T09:01:37.603 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:37.604 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 32 k 2024-09-21T09:01:37.604 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 142 k 2024-09-21T09:01:37.604 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:01:37.751 INFO:teuthology.orchestra.run.smithi178.stdout:libcephfs-devel-19.1.1-367.g9e2ac70b.el9.x86_64 216 kB/s | 32 kB 00:00 2024-09-21T09:01:37.752 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:37.752 INFO:teuthology.orchestra.run.smithi178.stdout:Total 213 kB/s | 32 kB 00:00 2024-09-21T09:01:37.752 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:01:37.756 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:01:37.756 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:01:37.778 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:01:37.778 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:01:37.868 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:01:37.972 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:38.340 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:38.577 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:38.577 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:38.577 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:01:38.577 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:01:38.577 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:38.577 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:38.755 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install librados2 2024-09-21T09:01:39.340 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:39.429 INFO:teuthology.orchestra.run.smithi178.stdout:Package librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:01:39.472 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:39.473 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-21T09:01:39.473 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:39.547 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install librbd1 2024-09-21T09:01:40.127 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:40.216 INFO:teuthology.orchestra.run.smithi178.stdout:Package librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:01:40.259 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:40.260 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-21T09:01:40.260 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:40.333 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install python3-rados 2024-09-21T09:01:40.917 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:41.007 INFO:teuthology.orchestra.run.smithi178.stdout:Package python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:01:41.050 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:41.051 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-21T09:01:41.051 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:41.125 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install python3-rgw 2024-09-21T09:01:41.711 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:41.801 INFO:teuthology.orchestra.run.smithi178.stdout:Package python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:01:41.844 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:41.845 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-21T09:01:41.845 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:41.924 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install python3-cephfs 2024-09-21T09:01:42.507 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:42.595 INFO:teuthology.orchestra.run.smithi178.stdout:Package python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:01:42.638 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:42.640 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-21T09:01:42.640 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:42.705 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install python3-rbd 2024-09-21T09:01:43.291 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:43.380 INFO:teuthology.orchestra.run.smithi178.stdout:Package python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:01:43.423 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:43.424 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-09-21T09:01:43.424 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:43.497 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install rbd-fuse 2024-09-21T09:01:43.971 INFO:teuthology.orchestra.run.smithi044.stdout:(1/6): ceph-mgr-cephadm-19.1.1-367.g9e2ac70b.el 707 kB/s | 146 kB 00:00 2024-09-21T09:01:44.029 INFO:teuthology.orchestra.run.smithi044.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-21T09:01:44.055 INFO:teuthology.orchestra.run.smithi044.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-21T09:01:44.080 INFO:teuthology.orchestra.run.smithi044.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-21T09:01:44.080 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:44.213 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:44.213 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:44.214 INFO:teuthology.orchestra.run.smithi178.stdout: Package Architecture Version Repository Size 2024-09-21T09:01:44.214 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:44.214 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:01:44.214 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 85 k 2024-09-21T09:01:44.214 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:44.214 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:01:44.214 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:44.214 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-21T09:01:44.214 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:44.214 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 85 k 2024-09-21T09:01:44.214 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 231 k 2024-09-21T09:01:44.215 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:01:44.413 INFO:teuthology.orchestra.run.smithi178.stdout:rbd-fuse-19.1.1-367.g9e2ac70b.el9.x86_64.rpm 430 kB/s | 85 kB 00:00 2024-09-21T09:01:44.413 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:44.414 INFO:teuthology.orchestra.run.smithi178.stdout:Total 427 kB/s | 85 kB 00:00 2024-09-21T09:01:44.414 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:01:44.420 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:01:44.420 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:01:44.484 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:01:44.484 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:01:44.547 INFO:teuthology.orchestra.run.smithi044.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 317 kB/s | 248 kB 00:00 2024-09-21T09:01:44.629 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:01:44.727 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.0 MB/s | 6.0 MB 00:01 2024-09-21T09:01:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:44.950 INFO:teuthology.orchestra.run.smithi044.stdout:Total 627 kB/s | 7.0 MB 00:11 2024-09-21T09:01:45.026 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:01:45.039 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:01:45.039 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:01:45.105 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:45.146 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:01:45.146 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:01:45.351 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:45.351 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:01:45.351 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:01:45.351 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:45.457 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:01:45.617 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install rbd-mirror 2024-09-21T09:01:45.632 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T09:01:45.692 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T09:01:46.216 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:46.259 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T09:01:46.348 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T09:01:46.353 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:46.354 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:46.354 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repo Size 2024-09-21T09:01:46.354 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:46.354 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:01:46.354 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 3.1 M 2024-09-21T09:01:46.355 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:46.355 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:01:46.355 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:46.355 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-21T09:01:46.355 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:46.355 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 3.1 M 2024-09-21T09:01:46.355 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 13 M 2024-09-21T09:01:46.356 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:01:46.418 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T09:01:46.444 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 6/6 2024-09-21T09:01:46.698 INFO:teuthology.orchestra.run.smithi178.stdout:rbd-mirror-19.1.1-367.g9e2ac70b.el9.x86_64.rpm 9.0 MB/s | 3.1 MB 00:00 2024-09-21T09:01:46.699 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:46.699 INFO:teuthology.orchestra.run.smithi178.stdout:Total 9.0 MB/s | 3.1 MB 00:00 2024-09-21T09:01:46.699 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:01:46.709 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:01:46.709 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:01:46.794 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:01:46.794 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:01:47.194 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 6/6 2024-09-21T09:01:47.194 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/6 2024-09-21T09:01:47.194 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T09:01:47.194 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T09:01:47.194 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T09:01:47.194 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T09:01:47.251 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:01:47.316 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:47.343 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:47.343 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:01:47.343 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T09:01:47.344 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T09:01:47.344 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T09:01:47.344 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T09:01:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:47.489 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:01:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T09:01:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T09:01:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T09:01:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T09:01:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T09:01:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:47.489 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:01:47.748 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-fuse 2024-09-21T09:01:48.357 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:44 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:48.498 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:01:48.498 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:48.498 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-21T09:01:48.498 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:48.498 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:01:48.499 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 896 k 2024-09-21T09:01:48.499 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-21T09:01:48.499 INFO:teuthology.orchestra.run.smithi044.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T09:01:48.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:48.499 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:01:48.499 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:48.499 INFO:teuthology.orchestra.run.smithi044.stdout:Install 2 Packages 2024-09-21T09:01:48.499 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:48.499 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 976 k 2024-09-21T09:01:48.500 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 2.9 M 2024-09-21T09:01:48.500 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:01:48.503 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:48.503 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:48.503 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:01:48.503 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:01:48.503 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:48.503 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:48.615 INFO:teuthology.orchestra.run.smithi044.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 836 kB/s | 80 kB 00:00 2024-09-21T09:01:48.737 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install rbd-nbd 2024-09-21T09:01:48.816 INFO:teuthology.orchestra.run.smithi044.stdout:(2/2): ceph-fuse-19.1.1-367.g9e2ac70b.el9.x86_6 3.0 MB/s | 896 kB 00:00 2024-09-21T09:01:48.816 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:48.816 INFO:teuthology.orchestra.run.smithi044.stdout:Total 3.0 MB/s | 976 kB 00:00 2024-09-21T09:01:48.829 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:01:48.851 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:01:48.851 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:01:48.939 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:01:48.939 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:01:49.133 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:01:49.281 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T09:01:49.337 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:45 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:49.351 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/2 2024-09-21T09:01:49.473 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T09:01:49.474 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:49.474 INFO:teuthology.orchestra.run.smithi178.stdout: Package Architecture Version Repository Size 2024-09-21T09:01:49.474 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:49.474 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T09:01:49.474 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 170 k 2024-09-21T09:01:49.474 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:49.474 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T09:01:49.474 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-21T09:01:49.474 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2024-09-21T09:01:49.474 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:49.475 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 170 k 2024-09-21T09:01:49.475 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 494 k 2024-09-21T09:01:49.475 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T09:01:49.685 INFO:teuthology.orchestra.run.smithi178.stdout:rbd-nbd-19.1.1-367.g9e2ac70b.el9.x86_64.rpm 812 kB/s | 170 kB 00:00 2024-09-21T09:01:49.686 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:49.687 INFO:teuthology.orchestra.run.smithi178.stdout:Total 805 kB/s | 170 kB 00:00 2024-09-21T09:01:49.687 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T09:01:49.694 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T09:01:49.694 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T09:01:49.757 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T09:01:49.758 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T09:01:49.913 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T09:01:50.007 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/2 2024-09-21T09:01:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/2 2024-09-21T09:01:50.345 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T09:01:50.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:50.345 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:01:50.345 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T09:01:50.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:50.345 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:01:50.436 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:50.613 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-volume 2024-09-21T09:01:50.703 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:50.703 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:50.703 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T09:01:50.703 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:01:50.703 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:01:50.703 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T09:01:50.955 DEBUG:teuthology.parallel:result is None 2024-09-21T09:01:51.232 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:47 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:51.372 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:01:51.373 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:51.373 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-21T09:01:51.373 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:51.373 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:01:51.373 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 285 k 2024-09-21T09:01:51.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:51.374 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:01:51.374 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:51.374 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-09-21T09:01:51.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:51.374 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 285 k 2024-09-21T09:01:51.374 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 1.3 M 2024-09-21T09:01:51.374 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:01:51.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-volume-19.1.1-367.g9e2ac70b.el9.noarch.rpm 1.3 MB/s | 285 kB 00:00 2024-09-21T09:01:51.596 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:51.597 INFO:teuthology.orchestra.run.smithi044.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-21T09:01:51.597 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:01:51.605 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:01:51.606 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:01:51.641 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:01:51.641 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:01:51.869 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:01:51.931 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T09:01:51.947 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T09:01:51.948 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:01:51.948 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T09:01:51.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T09:01:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:52.991 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:01:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T09:01:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:52.991 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:01:53.335 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install librados-devel 2024-09-21T09:01:53.952 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:49 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:54.090 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:01:54.091 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:54.091 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repo Size 2024-09-21T09:01:54.091 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:54.091 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:01:54.091 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 127 k 2024-09-21T09:01:54.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:54.092 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:01:54.092 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:54.092 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-09-21T09:01:54.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:54.092 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 127 k 2024-09-21T09:01:54.092 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 456 k 2024-09-21T09:01:54.092 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:01:54.300 INFO:teuthology.orchestra.run.smithi044.stdout:librados-devel-19.1.1-367.g9e2ac70b.el9.x86_64. 608 kB/s | 127 kB 00:00 2024-09-21T09:01:54.301 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:54.301 INFO:teuthology.orchestra.run.smithi044.stdout:Total 605 kB/s | 127 kB 00:00 2024-09-21T09:01:54.301 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:01:54.307 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:01:54.307 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:01:54.374 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:01:54.375 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:01:54.530 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:01:54.634 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:55.082 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:55.359 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:55.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:55.360 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:01:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:01:55.360 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:55.360 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:01:55.603 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install libcephfs2 2024-09-21T09:01:56.232 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:52 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:56.326 INFO:teuthology.orchestra.run.smithi044.stdout:Package libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:01:56.373 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:01:56.374 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-09-21T09:01:56.374 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:01:56.442 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install libcephfs-devel 2024-09-21T09:01:57.054 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:53 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:57.191 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:01:57.192 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:57.192 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repo Size 2024-09-21T09:01:57.192 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:57.192 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:01:57.192 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 32 k 2024-09-21T09:01:57.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:57.192 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:01:57.192 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:01:57.192 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-09-21T09:01:57.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:57.193 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 32 k 2024-09-21T09:01:57.193 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 142 k 2024-09-21T09:01:57.193 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:01:57.354 INFO:teuthology.orchestra.run.smithi044.stdout:libcephfs-devel-19.1.1-367.g9e2ac70b.el9.x86_64 197 kB/s | 32 kB 00:00 2024-09-21T09:01:57.355 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:01:57.355 INFO:teuthology.orchestra.run.smithi044.stdout:Total 195 kB/s | 32 kB 00:00 2024-09-21T09:01:57.355 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:01:57.359 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:01:57.359 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:01:57.382 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:01:57.383 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:01:57.475 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:01:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:58.011 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:58.260 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:01:58.260 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:58.260 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:01:58.260 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:01:58.260 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:01:58.261 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:01:58.446 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install librados2 2024-09-21T09:01:59.056 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:55 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:59.148 INFO:teuthology.orchestra.run.smithi044.stdout:Package librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:01:59.194 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:01:59.196 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-09-21T09:01:59.196 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:01:59.267 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install librbd1 2024-09-21T09:01:59.871 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:55 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:01:59.964 INFO:teuthology.orchestra.run.smithi044.stdout:Package librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:02:00.011 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:02:00.012 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-09-21T09:02:00.012 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:02:00.075 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install python3-rados 2024-09-21T09:02:00.688 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:56 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:02:00.781 INFO:teuthology.orchestra.run.smithi044.stdout:Package python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:02:00.826 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:02:00.827 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-09-21T09:02:00.828 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:02:00.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install python3-rgw 2024-09-21T09:02:01.500 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:57 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:02:01.594 INFO:teuthology.orchestra.run.smithi044.stdout:Package python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:02:01.640 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:02:01.641 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-09-21T09:02:01.641 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:02:01.708 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install python3-cephfs 2024-09-21T09:02:02.321 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:58 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:02:02.412 INFO:teuthology.orchestra.run.smithi044.stdout:Package python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:02:02.457 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:02:02.458 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-09-21T09:02:02.459 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:02:02.530 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install python3-rbd 2024-09-21T09:02:03.145 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:59 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:02:03.239 INFO:teuthology.orchestra.run.smithi044.stdout:Package python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T09:02:03.285 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:02:03.286 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-09-21T09:02:03.286 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:02:03.367 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install rbd-fuse 2024-09-21T09:02:03.974 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:59 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:02:04.113 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:02:04.114 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:02:04.114 INFO:teuthology.orchestra.run.smithi044.stdout: Package Architecture Version Repository Size 2024-09-21T09:02:04.114 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:02:04.114 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:02:04.114 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 85 k 2024-09-21T09:02:04.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:04.114 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:02:04.114 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:02:04.114 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-09-21T09:02:04.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:04.114 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 85 k 2024-09-21T09:02:04.114 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 231 k 2024-09-21T09:02:04.114 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:02:04.308 INFO:teuthology.orchestra.run.smithi044.stdout:rbd-fuse-19.1.1-367.g9e2ac70b.el9.x86_64.rpm 441 kB/s | 85 kB 00:00 2024-09-21T09:02:04.308 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:02:04.308 INFO:teuthology.orchestra.run.smithi044.stdout:Total 438 kB/s | 85 kB 00:00 2024-09-21T09:02:04.309 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:02:04.316 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:02:04.316 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:02:04.384 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:02:04.384 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:02:04.532 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:02:04.642 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:02:05.025 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:02:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:02:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:05.276 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:02:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:02:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:05.276 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:02:05.543 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install rbd-mirror 2024-09-21T09:02:06.166 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:02:02 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:02:06.306 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:02:06.306 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:02:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repo Size 2024-09-21T09:02:06.307 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:02:06.307 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:02:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 3.1 M 2024-09-21T09:02:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:06.307 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:02:06.307 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:02:06.307 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-09-21T09:02:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:06.308 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 3.1 M 2024-09-21T09:02:06.308 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 13 M 2024-09-21T09:02:06.308 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:02:06.636 INFO:teuthology.orchestra.run.smithi044.stdout:rbd-mirror-19.1.1-367.g9e2ac70b.el9.x86_64.rpm 9.4 MB/s | 3.1 MB 00:00 2024-09-21T09:02:06.637 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:02:06.637 INFO:teuthology.orchestra.run.smithi044.stdout:Total 9.4 MB/s | 3.1 MB 00:00 2024-09-21T09:02:06.637 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:02:06.647 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:02:06.647 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:02:06.734 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:02:06.734 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:02:07.183 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:02:07.237 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:02:07.264 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:02:07.264 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T09:02:07.264 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T09:02:07.264 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T09:02:07.264 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T09:02:07.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:02:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:08.443 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:02:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:02:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:08.443 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:02:08.708 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install rbd-nbd 2024-09-21T09:02:09.321 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:02:05 ago on Sat 21 Sep 2024 09:00:04 AM UTC. 2024-09-21T09:02:09.461 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T09:02:09.461 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:02:09.461 INFO:teuthology.orchestra.run.smithi044.stdout: Package Architecture Version Repository Size 2024-09-21T09:02:09.461 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:02:09.461 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T09:02:09.461 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 170 k 2024-09-21T09:02:09.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:09.462 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T09:02:09.462 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-21T09:02:09.462 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-09-21T09:02:09.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:09.462 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 170 k 2024-09-21T09:02:09.462 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 494 k 2024-09-21T09:02:09.462 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T09:02:09.673 INFO:teuthology.orchestra.run.smithi044.stdout:rbd-nbd-19.1.1-367.g9e2ac70b.el9.x86_64.rpm 810 kB/s | 170 kB 00:00 2024-09-21T09:02:09.673 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T09:02:09.674 INFO:teuthology.orchestra.run.smithi044.stdout:Total 805 kB/s | 170 kB 00:00 2024-09-21T09:02:09.674 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T09:02:09.682 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T09:02:09.682 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T09:02:09.750 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T09:02:09.750 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T09:02:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T09:02:10.033 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:02:10.454 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:02:10.734 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T09:02:10.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:10.734 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T09:02:10.734 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T09:02:10.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:10.735 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T09:02:10.996 DEBUG:teuthology.parallel:result is None 2024-09-21T09:02:10.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T09:02:11.143 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T09:02:11.165 INFO:teuthology.orchestra.run.smithi044.stdout:19.1.1-367.g9e2ac70b.el9 2024-09-21T09:02:11.166 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367.g9e2ac70b.el9 2024-09-21T09:02:11.166 INFO:teuthology.task.install:The correct ceph version 19.1.1-367.g9e2ac70b is installed. 2024-09-21T09:02:11.168 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T09:02:11.310 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T09:02:11.335 INFO:teuthology.orchestra.run.smithi178.stdout:19.1.1-367.g9e2ac70b.el9 2024-09-21T09:02:11.335 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367.g9e2ac70b.el9 2024-09-21T09:02:11.335 INFO:teuthology.task.install:The correct ceph version 19.1.1-367.g9e2ac70b is installed. 2024-09-21T09:02:11.337 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T09:02:11.337 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T09:02:11.337 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T09:02:11.364 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:11.364 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T09:02:11.406 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T09:02:11.406 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T09:02:11.407 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T09:02:11.432 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T09:02:11.498 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:11.498 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T09:02:11.527 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T09:02:11.596 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T09:02:11.597 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T09:02:11.597 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T09:02:11.623 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T09:02:11.688 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:11.688 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T09:02:11.715 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T09:02:11.782 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T09:02:11.782 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T09:02:11.782 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T09:02:11.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T09:02:11.874 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:11.874 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T09:02:11.902 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T09:02:11.968 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T09:02:12.066 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T09:02:12.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /var/log/ceph 2024-09-21T09:02:12.069 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /var/log/ceph 2024-09-21T09:02:12.096 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T09:02:12.096 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T09:02:12.135 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T09:02:12.161 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T09:02:12.162 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T09:02:12.201 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T09:02:12.237 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T09:02:12.237 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T09:02:12.238 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913221', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7913221', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9490, 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'targets': {'smithi044.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFJXR7i7zy2uVkGS4MvS7gOKllgkf/pHPhqlq2JRfLgHaDHubi4ru8UfdChoOKYZhFJ31/m6g39oNmXmmmizvP4=', 'smithi178.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHErAU2j7WWSJ+OsNLugEanI7x97M+xPZH1mXIjctSjO0vNLkepKfbFfKU2wRgLwduj1QgD6y7wv9Kj98lHSAgc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-20_21:40:05', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T09:02:12.238 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T09:02:12.267 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T09:02:12.284 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T09:02:12.323 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T09:02:12.348 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T09:02:12.349 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T09:02:12.403 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T09:02:12.403 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-09-21T09:02:12.458 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T09:02:12.458 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:02:12.458 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-21T09:02:12.458 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:02:12.458 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T09:02:12.458 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-21 09:02:07.553067326 +0000 2024-09-21T09:02:12.458 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-21 08:59:26.368245735 +0000 2024-09-21T09:02:12.459 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-21 08:59:26.368245735 +0000 2024-09-21T09:02:12.459 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-21 08:59:26.368245735 +0000 2024-09-21T09:02:12.459 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T09:02:12.522 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-21T09:02:12.522 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-21T09:02:12.523 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000257568 s, 2.0 MB/s 2024-09-21T09:02:12.524 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T09:02:12.581 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-09-21T09:02:12.637 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T09:02:12.637 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:02:12.637 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T09:02:12.637 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:02:12.637 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T09:02:12.637 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-21 09:02:07.553067326 +0000 2024-09-21T09:02:12.637 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-21 08:59:26.701240937 +0000 2024-09-21T09:02:12.637 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-21 08:59:26.701240937 +0000 2024-09-21T09:02:12.638 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-21 08:59:26.701240937 +0000 2024-09-21T09:02:12.638 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T09:02:12.701 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-21T09:02:12.701 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-21T09:02:12.701 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000163601 s, 3.1 MB/s 2024-09-21T09:02:12.703 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T09:02:12.759 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-09-21T09:02:12.815 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T09:02:12.815 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:02:12.815 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T09:02:12.815 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:02:12.815 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T09:02:12.815 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-21 09:02:07.553067326 +0000 2024-09-21T09:02:12.815 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-21 08:59:27.028236226 +0000 2024-09-21T09:02:12.815 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-21 08:59:27.028236226 +0000 2024-09-21T09:02:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-21 08:59:27.028236226 +0000 2024-09-21T09:02:12.816 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T09:02:12.879 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-21T09:02:12.879 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-21T09:02:12.879 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000183082 s, 2.8 MB/s 2024-09-21T09:02:12.880 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T09:02:12.937 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-09-21T09:02:12.993 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T09:02:12.993 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:02:12.993 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T09:02:12.993 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:02:12.993 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T09:02:12.993 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-21 09:02:07.554067311 +0000 2024-09-21T09:02:12.993 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-21 08:59:27.349231601 +0000 2024-09-21T09:02:12.993 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-21 08:59:27.349231601 +0000 2024-09-21T09:02:12.993 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-21 08:59:27.349231601 +0000 2024-09-21T09:02:12.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T09:02:13.057 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-21T09:02:13.057 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-21T09:02:13.057 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000166716 s, 3.1 MB/s 2024-09-21T09:02:13.059 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T09:02:13.116 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-21T09:02:13.116 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:13.116 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T09:02:13.135 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T09:02:13.136 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2024-09-21T09:02:13.193 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T09:02:13.193 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:02:13.193 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T09:02:13.193 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:02:13.193 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T09:02:13.193 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-21 09:01:47.612284995 +0000 2024-09-21T09:02:13.193 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-21 08:59:21.585504305 +0000 2024-09-21T09:02:13.193 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-21 08:59:21.585504305 +0000 2024-09-21T09:02:13.194 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-21 08:59:21.585504305 +0000 2024-09-21T09:02:13.194 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T09:02:13.260 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-21T09:02:13.260 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-21T09:02:13.260 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 9.7728e-05 s, 5.2 MB/s 2024-09-21T09:02:13.262 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T09:02:13.320 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2024-09-21T09:02:13.377 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T09:02:13.377 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:02:13.377 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T09:02:13.377 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:02:13.377 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T09:02:13.377 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-21 09:01:47.612284995 +0000 2024-09-21T09:02:13.377 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-21 08:59:21.892498679 +0000 2024-09-21T09:02:13.377 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-21 08:59:21.892498679 +0000 2024-09-21T09:02:13.377 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-21 08:59:21.892498679 +0000 2024-09-21T09:02:13.378 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T09:02:13.442 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-21T09:02:13.442 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-21T09:02:13.442 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 9.065e-05 s, 5.6 MB/s 2024-09-21T09:02:13.444 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T09:02:13.501 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2024-09-21T09:02:13.557 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T09:02:13.557 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:02:13.558 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T09:02:13.558 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:02:13.558 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T09:02:13.558 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-21 09:01:47.612284995 +0000 2024-09-21T09:02:13.558 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-21 08:59:22.201493015 +0000 2024-09-21T09:02:13.558 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-21 08:59:22.201493015 +0000 2024-09-21T09:02:13.558 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-21 08:59:22.201493015 +0000 2024-09-21T09:02:13.558 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T09:02:13.621 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-21T09:02:13.622 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-21T09:02:13.622 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000108908 s, 4.7 MB/s 2024-09-21T09:02:13.623 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T09:02:13.680 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2024-09-21T09:02:13.735 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T09:02:13.735 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:02:13.735 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T09:02:13.735 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:02:13.735 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T09:02:13.735 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-21 09:01:47.612284995 +0000 2024-09-21T09:02:13.735 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-21 08:59:22.515487259 +0000 2024-09-21T09:02:13.735 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-21 08:59:22.515487259 +0000 2024-09-21T09:02:13.736 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-21 08:59:22.515487259 +0000 2024-09-21T09:02:13.736 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T09:02:13.798 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-21T09:02:13.798 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-21T09:02:13.799 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 8.4347e-05 s, 6.1 MB/s 2024-09-21T09:02:13.800 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T09:02:13.855 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-21T09:02:13.855 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-21T09:02:13.855 INFO:tasks.ceph:Generating config... 2024-09-21T09:02:13.856 INFO:tasks.ceph:[client] debug ms = 1 2024-09-21T09:02:13.856 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-21T09:02:13.856 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-21T09:02:13.857 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-21T09:02:13.857 INFO:tasks.ceph:[client] setuser = ceph 2024-09-21T09:02:13.857 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T09:02:13.857 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-21T09:02:13.857 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-21T09:02:13.857 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-21T09:02:13.857 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-21T09:02:13.857 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T09:02:13.857 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T09:02:13.857 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-21T09:02:13.857 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-21T09:02:13.857 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T09:02:13.857 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-21T09:02:13.857 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T09:02:13.857 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T09:02:13.857 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T09:02:13.858 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T09:02:13.858 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T09:02:13.858 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T09:02:13.858 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T09:02:13.858 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T09:02:13.858 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T09:02:13.858 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T09:02:13.858 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T09:02:13.858 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T09:02:13.945 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T09:02:13.948 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T09:02:13.994 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T09:02:14.019 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.44')] 2024-09-21T09:02:14.020 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.44'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-21T09:02:14.020 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T09:02:14.020 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T09:02:14.076 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.44 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:02:14.158 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:02:14.158 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:02:14.159 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:02:14.159 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: generated fsid 7bec7bbe-ddde-41dc-a98a-89578467409a 2024-09-21T09:02:14.159 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = quincy 2024-09-21T09:02:14.159 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 0 2024-09-21T09:02:14.159 INFO:teuthology.orchestra.run.smithi044.stdout:fsid 7bec7bbe-ddde-41dc-a98a-89578467409a 2024-09-21T09:02:14.159 INFO:teuthology.orchestra.run.smithi044.stdout:last_changed 2024-09-21T09:02:14.158559+0000 2024-09-21T09:02:14.160 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-09-21T09:02:14.158559+0000 2024-09-21T09:02:14.160 INFO:teuthology.orchestra.run.smithi044.stdout:min_mon_release 17 (quincy) 2024-09-21T09:02:14.160 INFO:teuthology.orchestra.run.smithi044.stdout:election_strategy: 1 2024-09-21T09:02:14.160 INFO:teuthology.orchestra.run.smithi044.stdout:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-21T09:02:14.160 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-21T09:02:14.161 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T09:02:14.216 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7bec7bbe-ddde-41dc-a98a-89578467409a... 2024-09-21T09:02:14.217 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T09:02:14.259 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T09:02:14.301 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-09-21T09:02:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2024-09-21T09:02:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T09:02:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2024-09-21T09:02:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2024-09-21T09:02:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2024-09-21T09:02:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2024-09-21T09:02:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2024-09-21T09:02:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2024-09-21T09:02:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2024-09-21T09:02:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2024-09-21T09:02:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = 172.21.15.44 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 7bec7bbe-ddde-41dc-a98a-89578467409a 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.304 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2024-09-21T09:02:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2024-09-21T09:02:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2024-09-21T09:02:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2024-09-21T09:02:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2024-09-21T09:02:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2024-09-21T09:02:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2024-09-21T09:02:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2024-09-21T09:02:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2024-09-21T09:02:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-21T09:02:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: debug objclass = 20 2024-09-21T09:02:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: bdev async discard = True 2024-09-21T09:02:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: bdev enable discard = True 2024-09-21T09:02:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore allocator = bitmap 2024-09-21T09:02:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2024-09-21T09:02:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2024-09-21T09:02:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 1/20 2024-09-21T09:02:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 1/20 2024-09-21T09:02:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2024-09-21T09:02:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 4/10 2024-09-21T09:02:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T09:02:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2024-09-21T09:02:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2024-09-21T09:02:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2024-09-21T09:02:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2024-09-21T09:02:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.308 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2024-09-21T09:02:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-21T09:02:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2024-09-21T09:02:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-21T09:02:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-21T09:02:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-21T09:02:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-21T09:02:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2024-09-21T09:02:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.308 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2024-09-21T09:02:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T09:02:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: rgw gc obj min wait = 15 2024-09-21T09:02:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: debug rgw = 20 2024-09-21T09:02:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: setgroup = ceph 2024-09-21T09:02:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: setuser = ceph 2024-09-21T09:02:14.311 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2024-09-21T09:02:14.311 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2024-09-21T09:02:14.311 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2024-09-21T09:02:14.311 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T09:02:14.311 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2024-09-21T09:02:14.311 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.311 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.312 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2024-09-21T09:02:14.313 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.313 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2024-09-21T09:02:14.313 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2024-09-21T09:02:14.313 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2024-09-21T09:02:14.313 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2024-09-21T09:02:14.313 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2024-09-21T09:02:14.313 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2024-09-21T09:02:14.313 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2024-09-21T09:02:14.313 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T09:02:14.313 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T09:02:14.313 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2024-09-21T09:02:14.313 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.313 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = 172.21.15.44 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = 7bec7bbe-ddde-41dc-a98a-89578467409a 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.314 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: osd mclock profile = high_recovery_ops 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug trim objects = true 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2024-09-21T09:02:14.315 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: debug objclass = 20 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: bdev async discard = True 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: bdev enable discard = True 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore allocator = bitmap 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2024-09-21T09:02:14.316 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 1/20 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 1/20 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 4/10 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-09-21T09:02:14.317 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-09-21T09:02:14.318 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2024-09-21T09:02:14.318 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.318 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2024-09-21T09:02:14.318 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-21T09:02:14.318 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-09-21T09:02:14.318 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2024-09-21T09:02:14.318 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-09-21T09:02:14.318 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2024-09-21T09:02:14.318 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2024-09-21T09:02:14.318 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-09-21T09:02:14.318 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2024-09-21T09:02:14.318 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2024-09-21T09:02:14.318 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: # 1m isn't quite enough 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: mon_down_mkfs_grace = 2m 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_filestore_osds = false 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2024-09-21T09:02:14.319 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2024-09-21T09:02:14.320 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2024-09-21T09:02:14.320 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2024-09-21T09:02:14.320 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T09:02:14.320 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T09:02:14.320 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-21T09:02:14.320 INFO:teuthology.orchestra.run.smithi178.stdout: rgw gc obj min wait = 15 2024-09-21T09:02:14.320 INFO:teuthology.orchestra.run.smithi178.stdout: debug rgw = 20 2024-09-21T09:02:14.320 INFO:teuthology.orchestra.run.smithi178.stdout: setgroup = ceph 2024-09-21T09:02:14.320 INFO:teuthology.orchestra.run.smithi178.stdout: setuser = ceph 2024-09-21T09:02:14.320 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2024-09-21T09:02:14.321 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T09:02:14.321 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T09:02:14.418 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T09:02:14.418 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T09:02:14.418 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T09:02:14.433 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T09:02:14.433 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T09:02:14.489 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi044.front.sepia.ceph.com 2024-09-21T09:02:14.489 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T09:02:14.489 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T09:02:14.489 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T09:02:14.565 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T09:02:14.565 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:02:14.621 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi178.front.sepia.ceph.com 2024-09-21T09:02:14.621 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:14.621 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T09:02:14.621 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T09:02:14.655 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:14.656 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:02:14.711 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T09:02:14.711 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T09:02:14.711 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T09:02:14.811 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T09:02:14.814 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T09:02:14.814 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T09:02:14.814 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T09:02:14.855 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T09:02:14.867 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T09:02:14.868 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-21T09:02:14.868 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T09:02:14.893 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-21T09:02:14.893 INFO:tasks.ceph:role: osd.0 2024-09-21T09:02:14.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-21T09:02:14.894 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T09:02:14.967 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T09:02:14.967 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T09:02:14.967 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T09:02:14.967 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T09:02:14.967 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T09:02:14.967 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-09-21T09:02:14.968 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T09:02:14.968 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T09:02:14.968 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T09:02:14.968 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T09:02:15.462 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-09-21T09:02:15.464 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-09-21T09:02:15.464 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T09:02:15.590 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T09:02:15.624 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:02:15.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:15.723+0000 7fceef132640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T09:02:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:15.727+0000 7fceef132640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T09:02:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:15.727+0000 7fceef132640 -1 bdev(0x56029c25d800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-21T09:02:15.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:15.727+0000 7fceef132640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-21T09:02:18.904 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T09:02:18.937 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T09:02:18.966 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-21T09:02:18.966 INFO:tasks.ceph:role: osd.1 2024-09-21T09:02:18.966 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-21T09:02:18.966 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T09:02:19.036 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T09:02:19.036 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T09:02:19.036 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T09:02:19.036 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T09:02:19.036 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T09:02:19.036 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-09-21T09:02:19.036 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T09:02:19.036 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T09:02:19.036 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T09:02:19.037 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T09:02:19.072 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-09-21T09:02:19.074 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-09-21T09:02:19.075 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-21T09:02:19.149 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T09:02:19.217 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T09:02:19.283 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-21T09:02:19.283 INFO:tasks.ceph:role: osd.2 2024-09-21T09:02:19.283 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-21T09:02:19.284 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T09:02:19.347 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T09:02:19.348 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T09:02:19.348 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T09:02:19.348 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T09:02:19.348 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T09:02:19.348 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-09-21T09:02:19.348 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T09:02:19.348 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T09:02:19.348 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T09:02:19.348 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T09:02:19.381 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-09-21T09:02:19.382 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-09-21T09:02:19.383 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-21T09:02:19.451 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T09:02:19.520 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T09:02:19.585 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-21T09:02:19.585 INFO:tasks.ceph:role: osd.3 2024-09-21T09:02:19.585 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-21T09:02:19.585 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T09:02:19.653 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T09:02:19.654 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T09:02:19.654 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T09:02:19.654 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T09:02:19.654 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T09:02:19.654 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-09-21T09:02:19.654 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T09:02:19.654 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T09:02:19.654 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T09:02:19.654 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T09:02:19.685 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-09-21T09:02:19.688 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-09-21T09:02:19.688 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-21T09:02:19.758 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T09:02:19.828 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:02:19.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:19.922+0000 7f2079ad8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T09:02:19.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:19.922+0000 7f2079ad8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T09:02:19.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:19.922+0000 7f2079ad8640 -1 bdev(0x55ad380c1800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-21T09:02:19.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:19.922+0000 7f2079ad8640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-21T09:02:23.830 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T09:02:23.858 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:02:23.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:23.943+0000 7f5c873a4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T09:02:23.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:23.944+0000 7f5c873a4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T09:02:23.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:23.944+0000 7f5c873a4640 -1 bdev(0x560656e25800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-21T09:02:23.948 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:23.944+0000 7f5c873a4640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-21T09:02:27.595 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T09:02:27.625 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:02:27.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:27.713+0000 7f91971bd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T09:02:27.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:27.713+0000 7f91971bd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T09:02:27.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:27.713+0000 7f91971bd640 -1 bdev(0x564f9bf23800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-21T09:02:27.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:27.713+0000 7f91971bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-21T09:02:31.122 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T09:02:31.148 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T09:02:31.148 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T09:02:31.148 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T09:02:31.179 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:31.179 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T09:02:31.213 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:31.213 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T09:02:31.278 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:31.278 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T09:02:31.343 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:31.343 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T09:02:31.408 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:31.408 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T09:02:31.463 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T09:02:31.464 DEBUG:teuthology.orchestra.run.smithi044:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T09:02:31.492 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.0] 2024-09-21T09:02:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCXi+5mzpo/KxAADaLx0KfP34dI8OU4iK5Erg== 2024-09-21T09:02:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.x] 2024-09-21T09:02:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCWi+5mLbFUMBAAk5bTito5vL3DRbv+hRwucQ== 2024-09-21T09:02:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.1] 2024-09-21T09:02:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCbi+5mD78KNxAAGCTMTIrFqInf9oyzLqLbGA== 2024-09-21T09:02:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.2] 2024-09-21T09:02:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCfi+5mSFxQOBAA5rlmz5zg7Jz5hMBzY+WVQg== 2024-09-21T09:02:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.3] 2024-09-21T09:02:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCji+5mefWSKhAAlIuM4PXb2EdIMGybKopHHw== 2024-09-21T09:02:31.493 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-09-21T09:02:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCWi+5mILDtMhAAsTUui7+uzIVRLvpWre/07w== 2024-09-21T09:02:31.494 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:02:31.594 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T09:02:31.649 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:02:31.703 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:02:31.756 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:02:31.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T09:02:31.863 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T09:02:31.863 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T09:02:31.889 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T09:02:31.986 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T09:02:32.011 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:02:32.067 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T09:02:32.068 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T09:02:32.068 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T09:02:32.110 INFO:tasks.ceph.mon.a:Started 2024-09-21T09:02:32.110 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T09:02:32.110 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T09:02:32.110 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T09:02:32.113 INFO:tasks.ceph.mgr.x:Started 2024-09-21T09:02:32.113 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T09:02:32.113 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T09:02:32.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.212+0000 7f42041e4640 1 Processor -- start 2024-09-21T09:02:32.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.212+0000 7f42041e4640 1 -- start start 2024-09-21T09:02:32.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.213+0000 7f42041e4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f41fc12bc50 0x7f41fc1338c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:32.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.213+0000 7f42041e4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41fc06e6e0 con 0x7f41fc12b020 2024-09-21T09:02:32.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.213+0000 7f42041e4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f41fc096170 con 0x7f41fc12bc50 2024-09-21T09:02:32.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.213+0000 7f420177f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f41fc12bc50 0x7f41fc1338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:32.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.213+0000 7f420177f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f41fc12bc50 0x7f41fc1338c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52406/0 (socket says 172.21.15.44:52406) 2024-09-21T09:02:32.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.213+0000 7f4201f80640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f41fc12b020 0x7f41fc12b540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58064/0 (socket says 172.21.15.44:58064) 2024-09-21T09:02:32.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.213+0000 7f420177f640 1 -- 172.21.15.44:0/3046193281 learned_addr learned my addr 172.21.15.44:0/3046193281 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:32.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.213+0000 7f420177f640 1 -- 172.21.15.44:0/3046193281 >> v2:172.21.15.44:3300/0 conn(0x7f41fc12bc50 msgr2=0x7f41fc1338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-21T09:02:32.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.213+0000 7f420177f640 1 -- 172.21.15.44:0/3046193281 >> v2:172.21.15.44:3300/0 conn(0x7f41fc12bc50 msgr2=0x7f41fc1338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T09:02:32.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.213+0000 7f420177f640 1 --2- 172.21.15.44:0/3046193281 >> v2:172.21.15.44:3300/0 conn(0x7f41fc12bc50 0x7f41fc1338c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T09:02:32.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.213+0000 7f420177f640 1 --2- 172.21.15.44:0/3046193281 >> v2:172.21.15.44:3300/0 conn(0x7f41fc12bc50 0x7f41fc1338c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T09:02:32.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.218+0000 7f4200f7e640 1 -- 172.21.15.44:0/3046193281 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 621666572 0 0) 0x7f41fc06e6e0 con 0x7f41fc12b020 2024-09-21T09:02:32.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.218+0000 7f4200f7e640 1 -- 172.21.15.44:0/3046193281 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41e8003520 con 0x7f41fc12b020 2024-09-21T09:02:32.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.219+0000 7f4200f7e640 1 -- 172.21.15.44:0/3046193281 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4090709723 0 0) 0x7f41e8003520 con 0x7f41fc12b020 2024-09-21T09:02:32.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.219+0000 7f4200f7e640 1 -- 172.21.15.44:0/3046193281 >> v2:172.21.15.44:3300/0 conn(0x7f41fc12bc50 msgr2=0x7f41fc1338c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T09:02:32.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.219+0000 7f4200f7e640 1 --2- 172.21.15.44:0/3046193281 >> v2:172.21.15.44:3300/0 conn(0x7f41fc12bc50 0x7f41fc1338c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:32.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.219+0000 7f4200f7e640 1 -- 172.21.15.44:0/3046193281 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc096600 con 0x7f41fc12b020 2024-09-21T09:02:32.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.219+0000 7f4200f7e640 1 -- 172.21.15.44:0/3046193281 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 2381822562 0 0) 0x7f41f80015a0 con 0x7f41fc12b020 2024-09-21T09:02:32.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.219+0000 7f4200f7e640 1 -- 172.21.15.44:0/3046193281 >> v1:172.21.15.44:6789/0 conn(0x7f41fc12b020 legacy=0x7f41fc12b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:32.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.219+0000 7f4200f7e640 1 --2- 172.21.15.44:0/3046193281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80039b0 0x7f41e8003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:32.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.219+0000 7f4200f7e640 1 -- 172.21.15.44:0/3046193281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc096170 con 0x7f41e80039b0 2024-09-21T09:02:32.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.219+0000 7f4201f80640 1 --2- 172.21.15.44:0/3046193281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80039b0 0x7f41e8003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:32.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.219+0000 7f4201f80640 1 -- 172.21.15.44:0/3046193281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e8003520 con 0x7f41e80039b0 2024-09-21T09:02:32.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.221+0000 7f4201f80640 1 --2- 172.21.15.44:0/3046193281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80039b0 0x7f41e8003db0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f41f8007f50 tx=0x7f41e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447881c2f53d9833 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:32.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.221+0000 7f4200f7e640 1 -- 172.21.15.44:0/3046193281 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f8036070 con 0x7f41e80039b0 2024-09-21T09:02:32.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.221+0000 7f4200f7e640 1 -- 172.21.15.44:0/3046193281 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f80071a0 con 0x7f41e80039b0 2024-09-21T09:02:32.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.221+0000 7f4200f7e640 1 -- 172.21.15.44:0/3046193281 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f8007c20 con 0x7f41e80039b0 2024-09-21T09:02:32.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.221+0000 7f42041e4640 1 -- 172.21.15.44:0/3046193281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80039b0 msgr2=0x7f41e8003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:32.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.221+0000 7f42041e4640 1 --2- 172.21.15.44:0/3046193281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80039b0 0x7f41e8003db0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f41f8007f50 tx=0x7f41e8005830 comp rx=0 tx=0).stop 2024-09-21T09:02:32.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.221+0000 7f42041e4640 1 -- 172.21.15.44:0/3046193281 shutdown_connections 2024-09-21T09:02:32.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.221+0000 7f42041e4640 1 --2- 172.21.15.44:0/3046193281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80039b0 0x7f41e8003db0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:32.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.221+0000 7f42041e4640 1 --2- 172.21.15.44:0/3046193281 >> v2:172.21.15.44:3300/0 conn(0x7f41fc12bc50 0x7f41fc1338c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:32.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.222+0000 7f42041e4640 1 -- 172.21.15.44:0/3046193281 >> 172.21.15.44:0/3046193281 conn(0x7f41fc09ede0 msgr2=0x7f41fc09f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:32.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.222+0000 7f42041e4640 1 -- 172.21.15.44:0/3046193281 shutdown_connections 2024-09-21T09:02:32.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.222+0000 7f42041e4640 1 -- 172.21.15.44:0/3046193281 wait complete. 2024-09-21T09:02:32.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.222+0000 7f42041e4640 1 Processor -- start 2024-09-21T09:02:32.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.222+0000 7f42041e4640 1 -- start start 2024-09-21T09:02:32.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.223+0000 7f42041e4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80039b0 0x7f41fc1c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:32.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.223+0000 7f42041e4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc134190 con 0x7f41e80039b0 2024-09-21T09:02:32.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.223+0000 7f4201f80640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80039b0 0x7f41fc1c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:32.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.223+0000 7f4201f80640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80039b0 0x7f41fc1c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52428/0 (socket says 172.21.15.44:52428) 2024-09-21T09:02:32.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.223+0000 7f4201f80640 1 -- 172.21.15.44:0/481617352 learned_addr learned my addr 172.21.15.44:0/481617352 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:32.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.223+0000 7f4201f80640 1 -- 172.21.15.44:0/481617352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc12efc0 con 0x7f41e80039b0 2024-09-21T09:02:32.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.223+0000 7f4201f80640 1 --2- 172.21.15.44:0/481617352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80039b0 0x7f41fc1c34b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f41f8007f50 tx=0x7f41f8001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:32.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.224+0000 7f41f27fc640 1 -- 172.21.15.44:0/481617352 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f8036070 con 0x7f41e80039b0 2024-09-21T09:02:32.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.224+0000 7f41f27fc640 1 -- 172.21.15.44:0/481617352 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f8042070 con 0x7f41e80039b0 2024-09-21T09:02:32.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.224+0000 7f41f27fc640 1 -- 172.21.15.44:0/481617352 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f8004b20 con 0x7f41e80039b0 2024-09-21T09:02:32.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.224+0000 7f42041e4640 1 -- 172.21.15.44:0/481617352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41fc130800 con 0x7f41e80039b0 2024-09-21T09:02:32.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.224+0000 7f42041e4640 1 -- 172.21.15.44:0/481617352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41fc1c3bd0 con 0x7f41e80039b0 2024-09-21T09:02:32.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.224+0000 7f41f27fc640 1 -- 172.21.15.44:0/481617352 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f41f8004cc0 con 0x7f41e80039b0 2024-09-21T09:02:32.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.224+0000 7f41f27fc640 1 -- 172.21.15.44:0/481617352 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f41f803d430 con 0x7f41e80039b0 2024-09-21T09:02:32.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.225+0000 7f42041e4640 1 -- 172.21.15.44:0/481617352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41fc12f790 con 0x7f41e80039b0 2024-09-21T09:02:32.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.227+0000 7f41f27fc640 1 -- 172.21.15.44:0/481617352 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f41f8047460 con 0x7f41e80039b0 2024-09-21T09:02:32.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.290+0000 7f42041e4640 1 -- 172.21.15.44:0/481617352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f41fc12b4a0 con 0x7f41e80039b0 2024-09-21T09:02:32.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.291+0000 7f41f27fc640 1 -- 172.21.15.44:0/481617352 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f41f8047640 con 0x7f41e80039b0 2024-09-21T09:02:32.293 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2024-09-21T09:02:32.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.292+0000 7f42041e4640 1 -- 172.21.15.44:0/481617352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80039b0 msgr2=0x7f41fc1c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:32.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.292+0000 7f42041e4640 1 --2- 172.21.15.44:0/481617352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80039b0 0x7f41fc1c34b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f41f8007f50 tx=0x7f41f8001970 comp rx=0 tx=0).stop 2024-09-21T09:02:32.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.292+0000 7f42041e4640 1 -- 172.21.15.44:0/481617352 shutdown_connections 2024-09-21T09:02:32.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.292+0000 7f42041e4640 1 --2- 172.21.15.44:0/481617352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41e80039b0 0x7f41fc1c34b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:32.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.292+0000 7f42041e4640 1 -- 172.21.15.44:0/481617352 >> 172.21.15.44:0/481617352 conn(0x7f41fc09ede0 msgr2=0x7f41fc098620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:32.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.292+0000 7f42041e4640 1 -- 172.21.15.44:0/481617352 shutdown_connections 2024-09-21T09:02:32.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:32.292+0000 7f42041e4640 1 -- 172.21.15.44:0/481617352 wait complete. 2024-09-21T09:02:32.304 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T09:02:32.305 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T09:02:32.305 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T09:02:32.305 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T09:02:32.331 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:32.331 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T09:02:32.357 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:32.358 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T09:02:32.422 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T09:02:32.422 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T09:02:32.487 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 1fc5de68-f422-48c9-94eb-866cf7bdc692 0 2024-09-21T09:02:32.517 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:32.515+0000 7f31b6e17040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T09:02:32.560 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:32.558+0000 7f31b6e17040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T09:02:32.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.613+0000 7f8a4d1db640 1 Processor -- start 2024-09-21T09:02:32.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.613+0000 7f8a4d1db640 1 -- start start 2024-09-21T09:02:32.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.613+0000 7f8a4d1db640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8a4811ac10 0x7f8a4811d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:32.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.613+0000 7f8a4d1db640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4811d5d0 con 0x7f8a48117fb0 2024-09-21T09:02:32.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.613+0000 7f8a4d1db640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f8a4811e7b0 con 0x7f8a4811ac10 2024-09-21T09:02:32.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.613+0000 7f8a4659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8a4811ac10 0x7f8a4811d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:32.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.613+0000 7f8a4659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8a4811ac10 0x7f8a4811d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:52350/0 (socket says 172.21.15.178:52350) 2024-09-21T09:02:32.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.613+0000 7f8a4659c640 1 -- 172.21.15.178:0/308078287 learned_addr learned my addr 172.21.15.178:0/308078287 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:02:32.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.614+0000 7f8a4659c640 1 -- 172.21.15.178:0/308078287 >> v1:172.21.15.44:6789/0 conn(0x7f8a48117fb0 legacy=0x7f8a48118390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:32.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.614+0000 7f8a4659c640 1 -- 172.21.15.178:0/308078287 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4811e960 con 0x7f8a4811ac10 2024-09-21T09:02:32.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.614+0000 7f8a4659c640 1 --2- 172.21.15.178:0/308078287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a4811ac10 0x7f8a4811d000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0097f0 tx=0x7f8a3c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c2698c3a377d44 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:32.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.614+0000 7f8a45d9b640 1 -- 172.21.15.178:0/308078287 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a3c037070 con 0x7f8a4811ac10 2024-09-21T09:02:32.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.615+0000 7f8a45d9b640 1 -- 172.21.15.178:0/308078287 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a3c032440 con 0x7f8a4811ac10 2024-09-21T09:02:32.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.615+0000 7f8a45d9b640 1 -- 172.21.15.178:0/308078287 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a3c02ae60 con 0x7f8a4811ac10 2024-09-21T09:02:32.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.615+0000 7f8a4d1db640 1 -- 172.21.15.178:0/308078287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a4811ac10 msgr2=0x7f8a4811d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:32.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.615+0000 7f8a4d1db640 1 --2- 172.21.15.178:0/308078287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a4811ac10 0x7f8a4811d000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0097f0 tx=0x7f8a3c02a1e0 comp rx=0 tx=0).stop 2024-09-21T09:02:32.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.615+0000 7f8a4d1db640 1 -- 172.21.15.178:0/308078287 shutdown_connections 2024-09-21T09:02:32.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.615+0000 7f8a4d1db640 1 --2- 172.21.15.178:0/308078287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a4811ac10 0x7f8a4811d000 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:32.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.615+0000 7f8a4d1db640 1 -- 172.21.15.178:0/308078287 >> 172.21.15.178:0/308078287 conn(0x7f8a4806e5e0 msgr2=0x7f8a4806e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:32.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.615+0000 7f8a4d1db640 1 -- 172.21.15.178:0/308078287 shutdown_connections 2024-09-21T09:02:32.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.615+0000 7f8a4d1db640 1 -- 172.21.15.178:0/308078287 wait complete. 2024-09-21T09:02:32.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.616+0000 7f8a4d1db640 1 Processor -- start 2024-09-21T09:02:32.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.616+0000 7f8a4d1db640 1 -- start start 2024-09-21T09:02:32.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.616+0000 7f8a4d1db640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a48117fb0 0x7f8a481a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:32.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.616+0000 7f8a4d1db640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4811dcc0 con 0x7f8a48117fb0 2024-09-21T09:02:32.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.617+0000 7f8a46d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a48117fb0 0x7f8a481a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:32.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.617+0000 7f8a46d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a48117fb0 0x7f8a481a6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:52358/0 (socket says 172.21.15.178:52358) 2024-09-21T09:02:32.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.617+0000 7f8a46d9d640 1 -- 172.21.15.178:0/1715234435 learned_addr learned my addr 172.21.15.178:0/1715234435 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:02:32.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.617+0000 7f8a46d9d640 1 -- 172.21.15.178:0/1715234435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a481a71d0 con 0x7f8a48117fb0 2024-09-21T09:02:32.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.617+0000 7f8a46d9d640 1 --2- 172.21.15.178:0/1715234435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a48117fb0 0x7f8a481a6c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800c450 tx=0x7f8a3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:32.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.617+0000 7f8a2f7fe640 1 -- 172.21.15.178:0/1715234435 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a38017070 con 0x7f8a48117fb0 2024-09-21T09:02:32.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.617+0000 7f8a2f7fe640 1 -- 172.21.15.178:0/1715234435 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a38005220 con 0x7f8a48117fb0 2024-09-21T09:02:32.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.617+0000 7f8a4d1db640 1 -- 172.21.15.178:0/1715234435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a481a74c0 con 0x7f8a48117fb0 2024-09-21T09:02:32.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.617+0000 7f8a2f7fe640 1 -- 172.21.15.178:0/1715234435 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a380035f0 con 0x7f8a48117fb0 2024-09-21T09:02:32.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.617+0000 7f8a4d1db640 1 -- 172.21.15.178:0/1715234435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a481ab530 con 0x7f8a48117fb0 2024-09-21T09:02:32.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.617+0000 7f8a2f7fe640 1 -- 172.21.15.178:0/1715234435 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8a3801a070 con 0x7f8a48117fb0 2024-09-21T09:02:32.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.618+0000 7f8a2f7fe640 1 -- 172.21.15.178:0/1715234435 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f8a38003ad0 con 0x7f8a48117fb0 2024-09-21T09:02:32.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.618+0000 7f8a4d1db640 1 -- 172.21.15.178:0/1715234435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a481a76f0 con 0x7f8a48117fb0 2024-09-21T09:02:32.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.621+0000 7f8a2f7fe640 1 -- 172.21.15.178:0/1715234435 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8a38006df0 con 0x7f8a48117fb0 2024-09-21T09:02:32.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.690+0000 7f8a4d1db640 1 -- 172.21.15.178:0/1715234435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1fc5de68-f422-48c9-94eb-866cf7bdc692", "id": 0} v 0) -- 0x7f8a4811e280 con 0x7f8a48117fb0 2024-09-21T09:02:32.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.691+0000 7f8a2f7fe640 1 -- 172.21.15.178:0/1715234435 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1fc5de68-f422-48c9-94eb-866cf7bdc692", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f8a38003dd0 con 0x7f8a48117fb0 2024-09-21T09:02:32.693 INFO:teuthology.orchestra.run.smithi178.stdout:0 2024-09-21T09:02:32.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.692+0000 7f8a4d1db640 1 -- 172.21.15.178:0/1715234435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a48117fb0 msgr2=0x7f8a481a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:32.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.692+0000 7f8a4d1db640 1 --2- 172.21.15.178:0/1715234435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a48117fb0 0x7f8a481a6c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800c450 tx=0x7f8a3800c910 comp rx=0 tx=0).stop 2024-09-21T09:02:32.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.692+0000 7f8a4d1db640 1 -- 172.21.15.178:0/1715234435 shutdown_connections 2024-09-21T09:02:32.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.692+0000 7f8a4d1db640 1 --2- 172.21.15.178:0/1715234435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a48117fb0 0x7f8a481a6c00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:32.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.692+0000 7f8a4d1db640 1 -- 172.21.15.178:0/1715234435 >> 172.21.15.178:0/1715234435 conn(0x7f8a4806e5e0 msgr2=0x7f8a48110d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:32.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.692+0000 7f8a4d1db640 1 -- 172.21.15.178:0/1715234435 shutdown_connections 2024-09-21T09:02:32.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.692+0000 7f8a4d1db640 1 -- 172.21.15.178:0/1715234435 wait complete. 2024-09-21T09:02:32.702 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:32.701+0000 7f31b6e17040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T09:02:32.704 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 46978fe3-3a88-4346-8b7e-9a782c5d9510 1 2024-09-21T09:02:32.754 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:32.753+0000 7f31b6e17040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T09:02:32.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.842+0000 7efd696d2640 1 Processor -- start 2024-09-21T09:02:32.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.842+0000 7efd696d2640 1 -- start start 2024-09-21T09:02:32.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.842+0000 7efd696d2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efd64117fb0 0x7efd64118390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:32.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.842+0000 7efd696d2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd64112960 con 0x7efd64111da0 2024-09-21T09:02:32.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.842+0000 7efd696d2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7efd64118a50 con 0x7efd64117fb0 2024-09-21T09:02:32.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.842+0000 7efd62ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efd64117fb0 0x7efd64118390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:32.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.842+0000 7efd627fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efd64111da0 0x7efd64112250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:48350/0 (socket says 172.21.15.178:48350) 2024-09-21T09:02:32.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.842+0000 7efd627fc640 1 -- 172.21.15.178:0/2266199954 learned_addr learned my addr 172.21.15.178:0/2266199954 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:02:32.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.843+0000 7efd62ffd640 1 -- 172.21.15.178:0/2266199954 >> v1:172.21.15.44:6789/0 conn(0x7efd64111da0 legacy=0x7efd64112250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:32.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.843+0000 7efd61ffb640 1 -- 172.21.15.178:0/2266199954 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2966269108 0 0) 0x7efd64112960 con 0x7efd64111da0 2024-09-21T09:02:32.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.843+0000 7efd62ffd640 1 -- 172.21.15.178:0/2266199954 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd64112b30 con 0x7efd64117fb0 2024-09-21T09:02:32.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.844+0000 7efd62ffd640 1 --2- 172.21.15.178:0/2266199954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd64117fb0 0x7efd64118390 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efd54009720 tx=0x7efd5402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6712d9d4711e26c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:32.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.844+0000 7efd61ffb640 1 -- 172.21.15.178:0/2266199954 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd54037070 con 0x7efd64117fb0 2024-09-21T09:02:32.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.844+0000 7efd61ffb640 1 -- 172.21.15.178:0/2266199954 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd5402ad90 con 0x7efd64117fb0 2024-09-21T09:02:32.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.844+0000 7efd61ffb640 1 -- 172.21.15.178:0/2266199954 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd54032590 con 0x7efd64117fb0 2024-09-21T09:02:32.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.844+0000 7efd696d2640 1 -- 172.21.15.178:0/2266199954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd64117fb0 msgr2=0x7efd64118390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:32.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.844+0000 7efd696d2640 1 --2- 172.21.15.178:0/2266199954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd64117fb0 0x7efd64118390 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efd54009720 tx=0x7efd5402a110 comp rx=0 tx=0).stop 2024-09-21T09:02:32.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.844+0000 7efd696d2640 1 -- 172.21.15.178:0/2266199954 shutdown_connections 2024-09-21T09:02:32.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.844+0000 7efd696d2640 1 --2- 172.21.15.178:0/2266199954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd64117fb0 0x7efd64118390 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:32.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.844+0000 7efd696d2640 1 -- 172.21.15.178:0/2266199954 >> 172.21.15.178:0/2266199954 conn(0x7efd6406e5e0 msgr2=0x7efd6406e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:32.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.844+0000 7efd696d2640 1 -- 172.21.15.178:0/2266199954 shutdown_connections 2024-09-21T09:02:32.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.844+0000 7efd696d2640 1 -- 172.21.15.178:0/2266199954 wait complete. 2024-09-21T09:02:32.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.845+0000 7efd696d2640 1 Processor -- start 2024-09-21T09:02:32.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.845+0000 7efd696d2640 1 -- start start 2024-09-21T09:02:32.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.845+0000 7efd696d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd64111da0 0x7efd641a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:32.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.845+0000 7efd696d2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd6411e120 con 0x7efd64111da0 2024-09-21T09:02:32.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.846+0000 7efd62ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd64111da0 0x7efd641a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:32.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.846+0000 7efd62ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd64111da0 0x7efd641a6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:52372/0 (socket says 172.21.15.178:52372) 2024-09-21T09:02:32.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.846+0000 7efd62ffd640 1 -- 172.21.15.178:0/142721017 learned_addr learned my addr 172.21.15.178:0/142721017 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:02:32.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.846+0000 7efd62ffd640 1 -- 172.21.15.178:0/142721017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd641a6f20 con 0x7efd64111da0 2024-09-21T09:02:32.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.846+0000 7efd62ffd640 1 --2- 172.21.15.178:0/142721017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd64111da0 0x7efd641a6950 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efd54035040 tx=0x7efd540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:32.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.846+0000 7efd4b7fe640 1 -- 172.21.15.178:0/142721017 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd54037040 con 0x7efd64111da0 2024-09-21T09:02:32.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.847+0000 7efd4b7fe640 1 -- 172.21.15.178:0/142721017 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd54004030 con 0x7efd64111da0 2024-09-21T09:02:32.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.847+0000 7efd696d2640 1 -- 172.21.15.178:0/142721017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd641a7210 con 0x7efd64111da0 2024-09-21T09:02:32.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.847+0000 7efd4b7fe640 1 -- 172.21.15.178:0/142721017 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd54004350 con 0x7efd64111da0 2024-09-21T09:02:32.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.847+0000 7efd696d2640 1 -- 172.21.15.178:0/142721017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd641ab1e0 con 0x7efd64111da0 2024-09-21T09:02:32.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.847+0000 7efd4b7fe640 1 -- 172.21.15.178:0/142721017 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efd5403a040 con 0x7efd64111da0 2024-09-21T09:02:32.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.847+0000 7efd4b7fe640 1 -- 172.21.15.178:0/142721017 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7efd5403ec10 con 0x7efd64111da0 2024-09-21T09:02:32.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.847+0000 7efd696d2640 1 -- 172.21.15.178:0/142721017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd64118410 con 0x7efd64111da0 2024-09-21T09:02:32.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.850+0000 7efd4b7fe640 1 -- 172.21.15.178:0/142721017 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efd54042020 con 0x7efd64111da0 2024-09-21T09:02:32.919 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:32.917+0000 7f31b6e17040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T09:02:32.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.919+0000 7efd696d2640 1 -- 172.21.15.178:0/142721017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46978fe3-3a88-4346-8b7e-9a782c5d9510", "id": 1} v 0) -- 0x7efd64117fb0 con 0x7efd64111da0 2024-09-21T09:02:32.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.920+0000 7efd4b7fe640 1 -- 172.21.15.178:0/142721017 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46978fe3-3a88-4346-8b7e-9a782c5d9510", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7efd54003b30 con 0x7efd64111da0 2024-09-21T09:02:32.923 INFO:teuthology.orchestra.run.smithi178.stdout:1 2024-09-21T09:02:32.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.921+0000 7efd696d2640 1 -- 172.21.15.178:0/142721017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd64111da0 msgr2=0x7efd641a6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:32.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.921+0000 7efd696d2640 1 --2- 172.21.15.178:0/142721017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd64111da0 0x7efd641a6950 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efd54035040 tx=0x7efd540046c0 comp rx=0 tx=0).stop 2024-09-21T09:02:32.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.921+0000 7efd696d2640 1 -- 172.21.15.178:0/142721017 shutdown_connections 2024-09-21T09:02:32.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.921+0000 7efd696d2640 1 --2- 172.21.15.178:0/142721017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd64111da0 0x7efd641a6950 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:32.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.921+0000 7efd696d2640 1 -- 172.21.15.178:0/142721017 >> 172.21.15.178:0/142721017 conn(0x7efd6406e5e0 msgr2=0x7efd64113ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:32.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.922+0000 7efd696d2640 1 -- 172.21.15.178:0/142721017 shutdown_connections 2024-09-21T09:02:32.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:32.922+0000 7efd696d2640 1 -- 172.21.15.178:0/142721017 wait complete. 2024-09-21T09:02:32.934 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new eedae05b-7cc6-4b8f-9dce-c736c32d3c19 2 2024-09-21T09:02:33.036 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:33.034+0000 7f31b6e17040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T09:02:33.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.072+0000 7fd35f328640 1 Processor -- start 2024-09-21T09:02:33.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.072+0000 7fd35f328640 1 -- start start 2024-09-21T09:02:33.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.072+0000 7fd35f328640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd358117fb0 0x7fd358118390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:33.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.072+0000 7fd35f328640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd358112960 con 0x7fd358111da0 2024-09-21T09:02:33.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.072+0000 7fd35f328640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd358118a50 con 0x7fd358117fb0 2024-09-21T09:02:33.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.072+0000 7fd35d0c4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd358117fb0 0x7fd358118390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:33.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.072+0000 7fd35c8c3640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd358111da0 0x7fd358112250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:48362/0 (socket says 172.21.15.178:48362) 2024-09-21T09:02:33.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.072+0000 7fd35d0c4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd358117fb0 0x7fd358118390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:52384/0 (socket says 172.21.15.178:52384) 2024-09-21T09:02:33.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.072+0000 7fd35c8c3640 1 -- 172.21.15.178:0/2203217523 learned_addr learned my addr 172.21.15.178:0/2203217523 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:02:33.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.073+0000 7fd35d0c4640 1 -- 172.21.15.178:0/2203217523 >> v1:172.21.15.44:6789/0 conn(0x7fd358111da0 legacy=0x7fd358112250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:33.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.073+0000 7fd35d0c4640 1 -- 172.21.15.178:0/2203217523 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd358112b30 con 0x7fd358117fb0 2024-09-21T09:02:33.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.073+0000 7fd35d0c4640 1 --2- 172.21.15.178:0/2203217523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358117fb0 0x7fd358118390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd354009720 tx=0x7fd35402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db840f508806106d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:33.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.074+0000 7fd34ffff640 1 -- 172.21.15.178:0/2203217523 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd354037070 con 0x7fd358117fb0 2024-09-21T09:02:33.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.074+0000 7fd34ffff640 1 -- 172.21.15.178:0/2203217523 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35402ad90 con 0x7fd358117fb0 2024-09-21T09:02:33.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.074+0000 7fd34ffff640 1 -- 172.21.15.178:0/2203217523 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd354032590 con 0x7fd358117fb0 2024-09-21T09:02:33.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.074+0000 7fd35f328640 1 -- 172.21.15.178:0/2203217523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358117fb0 msgr2=0x7fd358118390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:33.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.074+0000 7fd35f328640 1 --2- 172.21.15.178:0/2203217523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358117fb0 0x7fd358118390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd354009720 tx=0x7fd35402a110 comp rx=0 tx=0).stop 2024-09-21T09:02:33.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.074+0000 7fd35f328640 1 -- 172.21.15.178:0/2203217523 shutdown_connections 2024-09-21T09:02:33.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.074+0000 7fd35f328640 1 --2- 172.21.15.178:0/2203217523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358117fb0 0x7fd358118390 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:33.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.074+0000 7fd35f328640 1 -- 172.21.15.178:0/2203217523 >> 172.21.15.178:0/2203217523 conn(0x7fd35806e5e0 msgr2=0x7fd35806e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:33.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.074+0000 7fd35f328640 1 -- 172.21.15.178:0/2203217523 shutdown_connections 2024-09-21T09:02:33.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.074+0000 7fd35f328640 1 -- 172.21.15.178:0/2203217523 wait complete. 2024-09-21T09:02:33.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.075+0000 7fd35f328640 1 Processor -- start 2024-09-21T09:02:33.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.075+0000 7fd35f328640 1 -- start start 2024-09-21T09:02:33.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.075+0000 7fd35f328640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358111da0 0x7fd3581a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:33.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.075+0000 7fd35f328640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd35811e120 con 0x7fd358111da0 2024-09-21T09:02:33.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.075+0000 7fd35d0c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358111da0 0x7fd3581a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:33.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.075+0000 7fd35d0c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358111da0 0x7fd3581a6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:52386/0 (socket says 172.21.15.178:52386) 2024-09-21T09:02:33.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.075+0000 7fd35d0c4640 1 -- 172.21.15.178:0/44022315 learned_addr learned my addr 172.21.15.178:0/44022315 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:02:33.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.076+0000 7fd35d0c4640 1 -- 172.21.15.178:0/44022315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3581a7180 con 0x7fd358111da0 2024-09-21T09:02:33.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.076+0000 7fd35d0c4640 1 --2- 172.21.15.178:0/44022315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358111da0 0x7fd3581a6bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd354009840 tx=0x7fd3540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:33.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.076+0000 7fd34dffb640 1 -- 172.21.15.178:0/44022315 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd354041070 con 0x7fd358111da0 2024-09-21T09:02:33.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.076+0000 7fd34dffb640 1 -- 172.21.15.178:0/44022315 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35403c460 con 0x7fd358111da0 2024-09-21T09:02:33.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.076+0000 7fd34dffb640 1 -- 172.21.15.178:0/44022315 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd354037040 con 0x7fd358111da0 2024-09-21T09:02:33.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.076+0000 7fd35f328640 1 -- 172.21.15.178:0/44022315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3581a7470 con 0x7fd358111da0 2024-09-21T09:02:33.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.076+0000 7fd35f328640 1 -- 172.21.15.178:0/44022315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3581ab460 con 0x7fd358111da0 2024-09-21T09:02:33.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.077+0000 7fd34dffb640 1 -- 172.21.15.178:0/44022315 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd354044070 con 0x7fd358111da0 2024-09-21T09:02:33.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.077+0000 7fd34dffb640 1 -- 172.21.15.178:0/44022315 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fd354046d20 con 0x7fd358111da0 2024-09-21T09:02:33.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.077+0000 7fd35f328640 1 -- 172.21.15.178:0/44022315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3581a76a0 con 0x7fd358111da0 2024-09-21T09:02:33.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.079+0000 7fd34dffb640 1 -- 172.21.15.178:0/44022315 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd354046450 con 0x7fd358111da0 2024-09-21T09:02:33.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.149+0000 7fd35f328640 1 -- 172.21.15.178:0/44022315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eedae05b-7cc6-4b8f-9dce-c736c32d3c19", "id": 2} v 0) -- 0x7fd358118410 con 0x7fd358111da0 2024-09-21T09:02:33.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.151+0000 7fd34dffb640 1 -- 172.21.15.178:0/44022315 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eedae05b-7cc6-4b8f-9dce-c736c32d3c19", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fd354046900 con 0x7fd358111da0 2024-09-21T09:02:33.153 INFO:teuthology.orchestra.run.smithi178.stdout:2 2024-09-21T09:02:33.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.152+0000 7fd35f328640 1 -- 172.21.15.178:0/44022315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358111da0 msgr2=0x7fd3581a6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:33.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.152+0000 7fd35f328640 1 --2- 172.21.15.178:0/44022315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358111da0 0x7fd3581a6bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd354009840 tx=0x7fd3540046c0 comp rx=0 tx=0).stop 2024-09-21T09:02:33.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.152+0000 7fd35f328640 1 -- 172.21.15.178:0/44022315 shutdown_connections 2024-09-21T09:02:33.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.152+0000 7fd35f328640 1 --2- 172.21.15.178:0/44022315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358111da0 0x7fd3581a6bb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:33.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.152+0000 7fd35f328640 1 -- 172.21.15.178:0/44022315 >> 172.21.15.178:0/44022315 conn(0x7fd35806e5e0 msgr2=0x7fd358113c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:33.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.152+0000 7fd35f328640 1 -- 172.21.15.178:0/44022315 shutdown_connections 2024-09-21T09:02:33.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.152+0000 7fd35f328640 1 -- 172.21.15.178:0/44022315 wait complete. 2024-09-21T09:02:33.164 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 45264942-4fad-46c1-85f7-67b9a1bbb25e 3 2024-09-21T09:02:33.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.259+0000 7f738bef8640 1 Processor -- start 2024-09-21T09:02:33.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.259+0000 7f738bef8640 1 -- start start 2024-09-21T09:02:33.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.260+0000 7f738bef8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f738411ac10 0x7f738411d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:33.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.260+0000 7f738bef8640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f738411d5d0 con 0x7f7384117fb0 2024-09-21T09:02:33.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.260+0000 7f738bef8640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f738411e7b0 con 0x7f738411ac10 2024-09-21T09:02:33.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.260+0000 7f7389493640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f738411ac10 0x7f738411d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:33.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.260+0000 7f7389493640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f738411ac10 0x7f738411d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:52398/0 (socket says 172.21.15.178:52398) 2024-09-21T09:02:33.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.260+0000 7f7389493640 1 -- 172.21.15.178:0/1324746468 learned_addr learned my addr 172.21.15.178:0/1324746468 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:02:33.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.260+0000 7f7389493640 1 -- 172.21.15.178:0/1324746468 >> v1:172.21.15.44:6789/0 conn(0x7f7384117fb0 legacy=0x7f7384118390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:33.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.260+0000 7f7389493640 1 -- 172.21.15.178:0/1324746468 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738411e960 con 0x7f738411ac10 2024-09-21T09:02:33.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.261+0000 7f7389493640 1 --2- 172.21.15.178:0/1324746468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f738411ac10 0x7f738411d000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f73740097f0 tx=0x7f737402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a0a22373686731 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:33.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.261+0000 7f7388c92640 1 -- 172.21.15.178:0/1324746468 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7374037070 con 0x7f738411ac10 2024-09-21T09:02:33.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.261+0000 7f7388c92640 1 -- 172.21.15.178:0/1324746468 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7374032440 con 0x7f738411ac10 2024-09-21T09:02:33.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.261+0000 7f7388c92640 1 -- 172.21.15.178:0/1324746468 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f737402ae60 con 0x7f738411ac10 2024-09-21T09:02:33.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.262+0000 7f738bef8640 1 -- 172.21.15.178:0/1324746468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f738411ac10 msgr2=0x7f738411d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:33.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.262+0000 7f738bef8640 1 --2- 172.21.15.178:0/1324746468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f738411ac10 0x7f738411d000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f73740097f0 tx=0x7f737402a1e0 comp rx=0 tx=0).stop 2024-09-21T09:02:33.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.262+0000 7f738bef8640 1 -- 172.21.15.178:0/1324746468 shutdown_connections 2024-09-21T09:02:33.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.262+0000 7f738bef8640 1 --2- 172.21.15.178:0/1324746468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f738411ac10 0x7f738411d000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:33.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.262+0000 7f738bef8640 1 -- 172.21.15.178:0/1324746468 >> 172.21.15.178:0/1324746468 conn(0x7f738406e5e0 msgr2=0x7f738406e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:33.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.262+0000 7f738bef8640 1 -- 172.21.15.178:0/1324746468 shutdown_connections 2024-09-21T09:02:33.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.262+0000 7f738bef8640 1 -- 172.21.15.178:0/1324746468 wait complete. 2024-09-21T09:02:33.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.262+0000 7f738bef8640 1 Processor -- start 2024-09-21T09:02:33.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.263+0000 7f738bef8640 1 -- start start 2024-09-21T09:02:33.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.263+0000 7f738bef8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7384117fb0 0x7f73841a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:33.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.263+0000 7f738bef8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f738411dcc0 con 0x7f7384117fb0 2024-09-21T09:02:33.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.263+0000 7f7389c94640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7384117fb0 0x7f73841a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:33.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.263+0000 7f7389c94640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7384117fb0 0x7f73841a6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:52400/0 (socket says 172.21.15.178:52400) 2024-09-21T09:02:33.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.263+0000 7f7389c94640 1 -- 172.21.15.178:0/480647757 learned_addr learned my addr 172.21.15.178:0/480647757 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:02:33.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.263+0000 7f7389c94640 1 -- 172.21.15.178:0/480647757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73841a71d0 con 0x7f7384117fb0 2024-09-21T09:02:33.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.263+0000 7f7389c94640 1 --2- 172.21.15.178:0/480647757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7384117fb0 0x7f73841a6c00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f738000c450 tx=0x7f738000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:33.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.264+0000 7f737a7fc640 1 -- 172.21.15.178:0/480647757 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7380017070 con 0x7f7384117fb0 2024-09-21T09:02:33.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.264+0000 7f737a7fc640 1 -- 172.21.15.178:0/480647757 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7380005220 con 0x7f7384117fb0 2024-09-21T09:02:33.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.264+0000 7f738bef8640 1 -- 172.21.15.178:0/480647757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73841a74c0 con 0x7f7384117fb0 2024-09-21T09:02:33.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.264+0000 7f737a7fc640 1 -- 172.21.15.178:0/480647757 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73800035f0 con 0x7f7384117fb0 2024-09-21T09:02:33.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.264+0000 7f738bef8640 1 -- 172.21.15.178:0/480647757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73841ab530 con 0x7f7384117fb0 2024-09-21T09:02:33.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.264+0000 7f737a7fc640 1 -- 172.21.15.178:0/480647757 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f738001a070 con 0x7f7384117fb0 2024-09-21T09:02:33.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.264+0000 7f737a7fc640 1 -- 172.21.15.178:0/480647757 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f7380012420 con 0x7f7384117fb0 2024-09-21T09:02:33.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.264+0000 7f738bef8640 1 -- 172.21.15.178:0/480647757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73841a76f0 con 0x7f7384117fb0 2024-09-21T09:02:33.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.267+0000 7f737a7fc640 1 -- 172.21.15.178:0/480647757 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7380021070 con 0x7f7384117fb0 2024-09-21T09:02:33.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.335+0000 7f738bef8640 1 -- 172.21.15.178:0/480647757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd new", "uuid": "45264942-4fad-46c1-85f7-67b9a1bbb25e", "id": 3} v 0) -- 0x7f738411e280 con 0x7f7384117fb0 2024-09-21T09:02:33.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.339+0000 7f737a7fc640 1 -- 172.21.15.178:0/480647757 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "45264942-4fad-46c1-85f7-67b9a1bbb25e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f7380011b20 con 0x7f7384117fb0 2024-09-21T09:02:33.341 INFO:teuthology.orchestra.run.smithi178.stdout:3 2024-09-21T09:02:33.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.340+0000 7f738bef8640 1 -- 172.21.15.178:0/480647757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7384117fb0 msgr2=0x7f73841a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:33.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.340+0000 7f738bef8640 1 --2- 172.21.15.178:0/480647757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7384117fb0 0x7f73841a6c00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f738000c450 tx=0x7f738000c910 comp rx=0 tx=0).stop 2024-09-21T09:02:33.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.340+0000 7f738bef8640 1 -- 172.21.15.178:0/480647757 shutdown_connections 2024-09-21T09:02:33.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.340+0000 7f738bef8640 1 --2- 172.21.15.178:0/480647757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7384117fb0 0x7f73841a6c00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:33.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.340+0000 7f738bef8640 1 -- 172.21.15.178:0/480647757 >> 172.21.15.178:0/480647757 conn(0x7f738406e5e0 msgr2=0x7f7384110d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:33.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.341+0000 7f738bef8640 1 -- 172.21.15.178:0/480647757 shutdown_connections 2024-09-21T09:02:33.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:33.341+0000 7f738bef8640 1 -- 172.21.15.178:0/480647757 wait complete. 2024-09-21T09:02:33.352 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T09:02:33.352 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T09:02:33.355 INFO:tasks.ceph.osd.0:Started 2024-09-21T09:02:33.355 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T09:02:33.355 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T09:02:33.357 INFO:tasks.ceph.osd.1:Started 2024-09-21T09:02:33.357 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T09:02:33.358 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T09:02:33.359 INFO:tasks.ceph.osd.2:Started 2024-09-21T09:02:33.360 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T09:02:33.360 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T09:02:33.362 INFO:tasks.ceph.osd.3:Started 2024-09-21T09:02:33.362 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T09:02:33.392 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:33.390+0000 7f31b6e17040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T09:02:33.449 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:33.447+0000 7f31b6e17040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T09:02:33.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.475+0000 7f9acdaf8640 1 Processor -- start 2024-09-21T09:02:33.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.475+0000 7f9acdaf8640 1 -- start start 2024-09-21T09:02:33.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.475+0000 7f9acdaf8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ac809bd50 0x7f9ac809c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:33.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.475+0000 7f9acdaf8640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac809d3b0 con 0x7f9ac809c670 2024-09-21T09:02:33.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.475+0000 7f9acdaf8640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac8098230 con 0x7f9ac809bd50 2024-09-21T09:02:33.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.475+0000 7f9ac77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ac809bd50 0x7f9ac809c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:33.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.475+0000 7f9ac6ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9ac809c670 0x7f9ac80990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58080/0 (socket says 172.21.15.44:58080) 2024-09-21T09:02:33.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.475+0000 7f9ac6ffd640 1 -- 172.21.15.44:0/2746063486 learned_addr learned my addr 172.21.15.44:0/2746063486 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:33.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.476+0000 7f9ac77fe640 1 -- 172.21.15.44:0/2746063486 >> v1:172.21.15.44:6789/0 conn(0x7f9ac809c670 legacy=0x7f9ac80990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:33.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.476+0000 7f9ac77fe640 1 -- 172.21.15.44:0/2746063486 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac80983e0 con 0x7f9ac809bd50 2024-09-21T09:02:33.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.476+0000 7f9ac67fc640 1 -- 172.21.15.44:0/2746063486 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414315715 0 0) 0x7f9abc001110 con 0x7f9ac809c670 2024-09-21T09:02:33.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.476+0000 7f9ac77fe640 1 --2- 172.21.15.44:0/2746063486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ac809bd50 0x7f9ac809c130 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009720 tx=0x7f9ab802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a188f9e5497b1e14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:33.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.477+0000 7f9ac67fc640 1 -- 172.21.15.44:0/2746063486 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ab8037070 con 0x7f9ac809bd50 2024-09-21T09:02:33.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.477+0000 7f9ac67fc640 1 -- 172.21.15.44:0/2746063486 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab802ad90 con 0x7f9ac809bd50 2024-09-21T09:02:33.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.477+0000 7f9ac67fc640 1 -- 172.21.15.44:0/2746063486 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ab8032590 con 0x7f9ac809bd50 2024-09-21T09:02:33.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.477+0000 7f9acdaf8640 1 -- 172.21.15.44:0/2746063486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ac809bd50 msgr2=0x7f9ac809c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:33.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.477+0000 7f9acdaf8640 1 --2- 172.21.15.44:0/2746063486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ac809bd50 0x7f9ac809c130 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009720 tx=0x7f9ab802a110 comp rx=0 tx=0).stop 2024-09-21T09:02:33.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.477+0000 7f9acdaf8640 1 -- 172.21.15.44:0/2746063486 shutdown_connections 2024-09-21T09:02:33.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.477+0000 7f9acdaf8640 1 --2- 172.21.15.44:0/2746063486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ac809bd50 0x7f9ac809c130 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:33.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.477+0000 7f9acdaf8640 1 -- 172.21.15.44:0/2746063486 >> 172.21.15.44:0/2746063486 conn(0x7f9ac806d4a0 msgr2=0x7f9ac806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:33.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.477+0000 7f9acdaf8640 1 -- 172.21.15.44:0/2746063486 shutdown_connections 2024-09-21T09:02:33.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.477+0000 7f9acdaf8640 1 -- 172.21.15.44:0/2746063486 wait complete. 2024-09-21T09:02:33.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.478+0000 7f9acdaf8640 1 Processor -- start 2024-09-21T09:02:33.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.478+0000 7f9acdaf8640 1 -- start start 2024-09-21T09:02:33.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.479+0000 7f9acdaf8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ac809bd50 0x7f9ac81b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:33.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.479+0000 7f9acdaf8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac8099b90 con 0x7f9ac809bd50 2024-09-21T09:02:33.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.479+0000 7f9ac77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ac809bd50 0x7f9ac81b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:33.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.479+0000 7f9ac77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ac809bd50 0x7f9ac81b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52450/0 (socket says 172.21.15.44:52450) 2024-09-21T09:02:33.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.479+0000 7f9ac77fe640 1 -- 172.21.15.44:0/3282582532 learned_addr learned my addr 172.21.15.44:0/3282582532 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:33.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.479+0000 7f9ac77fe640 1 -- 172.21.15.44:0/3282582532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac81b3020 con 0x7f9ac809bd50 2024-09-21T09:02:33.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.479+0000 7f9ac77fe640 1 --2- 172.21.15.44:0/3282582532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ac809bd50 0x7f9ac81b38b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009720 tx=0x7f9ab80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:33.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.479+0000 7f9aaffff640 1 -- 172.21.15.44:0/3282582532 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ab8041070 con 0x7f9ac809bd50 2024-09-21T09:02:33.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.479+0000 7f9aaffff640 1 -- 172.21.15.44:0/3282582532 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab803c460 con 0x7f9ac809bd50 2024-09-21T09:02:33.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.479+0000 7f9acdaf8640 1 -- 172.21.15.44:0/3282582532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac809a760 con 0x7f9ac809bd50 2024-09-21T09:02:33.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.479+0000 7f9aaffff640 1 -- 172.21.15.44:0/3282582532 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ab8037040 con 0x7f9ac809bd50 2024-09-21T09:02:33.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.479+0000 7f9acdaf8640 1 -- 172.21.15.44:0/3282582532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac81b28f0 con 0x7f9ac809bd50 2024-09-21T09:02:33.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.480+0000 7f9aaffff640 1 -- 172.21.15.44:0/3282582532 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ab8044070 con 0x7f9ac809bd50 2024-09-21T09:02:33.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.480+0000 7f9aaffff640 1 -- 172.21.15.44:0/3282582532 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f9ab8046be0 con 0x7f9ac809bd50 2024-09-21T09:02:33.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.480+0000 7f9acdaf8640 1 -- 172.21.15.44:0/3282582532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac81b2670 con 0x7f9ac809bd50 2024-09-21T09:02:33.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.482+0000 7f9aaffff640 1 -- 172.21.15.44:0/3282582532 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9ac81b3020 con 0x7f9ac809bd50 2024-09-21T09:02:33.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.542+0000 7f9acdaf8640 1 -- 172.21.15.44:0/3282582532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ac809a130 con 0x7f9ac809bd50 2024-09-21T09:02:33.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.543+0000 7f9aaffff640 1 -- 172.21.15.44:0/3282582532 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f9ab80468e0 con 0x7f9ac809bd50 2024-09-21T09:02:33.545 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":6,"fsid":"7bec7bbe-ddde-41dc-a98a-89578467409a","created":"2024-09-21T09:02:32.212507+0000","modified":"2024-09-21T09:02:33.337232+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T09:02:33.337232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1fc5de68-f422-48c9-94eb-866cf7bdc692","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"46978fe3-3a88-4346-8b7e-9a782c5d9510","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eedae05b-7cc6-4b8f-9dce-c736c32d3c19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"45264942-4fad-46c1-85f7-67b9a1bbb25e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:02:33.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.543+0000 7f9acdaf8640 1 -- 172.21.15.44:0/3282582532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ac809bd50 msgr2=0x7f9ac81b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:33.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.543+0000 7f9acdaf8640 1 --2- 172.21.15.44:0/3282582532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ac809bd50 0x7f9ac81b38b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009720 tx=0x7f9ab80046c0 comp rx=0 tx=0).stop 2024-09-21T09:02:33.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.543+0000 7f9acdaf8640 1 -- 172.21.15.44:0/3282582532 shutdown_connections 2024-09-21T09:02:33.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.543+0000 7f9acdaf8640 1 --2- 172.21.15.44:0/3282582532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ac809bd50 0x7f9ac81b38b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:33.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.543+0000 7f9acdaf8640 1 -- 172.21.15.44:0/3282582532 >> 172.21.15.44:0/3282582532 conn(0x7f9ac806d4a0 msgr2=0x7f9ac809eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:33.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.543+0000 7f9acdaf8640 1 -- 172.21.15.44:0/3282582532 shutdown_connections 2024-09-21T09:02:33.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:33.543+0000 7f9acdaf8640 1 -- 172.21.15.44:0/3282582532 wait complete. 2024-09-21T09:02:33.555 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T09:02:33.555 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T09:02:33.596 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:33.594+0000 7f31b6e17040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T09:02:33.958 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T09:02:34.054 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.052+0000 7f5e58e0e640 1 Processor -- start 2024-09-21T09:02:34.054 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.052+0000 7f5e58e0e640 1 -- start start 2024-09-21T09:02:34.055 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.052+0000 7f5e58e0e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5e5412b460 0x7f5e5412b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:34.055 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.052+0000 7f5e58e0e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e54071980 con 0x7f5e5412e550 2024-09-21T09:02:34.055 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.052+0000 7f5e58e0e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f5e54071d20 con 0x7f5e5412b460 2024-09-21T09:02:34.055 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.053+0000 7f5e5259c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5e5412b460 0x7f5e5412b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:34.055 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.053+0000 7f5e51d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5e5412e550 0x7f5e5412e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58082/0 (socket says 172.21.15.44:58082) 2024-09-21T09:02:34.055 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.053+0000 7f5e51d9b640 1 -- 172.21.15.44:0/1055626071 learned_addr learned my addr 172.21.15.44:0/1055626071 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:34.055 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.053+0000 7f5e5259c640 1 -- 172.21.15.44:0/1055626071 >> v1:172.21.15.44:6789/0 conn(0x7f5e5412e550 legacy=0x7f5e5412e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:34.056 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.053+0000 7f5e5259c640 1 -- 172.21.15.44:0/1055626071 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5409ace0 con 0x7f5e5412b460 2024-09-21T09:02:34.056 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.053+0000 7f5e5159a640 1 -- 172.21.15.44:0/1055626071 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908653041 0 0) 0x7f5e54071980 con 0x7f5e5412e550 2024-09-21T09:02:34.056 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.054+0000 7f5e5259c640 1 --2- 172.21.15.44:0/1055626071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e5412b460 0x7f5e5412b840 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5e54071b50 tx=0x7f5e4402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743ad5fbb484535 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:34.057 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.054+0000 7f5e5159a640 1 -- 172.21.15.44:0/1055626071 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e44037070 con 0x7f5e5412b460 2024-09-21T09:02:34.057 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.054+0000 7f5e5159a640 1 -- 172.21.15.44:0/1055626071 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e4402ad90 con 0x7f5e5412b460 2024-09-21T09:02:34.057 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.054+0000 7f5e5159a640 1 -- 172.21.15.44:0/1055626071 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e44032590 con 0x7f5e5412b460 2024-09-21T09:02:34.057 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.054+0000 7f5e58e0e640 1 -- 172.21.15.44:0/1055626071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e5412b460 msgr2=0x7f5e5412b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:34.057 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.054+0000 7f5e58e0e640 1 --2- 172.21.15.44:0/1055626071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e5412b460 0x7f5e5412b840 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5e54071b50 tx=0x7f5e4402a110 comp rx=0 tx=0).stop 2024-09-21T09:02:34.057 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.054+0000 7f5e58e0e640 1 -- 172.21.15.44:0/1055626071 shutdown_connections 2024-09-21T09:02:34.057 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.054+0000 7f5e58e0e640 1 --2- 172.21.15.44:0/1055626071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e5412b460 0x7f5e5412b840 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:34.057 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.054+0000 7f5e58e0e640 1 -- 172.21.15.44:0/1055626071 >> 172.21.15.44:0/1055626071 conn(0x7f5e54099a00 msgr2=0x7f5e54099e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:34.057 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.054+0000 7f5e58e0e640 1 -- 172.21.15.44:0/1055626071 shutdown_connections 2024-09-21T09:02:34.057 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.054+0000 7f5e58e0e640 1 -- 172.21.15.44:0/1055626071 wait complete. 2024-09-21T09:02:34.057 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.055+0000 7f5e58e0e640 1 Processor -- start 2024-09-21T09:02:34.058 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.055+0000 7f5e58e0e640 1 -- start start 2024-09-21T09:02:34.059 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.056+0000 7f5e58e0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e5412b460 0x7f5e5411e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:34.059 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.056+0000 7f5e58e0e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5412bf00 con 0x7f5e5412b460 2024-09-21T09:02:34.059 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.056+0000 7f5e5259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e5412b460 0x7f5e5411e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:34.059 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.056+0000 7f5e5259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e5412b460 0x7f5e5411e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52466/0 (socket says 172.21.15.44:52466) 2024-09-21T09:02:34.059 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.056+0000 7f5e5259c640 1 -- 172.21.15.44:0/4212933615 learned_addr learned my addr 172.21.15.44:0/4212933615 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:34.059 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.056+0000 7f5e5259c640 1 -- 172.21.15.44:0/4212933615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e54073440 con 0x7f5e5412b460 2024-09-21T09:02:34.059 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.056+0000 7f5e5259c640 1 --2- 172.21.15.44:0/4212933615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e5412b460 0x7f5e5411e960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009810 tx=0x7f5e440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:34.060 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.056+0000 7f5e42ffd640 1 -- 172.21.15.44:0/4212933615 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e44041070 con 0x7f5e5412b460 2024-09-21T09:02:34.060 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.056+0000 7f5e42ffd640 1 -- 172.21.15.44:0/4212933615 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e4403c460 con 0x7f5e5412b460 2024-09-21T09:02:34.060 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.056+0000 7f5e58e0e640 1 -- 172.21.15.44:0/4212933615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e541213a0 con 0x7f5e5412b460 2024-09-21T09:02:34.060 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.057+0000 7f5e42ffd640 1 -- 172.21.15.44:0/4212933615 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e44037040 con 0x7f5e5412b460 2024-09-21T09:02:34.060 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.057+0000 7f5e58e0e640 1 -- 172.21.15.44:0/4212933615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e5411eea0 con 0x7f5e5412b460 2024-09-21T09:02:34.060 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.057+0000 7f5e42ffd640 1 -- 172.21.15.44:0/4212933615 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5e44044070 con 0x7f5e5412b460 2024-09-21T09:02:34.060 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.057+0000 7f5e42ffd640 1 -- 172.21.15.44:0/4212933615 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f5e44046dc0 con 0x7f5e5412b460 2024-09-21T09:02:34.060 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.058+0000 7f5e58e0e640 1 -- 172.21.15.44:0/4212933615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e54120270 con 0x7f5e5412b460 2024-09-21T09:02:34.061 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.060+0000 7f5e42ffd640 1 -- 172.21.15.44:0/4212933615 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5e44046450 con 0x7f5e5412b460 2024-09-21T09:02:34.121 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.119+0000 7f5e58e0e640 1 -- 172.21.15.44:0/4212933615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e5412b840 con 0x7f5e5412b460 2024-09-21T09:02:34.121 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.119+0000 7f5e42ffd640 1 -- 172.21.15.44:0/4212933615 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f5e440468b0 con 0x7f5e5412b460 2024-09-21T09:02:34.121 INFO:teuthology.misc.health.smithi044.stdout: 2024-09-21T09:02:34.121 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":6,"fsid":"7bec7bbe-ddde-41dc-a98a-89578467409a","created":"2024-09-21T09:02:32.212507+0000","modified":"2024-09-21T09:02:33.337232+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T09:02:33.337232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1fc5de68-f422-48c9-94eb-866cf7bdc692","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"46978fe3-3a88-4346-8b7e-9a782c5d9510","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eedae05b-7cc6-4b8f-9dce-c736c32d3c19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"45264942-4fad-46c1-85f7-67b9a1bbb25e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:02:34.122 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.120+0000 7f5e58e0e640 1 -- 172.21.15.44:0/4212933615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e5412b460 msgr2=0x7f5e5411e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:34.122 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.120+0000 7f5e58e0e640 1 --2- 172.21.15.44:0/4212933615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e5412b460 0x7f5e5411e960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009810 tx=0x7f5e440046c0 comp rx=0 tx=0).stop 2024-09-21T09:02:34.122 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.120+0000 7f5e58e0e640 1 -- 172.21.15.44:0/4212933615 shutdown_connections 2024-09-21T09:02:34.122 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.120+0000 7f5e58e0e640 1 --2- 172.21.15.44:0/4212933615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e5412b460 0x7f5e5411e960 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:34.122 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.120+0000 7f5e58e0e640 1 -- 172.21.15.44:0/4212933615 >> 172.21.15.44:0/4212933615 conn(0x7f5e54099a00 msgr2=0x7f5e5409bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:34.123 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.120+0000 7f5e58e0e640 1 -- 172.21.15.44:0/4212933615 shutdown_connections 2024-09-21T09:02:34.123 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:34.120+0000 7f5e58e0e640 1 -- 172.21.15.44:0/4212933615 wait complete. 2024-09-21T09:02:34.131 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-21T09:02:34.521 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:34.519+0000 7f31b6e17040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T09:02:34.579 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:34.573+0000 7f31b6e17040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T09:02:34.789 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-21T09:02:34.787+0000 7f4d9289c640 -1 Falling back to public interface 2024-09-21T09:02:34.831 INFO:tasks.ceph.osd.1.smithi178.stderr:2024-09-21T09:02:34.829+0000 7f3fa8420640 -1 Falling back to public interface 2024-09-21T09:02:34.940 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:34.939+0000 7f31b6e17040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-21T09:02:35.025 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:35.023+0000 7f31b6e17040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T09:02:35.047 INFO:tasks.ceph.osd.3.smithi178.stderr:2024-09-21T09:02:35.045+0000 7f59b7a0d640 -1 Falling back to public interface 2024-09-21T09:02:35.087 INFO:tasks.ceph.osd.2.smithi178.stderr:2024-09-21T09:02:35.085+0000 7fd0f181e640 -1 Falling back to public interface 2024-09-21T09:02:35.135 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:35.133+0000 7f31b6e17040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T09:02:35.181 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:35.179+0000 7f31b6e17040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T09:02:35.293 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:35.291+0000 7f31b6e17040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-21T09:02:35.346 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:35.345+0000 7f31b6e17040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T09:02:35.393 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:35.391+0000 7f31b6e17040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T09:02:35.504 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:35.502+0000 7f31b6e17040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T09:02:35.553 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:35.551+0000 7f31b6e17040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T09:02:35.604 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:35.603+0000 7f31b6e17040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T09:02:35.673 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:35.672+0000 7f31b6e17040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T09:02:35.718 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:35.716+0000 7f31b6e17040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T09:02:35.761 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:35.760+0000 7f31b6e17040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T09:02:36.416 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:36.414+0000 7f31b6e17040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T09:02:37.425 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-21T09:02:37.424+0000 7f3156a77640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-21T09:02:38.552 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-21T09:02:38.550+0000 7f4d9289c640 -1 osd.0 0 log_to_monitors true 2024-09-21T09:02:38.635 INFO:tasks.ceph.osd.1.smithi178.stderr:2024-09-21T09:02:38.633+0000 7f3fa8420640 -1 osd.1 0 log_to_monitors true 2024-09-21T09:02:39.403 INFO:tasks.ceph.osd.2.smithi178.stderr:2024-09-21T09:02:39.401+0000 7fd0f181e640 -1 osd.2 0 log_to_monitors true 2024-09-21T09:02:39.584 INFO:tasks.ceph.osd.3.smithi178.stderr:2024-09-21T09:02:39.582+0000 7f59b7a0d640 -1 osd.3 0 log_to_monitors true 2024-09-21T09:02:40.534 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T09:02:40.638 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.636+0000 7f5af553b640 1 Processor -- start 2024-09-21T09:02:40.638 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.636+0000 7f5af553b640 1 -- start start 2024-09-21T09:02:40.639 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.637+0000 7f5af553b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5af0097950 0x7f5af0097d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:40.639 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.637+0000 7f5af553b640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af009ad10 con 0x7f5af00989f0 2024-09-21T09:02:40.639 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.637+0000 7f5af553b640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f5af009aae0 con 0x7f5af0097950 2024-09-21T09:02:40.639 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.637+0000 7f5aeeffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5af0097950 0x7f5af0097d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:40.639 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.637+0000 7f5aeeffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5af0097950 0x7f5af0097d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41656/0 (socket says 172.21.15.44:41656) 2024-09-21T09:02:40.639 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.637+0000 7f5aeeffd640 1 -- 172.21.15.44:0/416523105 learned_addr learned my addr 172.21.15.44:0/416523105 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:40.639 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.637+0000 7f5aee7fc640 1 --1- 172.21.15.44:0/416523105 >> v1:172.21.15.44:6789/0 conn(0x7f5af00989f0 0x7f5af0098e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36806/0 (socket says 172.21.15.44:36806) 2024-09-21T09:02:40.639 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.637+0000 7f5aeeffd640 1 -- 172.21.15.44:0/416523105 >> v1:172.21.15.44:6789/0 conn(0x7f5af00989f0 legacy=0x7f5af0098e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:40.640 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.637+0000 7f5aeeffd640 1 -- 172.21.15.44:0/416523105 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af0099510 con 0x7f5af0097950 2024-09-21T09:02:40.640 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.638+0000 7f5aeeffd640 1 --2- 172.21.15.44:0/416523105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5af0097950 0x7f5af0097d30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00097f0 tx=0x7f5ae002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442facf81b4f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:40.641 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.638+0000 7f5aedffb640 1 -- 172.21.15.44:0/416523105 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae0037070 con 0x7f5af0097950 2024-09-21T09:02:40.641 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.638+0000 7f5aedffb640 1 -- 172.21.15.44:0/416523105 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae0032440 con 0x7f5af0097950 2024-09-21T09:02:40.641 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.638+0000 7f5aedffb640 1 -- 172.21.15.44:0/416523105 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae002ae60 con 0x7f5af0097950 2024-09-21T09:02:40.641 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.639+0000 7f5af553b640 1 -- 172.21.15.44:0/416523105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5af0097950 msgr2=0x7f5af0097d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:40.641 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.639+0000 7f5af553b640 1 --2- 172.21.15.44:0/416523105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5af0097950 0x7f5af0097d30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00097f0 tx=0x7f5ae002a1e0 comp rx=0 tx=0).stop 2024-09-21T09:02:40.641 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.639+0000 7f5af553b640 1 -- 172.21.15.44:0/416523105 shutdown_connections 2024-09-21T09:02:40.641 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.639+0000 7f5af553b640 1 --2- 172.21.15.44:0/416523105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5af0097950 0x7f5af0097d30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:40.641 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.639+0000 7f5af553b640 1 -- 172.21.15.44:0/416523105 >> 172.21.15.44:0/416523105 conn(0x7f5af009f220 msgr2=0x7f5af009f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:40.641 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.639+0000 7f5af553b640 1 -- 172.21.15.44:0/416523105 shutdown_connections 2024-09-21T09:02:40.641 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.639+0000 7f5af553b640 1 -- 172.21.15.44:0/416523105 wait complete. 2024-09-21T09:02:40.642 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.640+0000 7f5af553b640 1 Processor -- start 2024-09-21T09:02:40.642 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.640+0000 7f5af553b640 1 -- start start 2024-09-21T09:02:40.642 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.640+0000 7f5af553b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5af0097950 0x7f5af008f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:40.642 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.640+0000 7f5af553b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0099c60 con 0x7f5af0097950 2024-09-21T09:02:40.643 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.641+0000 7f5aeeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5af0097950 0x7f5af008f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:40.643 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.641+0000 7f5aeeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5af0097950 0x7f5af008f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41664/0 (socket says 172.21.15.44:41664) 2024-09-21T09:02:40.643 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.641+0000 7f5aeeffd640 1 -- 172.21.15.44:0/284179666 learned_addr learned my addr 172.21.15.44:0/284179666 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:40.643 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.641+0000 7f5aeeffd640 1 -- 172.21.15.44:0/284179666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af0090980 con 0x7f5af0097950 2024-09-21T09:02:40.643 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.641+0000 7f5aeeffd640 1 --2- 172.21.15.44:0/284179666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5af0097950 0x7f5af008f3a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0035040 tx=0x7f5ae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:40.643 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.641+0000 7f5ad77fe640 1 -- 172.21.15.44:0/284179666 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae0041020 con 0x7f5af0097950 2024-09-21T09:02:40.643 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.641+0000 7f5ad77fe640 1 -- 172.21.15.44:0/284179666 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae00306c0 con 0x7f5af0097950 2024-09-21T09:02:40.644 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.641+0000 7f5ad77fe640 1 -- 172.21.15.44:0/284179666 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae0037040 con 0x7f5af0097950 2024-09-21T09:02:40.644 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.641+0000 7f5af553b640 1 -- 172.21.15.44:0/284179666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af0072d10 con 0x7f5af0097950 2024-09-21T09:02:40.644 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.641+0000 7f5af553b640 1 -- 172.21.15.44:0/284179666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af0091620 con 0x7f5af0097950 2024-09-21T09:02:40.644 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.642+0000 7f5ad77fe640 1 -- 172.21.15.44:0/284179666 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 45681+0+0 (secure 0 0 0) 0x7f5ae0044020 con 0x7f5af0097950 2024-09-21T09:02:40.644 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.642+0000 7f5ad77fe640 1 --2- 172.21.15.44:0/284179666 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5adc038210 0x7f5adc03a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:40.645 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.642+0000 7f5ad77fe640 1 -- 172.21.15.44:0/284179666 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1607+0+0 (secure 0 0 0) 0x7f5ae006b320 con 0x7f5af0097950 2024-09-21T09:02:40.645 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.642+0000 7f5aee7fc640 1 --2- 172.21.15.44:0/284179666 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5adc038210 0x7f5adc03a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:40.645 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.642+0000 7f5af553b640 1 -- 172.21.15.44:0/284179666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af0097d30 con 0x7f5af0097950 2024-09-21T09:02:40.645 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.643+0000 7f5aee7fc640 1 --2- 172.21.15.44:0/284179666 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5adc038210 0x7f5adc03a6d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4001550 tx=0x7f5ae4007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:40.649 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.648+0000 7f5ad77fe640 1 -- 172.21.15.44:0/284179666 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5ae004b030 con 0x7f5af0097950 2024-09-21T09:02:40.857 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.855+0000 7f5af553b640 1 -- 172.21.15.44:0/284179666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5af00756c0 con 0x7f5af0097950 2024-09-21T09:02:40.858 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.856+0000 7f5ad77fe640 1 -- 172.21.15.44:0/284179666 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7f5ae00459f0 con 0x7f5af0097950 2024-09-21T09:02:40.858 INFO:teuthology.misc.health.smithi044.stdout: 2024-09-21T09:02:40.859 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":8,"fsid":"7bec7bbe-ddde-41dc-a98a-89578467409a","created":"2024-09-21T09:02:32.212507+0000","modified":"2024-09-21T09:02:40.426292+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T09:02:33.337232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1fc5de68-f422-48c9-94eb-866cf7bdc692","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"46978fe3-3a88-4346-8b7e-9a782c5d9510","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eedae05b-7cc6-4b8f-9dce-c736c32d3c19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"45264942-4fad-46c1-85f7-67b9a1bbb25e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:02:40.861 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.858+0000 7f5af553b640 1 -- 172.21.15.44:0/284179666 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5adc038210 msgr2=0x7f5adc03a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:40.861 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.858+0000 7f5af553b640 1 --2- 172.21.15.44:0/284179666 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5adc038210 0x7f5adc03a6d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4001550 tx=0x7f5ae4007a40 comp rx=0 tx=0).stop 2024-09-21T09:02:40.861 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.858+0000 7f5af553b640 1 -- 172.21.15.44:0/284179666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5af0097950 msgr2=0x7f5af008f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:40.861 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.858+0000 7f5af553b640 1 --2- 172.21.15.44:0/284179666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5af0097950 0x7f5af008f3a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0035040 tx=0x7f5ae00046c0 comp rx=0 tx=0).stop 2024-09-21T09:02:40.861 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.858+0000 7f5af553b640 1 -- 172.21.15.44:0/284179666 shutdown_connections 2024-09-21T09:02:40.861 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.858+0000 7f5af553b640 1 --2- 172.21.15.44:0/284179666 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5adc038210 0x7f5adc03a6d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:40.861 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.858+0000 7f5af553b640 1 --2- 172.21.15.44:0/284179666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5af0097950 0x7f5af008f3a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:40.861 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.858+0000 7f5af553b640 1 -- 172.21.15.44:0/284179666 >> 172.21.15.44:0/284179666 conn(0x7f5af009f220 msgr2=0x7f5af012b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:40.861 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.858+0000 7f5af553b640 1 -- 172.21.15.44:0/284179666 shutdown_connections 2024-09-21T09:02:40.861 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:40.858+0000 7f5af553b640 1 -- 172.21.15.44:0/284179666 wait complete. 2024-09-21T09:02:40.870 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-21T09:02:41.347 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-21T09:02:41.346+0000 7f4d8e008640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T09:02:41.360 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-21T09:02:41.359+0000 7f4d8663a640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T09:02:41.363 INFO:tasks.ceph.osd.2.smithi178.stderr:2024-09-21T09:02:41.362+0000 7fd0eda20640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T09:02:41.364 INFO:tasks.ceph.osd.1.smithi178.stderr:2024-09-21T09:02:41.363+0000 7f3fa3b8c640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T09:02:41.373 INFO:tasks.ceph.osd.2.smithi178.stderr:2024-09-21T09:02:41.372+0000 7fd0e501b640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T09:02:41.378 INFO:tasks.ceph.osd.1.smithi178.stderr:2024-09-21T09:02:41.377+0000 7f3f9c1be640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T09:02:42.124 INFO:tasks.ceph.osd.3.smithi178.stderr:2024-09-21T09:02:42.122+0000 7f59b2c28640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T09:02:42.140 INFO:tasks.ceph.osd.3.smithi178.stderr:2024-09-21T09:02:42.139+0000 7f59ab25a640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T09:02:47.274 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T09:02:47.379 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.377+0000 7fc8be23c640 1 Processor -- start 2024-09-21T09:02:47.380 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.377+0000 7fc8be23c640 1 -- start start 2024-09-21T09:02:47.380 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.378+0000 7fc8be23c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc8b8128310 0x7fc8b8094540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:47.380 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.378+0000 7fc8be23c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b8127ec0 con 0x7fc8b81286f0 2024-09-21T09:02:47.380 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.378+0000 7fc8be23c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b806e430 con 0x7fc8b8128310 2024-09-21T09:02:47.380 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.378+0000 7fc8b77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc8b8128310 0x7fc8b8094540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:47.380 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.378+0000 7fc8b6ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc8b81286f0 0x7fc8b8095d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36814/0 (socket says 172.21.15.44:36814) 2024-09-21T09:02:47.380 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.378+0000 7fc8b6ffd640 1 -- 172.21.15.44:0/2781358439 learned_addr learned my addr 172.21.15.44:0/2781358439 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:47.380 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.378+0000 7fc8b77fe640 1 --2- 172.21.15.44:0/2781358439 >> v2:172.21.15.44:3300/0 conn(0x7fc8b8128310 0x7fc8b8094540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41676/0 (socket says 172.21.15.44:41676) 2024-09-21T09:02:47.381 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.378+0000 7fc8b77fe640 1 -- 172.21.15.44:0/2781358439 >> v1:172.21.15.44:6789/0 conn(0x7fc8b81286f0 legacy=0x7fc8b8095d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:47.381 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.378+0000 7fc8b77fe640 1 -- 172.21.15.44:0/2781358439 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b806dac0 con 0x7fc8b8128310 2024-09-21T09:02:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.378+0000 7fc8b67fc640 1 -- 172.21.15.44:0/2781358439 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4175998461 0 0) 0x7fc8b8127ec0 con 0x7fc8b81286f0 2024-09-21T09:02:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.379+0000 7fc8b77fe640 1 --2- 172.21.15.44:0/2781358439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b8128310 0x7fc8b8094540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800b9c0 tx=0x7fc8a802c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45dbb4b51efc2993 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.379+0000 7fc8b67fc640 1 -- 172.21.15.44:0/2781358439 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a8031640 con 0x7fc8b8128310 2024-09-21T09:02:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.379+0000 7fc8b67fc640 1 -- 172.21.15.44:0/2781358439 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a80317e0 con 0x7fc8b8128310 2024-09-21T09:02:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.379+0000 7fc8b67fc640 1 -- 172.21.15.44:0/2781358439 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a8031ae0 con 0x7fc8b8128310 2024-09-21T09:02:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.379+0000 7fc8be23c640 1 -- 172.21.15.44:0/2781358439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b8128310 msgr2=0x7fc8b8094540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.379+0000 7fc8be23c640 1 --2- 172.21.15.44:0/2781358439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b8128310 0x7fc8b8094540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800b9c0 tx=0x7fc8a802c7e0 comp rx=0 tx=0).stop 2024-09-21T09:02:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.380+0000 7fc8be23c640 1 -- 172.21.15.44:0/2781358439 shutdown_connections 2024-09-21T09:02:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.380+0000 7fc8be23c640 1 --2- 172.21.15.44:0/2781358439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b8128310 0x7fc8b8094540 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.380+0000 7fc8be23c640 1 -- 172.21.15.44:0/2781358439 >> 172.21.15.44:0/2781358439 conn(0x7fc8b809ac90 msgr2=0x7fc8b809b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.380+0000 7fc8be23c640 1 -- 172.21.15.44:0/2781358439 shutdown_connections 2024-09-21T09:02:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.380+0000 7fc8be23c640 1 -- 172.21.15.44:0/2781358439 wait complete. 2024-09-21T09:02:47.384 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.380+0000 7fc8be23c640 1 Processor -- start 2024-09-21T09:02:47.384 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.381+0000 7fc8be23c640 1 -- start start 2024-09-21T09:02:47.384 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.381+0000 7fc8be23c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b8128310 0x7fc8b81bf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:47.384 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.381+0000 7fc8be23c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8096590 con 0x7fc8b8128310 2024-09-21T09:02:47.384 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.381+0000 7fc8b77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b8128310 0x7fc8b81bf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:47.384 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.381+0000 7fc8b77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b8128310 0x7fc8b81bf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41688/0 (socket says 172.21.15.44:41688) 2024-09-21T09:02:47.384 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.381+0000 7fc8b77fe640 1 -- 172.21.15.44:0/1851120514 learned_addr learned my addr 172.21.15.44:0/1851120514 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:47.384 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.381+0000 7fc8b77fe640 1 -- 172.21.15.44:0/1851120514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b8125710 con 0x7fc8b8128310 2024-09-21T09:02:47.384 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.382+0000 7fc8b77fe640 1 --2- 172.21.15.44:0/1851120514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b8128310 0x7fc8b81bf210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8000c00 tx=0x7fc8a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:47.385 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.382+0000 7fc89ffff640 1 -- 172.21.15.44:0/1851120514 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a8033be0 con 0x7fc8b8128310 2024-09-21T09:02:47.385 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.382+0000 7fc89ffff640 1 -- 172.21.15.44:0/1851120514 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a8033da0 con 0x7fc8b8128310 2024-09-21T09:02:47.385 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.382+0000 7fc8be23c640 1 -- 172.21.15.44:0/1851120514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b8127290 con 0x7fc8b8128310 2024-09-21T09:02:47.385 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.382+0000 7fc89ffff640 1 -- 172.21.15.44:0/1851120514 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a803e590 con 0x7fc8b8128310 2024-09-21T09:02:47.385 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.382+0000 7fc8be23c640 1 -- 172.21.15.44:0/1851120514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b81bf750 con 0x7fc8b8128310 2024-09-21T09:02:47.386 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.383+0000 7fc89ffff640 1 -- 172.21.15.44:0/1851120514 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc8a803b040 con 0x7fc8b8128310 2024-09-21T09:02:47.386 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.383+0000 7fc8be23c640 1 -- 172.21.15.44:0/1851120514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b80954e0 con 0x7fc8b8128310 2024-09-21T09:02:47.386 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.383+0000 7fc89ffff640 1 --2- 172.21.15.44:0/1851120514 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc8a40382a0 0x7fc8a403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:47.386 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.383+0000 7fc89ffff640 1 -- 172.21.15.44:0/1851120514 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7fc8a806e990 con 0x7fc8b8128310 2024-09-21T09:02:47.386 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.383+0000 7fc8b6ffd640 1 --2- 172.21.15.44:0/1851120514 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc8a40382a0 0x7fc8a403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:47.386 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.384+0000 7fc8b6ffd640 1 --2- 172.21.15.44:0/1851120514 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc8a40382a0 0x7fc8a403a760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac005880 tx=0x7fc8ac007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:47.390 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.388+0000 7fc89ffff640 1 -- 172.21.15.44:0/1851120514 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc8b80954e0 con 0x7fc8b8128310 2024-09-21T09:02:47.569 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.567+0000 7fc8be23c640 1 -- 172.21.15.44:0/1851120514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8b80741e0 con 0x7fc8b8128310 2024-09-21T09:02:47.569 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.568+0000 7fc89ffff640 1 -- 172.21.15.44:0/1851120514 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7976 (secure 0 0 0) 0x7fc8a8042030 con 0x7fc8b8128310 2024-09-21T09:02:47.570 INFO:teuthology.misc.health.smithi044.stdout: 2024-09-21T09:02:47.570 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":12,"fsid":"7bec7bbe-ddde-41dc-a98a-89578467409a","created":"2024-09-21T09:02:32.212507+0000","modified":"2024-09-21T09:02:44.478056+0000","last_up_change":"2024-09-21T09:02:42.466256+0000","last_in_change":"2024-09-21T09:02:33.337232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T09:02:42.466115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1fc5de68-f422-48c9-94eb-866cf7bdc692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6801","nonce":2732047064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6803","nonce":2732047064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6807","nonce":2732047064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6805","nonce":2732047064}]},"public_addr":"172.21.15.44:6801/2732047064","cluster_addr":"172.21.15.44:6803/2732047064","heartbeat_back_addr":"172.21.15.44:6807/2732047064","heartbeat_front_addr":"172.21.15.44:6805/2732047064","state":["exists","up"]},{"osd":1,"uuid":"46978fe3-3a88-4346-8b7e-9a782c5d9510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6801","nonce":627496675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6803","nonce":627496675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6807","nonce":627496675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6805","nonce":627496675}]},"public_addr":"172.21.15.178:6801/627496675","cluster_addr":"172.21.15.178:6803/627496675","heartbeat_back_addr":"172.21.15.178:6807/627496675","heartbeat_front_addr":"172.21.15.178:6805/627496675","state":["exists","up"]},{"osd":2,"uuid":"eedae05b-7cc6-4b8f-9dce-c736c32d3c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6817","nonce":3267136144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6819","nonce":3267136144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6823","nonce":3267136144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6821","nonce":3267136144}]},"public_addr":"172.21.15.178:6817/3267136144","cluster_addr":"172.21.15.178:6819/3267136144","heartbeat_back_addr":"172.21.15.178:6823/3267136144","heartbeat_front_addr":"172.21.15.178:6821/3267136144","state":["exists","up"]},{"osd":3,"uuid":"45264942-4fad-46c1-85f7-67b9a1bbb25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6809","nonce":24558189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6811","nonce":24558189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6815","nonce":24558189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6813","nonce":24558189}]},"public_addr":"172.21.15.178:6809/24558189","cluster_addr":"172.21.15.178:6811/24558189","heartbeat_back_addr":"172.21.15.178:6815/24558189","heartbeat_front_addr":"172.21.15.178:6813/24558189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:39.589581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:39.642924+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:40.386523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:40.580469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:02:47.572 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.570+0000 7fc8be23c640 1 -- 172.21.15.44:0/1851120514 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc8a40382a0 msgr2=0x7fc8a403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:47.572 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.570+0000 7fc8be23c640 1 --2- 172.21.15.44:0/1851120514 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc8a40382a0 0x7fc8a403a760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac005880 tx=0x7fc8ac007970 comp rx=0 tx=0).stop 2024-09-21T09:02:47.572 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.570+0000 7fc8be23c640 1 -- 172.21.15.44:0/1851120514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b8128310 msgr2=0x7fc8b81bf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:47.573 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.570+0000 7fc8be23c640 1 --2- 172.21.15.44:0/1851120514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b8128310 0x7fc8b81bf210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8000c00 tx=0x7fc8a80046c0 comp rx=0 tx=0).stop 2024-09-21T09:02:47.573 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.570+0000 7fc8be23c640 1 -- 172.21.15.44:0/1851120514 shutdown_connections 2024-09-21T09:02:47.573 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.570+0000 7fc8be23c640 1 --2- 172.21.15.44:0/1851120514 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc8a40382a0 0x7fc8a403a760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:47.573 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.570+0000 7fc8be23c640 1 --2- 172.21.15.44:0/1851120514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b8128310 0x7fc8b81bf210 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:47.573 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.570+0000 7fc8be23c640 1 -- 172.21.15.44:0/1851120514 >> 172.21.15.44:0/1851120514 conn(0x7fc8b809ac90 msgr2=0x7fc8b80975b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:47.573 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.570+0000 7fc8be23c640 1 -- 172.21.15.44:0/1851120514 shutdown_connections 2024-09-21T09:02:47.573 INFO:teuthology.misc.health.smithi044.stderr:2024-09-21T09:02:47.570+0000 7fc8be23c640 1 -- 172.21.15.44:0/1851120514 wait complete. 2024-09-21T09:02:47.582 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-21T09:02:47.582 INFO:tasks.ceph:Creating RBD pool 2024-09-21T09:02:47.582 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-21T09:02:47.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.681+0000 7f649d9c4640 1 Processor -- start 2024-09-21T09:02:47.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.681+0000 7f649d9c4640 1 -- start start 2024-09-21T09:02:47.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.681+0000 7f649d9c4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f649812e940 0x7f6498130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:47.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.681+0000 7f649d9c4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f649806eba0 con 0x7f649806eda0 2024-09-21T09:02:47.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.681+0000 7f649d9c4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f649806d2f0 con 0x7f649812e940 2024-09-21T09:02:47.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.682+0000 7f64967fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f649812e940 0x7f6498130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:47.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.682+0000 7f6496ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f649806eda0 0x7f649806f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36828/0 (socket says 172.21.15.44:36828) 2024-09-21T09:02:47.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.682+0000 7f6496ffd640 1 -- 172.21.15.44:0/1931016212 learned_addr learned my addr 172.21.15.44:0/1931016212 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:47.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.682+0000 7f64967fc640 1 -- 172.21.15.44:0/1931016212 >> v1:172.21.15.44:6789/0 conn(0x7f649806eda0 legacy=0x7f649806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:47.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.682+0000 7f64967fc640 1 -- 172.21.15.44:0/1931016212 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6498070d50 con 0x7f649812e940 2024-09-21T09:02:47.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.683+0000 7f64967fc640 1 --2- 172.21.15.44:0/1931016212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f649812e940 0x7f6498130d30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f648c009720 tx=0x7f648c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11465f9a81440588 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:47.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.683+0000 7f6495ffb640 1 -- 172.21.15.44:0/1931016212 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f648c037070 con 0x7f649812e940 2024-09-21T09:02:47.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.683+0000 7f6495ffb640 1 -- 172.21.15.44:0/1931016212 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648c02ae20 con 0x7f649812e940 2024-09-21T09:02:47.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.683+0000 7f6495ffb640 1 -- 172.21.15.44:0/1931016212 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f648c032590 con 0x7f649812e940 2024-09-21T09:02:47.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.683+0000 7f649d9c4640 1 -- 172.21.15.44:0/1931016212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f649812e940 msgr2=0x7f6498130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:47.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.683+0000 7f649d9c4640 1 --2- 172.21.15.44:0/1931016212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f649812e940 0x7f6498130d30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f648c009720 tx=0x7f648c02a1a0 comp rx=0 tx=0).stop 2024-09-21T09:02:47.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.683+0000 7f649d9c4640 1 -- 172.21.15.44:0/1931016212 shutdown_connections 2024-09-21T09:02:47.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.683+0000 7f649d9c4640 1 --2- 172.21.15.44:0/1931016212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f649812e940 0x7f6498130d30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:47.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.683+0000 7f649d9c4640 1 -- 172.21.15.44:0/1931016212 >> 172.21.15.44:0/1931016212 conn(0x7f649809a890 msgr2=0x7f649809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:47.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.683+0000 7f649d9c4640 1 -- 172.21.15.44:0/1931016212 shutdown_connections 2024-09-21T09:02:47.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.683+0000 7f649d9c4640 1 -- 172.21.15.44:0/1931016212 wait complete. 2024-09-21T09:02:47.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.684+0000 7f649d9c4640 1 Processor -- start 2024-09-21T09:02:47.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.684+0000 7f649d9c4640 1 -- start start 2024-09-21T09:02:47.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.685+0000 7f649d9c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f649806eda0 0x7f6498096a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:47.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.685+0000 7f649d9c4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f649806fcd0 con 0x7f649806eda0 2024-09-21T09:02:47.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.685+0000 7f6496ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f649806eda0 0x7f6498096a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:47.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.685+0000 7f6496ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f649806eda0 0x7f6498096a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41702/0 (socket says 172.21.15.44:41702) 2024-09-21T09:02:47.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.685+0000 7f6496ffd640 1 -- 172.21.15.44:0/3694603977 learned_addr learned my addr 172.21.15.44:0/3694603977 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:47.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.685+0000 7f6496ffd640 1 -- 172.21.15.44:0/3694603977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64981284b0 con 0x7f649806eda0 2024-09-21T09:02:47.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.685+0000 7f6496ffd640 1 --2- 172.21.15.44:0/3694603977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f649806eda0 0x7f6498096a30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f648800c4a0 tx=0x7f648800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:47.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.685+0000 7f647ffff640 1 -- 172.21.15.44:0/3694603977 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6488017070 con 0x7f649806eda0 2024-09-21T09:02:47.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.685+0000 7f647ffff640 1 -- 172.21.15.44:0/3694603977 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6488005c10 con 0x7f649806eda0 2024-09-21T09:02:47.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.685+0000 7f649d9c4640 1 -- 172.21.15.44:0/3694603977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6498128c70 con 0x7f649806eda0 2024-09-21T09:02:47.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.685+0000 7f647ffff640 1 -- 172.21.15.44:0/3694603977 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6488007070 con 0x7f649806eda0 2024-09-21T09:02:47.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.685+0000 7f649d9c4640 1 -- 172.21.15.44:0/3694603977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f649812e4a0 con 0x7f649806eda0 2024-09-21T09:02:47.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.686+0000 7f647ffff640 1 -- 172.21.15.44:0/3694603977 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f648801a070 con 0x7f649806eda0 2024-09-21T09:02:47.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.686+0000 7f649d9c4640 1 -- 172.21.15.44:0/3694603977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6498072fc0 con 0x7f649806eda0 2024-09-21T09:02:47.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.686+0000 7f647ffff640 1 --2- 172.21.15.44:0/3694603977 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f64840382a0 0x7f648403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:47.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.687+0000 7f647ffff640 1 -- 172.21.15.44:0/3694603977 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7f648804a390 con 0x7f649806eda0 2024-09-21T09:02:47.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.687+0000 7f64967fc640 1 --2- 172.21.15.44:0/3694603977 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f64840382a0 0x7f648403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:47.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.687+0000 7f64967fc640 1 --2- 172.21.15.44:0/3694603977 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f64840382a0 0x7f648403a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f648c034000 tx=0x7f648c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:47.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.691+0000 7f647ffff640 1 -- 172.21.15.44:0/3694603977 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6498072fc0 con 0x7f649806eda0 2024-09-21T09:02:47.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:47.865+0000 7f649d9c4640 1 -- 172.21.15.44:0/3694603977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f649806f180 con 0x7f649806eda0 2024-09-21T09:02:48.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.485+0000 7f647ffff640 1 -- 172.21.15.44:0/3694603977 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) ==== 109+0+0 (secure 0 0 0) 0x7f6488012400 con 0x7f649806eda0 2024-09-21T09:02:48.488 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'rbd' created 2024-09-21T09:02:48.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.488+0000 7f649d9c4640 1 -- 172.21.15.44:0/3694603977 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f64840382a0 msgr2=0x7f648403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:48.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.488+0000 7f649d9c4640 1 --2- 172.21.15.44:0/3694603977 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f64840382a0 0x7f648403a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f648c034000 tx=0x7f648c02e000 comp rx=0 tx=0).stop 2024-09-21T09:02:48.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.488+0000 7f649d9c4640 1 -- 172.21.15.44:0/3694603977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f649806eda0 msgr2=0x7f6498096a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:48.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.488+0000 7f649d9c4640 1 --2- 172.21.15.44:0/3694603977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f649806eda0 0x7f6498096a30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f648800c4a0 tx=0x7f648800c960 comp rx=0 tx=0).stop 2024-09-21T09:02:48.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.488+0000 7f649d9c4640 1 -- 172.21.15.44:0/3694603977 shutdown_connections 2024-09-21T09:02:48.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.488+0000 7f649d9c4640 1 --2- 172.21.15.44:0/3694603977 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f64840382a0 0x7f648403a760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:48.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.488+0000 7f649d9c4640 1 --2- 172.21.15.44:0/3694603977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f649806eda0 0x7f6498096a30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:48.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.488+0000 7f649d9c4640 1 -- 172.21.15.44:0/3694603977 >> 172.21.15.44:0/3694603977 conn(0x7f649809a890 msgr2=0x7f6498071300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:48.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.489+0000 7f649d9c4640 1 -- 172.21.15.44:0/3694603977 shutdown_connections 2024-09-21T09:02:48.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.489+0000 7f649d9c4640 1 -- 172.21.15.44:0/3694603977 wait complete. 2024-09-21T09:02:48.503 DEBUG:teuthology.orchestra.run.smithi044:> rbd --cluster ceph pool init rbd 2024-09-21T09:02:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:02:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:02:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.564+0000 7f7cfc5add80 1 Processor -- start 2024-09-21T09:02:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.564+0000 7f7cfc5add80 1 -- start start 2024-09-21T09:02:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.564+0000 7f7cfc5add80 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55d958414120 0x55d958414500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:48.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.564+0000 7f7cfc5add80 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d958286050 con 0x55d958414a40 2024-09-21T09:02:48.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.564+0000 7f7cfc5add80 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55d958294930 con 0x55d958414120 2024-09-21T09:02:48.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.565+0000 7f7cfb0a3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55d958414120 0x55d958414500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:48.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.565+0000 7f7cfb0a3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55d958414120 0x55d958414500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41712/0 (socket says 172.21.15.44:41712) 2024-09-21T09:02:48.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.565+0000 7f7cfa8a2640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55d958414a40 0x55d9584aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36842/0 (socket says 172.21.15.44:36842) 2024-09-21T09:02:48.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.565+0000 7f7cfb0a3640 1 -- 172.21.15.44:0/3582323989 learned_addr learned my addr 172.21.15.44:0/3582323989 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:48.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.565+0000 7f7cfb0a3640 1 -- 172.21.15.44:0/3582323989 >> v1:172.21.15.44:6789/0 conn(0x55d958414a40 legacy=0x55d9584aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:48.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.565+0000 7f7cfb0a3640 1 -- 172.21.15.44:0/3582323989 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d95826fce0 con 0x55d958414120 2024-09-21T09:02:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.567+0000 7f7cfb0a3640 1 --2- 172.21.15.44:0/3582323989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d958414120 0x55d958414500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00a520 tx=0x7f7cec045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fdfaf3bad93919 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.567+0000 7f7cfa0a1640 1 -- 172.21.15.44:0/3582323989 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cec055070 con 0x55d958414120 2024-09-21T09:02:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.567+0000 7f7cfa0a1640 1 -- 172.21.15.44:0/3582323989 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cec0515b0 con 0x55d958414120 2024-09-21T09:02:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.567+0000 7f7cfa0a1640 1 -- 172.21.15.44:0/3582323989 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cec0518d0 con 0x55d958414120 2024-09-21T09:02:48.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.567+0000 7f7cfc5add80 1 -- 172.21.15.44:0/3582323989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d958414120 msgr2=0x55d958414500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:48.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.567+0000 7f7cfc5add80 1 --2- 172.21.15.44:0/3582323989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d958414120 0x55d958414500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00a520 tx=0x7f7cec045ba0 comp rx=0 tx=0).stop 2024-09-21T09:02:48.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.568+0000 7f7cfc5add80 1 -- 172.21.15.44:0/3582323989 shutdown_connections 2024-09-21T09:02:48.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.568+0000 7f7cfc5add80 1 --2- 172.21.15.44:0/3582323989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d958414120 0x55d958414500 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:48.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.568+0000 7f7cfc5add80 1 -- 172.21.15.44:0/3582323989 >> 172.21.15.44:0/3582323989 conn(0x55d95841d060 msgr2=0x55d9584194a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:48.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.568+0000 7f7cfc5add80 1 -- 172.21.15.44:0/3582323989 shutdown_connections 2024-09-21T09:02:48.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.568+0000 7f7cfc5add80 1 -- 172.21.15.44:0/3582323989 wait complete. 2024-09-21T09:02:48.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.568+0000 7f7cfc5add80 1 Processor -- start 2024-09-21T09:02:48.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.568+0000 7f7cfc5add80 1 -- start start 2024-09-21T09:02:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.569+0000 7f7cfc5add80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d958414120 0x55d958493020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.569+0000 7f7cfc5add80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d958296540 con 0x55d958414120 2024-09-21T09:02:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.569+0000 7f7cfb0a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d958414120 0x55d958493020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.569+0000 7f7cfb0a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d958414120 0x55d958493020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41714/0 (socket says 172.21.15.44:41714) 2024-09-21T09:02:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.569+0000 7f7cfb0a3640 1 -- 172.21.15.44:0/723416709 learned_addr learned my addr 172.21.15.44:0/723416709 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.569+0000 7f7cfb0a3640 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d958494ba0 con 0x55d958414120 2024-09-21T09:02:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.569+0000 7f7cfb0a3640 1 --2- 172.21.15.44:0/723416709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d958414120 0x55d958493020 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7cec025da0 tx=0x7f7cec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.570+0000 7f7ceb7fe640 1 -- 172.21.15.44:0/723416709 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cec069070 con 0x55d958414120 2024-09-21T09:02:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.570+0000 7f7ceb7fe640 1 -- 172.21.15.44:0/723416709 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cec051a20 con 0x55d958414120 2024-09-21T09:02:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.570+0000 7f7cfc5add80 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9584a2200 con 0x55d958414120 2024-09-21T09:02:48.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.570+0000 7f7ceb7fe640 1 -- 172.21.15.44:0/723416709 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cec055070 con 0x55d958414120 2024-09-21T09:02:48.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.570+0000 7f7cfc5add80 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d958493560 con 0x55d958414120 2024-09-21T09:02:48.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.570+0000 7f7ceb7fe640 1 -- 172.21.15.44:0/723416709 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7cec06c070 con 0x55d958414120 2024-09-21T09:02:48.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.571+0000 7f7ceb7fe640 1 --2- 172.21.15.44:0/723416709 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7ce0036b90 0x7f7ce0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:48.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.571+0000 7f7ceb7fe640 1 -- 172.21.15.44:0/723416709 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3471+0+0 (secure 0 0 0) 0x7f7cec061070 con 0x55d958414120 2024-09-21T09:02:48.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.571+0000 7f7cfc5add80 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55d958493ac0 con 0x55d958414120 2024-09-21T09:02:48.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.571+0000 7f7cfa8a2640 1 --2- 172.21.15.44:0/723416709 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7ce0036b90 0x7f7ce0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:48.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:48.572+0000 7f7cfa8a2640 1 --2- 172.21.15.44:0/723416709 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7ce0036b90 0x7f7ce0039050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0001e40 tx=0x7f7cf00013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.486+0000 7f7ceb7fe640 1 -- 172.21.15.44:0/723416709 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v14) ==== 141+0+0 (secure 0 0 0) 0x7f7cec018dd0 con 0x55d958414120 2024-09-21T09:02:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.486+0000 7f7cfc5add80 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7cec0515b0 con 0x55d958414120 2024-09-21T09:02:49.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.489+0000 7f7ceb7fe640 1 -- 172.21.15.44:0/723416709 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f7cec006380 con 0x55d958414120 2024-09-21T09:02:49.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.489+0000 7f7cf98a0640 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7f7cd8002ae0 con 0x55d958414120 2024-09-21T09:02:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.491+0000 7f7ceb7fe640 1 -- 172.21.15.44:0/723416709 <== mon.0 v2:172.21.15.44:3300/0 8 ==== osd_map(14..14 src has 1..14) ==== 650+0+0 (secure 0 0 0) 0x7f7cec06dbf0 con 0x55d958414120 2024-09-21T09:02:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.491+0000 7f7cfc5add80 1 --2- 172.21.15.44:0/723416709 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d958414a40 0x55d9584c1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.492+0000 7f7cfc5add80 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) -- 0x55d958494100 con 0x55d958414a40 2024-09-21T09:02:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.492+0000 7f7cfc305640 1 --2- 172.21.15.44:0/723416709 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d958414a40 0x55d9584c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:49.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.493+0000 7f7cfc305640 1 --2- 172.21.15.44:0/723416709 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d958414a40 0x55d9584c1080 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:49.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.495+0000 7f7cfc305640 1 -- 172.21.15.44:0/723416709 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(1 rbd_trash [create] v14'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f7cf4002040 con 0x55d958414a40 2024-09-21T09:02:49.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.497+0000 7f7cfc5add80 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) -- 0x55d958512bf0 con 0x55d958414a40 2024-09-21T09:02:49.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.498+0000 7f7cfc305640 1 -- 172.21.15.44:0/723416709 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7cf4002040 con 0x55d958414a40 2024-09-21T09:02:49.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.498+0000 7f7cfc5add80 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) -- 0x55d958511d00 con 0x55d958414a40 2024-09-21T09:02:49.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.498+0000 7f7cfc305640 1 -- 172.21.15.44:0/723416709 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7cf4002040 con 0x55d958414a40 2024-09-21T09:02:49.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:49.498+0000 7f7cf909f640 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f7cdc001f00 con 0x55d958414120 2024-09-21T09:02:50.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:50.493+0000 7f7ceb7fe640 1 -- 172.21.15.44:0/723416709 <== mon.0 v2:172.21.15.44:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v15) ==== 55+0+0 (secure 0 0 0) 0x7f7cec01b050 con 0x55d958414120 2024-09-21T09:02:50.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:50.493+0000 7f7ceb7fe640 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f7ce003c740 con 0x55d958414120 2024-09-21T09:02:50.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:50.493+0000 7f7ceb7fe640 1 -- 172.21.15.44:0/723416709 <== mon.0 v2:172.21.15.44:3300/0 10 ==== osd_map(15..15 src has 1..15) ==== 626+0+0 (secure 0 0 0) 0x7f7cec05a450 con 0x55d958414120 2024-09-21T09:02:50.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:50.493+0000 7f7cf98a0640 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x7f7cd8005680 con 0x55d958414a40 2024-09-21T09:02:50.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:50.497+0000 7f7cfc305640 1 -- 172.21.15.44:0/723416709 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v15'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7cf4002040 con 0x55d958414a40 2024-09-21T09:02:50.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:50.497+0000 7f7cf909f640 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v15) -- 0x7f7cdc003350 con 0x55d958414120 2024-09-21T09:02:51.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.496+0000 7f7ceb7fe640 1 -- 172.21.15.44:0/723416709 <== mon.0 v2:172.21.15.44:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v16) ==== 43+0+0 (secure 0 0 0) 0x7f7cec088080 con 0x55d958414120 2024-09-21T09:02:51.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.496+0000 7f7ceb7fe640 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f7ce003c9c0 con 0x55d958414120 2024-09-21T09:02:51.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.497+0000 7f7ceb7fe640 1 -- 172.21.15.44:0/723416709 <== mon.0 v2:172.21.15.44:3300/0 12 ==== osd_map(16..16 src has 1..16) ==== 654+0+0 (secure 0 0 0) 0x7f7cec04f360 con 0x55d958414120 2024-09-21T09:02:51.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.497+0000 7f7cf98a0640 1 -- 172.21.15.44:0/723416709 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7f7cd8005a20 con 0x55d958414a40 2024-09-21T09:02:51.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.501+0000 7f7cfc305640 1 -- 172.21.15.44:0/723416709 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(7 rbd_info [write 0~19] v16'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf4002040 con 0x55d958414a40 2024-09-21T09:02:51.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.501+0000 7f7cfc5add80 1 -- 172.21.15.44:0/723416709 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d958414a40 msgr2=0x55d9584c1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:51.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.501+0000 7f7cfc5add80 1 --2- 172.21.15.44:0/723416709 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d958414a40 0x55d9584c1080 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:51.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.501+0000 7f7cfc5add80 1 -- 172.21.15.44:0/723416709 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7ce0036b90 msgr2=0x7f7ce0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:51.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.501+0000 7f7cfc5add80 1 --2- 172.21.15.44:0/723416709 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7ce0036b90 0x7f7ce0039050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0001e40 tx=0x7f7cf00013a0 comp rx=0 tx=0).stop 2024-09-21T09:02:51.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.501+0000 7f7cfc5add80 1 -- 172.21.15.44:0/723416709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d958414120 msgr2=0x55d958493020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:51.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.501+0000 7f7cfc5add80 1 --2- 172.21.15.44:0/723416709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d958414120 0x55d958493020 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7cec025da0 tx=0x7f7cec002fb0 comp rx=0 tx=0).stop 2024-09-21T09:02:51.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.501+0000 7f7cfc5add80 1 -- 172.21.15.44:0/723416709 shutdown_connections 2024-09-21T09:02:51.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.501+0000 7f7cfc5add80 1 --2- 172.21.15.44:0/723416709 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d958414a40 0x55d9584c1080 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:51.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.501+0000 7f7cfc5add80 1 --2- 172.21.15.44:0/723416709 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7ce0036b90 0x7f7ce0039050 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:51.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.501+0000 7f7cfc5add80 1 --2- 172.21.15.44:0/723416709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d958414120 0x55d958493020 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:51.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.501+0000 7f7cfc5add80 1 -- 172.21.15.44:0/723416709 >> 172.21.15.44:0/723416709 conn(0x55d95841d060 msgr2=0x55d9584a9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:51.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.501+0000 7f7cfc5add80 1 -- 172.21.15.44:0/723416709 shutdown_connections 2024-09-21T09:02:51.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.501+0000 7f7cfc5add80 1 -- 172.21.15.44:0/723416709 wait complete. 2024-09-21T09:02:51.508 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T09:02:51.508 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T09:02:51.508 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T09:02:51.508 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T09:02:51.509 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T09:02:51.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.618+0000 7f9bee591640 1 Processor -- start 2024-09-21T09:02:51.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.619+0000 7f9bee591640 1 -- start start 2024-09-21T09:02:51.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.619+0000 7f9bee591640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9be809a100 0x7f9be8133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:51.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.619+0000 7f9bee591640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be809d3b0 con 0x7f9be809bd50 2024-09-21T09:02:51.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.619+0000 7f9bee591640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f9be809c840 con 0x7f9be809a100 2024-09-21T09:02:51.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.619+0000 7f9be77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9be809a100 0x7f9be8133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:51.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.619+0000 7f9be77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9be809a100 0x7f9be8133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43860/0 (socket says 172.21.15.44:43860) 2024-09-21T09:02:51.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.619+0000 7f9be7fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9be809bd50 0x7f9be809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55708/0 (socket says 172.21.15.44:55708) 2024-09-21T09:02:51.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.619+0000 7f9be77fe640 1 -- 172.21.15.44:0/3139445461 learned_addr learned my addr 172.21.15.44:0/3139445461 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:51.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.619+0000 7f9be77fe640 1 -- 172.21.15.44:0/3139445461 >> v1:172.21.15.44:6789/0 conn(0x7f9be809bd50 legacy=0x7f9be809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:51.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.619+0000 7f9be77fe640 1 -- 172.21.15.44:0/3139445461 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be8098230 con 0x7f9be809a100 2024-09-21T09:02:51.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.620+0000 7f9be77fe640 1 --2- 172.21.15.44:0/3139445461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9be809a100 0x7f9be8133da0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0097f0 tx=0x7f9bdc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33bada3191e0347 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:51.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.620+0000 7f9be6ffd640 1 -- 172.21.15.44:0/3139445461 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bdc037070 con 0x7f9be809a100 2024-09-21T09:02:51.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.620+0000 7f9be6ffd640 1 -- 172.21.15.44:0/3139445461 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bdc032440 con 0x7f9be809a100 2024-09-21T09:02:51.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.620+0000 7f9be6ffd640 1 -- 172.21.15.44:0/3139445461 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bdc02ae60 con 0x7f9be809a100 2024-09-21T09:02:51.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.621+0000 7f9bee591640 1 -- 172.21.15.44:0/3139445461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9be809a100 msgr2=0x7f9be8133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:51.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.621+0000 7f9bee591640 1 --2- 172.21.15.44:0/3139445461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9be809a100 0x7f9be8133da0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0097f0 tx=0x7f9bdc02a1e0 comp rx=0 tx=0).stop 2024-09-21T09:02:51.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.621+0000 7f9bee591640 1 -- 172.21.15.44:0/3139445461 shutdown_connections 2024-09-21T09:02:51.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.621+0000 7f9bee591640 1 --2- 172.21.15.44:0/3139445461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9be809a100 0x7f9be8133da0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:51.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.621+0000 7f9bee591640 1 -- 172.21.15.44:0/3139445461 >> 172.21.15.44:0/3139445461 conn(0x7f9be806d4a0 msgr2=0x7f9be806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:51.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.621+0000 7f9bee591640 1 -- 172.21.15.44:0/3139445461 shutdown_connections 2024-09-21T09:02:51.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.621+0000 7f9bee591640 1 -- 172.21.15.44:0/3139445461 wait complete. 2024-09-21T09:02:51.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.622+0000 7f9bee591640 1 Processor -- start 2024-09-21T09:02:51.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.622+0000 7f9bee591640 1 -- start start 2024-09-21T09:02:51.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.622+0000 7f9bee591640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9be809a100 0x7f9be8132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:51.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.622+0000 7f9bee591640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9be8134670 con 0x7f9be809a100 2024-09-21T09:02:51.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.622+0000 7f9be7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9be809a100 0x7f9be8132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:51.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.622+0000 7f9be7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9be809a100 0x7f9be8132880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43874/0 (socket says 172.21.15.44:43874) 2024-09-21T09:02:51.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.622+0000 7f9be7fff640 1 -- 172.21.15.44:0/1586045071 learned_addr learned my addr 172.21.15.44:0/1586045071 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:51.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.623+0000 7f9be7fff640 1 -- 172.21.15.44:0/1586045071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be8095540 con 0x7f9be809a100 2024-09-21T09:02:51.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.623+0000 7f9be7fff640 1 --2- 172.21.15.44:0/1586045071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9be809a100 0x7f9be8132880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800c450 tx=0x7f9bd800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:51.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.623+0000 7f9be4ff9640 1 -- 172.21.15.44:0/1586045071 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bd8007410 con 0x7f9be809a100 2024-09-21T09:02:51.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.623+0000 7f9be4ff9640 1 -- 172.21.15.44:0/1586045071 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd80075b0 con 0x7f9be809a100 2024-09-21T09:02:51.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.623+0000 7f9bee591640 1 -- 172.21.15.44:0/1586045071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be80950a0 con 0x7f9be809a100 2024-09-21T09:02:51.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.623+0000 7f9be4ff9640 1 -- 172.21.15.44:0/1586045071 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bd8004910 con 0x7f9be809a100 2024-09-21T09:02:51.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.623+0000 7f9bee591640 1 -- 172.21.15.44:0/1586045071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be80963b0 con 0x7f9be809a100 2024-09-21T09:02:51.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.624+0000 7f9be4ff9640 1 -- 172.21.15.44:0/1586045071 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9bd801a020 con 0x7f9be809a100 2024-09-21T09:02:51.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.624+0000 7f9bee591640 1 -- 172.21.15.44:0/1586045071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9be80008d0 con 0x7f9be809a100 2024-09-21T09:02:51.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.624+0000 7f9be4ff9640 1 --2- 172.21.15.44:0/1586045071 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9bd40382a0 0x7f9bd403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:51.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.624+0000 7f9be4ff9640 1 -- 172.21.15.44:0/1586045071 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f9bd804aa70 con 0x7f9be809a100 2024-09-21T09:02:51.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.625+0000 7f9be77fe640 1 --2- 172.21.15.44:0/1586045071 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9bd40382a0 0x7f9bd403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:51.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.625+0000 7f9be77fe640 1 --2- 172.21.15.44:0/1586045071 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9bd40382a0 0x7f9bd403a760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc034000 tx=0x7f9bdc02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:51.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.629+0000 7f9be4ff9640 1 -- 172.21.15.44:0/1586045071 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9be80963b0 con 0x7f9be809a100 2024-09-21T09:02:51.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.857+0000 7f9bee591640 1 -- 172.21.15.44:0/1586045071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9be8074970 con 0x7f9be809a100 2024-09-21T09:02:51.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.858+0000 7f9be4ff9640 1 -- 172.21.15.44:0/1586045071 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87485 (secure 0 0 0) 0x7f9bd80365d0 con 0x7f9be809a100 2024-09-21T09:02:51.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:51.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.861+0000 7f9bee591640 1 -- 172.21.15.44:0/1586045071 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9bd40382a0 msgr2=0x7f9bd403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:51.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.861+0000 7f9bee591640 1 --2- 172.21.15.44:0/1586045071 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9bd40382a0 0x7f9bd403a760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc034000 tx=0x7f9bdc02e000 comp rx=0 tx=0).stop 2024-09-21T09:02:51.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.861+0000 7f9bee591640 1 -- 172.21.15.44:0/1586045071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9be809a100 msgr2=0x7f9be8132880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:51.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.861+0000 7f9bee591640 1 --2- 172.21.15.44:0/1586045071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9be809a100 0x7f9be8132880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800c450 tx=0x7f9bd800c910 comp rx=0 tx=0).stop 2024-09-21T09:02:51.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.861+0000 7f9bee591640 1 -- 172.21.15.44:0/1586045071 shutdown_connections 2024-09-21T09:02:51.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.861+0000 7f9bee591640 1 --2- 172.21.15.44:0/1586045071 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9bd40382a0 0x7f9bd403a760 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:51.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.861+0000 7f9bee591640 1 --2- 172.21.15.44:0/1586045071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9be809a100 0x7f9be8132880 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:51.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.861+0000 7f9bee591640 1 -- 172.21.15.44:0/1586045071 >> 172.21.15.44:0/1586045071 conn(0x7f9be806d4a0 msgr2=0x7f9be8096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:51.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.861+0000 7f9bee591640 1 -- 172.21.15.44:0/1586045071 shutdown_connections 2024-09-21T09:02:51.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.861+0000 7f9bee591640 1 -- 172.21.15.44:0/1586045071 wait complete. 2024-09-21T09:02:51.874 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":968828701},{"type":"v1","addr":"172.21.15.178:6825","nonce":968828701}]},"active_addr":"172.21.15.178:6825/968828701","active_change":"2024-09-21T09:02:36.416815+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":3561623113}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":20656806}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":3408975239}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":1027825880}]}]} 2024-09-21T09:02:51.877 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T09:02:51.877 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T09:02:51.877 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T09:02:51.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.977+0000 7f1223b0a640 1 Processor -- start 2024-09-21T09:02:51.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.977+0000 7f1223b0a640 1 -- start start 2024-09-21T09:02:51.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.977+0000 7f1223b0a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f121c06eda0 0x7f121c06f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:51.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.977+0000 7f1223b0a640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f121c06eba0 con 0x7f121c06f6c0 2024-09-21T09:02:51.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.977+0000 7f1223b0a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f121c06d2f0 con 0x7f121c06eda0 2024-09-21T09:02:51.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.977+0000 7f12218a6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f121c06eda0 0x7f121c06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:51.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.977+0000 7f12218a6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f121c06eda0 0x7f121c06f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43876/0 (socket says 172.21.15.44:43876) 2024-09-21T09:02:51.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.977+0000 7f12210a5640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f121c06f6c0 0x7f121c121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55714/0 (socket says 172.21.15.44:55714) 2024-09-21T09:02:51.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.977+0000 7f12218a6640 1 -- 172.21.15.44:0/2289376691 learned_addr learned my addr 172.21.15.44:0/2289376691 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:51.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.978+0000 7f12218a6640 1 -- 172.21.15.44:0/2289376691 >> v1:172.21.15.44:6789/0 conn(0x7f121c06f6c0 legacy=0x7f121c121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:51.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.978+0000 7f12218a6640 1 -- 172.21.15.44:0/2289376691 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121c070d50 con 0x7f121c06eda0 2024-09-21T09:02:51.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.978+0000 7f12218a6640 1 --2- 172.21.15.44:0/2289376691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121c06eda0 0x7f121c06f180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f12180097f0 tx=0x7f121802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38688bf6cdd8978f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:51.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.979+0000 7f12208a4640 1 -- 172.21.15.44:0/2289376691 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1218037070 con 0x7f121c06eda0 2024-09-21T09:02:51.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.979+0000 7f12208a4640 1 -- 172.21.15.44:0/2289376691 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1218032440 con 0x7f121c06eda0 2024-09-21T09:02:51.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.979+0000 7f12208a4640 1 -- 172.21.15.44:0/2289376691 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1218032740 con 0x7f121c06eda0 2024-09-21T09:02:51.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.979+0000 7f1223b0a640 1 -- 172.21.15.44:0/2289376691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121c06eda0 msgr2=0x7f121c06f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:51.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.979+0000 7f1223b0a640 1 --2- 172.21.15.44:0/2289376691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121c06eda0 0x7f121c06f180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f12180097f0 tx=0x7f121802a270 comp rx=0 tx=0).stop 2024-09-21T09:02:51.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.979+0000 7f1223b0a640 1 -- 172.21.15.44:0/2289376691 shutdown_connections 2024-09-21T09:02:51.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.979+0000 7f1223b0a640 1 --2- 172.21.15.44:0/2289376691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121c06eda0 0x7f121c06f180 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:51.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.979+0000 7f1223b0a640 1 -- 172.21.15.44:0/2289376691 >> 172.21.15.44:0/2289376691 conn(0x7f121c09a890 msgr2=0x7f121c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:51.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.979+0000 7f1223b0a640 1 -- 172.21.15.44:0/2289376691 shutdown_connections 2024-09-21T09:02:51.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.979+0000 7f1223b0a640 1 -- 172.21.15.44:0/2289376691 wait complete. 2024-09-21T09:02:51.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.980+0000 7f1223b0a640 1 Processor -- start 2024-09-21T09:02:51.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.980+0000 7f1223b0a640 1 -- start start 2024-09-21T09:02:51.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.980+0000 7f1223b0a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121c06eda0 0x7f121c122d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:51.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.980+0000 7f1223b0a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f121c122160 con 0x7f121c06eda0 2024-09-21T09:02:51.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.981+0000 7f12218a6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121c06eda0 0x7f121c122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:51.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.981+0000 7f12218a6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121c06eda0 0x7f121c122d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43884/0 (socket says 172.21.15.44:43884) 2024-09-21T09:02:51.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.981+0000 7f12218a6640 1 -- 172.21.15.44:0/3688611088 learned_addr learned my addr 172.21.15.44:0/3688611088 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:51.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.981+0000 7f12218a6640 1 -- 172.21.15.44:0/3688611088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121c090cc0 con 0x7f121c06eda0 2024-09-21T09:02:51.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.981+0000 7f12218a6640 1 --2- 172.21.15.44:0/3688611088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121c06eda0 0x7f121c122d00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1218035040 tx=0x7f12180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:51.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.981+0000 7f12127fc640 1 -- 172.21.15.44:0/3688611088 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1218041070 con 0x7f121c06eda0 2024-09-21T09:02:51.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.981+0000 7f12127fc640 1 -- 172.21.15.44:0/3688611088 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f121803c7a0 con 0x7f121c06eda0 2024-09-21T09:02:51.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.981+0000 7f1223b0a640 1 -- 172.21.15.44:0/3688611088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f121c090520 con 0x7f121c06eda0 2024-09-21T09:02:51.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.981+0000 7f12127fc640 1 -- 172.21.15.44:0/3688611088 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1218037040 con 0x7f121c06eda0 2024-09-21T09:02:51.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.981+0000 7f1223b0a640 1 -- 172.21.15.44:0/3688611088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f121c123240 con 0x7f121c06eda0 2024-09-21T09:02:51.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.982+0000 7f12127fc640 1 -- 172.21.15.44:0/3688611088 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1218044070 con 0x7f121c06eda0 2024-09-21T09:02:51.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.982+0000 7f1223b0a640 1 -- 172.21.15.44:0/3688611088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f121c090080 con 0x7f121c06eda0 2024-09-21T09:02:51.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.982+0000 7f12127fc640 1 --2- 172.21.15.44:0/3688611088 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f12000382d0 0x7f120003a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:51.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.982+0000 7f12127fc640 1 -- 172.21.15.44:0/3688611088 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f121806bd40 con 0x7f121c06eda0 2024-09-21T09:02:51.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.982+0000 7f12210a5640 1 --2- 172.21.15.44:0/3688611088 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f12000382d0 0x7f120003a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:51.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.983+0000 7f12210a5640 1 --2- 172.21.15.44:0/3688611088 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f12000382d0 0x7f120003a790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f120c0015f0 tx=0x7f120c007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:51.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:51.987+0000 7f12127fc640 1 -- 172.21.15.44:0/3688611088 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f121c090080 con 0x7f121c06eda0 2024-09-21T09:02:52.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.165+0000 7f1223b0a640 1 -- 172.21.15.44:0/3688611088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f121c122670 con 0x7f121c06eda0 2024-09-21T09:02:52.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.165+0000 7f12127fc640 1 -- 172.21.15.44:0/3688611088 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9876 (secure 0 0 0) 0x7f121803ca80 con 0x7f121c06eda0 2024-09-21T09:02:52.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:52.167 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":16,"fsid":"7bec7bbe-ddde-41dc-a98a-89578467409a","created":"2024-09-21T09:02:32.212507+0000","modified":"2024-09-21T09:02:51.493369+0000","last_up_change":"2024-09-21T09:02:42.466256+0000","last_in_change":"2024-09-21T09:02:33.337232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T09:02:42.466115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T09:02:47.895676+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1fc5de68-f422-48c9-94eb-866cf7bdc692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6801","nonce":2732047064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6803","nonce":2732047064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6807","nonce":2732047064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6805","nonce":2732047064}]},"public_addr":"172.21.15.44:6801/2732047064","cluster_addr":"172.21.15.44:6803/2732047064","heartbeat_back_addr":"172.21.15.44:6807/2732047064","heartbeat_front_addr":"172.21.15.44:6805/2732047064","state":["exists","up"]},{"osd":1,"uuid":"46978fe3-3a88-4346-8b7e-9a782c5d9510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6801","nonce":627496675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6803","nonce":627496675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6807","nonce":627496675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6805","nonce":627496675}]},"public_addr":"172.21.15.178:6801/627496675","cluster_addr":"172.21.15.178:6803/627496675","heartbeat_back_addr":"172.21.15.178:6807/627496675","heartbeat_front_addr":"172.21.15.178:6805/627496675","state":["exists","up"]},{"osd":2,"uuid":"eedae05b-7cc6-4b8f-9dce-c736c32d3c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6817","nonce":3267136144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6819","nonce":3267136144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6823","nonce":3267136144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6821","nonce":3267136144}]},"public_addr":"172.21.15.178:6817/3267136144","cluster_addr":"172.21.15.178:6819/3267136144","heartbeat_back_addr":"172.21.15.178:6823/3267136144","heartbeat_front_addr":"172.21.15.178:6821/3267136144","state":["exists","up"]},{"osd":3,"uuid":"45264942-4fad-46c1-85f7-67b9a1bbb25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6809","nonce":24558189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6811","nonce":24558189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6815","nonce":24558189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6813","nonce":24558189}]},"public_addr":"172.21.15.178:6809/24558189","cluster_addr":"172.21.15.178:6811/24558189","heartbeat_back_addr":"172.21.15.178:6815/24558189","heartbeat_front_addr":"172.21.15.178:6813/24558189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:39.589581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:39.642924+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:40.386523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:40.580469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:02:52.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.167+0000 7f1223b0a640 1 -- 172.21.15.44:0/3688611088 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f12000382d0 msgr2=0x7f120003a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.167+0000 7f1223b0a640 1 --2- 172.21.15.44:0/3688611088 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f12000382d0 0x7f120003a790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f120c0015f0 tx=0x7f120c007a40 comp rx=0 tx=0).stop 2024-09-21T09:02:52.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.167+0000 7f1223b0a640 1 -- 172.21.15.44:0/3688611088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121c06eda0 msgr2=0x7f121c122d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.167+0000 7f1223b0a640 1 --2- 172.21.15.44:0/3688611088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121c06eda0 0x7f121c122d00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1218035040 tx=0x7f12180046c0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.168+0000 7f1223b0a640 1 -- 172.21.15.44:0/3688611088 shutdown_connections 2024-09-21T09:02:52.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.168+0000 7f1223b0a640 1 --2- 172.21.15.44:0/3688611088 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f12000382d0 0x7f120003a790 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.168+0000 7f1223b0a640 1 --2- 172.21.15.44:0/3688611088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121c06eda0 0x7f121c122d00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.168+0000 7f1223b0a640 1 -- 172.21.15.44:0/3688611088 >> 172.21.15.44:0/3688611088 conn(0x7f121c09a890 msgr2=0x7f121c06d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.168+0000 7f1223b0a640 1 -- 172.21.15.44:0/3688611088 shutdown_connections 2024-09-21T09:02:52.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.168+0000 7f1223b0a640 1 -- 172.21.15.44:0/3688611088 wait complete. 2024-09-21T09:02:52.180 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T09:02:52.180 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T09:02:52.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.280+0000 7fc6273df640 1 Processor -- start 2024-09-21T09:02:52.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.280+0000 7fc6273df640 1 -- start start 2024-09-21T09:02:52.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.281+0000 7fc6273df640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc62012cca0 0x7fc62012d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.281+0000 7fc6273df640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc62012d5c0 con 0x7fc6201290e0 2024-09-21T09:02:52.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.281+0000 7fc6273df640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc62006e350 con 0x7fc62012cca0 2024-09-21T09:02:52.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.281+0000 7fc62517b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc62012cca0 0x7fc62012d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.281+0000 7fc62497a640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc6201290e0 0x7fc620129530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55716/0 (socket says 172.21.15.44:55716) 2024-09-21T09:02:52.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.281+0000 7fc62497a640 1 -- 172.21.15.44:0/921903849 learned_addr learned my addr 172.21.15.44:0/921903849 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:52.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.281+0000 7fc62517b640 1 -- 172.21.15.44:0/921903849 >> v1:172.21.15.44:6789/0 conn(0x7fc6201290e0 legacy=0x7fc620129530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.281+0000 7fc62517b640 1 -- 172.21.15.44:0/921903849 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc620071f70 con 0x7fc62012cca0 2024-09-21T09:02:52.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.281+0000 7fc617fff640 1 -- 172.21.15.44:0/921903849 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868985195 0 0) 0x7fc62012d5c0 con 0x7fc6201290e0 2024-09-21T09:02:52.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.282+0000 7fc62517b640 1 --2- 172.21.15.44:0/921903849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc62012cca0 0x7fc62012d080 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009720 tx=0x7fc61c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c800e3a644cbd5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.282+0000 7fc617fff640 1 -- 172.21.15.44:0/921903849 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61c037070 con 0x7fc62012cca0 2024-09-21T09:02:52.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.282+0000 7fc617fff640 1 -- 172.21.15.44:0/921903849 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61c02ad90 con 0x7fc62012cca0 2024-09-21T09:02:52.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.282+0000 7fc617fff640 1 -- 172.21.15.44:0/921903849 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61c032590 con 0x7fc62012cca0 2024-09-21T09:02:52.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.282+0000 7fc6273df640 1 -- 172.21.15.44:0/921903849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc62012cca0 msgr2=0x7fc62012d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.282+0000 7fc6273df640 1 --2- 172.21.15.44:0/921903849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc62012cca0 0x7fc62012d080 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009720 tx=0x7fc61c02a110 comp rx=0 tx=0).stop 2024-09-21T09:02:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.282+0000 7fc6273df640 1 -- 172.21.15.44:0/921903849 shutdown_connections 2024-09-21T09:02:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.282+0000 7fc6273df640 1 --2- 172.21.15.44:0/921903849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc62012cca0 0x7fc62012d080 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.282+0000 7fc6273df640 1 -- 172.21.15.44:0/921903849 >> 172.21.15.44:0/921903849 conn(0x7fc62009a890 msgr2=0x7fc62009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.283+0000 7fc6273df640 1 -- 172.21.15.44:0/921903849 shutdown_connections 2024-09-21T09:02:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.283+0000 7fc6273df640 1 -- 172.21.15.44:0/921903849 wait complete. 2024-09-21T09:02:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.283+0000 7fc6273df640 1 Processor -- start 2024-09-21T09:02:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.283+0000 7fc6273df640 1 -- start start 2024-09-21T09:02:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.284+0000 7fc6273df640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6201290e0 0x7fc62008afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.284+0000 7fc6273df640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc620070e60 con 0x7fc6201290e0 2024-09-21T09:02:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.284+0000 7fc62517b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6201290e0 0x7fc62008afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.284+0000 7fc62517b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6201290e0 0x7fc62008afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43894/0 (socket says 172.21.15.44:43894) 2024-09-21T09:02:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.284+0000 7fc62517b640 1 -- 172.21.15.44:0/2888957389 learned_addr learned my addr 172.21.15.44:0/2888957389 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.284+0000 7fc62517b640 1 -- 172.21.15.44:0/2888957389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc620096ea0 con 0x7fc6201290e0 2024-09-21T09:02:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.284+0000 7fc62517b640 1 --2- 172.21.15.44:0/2888957389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6201290e0 0x7fc62008afc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc61c035040 tx=0x7fc61c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.284+0000 7fc615ffb640 1 -- 172.21.15.44:0/2888957389 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61c037040 con 0x7fc6201290e0 2024-09-21T09:02:52.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.284+0000 7fc615ffb640 1 -- 172.21.15.44:0/2888957389 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61c004030 con 0x7fc6201290e0 2024-09-21T09:02:52.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.284+0000 7fc6273df640 1 -- 172.21.15.44:0/2888957389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc620126610 con 0x7fc6201290e0 2024-09-21T09:02:52.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.284+0000 7fc615ffb640 1 -- 172.21.15.44:0/2888957389 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61c004310 con 0x7fc6201290e0 2024-09-21T09:02:52.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.285+0000 7fc6273df640 1 -- 172.21.15.44:0/2888957389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62008d450 con 0x7fc6201290e0 2024-09-21T09:02:52.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.285+0000 7fc615ffb640 1 -- 172.21.15.44:0/2888957389 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc61c03a040 con 0x7fc6201290e0 2024-09-21T09:02:52.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.286+0000 7fc6273df640 1 -- 172.21.15.44:0/2888957389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc62008c320 con 0x7fc6201290e0 2024-09-21T09:02:52.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.286+0000 7fc615ffb640 1 --2- 172.21.15.44:0/2888957389 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc6040382a0 0x7fc60403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.286+0000 7fc615ffb640 1 -- 172.21.15.44:0/2888957389 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fc61c06bc60 con 0x7fc6201290e0 2024-09-21T09:02:52.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.286+0000 7fc62497a640 1 --2- 172.21.15.44:0/2888957389 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc6040382a0 0x7fc60403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.286+0000 7fc62497a640 1 --2- 172.21.15.44:0/2888957389 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc6040382a0 0x7fc60403a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc610000c00 tx=0x7fc610007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.291+0000 7fc615ffb640 1 -- 172.21.15.44:0/2888957389 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc620096ea0 con 0x7fc6201290e0 2024-09-21T09:02:52.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.466+0000 7fc6273df640 1 -- 172.21.15.44:0/2888957389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc62006e510 con 0x7fc6201290e0 2024-09-21T09:02:52.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.466+0000 7fc615ffb640 1 -- 172.21.15.44:0/2888957389 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9876 (secure 0 0 0) 0x7fc61c042020 con 0x7fc6201290e0 2024-09-21T09:02:52.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:52.468 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":16,"fsid":"7bec7bbe-ddde-41dc-a98a-89578467409a","created":"2024-09-21T09:02:32.212507+0000","modified":"2024-09-21T09:02:51.493369+0000","last_up_change":"2024-09-21T09:02:42.466256+0000","last_in_change":"2024-09-21T09:02:33.337232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T09:02:42.466115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T09:02:47.895676+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1fc5de68-f422-48c9-94eb-866cf7bdc692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6801","nonce":2732047064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6803","nonce":2732047064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6807","nonce":2732047064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6805","nonce":2732047064}]},"public_addr":"172.21.15.44:6801/2732047064","cluster_addr":"172.21.15.44:6803/2732047064","heartbeat_back_addr":"172.21.15.44:6807/2732047064","heartbeat_front_addr":"172.21.15.44:6805/2732047064","state":["exists","up"]},{"osd":1,"uuid":"46978fe3-3a88-4346-8b7e-9a782c5d9510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6801","nonce":627496675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6803","nonce":627496675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6807","nonce":627496675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6805","nonce":627496675}]},"public_addr":"172.21.15.178:6801/627496675","cluster_addr":"172.21.15.178:6803/627496675","heartbeat_back_addr":"172.21.15.178:6807/627496675","heartbeat_front_addr":"172.21.15.178:6805/627496675","state":["exists","up"]},{"osd":2,"uuid":"eedae05b-7cc6-4b8f-9dce-c736c32d3c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6817","nonce":3267136144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6819","nonce":3267136144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6823","nonce":3267136144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6821","nonce":3267136144}]},"public_addr":"172.21.15.178:6817/3267136144","cluster_addr":"172.21.15.178:6819/3267136144","heartbeat_back_addr":"172.21.15.178:6823/3267136144","heartbeat_front_addr":"172.21.15.178:6821/3267136144","state":["exists","up"]},{"osd":3,"uuid":"45264942-4fad-46c1-85f7-67b9a1bbb25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6809","nonce":24558189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6811","nonce":24558189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6815","nonce":24558189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6813","nonce":24558189}]},"public_addr":"172.21.15.178:6809/24558189","cluster_addr":"172.21.15.178:6811/24558189","heartbeat_back_addr":"172.21.15.178:6815/24558189","heartbeat_front_addr":"172.21.15.178:6813/24558189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:39.589581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:39.642924+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:40.386523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:40.580469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:02:52.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.469+0000 7fc6273df640 1 -- 172.21.15.44:0/2888957389 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc6040382a0 msgr2=0x7fc60403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.469+0000 7fc6273df640 1 --2- 172.21.15.44:0/2888957389 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc6040382a0 0x7fc60403a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc610000c00 tx=0x7fc610007a40 comp rx=0 tx=0).stop 2024-09-21T09:02:52.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.469+0000 7fc6273df640 1 -- 172.21.15.44:0/2888957389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6201290e0 msgr2=0x7fc62008afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.469+0000 7fc6273df640 1 --2- 172.21.15.44:0/2888957389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6201290e0 0x7fc62008afc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc61c035040 tx=0x7fc61c0046c0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.469+0000 7fc6273df640 1 -- 172.21.15.44:0/2888957389 shutdown_connections 2024-09-21T09:02:52.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.469+0000 7fc6273df640 1 --2- 172.21.15.44:0/2888957389 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc6040382a0 0x7fc60403a760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.469+0000 7fc6273df640 1 --2- 172.21.15.44:0/2888957389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6201290e0 0x7fc62008afc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.469+0000 7fc6273df640 1 -- 172.21.15.44:0/2888957389 >> 172.21.15.44:0/2888957389 conn(0x7fc62009a890 msgr2=0x7fc620128910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.469+0000 7fc6273df640 1 -- 172.21.15.44:0/2888957389 shutdown_connections 2024-09-21T09:02:52.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.469+0000 7fc6273df640 1 -- 172.21.15.44:0/2888957389 wait complete. 2024-09-21T09:02:52.481 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T09:02:52.482 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T09:02:52.482 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T09:02:52.483 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T09:02:52.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.589+0000 7f866de9b640 1 Processor -- start 2024-09-21T09:02:52.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.589+0000 7fbf79696640 1 Processor -- start 2024-09-21T09:02:52.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.589+0000 7fd475f31640 1 Processor -- start 2024-09-21T09:02:52.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.589+0000 7fbf79696640 1 -- start start 2024-09-21T09:02:52.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.589+0000 7fd475f31640 1 -- start start 2024-09-21T09:02:52.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.589+0000 7f866de9b640 1 -- start start 2024-09-21T09:02:52.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.589+0000 7f0522c53640 1 Processor -- start 2024-09-21T09:02:52.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.589+0000 7f866de9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f866812c570 0x7f866812c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.589+0000 7f0522c53640 1 -- start start 2024-09-21T09:02:52.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.589+0000 7fbf79696640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbf7412eba0 0x7fbf7412ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.589+0000 7f866de9b640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8668131890 con 0x7f8668098a20 2024-09-21T09:02:52.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.589+0000 7f866de9b640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f8668098550 con 0x7f866812c570 2024-09-21T09:02:52.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fbf79696640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf74098b00 con 0x7fbf7412e770 2024-09-21T09:02:52.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fbf79696640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fbf7412f4c0 con 0x7fbf7412eba0 2024-09-21T09:02:52.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fd475f31640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd47009bd50 0x7fd47009c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fd475f31640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd47009d3b0 con 0x7fd47009c670 2024-09-21T09:02:52.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fd46f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd47009bd50 0x7fd47009c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fbf72ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbf7412eba0 0x7fbf7412ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fd475f31640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd470098230 con 0x7fd47009bd50 2024-09-21T09:02:52.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fd46f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd47009bd50 0x7fd47009c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43912/0 (socket says 172.21.15.44:43912) 2024-09-21T09:02:52.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fd46f7fe640 1 -- 172.21.15.44:0/2522304762 learned_addr learned my addr 172.21.15.44:0/2522304762 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:52.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fbf72ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbf7412eba0 0x7fbf7412ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43926/0 (socket says 172.21.15.44:43926) 2024-09-21T09:02:52.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fbf72ffd640 1 -- 172.21.15.44:0/806449218 learned_addr learned my addr 172.21.15.44:0/806449218 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:52.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7f86677fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f866812c570 0x7f866812c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7f86677fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f866812c570 0x7f866812c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43904/0 (socket says 172.21.15.44:43904) 2024-09-21T09:02:52.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7f86677fe640 1 -- 172.21.15.44:0/2291092470 learned_addr learned my addr 172.21.15.44:0/2291092470 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:52.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7f0522c53640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f051c12c850 0x7f051c131930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7f0522c53640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f051c12cda0 con 0x7f051c12d1f0 2024-09-21T09:02:52.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7f0522c53640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f051c070d00 con 0x7f051c12c850 2024-09-21T09:02:52.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fd46f7fe640 1 -- 172.21.15.44:0/2522304762 >> v1:172.21.15.44:6789/0 conn(0x7fd47009c670 legacy=0x7fd4700990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fd46f7fe640 1 -- 172.21.15.44:0/2522304762 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4700983e0 con 0x7fd47009bd50 2024-09-21T09:02:52.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fbf72ffd640 1 -- 172.21.15.44:0/806449218 >> v1:172.21.15.44:6789/0 conn(0x7fbf7412e770 legacy=0x7fbf7412b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7f051bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f051c12c850 0x7f051c131930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7f86677fe640 1 -- 172.21.15.44:0/2291092470 >> v1:172.21.15.44:6789/0 conn(0x7f8668098a20 legacy=0x7f866812ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7f05209ef640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f051c12d1f0 0x7f051c0705f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55758/0 (socket says 172.21.15.44:55758) 2024-09-21T09:02:52.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7f86677fe640 1 -- 172.21.15.44:0/2291092470 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8668132a70 con 0x7f866812c570 2024-09-21T09:02:52.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7f05209ef640 1 -- 172.21.15.44:0/447604650 learned_addr learned my addr 172.21.15.44:0/447604650 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:52.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.590+0000 7fbf72ffd640 1 -- 172.21.15.44:0/806449218 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf740986c0 con 0x7fbf7412eba0 2024-09-21T09:02:52.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.591+0000 7f051bfff640 1 -- 172.21.15.44:0/447604650 >> v1:172.21.15.44:6789/0 conn(0x7f051c12d1f0 legacy=0x7f051c0705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.591+0000 7f051bfff640 1 -- 172.21.15.44:0/447604650 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c0719d0 con 0x7f051c12c850 2024-09-21T09:02:52.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.591+0000 7fbf72ffd640 1 --2- 172.21.15.44:0/806449218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf7412eba0 0x7fbf7412ef80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf640097f0 tx=0x7fbf6402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98805a9bc3b733c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.591+0000 7fd46f7fe640 1 --2- 172.21.15.44:0/2522304762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd47009bd50 0x7fd47009c130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd4600097f0 tx=0x7fd46002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37896ecb619fedb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7fd46e7fc640 1 -- 172.21.15.44:0/2522304762 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd460037070 con 0x7fd47009bd50 2024-09-21T09:02:52.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7f051bfff640 1 --2- 172.21.15.44:0/447604650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f051c12c850 0x7f051c131930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0508009720 tx=0x7f050802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5600cdb5c580f76d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7fbf71ffb640 1 -- 172.21.15.44:0/806449218 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf64037070 con 0x7fbf7412eba0 2024-09-21T09:02:52.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7fd46e7fc640 1 -- 172.21.15.44:0/2522304762 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd460032440 con 0x7fd47009bd50 2024-09-21T09:02:52.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7f86677fe640 1 --2- 172.21.15.44:0/2291092470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f866812c570 0x7f866812c950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f86580097f0 tx=0x7f865802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca89022ee84a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7fd46e7fc640 1 -- 172.21.15.44:0/2522304762 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd46002ae60 con 0x7fd47009bd50 2024-09-21T09:02:52.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7fbf71ffb640 1 -- 172.21.15.44:0/806449218 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf64032440 con 0x7fbf7412eba0 2024-09-21T09:02:52.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7f051b7fe640 1 -- 172.21.15.44:0/447604650 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0508037070 con 0x7f051c12c850 2024-09-21T09:02:52.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7f051b7fe640 1 -- 172.21.15.44:0/447604650 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f050802ad90 con 0x7f051c12c850 2024-09-21T09:02:52.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7f051b7fe640 1 -- 172.21.15.44:0/447604650 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0508032590 con 0x7f051c12c850 2024-09-21T09:02:52.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7f86667fc640 1 -- 172.21.15.44:0/2291092470 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8658037070 con 0x7f866812c570 2024-09-21T09:02:52.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7fbf71ffb640 1 -- 172.21.15.44:0/806449218 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf64037070 con 0x7fbf7412eba0 2024-09-21T09:02:52.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7f86667fc640 1 -- 172.21.15.44:0/2291092470 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8658032440 con 0x7f866812c570 2024-09-21T09:02:52.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7f86667fc640 1 -- 172.21.15.44:0/2291092470 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8658037070 con 0x7f866812c570 2024-09-21T09:02:52.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7fd475f31640 1 -- 172.21.15.44:0/2522304762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd47009bd50 msgr2=0x7fd47009c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.592+0000 7fd475f31640 1 --2- 172.21.15.44:0/2522304762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd47009bd50 0x7fd47009c130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd4600097f0 tx=0x7fd46002a1e0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7fbf79696640 1 -- 172.21.15.44:0/806449218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf7412eba0 msgr2=0x7fbf7412ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7fbf79696640 1 --2- 172.21.15.44:0/806449218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf7412eba0 0x7fbf7412ef80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf640097f0 tx=0x7fbf6402a1e0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7fd475f31640 1 -- 172.21.15.44:0/2522304762 shutdown_connections 2024-09-21T09:02:52.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7fd475f31640 1 --2- 172.21.15.44:0/2522304762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd47009bd50 0x7fd47009c130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7fd475f31640 1 -- 172.21.15.44:0/2522304762 >> 172.21.15.44:0/2522304762 conn(0x7fd47006d4a0 msgr2=0x7fd47006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7fbf79696640 1 -- 172.21.15.44:0/806449218 shutdown_connections 2024-09-21T09:02:52.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7fbf79696640 1 --2- 172.21.15.44:0/806449218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf7412eba0 0x7fbf7412ef80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7fd475f31640 1 -- 172.21.15.44:0/2522304762 shutdown_connections 2024-09-21T09:02:52.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7fbf79696640 1 -- 172.21.15.44:0/806449218 >> 172.21.15.44:0/806449218 conn(0x7fbf7406d030 msgr2=0x7fbf7406d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7fd475f31640 1 -- 172.21.15.44:0/2522304762 wait complete. 2024-09-21T09:02:52.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7fbf79696640 1 -- 172.21.15.44:0/806449218 shutdown_connections 2024-09-21T09:02:52.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7f0522c53640 1 -- 172.21.15.44:0/447604650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f051c12c850 msgr2=0x7f051c131930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7fbf79696640 1 -- 172.21.15.44:0/806449218 wait complete. 2024-09-21T09:02:52.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7f0522c53640 1 --2- 172.21.15.44:0/447604650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f051c12c850 0x7f051c131930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0508009720 tx=0x7f050802a110 comp rx=0 tx=0).stop 2024-09-21T09:02:52.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7f0522c53640 1 -- 172.21.15.44:0/447604650 shutdown_connections 2024-09-21T09:02:52.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7f0522c53640 1 --2- 172.21.15.44:0/447604650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f051c12c850 0x7f051c131930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7f0522c53640 1 -- 172.21.15.44:0/447604650 >> 172.21.15.44:0/447604650 conn(0x7f051c09cbe0 msgr2=0x7f051c09cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7f0522c53640 1 -- 172.21.15.44:0/447604650 shutdown_connections 2024-09-21T09:02:52.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7f0522c53640 1 -- 172.21.15.44:0/447604650 wait complete. 2024-09-21T09:02:52.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7f866de9b640 1 -- 172.21.15.44:0/2291092470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f866812c570 msgr2=0x7f866812c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7f866de9b640 1 --2- 172.21.15.44:0/2291092470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f866812c570 0x7f866812c950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f86580097f0 tx=0x7f865802a1e0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7f866de9b640 1 -- 172.21.15.44:0/2291092470 shutdown_connections 2024-09-21T09:02:52.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7f866de9b640 1 --2- 172.21.15.44:0/2291092470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f866812c570 0x7f866812c950 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7f866de9b640 1 -- 172.21.15.44:0/2291092470 >> 172.21.15.44:0/2291092470 conn(0x7f866809f020 msgr2=0x7f866809f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7f866de9b640 1 -- 172.21.15.44:0/2291092470 shutdown_connections 2024-09-21T09:02:52.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.593+0000 7f866de9b640 1 -- 172.21.15.44:0/2291092470 wait complete. 2024-09-21T09:02:52.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.594+0000 7f0522c53640 1 Processor -- start 2024-09-21T09:02:52.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.594+0000 7fd475f31640 1 Processor -- start 2024-09-21T09:02:52.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.594+0000 7f0522c53640 1 -- start start 2024-09-21T09:02:52.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.594+0000 7fbf79696640 1 Processor -- start 2024-09-21T09:02:52.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.594+0000 7fbf79696640 1 -- start start 2024-09-21T09:02:52.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.594+0000 7fd475f31640 1 -- start start 2024-09-21T09:02:52.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7f0522c53640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f051c12c850 0x7f051c08afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7f0522c53640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f051c06d240 con 0x7f051c12c850 2024-09-21T09:02:52.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7fbf79696640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf7412e770 0x7fbf741c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7fbf79696640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7409cb70 con 0x7fbf7412e770 2024-09-21T09:02:52.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7f05209ef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f051c12c850 0x7f051c08afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7f05209ef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f051c12c850 0x7f051c08afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43958/0 (socket says 172.21.15.44:43958) 2024-09-21T09:02:52.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7fd475f31640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd47009bd50 0x7fd470094270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7fbf72ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf7412e770 0x7fbf741c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7fbf72ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf7412e770 0x7fbf741c36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43960/0 (socket says 172.21.15.44:43960) 2024-09-21T09:02:52.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7fbf72ffd640 1 -- 172.21.15.44:0/3483965980 learned_addr learned my addr 172.21.15.44:0/3483965980 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:52.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7fd475f31640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd470099b90 con 0x7fd47009bd50 2024-09-21T09:02:52.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7fd46f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd47009bd50 0x7fd470094270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7f866de9b640 1 Processor -- start 2024-09-21T09:02:52.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7fd46f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd47009bd50 0x7fd470094270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43972/0 (socket says 172.21.15.44:43972) 2024-09-21T09:02:52.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7fd46f7fe640 1 -- 172.21.15.44:0/3932997487 learned_addr learned my addr 172.21.15.44:0/3932997487 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:52.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7fbf72ffd640 1 -- 172.21.15.44:0/3483965980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7408da10 con 0x7fbf7412e770 2024-09-21T09:02:52.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7f866de9b640 1 -- start start 2024-09-21T09:02:52.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7f05209ef640 1 -- 172.21.15.44:0/955985092 learned_addr learned my addr 172.21.15.44:0/955985092 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:52.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.595+0000 7fbf72ffd640 1 --2- 172.21.15.44:0/3483965980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf7412e770 0x7fbf741c36b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbf6402a220 tx=0x7fbf640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7f05209ef640 1 -- 172.21.15.44:0/955985092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c08df40 con 0x7f051c12c850 2024-09-21T09:02:52.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7fbf5b7fe640 1 -- 172.21.15.44:0/3483965980 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf64041020 con 0x7fbf7412e770 2024-09-21T09:02:52.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7fd46f7fe640 1 -- 172.21.15.44:0/3932997487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd470096d40 con 0x7fd47009bd50 2024-09-21T09:02:52.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7fbf79696640 1 -- 172.21.15.44:0/3483965980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf74128d80 con 0x7fbf7412e770 2024-09-21T09:02:52.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7fbf5b7fe640 1 -- 172.21.15.44:0/3483965980 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf640325f0 con 0x7fbf7412e770 2024-09-21T09:02:52.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7fbf5b7fe640 1 -- 172.21.15.44:0/3483965980 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf64037040 con 0x7fbf7412e770 2024-09-21T09:02:52.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7fd46f7fe640 1 --2- 172.21.15.44:0/3932997487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd47009bd50 0x7fd470094270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd46002a220 tx=0x7fd4600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7f05209ef640 1 --2- 172.21.15.44:0/955985092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f051c12c850 0x7f051c08afc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f051000c4a0 tx=0x7f051000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7f866de9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8668098a20 0x7f86680723f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7f866de9b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8668131df0 con 0x7f8668098a20 2024-09-21T09:02:52.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7f86677fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8668098a20 0x7f86680723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7fd457fff640 1 -- 172.21.15.44:0/3932997487 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd460041070 con 0x7fd47009bd50 2024-09-21T09:02:52.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7f86677fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8668098a20 0x7f86680723f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43976/0 (socket says 172.21.15.44:43976) 2024-09-21T09:02:52.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7f86677fe640 1 -- 172.21.15.44:0/943459500 learned_addr learned my addr 172.21.15.44:0/943459500 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:52.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7fd457fff640 1 -- 172.21.15.44:0/3932997487 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4600307d0 con 0x7fd47009bd50 2024-09-21T09:02:52.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7fd457fff640 1 -- 172.21.15.44:0/3932997487 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd460037040 con 0x7fd47009bd50 2024-09-21T09:02:52.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7fd475f31640 1 -- 172.21.15.44:0/3932997487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd470095c10 con 0x7fd47009bd50 2024-09-21T09:02:52.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7fd475f31640 1 -- 172.21.15.44:0/3932997487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4700947b0 con 0x7fd47009bd50 2024-09-21T09:02:52.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7fbf79696640 1 -- 172.21.15.44:0/3483965980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf7408e6a0 con 0x7fbf7412e770 2024-09-21T09:02:52.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.596+0000 7f86677fe640 1 -- 172.21.15.44:0/943459500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8668070d50 con 0x7f8668098a20 2024-09-21T09:02:52.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.597+0000 7f05197fa640 1 -- 172.21.15.44:0/955985092 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0510017070 con 0x7f051c12c850 2024-09-21T09:02:52.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.597+0000 7f86677fe640 1 --2- 172.21.15.44:0/943459500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8668098a20 0x7f86680723f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f865802a220 tx=0x7f86580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.597+0000 7f05197fa640 1 -- 172.21.15.44:0/955985092 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0510005c10 con 0x7f051c12c850 2024-09-21T09:02:52.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.597+0000 7f05197fa640 1 -- 172.21.15.44:0/955985092 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0510007070 con 0x7f051c12c850 2024-09-21T09:02:52.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.597+0000 7f0522c53640 1 -- 172.21.15.44:0/955985092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f051c08c910 con 0x7f051c12c850 2024-09-21T09:02:52.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.597+0000 7f0522c53640 1 -- 172.21.15.44:0/955985092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f051c126e00 con 0x7f051c12c850 2024-09-21T09:02:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.597+0000 7f864ffff640 1 -- 172.21.15.44:0/943459500 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8658042070 con 0x7f8668098a20 2024-09-21T09:02:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.597+0000 7f864ffff640 1 -- 172.21.15.44:0/943459500 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8658030920 con 0x7f8668098a20 2024-09-21T09:02:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.597+0000 7f864ffff640 1 -- 172.21.15.44:0/943459500 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f865802ae60 con 0x7f8668098a20 2024-09-21T09:02:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.597+0000 7fd475f31640 1 -- 172.21.15.44:0/3932997487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd47009a130 con 0x7fd47009bd50 2024-09-21T09:02:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.597+0000 7fd457fff640 1 -- 172.21.15.44:0/3932997487 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd460044070 con 0x7fd47009bd50 2024-09-21T09:02:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.597+0000 7f866de9b640 1 -- 172.21.15.44:0/943459500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8668095e00 con 0x7f8668098a20 2024-09-21T09:02:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.598+0000 7f866de9b640 1 -- 172.21.15.44:0/943459500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8668071ca0 con 0x7f8668098a20 2024-09-21T09:02:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.598+0000 7fbf79696640 1 -- 172.21.15.44:0/3483965980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf7408e930 con 0x7fbf7412e770 2024-09-21T09:02:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.598+0000 7fd457fff640 1 --2- 172.21.15.44:0/3932997487 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd45c038320 0x7fd45c03a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.598+0000 7fd457fff640 1 -- 172.21.15.44:0/3932997487 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fd46006bfd0 con 0x7fd47009bd50 2024-09-21T09:02:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.598+0000 7fd457fff640 1 --2- 172.21.15.44:0/3932997487 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x7fd45c03daa0 0x7fd45c03ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.598+0000 7fd457fff640 1 -- 172.21.15.44:0/3932997487 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd460042e80 con 0x7fd45c03daa0 2024-09-21T09:02:52.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.598+0000 7fbf5b7fe640 1 -- 172.21.15.44:0/3483965980 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbf64044020 con 0x7fbf7412e770 2024-09-21T09:02:52.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.598+0000 7fd46ffff640 1 --2- 172.21.15.44:0/3932997487 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x7fd45c03daa0 0x7fd45c03ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.598+0000 7fd457fff640 1 -- 172.21.15.44:0/3932997487 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fd46003b840 con 0x7fd47009bd50 2024-09-21T09:02:52.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.598+0000 7fbf5b7fe640 1 --2- 172.21.15.44:0/3483965980 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fbf60038430 0x7fbf6003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.598+0000 7fbf5b7fe640 1 -- 172.21.15.44:0/3483965980 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fbf6406bbc0 con 0x7fbf7412e770 2024-09-21T09:02:52.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.599+0000 7f05197fa640 1 -- 172.21.15.44:0/955985092 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f051001a070 con 0x7f051c12c850 2024-09-21T09:02:52.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.598+0000 7fbf5b7fe640 1 --2- 172.21.15.44:0/3483965980 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fbf6003dbb0 0x7fbf60040030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.599+0000 7fbf5b7fe640 1 -- 172.21.15.44:0/3483965980 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf64038e50 con 0x7fbf6003dbb0 2024-09-21T09:02:52.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.599+0000 7fbf5b7fe640 1 -- 172.21.15.44:0/3483965980 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fbf6403a710 con 0x7fbf7412e770 2024-09-21T09:02:52.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.599+0000 7f0522c53640 1 -- 172.21.15.44:0/955985092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f051c0705f0 con 0x7f051c12c850 2024-09-21T09:02:52.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.599+0000 7f866de9b640 1 -- 172.21.15.44:0/943459500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86681322a0 con 0x7f8668098a20 2024-09-21T09:02:52.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.599+0000 7fbf727fc640 1 --2- 172.21.15.44:0/3483965980 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fbf60038430 0x7fbf6003a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.599+0000 7fd46effd640 1 --2- 172.21.15.44:0/3932997487 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd45c038320 0x7fd45c03a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.599+0000 7fd46ffff640 1 --2- 172.21.15.44:0/3932997487 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x7fd45c03daa0 0x7fd45c03ff20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.599+0000 7f05197fa640 1 --2- 172.21.15.44:0/955985092 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0500038340 0x7f050003a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.599+0000 7f864ffff640 1 -- 172.21.15.44:0/943459500 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8658045070 con 0x7f8668098a20 2024-09-21T09:02:52.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.599+0000 7f05197fa640 1 -- 172.21.15.44:0/955985092 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f051004a5f0 con 0x7f051c12c850 2024-09-21T09:02:52.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f051bfff640 1 --2- 172.21.15.44:0/955985092 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0500038340 0x7f050003a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.599+0000 7fbf737fe640 1 --2- 172.21.15.44:0/3483965980 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fbf6003dbb0 0x7fbf60040030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f05197fa640 1 --2- 172.21.15.44:0/955985092 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x7f050003db40 0x7f050003ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f864ffff640 1 --2- 172.21.15.44:0/943459500 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f86540382f0 0x7f865403a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f864ffff640 1 -- 172.21.15.44:0/943459500 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f865806b770 con 0x7f8668098a20 2024-09-21T09:02:52.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f05197fa640 1 -- 172.21.15.44:0/955985092 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0500040690 con 0x7f050003db40 2024-09-21T09:02:52.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f05197fa640 1 -- 172.21.15.44:0/955985092 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f0510051050 con 0x7f051c12c850 2024-09-21T09:02:52.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f864ffff640 1 --2- 172.21.15.44:0/943459500 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x7f865403da70 0x7f865403fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f864ffff640 1 -- 172.21.15.44:0/943459500 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f865804ce80 con 0x7f865403da70 2024-09-21T09:02:52.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f864ffff640 1 -- 172.21.15.44:0/943459500 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f8658072050 con 0x7f8668098a20 2024-09-21T09:02:52.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7fd46effd640 1 --2- 172.21.15.44:0/3932997487 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd45c038320 0x7fd45c03a7e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd47009cac0 tx=0x7fd464007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7fbf727fc640 1 --2- 172.21.15.44:0/3483965980 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fbf60038430 0x7fbf6003a8f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf7412eb70 tx=0x7fbf68007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f8666ffd640 1 --2- 172.21.15.44:0/943459500 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f86540382f0 0x7f865403a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f05211f0640 1 --2- 172.21.15.44:0/955985092 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x7f050003db40 0x7f050003ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f8667fff640 1 --2- 172.21.15.44:0/943459500 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x7f865403da70 0x7f865403fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7fbf737fe640 1 --2- 172.21.15.44:0/3483965980 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fbf6003dbb0 0x7fbf60040030 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7fd457fff640 1 -- 172.21.15.44:0/3932997487 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd460042e80 con 0x7fd45c03daa0 2024-09-21T09:02:52.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f051bfff640 1 --2- 172.21.15.44:0/955985092 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0500038340 0x7f050003a800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0508034000 tx=0x7f050802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f05211f0640 1 --2- 172.21.15.44:0/955985092 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x7f050003db40 0x7f050003ffc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.600+0000 7f8666ffd640 1 --2- 172.21.15.44:0/943459500 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f86540382f0 0x7f865403a7b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f865c001560 tx=0x7f865c007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.601+0000 7f8667fff640 1 --2- 172.21.15.44:0/943459500 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x7f865403da70 0x7f865403fef0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.601+0000 7fbf5b7fe640 1 -- 172.21.15.44:0/3483965980 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbf64038e50 con 0x7fbf6003dbb0 2024-09-21T09:02:52.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.601+0000 7f05197fa640 1 -- 172.21.15.44:0/955985092 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0500040690 con 0x7f050003db40 2024-09-21T09:02:52.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.601+0000 7f864ffff640 1 -- 172.21.15.44:0/943459500 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f865804ce80 con 0x7f865403da70 2024-09-21T09:02:52.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.630+0000 7fd475f31640 1 -- 172.21.15.44:0/3932997487 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd4701ab000 con 0x7fd45c03daa0 2024-09-21T09:02:52.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.630+0000 7fd457fff640 1 -- 172.21.15.44:0/3932997487 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd4701ab000 con 0x7fd45c03daa0 2024-09-21T09:02:52.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.631+0000 7fd475f31640 1 -- 172.21.15.44:0/3932997487 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x7fd45c03daa0 msgr2=0x7fd45c03ff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.631+0000 7fd475f31640 1 --2- 172.21.15.44:0/3932997487 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x7fd45c03daa0 0x7fd45c03ff20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.631+0000 7fd475f31640 1 -- 172.21.15.44:0/3932997487 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd45c038320 msgr2=0x7fd45c03a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.631+0000 7fd475f31640 1 --2- 172.21.15.44:0/3932997487 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd45c038320 0x7fd45c03a7e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd47009cac0 tx=0x7fd464007a50 comp rx=0 tx=0).stop 2024-09-21T09:02:52.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.631+0000 7fd475f31640 1 -- 172.21.15.44:0/3932997487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd47009bd50 msgr2=0x7fd470094270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.631+0000 7fd475f31640 1 --2- 172.21.15.44:0/3932997487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd47009bd50 0x7fd470094270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd46002a220 tx=0x7fd4600046c0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.631+0000 7fd475f31640 1 -- 172.21.15.44:0/3932997487 shutdown_connections 2024-09-21T09:02:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.631+0000 7fd475f31640 1 --2- 172.21.15.44:0/3932997487 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x7fd45c03daa0 0x7fd45c03ff20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.631+0000 7fd475f31640 1 --2- 172.21.15.44:0/3932997487 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd45c038320 0x7fd45c03a7e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.631+0000 7fd475f31640 1 --2- 172.21.15.44:0/3932997487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd47009bd50 0x7fd470094270 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.631+0000 7fd475f31640 1 -- 172.21.15.44:0/3932997487 >> 172.21.15.44:0/3932997487 conn(0x7fd47006d4a0 msgr2=0x7fd47009eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.631+0000 7fd475f31640 1 -- 172.21.15.44:0/3932997487 shutdown_connections 2024-09-21T09:02:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.631+0000 7fd475f31640 1 -- 172.21.15.44:0/3932997487 wait complete. 2024-09-21T09:02:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.631+0000 7fbf79696640 1 -- 172.21.15.44:0/3483965980 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbf7412edf0 con 0x7fbf6003dbb0 2024-09-21T09:02:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.632+0000 7fbf5b7fe640 1 -- 172.21.15.44:0/3483965980 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbf7412edf0 con 0x7fbf6003dbb0 2024-09-21T09:02:52.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.632+0000 7fbf79696640 1 -- 172.21.15.44:0/3483965980 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fbf6003dbb0 msgr2=0x7fbf60040030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.632+0000 7fbf79696640 1 --2- 172.21.15.44:0/3483965980 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fbf6003dbb0 0x7fbf60040030 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.632+0000 7fbf79696640 1 -- 172.21.15.44:0/3483965980 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fbf60038430 msgr2=0x7fbf6003a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.632+0000 7fbf79696640 1 --2- 172.21.15.44:0/3483965980 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fbf60038430 0x7fbf6003a8f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf7412eb70 tx=0x7fbf68007a50 comp rx=0 tx=0).stop 2024-09-21T09:02:52.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.632+0000 7fbf79696640 1 -- 172.21.15.44:0/3483965980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf7412e770 msgr2=0x7fbf741c36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.632+0000 7fbf79696640 1 --2- 172.21.15.44:0/3483965980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf7412e770 0x7fbf741c36b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbf6402a220 tx=0x7fbf640046c0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.632+0000 7fbf79696640 1 -- 172.21.15.44:0/3483965980 shutdown_connections 2024-09-21T09:02:52.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.632+0000 7fbf79696640 1 --2- 172.21.15.44:0/3483965980 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fbf6003dbb0 0x7fbf60040030 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.632+0000 7fbf79696640 1 --2- 172.21.15.44:0/3483965980 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fbf60038430 0x7fbf6003a8f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.632+0000 7fbf79696640 1 --2- 172.21.15.44:0/3483965980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf7412e770 0x7fbf741c36b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.632+0000 7fbf79696640 1 -- 172.21.15.44:0/3483965980 >> 172.21.15.44:0/3483965980 conn(0x7fbf7406d030 msgr2=0x7fbf7409a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.632+0000 7fbf79696640 1 -- 172.21.15.44:0/3483965980 shutdown_connections 2024-09-21T09:02:52.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.633+0000 7fbf79696640 1 -- 172.21.15.44:0/3483965980 wait complete. 2024-09-21T09:02:52.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.633+0000 7f0522c53640 1 -- 172.21.15.44:0/955985092 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f051c08d250 con 0x7f050003db40 2024-09-21T09:02:52.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.633+0000 7f866de9b640 1 -- 172.21.15.44:0/943459500 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8668071710 con 0x7f865403da70 2024-09-21T09:02:52.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.633+0000 7f864ffff640 1 -- 172.21.15.44:0/943459500 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8668071710 con 0x7f865403da70 2024-09-21T09:02:52.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.633+0000 7f05197fa640 1 -- 172.21.15.44:0/955985092 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f051c08d250 con 0x7f050003db40 2024-09-21T09:02:52.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f866de9b640 1 -- 172.21.15.44:0/943459500 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x7f865403da70 msgr2=0x7f865403fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f866de9b640 1 --2- 172.21.15.44:0/943459500 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x7f865403da70 0x7f865403fef0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f866de9b640 1 -- 172.21.15.44:0/943459500 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f86540382f0 msgr2=0x7f865403a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f866de9b640 1 --2- 172.21.15.44:0/943459500 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f86540382f0 0x7f865403a7b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f865c001560 tx=0x7f865c007a50 comp rx=0 tx=0).stop 2024-09-21T09:02:52.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f866de9b640 1 -- 172.21.15.44:0/943459500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8668098a20 msgr2=0x7f86680723f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f866de9b640 1 --2- 172.21.15.44:0/943459500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8668098a20 0x7f86680723f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f865802a220 tx=0x7f86580046c0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f0522c53640 1 -- 172.21.15.44:0/955985092 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x7f050003db40 msgr2=0x7f050003ffc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f0522c53640 1 --2- 172.21.15.44:0/955985092 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x7f050003db40 0x7f050003ffc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f866de9b640 1 -- 172.21.15.44:0/943459500 shutdown_connections 2024-09-21T09:02:52.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f866de9b640 1 --2- 172.21.15.44:0/943459500 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x7f865403da70 0x7f865403fef0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f866de9b640 1 --2- 172.21.15.44:0/943459500 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f86540382f0 0x7f865403a7b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f866de9b640 1 --2- 172.21.15.44:0/943459500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8668098a20 0x7f86680723f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f866de9b640 1 -- 172.21.15.44:0/943459500 >> 172.21.15.44:0/943459500 conn(0x7f866809f020 msgr2=0x7f866812ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f0522c53640 1 -- 172.21.15.44:0/955985092 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0500038340 msgr2=0x7f050003a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f0522c53640 1 --2- 172.21.15.44:0/955985092 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0500038340 0x7f050003a800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0508034000 tx=0x7f050802e000 comp rx=0 tx=0).stop 2024-09-21T09:02:52.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f0522c53640 1 -- 172.21.15.44:0/955985092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f051c12c850 msgr2=0x7f051c08afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f0522c53640 1 --2- 172.21.15.44:0/955985092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f051c12c850 0x7f051c08afc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f051000c4a0 tx=0x7f051000c960 comp rx=0 tx=0).stop 2024-09-21T09:02:52.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f0522c53640 1 -- 172.21.15.44:0/955985092 shutdown_connections 2024-09-21T09:02:52.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f0522c53640 1 --2- 172.21.15.44:0/955985092 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x7f050003db40 0x7f050003ffc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f0522c53640 1 --2- 172.21.15.44:0/955985092 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0500038340 0x7f050003a800 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0508034000 tx=0x7f050802e000 comp rx=0 tx=0).stop 2024-09-21T09:02:52.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f0522c53640 1 --2- 172.21.15.44:0/955985092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f051c12c850 0x7f051c08afc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f0522c53640 1 -- 172.21.15.44:0/955985092 >> 172.21.15.44:0/955985092 conn(0x7f051c09cbe0 msgr2=0x7f051c09d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f866de9b640 1 -- 172.21.15.44:0/943459500 shutdown_connections 2024-09-21T09:02:52.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f866de9b640 1 -- 172.21.15.44:0/943459500 wait complete. 2024-09-21T09:02:52.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f0522c53640 1 -- 172.21.15.44:0/955985092 shutdown_connections 2024-09-21T09:02:52.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.634+0000 7f0522c53640 1 -- 172.21.15.44:0/955985092 wait complete. 2024-09-21T09:02:52.647 INFO:teuthology.orchestra.run.smithi044.stdout:38654705669 2024-09-21T09:02:52.648 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T09:02:52.649 INFO:teuthology.orchestra.run.smithi044.stdout:38654705668 2024-09-21T09:02:52.649 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T09:02:52.650 INFO:teuthology.orchestra.run.smithi044.stdout:38654705668 2024-09-21T09:02:52.650 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T09:02:52.652 INFO:teuthology.orchestra.run.smithi044.stdout:42949672965 2024-09-21T09:02:52.653 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T09:02:52.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.756+0000 7f49c2703640 1 Processor -- start 2024-09-21T09:02:52.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.756+0000 7f49c2703640 1 -- start start 2024-09-21T09:02:52.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.757+0000 7f49c2703640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f49bc09a100 0x7f49bc133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.757+0000 7f49c2703640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49bc09d3b0 con 0x7f49bc09bd50 2024-09-21T09:02:52.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.757+0000 7f49c2703640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f49bc09c840 con 0x7f49bc09a100 2024-09-21T09:02:52.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.757+0000 7f49bb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f49bc09a100 0x7f49bc133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.757+0000 7f49bbfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f49bc09bd50 0x7f49bc09c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55772/0 (socket says 172.21.15.44:55772) 2024-09-21T09:02:52.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.757+0000 7f49bb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f49bc09a100 0x7f49bc133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43990/0 (socket says 172.21.15.44:43990) 2024-09-21T09:02:52.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.757+0000 7f49bbfff640 1 -- 172.21.15.44:0/2459128484 learned_addr learned my addr 172.21.15.44:0/2459128484 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:52.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.757+0000 7f49bb7fe640 1 -- 172.21.15.44:0/2459128484 >> v1:172.21.15.44:6789/0 conn(0x7f49bc09bd50 legacy=0x7f49bc09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.757+0000 7f49bb7fe640 1 -- 172.21.15.44:0/2459128484 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49bc098230 con 0x7f49bc09a100 2024-09-21T09:02:52.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.759+0000 7f49bb7fe640 1 --2- 172.21.15.44:0/2459128484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49bc09a100 0x7f49bc133da0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009720 tx=0x7f49b002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d683790ec8f717dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.759+0000 7f49baffd640 1 -- 172.21.15.44:0/2459128484 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49b0037070 con 0x7f49bc09a100 2024-09-21T09:02:52.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.759+0000 7f49baffd640 1 -- 172.21.15.44:0/2459128484 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b002ad90 con 0x7f49bc09a100 2024-09-21T09:02:52.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.759+0000 7f49baffd640 1 -- 172.21.15.44:0/2459128484 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49b0032590 con 0x7f49bc09a100 2024-09-21T09:02:52.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.760+0000 7f49c2703640 1 -- 172.21.15.44:0/2459128484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49bc09a100 msgr2=0x7f49bc133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.760+0000 7f49c2703640 1 --2- 172.21.15.44:0/2459128484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49bc09a100 0x7f49bc133da0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009720 tx=0x7f49b002a110 comp rx=0 tx=0).stop 2024-09-21T09:02:52.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.760+0000 7f49c2703640 1 -- 172.21.15.44:0/2459128484 shutdown_connections 2024-09-21T09:02:52.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.760+0000 7f49c2703640 1 --2- 172.21.15.44:0/2459128484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49bc09a100 0x7f49bc133da0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.760+0000 7f49c2703640 1 -- 172.21.15.44:0/2459128484 >> 172.21.15.44:0/2459128484 conn(0x7f49bc06d4a0 msgr2=0x7f49bc06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.760+0000 7f49c2703640 1 -- 172.21.15.44:0/2459128484 shutdown_connections 2024-09-21T09:02:52.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.760+0000 7f49c2703640 1 -- 172.21.15.44:0/2459128484 wait complete. 2024-09-21T09:02:52.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.761+0000 7f49c2703640 1 Processor -- start 2024-09-21T09:02:52.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.762+0000 7f49c2703640 1 -- start start 2024-09-21T09:02:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.762+0000 7f49c2703640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49bc09a100 0x7f49bc1c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.762+0000 7f49c2703640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc134670 con 0x7f49bc09a100 2024-09-21T09:02:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.762+0000 7f49bbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49bc09a100 0x7f49bc1c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.762+0000 7f49bbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49bc09a100 0x7f49bc1c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44004/0 (socket says 172.21.15.44:44004) 2024-09-21T09:02:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.762+0000 7f49bbfff640 1 -- 172.21.15.44:0/3014024350 learned_addr learned my addr 172.21.15.44:0/3014024350 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.763+0000 7f49bbfff640 1 -- 172.21.15.44:0/3014024350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49bc125ee0 con 0x7f49bc09a100 2024-09-21T09:02:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.763+0000 7f49bbfff640 1 --2- 172.21.15.44:0/3014024350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49bc09a100 0x7f49bc1c3990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00c4a0 tx=0x7f49ac00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.763+0000 7f49b8ff9640 1 -- 172.21.15.44:0/3014024350 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49ac017070 con 0x7f49bc09a100 2024-09-21T09:02:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.763+0000 7f49b8ff9640 1 -- 172.21.15.44:0/3014024350 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ac005c10 con 0x7f49bc09a100 2024-09-21T09:02:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.763+0000 7f49c2703640 1 -- 172.21.15.44:0/3014024350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49bc095510 con 0x7f49bc09a100 2024-09-21T09:02:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.763+0000 7f49b8ff9640 1 -- 172.21.15.44:0/3014024350 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49ac007070 con 0x7f49bc09a100 2024-09-21T09:02:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.763+0000 7f49c2703640 1 -- 172.21.15.44:0/3014024350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49bc0961a0 con 0x7f49bc09a100 2024-09-21T09:02:52.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.764+0000 7f49c2703640 1 -- 172.21.15.44:0/3014024350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49bc096490 con 0x7f49bc09a100 2024-09-21T09:02:52.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.764+0000 7f49b8ff9640 1 -- 172.21.15.44:0/3014024350 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f49ac01a070 con 0x7f49bc09a100 2024-09-21T09:02:52.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.765+0000 7f49b8ff9640 1 --2- 172.21.15.44:0/3014024350 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f49a80382a0 0x7f49a803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.765+0000 7f49b8ff9640 1 -- 172.21.15.44:0/3014024350 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f49ac04a540 con 0x7f49bc09a100 2024-09-21T09:02:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.765+0000 7f49bb7fe640 1 --2- 172.21.15.44:0/3014024350 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f49a80382a0 0x7f49a803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.765+0000 7f49bb7fe640 1 --2- 172.21.15.44:0/3014024350 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f49a80382a0 0x7f49a803a760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f49b0034000 tx=0x7f49b002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.770+0000 7f49b8ff9640 1 -- 172.21.15.44:0/3014024350 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f49bc096490 con 0x7f49bc09a100 2024-09-21T09:02:52.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.800+0000 7f697cb11640 1 Processor -- start 2024-09-21T09:02:52.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.800+0000 7f697cb11640 1 -- start start 2024-09-21T09:02:52.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.800+0000 7f4c796ac640 1 Processor -- start 2024-09-21T09:02:52.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.800+0000 7f4c796ac640 1 -- start start 2024-09-21T09:02:52.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7fe95abe4640 1 Processor -- start 2024-09-21T09:02:52.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7fe95abe4640 1 -- start start 2024-09-21T09:02:52.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7f4c796ac640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4c7412eba0 0x7f4c7412ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7f697cb11640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f697809a100 0x7f6978133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7f4c796ac640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c74098b00 con 0x7f4c7412e770 2024-09-21T09:02:52.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7f697cb11640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f697809d3b0 con 0x7f697809bd50 2024-09-21T09:02:52.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7f697cb11640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f697809c840 con 0x7f697809a100 2024-09-21T09:02:52.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7f4c796ac640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4c7412f4c0 con 0x7f4c7412eba0 2024-09-21T09:02:52.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7f4c72ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4c7412eba0 0x7f4c7412ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7f6975d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f697809a100 0x7f6978133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7f6975d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f697809a100 0x7f6978133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44022/0 (socket says 172.21.15.44:44022) 2024-09-21T09:02:52.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7f4c72ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4c7412eba0 0x7f4c7412ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44018/0 (socket says 172.21.15.44:44018) 2024-09-21T09:02:52.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7f4c72ffd640 1 -- 172.21.15.44:0/2159870710 learned_addr learned my addr 172.21.15.44:0/2159870710 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:52.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7f6975d9b640 1 -- 172.21.15.44:0/2282576241 learned_addr learned my addr 172.21.15.44:0/2282576241 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:52.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7f6975d9b640 1 -- 172.21.15.44:0/2282576241 >> v1:172.21.15.44:6789/0 conn(0x7f697809bd50 legacy=0x7f697809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T09:02:52.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.801+0000 7f6975d9b640 1 -- 172.21.15.44:0/2282576241 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6978098230 con 0x7f697809a100 2024-09-21T09:02:52.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.802+0000 7f4c72ffd640 1 -- 172.21.15.44:0/2159870710 >> v1:172.21.15.44:6789/0 conn(0x7f4c7412e770 legacy=0x7f4c7412b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T09:02:52.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.802+0000 7fe95abe4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe95406f290 0x7fe954130c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.802+0000 7fe958980640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe95406e7a0 0x7fe95406eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55806/0 (socket says 172.21.15.44:55806) 2024-09-21T09:02:52.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.802+0000 7fe958980640 1 -- 172.21.15.44:0/3378441845 learned_addr learned my addr 172.21.15.44:0/3378441845 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:52.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.802+0000 7f4c72ffd640 1 -- 172.21.15.44:0/2159870710 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c740986c0 con 0x7f4c7412eba0 2024-09-21T09:02:52.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.802+0000 7fe95abe4640 1 -- 172.21.15.44:0/3378441845 --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9540728c0 con 0x7fe95406e7a0 2024-09-21T09:02:52.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.802+0000 7fe95abe4640 1 -- 172.21.15.44:0/3378441845 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe9540701d0 con 0x7fe95406f290 2024-09-21T09:02:52.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.802+0000 7fe953fff640 1 --2- 172.21.15.44:0/3378441845 >> v2:172.21.15.44:3300/0 conn(0x7fe95406f290 0x7fe954130c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.802+0000 7fe9537fe640 1 -- 172.21.15.44:0/3378441845 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1239300598 0 0) 0x7fe9540728c0 con 0x7fe95406e7a0 2024-09-21T09:02:52.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.802+0000 7fe9537fe640 1 -- 172.21.15.44:0/3378441845 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe944003520 con 0x7fe95406e7a0 2024-09-21T09:02:52.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.802+0000 7fe953fff640 1 -- 172.21.15.44:0/3378441845 >> v1:172.21.15.44:6789/0 conn(0x7fe95406e7a0 legacy=0x7fe95406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.802+0000 7fe953fff640 1 -- 172.21.15.44:0/3378441845 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9540715a0 con 0x7fe95406f290 2024-09-21T09:02:52.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.803+0000 7f6975d9b640 1 --2- 172.21.15.44:0/2282576241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f697809a100 0x7f6978133da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f696c0097f0 tx=0x7f696c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1b9478faf42db8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.803+0000 7f4c72ffd640 1 --2- 172.21.15.44:0/2159870710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c7412eba0 0x7f4c7412ef80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4c640097f0 tx=0x7f4c6402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85334a1fbfc3dfc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.803+0000 7f697559a640 1 -- 172.21.15.44:0/2282576241 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f696c037070 con 0x7f697809a100 2024-09-21T09:02:52.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.803+0000 7f697559a640 1 -- 172.21.15.44:0/2282576241 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696c02ade0 con 0x7f697809a100 2024-09-21T09:02:52.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.803+0000 7f697559a640 1 -- 172.21.15.44:0/2282576241 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f696c032590 con 0x7f697809a100 2024-09-21T09:02:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.803+0000 7f4c71ffb640 1 -- 172.21.15.44:0/2159870710 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c64037070 con 0x7f4c7412eba0 2024-09-21T09:02:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.803+0000 7f4c71ffb640 1 -- 172.21.15.44:0/2159870710 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6402ade0 con 0x7f4c7412eba0 2024-09-21T09:02:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.803+0000 7f4c71ffb640 1 -- 172.21.15.44:0/2159870710 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c64032590 con 0x7f4c7412eba0 2024-09-21T09:02:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.803+0000 7fe953fff640 1 --2- 172.21.15.44:0/3378441845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe95406f290 0x7fe954130c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe940009720 tx=0x7fe94002c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746c2c2d01e1cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.803+0000 7fe9537fe640 1 -- 172.21.15.44:0/3378441845 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe940039070 con 0x7fe95406f290 2024-09-21T09:02:52.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.803+0000 7fe9537fe640 1 -- 172.21.15.44:0/3378441845 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe940034440 con 0x7fe95406f290 2024-09-21T09:02:52.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.803+0000 7fe9537fe640 1 -- 172.21.15.44:0/3378441845 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe940034740 con 0x7fe95406f290 2024-09-21T09:02:52.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7f697cb11640 1 -- 172.21.15.44:0/2282576241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f697809a100 msgr2=0x7f6978133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7f697cb11640 1 --2- 172.21.15.44:0/2282576241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f697809a100 0x7f6978133da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f696c0097f0 tx=0x7f696c02a1a0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7f4c796ac640 1 -- 172.21.15.44:0/2159870710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c7412eba0 msgr2=0x7f4c7412ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7f4c796ac640 1 --2- 172.21.15.44:0/2159870710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c7412eba0 0x7f4c7412ef80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4c640097f0 tx=0x7f4c6402a1a0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7f4c796ac640 1 -- 172.21.15.44:0/2159870710 shutdown_connections 2024-09-21T09:02:52.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7f4c796ac640 1 --2- 172.21.15.44:0/2159870710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c7412eba0 0x7f4c7412ef80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7f4c796ac640 1 -- 172.21.15.44:0/2159870710 >> 172.21.15.44:0/2159870710 conn(0x7f4c7406d030 msgr2=0x7f4c7406d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7f697cb11640 1 -- 172.21.15.44:0/2282576241 shutdown_connections 2024-09-21T09:02:52.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7f697cb11640 1 --2- 172.21.15.44:0/2282576241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f697809a100 0x7f6978133da0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7f697cb11640 1 -- 172.21.15.44:0/2282576241 >> 172.21.15.44:0/2282576241 conn(0x7f697806d4a0 msgr2=0x7f697806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7f4c796ac640 1 -- 172.21.15.44:0/2159870710 shutdown_connections 2024-09-21T09:02:52.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7f4c796ac640 1 -- 172.21.15.44:0/2159870710 wait complete. 2024-09-21T09:02:52.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7f697cb11640 1 -- 172.21.15.44:0/2282576241 shutdown_connections 2024-09-21T09:02:52.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7f697cb11640 1 -- 172.21.15.44:0/2282576241 wait complete. 2024-09-21T09:02:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7fe95abe4640 1 -- 172.21.15.44:0/3378441845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe95406f290 msgr2=0x7fe954130c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7fe95abe4640 1 --2- 172.21.15.44:0/3378441845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe95406f290 0x7fe954130c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe940009720 tx=0x7fe94002c320 comp rx=0 tx=0).stop 2024-09-21T09:02:52.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7fe95abe4640 1 -- 172.21.15.44:0/3378441845 shutdown_connections 2024-09-21T09:02:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7fe95abe4640 1 --2- 172.21.15.44:0/3378441845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe95406f290 0x7fe954130c70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.804+0000 7fe95abe4640 1 -- 172.21.15.44:0/3378441845 >> 172.21.15.44:0/3378441845 conn(0x7fe95409ac20 msgr2=0x7fe95406d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.805+0000 7fe95abe4640 1 -- 172.21.15.44:0/3378441845 shutdown_connections 2024-09-21T09:02:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.805+0000 7fe95abe4640 1 -- 172.21.15.44:0/3378441845 wait complete. 2024-09-21T09:02:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.805+0000 7f4c796ac640 1 Processor -- start 2024-09-21T09:02:52.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.805+0000 7f4c796ac640 1 -- start start 2024-09-21T09:02:52.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.805+0000 7f697cb11640 1 Processor -- start 2024-09-21T09:02:52.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.805+0000 7f697cb11640 1 -- start start 2024-09-21T09:02:52.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.805+0000 7f4c796ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c7412e770 0x7f4c741c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7f4c796ac640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7409cb70 con 0x7f4c7412e770 2024-09-21T09:02:52.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7f4c72ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c7412e770 0x7f4c741c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7f4c72ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c7412e770 0x7f4c741c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44042/0 (socket says 172.21.15.44:44042) 2024-09-21T09:02:52.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7f4c72ffd640 1 -- 172.21.15.44:0/735839443 learned_addr learned my addr 172.21.15.44:0/735839443 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:52.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7f697cb11640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f697809a100 0x7f69781328d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7f697cb11640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6978134670 con 0x7f697809a100 2024-09-21T09:02:52.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7f697659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f697809a100 0x7f69781328d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7f4c72ffd640 1 -- 172.21.15.44:0/735839443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7408d8a0 con 0x7f4c7412e770 2024-09-21T09:02:52.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7f697659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f697809a100 0x7f69781328d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44050/0 (socket says 172.21.15.44:44050) 2024-09-21T09:02:52.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7f697659c640 1 -- 172.21.15.44:0/1511558496 learned_addr learned my addr 172.21.15.44:0/1511558496 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:52.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7f4c72ffd640 1 --2- 172.21.15.44:0/735839443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c7412e770 0x7f4c741c3440 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c64035040 tx=0x7f4c64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7fe95abe4640 1 Processor -- start 2024-09-21T09:02:52.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7f697659c640 1 -- 172.21.15.44:0/1511558496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6978097540 con 0x7f697809a100 2024-09-21T09:02:52.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7fe95abe4640 1 -- start start 2024-09-21T09:02:52.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.806+0000 7f4c5b7fe640 1 -- 172.21.15.44:0/735839443 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c64041070 con 0x7f4c7412e770 2024-09-21T09:02:52.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.807+0000 7f4c796ac640 1 -- 172.21.15.44:0/735839443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7408e530 con 0x7f4c7412e770 2024-09-21T09:02:52.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.807+0000 7f4c5b7fe640 1 -- 172.21.15.44:0/735839443 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6403c590 con 0x7f4c7412e770 2024-09-21T09:02:52.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.807+0000 7f697659c640 1 --2- 172.21.15.44:0/1511558496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f697809a100 0x7f69781328d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f696800c3b0 tx=0x7f696800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.807+0000 7f4c796ac640 1 -- 172.21.15.44:0/735839443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c741c3980 con 0x7f4c7412e770 2024-09-21T09:02:52.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.807+0000 7f6966ffd640 1 -- 172.21.15.44:0/1511558496 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6968017070 con 0x7f697809a100 2024-09-21T09:02:52.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.807+0000 7f4c5b7fe640 1 -- 172.21.15.44:0/735839443 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c6404b060 con 0x7f4c7412e770 2024-09-21T09:02:52.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.807+0000 7fe95abe4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe95406e7a0 0x7fe9540944d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.807+0000 7f697cb11640 1 -- 172.21.15.44:0/1511558496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6978132e10 con 0x7f697809a100 2024-09-21T09:02:52.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.808+0000 7f697cb11640 1 -- 172.21.15.44:0/1511558496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6978133220 con 0x7f697809a100 2024-09-21T09:02:52.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.808+0000 7f6966ffd640 1 -- 172.21.15.44:0/1511558496 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6968005410 con 0x7f697809a100 2024-09-21T09:02:52.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.808+0000 7f6966ffd640 1 -- 172.21.15.44:0/1511558496 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6968003740 con 0x7f697809a100 2024-09-21T09:02:52.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.808+0000 7fe958980640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe95406e7a0 0x7fe9540944d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.808+0000 7fe958980640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe95406e7a0 0x7fe9540944d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44064/0 (socket says 172.21.15.44:44064) 2024-09-21T09:02:52.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.808+0000 7fe958980640 1 -- 172.21.15.44:0/4123212192 learned_addr learned my addr 172.21.15.44:0/4123212192 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:52.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.808+0000 7fe95abe4640 1 -- 172.21.15.44:0/4123212192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe95406bf30 con 0x7fe95406e7a0 2024-09-21T09:02:52.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.808+0000 7f4c5b7fe640 1 -- 172.21.15.44:0/735839443 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4c64044070 con 0x7f4c7412e770 2024-09-21T09:02:52.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.808+0000 7f4c5b7fe640 1 --2- 172.21.15.44:0/735839443 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4c60038250 0x7f4c6003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.808+0000 7f4c5b7fe640 1 -- 172.21.15.44:0/735839443 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f4c6406bf30 con 0x7f4c7412e770 2024-09-21T09:02:52.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.808+0000 7fe958980640 1 -- 172.21.15.44:0/4123212192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe954095bf0 con 0x7fe95406e7a0 2024-09-21T09:02:52.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.809+0000 7f6966ffd640 1 -- 172.21.15.44:0/1511558496 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f696801a070 con 0x7f697809a100 2024-09-21T09:02:52.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.809+0000 7f4c727fc640 1 --2- 172.21.15.44:0/735839443 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4c60038250 0x7f4c6003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.809+0000 7f4c796ac640 1 -- 172.21.15.44:0/735839443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7408e810 con 0x7f4c7412e770 2024-09-21T09:02:52.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.809+0000 7fe958980640 1 --2- 172.21.15.44:0/4123212192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe95406e7a0 0x7fe9540944d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe94800c700 tx=0x7fe94800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.809+0000 7f6966ffd640 1 --2- 172.21.15.44:0/1511558496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f69580382a0 0x7f695803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.809+0000 7f6966ffd640 1 -- 172.21.15.44:0/1511558496 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f696804a5d0 con 0x7f697809a100 2024-09-21T09:02:52.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.809+0000 7f697cb11640 1 -- 172.21.15.44:0/1511558496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69780008d0 con 0x7f697809a100 2024-09-21T09:02:52.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.809+0000 7f6975d9b640 1 --2- 172.21.15.44:0/1511558496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f69580382a0 0x7f695803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.809+0000 7f4c727fc640 1 --2- 172.21.15.44:0/735839443 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4c60038250 0x7f4c6003a710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4c7412eb70 tx=0x7f4c68007a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.810+0000 7f6975d9b640 1 --2- 172.21.15.44:0/1511558496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f69580382a0 0x7f695803a760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f696c034000 tx=0x7f696c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.814+0000 7fe9517fa640 1 -- 172.21.15.44:0/4123212192 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe948017070 con 0x7fe95406e7a0 2024-09-21T09:02:52.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.814+0000 7fe95abe4640 1 -- 172.21.15.44:0/4123212192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe954097810 con 0x7fe95406e7a0 2024-09-21T09:02:52.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.814+0000 7fe95abe4640 1 -- 172.21.15.44:0/4123212192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9540973d0 con 0x7fe95406e7a0 2024-09-21T09:02:52.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.814+0000 7f4c5b7fe640 1 -- 172.21.15.44:0/735839443 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4c6402ad90 con 0x7f4c7412e770 2024-09-21T09:02:52.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.815+0000 7fe95abe4640 1 -- 172.21.15.44:0/4123212192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe95406eb80 con 0x7fe95406e7a0 2024-09-21T09:02:52.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.818+0000 7fe9517fa640 1 -- 172.21.15.44:0/4123212192 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9480058b0 con 0x7fe95406e7a0 2024-09-21T09:02:52.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.818+0000 7fe9517fa640 1 -- 172.21.15.44:0/4123212192 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe948021060 con 0x7fe95406e7a0 2024-09-21T09:02:52.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.818+0000 7f6966ffd640 1 -- 172.21.15.44:0/1511558496 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f69680038e0 con 0x7f697809a100 2024-09-21T09:02:52.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.819+0000 7fe9517fa640 1 -- 172.21.15.44:0/4123212192 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe94801a070 con 0x7fe95406e7a0 2024-09-21T09:02:52.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.819+0000 7fe9517fa640 1 --2- 172.21.15.44:0/4123212192 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe9380382a0 0x7fe93803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:52.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.819+0000 7fe9517fa640 1 -- 172.21.15.44:0/4123212192 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fe94804ab10 con 0x7fe95406e7a0 2024-09-21T09:02:52.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.820+0000 7fe953fff640 1 --2- 172.21.15.44:0/4123212192 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe9380382a0 0x7fe93803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:52.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.820+0000 7fe953fff640 1 --2- 172.21.15.44:0/4123212192 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe9380382a0 0x7fe93803a760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe940036000 tx=0x7fe940030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:52.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.827+0000 7fe9517fa640 1 -- 172.21.15.44:0/4123212192 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe948005df0 con 0x7fe95406e7a0 2024-09-21T09:02:52.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.953+0000 7f49c2703640 1 -- 172.21.15.44:0/3014024350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f49bc1260b0 con 0x7f49bc09a100 2024-09-21T09:02:52.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.953+0000 7f49b8ff9640 1 -- 172.21.15.44:0/3014024350 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f49bc09d3b0 con 0x7f49bc09a100 2024-09-21T09:02:52.955 INFO:teuthology.orchestra.run.smithi044.stdout:38654705667 2024-09-21T09:02:52.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.955+0000 7f49c2703640 1 -- 172.21.15.44:0/3014024350 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f49a80382a0 msgr2=0x7f49a803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.955+0000 7f49c2703640 1 --2- 172.21.15.44:0/3014024350 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f49a80382a0 0x7f49a803a760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f49b0034000 tx=0x7f49b002e000 comp rx=0 tx=0).stop 2024-09-21T09:02:52.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.955+0000 7f49c2703640 1 -- 172.21.15.44:0/3014024350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49bc09a100 msgr2=0x7f49bc1c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:52.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.955+0000 7f49c2703640 1 --2- 172.21.15.44:0/3014024350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49bc09a100 0x7f49bc1c3990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00c4a0 tx=0x7f49ac00c960 comp rx=0 tx=0).stop 2024-09-21T09:02:52.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.955+0000 7f49c2703640 1 -- 172.21.15.44:0/3014024350 shutdown_connections 2024-09-21T09:02:52.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.955+0000 7f49c2703640 1 --2- 172.21.15.44:0/3014024350 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f49a80382a0 0x7f49a803a760 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.955+0000 7f49c2703640 1 --2- 172.21.15.44:0/3014024350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49bc09a100 0x7f49bc1c3990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:52.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.955+0000 7f49c2703640 1 -- 172.21.15.44:0/3014024350 >> 172.21.15.44:0/3014024350 conn(0x7f49bc06d4a0 msgr2=0x7f49bc096af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:52.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.955+0000 7f49c2703640 1 -- 172.21.15.44:0/3014024350 shutdown_connections 2024-09-21T09:02:52.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.955+0000 7f49c2703640 1 -- 172.21.15.44:0/3014024350 wait complete. 2024-09-21T09:02:52.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.2 2024-09-21T09:02:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.999+0000 7f697cb11640 1 -- 172.21.15.44:0/1511558496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6978074970 con 0x7f697809a100 2024-09-21T09:02:53.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:52.999+0000 7f6966ffd640 1 -- 172.21.15.44:0/1511558496 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6968012450 con 0x7f697809a100 2024-09-21T09:02:53.001 INFO:teuthology.orchestra.run.smithi044.stdout:42949672964 2024-09-21T09:02:53.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.001+0000 7f697cb11640 1 -- 172.21.15.44:0/1511558496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f69580382a0 msgr2=0x7f695803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:53.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.001+0000 7f697cb11640 1 --2- 172.21.15.44:0/1511558496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f69580382a0 0x7f695803a760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f696c034000 tx=0x7f696c02e000 comp rx=0 tx=0).stop 2024-09-21T09:02:53.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.001+0000 7f697cb11640 1 -- 172.21.15.44:0/1511558496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f697809a100 msgr2=0x7f69781328d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:53.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.001+0000 7f697cb11640 1 --2- 172.21.15.44:0/1511558496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f697809a100 0x7f69781328d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f696800c3b0 tx=0x7f696800c870 comp rx=0 tx=0).stop 2024-09-21T09:02:53.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.001+0000 7f697cb11640 1 -- 172.21.15.44:0/1511558496 shutdown_connections 2024-09-21T09:02:53.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.001+0000 7f697cb11640 1 --2- 172.21.15.44:0/1511558496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f69580382a0 0x7f695803a760 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:53.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.001+0000 7f697cb11640 1 --2- 172.21.15.44:0/1511558496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f697809a100 0x7f69781328d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:53.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.001+0000 7f697cb11640 1 -- 172.21.15.44:0/1511558496 >> 172.21.15.44:0/1511558496 conn(0x7f697806d4a0 msgr2=0x7f697808d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:53.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.001+0000 7f697cb11640 1 -- 172.21.15.44:0/1511558496 shutdown_connections 2024-09-21T09:02:53.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.001+0000 7f697cb11640 1 -- 172.21.15.44:0/1511558496 wait complete. 2024-09-21T09:02:53.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.003+0000 7f4c796ac640 1 -- 172.21.15.44:0/735839443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4c74075b40 con 0x7f4c7412e770 2024-09-21T09:02:53.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.003+0000 7f4c5b7fe640 1 -- 172.21.15.44:0/735839443 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4c6403b580 con 0x7f4c7412e770 2024-09-21T09:02:53.005 INFO:teuthology.orchestra.run.smithi044.stdout:38654705666 2024-09-21T09:02:53.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.005+0000 7f4c796ac640 1 -- 172.21.15.44:0/735839443 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4c60038250 msgr2=0x7f4c6003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:53.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.005+0000 7f4c796ac640 1 --2- 172.21.15.44:0/735839443 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4c60038250 0x7f4c6003a710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4c7412eb70 tx=0x7f4c68007a10 comp rx=0 tx=0).stop 2024-09-21T09:02:53.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.005+0000 7f4c796ac640 1 -- 172.21.15.44:0/735839443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c7412e770 msgr2=0x7f4c741c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:53.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.005+0000 7f4c796ac640 1 --2- 172.21.15.44:0/735839443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c7412e770 0x7f4c741c3440 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c64035040 tx=0x7f4c64004730 comp rx=0 tx=0).stop 2024-09-21T09:02:53.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.005+0000 7f4c796ac640 1 -- 172.21.15.44:0/735839443 shutdown_connections 2024-09-21T09:02:53.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.005+0000 7f4c796ac640 1 --2- 172.21.15.44:0/735839443 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4c60038250 0x7f4c6003a710 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:53.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.005+0000 7f4c796ac640 1 --2- 172.21.15.44:0/735839443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c7412e770 0x7f4c741c3440 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:53.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.005+0000 7f4c796ac640 1 -- 172.21.15.44:0/735839443 >> 172.21.15.44:0/735839443 conn(0x7f4c7406d030 msgr2=0x7f4c7409f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:53.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.005+0000 7f4c796ac640 1 -- 172.21.15.44:0/735839443 shutdown_connections 2024-09-21T09:02:53.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.005+0000 7f4c796ac640 1 -- 172.21.15.44:0/735839443 wait complete. 2024-09-21T09:02:53.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.007+0000 7fe95abe4640 1 -- 172.21.15.44:0/4123212192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe95406fc30 con 0x7fe95406e7a0 2024-09-21T09:02:53.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.008+0000 7fe9517fa640 1 -- 172.21.15.44:0/4123212192 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe9480117a0 con 0x7fe95406e7a0 2024-09-21T09:02:53.009 INFO:teuthology.orchestra.run.smithi044.stdout:38654705666 2024-09-21T09:02:53.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.011+0000 7fe95abe4640 1 -- 172.21.15.44:0/4123212192 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe9380382a0 msgr2=0x7fe93803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:53.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.011+0000 7fe95abe4640 1 --2- 172.21.15.44:0/4123212192 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe9380382a0 0x7fe93803a760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe940036000 tx=0x7fe940030000 comp rx=0 tx=0).stop 2024-09-21T09:02:53.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.011+0000 7fe95abe4640 1 -- 172.21.15.44:0/4123212192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe95406e7a0 msgr2=0x7fe9540944d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:53.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.011+0000 7fe95abe4640 1 --2- 172.21.15.44:0/4123212192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe95406e7a0 0x7fe9540944d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe94800c700 tx=0x7fe94800cbc0 comp rx=0 tx=0).stop 2024-09-21T09:02:53.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.011+0000 7fe95abe4640 1 -- 172.21.15.44:0/4123212192 shutdown_connections 2024-09-21T09:02:53.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.011+0000 7fe95abe4640 1 --2- 172.21.15.44:0/4123212192 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe9380382a0 0x7fe93803a760 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:53.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.011+0000 7fe95abe4640 1 --2- 172.21.15.44:0/4123212192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe95406e7a0 0x7fe9540944d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:53.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.011+0000 7fe95abe4640 1 -- 172.21.15.44:0/4123212192 >> 172.21.15.44:0/4123212192 conn(0x7fe95409ac20 msgr2=0x7fe95408cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:53.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.011+0000 7fe95abe4640 1 -- 172.21.15.44:0/4123212192 shutdown_connections 2024-09-21T09:02:53.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:53.011+0000 7fe95abe4640 1 -- 172.21.15.44:0/4123212192 wait complete. 2024-09-21T09:02:53.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.3 2024-09-21T09:02:53.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705666 for osd.0 2024-09-21T09:02:53.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705666 for osd.1 2024-09-21T09:02:53.973 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T09:02:54.018 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T09:02:54.019 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T09:02:54.026 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T09:02:54.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.087+0000 7f34e4cde640 1 Processor -- start 2024-09-21T09:02:54.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.087+0000 7f34e4cde640 1 -- start start 2024-09-21T09:02:54.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.088+0000 7f34e4cde640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f34e006dd90 0x7f34e0133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:54.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.088+0000 7f34e4cde640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e006f980 con 0x7f34e006d2a0 2024-09-21T09:02:54.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.088+0000 7f34e4cde640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f34e006fc20 con 0x7f34e006dd90 2024-09-21T09:02:54.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.088+0000 7f34ddd9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f34e006dd90 0x7f34e0133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:54.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.088+0000 7f34de59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f34e006d2a0 0x7f34e006d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55822/0 (socket says 172.21.15.44:55822) 2024-09-21T09:02:54.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.088+0000 7f34de59c640 1 -- 172.21.15.44:0/626864138 learned_addr learned my addr 172.21.15.44:0/626864138 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:54.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.088+0000 7f34ddd9b640 1 -- 172.21.15.44:0/626864138 >> v1:172.21.15.44:6789/0 conn(0x7f34e006d2a0 legacy=0x7f34e006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.088+0000 7f34ddd9b640 1 -- 172.21.15.44:0/626864138 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e006ed50 con 0x7f34e006dd90 2024-09-21T09:02:54.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.088+0000 7f34dd59a640 1 -- 172.21.15.44:0/626864138 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 292026192 0 0) 0x7f34d0001110 con 0x7f34e006d2a0 2024-09-21T09:02:54.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.089+0000 7f34ddd9b640 1 --2- 172.21.15.44:0/626864138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e006dd90 0x7f34e0133ca0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009720 tx=0x7f34d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf407cb5e8814bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:54.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.090+0000 7f34dd59a640 1 -- 172.21.15.44:0/626864138 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d4037070 con 0x7f34e006dd90 2024-09-21T09:02:54.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.090+0000 7f34dd59a640 1 -- 172.21.15.44:0/626864138 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d402ad90 con 0x7f34e006dd90 2024-09-21T09:02:54.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.090+0000 7f34dd59a640 1 -- 172.21.15.44:0/626864138 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d4032590 con 0x7f34e006dd90 2024-09-21T09:02:54.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.090+0000 7f34e4cde640 1 -- 172.21.15.44:0/626864138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e006dd90 msgr2=0x7f34e0133ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.090+0000 7f34e4cde640 1 --2- 172.21.15.44:0/626864138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e006dd90 0x7f34e0133ca0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009720 tx=0x7f34d402a110 comp rx=0 tx=0).stop 2024-09-21T09:02:54.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.091+0000 7f34e4cde640 1 -- 172.21.15.44:0/626864138 shutdown_connections 2024-09-21T09:02:54.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.091+0000 7f34e4cde640 1 --2- 172.21.15.44:0/626864138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e006dd90 0x7f34e0133ca0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.091+0000 7f34e4cde640 1 -- 172.21.15.44:0/626864138 >> 172.21.15.44:0/626864138 conn(0x7f34e009cbe0 msgr2=0x7f34e009cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:54.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.091+0000 7f34e4cde640 1 -- 172.21.15.44:0/626864138 shutdown_connections 2024-09-21T09:02:54.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.091+0000 7f34e4cde640 1 -- 172.21.15.44:0/626864138 wait complete. 2024-09-21T09:02:54.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.092+0000 7f34e4cde640 1 Processor -- start 2024-09-21T09:02:54.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.092+0000 7f34e4cde640 1 -- start start 2024-09-21T09:02:54.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.092+0000 7f34e4cde640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e006d2a0 0x7f34e00954e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:54.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.092+0000 7f34e4cde640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f34e01341e0 con 0x7f34e006d2a0 2024-09-21T09:02:54.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.092+0000 7f34de59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e006d2a0 0x7f34e00954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:54.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.092+0000 7f34de59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e006d2a0 0x7f34e00954e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44080/0 (socket says 172.21.15.44:44080) 2024-09-21T09:02:54.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.092+0000 7f34de59c640 1 -- 172.21.15.44:0/2599306596 learned_addr learned my addr 172.21.15.44:0/2599306596 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:54.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.093+0000 7f34de59c640 1 -- 172.21.15.44:0/2599306596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e0097500 con 0x7f34e006d2a0 2024-09-21T09:02:54.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.093+0000 7f34de59c640 1 --2- 172.21.15.44:0/2599306596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e006d2a0 0x7f34e00954e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f34d000c700 tx=0x7f34d000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:54.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.093+0000 7f34ceffd640 1 -- 172.21.15.44:0/2599306596 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d0018070 con 0x7f34e006d2a0 2024-09-21T09:02:54.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.093+0000 7f34ceffd640 1 -- 172.21.15.44:0/2599306596 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d00070d0 con 0x7f34e006d2a0 2024-09-21T09:02:54.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.093+0000 7f34e4cde640 1 -- 172.21.15.44:0/2599306596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e0098190 con 0x7f34e006d2a0 2024-09-21T09:02:54.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.093+0000 7f34ceffd640 1 -- 172.21.15.44:0/2599306596 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d00073f0 con 0x7f34e006d2a0 2024-09-21T09:02:54.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.093+0000 7f34e4cde640 1 -- 172.21.15.44:0/2599306596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e0095a20 con 0x7f34e006d2a0 2024-09-21T09:02:54.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.094+0000 7f34ceffd640 1 -- 172.21.15.44:0/2599306596 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f34d001b070 con 0x7f34e006d2a0 2024-09-21T09:02:54.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.094+0000 7f34e4cde640 1 -- 172.21.15.44:0/2599306596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e006d680 con 0x7f34e006d2a0 2024-09-21T09:02:54.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.095+0000 7f34ceffd640 1 --2- 172.21.15.44:0/2599306596 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34c00382a0 0x7f34c003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:54.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.095+0000 7f34ceffd640 1 -- 172.21.15.44:0/2599306596 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f34d004a600 con 0x7f34e006d2a0 2024-09-21T09:02:54.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.095+0000 7f34ddd9b640 1 --2- 172.21.15.44:0/2599306596 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34c00382a0 0x7f34c003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:54.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.096+0000 7f34ddd9b640 1 --2- 172.21.15.44:0/2599306596 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34c00382a0 0x7f34c003a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f34d4034000 tx=0x7f34d402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:54.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.100+0000 7f34ceffd640 1 -- 172.21.15.44:0/2599306596 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f34e006f980 con 0x7f34e006d2a0 2024-09-21T09:02:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.129+0000 7f62067e8640 1 Processor -- start 2024-09-21T09:02:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.129+0000 7f62067e8640 1 -- start start 2024-09-21T09:02:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.129+0000 7fac49349640 1 Processor -- start 2024-09-21T09:02:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.129+0000 7fac49349640 1 -- start start 2024-09-21T09:02:54.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7f62067e8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f620006f0b0 0x7f6200133d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:54.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7f62067e8640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f620006be10 con 0x7f620006e5c0 2024-09-21T09:02:54.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7f62067e8640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f620009b5a0 con 0x7f620006f0b0 2024-09-21T09:02:54.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7f61ff7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f620006f0b0 0x7f6200133d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:54.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7f61ff7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f620006f0b0 0x7f6200133d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44094/0 (socket says 172.21.15.44:44094) 2024-09-21T09:02:54.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7f61ff7fe640 1 -- 172.21.15.44:0/746125757 learned_addr learned my addr 172.21.15.44:0/746125757 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:54.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7fac49349640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fac441295c0 0x7fac441299a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:54.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7f61fffff640 1 --1- 172.21.15.44:0/746125757 >> v1:172.21.15.44:6789/0 conn(0x7f620006e5c0 0x7f620006e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55838/0 (socket says 172.21.15.44:55838) 2024-09-21T09:02:54.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7fac49349640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac44096f80 con 0x7fac44074e50 2024-09-21T09:02:54.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7fac49349640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fac440971f0 con 0x7fac441295c0 2024-09-21T09:02:54.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7fac42ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fac441295c0 0x7fac441299a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:54.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7fac42ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fac441295c0 0x7fac441299a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44100/0 (socket says 172.21.15.44:44100) 2024-09-21T09:02:54.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7fac42ffd640 1 -- 172.21.15.44:0/1475002210 learned_addr learned my addr 172.21.15.44:0/1475002210 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:54.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7f61ff7fe640 1 -- 172.21.15.44:0/746125757 >> v1:172.21.15.44:6789/0 conn(0x7f620006e5c0 legacy=0x7f620006e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T09:02:54.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.130+0000 7f61ff7fe640 1 -- 172.21.15.44:0/746125757 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620006c400 con 0x7f620006f0b0 2024-09-21T09:02:54.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.131+0000 7fac42ffd640 1 -- 172.21.15.44:0/1475002210 >> v1:172.21.15.44:6789/0 conn(0x7fac44074e50 legacy=0x7fac44092130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.131+0000 7fac42ffd640 1 -- 172.21.15.44:0/1475002210 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac44129ee0 con 0x7fac441295c0 2024-09-21T09:02:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.131+0000 7f61ff7fe640 1 --2- 172.21.15.44:0/746125757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620006f0b0 0x7f6200133d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61f40097f0 tx=0x7f61f402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5acdd5df97735a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.131+0000 7f61feffd640 1 -- 172.21.15.44:0/746125757 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f4037070 con 0x7f620006f0b0 2024-09-21T09:02:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.131+0000 7f61feffd640 1 -- 172.21.15.44:0/746125757 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f4032440 con 0x7f620006f0b0 2024-09-21T09:02:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.131+0000 7f61feffd640 1 -- 172.21.15.44:0/746125757 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f4032740 con 0x7f620006f0b0 2024-09-21T09:02:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.132+0000 7fac42ffd640 1 --2- 172.21.15.44:0/1475002210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac441295c0 0x7fac441299a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fac340097f0 tx=0x7fac3402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7fe68f79f68114 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.132+0000 7fac41ffb640 1 -- 172.21.15.44:0/1475002210 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac34037070 con 0x7fac441295c0 2024-09-21T09:02:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.132+0000 7fac41ffb640 1 -- 172.21.15.44:0/1475002210 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac34032440 con 0x7fac441295c0 2024-09-21T09:02:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.132+0000 7fac41ffb640 1 -- 172.21.15.44:0/1475002210 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac3402ae60 con 0x7fac441295c0 2024-09-21T09:02:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.132+0000 7f62067e8640 1 -- 172.21.15.44:0/746125757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620006f0b0 msgr2=0x7f6200133d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.132+0000 7f62067e8640 1 --2- 172.21.15.44:0/746125757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620006f0b0 0x7f6200133d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61f40097f0 tx=0x7f61f402a230 comp rx=0 tx=0).stop 2024-09-21T09:02:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.132+0000 7f62067e8640 1 -- 172.21.15.44:0/746125757 shutdown_connections 2024-09-21T09:02:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.132+0000 7f62067e8640 1 --2- 172.21.15.44:0/746125757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620006f0b0 0x7f6200133d10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.132+0000 7f62067e8640 1 -- 172.21.15.44:0/746125757 >> 172.21.15.44:0/746125757 conn(0x7f620009aa80 msgr2=0x7f620009ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.132+0000 7f62067e8640 1 -- 172.21.15.44:0/746125757 shutdown_connections 2024-09-21T09:02:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.132+0000 7f62067e8640 1 -- 172.21.15.44:0/746125757 wait complete. 2024-09-21T09:02:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.133+0000 7fac49349640 1 -- 172.21.15.44:0/1475002210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac441295c0 msgr2=0x7fac441299a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.133+0000 7fac49349640 1 --2- 172.21.15.44:0/1475002210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac441295c0 0x7fac441299a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fac340097f0 tx=0x7fac3402a1e0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.133+0000 7fac49349640 1 -- 172.21.15.44:0/1475002210 shutdown_connections 2024-09-21T09:02:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.133+0000 7fac49349640 1 --2- 172.21.15.44:0/1475002210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac441295c0 0x7fac441299a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.133+0000 7fac49349640 1 -- 172.21.15.44:0/1475002210 >> 172.21.15.44:0/1475002210 conn(0x7fac4409d6e0 msgr2=0x7fac44099bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.133+0000 7fac49349640 1 -- 172.21.15.44:0/1475002210 shutdown_connections 2024-09-21T09:02:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.133+0000 7fac49349640 1 -- 172.21.15.44:0/1475002210 wait complete. 2024-09-21T09:02:54.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.133+0000 7f62067e8640 1 Processor -- start 2024-09-21T09:02:54.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.134+0000 7f62067e8640 1 -- start start 2024-09-21T09:02:54.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.134+0000 7f62067e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620006e5c0 0x7f620008afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:54.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.134+0000 7f62067e8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6200134250 con 0x7f620006e5c0 2024-09-21T09:02:54.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.134+0000 7f61fffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620006e5c0 0x7f620008afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:54.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.134+0000 7f61fffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620006e5c0 0x7f620008afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44108/0 (socket says 172.21.15.44:44108) 2024-09-21T09:02:54.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.134+0000 7f61fffff640 1 -- 172.21.15.44:0/3611891918 learned_addr learned my addr 172.21.15.44:0/3611891918 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:54.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.134+0000 7fac49349640 1 Processor -- start 2024-09-21T09:02:54.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.134+0000 7fac49349640 1 -- start start 2024-09-21T09:02:54.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.134+0000 7f61fffff640 1 -- 172.21.15.44:0/3611891918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620012e200 con 0x7f620006e5c0 2024-09-21T09:02:54.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.135+0000 7f61fffff640 1 --2- 172.21.15.44:0/3611891918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620006e5c0 0x7f620008afc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f61f000c3f0 tx=0x7f61f000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:54.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.135+0000 7f61fcff9640 1 -- 172.21.15.44:0/3611891918 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f0017070 con 0x7f620006e5c0 2024-09-21T09:02:54.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.135+0000 7f62067e8640 1 -- 172.21.15.44:0/3611891918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f620008ca40 con 0x7f620006e5c0 2024-09-21T09:02:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.135+0000 7fac49349640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44074e50 0x7fac4406e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.135+0000 7f62067e8640 1 -- 172.21.15.44:0/3611891918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f620008da90 con 0x7f620006e5c0 2024-09-21T09:02:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.135+0000 7f61fcff9640 1 -- 172.21.15.44:0/3611891918 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f0007430 con 0x7f620006e5c0 2024-09-21T09:02:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.135+0000 7fac49349640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fac44092840 con 0x7fac44074e50 2024-09-21T09:02:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.135+0000 7fac42ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44074e50 0x7fac4406e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.135+0000 7fac42ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44074e50 0x7fac4406e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44110/0 (socket says 172.21.15.44:44110) 2024-09-21T09:02:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.135+0000 7fac42ffd640 1 -- 172.21.15.44:0/1222740350 learned_addr learned my addr 172.21.15.44:0/1222740350 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.136+0000 7fac42ffd640 1 -- 172.21.15.44:0/1222740350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac44070340 con 0x7fac44074e50 2024-09-21T09:02:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.136+0000 7fac42ffd640 1 --2- 172.21.15.44:0/1222740350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44074e50 0x7fac4406e420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fac340097f0 tx=0x7fac340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.136+0000 7fac2b7fe640 1 -- 172.21.15.44:0/1222740350 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac34041070 con 0x7fac44074e50 2024-09-21T09:02:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.136+0000 7fac2b7fe640 1 -- 172.21.15.44:0/1222740350 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac3403c670 con 0x7fac44074e50 2024-09-21T09:02:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.136+0000 7fac2b7fe640 1 -- 172.21.15.44:0/1222740350 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac34037040 con 0x7fac44074e50 2024-09-21T09:02:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.136+0000 7fac49349640 1 -- 172.21.15.44:0/1222740350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac44070b10 con 0x7fac44074e50 2024-09-21T09:02:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.136+0000 7f61fcff9640 1 -- 172.21.15.44:0/3611891918 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f00057f0 con 0x7f620006e5c0 2024-09-21T09:02:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.136+0000 7fac49349640 1 -- 172.21.15.44:0/1222740350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac440711b0 con 0x7fac44074e50 2024-09-21T09:02:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.136+0000 7f62067e8640 1 -- 172.21.15.44:0/3611891918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f620012eb00 con 0x7f620006e5c0 2024-09-21T09:02:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.136+0000 7f61fcff9640 1 -- 172.21.15.44:0/3611891918 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f61f001a070 con 0x7f620006e5c0 2024-09-21T09:02:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.137+0000 7f61fcff9640 1 --2- 172.21.15.44:0/3611891918 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f61ec0382f0 0x7f61ec03a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.137+0000 7f61fcff9640 1 -- 172.21.15.44:0/3611891918 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f61f004a7a0 con 0x7f620006e5c0 2024-09-21T09:02:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.137+0000 7fac49349640 1 -- 172.21.15.44:0/1222740350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac44092de0 con 0x7fac44074e50 2024-09-21T09:02:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.137+0000 7fac2b7fe640 1 -- 172.21.15.44:0/1222740350 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fac34044070 con 0x7fac44074e50 2024-09-21T09:02:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.138+0000 7f61ff7fe640 1 --2- 172.21.15.44:0/3611891918 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f61ec0382f0 0x7f61ec03a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.138+0000 7fac2b7fe640 1 --2- 172.21.15.44:0/1222740350 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fac3003c660 0x7fac3003eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:54.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.138+0000 7fac2b7fe640 1 -- 172.21.15.44:0/1222740350 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fac3406bf60 con 0x7fac44074e50 2024-09-21T09:02:54.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.138+0000 7fac427fc640 1 --2- 172.21.15.44:0/1222740350 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fac3003c660 0x7fac3003eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:54.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.138+0000 7f61ff7fe640 1 --2- 172.21.15.44:0/3611891918 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f61ec0382f0 0x7f61ec03a7b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f61f4034000 tx=0x7f61f402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:54.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.138+0000 7fac427fc640 1 --2- 172.21.15.44:0/1222740350 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fac3003c660 0x7fac3003eb20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fac38000f60 tx=0x7fac38007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:54.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.142+0000 7f61fcff9640 1 -- 172.21.15.44:0/3611891918 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f61f0019e10 con 0x7f620006e5c0 2024-09-21T09:02:54.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.150+0000 7fac2b7fe640 1 -- 172.21.15.44:0/1222740350 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fac440711b0 con 0x7fac44074e50 2024-09-21T09:02:54.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.171+0000 7fb340d8d640 1 Processor -- start 2024-09-21T09:02:54.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.171+0000 7fb340d8d640 1 -- start start 2024-09-21T09:02:54.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.172+0000 7fb340d8d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb33c09a100 0x7fb33c133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:54.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.172+0000 7fb340d8d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33c09d3b0 con 0x7fb33c09bd50 2024-09-21T09:02:54.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.172+0000 7fb340d8d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb33c09c840 con 0x7fb33c09a100 2024-09-21T09:02:54.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.172+0000 7fb339d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb33c09a100 0x7fb33c133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:54.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.172+0000 7fb33a59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb33c09bd50 0x7fb33c09c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55860/0 (socket says 172.21.15.44:55860) 2024-09-21T09:02:54.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.172+0000 7fb339d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb33c09a100 0x7fb33c133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44126/0 (socket says 172.21.15.44:44126) 2024-09-21T09:02:54.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.172+0000 7fb33a59c640 1 -- 172.21.15.44:0/2838552323 learned_addr learned my addr 172.21.15.44:0/2838552323 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:54.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.173+0000 7fb339d9b640 1 -- 172.21.15.44:0/2838552323 >> v1:172.21.15.44:6789/0 conn(0x7fb33c09bd50 legacy=0x7fb33c09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.173+0000 7fb339d9b640 1 -- 172.21.15.44:0/2838552323 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33c098230 con 0x7fb33c09a100 2024-09-21T09:02:54.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.173+0000 7fb339d9b640 1 --2- 172.21.15.44:0/2838552323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb33c09a100 0x7fb33c133da0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb330009720 tx=0x7fb33002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b822a5caf862b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:54.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.173+0000 7fb33959a640 1 -- 172.21.15.44:0/2838552323 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb330037070 con 0x7fb33c09a100 2024-09-21T09:02:54.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.173+0000 7fb33959a640 1 -- 172.21.15.44:0/2838552323 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33002ad90 con 0x7fb33c09a100 2024-09-21T09:02:54.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.173+0000 7fb33959a640 1 -- 172.21.15.44:0/2838552323 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb330032590 con 0x7fb33c09a100 2024-09-21T09:02:54.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.174+0000 7fb340d8d640 1 -- 172.21.15.44:0/2838552323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb33c09a100 msgr2=0x7fb33c133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.174+0000 7fb340d8d640 1 --2- 172.21.15.44:0/2838552323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb33c09a100 0x7fb33c133da0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb330009720 tx=0x7fb33002a110 comp rx=0 tx=0).stop 2024-09-21T09:02:54.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.174+0000 7fb340d8d640 1 -- 172.21.15.44:0/2838552323 shutdown_connections 2024-09-21T09:02:54.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.174+0000 7fb340d8d640 1 --2- 172.21.15.44:0/2838552323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb33c09a100 0x7fb33c133da0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.174+0000 7fb340d8d640 1 -- 172.21.15.44:0/2838552323 >> 172.21.15.44:0/2838552323 conn(0x7fb33c06d4a0 msgr2=0x7fb33c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:54.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.174+0000 7fb340d8d640 1 -- 172.21.15.44:0/2838552323 shutdown_connections 2024-09-21T09:02:54.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.174+0000 7fb340d8d640 1 -- 172.21.15.44:0/2838552323 wait complete. 2024-09-21T09:02:54.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.175+0000 7fb340d8d640 1 Processor -- start 2024-09-21T09:02:54.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.175+0000 7fb340d8d640 1 -- start start 2024-09-21T09:02:54.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.176+0000 7fb340d8d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb33c09a100 0x7fb33c1c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:54.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.176+0000 7fb340d8d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb33c134670 con 0x7fb33c09a100 2024-09-21T09:02:54.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.176+0000 7fb33a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb33c09a100 0x7fb33c1c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:54.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.176+0000 7fb33a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb33c09a100 0x7fb33c1c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44132/0 (socket says 172.21.15.44:44132) 2024-09-21T09:02:54.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.176+0000 7fb33a59c640 1 -- 172.21.15.44:0/2167671110 learned_addr learned my addr 172.21.15.44:0/2167671110 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.176+0000 7fb33a59c640 1 -- 172.21.15.44:0/2167671110 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33c125ee0 con 0x7fb33c09a100 2024-09-21T09:02:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.177+0000 7fb33a59c640 1 --2- 172.21.15.44:0/2167671110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb33c09a100 0x7fb33c1c3990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00c4a0 tx=0x7fb32c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.177+0000 7fb32affd640 1 -- 172.21.15.44:0/2167671110 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb32c017070 con 0x7fb33c09a100 2024-09-21T09:02:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.177+0000 7fb32affd640 1 -- 172.21.15.44:0/2167671110 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32c005c10 con 0x7fb33c09a100 2024-09-21T09:02:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.177+0000 7fb340d8d640 1 -- 172.21.15.44:0/2167671110 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33c095510 con 0x7fb33c09a100 2024-09-21T09:02:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.177+0000 7fb32affd640 1 -- 172.21.15.44:0/2167671110 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb32c007070 con 0x7fb33c09a100 2024-09-21T09:02:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.177+0000 7fb340d8d640 1 -- 172.21.15.44:0/2167671110 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb33c0961a0 con 0x7fb33c09a100 2024-09-21T09:02:54.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.178+0000 7fb32affd640 1 -- 172.21.15.44:0/2167671110 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb32c01a070 con 0x7fb33c09a100 2024-09-21T09:02:54.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.178+0000 7fb32affd640 1 --2- 172.21.15.44:0/2167671110 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb31c0382a0 0x7fb31c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:54.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.178+0000 7fb32affd640 1 -- 172.21.15.44:0/2167671110 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fb32c04a600 con 0x7fb33c09a100 2024-09-21T09:02:54.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.178+0000 7fb340d8d640 1 -- 172.21.15.44:0/2167671110 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb33c096490 con 0x7fb33c09a100 2024-09-21T09:02:54.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.179+0000 7fb339d9b640 1 --2- 172.21.15.44:0/2167671110 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb31c0382a0 0x7fb31c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:54.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.179+0000 7fb339d9b640 1 --2- 172.21.15.44:0/2167671110 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb31c0382a0 0x7fb31c03a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb330034000 tx=0x7fb33002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:54.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.188+0000 7fb32affd640 1 -- 172.21.15.44:0/2167671110 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb33c096490 con 0x7fb33c09a100 2024-09-21T09:02:54.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.316+0000 7f34e4cde640 1 -- 172.21.15.44:0/2599306596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f34e0097cd0 con 0x7f34e006d2a0 2024-09-21T09:02:54.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.317+0000 7f34ceffd640 1 -- 172.21.15.44:0/2599306596 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f34d0004890 con 0x7f34e006d2a0 2024-09-21T09:02:54.319 INFO:teuthology.orchestra.run.smithi044.stdout:38654705667 2024-09-21T09:02:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.320+0000 7f34e4cde640 1 -- 172.21.15.44:0/2599306596 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34c00382a0 msgr2=0x7f34c003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.320+0000 7f34e4cde640 1 --2- 172.21.15.44:0/2599306596 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34c00382a0 0x7f34c003a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f34d4034000 tx=0x7f34d402e000 comp rx=0 tx=0).stop 2024-09-21T09:02:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.320+0000 7f34e4cde640 1 -- 172.21.15.44:0/2599306596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e006d2a0 msgr2=0x7f34e00954e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.320+0000 7f34e4cde640 1 --2- 172.21.15.44:0/2599306596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e006d2a0 0x7f34e00954e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f34d000c700 tx=0x7f34d000cbc0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.320+0000 7f34e4cde640 1 -- 172.21.15.44:0/2599306596 shutdown_connections 2024-09-21T09:02:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.320+0000 7f34e4cde640 1 --2- 172.21.15.44:0/2599306596 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34c00382a0 0x7f34c003a760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.320+0000 7f34e4cde640 1 --2- 172.21.15.44:0/2599306596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e006d2a0 0x7f34e00954e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.320+0000 7f34e4cde640 1 -- 172.21.15.44:0/2599306596 >> 172.21.15.44:0/2599306596 conn(0x7f34e009cbe0 msgr2=0x7f34e0099a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.320+0000 7f34e4cde640 1 -- 172.21.15.44:0/2599306596 shutdown_connections 2024-09-21T09:02:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.320+0000 7f34e4cde640 1 -- 172.21.15.44:0/2599306596 wait complete. 2024-09-21T09:02:54.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.2 2024-09-21T09:02:54.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.337+0000 7f62067e8640 1 -- 172.21.15.44:0/3611891918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f620006e9a0 con 0x7f620006e5c0 2024-09-21T09:02:54.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.338+0000 7f61fcff9640 1 -- 172.21.15.44:0/3611891918 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f61f0010e00 con 0x7f620006e5c0 2024-09-21T09:02:54.340 INFO:teuthology.orchestra.run.smithi044.stdout:38654705666 2024-09-21T09:02:54.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.340+0000 7f62067e8640 1 -- 172.21.15.44:0/3611891918 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f61ec0382f0 msgr2=0x7f61ec03a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.340+0000 7f62067e8640 1 --2- 172.21.15.44:0/3611891918 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f61ec0382f0 0x7f61ec03a7b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f61f4034000 tx=0x7f61f402e000 comp rx=0 tx=0).stop 2024-09-21T09:02:54.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.340+0000 7f62067e8640 1 -- 172.21.15.44:0/3611891918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620006e5c0 msgr2=0x7f620008afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.340+0000 7f62067e8640 1 --2- 172.21.15.44:0/3611891918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620006e5c0 0x7f620008afc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f61f000c3f0 tx=0x7f61f000c8b0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.340+0000 7f62067e8640 1 -- 172.21.15.44:0/3611891918 shutdown_connections 2024-09-21T09:02:54.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.340+0000 7f62067e8640 1 --2- 172.21.15.44:0/3611891918 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f61ec0382f0 0x7f61ec03a7b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.340+0000 7f62067e8640 1 --2- 172.21.15.44:0/3611891918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620006e5c0 0x7f620008afc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.340+0000 7f62067e8640 1 -- 172.21.15.44:0/3611891918 >> 172.21.15.44:0/3611891918 conn(0x7f620009aa80 msgr2=0x7f6200071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:54.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.340+0000 7f62067e8640 1 -- 172.21.15.44:0/3611891918 shutdown_connections 2024-09-21T09:02:54.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.340+0000 7f62067e8640 1 -- 172.21.15.44:0/3611891918 wait complete. 2024-09-21T09:02:54.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705666 for osd.0 2024-09-21T09:02:54.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.364+0000 7fac49349640 1 -- 172.21.15.44:0/1222740350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fac4406fea0 con 0x7fac44074e50 2024-09-21T09:02:54.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.364+0000 7fac2b7fe640 1 -- 172.21.15.44:0/1222740350 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fac440711b0 con 0x7fac44074e50 2024-09-21T09:02:54.366 INFO:teuthology.orchestra.run.smithi044.stdout:42949672964 2024-09-21T09:02:54.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.366+0000 7fac49349640 1 -- 172.21.15.44:0/1222740350 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fac3003c660 msgr2=0x7fac3003eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.366+0000 7fac49349640 1 --2- 172.21.15.44:0/1222740350 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fac3003c660 0x7fac3003eb20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fac38000f60 tx=0x7fac38007a30 comp rx=0 tx=0).stop 2024-09-21T09:02:54.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.366+0000 7fac49349640 1 -- 172.21.15.44:0/1222740350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44074e50 msgr2=0x7fac4406e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.366+0000 7fac49349640 1 --2- 172.21.15.44:0/1222740350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44074e50 0x7fac4406e420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fac340097f0 tx=0x7fac340046c0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.366+0000 7fac49349640 1 -- 172.21.15.44:0/1222740350 shutdown_connections 2024-09-21T09:02:54.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.366+0000 7fac49349640 1 --2- 172.21.15.44:0/1222740350 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fac3003c660 0x7fac3003eb20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.366+0000 7fac49349640 1 --2- 172.21.15.44:0/1222740350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac44074e50 0x7fac4406e420 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.366+0000 7fac49349640 1 -- 172.21.15.44:0/1222740350 >> 172.21.15.44:0/1222740350 conn(0x7fac4409d6e0 msgr2=0x7fac4408afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:54.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.366+0000 7fac49349640 1 -- 172.21.15.44:0/1222740350 shutdown_connections 2024-09-21T09:02:54.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.366+0000 7fac49349640 1 -- 172.21.15.44:0/1222740350 wait complete. 2024-09-21T09:02:54.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.367+0000 7fb340d8d640 1 -- 172.21.15.44:0/2167671110 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb33c1260b0 con 0x7fb33c09a100 2024-09-21T09:02:54.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.368+0000 7fb32affd640 1 -- 172.21.15.44:0/2167671110 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb33c09d3b0 con 0x7fb33c09a100 2024-09-21T09:02:54.370 INFO:teuthology.orchestra.run.smithi044.stdout:38654705666 2024-09-21T09:02:54.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.370+0000 7fb340d8d640 1 -- 172.21.15.44:0/2167671110 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb31c0382a0 msgr2=0x7fb31c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.370+0000 7fb340d8d640 1 --2- 172.21.15.44:0/2167671110 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb31c0382a0 0x7fb31c03a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb330034000 tx=0x7fb33002e000 comp rx=0 tx=0).stop 2024-09-21T09:02:54.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.370+0000 7fb340d8d640 1 -- 172.21.15.44:0/2167671110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb33c09a100 msgr2=0x7fb33c1c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:54.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.370+0000 7fb340d8d640 1 --2- 172.21.15.44:0/2167671110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb33c09a100 0x7fb33c1c3990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00c4a0 tx=0x7fb32c00c960 comp rx=0 tx=0).stop 2024-09-21T09:02:54.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.370+0000 7fb340d8d640 1 -- 172.21.15.44:0/2167671110 shutdown_connections 2024-09-21T09:02:54.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.370+0000 7fb340d8d640 1 --2- 172.21.15.44:0/2167671110 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb31c0382a0 0x7fb31c03a760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.370+0000 7fb340d8d640 1 --2- 172.21.15.44:0/2167671110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb33c09a100 0x7fb33c1c3990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:54.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.370+0000 7fb340d8d640 1 -- 172.21.15.44:0/2167671110 >> 172.21.15.44:0/2167671110 conn(0x7fb33c06d4a0 msgr2=0x7fb33c096af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:54.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.370+0000 7fb340d8d640 1 -- 172.21.15.44:0/2167671110 shutdown_connections 2024-09-21T09:02:54.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:54.370+0000 7fb340d8d640 1 -- 172.21.15.44:0/2167671110 wait complete. 2024-09-21T09:02:54.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.3 2024-09-21T09:02:54.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705666 for osd.1 2024-09-21T09:02:55.338 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T09:02:55.354 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T09:02:55.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T09:02:55.383 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T09:02:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.457+0000 7f43f5911640 1 Processor -- start 2024-09-21T09:02:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.457+0000 7f43f5911640 1 -- start start 2024-09-21T09:02:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.458+0000 7f43f5911640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43f006f0b0 0x7f43f0130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.458+0000 7f43f5911640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43f0072780 con 0x7f43f006e5c0 2024-09-21T09:02:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.458+0000 7f43f5911640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f43f0070000 con 0x7f43f006f0b0 2024-09-21T09:02:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.458+0000 7f43ee7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43f006f0b0 0x7f43f0130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.458+0000 7f43eeffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f43f006e5c0 0x7f43f006e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55866/0 (socket says 172.21.15.44:55866) 2024-09-21T09:02:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.458+0000 7f43ee7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43f006f0b0 0x7f43f0130ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44138/0 (socket says 172.21.15.44:44138) 2024-09-21T09:02:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.458+0000 7f43eeffd640 1 -- 172.21.15.44:0/1493721992 learned_addr learned my addr 172.21.15.44:0/1493721992 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.458+0000 7f43ee7fc640 1 -- 172.21.15.44:0/1493721992 >> v1:172.21.15.44:6789/0 conn(0x7f43f006e5c0 legacy=0x7f43f006e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.458+0000 7f43ee7fc640 1 -- 172.21.15.44:0/1493721992 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f0071460 con 0x7f43f006f0b0 2024-09-21T09:02:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.459+0000 7f43ee7fc640 1 --2- 172.21.15.44:0/1493721992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43f006f0b0 0x7f43f0130ce0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009720 tx=0x7f43e402c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b35020bfd81b7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.459+0000 7f43edffb640 1 -- 172.21.15.44:0/1493721992 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e4039070 con 0x7f43f006f0b0 2024-09-21T09:02:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.459+0000 7f43edffb640 1 -- 172.21.15.44:0/1493721992 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e4034440 con 0x7f43f006f0b0 2024-09-21T09:02:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.459+0000 7f43edffb640 1 -- 172.21.15.44:0/1493721992 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e4034740 con 0x7f43f006f0b0 2024-09-21T09:02:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.460+0000 7f43f5911640 1 -- 172.21.15.44:0/1493721992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43f006f0b0 msgr2=0x7f43f0130ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.460+0000 7f43f5911640 1 --2- 172.21.15.44:0/1493721992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43f006f0b0 0x7f43f0130ce0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009720 tx=0x7f43e402c320 comp rx=0 tx=0).stop 2024-09-21T09:02:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.460+0000 7f43f5911640 1 -- 172.21.15.44:0/1493721992 shutdown_connections 2024-09-21T09:02:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.460+0000 7f43f5911640 1 --2- 172.21.15.44:0/1493721992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43f006f0b0 0x7f43f0130ce0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.460+0000 7f43f5911640 1 -- 172.21.15.44:0/1493721992 >> 172.21.15.44:0/1493721992 conn(0x7f43f009aa80 msgr2=0x7f43f009ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.460+0000 7f43f5911640 1 -- 172.21.15.44:0/1493721992 shutdown_connections 2024-09-21T09:02:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.460+0000 7f43f5911640 1 -- 172.21.15.44:0/1493721992 wait complete. 2024-09-21T09:02:55.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.461+0000 7f43f5911640 1 Processor -- start 2024-09-21T09:02:55.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.461+0000 7f43f5911640 1 -- start start 2024-09-21T09:02:55.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.462+0000 7f43f5911640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43f006e5c0 0x7f43f01b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.462+0000 7f43f5911640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f43f006bba0 con 0x7f43f006e5c0 2024-09-21T09:02:55.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.462+0000 7f43eeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43f006e5c0 0x7f43f01b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.462+0000 7f43eeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43f006e5c0 0x7f43f01b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44150/0 (socket says 172.21.15.44:44150) 2024-09-21T09:02:55.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.462+0000 7f43eeffd640 1 -- 172.21.15.44:0/3272241529 learned_addr learned my addr 172.21.15.44:0/3272241529 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:55.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.462+0000 7f43eeffd640 1 -- 172.21.15.44:0/3272241529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f0097dc0 con 0x7f43f006e5c0 2024-09-21T09:02:55.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.463+0000 7f43eeffd640 1 --2- 172.21.15.44:0/3272241529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43f006e5c0 0x7f43f01b0ec0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f43e000c480 tx=0x7f43e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.463+0000 7f43d7fff640 1 -- 172.21.15.44:0/3272241529 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e0017070 con 0x7f43f006e5c0 2024-09-21T09:02:55.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.463+0000 7f43d7fff640 1 -- 172.21.15.44:0/3272241529 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e0005c10 con 0x7f43f006e5c0 2024-09-21T09:02:55.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.463+0000 7f43f5911640 1 -- 172.21.15.44:0/3272241529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f008bfa0 con 0x7f43f006e5c0 2024-09-21T09:02:55.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.463+0000 7f43d7fff640 1 -- 172.21.15.44:0/3272241529 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e00070d0 con 0x7f43f006e5c0 2024-09-21T09:02:55.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.463+0000 7f43f5911640 1 -- 172.21.15.44:0/3272241529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f01b1400 con 0x7f43f006e5c0 2024-09-21T09:02:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.464+0000 7f43f5911640 1 -- 172.21.15.44:0/3272241529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f006e9a0 con 0x7f43f006e5c0 2024-09-21T09:02:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.464+0000 7f43d7fff640 1 -- 172.21.15.44:0/3272241529 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f43e001a070 con 0x7f43f006e5c0 2024-09-21T09:02:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.464+0000 7f43d7fff640 1 --2- 172.21.15.44:0/3272241529 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f43dc0382d0 0x7f43dc03a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.465+0000 7f43d7fff640 1 -- 172.21.15.44:0/3272241529 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f43e004a540 con 0x7f43f006e5c0 2024-09-21T09:02:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.465+0000 7f43ee7fc640 1 --2- 172.21.15.44:0/3272241529 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f43dc0382d0 0x7f43dc03a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.466+0000 7f43ee7fc640 1 --2- 172.21.15.44:0/3272241529 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f43dc0382d0 0x7f43dc03a790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f43e4036000 tx=0x7f43e4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.473+0000 7f43d7fff640 1 -- 172.21.15.44:0/3272241529 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f43e001a760 con 0x7f43f006e5c0 2024-09-21T09:02:55.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.495+0000 7f49a0c3d640 1 Processor -- start 2024-09-21T09:02:55.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.495+0000 7f49a0c3d640 1 -- start start 2024-09-21T09:02:55.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.496+0000 7f49a0c3d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f499c09a100 0x7f499c133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.496+0000 7f49a0c3d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f499c09d3b0 con 0x7f499c09bd50 2024-09-21T09:02:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.496+0000 7f49a0c3d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f499c09c840 con 0x7f499c09a100 2024-09-21T09:02:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.496+0000 7f4999d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f499c09a100 0x7f499c133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.496+0000 7f4999d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f499c09a100 0x7f499c133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44156/0 (socket says 172.21.15.44:44156) 2024-09-21T09:02:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.496+0000 7f4999d9b640 1 -- 172.21.15.44:0/1315509440 learned_addr learned my addr 172.21.15.44:0/1315509440 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.496+0000 7f499a59c640 1 --1- 172.21.15.44:0/1315509440 >> v1:172.21.15.44:6789/0 conn(0x7f499c09bd50 0x7f499c09c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55878/0 (socket says 172.21.15.44:55878) 2024-09-21T09:02:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.496+0000 7f4999d9b640 1 -- 172.21.15.44:0/1315509440 >> v1:172.21.15.44:6789/0 conn(0x7f499c09bd50 legacy=0x7f499c09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.496+0000 7f4999d9b640 1 -- 172.21.15.44:0/1315509440 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c098230 con 0x7f499c09a100 2024-09-21T09:02:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.497+0000 7f4999d9b640 1 --2- 172.21.15.44:0/1315509440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499c09a100 0x7f499c133da0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f49900097f0 tx=0x7f499002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3514060a16e196a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.497+0000 7f499959a640 1 -- 172.21.15.44:0/1315509440 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4990037070 con 0x7f499c09a100 2024-09-21T09:02:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.497+0000 7f499959a640 1 -- 172.21.15.44:0/1315509440 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4990032440 con 0x7f499c09a100 2024-09-21T09:02:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.497+0000 7f499959a640 1 -- 172.21.15.44:0/1315509440 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f499002ae60 con 0x7f499c09a100 2024-09-21T09:02:55.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.498+0000 7fed68b86640 1 Processor -- start 2024-09-21T09:02:55.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.498+0000 7fed68b86640 1 -- start start 2024-09-21T09:02:55.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.498+0000 7f49a0c3d640 1 -- 172.21.15.44:0/1315509440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499c09a100 msgr2=0x7f499c133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.498+0000 7f49a0c3d640 1 --2- 172.21.15.44:0/1315509440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499c09a100 0x7f499c133da0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f49900097f0 tx=0x7f499002a1e0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.498+0000 7f49a0c3d640 1 -- 172.21.15.44:0/1315509440 shutdown_connections 2024-09-21T09:02:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.498+0000 7f49a0c3d640 1 --2- 172.21.15.44:0/1315509440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499c09a100 0x7f499c133da0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.498+0000 7f49a0c3d640 1 -- 172.21.15.44:0/1315509440 >> 172.21.15.44:0/1315509440 conn(0x7f499c06d4a0 msgr2=0x7f499c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.498+0000 7f49a0c3d640 1 -- 172.21.15.44:0/1315509440 shutdown_connections 2024-09-21T09:02:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.498+0000 7f49a0c3d640 1 -- 172.21.15.44:0/1315509440 wait complete. 2024-09-21T09:02:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.498+0000 7fed68b86640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fed6409a100 0x7fed64133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.498+0000 7fed68b86640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed6409d3b0 con 0x7fed6409bd50 2024-09-21T09:02:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.498+0000 7fed68b86640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fed6409c840 con 0x7fed6409a100 2024-09-21T09:02:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.498+0000 7fed6259c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fed6409bd50 0x7fed6409c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55886/0 (socket says 172.21.15.44:55886) 2024-09-21T09:02:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.499+0000 7fed6259c640 1 -- 172.21.15.44:0/3596647190 learned_addr learned my addr 172.21.15.44:0/3596647190 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.498+0000 7fed61d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fed6409a100 0x7fed64133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.499+0000 7fed61d9b640 1 -- 172.21.15.44:0/3596647190 >> v1:172.21.15.44:6789/0 conn(0x7fed6409bd50 legacy=0x7fed6409c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.499+0000 7fed61d9b640 1 -- 172.21.15.44:0/3596647190 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed64098230 con 0x7fed6409a100 2024-09-21T09:02:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.499+0000 7f49a0c3d640 1 Processor -- start 2024-09-21T09:02:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.500+0000 7f49a0c3d640 1 -- start start 2024-09-21T09:02:55.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.500+0000 7fed61d9b640 1 --2- 172.21.15.44:0/3596647190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed6409a100 0x7fed64133da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fed58009720 tx=0x7fed5802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1d56b899dd8302 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.500+0000 7f49a0c3d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499c09a100 0x7f499c1c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.500+0000 7f49a0c3d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f499c134670 con 0x7f499c09a100 2024-09-21T09:02:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.500+0000 7f499a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499c09a100 0x7f499c1c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.500+0000 7f499a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499c09a100 0x7f499c1c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44168/0 (socket says 172.21.15.44:44168) 2024-09-21T09:02:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.500+0000 7f499a59c640 1 -- 172.21.15.44:0/3711229269 learned_addr learned my addr 172.21.15.44:0/3711229269 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.500+0000 7fed6159a640 1 -- 172.21.15.44:0/3596647190 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed58037070 con 0x7fed6409a100 2024-09-21T09:02:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.500+0000 7fed6159a640 1 -- 172.21.15.44:0/3596647190 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed5802ad90 con 0x7fed6409a100 2024-09-21T09:02:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.501+0000 7fed6159a640 1 -- 172.21.15.44:0/3596647190 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed58032590 con 0x7fed6409a100 2024-09-21T09:02:55.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.501+0000 7f499a59c640 1 -- 172.21.15.44:0/3711229269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c125ee0 con 0x7f499c09a100 2024-09-21T09:02:55.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.501+0000 7f499a59c640 1 --2- 172.21.15.44:0/3711229269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499c09a100 0x7f499c1c3990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f498c00c450 tx=0x7f498c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.501+0000 7fed68b86640 1 -- 172.21.15.44:0/3596647190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed6409a100 msgr2=0x7fed64133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.501+0000 7fed68b86640 1 --2- 172.21.15.44:0/3596647190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed6409a100 0x7fed64133da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fed58009720 tx=0x7fed5802a110 comp rx=0 tx=0).stop 2024-09-21T09:02:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.501+0000 7fed68b86640 1 -- 172.21.15.44:0/3596647190 shutdown_connections 2024-09-21T09:02:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.501+0000 7fed68b86640 1 --2- 172.21.15.44:0/3596647190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed6409a100 0x7fed64133da0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.501+0000 7fed68b86640 1 -- 172.21.15.44:0/3596647190 >> 172.21.15.44:0/3596647190 conn(0x7fed6406d4a0 msgr2=0x7fed6406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.502+0000 7fed68b86640 1 -- 172.21.15.44:0/3596647190 shutdown_connections 2024-09-21T09:02:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.502+0000 7fed68b86640 1 -- 172.21.15.44:0/3596647190 wait complete. 2024-09-21T09:02:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.503+0000 7fed68b86640 1 Processor -- start 2024-09-21T09:02:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.503+0000 7fed68b86640 1 -- start start 2024-09-21T09:02:55.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.503+0000 7f498affd640 1 -- 172.21.15.44:0/3711229269 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f498c007410 con 0x7f499c09a100 2024-09-21T09:02:55.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.503+0000 7f49a0c3d640 1 -- 172.21.15.44:0/3711229269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499c095510 con 0x7f499c09a100 2024-09-21T09:02:55.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.503+0000 7f498affd640 1 -- 172.21.15.44:0/3711229269 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f498c0075b0 con 0x7f499c09a100 2024-09-21T09:02:55.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.503+0000 7f49a0c3d640 1 -- 172.21.15.44:0/3711229269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f499c0961a0 con 0x7f499c09a100 2024-09-21T09:02:55.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.503+0000 7f498affd640 1 -- 172.21.15.44:0/3711229269 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f498c007410 con 0x7f499c09a100 2024-09-21T09:02:55.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.504+0000 7fed68b86640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed6409a100 0x7fed641c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.504+0000 7fed68b86640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fed64134670 con 0x7fed6409a100 2024-09-21T09:02:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.504+0000 7fed6259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed6409a100 0x7fed641c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.504+0000 7fed6259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed6409a100 0x7fed641c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44180/0 (socket says 172.21.15.44:44180) 2024-09-21T09:02:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.504+0000 7fed6259c640 1 -- 172.21.15.44:0/2670044554 learned_addr learned my addr 172.21.15.44:0/2670044554 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.505+0000 7f498affd640 1 -- 172.21.15.44:0/3711229269 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f498c01a020 con 0x7f499c09a100 2024-09-21T09:02:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.505+0000 7fed6259c640 1 -- 172.21.15.44:0/2670044554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed640963e0 con 0x7fed6409a100 2024-09-21T09:02:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.505+0000 7fed6259c640 1 --2- 172.21.15.44:0/2670044554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed6409a100 0x7fed641c3990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed5400c380 tx=0x7fed5400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.505+0000 7f498affd640 1 --2- 172.21.15.44:0/3711229269 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f497c038630 0x7f497c03aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.505+0000 7f49a0c3d640 1 -- 172.21.15.44:0/3711229269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4980005080 con 0x7f499c09a100 2024-09-21T09:02:55.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.505+0000 7fed52ffd640 1 -- 172.21.15.44:0/2670044554 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed54005c10 con 0x7fed6409a100 2024-09-21T09:02:55.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.505+0000 7fed52ffd640 1 -- 172.21.15.44:0/2670044554 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed54005db0 con 0x7fed6409a100 2024-09-21T09:02:55.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.505+0000 7fed52ffd640 1 -- 172.21.15.44:0/2670044554 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed54004930 con 0x7fed6409a100 2024-09-21T09:02:55.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.505+0000 7f498affd640 1 -- 172.21.15.44:0/3711229269 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f498c04a610 con 0x7f499c09a100 2024-09-21T09:02:55.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.506+0000 7fed68b86640 1 -- 172.21.15.44:0/2670044554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed64126090 con 0x7fed6409a100 2024-09-21T09:02:55.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.506+0000 7f4999d9b640 1 --2- 172.21.15.44:0/3711229269 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f497c038630 0x7f497c03aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.506+0000 7fed68b86640 1 -- 172.21.15.44:0/2670044554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed641c3ed0 con 0x7fed6409a100 2024-09-21T09:02:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.506+0000 7f4999d9b640 1 --2- 172.21.15.44:0/3711229269 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f497c038630 0x7f497c03aaf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4990034000 tx=0x7f499002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.507+0000 7fed68b86640 1 -- 172.21.15.44:0/2670044554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed6409a760 con 0x7fed6409a100 2024-09-21T09:02:55.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.510+0000 7f498affd640 1 -- 172.21.15.44:0/3711229269 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f499c09d3b0 con 0x7f499c09a100 2024-09-21T09:02:55.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.511+0000 7fed52ffd640 1 -- 172.21.15.44:0/2670044554 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fed5401a020 con 0x7fed6409a100 2024-09-21T09:02:55.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.511+0000 7fed52ffd640 1 --2- 172.21.15.44:0/2670044554 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fed440382f0 0x7fed4403a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.512+0000 7fed52ffd640 1 -- 172.21.15.44:0/2670044554 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fed5404b280 con 0x7fed6409a100 2024-09-21T09:02:55.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.512+0000 7fed61d9b640 1 --2- 172.21.15.44:0/2670044554 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fed440382f0 0x7fed4403a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.512+0000 7fed61d9b640 1 --2- 172.21.15.44:0/2670044554 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fed440382f0 0x7fed4403a7b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fed58034000 tx=0x7fed5802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.515+0000 7fed52ffd640 1 -- 172.21.15.44:0/2670044554 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fed6409a760 con 0x7fed6409a100 2024-09-21T09:02:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.543+0000 7fe3af477640 1 Processor -- start 2024-09-21T09:02:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.543+0000 7fe3af477640 1 -- start start 2024-09-21T09:02:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.544+0000 7fe3af477640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe3a809bd50 0x7fe3a809c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.544+0000 7fe3af477640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a809d3b0 con 0x7fe3a809c670 2024-09-21T09:02:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.544+0000 7fe3af477640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe3a8098230 con 0x7fe3a809bd50 2024-09-21T09:02:55.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.544+0000 7fe3ad213640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe3a809bd50 0x7fe3a809c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.544+0000 7fe3aca12640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe3a809c670 0x7fe3a80990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55890/0 (socket says 172.21.15.44:55890) 2024-09-21T09:02:55.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.544+0000 7fe3aca12640 1 -- 172.21.15.44:0/4102812577 learned_addr learned my addr 172.21.15.44:0/4102812577 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:55.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.544+0000 7fe3ad213640 1 -- 172.21.15.44:0/4102812577 >> v1:172.21.15.44:6789/0 conn(0x7fe3a809c670 legacy=0x7fe3a80990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.544+0000 7fe3ad213640 1 -- 172.21.15.44:0/4102812577 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a80983e0 con 0x7fe3a809bd50 2024-09-21T09:02:55.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.545+0000 7fe3ad213640 1 --2- 172.21.15.44:0/4102812577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3a809bd50 0x7fe3a809c130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4009720 tx=0x7fe3a402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397c18a69e7d538a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.545+0000 7fe39ffff640 1 -- 172.21.15.44:0/4102812577 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3a4037070 con 0x7fe3a809bd50 2024-09-21T09:02:55.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.545+0000 7fe39ffff640 1 -- 172.21.15.44:0/4102812577 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3a402ad90 con 0x7fe3a809bd50 2024-09-21T09:02:55.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.545+0000 7fe39ffff640 1 -- 172.21.15.44:0/4102812577 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3a4032590 con 0x7fe3a809bd50 2024-09-21T09:02:55.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.546+0000 7fe3af477640 1 -- 172.21.15.44:0/4102812577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3a809bd50 msgr2=0x7fe3a809c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.546+0000 7fe3af477640 1 --2- 172.21.15.44:0/4102812577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3a809bd50 0x7fe3a809c130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4009720 tx=0x7fe3a402a110 comp rx=0 tx=0).stop 2024-09-21T09:02:55.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.546+0000 7fe3af477640 1 -- 172.21.15.44:0/4102812577 shutdown_connections 2024-09-21T09:02:55.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.546+0000 7fe3af477640 1 --2- 172.21.15.44:0/4102812577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3a809bd50 0x7fe3a809c130 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.546+0000 7fe3af477640 1 -- 172.21.15.44:0/4102812577 >> 172.21.15.44:0/4102812577 conn(0x7fe3a806d4a0 msgr2=0x7fe3a806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:55.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.546+0000 7fe3af477640 1 -- 172.21.15.44:0/4102812577 shutdown_connections 2024-09-21T09:02:55.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.546+0000 7fe3af477640 1 -- 172.21.15.44:0/4102812577 wait complete. 2024-09-21T09:02:55.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.547+0000 7fe3af477640 1 Processor -- start 2024-09-21T09:02:55.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.547+0000 7fe3af477640 1 -- start start 2024-09-21T09:02:55.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.548+0000 7fe3af477640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3a809bd50 0x7fe3a81c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.548+0000 7fe3af477640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8099b90 con 0x7fe3a809bd50 2024-09-21T09:02:55.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.548+0000 7fe3ad213640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3a809bd50 0x7fe3a81c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.548+0000 7fe3ad213640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3a809bd50 0x7fe3a81c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44206/0 (socket says 172.21.15.44:44206) 2024-09-21T09:02:55.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.548+0000 7fe3ad213640 1 -- 172.21.15.44:0/3899486156 learned_addr learned my addr 172.21.15.44:0/3899486156 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:55.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.548+0000 7fe3ad213640 1 -- 172.21.15.44:0/3899486156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a81b3080 con 0x7fe3a809bd50 2024-09-21T09:02:55.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.548+0000 7fe3ad213640 1 --2- 172.21.15.44:0/3899486156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3a809bd50 0x7fe3a81c3900 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4009840 tx=0x7fe3a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.549+0000 7fe39dffb640 1 -- 172.21.15.44:0/3899486156 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3a4041070 con 0x7fe3a809bd50 2024-09-21T09:02:55.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.549+0000 7fe39dffb640 1 -- 172.21.15.44:0/3899486156 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3a403c460 con 0x7fe3a809bd50 2024-09-21T09:02:55.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.549+0000 7fe39dffb640 1 -- 172.21.15.44:0/3899486156 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3a4037040 con 0x7fe3a809bd50 2024-09-21T09:02:55.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.549+0000 7fe3af477640 1 -- 172.21.15.44:0/3899486156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a81b4880 con 0x7fe3a809bd50 2024-09-21T09:02:55.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.549+0000 7fe3af477640 1 -- 172.21.15.44:0/3899486156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a81b1a80 con 0x7fe3a809bd50 2024-09-21T09:02:55.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.550+0000 7fe39dffb640 1 -- 172.21.15.44:0/3899486156 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe3a4044070 con 0x7fe3a809bd50 2024-09-21T09:02:55.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.550+0000 7fe39dffb640 1 --2- 172.21.15.44:0/3899486156 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe38c0382d0 0x7fe38c03a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.550+0000 7fe39dffb640 1 -- 172.21.15.44:0/3899486156 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fe3a406bae0 con 0x7fe3a809bd50 2024-09-21T09:02:55.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.550+0000 7fe3af477640 1 -- 172.21.15.44:0/3899486156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a809a130 con 0x7fe3a809bd50 2024-09-21T09:02:55.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.550+0000 7fe3aca12640 1 --2- 172.21.15.44:0/3899486156 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe38c0382d0 0x7fe38c03a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.551+0000 7fe3aca12640 1 --2- 172.21.15.44:0/3899486156 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe38c0382d0 0x7fe38c03a790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe398007fd0 tx=0x7fe398007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.555+0000 7fe39dffb640 1 -- 172.21.15.44:0/3899486156 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe3a81b3080 con 0x7fe3a809bd50 2024-09-21T09:02:55.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.713+0000 7f43f5911640 1 -- 172.21.15.44:0/3272241529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f43f01b2020 con 0x7f43f006e5c0 2024-09-21T09:02:55.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.713+0000 7f43d7fff640 1 -- 172.21.15.44:0/3272241529 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f43e0012400 con 0x7f43f006e5c0 2024-09-21T09:02:55.715 INFO:teuthology.orchestra.run.smithi044.stdout:38654705669 2024-09-21T09:02:55.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.715+0000 7f43f5911640 1 -- 172.21.15.44:0/3272241529 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f43dc0382d0 msgr2=0x7f43dc03a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.715+0000 7f43f5911640 1 --2- 172.21.15.44:0/3272241529 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f43dc0382d0 0x7f43dc03a790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f43e4036000 tx=0x7f43e4030000 comp rx=0 tx=0).stop 2024-09-21T09:02:55.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.715+0000 7f43f5911640 1 -- 172.21.15.44:0/3272241529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43f006e5c0 msgr2=0x7f43f01b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.715+0000 7f43f5911640 1 --2- 172.21.15.44:0/3272241529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43f006e5c0 0x7f43f01b0ec0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f43e000c480 tx=0x7f43e000c940 comp rx=0 tx=0).stop 2024-09-21T09:02:55.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.715+0000 7f43f5911640 1 -- 172.21.15.44:0/3272241529 shutdown_connections 2024-09-21T09:02:55.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.715+0000 7f43f5911640 1 --2- 172.21.15.44:0/3272241529 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f43dc0382d0 0x7f43dc03a790 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.715+0000 7f43f5911640 1 --2- 172.21.15.44:0/3272241529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43f006e5c0 0x7f43f01b0ec0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.715+0000 7f43f5911640 1 -- 172.21.15.44:0/3272241529 >> 172.21.15.44:0/3272241529 conn(0x7f43f009aa80 msgr2=0x7f43f01a9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:55.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.715+0000 7f43f5911640 1 -- 172.21.15.44:0/3272241529 shutdown_connections 2024-09-21T09:02:55.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.715+0000 7f43f5911640 1 -- 172.21.15.44:0/3272241529 wait complete. 2024-09-21T09:02:55.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.720+0000 7fed68b86640 1 -- 172.21.15.44:0/2670044554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fed640971a0 con 0x7fed6409a100 2024-09-21T09:02:55.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.720+0000 7fed52ffd640 1 -- 172.21.15.44:0/2670044554 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fed54021070 con 0x7fed6409a100 2024-09-21T09:02:55.722 INFO:teuthology.orchestra.run.smithi044.stdout:42949672966 2024-09-21T09:02:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.723+0000 7fed68b86640 1 -- 172.21.15.44:0/2670044554 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fed440382f0 msgr2=0x7fed4403a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.723+0000 7fed68b86640 1 --2- 172.21.15.44:0/2670044554 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fed440382f0 0x7fed4403a7b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fed58034000 tx=0x7fed5802e000 comp rx=0 tx=0).stop 2024-09-21T09:02:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.723+0000 7fed68b86640 1 -- 172.21.15.44:0/2670044554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed6409a100 msgr2=0x7fed641c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.723+0000 7fed68b86640 1 --2- 172.21.15.44:0/2670044554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed6409a100 0x7fed641c3990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed5400c380 tx=0x7fed5400c840 comp rx=0 tx=0).stop 2024-09-21T09:02:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.723+0000 7fed68b86640 1 -- 172.21.15.44:0/2670044554 shutdown_connections 2024-09-21T09:02:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.723+0000 7fed68b86640 1 --2- 172.21.15.44:0/2670044554 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fed440382f0 0x7fed4403a7b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.723+0000 7fed68b86640 1 --2- 172.21.15.44:0/2670044554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed6409a100 0x7fed641c3990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.723+0000 7fed68b86640 1 -- 172.21.15.44:0/2670044554 >> 172.21.15.44:0/2670044554 conn(0x7fed6406d4a0 msgr2=0x7fed6408d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.723+0000 7fed68b86640 1 -- 172.21.15.44:0/2670044554 shutdown_connections 2024-09-21T09:02:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.723+0000 7fed68b86640 1 -- 172.21.15.44:0/2670044554 wait complete. 2024-09-21T09:02:55.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2024-09-21T09:02:55.730 DEBUG:teuthology.parallel:result is None 2024-09-21T09:02:55.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672966 for osd.3 2024-09-21T09:02:55.736 DEBUG:teuthology.parallel:result is None 2024-09-21T09:02:55.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.745+0000 7f49a0c3d640 1 -- 172.21.15.44:0/3711229269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4980005370 con 0x7f499c09a100 2024-09-21T09:02:55.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.745+0000 7f498affd640 1 -- 172.21.15.44:0/3711229269 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f498c01c3f0 con 0x7f499c09a100 2024-09-21T09:02:55.747 INFO:teuthology.orchestra.run.smithi044.stdout:38654705668 2024-09-21T09:02:55.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.748+0000 7fe3af477640 1 -- 172.21.15.44:0/3899486156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe3a809d020 con 0x7fe3a809bd50 2024-09-21T09:02:55.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.748+0000 7f49a0c3d640 1 -- 172.21.15.44:0/3711229269 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f497c038630 msgr2=0x7f497c03aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.748+0000 7f49a0c3d640 1 --2- 172.21.15.44:0/3711229269 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f497c038630 0x7f497c03aaf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4990034000 tx=0x7f499002e000 comp rx=0 tx=0).stop 2024-09-21T09:02:55.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.748+0000 7f49a0c3d640 1 -- 172.21.15.44:0/3711229269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499c09a100 msgr2=0x7f499c1c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.748+0000 7f49a0c3d640 1 --2- 172.21.15.44:0/3711229269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499c09a100 0x7f499c1c3990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f498c00c450 tx=0x7f498c00c910 comp rx=0 tx=0).stop 2024-09-21T09:02:55.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.748+0000 7f49a0c3d640 1 -- 172.21.15.44:0/3711229269 shutdown_connections 2024-09-21T09:02:55.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.748+0000 7f49a0c3d640 1 --2- 172.21.15.44:0/3711229269 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f497c038630 0x7f497c03aaf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.748+0000 7f49a0c3d640 1 --2- 172.21.15.44:0/3711229269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f499c09a100 0x7f499c1c3990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.748+0000 7f49a0c3d640 1 -- 172.21.15.44:0/3711229269 >> 172.21.15.44:0/3711229269 conn(0x7f499c06d4a0 msgr2=0x7f499c096af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:55.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.748+0000 7f49a0c3d640 1 -- 172.21.15.44:0/3711229269 shutdown_connections 2024-09-21T09:02:55.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.748+0000 7f49a0c3d640 1 -- 172.21.15.44:0/3711229269 wait complete. 2024-09-21T09:02:55.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.748+0000 7fe39dffb640 1 -- 172.21.15.44:0/3899486156 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe3a4044360 con 0x7fe3a809bd50 2024-09-21T09:02:55.751 INFO:teuthology.orchestra.run.smithi044.stdout:38654705668 2024-09-21T09:02:55.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.750+0000 7fe3af477640 1 -- 172.21.15.44:0/3899486156 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe38c0382d0 msgr2=0x7fe38c03a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.750+0000 7fe3af477640 1 --2- 172.21.15.44:0/3899486156 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe38c0382d0 0x7fe38c03a790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe398007fd0 tx=0x7fe398007ac0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.750+0000 7fe3af477640 1 -- 172.21.15.44:0/3899486156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3a809bd50 msgr2=0x7fe3a81c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.750+0000 7fe3af477640 1 --2- 172.21.15.44:0/3899486156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3a809bd50 0x7fe3a81c3900 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4009840 tx=0x7fe3a40046c0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.750+0000 7fe3af477640 1 -- 172.21.15.44:0/3899486156 shutdown_connections 2024-09-21T09:02:55.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.750+0000 7fe3af477640 1 --2- 172.21.15.44:0/3899486156 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe38c0382d0 0x7fe38c03a790 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.750+0000 7fe3af477640 1 --2- 172.21.15.44:0/3899486156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3a809bd50 0x7fe3a81c3900 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.750+0000 7fe3af477640 1 -- 172.21.15.44:0/3899486156 >> 172.21.15.44:0/3899486156 conn(0x7fe3a806d4a0 msgr2=0x7fe3a809eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:55.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.750+0000 7fe3af477640 1 -- 172.21.15.44:0/3899486156 shutdown_connections 2024-09-21T09:02:55.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.750+0000 7fe3af477640 1 -- 172.21.15.44:0/3899486156 wait complete. 2024-09-21T09:02:55.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2024-09-21T09:02:55.761 DEBUG:teuthology.parallel:result is None 2024-09-21T09:02:55.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.1 2024-09-21T09:02:55.763 DEBUG:teuthology.parallel:result is None 2024-09-21T09:02:55.763 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T09:02:55.763 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:02:55.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.902+0000 7f594adf8640 1 Processor -- start 2024-09-21T09:02:55.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.902+0000 7f594adf8640 1 -- start start 2024-09-21T09:02:55.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.902+0000 7f594adf8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f594412e8f0 0x7f594412ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.903+0000 7f594adf8640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5944096ee0 con 0x7f594412f210 2024-09-21T09:02:55.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.903+0000 7f594adf8640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f594409e090 con 0x7f594412e8f0 2024-09-21T09:02:55.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.903+0000 7f5948b94640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f594412e8f0 0x7f594412ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.903+0000 7f5943fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f594412f210 0x7f594412a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55896/0 (socket says 172.21.15.44:55896) 2024-09-21T09:02:55.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.903+0000 7f5943fff640 1 -- 172.21.15.44:0/3047716900 learned_addr learned my addr 172.21.15.44:0/3047716900 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:55.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.903+0000 7f5948b94640 1 -- 172.21.15.44:0/3047716900 >> v1:172.21.15.44:6789/0 conn(0x7f594412f210 legacy=0x7f594412a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.903+0000 7f59437fe640 1 -- 172.21.15.44:0/3047716900 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3167293798 0 0) 0x7f5944096ee0 con 0x7f594412f210 2024-09-21T09:02:55.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.903+0000 7f5948b94640 1 -- 172.21.15.44:0/3047716900 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5944074e50 con 0x7f594412e8f0 2024-09-21T09:02:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.904+0000 7f5948b94640 1 --2- 172.21.15.44:0/3047716900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f594412e8f0 0x7f594412ecd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5934009720 tx=0x7f593402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821b9974bb834a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.904+0000 7f59437fe640 1 -- 172.21.15.44:0/3047716900 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5934037070 con 0x7f594412e8f0 2024-09-21T09:02:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.904+0000 7f59437fe640 1 -- 172.21.15.44:0/3047716900 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f593402ad90 con 0x7f594412e8f0 2024-09-21T09:02:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.904+0000 7f59437fe640 1 -- 172.21.15.44:0/3047716900 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5934032590 con 0x7f594412e8f0 2024-09-21T09:02:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.904+0000 7f594adf8640 1 -- 172.21.15.44:0/3047716900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f594412e8f0 msgr2=0x7f594412ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.904+0000 7f594adf8640 1 --2- 172.21.15.44:0/3047716900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f594412e8f0 0x7f594412ecd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5934009720 tx=0x7f593402a110 comp rx=0 tx=0).stop 2024-09-21T09:02:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.904+0000 7f594adf8640 1 -- 172.21.15.44:0/3047716900 shutdown_connections 2024-09-21T09:02:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.904+0000 7f594adf8640 1 --2- 172.21.15.44:0/3047716900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f594412e8f0 0x7f594412ecd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:55.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.904+0000 7f594adf8640 1 -- 172.21.15.44:0/3047716900 >> 172.21.15.44:0/3047716900 conn(0x7f594409d860 msgr2=0x7f5944099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.904+0000 7f594adf8640 1 -- 172.21.15.44:0/3047716900 shutdown_connections 2024-09-21T09:02:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.904+0000 7f594adf8640 1 -- 172.21.15.44:0/3047716900 wait complete. 2024-09-21T09:02:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.905+0000 7f594adf8640 1 Processor -- start 2024-09-21T09:02:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.905+0000 7f594adf8640 1 -- start start 2024-09-21T09:02:55.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.906+0000 7f594adf8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f594412e8f0 0x7f59441c3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.906+0000 7f594adf8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5944096ac0 con 0x7f594412e8f0 2024-09-21T09:02:55.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.906+0000 7f5948b94640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f594412e8f0 0x7f59441c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.906+0000 7f5948b94640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f594412e8f0 0x7f59441c3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44222/0 (socket says 172.21.15.44:44222) 2024-09-21T09:02:55.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.906+0000 7f5948b94640 1 -- 172.21.15.44:0/3543596990 learned_addr learned my addr 172.21.15.44:0/3543596990 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:55.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.906+0000 7f5948b94640 1 -- 172.21.15.44:0/3543596990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59440717e0 con 0x7f594412e8f0 2024-09-21T09:02:55.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.906+0000 7f5948b94640 1 --2- 172.21.15.44:0/3543596990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f594412e8f0 0x7f59441c3230 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5934009720 tx=0x7f59340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.906+0000 7f59417fa640 1 -- 172.21.15.44:0/3543596990 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5934041070 con 0x7f594412e8f0 2024-09-21T09:02:55.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.906+0000 7f59417fa640 1 -- 172.21.15.44:0/3543596990 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f593403c460 con 0x7f594412e8f0 2024-09-21T09:02:55.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.906+0000 7f594adf8640 1 -- 172.21.15.44:0/3543596990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5944071d70 con 0x7f594412e8f0 2024-09-21T09:02:55.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.906+0000 7f59417fa640 1 -- 172.21.15.44:0/3543596990 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5934037040 con 0x7f594412e8f0 2024-09-21T09:02:55.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.907+0000 7f594adf8640 1 -- 172.21.15.44:0/3543596990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59441c3950 con 0x7f594412e8f0 2024-09-21T09:02:55.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.907+0000 7f59417fa640 1 -- 172.21.15.44:0/3543596990 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5934044070 con 0x7f594412e8f0 2024-09-21T09:02:55.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.907+0000 7f594adf8640 1 -- 172.21.15.44:0/3543596990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f594412aea0 con 0x7f594412e8f0 2024-09-21T09:02:55.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.908+0000 7f59417fa640 1 --2- 172.21.15.44:0/3543596990 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f59300382a0 0x7f593003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:55.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.908+0000 7f59417fa640 1 -- 172.21.15.44:0/3543596990 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f593406be30 con 0x7f594412e8f0 2024-09-21T09:02:55.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.908+0000 7f5943fff640 1 --2- 172.21.15.44:0/3543596990 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f59300382a0 0x7f593003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:55.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.908+0000 7f5943fff640 1 --2- 172.21.15.44:0/3543596990 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f59300382a0 0x7f593003a760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5938000c00 tx=0x7f5938007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:55.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:55.912+0000 7f59417fa640 1 -- 172.21.15.44:0/3543596990 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f593403a520 con 0x7f594412e8f0 2024-09-21T09:02:56.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.084+0000 7f594adf8640 1 -- 172.21.15.44:0/3543596990 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5944071560 con 0x7f59300382a0 2024-09-21T09:02:56.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.086+0000 7f59417fa640 1 -- 172.21.15.44:0/3543596990 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32192 (secure 0 0 0) 0x7f5944071560 con 0x7f59300382a0 2024-09-21T09:02:56.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:56.088 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-21T09:02:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.088+0000 7f594adf8640 1 -- 172.21.15.44:0/3543596990 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f59300382a0 msgr2=0x7f593003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.088+0000 7f594adf8640 1 --2- 172.21.15.44:0/3543596990 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f59300382a0 0x7f593003a760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5938000c00 tx=0x7f5938007970 comp rx=0 tx=0).stop 2024-09-21T09:02:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.088+0000 7f594adf8640 1 -- 172.21.15.44:0/3543596990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f594412e8f0 msgr2=0x7f59441c3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.088+0000 7f594adf8640 1 --2- 172.21.15.44:0/3543596990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f594412e8f0 0x7f59441c3230 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5934009720 tx=0x7f59340046c0 comp rx=0 tx=0).stop 2024-09-21T09:02:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.088+0000 7f594adf8640 1 -- 172.21.15.44:0/3543596990 shutdown_connections 2024-09-21T09:02:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.088+0000 7f594adf8640 1 --2- 172.21.15.44:0/3543596990 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f59300382a0 0x7f593003a760 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.088+0000 7f594adf8640 1 --2- 172.21.15.44:0/3543596990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f594412e8f0 0x7f59441c3230 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.088+0000 7f594adf8640 1 -- 172.21.15.44:0/3543596990 >> 172.21.15.44:0/3543596990 conn(0x7f594409d860 msgr2=0x7f5944095de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.088+0000 7f594adf8640 1 -- 172.21.15.44:0/3543596990 shutdown_connections 2024-09-21T09:02:56.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.088+0000 7f594adf8640 1 -- 172.21.15.44:0/3543596990 wait complete. 2024-09-21T09:02:56.100 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-21T09:02:54.423726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":130616,"kb_used_data":1704,"kb_used_omap":6,"kb_used_meta":128825,"kb_avail":377356744,"statfs":{"total":386547056640,"available":386413305856,"internally_reserved":0,"allocated":1744896,"data_stored":1359014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":131917591},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.935979"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.501161+0000","last_change":"2024-09-21T09:02:51.501161+0000","last_active":"2024-09-21T09:02:51.501161+0000","last_peered":"2024-09-21T09:02:51.501161+0000","last_clean":"2024-09-21T09:02:51.501161+0000","last_became_active":"2024-09-21T09:02:49.542160+0000","last_became_peered":"2024-09-21T09:02:49.542160+0000","last_unstale":"2024-09-21T09:02:51.501161+0000","last_undegraded":"2024-09-21T09:02:51.501161+0000","last_fullsized":"2024-09-21T09:02:51.501161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:18.503834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099618800000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.498192+0000","last_change":"2024-09-21T09:02:51.498192+0000","last_active":"2024-09-21T09:02:51.498192+0000","last_peered":"2024-09-21T09:02:51.498192+0000","last_clean":"2024-09-21T09:02:51.498192+0000","last_became_active":"2024-09-21T09:02:49.493144+0000","last_became_peered":"2024-09-21T09:02:49.493144+0000","last_unstale":"2024-09-21T09:02:51.498192+0000","last_undegraded":"2024-09-21T09:02:51.498192+0000","last_fullsized":"2024-09-21T09:02:51.498192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:04.340866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042500699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.501475+0000","last_change":"2024-09-21T09:02:51.501475+0000","last_active":"2024-09-21T09:02:51.501475+0000","last_peered":"2024-09-21T09:02:51.501475+0000","last_clean":"2024-09-21T09:02:51.501475+0000","last_became_active":"2024-09-21T09:02:49.493469+0000","last_became_peered":"2024-09-21T09:02:49.493469+0000","last_unstale":"2024-09-21T09:02:51.501475+0000","last_undegraded":"2024-09-21T09:02:51.501475+0000","last_fullsized":"2024-09-21T09:02:51.501475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:23.397410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001228114,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.498275+0000","last_change":"2024-09-21T09:02:51.498275+0000","last_active":"2024-09-21T09:02:51.498275+0000","last_peered":"2024-09-21T09:02:51.498275+0000","last_clean":"2024-09-21T09:02:51.498275+0000","last_became_active":"2024-09-21T09:02:49.493509+0000","last_became_peered":"2024-09-21T09:02:49.493509+0000","last_unstale":"2024-09-21T09:02:51.498275+0000","last_undegraded":"2024-09-21T09:02:51.498275+0000","last_fullsized":"2024-09-21T09:02:51.498275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:48.460775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038981200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"16'2","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.501901+0000","last_change":"2024-09-21T09:02:51.501105+0000","last_active":"2024-09-21T09:02:51.501901+0000","last_peered":"2024-09-21T09:02:51.501901+0000","last_clean":"2024-09-21T09:02:51.501901+0000","last_became_active":"2024-09-21T09:02:49.493348+0000","last_became_peered":"2024-09-21T09:02:49.493348+0000","last_unstale":"2024-09-21T09:02:51.501901+0000","last_undegraded":"2024-09-21T09:02:51.501901+0000","last_fullsized":"2024-09-21T09:02:51.501901+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:12.805512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096028300000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.506704+0000","last_change":"2024-09-21T09:02:51.506704+0000","last_active":"2024-09-21T09:02:51.506704+0000","last_peered":"2024-09-21T09:02:51.506704+0000","last_clean":"2024-09-21T09:02:51.506704+0000","last_became_active":"2024-09-21T09:02:49.493605+0000","last_became_peered":"2024-09-21T09:02:49.493605+0000","last_unstale":"2024-09-21T09:02:51.506704+0000","last_undegraded":"2024-09-21T09:02:51.506704+0000","last_fullsized":"2024-09-21T09:02:51.506704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:33.820022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033020199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.500609+0000","last_change":"2024-09-21T09:02:51.500609+0000","last_active":"2024-09-21T09:02:51.500609+0000","last_peered":"2024-09-21T09:02:51.500609+0000","last_clean":"2024-09-21T09:02:51.500609+0000","last_became_active":"2024-09-21T09:02:49.493239+0000","last_became_peered":"2024-09-21T09:02:49.493239+0000","last_unstale":"2024-09-21T09:02:51.500609+0000","last_undegraded":"2024-09-21T09:02:51.500609+0000","last_fullsized":"2024-09-21T09:02:51.500609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:46.489803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046437600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"14'1","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.501401+0000","last_change":"2024-09-21T09:02:51.501401+0000","last_active":"2024-09-21T09:02:51.501401+0000","last_peered":"2024-09-21T09:02:51.501401+0000","last_clean":"2024-09-21T09:02:51.501401+0000","last_became_active":"2024-09-21T09:02:49.492504+0000","last_became_peered":"2024-09-21T09:02:49.492504+0000","last_unstale":"2024-09-21T09:02:51.501401+0000","last_undegraded":"2024-09-21T09:02:51.501401+0000","last_fullsized":"2024-09-21T09:02:51.501401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:33.286003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001229291,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"11'117","reported_seq":170,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:52.510984+0000","last_change":"2024-09-21T09:02:44.107999+0000","last_active":"2024-09-21T09:02:52.510984+0000","last_peered":"2024-09-21T09:02:52.510984+0000","last_clean":"2024-09-21T09:02:52.510984+0000","last_became_active":"2024-09-21T09:02:44.107052+0000","last_became_peered":"2024-09-21T09:02:44.107052+0000","last_unstale":"2024-09-21T09:02:52.510984+0000","last_undegraded":"2024-09-21T09:02:52.510984+0000","last_fullsized":"2024-09-21T09:02:52.510984+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_clean_scrub_stamp":"2024-09-21T09:02:42.466256+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:10.291354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":143360,"data_stored":45605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36064,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335776,"statfs":{"total":96636764160,"available":96599834624,"internally_reserved":0,"allocated":733184,"data_stored":635954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36056,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335784,"statfs":{"total":96636764160,"available":96599842816,"internally_reserved":0,"allocated":724992,"data_stored":631850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":143360,"data_stored":45605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:02:56.101 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:02:56.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.200+0000 7efec5fc4640 1 Processor -- start 2024-09-21T09:02:56.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.200+0000 7efec5fc4640 1 -- start start 2024-09-21T09:02:56.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.201+0000 7efec5fc4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efec012f3e0 0x7efec0133e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:56.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.201+0000 7efec5fc4640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec0096ee0 con 0x7efec012e8f0 2024-09-21T09:02:56.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.201+0000 7efec5fc4640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7efec009e090 con 0x7efec012f3e0 2024-09-21T09:02:56.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.201+0000 7efebeffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efec012f3e0 0x7efec0133e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:56.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.201+0000 7efebf7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efec012e8f0 0x7efec012ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55898/0 (socket says 172.21.15.44:55898) 2024-09-21T09:02:56.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.201+0000 7efebf7fe640 1 -- 172.21.15.44:0/2206355966 learned_addr learned my addr 172.21.15.44:0/2206355966 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:56.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.201+0000 7efebe7fc640 1 -- 172.21.15.44:0/2206355966 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1954692153 0 0) 0x7efec0096ee0 con 0x7efec012e8f0 2024-09-21T09:02:56.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.201+0000 7efebe7fc640 1 -- 172.21.15.44:0/2206355966 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efea8003520 con 0x7efec012e8f0 2024-09-21T09:02:56.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.201+0000 7efebeffd640 1 -- 172.21.15.44:0/2206355966 >> v1:172.21.15.44:6789/0 conn(0x7efec012e8f0 legacy=0x7efec012ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:56.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.201+0000 7efebeffd640 1 -- 172.21.15.44:0/2206355966 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec0074e50 con 0x7efec012f3e0 2024-09-21T09:02:56.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.202+0000 7efebeffd640 1 --2- 172.21.15.44:0/2206355966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec012f3e0 0x7efec0133e90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009720 tx=0x7efeb402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39447f149b12c4c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:56.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.202+0000 7efebe7fc640 1 -- 172.21.15.44:0/2206355966 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb4037070 con 0x7efec012f3e0 2024-09-21T09:02:56.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.202+0000 7efebe7fc640 1 -- 172.21.15.44:0/2206355966 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb402ad90 con 0x7efec012f3e0 2024-09-21T09:02:56.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.202+0000 7efebe7fc640 1 -- 172.21.15.44:0/2206355966 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb4032590 con 0x7efec012f3e0 2024-09-21T09:02:56.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.202+0000 7efec5fc4640 1 -- 172.21.15.44:0/2206355966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec012f3e0 msgr2=0x7efec0133e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:56.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.202+0000 7efec5fc4640 1 --2- 172.21.15.44:0/2206355966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec012f3e0 0x7efec0133e90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009720 tx=0x7efeb402a110 comp rx=0 tx=0).stop 2024-09-21T09:02:56.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.202+0000 7efec5fc4640 1 -- 172.21.15.44:0/2206355966 shutdown_connections 2024-09-21T09:02:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.202+0000 7efec5fc4640 1 --2- 172.21.15.44:0/2206355966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec012f3e0 0x7efec0133e90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.202+0000 7efec5fc4640 1 -- 172.21.15.44:0/2206355966 >> 172.21.15.44:0/2206355966 conn(0x7efec009d860 msgr2=0x7efec0099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.202+0000 7efec5fc4640 1 -- 172.21.15.44:0/2206355966 shutdown_connections 2024-09-21T09:02:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.202+0000 7efec5fc4640 1 -- 172.21.15.44:0/2206355966 wait complete. 2024-09-21T09:02:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.203+0000 7efec5fc4640 1 Processor -- start 2024-09-21T09:02:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.204+0000 7efec5fc4640 1 -- start start 2024-09-21T09:02:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.204+0000 7efec5fc4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec012e8f0 0x7efec006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.204+0000 7efec5fc4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efec0096ac0 con 0x7efec012e8f0 2024-09-21T09:02:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.204+0000 7efebf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec012e8f0 0x7efec006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.204+0000 7efebf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec012e8f0 0x7efec006d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44244/0 (socket says 172.21.15.44:44244) 2024-09-21T09:02:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.204+0000 7efebf7fe640 1 -- 172.21.15.44:0/70291103 learned_addr learned my addr 172.21.15.44:0/70291103 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.204+0000 7efebf7fe640 1 -- 172.21.15.44:0/70291103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec006f7f0 con 0x7efec012e8f0 2024-09-21T09:02:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.204+0000 7efebf7fe640 1 --2- 172.21.15.44:0/70291103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec012e8f0 0x7efec006d7b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efeb000c480 tx=0x7efeb000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.204+0000 7efea7fff640 1 -- 172.21.15.44:0/70291103 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb0017070 con 0x7efec012e8f0 2024-09-21T09:02:56.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.205+0000 7efea7fff640 1 -- 172.21.15.44:0/70291103 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb0005c10 con 0x7efec012e8f0 2024-09-21T09:02:56.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.205+0000 7efec5fc4640 1 -- 172.21.15.44:0/70291103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec0093210 con 0x7efec012e8f0 2024-09-21T09:02:56.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.205+0000 7efea7fff640 1 -- 172.21.15.44:0/70291103 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb0007070 con 0x7efec012e8f0 2024-09-21T09:02:56.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.205+0000 7efec5fc4640 1 -- 172.21.15.44:0/70291103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec006f340 con 0x7efec012e8f0 2024-09-21T09:02:56.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.205+0000 7efea7fff640 1 -- 172.21.15.44:0/70291103 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efeb001a070 con 0x7efec012e8f0 2024-09-21T09:02:56.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.205+0000 7efec5fc4640 1 -- 172.21.15.44:0/70291103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec0093b60 con 0x7efec012e8f0 2024-09-21T09:02:56.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.206+0000 7efea7fff640 1 --2- 172.21.15.44:0/70291103 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efeac0382a0 0x7efeac03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:56.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.206+0000 7efea7fff640 1 -- 172.21.15.44:0/70291103 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7efeb004a590 con 0x7efec012e8f0 2024-09-21T09:02:56.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.206+0000 7efebeffd640 1 --2- 172.21.15.44:0/70291103 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efeac0382a0 0x7efeac03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:56.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.207+0000 7efebeffd640 1 --2- 172.21.15.44:0/70291103 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efeac0382a0 0x7efeac03a760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efeb4034000 tx=0x7efeb402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:56.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.210+0000 7efea7fff640 1 -- 172.21.15.44:0/70291103 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7efeb001b7b0 con 0x7efec012e8f0 2024-09-21T09:02:56.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.381+0000 7efec5fc4640 1 -- 172.21.15.44:0/70291103 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efec006e8e0 con 0x7efeac0382a0 2024-09-21T09:02:56.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.383+0000 7efea7fff640 1 -- 172.21.15.44:0/70291103 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32192 (secure 0 0 0) 0x7efec006e8e0 con 0x7efeac0382a0 2024-09-21T09:02:56.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:56.385 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-21T09:02:56.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.385+0000 7efec5fc4640 1 -- 172.21.15.44:0/70291103 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efeac0382a0 msgr2=0x7efeac03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:56.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.385+0000 7efec5fc4640 1 --2- 172.21.15.44:0/70291103 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efeac0382a0 0x7efeac03a760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efeb4034000 tx=0x7efeb402e000 comp rx=0 tx=0).stop 2024-09-21T09:02:56.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.385+0000 7efec5fc4640 1 -- 172.21.15.44:0/70291103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec012e8f0 msgr2=0x7efec006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:56.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.385+0000 7efec5fc4640 1 --2- 172.21.15.44:0/70291103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec012e8f0 0x7efec006d7b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efeb000c480 tx=0x7efeb000c940 comp rx=0 tx=0).stop 2024-09-21T09:02:56.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.385+0000 7efec5fc4640 1 -- 172.21.15.44:0/70291103 shutdown_connections 2024-09-21T09:02:56.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.385+0000 7efec5fc4640 1 --2- 172.21.15.44:0/70291103 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efeac0382a0 0x7efeac03a760 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:56.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.385+0000 7efec5fc4640 1 --2- 172.21.15.44:0/70291103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec012e8f0 0x7efec006d7b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:56.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.385+0000 7efec5fc4640 1 -- 172.21.15.44:0/70291103 >> 172.21.15.44:0/70291103 conn(0x7efec009d860 msgr2=0x7efec0098980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:56.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.385+0000 7efec5fc4640 1 -- 172.21.15.44:0/70291103 shutdown_connections 2024-09-21T09:02:56.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.385+0000 7efec5fc4640 1 -- 172.21.15.44:0/70291103 wait complete. 2024-09-21T09:02:56.397 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-21T09:02:54.423726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":130616,"kb_used_data":1704,"kb_used_omap":6,"kb_used_meta":128825,"kb_avail":377356744,"statfs":{"total":386547056640,"available":386413305856,"internally_reserved":0,"allocated":1744896,"data_stored":1359014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":131917591},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.935979"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.501161+0000","last_change":"2024-09-21T09:02:51.501161+0000","last_active":"2024-09-21T09:02:51.501161+0000","last_peered":"2024-09-21T09:02:51.501161+0000","last_clean":"2024-09-21T09:02:51.501161+0000","last_became_active":"2024-09-21T09:02:49.542160+0000","last_became_peered":"2024-09-21T09:02:49.542160+0000","last_unstale":"2024-09-21T09:02:51.501161+0000","last_undegraded":"2024-09-21T09:02:51.501161+0000","last_fullsized":"2024-09-21T09:02:51.501161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:18.503834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099618800000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.498192+0000","last_change":"2024-09-21T09:02:51.498192+0000","last_active":"2024-09-21T09:02:51.498192+0000","last_peered":"2024-09-21T09:02:51.498192+0000","last_clean":"2024-09-21T09:02:51.498192+0000","last_became_active":"2024-09-21T09:02:49.493144+0000","last_became_peered":"2024-09-21T09:02:49.493144+0000","last_unstale":"2024-09-21T09:02:51.498192+0000","last_undegraded":"2024-09-21T09:02:51.498192+0000","last_fullsized":"2024-09-21T09:02:51.498192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:04.340866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042500699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.501475+0000","last_change":"2024-09-21T09:02:51.501475+0000","last_active":"2024-09-21T09:02:51.501475+0000","last_peered":"2024-09-21T09:02:51.501475+0000","last_clean":"2024-09-21T09:02:51.501475+0000","last_became_active":"2024-09-21T09:02:49.493469+0000","last_became_peered":"2024-09-21T09:02:49.493469+0000","last_unstale":"2024-09-21T09:02:51.501475+0000","last_undegraded":"2024-09-21T09:02:51.501475+0000","last_fullsized":"2024-09-21T09:02:51.501475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:23.397410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001228114,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.498275+0000","last_change":"2024-09-21T09:02:51.498275+0000","last_active":"2024-09-21T09:02:51.498275+0000","last_peered":"2024-09-21T09:02:51.498275+0000","last_clean":"2024-09-21T09:02:51.498275+0000","last_became_active":"2024-09-21T09:02:49.493509+0000","last_became_peered":"2024-09-21T09:02:49.493509+0000","last_unstale":"2024-09-21T09:02:51.498275+0000","last_undegraded":"2024-09-21T09:02:51.498275+0000","last_fullsized":"2024-09-21T09:02:51.498275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:48.460775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038981200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"16'2","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.501901+0000","last_change":"2024-09-21T09:02:51.501105+0000","last_active":"2024-09-21T09:02:51.501901+0000","last_peered":"2024-09-21T09:02:51.501901+0000","last_clean":"2024-09-21T09:02:51.501901+0000","last_became_active":"2024-09-21T09:02:49.493348+0000","last_became_peered":"2024-09-21T09:02:49.493348+0000","last_unstale":"2024-09-21T09:02:51.501901+0000","last_undegraded":"2024-09-21T09:02:51.501901+0000","last_fullsized":"2024-09-21T09:02:51.501901+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:12.805512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096028300000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.506704+0000","last_change":"2024-09-21T09:02:51.506704+0000","last_active":"2024-09-21T09:02:51.506704+0000","last_peered":"2024-09-21T09:02:51.506704+0000","last_clean":"2024-09-21T09:02:51.506704+0000","last_became_active":"2024-09-21T09:02:49.493605+0000","last_became_peered":"2024-09-21T09:02:49.493605+0000","last_unstale":"2024-09-21T09:02:51.506704+0000","last_undegraded":"2024-09-21T09:02:51.506704+0000","last_fullsized":"2024-09-21T09:02:51.506704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:33.820022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033020199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.500609+0000","last_change":"2024-09-21T09:02:51.500609+0000","last_active":"2024-09-21T09:02:51.500609+0000","last_peered":"2024-09-21T09:02:51.500609+0000","last_clean":"2024-09-21T09:02:51.500609+0000","last_became_active":"2024-09-21T09:02:49.493239+0000","last_became_peered":"2024-09-21T09:02:49.493239+0000","last_unstale":"2024-09-21T09:02:51.500609+0000","last_undegraded":"2024-09-21T09:02:51.500609+0000","last_fullsized":"2024-09-21T09:02:51.500609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:46.489803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046437600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"14'1","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:51.501401+0000","last_change":"2024-09-21T09:02:51.501401+0000","last_active":"2024-09-21T09:02:51.501401+0000","last_peered":"2024-09-21T09:02:51.501401+0000","last_clean":"2024-09-21T09:02:51.501401+0000","last_became_active":"2024-09-21T09:02:49.492504+0000","last_became_peered":"2024-09-21T09:02:49.492504+0000","last_unstale":"2024-09-21T09:02:51.501401+0000","last_undegraded":"2024-09-21T09:02:51.501401+0000","last_fullsized":"2024-09-21T09:02:51.501401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:33.286003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001229291,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"11'117","reported_seq":170,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T09:02:52.510984+0000","last_change":"2024-09-21T09:02:44.107999+0000","last_active":"2024-09-21T09:02:52.510984+0000","last_peered":"2024-09-21T09:02:52.510984+0000","last_clean":"2024-09-21T09:02:52.510984+0000","last_became_active":"2024-09-21T09:02:44.107052+0000","last_became_peered":"2024-09-21T09:02:44.107052+0000","last_unstale":"2024-09-21T09:02:52.510984+0000","last_undegraded":"2024-09-21T09:02:52.510984+0000","last_fullsized":"2024-09-21T09:02:52.510984+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_clean_scrub_stamp":"2024-09-21T09:02:42.466256+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:10.291354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":143360,"data_stored":45605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36064,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335776,"statfs":{"total":96636764160,"available":96599834624,"internally_reserved":0,"allocated":733184,"data_stored":635954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36056,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335784,"statfs":{"total":96636764160,"available":96599842816,"internally_reserved":0,"allocated":724992,"data_stored":631850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":143360,"data_stored":45605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:02:56.398 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T09:02:56.398 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T09:02:56.399 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T09:02:56.399 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T09:02:56.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.497+0000 7f3d026ac640 1 Processor -- start 2024-09-21T09:02:56.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.497+0000 7f3d026ac640 1 -- start start 2024-09-21T09:02:56.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.497+0000 7f3d026ac640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3cfc096230 0x7f3cfc133e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:56.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.497+0000 7f3d026ac640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cfc09e100 con 0x7f3cfc095740 2024-09-21T09:02:56.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.497+0000 7f3d026ac640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f3cfc09a960 con 0x7f3cfc096230 2024-09-21T09:02:56.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.498+0000 7f3cfb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3cfc096230 0x7f3cfc133e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:56.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.498+0000 7f3cfbfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3cfc095740 0x7f3cfc095b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:55908/0 (socket says 172.21.15.44:55908) 2024-09-21T09:02:56.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.498+0000 7f3cfbfff640 1 -- 172.21.15.44:0/3665193681 learned_addr learned my addr 172.21.15.44:0/3665193681 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:02:56.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.498+0000 7f3cfb7fe640 1 -- 172.21.15.44:0/3665193681 >> v1:172.21.15.44:6789/0 conn(0x7f3cfc095740 legacy=0x7f3cfc095b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:56.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.498+0000 7f3cfb7fe640 1 -- 172.21.15.44:0/3665193681 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cfc097220 con 0x7f3cfc096230 2024-09-21T09:02:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.499+0000 7f3cfb7fe640 1 --2- 172.21.15.44:0/3665193681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc096230 0x7f3cfc133e20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009720 tx=0x7f3cf002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6638f7c4b62e21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:56.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.499+0000 7f3cfaffd640 1 -- 172.21.15.44:0/3665193681 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf0037070 con 0x7f3cfc096230 2024-09-21T09:02:56.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.499+0000 7f3cfaffd640 1 -- 172.21.15.44:0/3665193681 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf002ae20 con 0x7f3cfc096230 2024-09-21T09:02:56.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.499+0000 7f3cfaffd640 1 -- 172.21.15.44:0/3665193681 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf0032590 con 0x7f3cfc096230 2024-09-21T09:02:56.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.499+0000 7f3d026ac640 1 -- 172.21.15.44:0/3665193681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc096230 msgr2=0x7f3cfc133e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:56.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.499+0000 7f3d026ac640 1 --2- 172.21.15.44:0/3665193681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc096230 0x7f3cfc133e20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009720 tx=0x7f3cf002a1a0 comp rx=0 tx=0).stop 2024-09-21T09:02:56.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.499+0000 7f3d026ac640 1 -- 172.21.15.44:0/3665193681 shutdown_connections 2024-09-21T09:02:56.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.499+0000 7f3d026ac640 1 --2- 172.21.15.44:0/3665193681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc096230 0x7f3cfc133e20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:56.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.499+0000 7f3d026ac640 1 -- 172.21.15.44:0/3665193681 >> 172.21.15.44:0/3665193681 conn(0x7f3cfc09d860 msgr2=0x7f3cfc099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:56.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.499+0000 7f3d026ac640 1 -- 172.21.15.44:0/3665193681 shutdown_connections 2024-09-21T09:02:56.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.499+0000 7f3d026ac640 1 -- 172.21.15.44:0/3665193681 wait complete. 2024-09-21T09:02:56.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.500+0000 7f3d026ac640 1 Processor -- start 2024-09-21T09:02:56.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.500+0000 7f3d026ac640 1 -- start start 2024-09-21T09:02:56.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.501+0000 7f3d026ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc095740 0x7f3cfc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:56.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.501+0000 7f3d026ac640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc096bd0 con 0x7f3cfc095740 2024-09-21T09:02:56.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.501+0000 7f3cfbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc095740 0x7f3cfc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:56.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.501+0000 7f3cfbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc095740 0x7f3cfc06d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44262/0 (socket says 172.21.15.44:44262) 2024-09-21T09:02:56.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.501+0000 7f3cfbfff640 1 -- 172.21.15.44:0/1991890504 learned_addr learned my addr 172.21.15.44:0/1991890504 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:02:56.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.501+0000 7f3cfbfff640 1 -- 172.21.15.44:0/1991890504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cfc093fa0 con 0x7f3cfc095740 2024-09-21T09:02:56.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.501+0000 7f3cfbfff640 1 --2- 172.21.15.44:0/1991890504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc095740 0x7f3cfc06d7b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00c4a0 tx=0x7f3cec00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:56.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.504+0000 7f3cf8ff9640 1 -- 172.21.15.44:0/1991890504 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cec017070 con 0x7f3cfc095740 2024-09-21T09:02:56.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.504+0000 7f3cf8ff9640 1 -- 172.21.15.44:0/1991890504 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cec005c10 con 0x7f3cfc095740 2024-09-21T09:02:56.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.504+0000 7f3d026ac640 1 -- 172.21.15.44:0/1991890504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cfc0937b0 con 0x7f3cfc095740 2024-09-21T09:02:56.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.504+0000 7f3cf8ff9640 1 -- 172.21.15.44:0/1991890504 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cec007070 con 0x7f3cfc095740 2024-09-21T09:02:56.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.504+0000 7f3d026ac640 1 -- 172.21.15.44:0/1991890504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cfc06ec20 con 0x7f3cfc095740 2024-09-21T09:02:56.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.505+0000 7f3cf8ff9640 1 -- 172.21.15.44:0/1991890504 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3cec01a070 con 0x7f3cfc095740 2024-09-21T09:02:56.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.505+0000 7f3d026ac640 1 -- 172.21.15.44:0/1991890504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cfc095b20 con 0x7f3cfc095740 2024-09-21T09:02:56.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.505+0000 7f3cf8ff9640 1 --2- 172.21.15.44:0/1991890504 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3ce80382a0 0x7f3ce803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:56.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.505+0000 7f3cf8ff9640 1 -- 172.21.15.44:0/1991890504 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f3cec04a530 con 0x7f3cfc095740 2024-09-21T09:02:56.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.505+0000 7f3cfb7fe640 1 --2- 172.21.15.44:0/1991890504 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3ce80382a0 0x7f3ce803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:56.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.506+0000 7f3cfb7fe640 1 --2- 172.21.15.44:0/1991890504 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3ce80382a0 0x7f3ce803a760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0034000 tx=0x7f3cf002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:56.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.509+0000 7f3cf8ff9640 1 -- 172.21.15.44:0/1991890504 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3cec012400 con 0x7f3cfc095740 2024-09-21T09:02:56.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.723+0000 7f3d026ac640 1 -- 172.21.15.44:0/1991890504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3cfc070100 con 0x7f3cfc095740 2024-09-21T09:02:56.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.724+0000 7f3cf8ff9640 1 -- 172.21.15.44:0/1991890504 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3cec01ac10 con 0x7f3cfc095740 2024-09-21T09:02:56.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:02:56.726 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T09:02:56.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.726+0000 7f3d026ac640 1 -- 172.21.15.44:0/1991890504 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3ce80382a0 msgr2=0x7f3ce803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:56.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.726+0000 7f3d026ac640 1 --2- 172.21.15.44:0/1991890504 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3ce80382a0 0x7f3ce803a760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0034000 tx=0x7f3cf002e000 comp rx=0 tx=0).stop 2024-09-21T09:02:56.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.726+0000 7f3d026ac640 1 -- 172.21.15.44:0/1991890504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc095740 msgr2=0x7f3cfc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:56.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.726+0000 7f3d026ac640 1 --2- 172.21.15.44:0/1991890504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc095740 0x7f3cfc06d7b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00c4a0 tx=0x7f3cec00c960 comp rx=0 tx=0).stop 2024-09-21T09:02:56.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.726+0000 7f3d026ac640 1 -- 172.21.15.44:0/1991890504 shutdown_connections 2024-09-21T09:02:56.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.726+0000 7f3d026ac640 1 --2- 172.21.15.44:0/1991890504 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3ce80382a0 0x7f3ce803a760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:56.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.726+0000 7f3d026ac640 1 --2- 172.21.15.44:0/1991890504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc095740 0x7f3cfc06d7b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:56.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.726+0000 7f3d026ac640 1 -- 172.21.15.44:0/1991890504 >> 172.21.15.44:0/1991890504 conn(0x7f3cfc09d860 msgr2=0x7f3cfc098520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:56.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.726+0000 7f3d026ac640 1 -- 172.21.15.44:0/1991890504 shutdown_connections 2024-09-21T09:02:56.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:02:56.726+0000 7f3d026ac640 1 -- 172.21.15.44:0/1991890504 wait complete. 2024-09-21T09:02:56.738 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T09:02:56.739 INFO:teuthology.run_tasks:Running task rgw... 2024-09-21T09:02:56.757 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-21T09:02:56.757 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-21T09:02:56.757 INFO:tasks.rgw:Creating data pools 2024-09-21T09:02:56.757 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-21T09:02:56.758 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-21T09:02:56.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.865+0000 7fa45671a640 1 Processor -- start 2024-09-21T09:02:56.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.865+0000 7fa45671a640 1 -- start start 2024-09-21T09:02:56.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.865+0000 7fa45671a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa450073ec0 0x7fa45011b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:56.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.865+0000 7fa45671a640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa45011b650 con 0x7fa4500733d0 2024-09-21T09:02:56.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.865+0000 7fa45671a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fa45011c830 con 0x7fa450073ec0 2024-09-21T09:02:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.866+0000 7fa44f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa450073ec0 0x7fa45011b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.866+0000 7fa44f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa450073ec0 0x7fa45011b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33278/0 (socket says 172.21.15.178:33278) 2024-09-21T09:02:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.866+0000 7fa44f7fe640 1 -- 172.21.15.178:0/3175781407 learned_addr learned my addr 172.21.15.178:0/3175781407 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:02:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.866+0000 7fa44effd640 1 -- 172.21.15.178:0/3175781407 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327590401 0 0) 0x7fa45011b650 con 0x7fa4500733d0 2024-09-21T09:02:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.866+0000 7fa44effd640 1 -- 172.21.15.178:0/3175781407 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa438003520 con 0x7fa4500733d0 2024-09-21T09:02:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.866+0000 7fa44f7fe640 1 -- 172.21.15.178:0/3175781407 >> v1:172.21.15.44:6789/0 conn(0x7fa4500733d0 legacy=0x7fa4500737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.866+0000 7fa44f7fe640 1 -- 172.21.15.178:0/3175781407 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45011c9b0 con 0x7fa450073ec0 2024-09-21T09:02:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.867+0000 7fa44f7fe640 1 --2- 172.21.15.178:0/3175781407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa450073ec0 0x7fa45011b110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4440097f0 tx=0x7fa44402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f39b7aaafad111e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.867+0000 7fa44effd640 1 -- 172.21.15.178:0/3175781407 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa444037070 con 0x7fa450073ec0 2024-09-21T09:02:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.867+0000 7fa44effd640 1 -- 172.21.15.178:0/3175781407 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa444032440 con 0x7fa450073ec0 2024-09-21T09:02:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.867+0000 7fa44effd640 1 -- 172.21.15.178:0/3175781407 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa44402ae60 con 0x7fa450073ec0 2024-09-21T09:02:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.868+0000 7fa45671a640 1 -- 172.21.15.178:0/3175781407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa450073ec0 msgr2=0x7fa45011b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.868+0000 7fa45671a640 1 --2- 172.21.15.178:0/3175781407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa450073ec0 0x7fa45011b110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4440097f0 tx=0x7fa44402a1e0 comp rx=0 tx=0).stop 2024-09-21T09:02:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.868+0000 7fa45671a640 1 -- 172.21.15.178:0/3175781407 shutdown_connections 2024-09-21T09:02:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.868+0000 7fa45671a640 1 --2- 172.21.15.178:0/3175781407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa450073ec0 0x7fa45011b110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.868+0000 7fa45671a640 1 -- 172.21.15.178:0/3175781407 >> 172.21.15.178:0/3175781407 conn(0x7fa45006ef30 msgr2=0x7fa450071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.868+0000 7fa45671a640 1 -- 172.21.15.178:0/3175781407 shutdown_connections 2024-09-21T09:02:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.868+0000 7fa45671a640 1 -- 172.21.15.178:0/3175781407 wait complete. 2024-09-21T09:02:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.868+0000 7fa45671a640 1 Processor -- start 2024-09-21T09:02:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.869+0000 7fa45671a640 1 -- start start 2024-09-21T09:02:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.869+0000 7fa45671a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4500733d0 0x7fa45010ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.869+0000 7fa45671a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa45011bc70 con 0x7fa4500733d0 2024-09-21T09:02:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.869+0000 7fa44ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4500733d0 0x7fa45010ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.869+0000 7fa44ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4500733d0 0x7fa45010ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33286/0 (socket says 172.21.15.178:33286) 2024-09-21T09:02:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.869+0000 7fa44ffff640 1 -- 172.21.15.178:0/2078750645 learned_addr learned my addr 172.21.15.178:0/2078750645 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:02:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.869+0000 7fa44ffff640 1 -- 172.21.15.178:0/2078750645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4501104a0 con 0x7fa4500733d0 2024-09-21T09:02:56.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.870+0000 7fa44ffff640 1 --2- 172.21.15.178:0/2078750645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4500733d0 0x7fa45010ff60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa44000c480 tx=0x7fa44000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:56.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.870+0000 7fa44cff9640 1 -- 172.21.15.178:0/2078750645 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa440017070 con 0x7fa4500733d0 2024-09-21T09:02:56.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.870+0000 7fa44cff9640 1 -- 172.21.15.178:0/2078750645 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa440005200 con 0x7fa4500733d0 2024-09-21T09:02:56.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.870+0000 7fa45671a640 1 -- 172.21.15.178:0/2078750645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa450110730 con 0x7fa4500733d0 2024-09-21T09:02:56.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.870+0000 7fa44cff9640 1 -- 172.21.15.178:0/2078750645 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4400126f0 con 0x7fa4500733d0 2024-09-21T09:02:56.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.870+0000 7fa45671a640 1 -- 172.21.15.178:0/2078750645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa450110c80 con 0x7fa4500733d0 2024-09-21T09:02:56.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.871+0000 7fa44cff9640 1 -- 172.21.15.178:0/2078750645 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa44001a070 con 0x7fa4500733d0 2024-09-21T09:02:56.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.871+0000 7fa45671a640 1 -- 172.21.15.178:0/2078750645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa45011c1b0 con 0x7fa4500733d0 2024-09-21T09:02:56.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.871+0000 7fa44cff9640 1 --2- 172.21.15.178:0/2078750645 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa43c038250 0x7fa43c03a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:56.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.871+0000 7fa44cff9640 1 -- 172.21.15.178:0/2078750645 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fa44004a690 con 0x7fa4500733d0 2024-09-21T09:02:56.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.871+0000 7fa44f7fe640 1 --2- 172.21.15.178:0/2078750645 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa43c038250 0x7fa43c03a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:56.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.871+0000 7fa44f7fe640 1 --2- 172.21.15.178:0/2078750645 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa43c038250 0x7fa43c03a710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa444034000 tx=0x7fa44402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:56.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:56.876+0000 7fa44cff9640 1 -- 172.21.15.178:0/2078750645 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa44001b3b0 con 0x7fa4500733d0 2024-09-21T09:02:57.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.038+0000 7fa45671a640 1 -- 172.21.15.178:0/2078750645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fa450073ec0 con 0x7fa4500733d0 2024-09-21T09:02:57.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.192+0000 7fa44cff9640 1 -- 172.21.15.178:0/2078750645 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v17) ==== 167+0+0 (secure 0 0 0) 0x7fa4400102e0 con 0x7fa4500733d0 2024-09-21T09:02:57.195 INFO:teuthology.orchestra.run.smithi178.stderr:pool 'default.rgw.buckets.data' created 2024-09-21T09:02:57.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.193+0000 7fa45671a640 1 -- 172.21.15.178:0/2078750645 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa43c038250 msgr2=0x7fa43c03a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:57.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.193+0000 7fa45671a640 1 --2- 172.21.15.178:0/2078750645 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa43c038250 0x7fa43c03a710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa444034000 tx=0x7fa44402e000 comp rx=0 tx=0).stop 2024-09-21T09:02:57.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.193+0000 7fa45671a640 1 -- 172.21.15.178:0/2078750645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4500733d0 msgr2=0x7fa45010ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:57.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.193+0000 7fa45671a640 1 --2- 172.21.15.178:0/2078750645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4500733d0 0x7fa45010ff60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa44000c480 tx=0x7fa44000c940 comp rx=0 tx=0).stop 2024-09-21T09:02:57.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.194+0000 7fa45671a640 1 -- 172.21.15.178:0/2078750645 shutdown_connections 2024-09-21T09:02:57.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.194+0000 7fa45671a640 1 --2- 172.21.15.178:0/2078750645 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa43c038250 0x7fa43c03a710 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:57.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.194+0000 7fa45671a640 1 --2- 172.21.15.178:0/2078750645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4500733d0 0x7fa45010ff60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:57.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.194+0000 7fa45671a640 1 -- 172.21.15.178:0/2078750645 >> 172.21.15.178:0/2078750645 conn(0x7fa45006ef30 msgr2=0x7fa4501129d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:57.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.194+0000 7fa45671a640 1 -- 172.21.15.178:0/2078750645 shutdown_connections 2024-09-21T09:02:57.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.194+0000 7fa45671a640 1 -- 172.21.15.178:0/2078750645 wait complete. 2024-09-21T09:02:57.212 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-21T09:02:57.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.307+0000 7fdb7701e640 1 Processor -- start 2024-09-21T09:02:57.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.307+0000 7fdb7701e640 1 -- start start 2024-09-21T09:02:57.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.307+0000 7fdb7701e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdb70117a50 0x7fdb70119e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:57.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.307+0000 7fdb7701e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb7011a380 con 0x7fdb70114c40 2024-09-21T09:02:57.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.307+0000 7fdb7701e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fdb7011b560 con 0x7fdb70117a50 2024-09-21T09:02:57.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.308+0000 7fdb6ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdb70117a50 0x7fdb70119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:57.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.308+0000 7fdb74dba640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdb70114c40 0x7fdb70115020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:35386/0 (socket says 172.21.15.178:35386) 2024-09-21T09:02:57.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.308+0000 7fdb74dba640 1 -- 172.21.15.178:0/2801455953 learned_addr learned my addr 172.21.15.178:0/2801455953 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:02:57.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.308+0000 7fdb6f7fe640 1 -- 172.21.15.178:0/2801455953 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 177069812 0 0) 0x7fdb7011a380 con 0x7fdb70114c40 2024-09-21T09:02:57.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.308+0000 7fdb6f7fe640 1 -- 172.21.15.178:0/2801455953 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb60003520 con 0x7fdb70114c40 2024-09-21T09:02:57.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.308+0000 7fdb6ffff640 1 -- 172.21.15.178:0/2801455953 >> v1:172.21.15.44:6789/0 conn(0x7fdb70114c40 legacy=0x7fdb70115020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:57.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.308+0000 7fdb6ffff640 1 -- 172.21.15.178:0/2801455953 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7011b6e0 con 0x7fdb70117a50 2024-09-21T09:02:57.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.309+0000 7fdb6ffff640 1 --2- 172.21.15.178:0/2801455953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb70117a50 0x7fdb70119e40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009720 tx=0x7fdb5c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7e56b662e5d9ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:57.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.309+0000 7fdb6f7fe640 1 -- 172.21.15.178:0/2801455953 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb5c037070 con 0x7fdb70117a50 2024-09-21T09:02:57.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.309+0000 7fdb6f7fe640 1 -- 172.21.15.178:0/2801455953 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5c02ad90 con 0x7fdb70117a50 2024-09-21T09:02:57.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.309+0000 7fdb6f7fe640 1 -- 172.21.15.178:0/2801455953 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb5c032570 con 0x7fdb70117a50 2024-09-21T09:02:57.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.309+0000 7fdb7701e640 1 -- 172.21.15.178:0/2801455953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb70117a50 msgr2=0x7fdb70119e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:57.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.309+0000 7fdb7701e640 1 --2- 172.21.15.178:0/2801455953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb70117a50 0x7fdb70119e40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009720 tx=0x7fdb5c02a110 comp rx=0 tx=0).stop 2024-09-21T09:02:57.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.310+0000 7fdb7701e640 1 -- 172.21.15.178:0/2801455953 shutdown_connections 2024-09-21T09:02:57.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.310+0000 7fdb7701e640 1 --2- 172.21.15.178:0/2801455953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb70117a50 0x7fdb70119e40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:57.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.310+0000 7fdb7701e640 1 -- 172.21.15.178:0/2801455953 >> 172.21.15.178:0/2801455953 conn(0x7fdb7006f300 msgr2=0x7fdb70071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:57.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.310+0000 7fdb7701e640 1 -- 172.21.15.178:0/2801455953 shutdown_connections 2024-09-21T09:02:57.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.310+0000 7fdb7701e640 1 -- 172.21.15.178:0/2801455953 wait complete. 2024-09-21T09:02:57.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.310+0000 7fdb7701e640 1 Processor -- start 2024-09-21T09:02:57.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.310+0000 7fdb7701e640 1 -- start start 2024-09-21T09:02:57.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.311+0000 7fdb7701e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb70114c40 0x7fdb701aa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:57.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.311+0000 7fdb7701e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7011aa70 con 0x7fdb70114c40 2024-09-21T09:02:57.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.311+0000 7fdb74dba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb70114c40 0x7fdb701aa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:57.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.311+0000 7fdb74dba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb70114c40 0x7fdb701aa360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:59948/0 (socket says 172.21.15.178:59948) 2024-09-21T09:02:57.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.311+0000 7fdb74dba640 1 -- 172.21.15.178:0/3586513135 learned_addr learned my addr 172.21.15.178:0/3586513135 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:02:57.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.311+0000 7fdb74dba640 1 -- 172.21.15.178:0/3586513135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb701aa930 con 0x7fdb70114c40 2024-09-21T09:02:57.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.311+0000 7fdb74dba640 1 --2- 172.21.15.178:0/3586513135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb70114c40 0x7fdb701aa360 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c3b0 tx=0x7fdb6400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:57.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.311+0000 7fdb6d7fa640 1 -- 172.21.15.178:0/3586513135 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb64017070 con 0x7fdb70114c40 2024-09-21T09:02:57.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.311+0000 7fdb6d7fa640 1 -- 172.21.15.178:0/3586513135 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb64005c10 con 0x7fdb70114c40 2024-09-21T09:02:57.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.311+0000 7fdb6d7fa640 1 -- 172.21.15.178:0/3586513135 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb640070d0 con 0x7fdb70114c40 2024-09-21T09:02:57.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.311+0000 7fdb7701e640 1 -- 172.21.15.178:0/3586513135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb701aabc0 con 0x7fdb70114c40 2024-09-21T09:02:57.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.312+0000 7fdb7701e640 1 -- 172.21.15.178:0/3586513135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb701a4650 con 0x7fdb70114c40 2024-09-21T09:02:57.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.312+0000 7fdb7701e640 1 -- 172.21.15.178:0/3586513135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb7011afb0 con 0x7fdb70114c40 2024-09-21T09:02:57.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.312+0000 7fdb6d7fa640 1 -- 172.21.15.178:0/3586513135 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb6401a070 con 0x7fdb70114c40 2024-09-21T09:02:57.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.313+0000 7fdb6d7fa640 1 --2- 172.21.15.178:0/3586513135 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdb54038250 0x7fdb5403a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:57.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.313+0000 7fdb6d7fa640 1 -- 172.21.15.178:0/3586513135 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3873+0+0 (secure 0 0 0) 0x7fdb6404a8e0 con 0x7fdb70114c40 2024-09-21T09:02:57.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.313+0000 7fdb6ffff640 1 --2- 172.21.15.178:0/3586513135 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdb54038250 0x7fdb5403a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:57.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.313+0000 7fdb6ffff640 1 --2- 172.21.15.178:0/3586513135 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdb54038250 0x7fdb5403a710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c034000 tx=0x7fdb5c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:57.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.318+0000 7fdb6d7fa640 1 -- 172.21.15.178:0/3586513135 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdb64019e10 con 0x7fdb70114c40 2024-09-21T09:02:57.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:57.485+0000 7fdb7701e640 1 -- 172.21.15.178:0/3586513135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7fdb701aae60 con 0x7fdb70114c40 2024-09-21T09:02:58.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.193+0000 7fdb6d7fa640 1 -- 172.21.15.178:0/3586513135 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v18) ==== 185+0+0 (secure 0 0 0) 0x7fdb64010b90 con 0x7fdb70114c40 2024-09-21T09:02:58.196 INFO:teuthology.orchestra.run.smithi178.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-21T09:02:58.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.197+0000 7fdb7701e640 1 -- 172.21.15.178:0/3586513135 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdb54038250 msgr2=0x7fdb5403a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:58.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.197+0000 7fdb7701e640 1 --2- 172.21.15.178:0/3586513135 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdb54038250 0x7fdb5403a710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c034000 tx=0x7fdb5c02e000 comp rx=0 tx=0).stop 2024-09-21T09:02:58.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.197+0000 7fdb7701e640 1 -- 172.21.15.178:0/3586513135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb70114c40 msgr2=0x7fdb701aa360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:58.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.197+0000 7fdb7701e640 1 --2- 172.21.15.178:0/3586513135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb70114c40 0x7fdb701aa360 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c3b0 tx=0x7fdb6400c870 comp rx=0 tx=0).stop 2024-09-21T09:02:58.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.199+0000 7fdb7701e640 1 -- 172.21.15.178:0/3586513135 shutdown_connections 2024-09-21T09:02:58.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.199+0000 7fdb7701e640 1 --2- 172.21.15.178:0/3586513135 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdb54038250 0x7fdb5403a710 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:58.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.199+0000 7fdb7701e640 1 --2- 172.21.15.178:0/3586513135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb70114c40 0x7fdb701aa360 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:58.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.199+0000 7fdb7701e640 1 -- 172.21.15.178:0/3586513135 >> 172.21.15.178:0/3586513135 conn(0x7fdb7006f300 msgr2=0x7fdb701194a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:58.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.202+0000 7fdb7701e640 1 -- 172.21.15.178:0/3586513135 shutdown_connections 2024-09-21T09:02:58.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.203+0000 7fdb7701e640 1 -- 172.21.15.178:0/3586513135 wait complete. 2024-09-21T09:02:58.229 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-21T09:02:58.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.328+0000 7efc80352640 1 Processor -- start 2024-09-21T09:02:58.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.329+0000 7efc80352640 1 -- start start 2024-09-21T09:02:58.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.329+0000 7efc80352640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efc7810f870 0x7efc7811b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:58.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.329+0000 7efc80352640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc7811b650 con 0x7efc7810ed80 2024-09-21T09:02:58.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.329+0000 7efc80352640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7efc7811c830 con 0x7efc7810f870 2024-09-21T09:02:58.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.329+0000 7efc7d8ed640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efc7810f870 0x7efc7811b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:58.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.329+0000 7efc7e0ee640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efc7810ed80 0x7efc7810f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:35390/0 (socket says 172.21.15.178:35390) 2024-09-21T09:02:58.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.329+0000 7efc7e0ee640 1 -- 172.21.15.178:0/2752838486 learned_addr learned my addr 172.21.15.178:0/2752838486 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:02:58.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.330+0000 7efc7d8ed640 1 -- 172.21.15.178:0/2752838486 >> v1:172.21.15.44:6789/0 conn(0x7efc7810ed80 legacy=0x7efc7810f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:58.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.330+0000 7efc7d8ed640 1 -- 172.21.15.178:0/2752838486 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7811c9b0 con 0x7efc7810f870 2024-09-21T09:02:58.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.331+0000 7efc7d8ed640 1 --2- 172.21.15.178:0/2752838486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc7810f870 0x7efc7811b110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efc74009720 tx=0x7efc7402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77379603e7d72bb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:58.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.331+0000 7efc7d0ec640 1 -- 172.21.15.178:0/2752838486 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc74037070 con 0x7efc7810f870 2024-09-21T09:02:58.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.331+0000 7efc7d0ec640 1 -- 172.21.15.178:0/2752838486 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7402ad90 con 0x7efc7810f870 2024-09-21T09:02:58.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.331+0000 7efc7d0ec640 1 -- 172.21.15.178:0/2752838486 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc74032590 con 0x7efc7810f870 2024-09-21T09:02:58.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.331+0000 7efc80352640 1 -- 172.21.15.178:0/2752838486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc7810f870 msgr2=0x7efc7811b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:58.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.331+0000 7efc80352640 1 --2- 172.21.15.178:0/2752838486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc7810f870 0x7efc7811b110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efc74009720 tx=0x7efc7402a110 comp rx=0 tx=0).stop 2024-09-21T09:02:58.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.331+0000 7efc80352640 1 -- 172.21.15.178:0/2752838486 shutdown_connections 2024-09-21T09:02:58.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.331+0000 7efc80352640 1 --2- 172.21.15.178:0/2752838486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc7810f870 0x7efc7811b110 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:58.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.331+0000 7efc80352640 1 -- 172.21.15.178:0/2752838486 >> 172.21.15.178:0/2752838486 conn(0x7efc7806f300 msgr2=0x7efc78071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:58.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.331+0000 7efc80352640 1 -- 172.21.15.178:0/2752838486 shutdown_connections 2024-09-21T09:02:58.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.331+0000 7efc80352640 1 -- 172.21.15.178:0/2752838486 wait complete. 2024-09-21T09:02:58.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.332+0000 7efc80352640 1 Processor -- start 2024-09-21T09:02:58.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.332+0000 7efc80352640 1 -- start start 2024-09-21T09:02:58.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.332+0000 7efc80352640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc7810ed80 0x7efc781a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:58.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.332+0000 7efc80352640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efc7811bc70 con 0x7efc7810ed80 2024-09-21T09:02:58.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.333+0000 7efc7e0ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc7810ed80 0x7efc781a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:58.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.333+0000 7efc7e0ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc7810ed80 0x7efc781a4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:59956/0 (socket says 172.21.15.178:59956) 2024-09-21T09:02:58.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.333+0000 7efc7e0ee640 1 -- 172.21.15.178:0/306008211 learned_addr learned my addr 172.21.15.178:0/306008211 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:02:58.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.333+0000 7efc7e0ee640 1 -- 172.21.15.178:0/306008211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc781a4f60 con 0x7efc7810ed80 2024-09-21T09:02:58.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.333+0000 7efc7e0ee640 1 --2- 172.21.15.178:0/306008211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc7810ed80 0x7efc781a4990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00c340 tx=0x7efc6c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:58.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.333+0000 7efc6affd640 1 -- 172.21.15.178:0/306008211 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6c005c10 con 0x7efc7810ed80 2024-09-21T09:02:58.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.333+0000 7efc6affd640 1 -- 172.21.15.178:0/306008211 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6c005db0 con 0x7efc7810ed80 2024-09-21T09:02:58.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.333+0000 7efc6affd640 1 -- 172.21.15.178:0/306008211 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6c004930 con 0x7efc7810ed80 2024-09-21T09:02:58.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.333+0000 7efc80352640 1 -- 172.21.15.178:0/306008211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc781a51f0 con 0x7efc7810ed80 2024-09-21T09:02:58.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.333+0000 7efc80352640 1 -- 172.21.15.178:0/306008211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc781a92a0 con 0x7efc7810ed80 2024-09-21T09:02:58.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.334+0000 7efc80352640 1 -- 172.21.15.178:0/306008211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc7811c1b0 con 0x7efc7810ed80 2024-09-21T09:02:58.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.334+0000 7efc6affd640 1 -- 172.21.15.178:0/306008211 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efc6c01a020 con 0x7efc7810ed80 2024-09-21T09:02:58.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.335+0000 7efc6affd640 1 --2- 172.21.15.178:0/306008211 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efc5c038250 0x7efc5c03a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:58.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.335+0000 7efc6affd640 1 -- 172.21.15.178:0/306008211 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3856+0+0 (secure 0 0 0) 0x7efc6c04ab80 con 0x7efc7810ed80 2024-09-21T09:02:58.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.335+0000 7efc7d8ed640 1 --2- 172.21.15.178:0/306008211 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efc5c038250 0x7efc5c03a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:58.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.335+0000 7efc7d8ed640 1 --2- 172.21.15.178:0/306008211 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efc5c038250 0x7efc5c03a710 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efc74034000 tx=0x7efc7402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:58.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.340+0000 7efc6affd640 1 -- 172.21.15.178:0/306008211 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7efc6c0127f0 con 0x7efc7810ed80 2024-09-21T09:02:58.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:58.507+0000 7efc80352640 1 -- 172.21.15.178:0/306008211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7efc781a5420 con 0x7efc7810ed80 2024-09-21T09:02:59.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.196+0000 7efc6affd640 1 -- 172.21.15.178:0/306008211 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v19) ==== 169+0+0 (secure 0 0 0) 0x7efc6c012a50 con 0x7efc7810ed80 2024-09-21T09:02:59.199 INFO:teuthology.orchestra.run.smithi178.stderr:pool 'default.rgw.buckets.index' created 2024-09-21T09:02:59.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.200+0000 7efc80352640 1 -- 172.21.15.178:0/306008211 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efc5c038250 msgr2=0x7efc5c03a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:59.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.200+0000 7efc80352640 1 --2- 172.21.15.178:0/306008211 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efc5c038250 0x7efc5c03a710 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efc74034000 tx=0x7efc7402e000 comp rx=0 tx=0).stop 2024-09-21T09:02:59.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.200+0000 7efc80352640 1 -- 172.21.15.178:0/306008211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc7810ed80 msgr2=0x7efc781a4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:59.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.200+0000 7efc80352640 1 --2- 172.21.15.178:0/306008211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc7810ed80 0x7efc781a4990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00c340 tx=0x7efc6c001e70 comp rx=0 tx=0).stop 2024-09-21T09:02:59.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.201+0000 7efc80352640 1 -- 172.21.15.178:0/306008211 shutdown_connections 2024-09-21T09:02:59.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.201+0000 7efc80352640 1 --2- 172.21.15.178:0/306008211 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efc5c038250 0x7efc5c03a710 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:59.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.201+0000 7efc80352640 1 --2- 172.21.15.178:0/306008211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc7810ed80 0x7efc781a4990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:59.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.201+0000 7efc80352640 1 -- 172.21.15.178:0/306008211 >> 172.21.15.178:0/306008211 conn(0x7efc7806f300 msgr2=0x7efc7811ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:59.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.201+0000 7efc80352640 1 -- 172.21.15.178:0/306008211 shutdown_connections 2024-09-21T09:02:59.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.201+0000 7efc80352640 1 -- 172.21.15.178:0/306008211 wait complete. 2024-09-21T09:02:59.220 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-21T09:02:59.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.318+0000 7f8cc29f8640 1 Processor -- start 2024-09-21T09:02:59.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.318+0000 7f8cc29f8640 1 -- start start 2024-09-21T09:02:59.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.318+0000 7f8cc29f8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8cbc117a50 0x7f8cbc119e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:59.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.318+0000 7f8cc29f8640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cbc11a380 con 0x7f8cbc114c40 2024-09-21T09:02:59.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.318+0000 7f8cc29f8640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f8cbc11b560 con 0x7f8cbc117a50 2024-09-21T09:02:59.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.319+0000 7f8cbb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8cbc117a50 0x7f8cbc119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:59.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.319+0000 7f8cbb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8cbc117a50 0x7f8cbc119e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:59958/0 (socket says 172.21.15.178:59958) 2024-09-21T09:02:59.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.319+0000 7f8cbb7fe640 1 -- 172.21.15.178:0/2982800260 learned_addr learned my addr 172.21.15.178:0/2982800260 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:02:59.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.319+0000 7f8cbbfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8cbc114c40 0x7f8cbc115020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:35404/0 (socket says 172.21.15.178:35404) 2024-09-21T09:02:59.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.319+0000 7f8cbb7fe640 1 -- 172.21.15.178:0/2982800260 >> v1:172.21.15.44:6789/0 conn(0x7f8cbc114c40 legacy=0x7f8cbc115020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:59.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.319+0000 7f8cbb7fe640 1 -- 172.21.15.178:0/2982800260 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cbc11b6e0 con 0x7f8cbc117a50 2024-09-21T09:02:59.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.320+0000 7f8cbb7fe640 1 --2- 172.21.15.178:0/2982800260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cbc117a50 0x7f8cbc119e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000ba90 tx=0x7f8cb002c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136bef9ed8d1f689 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:59.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.320+0000 7f8cbaffd640 1 -- 172.21.15.178:0/2982800260 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cb0033570 con 0x7f8cbc117a50 2024-09-21T09:02:59.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.320+0000 7f8cbaffd640 1 -- 172.21.15.178:0/2982800260 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb0038070 con 0x7f8cbc117a50 2024-09-21T09:02:59.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.320+0000 7f8cbaffd640 1 -- 172.21.15.178:0/2982800260 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cb0033860 con 0x7f8cbc117a50 2024-09-21T09:02:59.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.320+0000 7f8cc29f8640 1 -- 172.21.15.178:0/2982800260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cbc117a50 msgr2=0x7f8cbc119e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:02:59.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.320+0000 7f8cc29f8640 1 --2- 172.21.15.178:0/2982800260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cbc117a50 0x7f8cbc119e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000ba90 tx=0x7f8cb002c8b0 comp rx=0 tx=0).stop 2024-09-21T09:02:59.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.321+0000 7f8cc29f8640 1 -- 172.21.15.178:0/2982800260 shutdown_connections 2024-09-21T09:02:59.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.321+0000 7f8cc29f8640 1 --2- 172.21.15.178:0/2982800260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cbc117a50 0x7f8cbc119e40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:02:59.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.321+0000 7f8cc29f8640 1 -- 172.21.15.178:0/2982800260 >> 172.21.15.178:0/2982800260 conn(0x7f8cbc06f300 msgr2=0x7f8cbc071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:02:59.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.321+0000 7f8cc29f8640 1 -- 172.21.15.178:0/2982800260 shutdown_connections 2024-09-21T09:02:59.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.321+0000 7f8cc29f8640 1 -- 172.21.15.178:0/2982800260 wait complete. 2024-09-21T09:02:59.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.321+0000 7f8cc29f8640 1 Processor -- start 2024-09-21T09:02:59.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.321+0000 7f8cc29f8640 1 -- start start 2024-09-21T09:02:59.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.322+0000 7f8cc29f8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cbc114c40 0x7f8cbc1a8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:59.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.322+0000 7f8cc29f8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc11aa70 con 0x7f8cbc114c40 2024-09-21T09:02:59.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.322+0000 7f8cbbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cbc114c40 0x7f8cbc1a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:59.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.322+0000 7f8cbbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cbc114c40 0x7f8cbc1a8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:59972/0 (socket says 172.21.15.178:59972) 2024-09-21T09:02:59.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.322+0000 7f8cbbfff640 1 -- 172.21.15.178:0/416400807 learned_addr learned my addr 172.21.15.178:0/416400807 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:02:59.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.322+0000 7f8cbbfff640 1 -- 172.21.15.178:0/416400807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cbc1a8930 con 0x7f8cbc114c40 2024-09-21T09:02:59.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.322+0000 7f8cbbfff640 1 --2- 172.21.15.178:0/416400807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cbc114c40 0x7f8cbc1a8360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00c380 tx=0x7f8cac00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:59.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.322+0000 7f8cb8ff9640 1 -- 172.21.15.178:0/416400807 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cac007410 con 0x7f8cbc114c40 2024-09-21T09:02:59.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.323+0000 7f8cb8ff9640 1 -- 172.21.15.178:0/416400807 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cac0075b0 con 0x7f8cbc114c40 2024-09-21T09:02:59.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.323+0000 7f8cb8ff9640 1 -- 172.21.15.178:0/416400807 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cac0047e0 con 0x7f8cbc114c40 2024-09-21T09:02:59.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.323+0000 7f8cc29f8640 1 -- 172.21.15.178:0/416400807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cbc1a8b60 con 0x7f8cbc114c40 2024-09-21T09:02:59.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.323+0000 7f8cc29f8640 1 -- 172.21.15.178:0/416400807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cbc1a2470 con 0x7f8cbc114c40 2024-09-21T09:02:59.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.324+0000 7f8cc29f8640 1 -- 172.21.15.178:0/416400807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cbc11afb0 con 0x7f8cbc114c40 2024-09-21T09:02:59.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.324+0000 7f8cb8ff9640 1 -- 172.21.15.178:0/416400807 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8cac01a020 con 0x7f8cbc114c40 2024-09-21T09:02:59.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.324+0000 7f8cb8ff9640 1 --2- 172.21.15.178:0/416400807 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ca8038250 0x7f8ca803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:02:59.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.324+0000 7f8cb8ff9640 1 -- 172.21.15.178:0/416400807 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4220+0+0 (secure 0 0 0) 0x7f8cac04acf0 con 0x7f8cbc114c40 2024-09-21T09:02:59.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.324+0000 7f8cbb7fe640 1 --2- 172.21.15.178:0/416400807 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ca8038250 0x7f8ca803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:02:59.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.324+0000 7f8cbb7fe640 1 --2- 172.21.15.178:0/416400807 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ca8038250 0x7f8ca803a710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0037000 tx=0x7f8cb0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:02:59.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.329+0000 7f8cb8ff9640 1 -- 172.21.15.178:0/416400807 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8cac01bc30 con 0x7f8cbc114c40 2024-09-21T09:02:59.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:02:59.496+0000 7f8cc29f8640 1 -- 172.21.15.178:0/416400807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f8cbc117a50 con 0x7f8cbc114c40 2024-09-21T09:03:00.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:00.198+0000 7f8cb8ff9640 1 -- 172.21.15.178:0/416400807 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v20) ==== 187+0+0 (secure 0 0 0) 0x7f8cac0138d0 con 0x7f8cbc114c40 2024-09-21T09:03:00.200 INFO:teuthology.orchestra.run.smithi178.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-21T09:03:00.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:00.201+0000 7f8cc29f8640 1 -- 172.21.15.178:0/416400807 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ca8038250 msgr2=0x7f8ca803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:00.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:00.201+0000 7f8cc29f8640 1 --2- 172.21.15.178:0/416400807 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ca8038250 0x7f8ca803a710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0037000 tx=0x7f8cb0032000 comp rx=0 tx=0).stop 2024-09-21T09:03:00.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:00.201+0000 7f8cc29f8640 1 -- 172.21.15.178:0/416400807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cbc114c40 msgr2=0x7f8cbc1a8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:00.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:00.201+0000 7f8cc29f8640 1 --2- 172.21.15.178:0/416400807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cbc114c40 0x7f8cbc1a8360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00c380 tx=0x7f8cac00c840 comp rx=0 tx=0).stop 2024-09-21T09:03:00.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:00.202+0000 7f8cc29f8640 1 -- 172.21.15.178:0/416400807 shutdown_connections 2024-09-21T09:03:00.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:00.202+0000 7f8cc29f8640 1 --2- 172.21.15.178:0/416400807 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ca8038250 0x7f8ca803a710 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:00.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:00.202+0000 7f8cc29f8640 1 --2- 172.21.15.178:0/416400807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cbc114c40 0x7f8cbc1a8360 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:00.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:00.202+0000 7f8cc29f8640 1 -- 172.21.15.178:0/416400807 >> 172.21.15.178:0/416400807 conn(0x7f8cbc06f300 msgr2=0x7f8cbc1166e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:00.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:00.202+0000 7f8cc29f8640 1 -- 172.21.15.178:0/416400807 shutdown_connections 2024-09-21T09:03:00.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:00.202+0000 7f8cc29f8640 1 -- 172.21.15.178:0/416400807 wait complete. 2024-09-21T09:03:00.233 DEBUG:tasks.rgw:Pools created 2024-09-21T09:03:00.234 INFO:tasks.rgw:Starting rgw... 2024-09-21T09:03:00.234 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-21T09:03:00.234 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-21T09:03:00.234 DEBUG:teuthology.orchestra.run.smithi178:> sudo echo -n http://smithi178.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-21T09:03:00.262 INFO:teuthology.orchestra.run.smithi178.stdout:http://smithi178.front.sepia.ceph.com:80 2024-09-21T09:03:00.263 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-21T09:03:00.329 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-21T09:03:00.329 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-21T09:03:00.371 INFO:tasks.rgw.client.0:Started 2024-09-21T09:03:00.371 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi178.front.sepia.ceph.com:80/ 2024-09-21T09:03:00.371 DEBUG:teuthology.orchestra.run.smithi178:> curl http://smithi178.front.sepia.ceph.com:80/ 2024-09-21T09:03:00.399 INFO:teuthology.orchestra.run.smithi178.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T09:03:00.399 INFO:teuthology.orchestra.run.smithi178.stderr: Dload Upload Total Spent Left Speed 2024-09-21T09:03:00.399 INFO:teuthology.orchestra.run.smithi178.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-21T09:03:00.400 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-21T09:03:00.400 INFO:teuthology.orchestra.run.smithi178.stderr:curl: (7) Failed to connect to smithi178.front.sepia.ceph.com port 80: Connection refused 2024-09-21T09:03:01.402 DEBUG:teuthology.orchestra.run.smithi178:> curl http://smithi178.front.sepia.ceph.com:80/ 2024-09-21T09:03:01.424 INFO:teuthology.orchestra.run.smithi178.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T09:03:01.424 INFO:teuthology.orchestra.run.smithi178.stderr: Dload Upload Total Spent Left Speed 2024-09-21T09:03:01.424 INFO:teuthology.orchestra.run.smithi178.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-21T09:03:01.425 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-21T09:03:01.425 INFO:teuthology.orchestra.run.smithi178.stderr:curl: (7) Failed to connect to smithi178.front.sepia.ceph.com port 80: Connection refused 2024-09-21T09:03:03.427 DEBUG:teuthology.orchestra.run.smithi178:> curl http://smithi178.front.sepia.ceph.com:80/ 2024-09-21T09:03:03.450 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-21T09:03:03.450 INFO:teuthology.orchestra.run.smithi178.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T09:03:03.450 INFO:teuthology.orchestra.run.smithi178.stderr: Dload Upload Total Spent Left Speed 2024-09-21T09:03:03.450 INFO:teuthology.orchestra.run.smithi178.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-21T09:03:03.450 INFO:teuthology.orchestra.run.smithi178.stderr:curl: (7) Failed to connect to smithi178.front.sepia.ceph.com port 80: Connection refused 2024-09-21T09:03:07.451 DEBUG:teuthology.orchestra.run.smithi178:> curl http://smithi178.front.sepia.ceph.com:80/ 2024-09-21T09:03:07.475 INFO:teuthology.orchestra.run.smithi178.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T09:03:07.475 INFO:teuthology.orchestra.run.smithi178.stderr: Dload Upload Total Spent Left Speed 2024-09-21T09:03:07.475 INFO:teuthology.orchestra.run.smithi178.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-21T09:03:07.475 INFO:teuthology.orchestra.run.smithi178.stderr:curl: (7) Failed to connect to smithi178.front.sepia.ceph.com port 80: Connection refused 2024-09-21T09:03:07.476 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-21T09:03:09.329 INFO:tasks.rgw.client.0.smithi178.stdout:2024-09-21T09:03:09.327+0000 7f6696ec4880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-21T09:03:15.477 DEBUG:teuthology.orchestra.run.smithi178:> curl http://smithi178.front.sepia.ceph.com:80/ 2024-09-21T09:03:15.500 INFO:teuthology.orchestra.run.smithi178.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T09:03:15.500 INFO:teuthology.orchestra.run.smithi178.stderr: Dload Upload Total Spent Left Speed 2024-09-21T09:03:15.502 INFO:teuthology.orchestra.run.smithi178.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-21T09:03:15.502 INFO:teuthology.orchestra.run.smithi178.stdout:anonymous 2024-09-21T09:03:15.502 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-21T09:03:15.575 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-21T09:03:15.575 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-21T09:03:15.576 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-21T09:03:15.576 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-21T09:03:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:15.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.624+0000 7f17cbb26800 1 Processor -- start 2024-09-21T09:03:15.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.624+0000 7f17cbb26800 1 -- start start 2024-09-21T09:03:15.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.624+0000 7f17cbb26800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5628beb0dde0 0x5628beb9f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.625+0000 7f17cbb26800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5628bea59b30 con 0x5628beb9fb10 2024-09-21T09:03:15.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.625+0000 7f17cbb26800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5628bea3b360 con 0x5628beb0dde0 2024-09-21T09:03:15.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.625+0000 7f17c7713640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5628beb0dde0 0x5628beb9f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.625+0000 7f17c7713640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5628beb0dde0 0x5628beb9f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55492/0 (socket says 172.21.15.178:55492) 2024-09-21T09:03:15.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.625+0000 7f17c7713640 1 -- 172.21.15.178:0/965451831 learned_addr learned my addr 172.21.15.178:0/965451831 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.625+0000 7f17c7713640 1 -- 172.21.15.178:0/965451831 >> v1:172.21.15.44:6789/0 conn(0x5628beb9fb10 legacy=0x5628beba1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.625+0000 7f17c6f12640 1 -- 172.21.15.178:0/965451831 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 355184355 0 0) 0x5628bea59b30 con 0x5628beb9fb10 2024-09-21T09:03:15.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.625+0000 7f17c7713640 1 -- 172.21.15.178:0/965451831 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628bea61e00 con 0x5628beb0dde0 2024-09-21T09:03:15.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.627+0000 7f17c7713640 1 --2- 172.21.15.178:0/965451831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628beb9f5d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f17b800a520 tx=0x7f17b8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba79b96a31357cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.628+0000 7f17c6f12640 1 -- 172.21.15.178:0/965451831 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17b8055070 con 0x5628beb0dde0 2024-09-21T09:03:15.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.628+0000 7f17c6f12640 1 -- 172.21.15.178:0/965451831 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b80515b0 con 0x5628beb0dde0 2024-09-21T09:03:15.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.628+0000 7f17c6f12640 1 -- 172.21.15.178:0/965451831 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17b80518d0 con 0x5628beb0dde0 2024-09-21T09:03:15.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.628+0000 7f17cbb26800 1 -- 172.21.15.178:0/965451831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 msgr2=0x5628beb9f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.628+0000 7f17cbb26800 1 --2- 172.21.15.178:0/965451831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628beb9f5d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f17b800a520 tx=0x7f17b8045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.628+0000 7f17cbb26800 1 -- 172.21.15.178:0/965451831 shutdown_connections 2024-09-21T09:03:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.628+0000 7f17cbb26800 1 --2- 172.21.15.178:0/965451831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628beb9f5d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.628+0000 7f17cbb26800 1 -- 172.21.15.178:0/965451831 >> 172.21.15.178:0/965451831 conn(0x5628beb94de0 msgr2=0x5628beb97200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.628+0000 7f17cbb26800 1 -- 172.21.15.178:0/965451831 shutdown_connections 2024-09-21T09:03:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.628+0000 7f17cbb26800 1 -- 172.21.15.178:0/965451831 wait complete. 2024-09-21T09:03:15.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.644+0000 7f17cbb26800 1 Processor -- start 2024-09-21T09:03:15.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.644+0000 7f17cbb26800 1 -- start start 2024-09-21T09:03:15.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.644+0000 7f17cbb26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628bec8b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.644+0000 7f17cbb26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5628beae6320 con 0x5628beb0dde0 2024-09-21T09:03:15.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.645+0000 7f17c7713640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628bec8b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.645+0000 7f17c7713640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628bec8b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55504/0 (socket says 172.21.15.178:55504) 2024-09-21T09:03:15.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.645+0000 7f17c7713640 1 -- 172.21.15.178:0/2824647794 learned_addr learned my addr 172.21.15.178:0/2824647794 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.645+0000 7f17c7713640 1 -- 172.21.15.178:0/2824647794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628bea33bc0 con 0x5628beb0dde0 2024-09-21T09:03:15.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.645+0000 7f17c7713640 1 --2- 172.21.15.178:0/2824647794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628bec8b860 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f17b8000c00 tx=0x7f17b8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a708fb67e1415af1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.645+0000 7f16b560a640 1 -- 172.21.15.178:0/2824647794 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17b80519d0 con 0x5628beb0dde0 2024-09-21T09:03:15.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.645+0000 7f16b560a640 1 -- 172.21.15.178:0/2824647794 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b8051b70 con 0x5628beb0dde0 2024-09-21T09:03:15.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.645+0000 7f16b560a640 1 -- 172.21.15.178:0/2824647794 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17b8051e50 con 0x5628beb0dde0 2024-09-21T09:03:15.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.646+0000 7f17cbb26800 1 -- 172.21.15.178:0/2824647794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 msgr2=0x5628bec8b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.646+0000 7f17cbb26800 1 --2- 172.21.15.178:0/2824647794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628bec8b860 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f17b8000c00 tx=0x7f17b8051000 comp rx=0 tx=0).stop 2024-09-21T09:03:15.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.646+0000 7f17cbb26800 1 -- 172.21.15.178:0/2824647794 shutdown_connections 2024-09-21T09:03:15.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.646+0000 7f17cbb26800 1 --2- 172.21.15.178:0/2824647794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628bec8b860 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.646+0000 7f17cbb26800 1 -- 172.21.15.178:0/2824647794 >> 172.21.15.178:0/2824647794 conn(0x5628beb94de0 msgr2=0x5628bec87220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.646+0000 7f17cbb26800 1 -- 172.21.15.178:0/2824647794 shutdown_connections 2024-09-21T09:03:15.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.646+0000 7f17cbb26800 1 -- 172.21.15.178:0/2824647794 wait complete. 2024-09-21T09:03:15.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.647+0000 7f17cbb26800 1 Processor -- start 2024-09-21T09:03:15.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.647+0000 7f17cbb26800 1 -- start start 2024-09-21T09:03:15.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.647+0000 7f17cbb26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628bec93070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.647+0000 7f17cbb26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5628beba38f0 con 0x5628beb0dde0 2024-09-21T09:03:15.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.647+0000 7f17c7713640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628bec93070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.647+0000 7f17c7713640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628bec93070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55510/0 (socket says 172.21.15.178:55510) 2024-09-21T09:03:15.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.647+0000 7f17c7713640 1 -- 172.21.15.178:0/3315898762 learned_addr learned my addr 172.21.15.178:0/3315898762 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.648+0000 7f17c7713640 1 -- 172.21.15.178:0/3315898762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628bea47fe0 con 0x5628beb0dde0 2024-09-21T09:03:15.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.648+0000 7f17c7713640 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628bec93070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f17b800a520 tx=0x7f17b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.648+0000 7f16b3e07640 1 -- 172.21.15.178:0/3315898762 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17b8073070 con 0x5628beb0dde0 2024-09-21T09:03:15.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.648+0000 7f16b3e07640 1 -- 172.21.15.178:0/3315898762 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b805a580 con 0x5628beb0dde0 2024-09-21T09:03:15.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.648+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628bec935b0 con 0x5628beb0dde0 2024-09-21T09:03:15.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.648+0000 7f16b3e07640 1 -- 172.21.15.178:0/3315898762 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17b805a8a0 con 0x5628beb0dde0 2024-09-21T09:03:15.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.648+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628bec93b30 con 0x5628beb0dde0 2024-09-21T09:03:15.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.649+0000 7f16b3e07640 1 -- 172.21.15.178:0/3315898762 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f17b8076070 con 0x5628beb0dde0 2024-09-21T09:03:15.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.649+0000 7f16b3e07640 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f16ac036b40 0x7f16ac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.649+0000 7f16b3e07640 1 -- 172.21.15.178:0/3315898762 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f17b8062070 con 0x5628beb0dde0 2024-09-21T09:03:15.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.649+0000 7f17cbb26800 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5628beb9fb10 0x5628bec9a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.649+0000 7f17bef12640 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f16ac036b40 0x7f16ac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.649+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628bec9a6e0 con 0x5628beb9fb10 2024-09-21T09:03:15.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.650+0000 7f17c7f14640 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5628beb9fb10 0x5628bec9a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.650+0000 7f17bef12640 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f16ac036b40 0x7f16ac039000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f17b0000f60 tx=0x7f17b00013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.650+0000 7f17c7f14640 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5628beb9fb10 0x5628bec9a0e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.650+0000 7f17c7f14640 1 -- 172.21.15.178:0/3315898762 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17c000a4a0 con 0x5628beb9fb10 2024-09-21T09:03:15.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.650+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628bec97670 con 0x5628beb9fb10 2024-09-21T09:03:15.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.650+0000 7f17c7f14640 1 -- 172.21.15.178:0/3315898762 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17c000a4a0 con 0x5628beb9fb10 2024-09-21T09:03:15.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.651+0000 7f17cbb26800 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5628bec9c9f0 0x5628bec9ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.651+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628bec9f480 con 0x5628bec9c9f0 2024-09-21T09:03:15.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.651+0000 7f17c7713640 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5628bec9c9f0 0x5628bec9ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.651+0000 7f17c7713640 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5628bec9c9f0 0x5628bec9ede0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.652+0000 7f17c7713640 1 -- 172.21.15.178:0/3315898762 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f17b807f070 con 0x5628bec9c9f0 2024-09-21T09:03:15.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.652+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628bec9b890 con 0x5628beb9fb10 2024-09-21T09:03:15.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.652+0000 7f17c7f14640 1 -- 172.21.15.178:0/3315898762 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f17c000a4a0 con 0x5628beb9fb10 2024-09-21T09:03:15.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.652+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628bec9bcf0 con 0x5628beb9fb10 2024-09-21T09:03:15.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.652+0000 7f17c7f14640 1 -- 172.21.15.178:0/3315898762 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f17c000a4a0 con 0x5628beb9fb10 2024-09-21T09:03:15.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.653+0000 7f17cbb26800 1 Processor -- start 2024-09-21T09:03:15.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.653+0000 7f17cbb26800 1 -- start start 2024-09-21T09:03:15.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.653+0000 7f17cbb26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becade00 0x5628becae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.653+0000 7f17cbb26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5628bea35580 con 0x5628becade00 2024-09-21T09:03:15.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.653+0000 7f17c7f14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becade00 0x5628becae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.653+0000 7f17c7f14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becade00 0x5628becae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55518/0 (socket says 172.21.15.178:55518) 2024-09-21T09:03:15.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.653+0000 7f17c7f14640 1 -- 172.21.15.178:0/2443588463 learned_addr learned my addr 172.21.15.178:0/2443588463 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.653+0000 7f17c7f14640 1 -- 172.21.15.178:0/2443588463 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628becae760 con 0x5628becade00 2024-09-21T09:03:15.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.654+0000 7f17c7f14640 1 --2- 172.21.15.178:0/2443588463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becade00 0x5628becae220 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5628bec9aac0 tx=0x7f17c0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.654+0000 7f16b1602640 1 -- 172.21.15.178:0/2443588463 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c0014450 con 0x5628becade00 2024-09-21T09:03:15.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.654+0000 7f16b1602640 1 -- 172.21.15.178:0/2443588463 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c0014610 con 0x5628becade00 2024-09-21T09:03:15.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.654+0000 7f17cbb26800 1 -- 172.21.15.178:0/2443588463 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628becae9f0 con 0x5628becade00 2024-09-21T09:03:15.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.654+0000 7f16b1602640 1 -- 172.21.15.178:0/2443588463 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c0014930 con 0x5628becade00 2024-09-21T09:03:15.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.654+0000 7f17cbb26800 1 -- 172.21.15.178:0/2443588463 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628becb16d0 con 0x5628becade00 2024-09-21T09:03:15.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.655+0000 7f16b1602640 1 -- 172.21.15.178:0/2443588463 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f17c0011040 con 0x5628becade00 2024-09-21T09:03:15.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.655+0000 7f16b1602640 1 --2- 172.21.15.178:0/2443588463 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f16a0036b90 0x7f16a0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.655+0000 7f16b1602640 1 -- 172.21.15.178:0/2443588463 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f17c001e070 con 0x5628becade00 2024-09-21T09:03:15.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.655+0000 7f17c7713640 1 --2- 172.21.15.178:0/2443588463 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f16a0036b90 0x7f16a0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.655+0000 7f17cbb26800 1 Processor -- start 2024-09-21T09:03:15.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.655+0000 7f17cbb26800 1 -- start start 2024-09-21T09:03:15.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.655+0000 7f17c7713640 1 --2- 172.21.15.178:0/2443588463 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f16a0036b90 0x7f16a0039050 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x5628bec9aaf0 tx=0x7f17b808f220 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.655+0000 7f17cbb26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becbaa80 0x5628becbae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.655+0000 7f17cbb26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5628bec8bf50 con 0x5628becbaa80 2024-09-21T09:03:15.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.656+0000 7f17c7f14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becbaa80 0x5628becbae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.656+0000 7f17c7f14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becbaa80 0x5628becbae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55524/0 (socket says 172.21.15.178:55524) 2024-09-21T09:03:15.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.656+0000 7f17c7f14640 1 -- 172.21.15.178:0/3172018702 learned_addr learned my addr 172.21.15.178:0/3172018702 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.656+0000 7f17c7f14640 1 -- 172.21.15.178:0/3172018702 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628becbb450 con 0x5628becbaa80 2024-09-21T09:03:15.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.656+0000 7f17c7f14640 1 --2- 172.21.15.178:0/3172018702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becbaa80 0x5628becbae80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f17c004cb90 tx=0x7f17c0011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db762eb4ea3777c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.656+0000 7f16aaffd640 1 -- 172.21.15.178:0/3172018702 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c0044070 con 0x5628becbaa80 2024-09-21T09:03:15.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.656+0000 7f16aaffd640 1 -- 172.21.15.178:0/3172018702 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c0014ad0 con 0x5628becbaa80 2024-09-21T09:03:15.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.656+0000 7f16aaffd640 1 -- 172.21.15.178:0/3172018702 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c004e0d0 con 0x5628becbaa80 2024-09-21T09:03:15.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.657+0000 7f17cbb26800 1 -- 172.21.15.178:0/3172018702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becbaa80 msgr2=0x5628becbae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.657+0000 7f17cbb26800 1 --2- 172.21.15.178:0/3172018702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becbaa80 0x5628becbae80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f17c004cb90 tx=0x7f17c0011700 comp rx=0 tx=0).stop 2024-09-21T09:03:15.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.657+0000 7f17cbb26800 1 -- 172.21.15.178:0/3172018702 shutdown_connections 2024-09-21T09:03:15.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.657+0000 7f17cbb26800 1 --2- 172.21.15.178:0/3172018702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becbaa80 0x5628becbae80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.657+0000 7f17cbb26800 1 -- 172.21.15.178:0/3172018702 >> 172.21.15.178:0/3172018702 conn(0x5628becb6de0 msgr2=0x5628becb4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.657+0000 7f17cbb26800 1 -- 172.21.15.178:0/3172018702 shutdown_connections 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.657+0000 7f17cbb26800 1 -- 172.21.15.178:0/3172018702 wait complete. 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.657+0000 7f17cbb26800 1 Processor -- start 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.657+0000 7f17cbb26800 1 -- start start 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.657+0000 7f17cbb26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becbaa80 0x5628becc1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.657+0000 7f17cbb26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5628becbbb00 con 0x5628becbaa80 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.658+0000 7f17c7f14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becbaa80 0x5628becc1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.658+0000 7f17c7f14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becbaa80 0x5628becc1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55540/0 (socket says 172.21.15.178:55540) 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.658+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 learned_addr learned my addr 172.21.15.178:0/1336028943 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.658+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628becc2450 con 0x5628becbaa80 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.658+0000 7f17c7f14640 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becbaa80 0x5628becc1f10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f17c0016ad0 tx=0x7f17c004cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.658+0000 7f16a97fa640 1 -- 172.21.15.178:0/1336028943 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c0016440 con 0x5628becbaa80 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.658+0000 7f16a97fa640 1 -- 172.21.15.178:0/1336028943 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c0014c80 con 0x5628becbaa80 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.658+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628becc26e0 con 0x5628becbaa80 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.658+0000 7f16a97fa640 1 -- 172.21.15.178:0/1336028943 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c002b690 con 0x5628becbaa80 2024-09-21T09:03:15.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.659+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628becc5390 con 0x5628becbaa80 2024-09-21T09:03:15.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.659+0000 7f16a97fa640 1 -- 172.21.15.178:0/1336028943 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f17c003e020 con 0x5628becbaa80 2024-09-21T09:03:15.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.660+0000 7f16a97fa640 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1690036b90 0x7f1690039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.660+0000 7f16a97fa640 1 -- 172.21.15.178:0/1336028943 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f17c003c020 con 0x5628becbaa80 2024-09-21T09:03:15.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.660+0000 7f17c7713640 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1690036b90 0x7f1690039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.660+0000 7f17cbb26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.660+0000 7f17cbb26800 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5628beccdbe0 0x5628becd00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.660+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628becd07f0 con 0x5628beccdbe0 2024-09-21T09:03:15.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.660+0000 7f17bef12640 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5628beccdbe0 0x5628becd00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.660+0000 7f17c7713640 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1690036b90 0x7f1690039050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f17b8051e30 tx=0x7f17b8091000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.660+0000 7f17bef12640 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5628beccdbe0 0x5628becd00a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17b0010510 con 0x5628beccdbe0 2024-09-21T09:03:15.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 20 realm 2024-09-21T09:03:15.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628beccd030 con 0x5628beccdbe0 2024-09-21T09:03:15.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17b0010510 con 0x5628beccdbe0 2024-09-21T09:03:15.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:15.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628becd12d0 con 0x5628beccdbe0 2024-09-21T09:03:15.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17b0010510 con 0x5628beccdbe0 2024-09-21T09:03:15.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628becd1ba0 con 0x5628beccdbe0 2024-09-21T09:03:15.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17b0010510 con 0x5628beccdbe0 2024-09-21T09:03:15.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:15.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5628becd24a0 0x5628becd4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.661+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd24a0 2024-09-21T09:03:15.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.662+0000 7f17c7f14640 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5628becd24a0 0x5628becd4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.662+0000 7f17c7f14640 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5628becd24a0 0x5628becd4890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.662+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.663+0000 7f17cbb26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.663+0000 7f17cbb26800 20 searching for the correct realm 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.663+0000 7f17cbb26800 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5628becd70a0 0x5628becd9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.663+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd9c30 con 0x5628becd70a0 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.663+0000 7f17c7713640 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5628becd70a0 0x5628becd9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.663+0000 7f17c7713640 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5628becd70a0 0x5628becd9560 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.663+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.663+0000 7f17c7713640 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f17b8078070 0x7f17b8004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.663+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd9c30 con 0x7f17b8078070 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.663+0000 7f17bef12640 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f17b8078070 0x7f17b8004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.664+0000 7f17bef12640 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f17b8078070 0x7f17b8004280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.664+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b0010510 con 0x7f17b8078070 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.664+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd9c30 con 0x5628becd24a0 2024-09-21T09:03:15.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.664+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.664+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628beccdbe0 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.665+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b0010510 con 0x5628beccdbe0 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.665+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628beccdbe0 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.665+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.665+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd24a0 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.665+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.665+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd24a0 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.666+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.666+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x7f17b8078070 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.666+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.666+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd70a0 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.666+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.666+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628beccdbe0 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.666+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.666+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd24a0 2024-09-21T09:03:15.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.667+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.667+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628beccdbe0 2024-09-21T09:03:15.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.667+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.667+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x7f17b8078070 2024-09-21T09:03:15.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.667+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.667+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd70a0 2024-09-21T09:03:15.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.667+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.667+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd70a0 2024-09-21T09:03:15.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.668+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.668+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd24a0 2024-09-21T09:03:15.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.668+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.668+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd70a0 2024-09-21T09:03:15.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.668+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.668+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd70a0 2024-09-21T09:03:15.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.669+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.669+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628beccdbe0 2024-09-21T09:03:15.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.669+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.669+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628beccdbe0 2024-09-21T09:03:15.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.669+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.669+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd24a0 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.670+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.670+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd70a0 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.670+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.670+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x7f17b8078070 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.670+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.670+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628beccdbe0 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.670+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.670+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd24a0 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.671+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.671+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd70a0 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.671+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.671+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd24a0 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.671+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.671+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x7f17b8078070 2024-09-21T09:03:15.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.672+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.672+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd70a0 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.672+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.672+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628becd24a0 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.672+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.672+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x5628beccdbe0 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd4ff0 con 0x7f17b8078070 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17cbb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17cbb26800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17cbb26800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17cbb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17cbb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17cbb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:15.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17cbb26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628becd59a0 con 0x5628beccdbe0 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17cbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17cbb26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628becd5d90 con 0x5628beccdbe0 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17cbb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17cbb26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.673+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628becd61b0 con 0x5628beccdbe0 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 20 zone default found 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 4 Realm: () 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:15.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 20 zonegroup default 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628becd24a0 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628becdbf40 con 0x5628becd70a0 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.674+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628becdc2e0 con 0x5628becd70a0 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.675+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.675+0000 7f17cbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.675+0000 7f17cbb26800 20 started sync module instance, tier type = 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.675+0000 7f17cbb26800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:15.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.675+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdb380 con 0x7f17b8078070 2024-09-21T09:03:15.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.676+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.676+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94732999833456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdb380 con 0x7f17b8078070 2024-09-21T09:03:15.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.676+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdcca0 con 0x5628beccdbe0 2024-09-21T09:03:15.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.677+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94732999833456] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.677+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.677+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94732999831728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdcca0 con 0x5628beccdbe0 2024-09-21T09:03:15.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.677+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdd660 con 0x5628becd70a0 2024-09-21T09:03:15.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.679+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94732999831728] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.679+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.679+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94732999837680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdcc10 con 0x5628becd70a0 2024-09-21T09:03:15.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.679+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becde520 con 0x7f17b8078070 2024-09-21T09:03:15.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.680+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.680+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94732999844432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdeca0 con 0x7f17b8078070 2024-09-21T09:03:15.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.680+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdf7c0 con 0x5628beccdbe0 2024-09-21T09:03:15.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.680+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94732999837680] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.682+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.682+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94732999844432] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.682+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94732999848592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdf780 con 0x5628beccdbe0 2024-09-21T09:03:15.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.682+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdfd20 con 0x5628becd24a0 2024-09-21T09:03:15.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.683+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.683+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94732999845616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628bece01d0 con 0x5628becd24a0 2024-09-21T09:03:15.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.683+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628bece0c10 con 0x5628becd24a0 2024-09-21T09:03:15.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.683+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94732999848592] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.685+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94732999845616] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.688+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.688+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94732999853792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdfd60 con 0x5628becd24a0 2024-09-21T09:03:15.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.688+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628bece12a0 con 0x5628becd24a0 2024-09-21T09:03:15.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.691+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94732999853792] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.691+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.691+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94732999842384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628bece12a0 con 0x5628becd24a0 2024-09-21T09:03:15.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.691+0000 7f17cbb26800 20 add_watcher() i=0 2024-09-21T09:03:15.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.691+0000 7f17cbb26800 20 add_watcher() i=1 2024-09-21T09:03:15.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.691+0000 7f17cbb26800 20 add_watcher() i=2 2024-09-21T09:03:15.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.691+0000 7f17cbb26800 20 add_watcher() i=3 2024-09-21T09:03:15.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.691+0000 7f17cbb26800 20 add_watcher() i=4 2024-09-21T09:03:15.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.691+0000 7f17cbb26800 20 add_watcher() i=5 2024-09-21T09:03:15.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.691+0000 7f17cbb26800 20 add_watcher() i=6 2024-09-21T09:03:15.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.694+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94732999842384] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.694+0000 7f17cbb26800 20 add_watcher() i=7 2024-09-21T09:03:15.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.694+0000 7f17cbb26800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:15.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.694+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5628bece44a0 con 0x5628beccdbe0 2024-09-21T09:03:15.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.695+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.695+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94732999867984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628bece12a0 con 0x5628beccdbe0 2024-09-21T09:03:15.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.696+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94732999867984] v29'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.696+0000 7f167dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:15.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.696+0000 7f17cbb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:15.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.696+0000 7f17cbb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:15.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.696+0000 7f17cbb26800 5 note: GC not initialized 2024-09-21T09:03:15.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.696+0000 7f167cfe1640 20 reqs_thread_entry: start 2024-09-21T09:03:15.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.696+0000 7f17cbb26800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:15.699 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.696+0000 7f17cbb26800 20 Filter name: none 2024-09-21T09:03:15.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.697+0000 7f15f67fc640 20 reqs_thread_entry: start 2024-09-21T09:03:15.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.697+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628bed16fa0 con 0x5628becd70a0 2024-09-21T09:03:15.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.697+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.697+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628bed16fa0 con 0x5628becd70a0 2024-09-21T09:03:15.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.697+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(63 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.697+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628bed16fa0 con 0x5628beccdbe0 2024-09-21T09:03:15.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.697+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.697+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd5d90 con 0x5628beccdbe0 2024-09-21T09:03:15.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.698+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.698+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd5d90 con 0x7f17b8078070 2024-09-21T09:03:15.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.698+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.698+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd5d90 con 0x5628becd70a0 2024-09-21T09:03:15.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.698+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.698+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd5d90 con 0x5628beccdbe0 2024-09-21T09:03:15.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.698+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.698+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd5d90 con 0x5628becd70a0 2024-09-21T09:03:15.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.699+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.699+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd5d90 con 0x7f17b8078070 2024-09-21T09:03:15.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.699+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.699+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd5d90 con 0x5628becd70a0 2024-09-21T09:03:15.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.699+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.699+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd5d90 con 0x5628beccdbe0 2024-09-21T09:03:15.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.699+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.699+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd5d90 con 0x5628becd24a0 2024-09-21T09:03:15.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.700+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.700+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628becd24a0 2024-09-21T09:03:15.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.700+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(74 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.700+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628becd70a0 2024-09-21T09:03:15.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.700+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.700+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628becd24a0 2024-09-21T09:03:15.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.701+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(76 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.701+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628becd24a0 2024-09-21T09:03:15.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.701+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(77 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.701+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628becd24a0 2024-09-21T09:03:15.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.701+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(78 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.701+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628becd70a0 2024-09-21T09:03:15.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.702+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(79 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.702+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x7f17b8078070 2024-09-21T09:03:15.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.702+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(80 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.702+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628beccdbe0 2024-09-21T09:03:15.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.702+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(81 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.702+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628beccdbe0 2024-09-21T09:03:15.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.702+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(82 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.702+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628becd70a0 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.703+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(83 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.703+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x7f17b8078070 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.703+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(84 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.703+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628becd24a0 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.703+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(85 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.703+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628beccdbe0 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.703+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(86 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.703+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628becd24a0 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.704+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(87 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.704+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628becd70a0 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.704+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(88 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.704+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x7f17b8078070 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.704+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(89 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.704+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628becd24a0 2024-09-21T09:03:15.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.705+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(90 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.705+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628beccdbe0 2024-09-21T09:03:15.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.705+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(91 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.705+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x5628becd70a0 2024-09-21T09:03:15.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.705+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(92 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.705+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5628becd65e0 con 0x7f17b8078070 2024-09-21T09:03:15.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.705+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(93 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.706+0000 7f167dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:15.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.706+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94732999867984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becd5d90 con 0x5628beccdbe0 2024-09-21T09:03:15.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.707+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94732999867984] v29'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.707+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94732999833456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becd5d90 con 0x7f17b8078070 2024-09-21T09:03:15.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.708+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94732999833456] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.708+0000 7f17cbb26800 20 remove_watcher() i=0 2024-09-21T09:03:15.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.708+0000 7f17cbb26800 2 removed watcher, disabling cache 2024-09-21T09:03:15.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.708+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94732999831728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becd5d90 con 0x5628beccdbe0 2024-09-21T09:03:15.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.709+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94732999831728] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.709+0000 7f17cbb26800 20 remove_watcher() i=1 2024-09-21T09:03:15.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.709+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94732999837680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becd5d90 con 0x5628becd70a0 2024-09-21T09:03:15.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.712+0000 7f17c7713640 1 -- 172.21.15.178:0/1336028943 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94732999837680] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b809a040 con 0x5628becd70a0 2024-09-21T09:03:15.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.712+0000 7f17cbb26800 20 remove_watcher() i=2 2024-09-21T09:03:15.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.712+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94732999844432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdb770 con 0x7f17b8078070 2024-09-21T09:03:15.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.713+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94732999844432] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x7f17b8078070 2024-09-21T09:03:15.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.713+0000 7f17cbb26800 20 remove_watcher() i=3 2024-09-21T09:03:15.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.713+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94732999848592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdc7f0 con 0x5628beccdbe0 2024-09-21T09:03:15.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.714+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94732999848592] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17b002a040 con 0x5628beccdbe0 2024-09-21T09:03:15.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.714+0000 7f17cbb26800 20 remove_watcher() i=4 2024-09-21T09:03:15.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.714+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94732999845616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becde250 con 0x5628becd24a0 2024-09-21T09:03:15.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.717+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94732999845616] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.717+0000 7f17cbb26800 20 remove_watcher() i=5 2024-09-21T09:03:15.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.717+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94732999853792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdb770 con 0x5628becd24a0 2024-09-21T09:03:15.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.722+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94732999853792] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.722+0000 7f17cbb26800 20 remove_watcher() i=6 2024-09-21T09:03:15.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.722+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94732999842384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5628becdc7f0 con 0x5628becd24a0 2024-09-21T09:03:15.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17c7f14640 1 -- 172.21.15.178:0/1336028943 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94732999842384] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17c002a070 con 0x5628becd24a0 2024-09-21T09:03:15.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 20 remove_watcher() i=7 2024-09-21T09:03:15.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5628becd24a0 msgr2=0x5628becd4890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5628becd24a0 0x5628becd4890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5628beccdbe0 msgr2=0x5628becd00a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5628beccdbe0 0x5628becd00a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f17b8078070 msgr2=0x7f17b8004280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f17b8078070 0x7f17b8004280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5628becd70a0 msgr2=0x5628becd9560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5628becd70a0 0x5628becd9560 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1690036b90 msgr2=0x7f1690039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1690036b90 0x7f1690039050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f17b8051e30 tx=0x7f17b8091000 comp rx=0 tx=0).stop 2024-09-21T09:03:15.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becbaa80 msgr2=0x5628becc1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17bef12640 1 -- 172.21.15.178:0/1336028943 reap_dead start 2024-09-21T09:03:15.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becbaa80 0x5628becc1f10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f17c0016ad0 tx=0x7f17c004cb20 comp rx=0 tx=0).stop 2024-09-21T09:03:15.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 shutdown_connections 2024-09-21T09:03:15.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 --2- 172.21.15.178:0/1336028943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becbaa80 0x5628becc1f10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 >> 172.21.15.178:0/1336028943 conn(0x5628becb6de0 msgr2=0x5628becb4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 shutdown_connections 2024-09-21T09:03:15.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.723+0000 7f17cbb26800 1 -- 172.21.15.178:0/1336028943 wait complete. 2024-09-21T09:03:15.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 -- 172.21.15.178:0/2443588463 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f16a0036b90 msgr2=0x7f16a0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 --2- 172.21.15.178:0/2443588463 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f16a0036b90 0x7f16a0039050 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x5628bec9aaf0 tx=0x7f17b808f220 comp rx=0 tx=0).stop 2024-09-21T09:03:15.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 -- 172.21.15.178:0/2443588463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becade00 msgr2=0x5628becae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 --2- 172.21.15.178:0/2443588463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becade00 0x5628becae220 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5628bec9aac0 tx=0x7f17c0018830 comp rx=0 tx=0).stop 2024-09-21T09:03:15.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 -- 172.21.15.178:0/2443588463 shutdown_connections 2024-09-21T09:03:15.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 --2- 172.21.15.178:0/2443588463 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f16a0036b90 0x7f16a0039050 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 --2- 172.21.15.178:0/2443588463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628becade00 0x5628becae220 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 -- 172.21.15.178:0/2443588463 >> 172.21.15.178:0/2443588463 conn(0x5628beca2d90 msgr2=0x5628beca5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 -- 172.21.15.178:0/2443588463 shutdown_connections 2024-09-21T09:03:15.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 -- 172.21.15.178:0/2443588463 wait complete. 2024-09-21T09:03:15.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5628bec9c9f0 msgr2=0x5628bec9ede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5628bec9c9f0 0x5628bec9ede0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5628beb9fb10 msgr2=0x5628bec9a0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5628beb9fb10 0x5628bec9a0e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f16ac036b40 msgr2=0x7f16ac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f16ac036b40 0x7f16ac039000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f17b0000f60 tx=0x7f17b00013f0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 msgr2=0x5628bec93070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628bec93070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f17b800a520 tx=0x7f17b8002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 shutdown_connections 2024-09-21T09:03:15.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5628bec9c9f0 0x5628bec9ede0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5628beb9fb10 0x5628bec9a0e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f16ac036b40 0x7f16ac039000 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 --2- 172.21.15.178:0/3315898762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628beb0dde0 0x5628bec93070 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 >> 172.21.15.178:0/3315898762 conn(0x5628beb94de0 msgr2=0x5628bec85b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 shutdown_connections 2024-09-21T09:03:15.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.724+0000 7f17cbb26800 1 -- 172.21.15.178:0/3315898762 wait complete. 2024-09-21T09:03:15.743 INFO:teuthology.orchestra.run.smithi178.stdout:[] 2024-09-21T09:03:15.743 DEBUG:tasks.util.rgw: json result: [] 2024-09-21T09:03:15.743 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-21T09:03:15.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-21T09:03:15.744 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-21T09:03:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.787+0000 7f6084d19800 1 Processor -- start 2024-09-21T09:03:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.787+0000 7f6084d19800 1 -- start start 2024-09-21T09:03:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.787+0000 7f6084d19800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5585c25b4550 0x5585c25b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.787+0000 7f6084d19800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5585c2474b30 con 0x5585c25b4e90 2024-09-21T09:03:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.787+0000 7f6084d19800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5585c2456360 con 0x5585c25b4550 2024-09-21T09:03:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.788+0000 7f6082814640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5585c25b4550 0x5585c25b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.788+0000 7f607a013640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5585c25b4e90 0x5585c25b9a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:58286/0 (socket says 172.21.15.178:58286) 2024-09-21T09:03:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.788+0000 7f6082814640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5585c25b4550 0x5585c25b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55548/0 (socket says 172.21.15.178:55548) 2024-09-21T09:03:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.788+0000 7f607a013640 1 -- 172.21.15.178:0/3197463637 learned_addr learned my addr 172.21.15.178:0/3197463637 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.788+0000 7f6082814640 1 -- 172.21.15.178:0/3197463637 >> v1:172.21.15.44:6789/0 conn(0x5585c25b4e90 legacy=0x5585c25b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.788+0000 7f6082814640 1 -- 172.21.15.178:0/3197463637 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c247ce00 con 0x5585c25b4550 2024-09-21T09:03:15.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.790+0000 7f6082814640 1 --2- 172.21.15.178:0/3197463637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c25b4950 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f607400a600 tx=0x7f6074047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a680829be3fe4d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.790+0000 7f6082013640 1 -- 172.21.15.178:0/3197463637 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6074056070 con 0x5585c25b4550 2024-09-21T09:03:15.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.790+0000 7f6082013640 1 -- 172.21.15.178:0/3197463637 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607400a200 con 0x5585c25b4550 2024-09-21T09:03:15.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.790+0000 7f6082013640 1 -- 172.21.15.178:0/3197463637 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6074008590 con 0x5585c25b4550 2024-09-21T09:03:15.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.790+0000 7f6084d19800 1 -- 172.21.15.178:0/3197463637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 msgr2=0x5585c25b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.790+0000 7f6084d19800 1 --2- 172.21.15.178:0/3197463637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c25b4950 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f607400a600 tx=0x7f6074047cb0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.790+0000 7f6084d19800 1 -- 172.21.15.178:0/3197463637 shutdown_connections 2024-09-21T09:03:15.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.790+0000 7f6084d19800 1 --2- 172.21.15.178:0/3197463637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c25b4950 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.790+0000 7f6084d19800 1 -- 172.21.15.178:0/3197463637 >> 172.21.15.178:0/3197463637 conn(0x5585c25afde0 msgr2=0x5585c25b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.791+0000 7f6084d19800 1 -- 172.21.15.178:0/3197463637 shutdown_connections 2024-09-21T09:03:15.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.791+0000 7f6084d19800 1 -- 172.21.15.178:0/3197463637 wait complete. 2024-09-21T09:03:15.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.804+0000 7f6084d19800 1 Processor -- start 2024-09-21T09:03:15.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.804+0000 7f6084d19800 1 -- start start 2024-09-21T09:03:15.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.804+0000 7f6084d19800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c26a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.804+0000 7f6084d19800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5585c2501330 con 0x5585c25b4550 2024-09-21T09:03:15.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.805+0000 7f6082814640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c26a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.805+0000 7f6082814640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c26a6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55556/0 (socket says 172.21.15.178:55556) 2024-09-21T09:03:15.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.805+0000 7f6082814640 1 -- 172.21.15.178:0/2857504501 learned_addr learned my addr 172.21.15.178:0/2857504501 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.805+0000 7f6082814640 1 -- 172.21.15.178:0/2857504501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c244ebc0 con 0x5585c25b4550 2024-09-21T09:03:15.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.805+0000 7f6082814640 1 --2- 172.21.15.178:0/2857504501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c26a6aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6074027ae0 tx=0x7f6074053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837d753eb54531fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.808 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.805+0000 7f5f70e09640 1 -- 172.21.15.178:0/2857504501 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6074051660 con 0x5585c25b4550 2024-09-21T09:03:15.808 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.805+0000 7f5f70e09640 1 -- 172.21.15.178:0/2857504501 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6074051800 con 0x5585c25b4550 2024-09-21T09:03:15.808 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.805+0000 7f5f70e09640 1 -- 172.21.15.178:0/2857504501 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6074051ae0 con 0x5585c25b4550 2024-09-21T09:03:15.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.806+0000 7f6084d19800 1 -- 172.21.15.178:0/2857504501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 msgr2=0x5585c26a6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.806+0000 7f6084d19800 1 --2- 172.21.15.178:0/2857504501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c26a6aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6074027ae0 tx=0x7f6074053000 comp rx=0 tx=0).stop 2024-09-21T09:03:15.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.806+0000 7f6084d19800 1 -- 172.21.15.178:0/2857504501 shutdown_connections 2024-09-21T09:03:15.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.806+0000 7f6084d19800 1 --2- 172.21.15.178:0/2857504501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c26a6aa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.806+0000 7f6084d19800 1 -- 172.21.15.178:0/2857504501 >> 172.21.15.178:0/2857504501 conn(0x5585c25afde0 msgr2=0x5585c269e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.806+0000 7f6084d19800 1 -- 172.21.15.178:0/2857504501 shutdown_connections 2024-09-21T09:03:15.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.806+0000 7f6084d19800 1 -- 172.21.15.178:0/2857504501 wait complete. 2024-09-21T09:03:15.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.806+0000 7f6084d19800 1 Processor -- start 2024-09-21T09:03:15.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.807+0000 7f6084d19800 1 -- start start 2024-09-21T09:03:15.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.807+0000 7f6084d19800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c26ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.807+0000 7f6084d19800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5585c25bb570 con 0x5585c25b4550 2024-09-21T09:03:15.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.807+0000 7f6082814640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c26ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.807+0000 7f6082814640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c26ae2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55572/0 (socket says 172.21.15.178:55572) 2024-09-21T09:03:15.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.807+0000 7f6082814640 1 -- 172.21.15.178:0/346257009 learned_addr learned my addr 172.21.15.178:0/346257009 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.807+0000 7f6082814640 1 -- 172.21.15.178:0/346257009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c2462fe0 con 0x5585c25b4550 2024-09-21T09:03:15.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.808+0000 7f6082814640 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c26ae2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6074027ae0 tx=0x7f6074002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.808+0000 7f5f6f606640 1 -- 172.21.15.178:0/346257009 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60740519b0 con 0x5585c25b4550 2024-09-21T09:03:15.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.808+0000 7f5f6f606640 1 -- 172.21.15.178:0/346257009 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6074051b50 con 0x5585c25b4550 2024-09-21T09:03:15.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.808+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585c26ae830 con 0x5585c25b4550 2024-09-21T09:03:15.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.808+0000 7f5f6f606640 1 -- 172.21.15.178:0/346257009 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f607405b580 con 0x5585c25b4550 2024-09-21T09:03:15.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.808+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585c26aedb0 con 0x5585c25b4550 2024-09-21T09:03:15.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.809+0000 7f5f6f606640 1 -- 172.21.15.178:0/346257009 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6074059070 con 0x5585c25b4550 2024-09-21T09:03:15.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.809+0000 7f5f6f606640 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f68036b40 0x7f5f68039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.809+0000 7f5f6f606640 1 -- 172.21.15.178:0/346257009 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f607406b050 con 0x5585c25b4550 2024-09-21T09:03:15.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.809+0000 7f607a013640 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f68036b40 0x7f5f68039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.809+0000 7f6084d19800 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5585c25b4e90 0x5585c26b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.809+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26b58e0 con 0x5585c25b4e90 2024-09-21T09:03:15.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.809+0000 7f6083015640 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5585c25b4e90 0x5585c26b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.809+0000 7f607a013640 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f68036b40 0x7f5f68039000 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f606c000f60 tx=0x7f606c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.809+0000 7f6083015640 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5585c25b4e90 0x5585c26b5360 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.810+0000 7f6083015640 1 -- 172.21.15.178:0/346257009 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f607c00a4a0 con 0x5585c25b4e90 2024-09-21T09:03:15.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.810+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26b2930 con 0x5585c25b4e90 2024-09-21T09:03:15.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.810+0000 7f6083015640 1 -- 172.21.15.178:0/346257009 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f607c00a4a0 con 0x5585c25b4e90 2024-09-21T09:03:15.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.810+0000 7f6084d19800 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5585c26b7c30 0x5585c26ba020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.810+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26ba710 con 0x5585c26b7c30 2024-09-21T09:03:15.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.810+0000 7f6082814640 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5585c26b7c30 0x5585c26ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.811+0000 7f6082814640 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5585c26b7c30 0x5585c26ba020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.811+0000 7f6082814640 1 -- 172.21.15.178:0/346257009 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6074058030 con 0x5585c26b7c30 2024-09-21T09:03:15.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.811+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26b6a10 con 0x5585c25b4e90 2024-09-21T09:03:15.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.811+0000 7f6083015640 1 -- 172.21.15.178:0/346257009 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f607c00a4a0 con 0x5585c25b4e90 2024-09-21T09:03:15.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.811+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26b6ef0 con 0x5585c25b4e90 2024-09-21T09:03:15.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.812+0000 7f6083015640 1 -- 172.21.15.178:0/346257009 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f607c00a4a0 con 0x5585c25b4e90 2024-09-21T09:03:15.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.812+0000 7f6084d19800 1 Processor -- start 2024-09-21T09:03:15.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.812+0000 7f6084d19800 1 -- start start 2024-09-21T09:03:15.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.812+0000 7f6084d19800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26c8ff0 0x5585c26c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.812+0000 7f6084d19800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5585c2450580 con 0x5585c26c8ff0 2024-09-21T09:03:15.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.812+0000 7f6083015640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26c8ff0 0x5585c26c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.812+0000 7f6083015640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26c8ff0 0x5585c26c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55576/0 (socket says 172.21.15.178:55576) 2024-09-21T09:03:15.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.812+0000 7f6083015640 1 -- 172.21.15.178:0/578229324 learned_addr learned my addr 172.21.15.178:0/578229324 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.813+0000 7f6083015640 1 -- 172.21.15.178:0/578229324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c26c9950 con 0x5585c26c8ff0 2024-09-21T09:03:15.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.813+0000 7f6083015640 1 --2- 172.21.15.178:0/578229324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26c8ff0 0x5585c26c9410 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5585c26b5ce0 tx=0x7f607c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.813+0000 7f5f6ce01640 1 -- 172.21.15.178:0/578229324 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f607c014450 con 0x5585c26c8ff0 2024-09-21T09:03:15.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.813+0000 7f5f6ce01640 1 -- 172.21.15.178:0/578229324 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607c014610 con 0x5585c26c8ff0 2024-09-21T09:03:15.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.813+0000 7f6084d19800 1 -- 172.21.15.178:0/578229324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585c26c9be0 con 0x5585c26c8ff0 2024-09-21T09:03:15.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.813+0000 7f5f6ce01640 1 -- 172.21.15.178:0/578229324 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f607c014930 con 0x5585c26c8ff0 2024-09-21T09:03:15.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.813+0000 7f6084d19800 1 -- 172.21.15.178:0/578229324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585c26cc8c0 con 0x5585c26c8ff0 2024-09-21T09:03:15.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.814+0000 7f5f6ce01640 1 -- 172.21.15.178:0/578229324 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f607c011040 con 0x5585c26c8ff0 2024-09-21T09:03:15.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.814+0000 7f5f6ce01640 1 --2- 172.21.15.178:0/578229324 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f5c036bb0 0x7f5f5c039070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.814+0000 7f5f6ce01640 1 -- 172.21.15.178:0/578229324 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f607c01e070 con 0x5585c26c8ff0 2024-09-21T09:03:15.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.814+0000 7f6082814640 1 --2- 172.21.15.178:0/578229324 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f5c036bb0 0x7f5f5c039070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.814+0000 7f6084d19800 1 Processor -- start 2024-09-21T09:03:15.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.815+0000 7f6082814640 1 --2- 172.21.15.178:0/578229324 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f5c036bb0 0x7f5f5c039070 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5585c26b5d80 tx=0x7f607405b7a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.815+0000 7f6084d19800 1 -- start start 2024-09-21T09:03:15.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.815+0000 7f6084d19800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26d5c10 0x5585c26d6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.815+0000 7f6084d19800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5585c26a7190 con 0x5585c26d5c10 2024-09-21T09:03:15.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.815+0000 7f6083015640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26d5c10 0x5585c26d6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.815+0000 7f6083015640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26d5c10 0x5585c26d6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55580/0 (socket says 172.21.15.178:55580) 2024-09-21T09:03:15.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.815+0000 7f6083015640 1 -- 172.21.15.178:0/4049315888 learned_addr learned my addr 172.21.15.178:0/4049315888 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.815+0000 7f6083015640 1 -- 172.21.15.178:0/4049315888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c26d65e0 con 0x5585c26d5c10 2024-09-21T09:03:15.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.815+0000 7f6083015640 1 --2- 172.21.15.178:0/4049315888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26d5c10 0x5585c26d6010 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f607c04cba0 tx=0x7f607c02b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4784b710960bac3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.816+0000 7f5f667fc640 1 -- 172.21.15.178:0/4049315888 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f607c028040 con 0x5585c26d5c10 2024-09-21T09:03:15.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.816+0000 7f5f667fc640 1 -- 172.21.15.178:0/4049315888 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607c0400c0 con 0x5585c26d5c10 2024-09-21T09:03:15.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.816+0000 7f5f667fc640 1 -- 172.21.15.178:0/4049315888 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f607c016980 con 0x5585c26d5c10 2024-09-21T09:03:15.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.816+0000 7f6084d19800 1 -- 172.21.15.178:0/4049315888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26d5c10 msgr2=0x5585c26d6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.816+0000 7f6084d19800 1 --2- 172.21.15.178:0/4049315888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26d5c10 0x5585c26d6010 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f607c04cba0 tx=0x7f607c02b410 comp rx=0 tx=0).stop 2024-09-21T09:03:15.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.816+0000 7f6084d19800 1 -- 172.21.15.178:0/4049315888 shutdown_connections 2024-09-21T09:03:15.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.816+0000 7f6084d19800 1 --2- 172.21.15.178:0/4049315888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26d5c10 0x5585c26d6010 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.816+0000 7f6084d19800 1 -- 172.21.15.178:0/4049315888 >> 172.21.15.178:0/4049315888 conn(0x5585c26d2000 msgr2=0x5585c26d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.816+0000 7f6084d19800 1 -- 172.21.15.178:0/4049315888 shutdown_connections 2024-09-21T09:03:15.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.816+0000 7f6084d19800 1 -- 172.21.15.178:0/4049315888 wait complete. 2024-09-21T09:03:15.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.816+0000 7f6084d19800 1 Processor -- start 2024-09-21T09:03:15.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.816+0000 7f6084d19800 1 -- start start 2024-09-21T09:03:15.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.816+0000 7f6084d19800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26d5c10 0x5585c26dd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.816+0000 7f6084d19800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5585c26d6c20 con 0x5585c26d5c10 2024-09-21T09:03:15.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.817+0000 7f6083015640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26d5c10 0x5585c26dd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.817+0000 7f6083015640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26d5c10 0x5585c26dd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55588/0 (socket says 172.21.15.178:55588) 2024-09-21T09:03:15.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.817+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 learned_addr learned my addr 172.21.15.178:0/427962982 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.817+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c26dd660 con 0x5585c26d5c10 2024-09-21T09:03:15.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.817+0000 7f6083015640 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26d5c10 0x5585c26dd120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f607c011b50 tx=0x7f607c04cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.817+0000 7f5f64ff9640 1 -- 172.21.15.178:0/427962982 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f607c028050 con 0x5585c26d5c10 2024-09-21T09:03:15.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.817+0000 7f5f64ff9640 1 -- 172.21.15.178:0/427962982 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607c016980 con 0x5585c26d5c10 2024-09-21T09:03:15.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.817+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585c26dd8f0 con 0x5585c26d5c10 2024-09-21T09:03:15.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.817+0000 7f5f64ff9640 1 -- 172.21.15.178:0/427962982 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f607c04e070 con 0x5585c26d5c10 2024-09-21T09:03:15.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.818+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585c26e05a0 con 0x5585c26d5c10 2024-09-21T09:03:15.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.818+0000 7f5f64ff9640 1 -- 172.21.15.178:0/427962982 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f607c04e210 con 0x5585c26d5c10 2024-09-21T09:03:15.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.819+0000 7f5f64ff9640 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f4c036b90 0x7f5f4c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.819+0000 7f5f64ff9640 1 -- 172.21.15.178:0/427962982 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f607c00e040 con 0x5585c26d5c10 2024-09-21T09:03:15.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.819+0000 7f6082814640 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f4c036b90 0x7f5f4c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.819+0000 7f6082814640 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f4c036b90 0x7f5f4c039050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5585c26bab10 tx=0x7f6074085000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.819+0000 7f6084d19800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.819+0000 7f6084d19800 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5585c26e8b60 0x5585c26eb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.819+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26eb770 con 0x5585c26e8b60 2024-09-21T09:03:15.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.819+0000 7f607a013640 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5585c26e8b60 0x5585c26eb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f607a013640 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5585c26e8b60 0x5585c26eb020 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f606c009050 con 0x5585c26e8b60 2024-09-21T09:03:15.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f6084d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f6084d19800 20 realm 2024-09-21T09:03:15.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f6084d19800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26e7fb0 con 0x5585c26e8b60 2024-09-21T09:03:15.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f606c009050 con 0x5585c26e8b60 2024-09-21T09:03:15.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f6084d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f6084d19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:15.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f6084d19800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26ec260 con 0x5585c26e8b60 2024-09-21T09:03:15.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f606c009050 con 0x5585c26e8b60 2024-09-21T09:03:15.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f6084d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f6084d19800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.820+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26ecb30 con 0x5585c26e8b60 2024-09-21T09:03:15.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.821+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f606c009050 con 0x5585c26e8b60 2024-09-21T09:03:15.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.821+0000 7f6084d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:15.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.821+0000 7f6084d19800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.821+0000 7f6084d19800 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5585c26ed470 0x5585c26ef860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.821+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26efff0 con 0x5585c26ed470 2024-09-21T09:03:15.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.821+0000 7f6083015640 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5585c26ed470 0x5585c26ef860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.821+0000 7f6083015640 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5585c26ed470 0x5585c26ef860 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.822+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.822+0000 7f6084d19800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:15.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.822+0000 7f6084d19800 20 searching for the correct realm 2024-09-21T09:03:15.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.822+0000 7f6084d19800 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5585c26f1fc0 0x5585c26f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.822+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4b50 con 0x5585c26f1fc0 2024-09-21T09:03:15.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.822+0000 7f6082814640 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5585c26f1fc0 0x5585c26f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.822+0000 7f6082814640 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5585c26f1fc0 0x5585c26f4480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.822+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.822+0000 7f6082814640 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f607405b070 0x7f6074007400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.822+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4b50 con 0x7f607405b070 2024-09-21T09:03:15.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.822+0000 7f607a013640 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f607405b070 0x7f6074007400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.823+0000 7f607a013640 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f607405b070 0x7f6074007400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.823+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c009050 con 0x7f607405b070 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.823+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4b50 con 0x5585c26ed470 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.823+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.823+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4b50 con 0x5585c26e8b60 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.823+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c009050 con 0x5585c26e8b60 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.823+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4b50 con 0x5585c26e8b60 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.824+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c029040 con 0x5585c26e8b60 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.824+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4b50 con 0x5585c26ed470 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.824+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.824+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4b50 con 0x5585c26ed470 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.824+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.824+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4b50 con 0x7f607405b070 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.825+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c029040 con 0x7f607405b070 2024-09-21T09:03:15.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.825+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4b50 con 0x5585c26f1fc0 2024-09-21T09:03:15.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.825+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.825+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4b50 con 0x5585c26e8b60 2024-09-21T09:03:15.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.825+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c029040 con 0x5585c26e8b60 2024-09-21T09:03:15.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.825+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4b50 con 0x5585c26ed470 2024-09-21T09:03:15.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.825+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.825+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4b50 con 0x5585c26e8b60 2024-09-21T09:03:15.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.826+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c029040 con 0x5585c26e8b60 2024-09-21T09:03:15.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.826+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4b50 con 0x7f607405b070 2024-09-21T09:03:15.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.826+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f606c029040 con 0x7f607405b070 2024-09-21T09:03:15.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.826+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4b50 con 0x5585c26f1fc0 2024-09-21T09:03:15.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.826+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.826+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26f1fc0 2024-09-21T09:03:15.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.826+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.826+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26ed470 2024-09-21T09:03:15.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.827+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.827+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26f1fc0 2024-09-21T09:03:15.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.827+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.827+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26f1fc0 2024-09-21T09:03:15.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.827+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.827+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26e8b60 2024-09-21T09:03:15.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.827+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f606c029040 con 0x5585c26e8b60 2024-09-21T09:03:15.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.827+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26e8b60 2024-09-21T09:03:15.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.828+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f606c029040 con 0x5585c26e8b60 2024-09-21T09:03:15.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.828+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26ed470 2024-09-21T09:03:15.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.828+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.828+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26f1fc0 2024-09-21T09:03:15.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.828+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.828+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x7f607405b070 2024-09-21T09:03:15.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.828+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c029040 con 0x7f607405b070 2024-09-21T09:03:15.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.828+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26e8b60 2024-09-21T09:03:15.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.829+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c029040 con 0x5585c26e8b60 2024-09-21T09:03:15.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.829+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26ed470 2024-09-21T09:03:15.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.829+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.829+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26f1fc0 2024-09-21T09:03:15.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.829+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.829+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26ed470 2024-09-21T09:03:15.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.829+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.829+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x7f607405b070 2024-09-21T09:03:15.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.830+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c029040 con 0x7f607405b070 2024-09-21T09:03:15.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.830+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26f1fc0 2024-09-21T09:03:15.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.830+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.830+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26ed470 2024-09-21T09:03:15.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.830+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.830+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x5585c26e8b60 2024-09-21T09:03:15.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.830+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f606c029040 con 0x5585c26e8b60 2024-09-21T09:03:15.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.830+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f60740aa040 con 0x7f607405b070 2024-09-21T09:03:15.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c029040 con 0x7f607405b070 2024-09-21T09:03:15.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:15.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:15.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:15.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:15.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:15.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:15.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f09b0 con 0x5585c26e8b60 2024-09-21T09:03:15.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f606c029040 con 0x5585c26e8b60 2024-09-21T09:03:15.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f05f0 con 0x5585c26e8b60 2024-09-21T09:03:15.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f606c029040 con 0x5585c26e8b60 2024-09-21T09:03:15.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:15.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f1350 con 0x5585c26e8b60 2024-09-21T09:03:15.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:15.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 zone default found 2024-09-21T09:03:15.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 4 Realm: () 2024-09-21T09:03:15.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:15.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:15.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:15.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 zonegroup default 2024-09-21T09:03:15.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.831+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f4ff0 con 0x5585c26ed470 2024-09-21T09:03:15.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.832+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.832+0000 7f6084d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.832+0000 7f6084d19800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.832+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f72c0 con 0x5585c26f1fc0 2024-09-21T09:03:15.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.832+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.832+0000 7f6084d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.832+0000 7f6084d19800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.832+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f7660 con 0x5585c26f1fc0 2024-09-21T09:03:15.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.832+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.832+0000 7f6084d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.832+0000 7f6084d19800 20 started sync module instance, tier type = 2024-09-21T09:03:15.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.832+0000 7f6084d19800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:15.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.832+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f6700 con 0x7f607405b070 2024-09-21T09:03:15.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.833+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x7f607405b070 2024-09-21T09:03:15.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.833+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94032981093408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f6700 con 0x7f607405b070 2024-09-21T09:03:15.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.833+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f8060 con 0x5585c26e8b60 2024-09-21T09:03:15.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.834+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94032981093408] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x7f607405b070 2024-09-21T09:03:15.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.835+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.835+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94032981097328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f6700 con 0x5585c26e8b60 2024-09-21T09:03:15.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.835+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f8ad0 con 0x5585c26f1fc0 2024-09-21T09:03:15.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.837+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.837+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94032981099968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f93a0 con 0x5585c26f1fc0 2024-09-21T09:03:15.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.837+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f9e40 con 0x7f607405b070 2024-09-21T09:03:15.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.838+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94032981097328] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.838+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x7f607405b070 2024-09-21T09:03:15.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.839+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94032981104912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26fa230 con 0x7f607405b070 2024-09-21T09:03:15.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.839+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26fac30 con 0x5585c26e8b60 2024-09-21T09:03:15.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.839+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94032981104912] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x7f607405b070 2024-09-21T09:03:15.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.840+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94032981099968] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.841+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.841+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94032981102320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26fa740 con 0x5585c26e8b60 2024-09-21T09:03:15.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.841+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26fb4d0 con 0x5585c26ed470 2024-09-21T09:03:15.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.843+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.843+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94032981110816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26fa740 con 0x5585c26ed470 2024-09-21T09:03:15.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.843+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26fc3c0 con 0x5585c26ed470 2024-09-21T09:03:15.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.848+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94032981102320] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.848+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94032981110816] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.848+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.849+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94032981112944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f6250 con 0x5585c26ed470 2024-09-21T09:03:15.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.849+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26fc9a0 con 0x5585c26ed470 2024-09-21T09:03:15.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.851+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94032981112944] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.854+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.854+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94032981114512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26fc9a0 con 0x5585c26ed470 2024-09-21T09:03:15.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.854+0000 7f6084d19800 20 add_watcher() i=0 2024-09-21T09:03:15.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.854+0000 7f6084d19800 20 add_watcher() i=1 2024-09-21T09:03:15.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.854+0000 7f6084d19800 20 add_watcher() i=2 2024-09-21T09:03:15.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.854+0000 7f6084d19800 20 add_watcher() i=3 2024-09-21T09:03:15.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.854+0000 7f6084d19800 20 add_watcher() i=4 2024-09-21T09:03:15.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.854+0000 7f6084d19800 20 add_watcher() i=5 2024-09-21T09:03:15.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.854+0000 7f6084d19800 20 add_watcher() i=6 2024-09-21T09:03:15.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.855+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94032981114512] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.855+0000 7f6084d19800 20 add_watcher() i=7 2024-09-21T09:03:15.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.855+0000 7f6084d19800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:15.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.855+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c26ffc90 con 0x5585c26e8b60 2024-09-21T09:03:15.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.855+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.855+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94032981116512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26fcf30 con 0x5585c26e8b60 2024-09-21T09:03:15.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.856+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94032981116512] v29'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.856+0000 7f5f397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:15.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.856+0000 7f6084d19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:15.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.856+0000 7f6084d19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:15.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.856+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26ff600 con 0x5585c26e8b60 2024-09-21T09:03:15.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.858+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.858+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c2708f20 con 0x5585c26ed470 2024-09-21T09:03:15.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.859+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.859+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c2708f20 con 0x5585c26f1fc0 2024-09-21T09:03:15.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.860+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.860+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c27093d0 con 0x5585c26e8b60 2024-09-21T09:03:15.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.861+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.861+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c27083c0 con 0x7f607405b070 2024-09-21T09:03:15.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.862+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x7f607405b070 2024-09-21T09:03:15.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.862+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c27083c0 con 0x5585c26f1fc0 2024-09-21T09:03:15.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.862+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'13 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.863+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c27083c0 con 0x5585c26e8b60 2024-09-21T09:03:15.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.864+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.864+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c2708590 con 0x5585c26ed470 2024-09-21T09:03:15.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.865+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'13 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.865+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c2709f30 con 0x7f607405b070 2024-09-21T09:03:15.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.866+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x7f607405b070 2024-09-21T09:03:15.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.866+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c2709f30 con 0x5585c26f1fc0 2024-09-21T09:03:15.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.867+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.867+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c2709f30 con 0x7f607405b070 2024-09-21T09:03:15.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.868+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x7f607405b070 2024-09-21T09:03:15.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.868+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c2709f30 con 0x5585c26ed470 2024-09-21T09:03:15.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.869+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.869+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c2709fc0 con 0x7f607405b070 2024-09-21T09:03:15.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.870+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x7f607405b070 2024-09-21T09:03:15.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.870+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c2709fc0 con 0x5585c26ed470 2024-09-21T09:03:15.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.871+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.871+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c2709fc0 con 0x5585c26e8b60 2024-09-21T09:03:15.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.872+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.872+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a190 con 0x5585c26f1fc0 2024-09-21T09:03:15.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.873+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.874+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a6b0 con 0x7f607405b070 2024-09-21T09:03:15.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.874+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x7f607405b070 2024-09-21T09:03:15.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.874+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x5585c26f1fc0 2024-09-21T09:03:15.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.875+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.875+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x5585c26e8b60 2024-09-21T09:03:15.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.877+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.877+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x5585c26e8b60 2024-09-21T09:03:15.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.877+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.877+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x5585c26f1fc0 2024-09-21T09:03:15.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.879+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'15 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.879+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x7f607405b070 2024-09-21T09:03:15.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.880+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x7f607405b070 2024-09-21T09:03:15.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.880+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x5585c26f1fc0 2024-09-21T09:03:15.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.881+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.881+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x5585c26f1fc0 2024-09-21T09:03:15.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.882+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.882+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x5585c26f1fc0 2024-09-21T09:03:15.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.883+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.883+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x5585c26f1fc0 2024-09-21T09:03:15.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.884+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.884+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x5585c26ed470 2024-09-21T09:03:15.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.885+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.885+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x5585c26f1fc0 2024-09-21T09:03:15.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.886+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.886+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x5585c26ed470 2024-09-21T09:03:15.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.887+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.887+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x5585c26f1fc0 2024-09-21T09:03:15.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.888+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.888+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x5585c26ed470 2024-09-21T09:03:15.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.889+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.889+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c270a670 con 0x7f607405b070 2024-09-21T09:03:15.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.890+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x7f607405b070 2024-09-21T09:03:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.890+0000 7f5eb3fff640 20 reqs_thread_entry: start 2024-09-21T09:03:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.891+0000 7f6084d19800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.891+0000 7f6084d19800 20 Filter name: none 2024-09-21T09:03:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.891+0000 7f5eb1ffb640 20 reqs_thread_entry: start 2024-09-21T09:03:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.891+0000 7f6084d19800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-21T09:03:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.891+0000 7f6084d19800 20 rados->read ofs=0 len=0 2024-09-21T09:03:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.891+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5585c27351c0 con 0x7f607405b070 2024-09-21T09:03:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.891+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x7f607405b070 2024-09-21T09:03:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.891+0000 7f6084d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.891+0000 7f6084d19800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-21T09:03:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.891+0000 7f6084d19800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-21T09:03:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:could not remove user: unable to remove user, user does not exist 2024-09-21T09:03:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.892+0000 7f5f397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.892+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94032981116512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c2734c00 con 0x5585c26e8b60 2024-09-21T09:03:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.893+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94032981116512] v29'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.893+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94032981093408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26fc660 con 0x7f607405b070 2024-09-21T09:03:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.894+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94032981093408] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x7f607405b070 2024-09-21T09:03:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.894+0000 7f6084d19800 20 remove_watcher() i=0 2024-09-21T09:03:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.894+0000 7f6084d19800 2 removed watcher, disabling cache 2024-09-21T09:03:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.894+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94032981097328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26fc660 con 0x5585c26e8b60 2024-09-21T09:03:15.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.895+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94032981097328] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.895+0000 7f6084d19800 20 remove_watcher() i=1 2024-09-21T09:03:15.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.895+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94032981099968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26fc660 con 0x5585c26f1fc0 2024-09-21T09:03:15.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.896+0000 7f6082814640 1 -- 172.21.15.178:0/427962982 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94032981099968] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607408d050 con 0x5585c26f1fc0 2024-09-21T09:03:15.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.896+0000 7f6084d19800 20 remove_watcher() i=2 2024-09-21T09:03:15.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.896+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94032981104912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f85c0 con 0x7f607405b070 2024-09-21T09:03:15.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.897+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94032981104912] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x7f607405b070 2024-09-21T09:03:15.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.897+0000 7f6084d19800 20 remove_watcher() i=3 2024-09-21T09:03:15.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.897+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94032981102320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26fc660 con 0x5585c26e8b60 2024-09-21T09:03:15.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.898+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94032981102320] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c03d040 con 0x5585c26e8b60 2024-09-21T09:03:15.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.898+0000 7f6084d19800 20 remove_watcher() i=4 2024-09-21T09:03:15.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.898+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94032981110816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f85c0 con 0x5585c26ed470 2024-09-21T09:03:15.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.899+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94032981110816] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.899+0000 7f6084d19800 20 remove_watcher() i=5 2024-09-21T09:03:15.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.899+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94032981112944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26f8ef0 con 0x5585c26ed470 2024-09-21T09:03:15.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.900+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94032981112944] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.900+0000 7f6084d19800 20 remove_watcher() i=6 2024-09-21T09:03:15.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.900+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94032981114512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5585c26fc660 con 0x5585c26ed470 2024-09-21T09:03:15.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6083015640 1 -- 172.21.15.178:0/427962982 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94032981114512] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c02a070 con 0x5585c26ed470 2024-09-21T09:03:15.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 20 remove_watcher() i=7 2024-09-21T09:03:15.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5585c26ed470 msgr2=0x5585c26ef860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5585c26ed470 0x5585c26ef860 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5585c26e8b60 msgr2=0x5585c26eb020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5585c26e8b60 0x5585c26eb020 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f607405b070 msgr2=0x7f6074007400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f607405b070 0x7f6074007400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5585c26f1fc0 msgr2=0x5585c26f4480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5585c26f1fc0 0x5585c26f4480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f4c036b90 msgr2=0x7f5f4c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f4c036b90 0x7f5f4c039050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5585c26bab10 tx=0x7f6074085000 comp rx=0 tx=0).stop 2024-09-21T09:03:15.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26d5c10 msgr2=0x5585c26dd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f607a013640 1 -- 172.21.15.178:0/427962982 reap_dead start 2024-09-21T09:03:15.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26d5c10 0x5585c26dd120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f607c011b50 tx=0x7f607c04cb30 comp rx=0 tx=0).stop 2024-09-21T09:03:15.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 shutdown_connections 2024-09-21T09:03:15.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 --2- 172.21.15.178:0/427962982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26d5c10 0x5585c26dd120 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 >> 172.21.15.178:0/427962982 conn(0x5585c26d2000 msgr2=0x5585c26d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 shutdown_connections 2024-09-21T09:03:15.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.901+0000 7f6084d19800 1 -- 172.21.15.178:0/427962982 wait complete. 2024-09-21T09:03:15.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 -- 172.21.15.178:0/578229324 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f5c036bb0 msgr2=0x7f5f5c039070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 --2- 172.21.15.178:0/578229324 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f5c036bb0 0x7f5f5c039070 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5585c26b5d80 tx=0x7f607405b7a0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 -- 172.21.15.178:0/578229324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26c8ff0 msgr2=0x5585c26c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 --2- 172.21.15.178:0/578229324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26c8ff0 0x5585c26c9410 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5585c26b5ce0 tx=0x7f607c018830 comp rx=0 tx=0).stop 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 -- 172.21.15.178:0/578229324 shutdown_connections 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 --2- 172.21.15.178:0/578229324 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f5c036bb0 0x7f5f5c039070 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 --2- 172.21.15.178:0/578229324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c26c8ff0 0x5585c26c9410 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 -- 172.21.15.178:0/578229324 >> 172.21.15.178:0/578229324 conn(0x5585c26bdf80 msgr2=0x5585c26c0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 -- 172.21.15.178:0/578229324 shutdown_connections 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 -- 172.21.15.178:0/578229324 wait complete. 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5585c26b7c30 msgr2=0x5585c26ba020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5585c26b7c30 0x5585c26ba020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5585c25b4e90 msgr2=0x5585c26b5360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5585c25b4e90 0x5585c26b5360 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f68036b40 msgr2=0x7f5f68039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f68036b40 0x7f5f68039000 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f606c000f60 tx=0x7f606c0012b0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 msgr2=0x5585c26ae2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c26ae2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6074027ae0 tx=0x7f6074002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 shutdown_connections 2024-09-21T09:03:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5585c26b7c30 0x5585c26ba020 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5585c25b4e90 0x5585c26b5360 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5f68036b40 0x7f5f68039000 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 --2- 172.21.15.178:0/346257009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585c25b4550 0x5585c26ae2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 >> 172.21.15.178:0/346257009 conn(0x5585c25afde0 msgr2=0x5585c269c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 shutdown_connections 2024-09-21T09:03:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.902+0000 7f6084d19800 1 -- 172.21.15.178:0/346257009 wait complete. 2024-09-21T09:03:15.912 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-21T09:03:15.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-21T09:03:15.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-21T09:03:15.913 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-21T09:03:15.957 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:15.957 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:15.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.956+0000 7f6dd8b40800 1 Processor -- start 2024-09-21T09:03:15.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.956+0000 7f6dd8b40800 1 -- start start 2024-09-21T09:03:15.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.956+0000 7f6dd8b40800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x555ddb218db0 0x555ddb21b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.956+0000 7f6dd8b40800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555ddb0d1b30 con 0x555ddb1865f0 2024-09-21T09:03:15.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.956+0000 7f6dd8b40800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x555ddb0b3360 con 0x555ddb218db0 2024-09-21T09:03:15.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.957+0000 7f6dcc0d0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x555ddb218db0 0x555ddb21b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.957+0000 7f6dd48d1640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x555ddb1865f0 0x555ddb217690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:58298/0 (socket says 172.21.15.178:58298) 2024-09-21T09:03:15.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.957+0000 7f6dcc0d0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x555ddb218db0 0x555ddb21b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55598/0 (socket says 172.21.15.178:55598) 2024-09-21T09:03:15.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.957+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3897010696 learned_addr learned my addr 172.21.15.178:0/3897010696 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:15.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.957+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3897010696 >> v1:172.21.15.44:6789/0 conn(0x555ddb1865f0 legacy=0x555ddb217690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.957+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3897010696 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ddb0d9e00 con 0x555ddb218db0 2024-09-21T09:03:15.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.959+0000 7f6dcc0d0640 1 --2- 172.21.15.178:0/3897010696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb218db0 0x555ddb21b1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00a470 tx=0x7f6dbc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504a2c152a00d606 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.959+0000 7f6dcffff640 1 -- 172.21.15.178:0/3897010696 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dbc053570 con 0x555ddb218db0 2024-09-21T09:03:15.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.959+0000 7f6dcffff640 1 -- 172.21.15.178:0/3897010696 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dbc058070 con 0x555ddb218db0 2024-09-21T09:03:15.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.959+0000 7f6dcffff640 1 -- 172.21.15.178:0/3897010696 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dbc053880 con 0x555ddb218db0 2024-09-21T09:03:15.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.959+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3897010696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb218db0 msgr2=0x555ddb21b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.959+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/3897010696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb218db0 0x555ddb21b1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00a470 tx=0x7f6dbc045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:15.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.959+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3897010696 shutdown_connections 2024-09-21T09:03:15.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.959+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/3897010696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb218db0 0x555ddb21b1a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.959+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3897010696 >> 172.21.15.178:0/3897010696 conn(0x555ddb20cde0 msgr2=0x555ddb20f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.959+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3897010696 shutdown_connections 2024-09-21T09:03:15.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.959+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3897010696 wait complete. 2024-09-21T09:03:15.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.973+0000 7f6dd8b40800 1 Processor -- start 2024-09-21T09:03:15.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.973+0000 7f6dd8b40800 1 -- start start 2024-09-21T09:03:15.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.973+0000 7f6dd8b40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb1865f0 0x555ddb303a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.973+0000 7f6dd8b40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555ddb15e330 con 0x555ddb1865f0 2024-09-21T09:03:15.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.974+0000 7f6dd48d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb1865f0 0x555ddb303a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.974+0000 7f6dd48d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb1865f0 0x555ddb303a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55600/0 (socket says 172.21.15.178:55600) 2024-09-21T09:03:15.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.974+0000 7f6dd48d1640 1 -- 172.21.15.178:0/602128577 learned_addr learned my addr 172.21.15.178:0/602128577 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.974+0000 7f6dd48d1640 1 -- 172.21.15.178:0/602128577 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ddb0abbc0 con 0x555ddb1865f0 2024-09-21T09:03:15.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.974+0000 7f6dd48d1640 1 --2- 172.21.15.178:0/602128577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb1865f0 0x555ddb303a80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4001e10 tx=0x7f6dc400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323316ac275f4882 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.974+0000 7f6cc2e0d640 1 -- 172.21.15.178:0/602128577 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc4012020 con 0x555ddb1865f0 2024-09-21T09:03:15.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.974+0000 7f6cc2e0d640 1 -- 172.21.15.178:0/602128577 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc400e5a0 con 0x555ddb1865f0 2024-09-21T09:03:15.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.974+0000 7f6cc2e0d640 1 -- 172.21.15.178:0/602128577 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc400e8e0 con 0x555ddb1865f0 2024-09-21T09:03:15.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.975+0000 7f6dd8b40800 1 -- 172.21.15.178:0/602128577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb1865f0 msgr2=0x555ddb303a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.975+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/602128577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb1865f0 0x555ddb303a80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4001e10 tx=0x7f6dc400b780 comp rx=0 tx=0).stop 2024-09-21T09:03:15.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.975+0000 7f6dd8b40800 1 -- 172.21.15.178:0/602128577 shutdown_connections 2024-09-21T09:03:15.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.975+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/602128577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb1865f0 0x555ddb303a80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.975+0000 7f6dd8b40800 1 -- 172.21.15.178:0/602128577 >> 172.21.15.178:0/602128577 conn(0x555ddb20cde0 msgr2=0x555ddb2ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.975+0000 7f6dd8b40800 1 -- 172.21.15.178:0/602128577 shutdown_connections 2024-09-21T09:03:15.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.975+0000 7f6dd8b40800 1 -- 172.21.15.178:0/602128577 wait complete. 2024-09-21T09:03:15.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.975+0000 7f6dd8b40800 1 Processor -- start 2024-09-21T09:03:15.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.975+0000 7f6dd8b40800 1 -- start start 2024-09-21T09:03:15.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.976+0000 7f6dd8b40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb1865f0 0x555ddb30b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.976+0000 7f6dd8b40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555ddb21b980 con 0x555ddb1865f0 2024-09-21T09:03:15.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.976+0000 7f6dd48d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb1865f0 0x555ddb30b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.976+0000 7f6dd48d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb1865f0 0x555ddb30b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55602/0 (socket says 172.21.15.178:55602) 2024-09-21T09:03:15.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.976+0000 7f6dd48d1640 1 -- 172.21.15.178:0/1345342620 learned_addr learned my addr 172.21.15.178:0/1345342620 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.976+0000 7f6dd48d1640 1 -- 172.21.15.178:0/1345342620 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ddb0bffe0 con 0x555ddb1865f0 2024-09-21T09:03:15.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.976+0000 7f6dd48d1640 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb1865f0 0x555ddb30b480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400b7c0 tx=0x7f6dc4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.977+0000 7f6cc160a640 1 -- 172.21.15.178:0/1345342620 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc4012030 con 0x555ddb1865f0 2024-09-21T09:03:15.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.977+0000 7f6cc160a640 1 -- 172.21.15.178:0/1345342620 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc4001470 con 0x555ddb1865f0 2024-09-21T09:03:15.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.977+0000 7f6cc160a640 1 -- 172.21.15.178:0/1345342620 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc401a8d0 con 0x555ddb1865f0 2024-09-21T09:03:15.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.977+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ddb30b9c0 con 0x555ddb1865f0 2024-09-21T09:03:15.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.977+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ddb30bee0 con 0x555ddb1865f0 2024-09-21T09:03:15.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.978+0000 7f6cc160a640 1 -- 172.21.15.178:0/1345342620 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6dc4015020 con 0x555ddb1865f0 2024-09-21T09:03:15.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.978+0000 7f6cc160a640 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cbc036b40 0x7f6cbc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.978+0000 7f6cc160a640 1 -- 172.21.15.178:0/1345342620 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6dc4020030 con 0x555ddb1865f0 2024-09-21T09:03:15.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.978+0000 7f6dcc0d0640 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cbc036b40 0x7f6cbc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.978+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555ddb218db0 0x555ddb3124f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.978+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb312ac0 con 0x555ddb218db0 2024-09-21T09:03:15.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.978+0000 7f6dd50d2640 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555ddb218db0 0x555ddb3124f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.978+0000 7f6dcc0d0640 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cbc036b40 0x7f6cbc039000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc057000 tx=0x7f6dbc052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.978+0000 7f6dd50d2640 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555ddb218db0 0x555ddb3124f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.979+0000 7f6dd50d2640 1 -- 172.21.15.178:0/1345342620 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dd000a4a0 con 0x555ddb218db0 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.979+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb30faa0 con 0x555ddb218db0 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.979+0000 7f6dd50d2640 1 -- 172.21.15.178:0/1345342620 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6dd000a4a0 con 0x555ddb218db0 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.979+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555ddb314dd0 0x555ddb3171c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.979+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb317860 con 0x555ddb314dd0 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.979+0000 7f6dd48d1640 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555ddb314dd0 0x555ddb3171c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.980+0000 7f6dd48d1640 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555ddb314dd0 0x555ddb3171c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.980+0000 7f6dd48d1640 1 -- 172.21.15.178:0/1345342620 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb314dd0 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.980+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb313c70 con 0x555ddb218db0 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.980+0000 7f6dd50d2640 1 -- 172.21.15.178:0/1345342620 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6dd000a4a0 con 0x555ddb218db0 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.980+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb314150 con 0x555ddb218db0 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.981+0000 7f6dd50d2640 1 -- 172.21.15.178:0/1345342620 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6dd000a4a0 con 0x555ddb218db0 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.981+0000 7f6dd8b40800 1 Processor -- start 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.981+0000 7f6dd8b40800 1 -- start start 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.981+0000 7f6dd8b40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb326220 0x555ddb326640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.981+0000 7f6dd8b40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555ddb0ad580 con 0x555ddb326220 2024-09-21T09:03:15.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.981+0000 7f6dd50d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb326220 0x555ddb326640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.981+0000 7f6dd50d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb326220 0x555ddb326640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55618/0 (socket says 172.21.15.178:55618) 2024-09-21T09:03:15.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.981+0000 7f6dd50d2640 1 -- 172.21.15.178:0/674692599 learned_addr learned my addr 172.21.15.178:0/674692599 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.982+0000 7f6dd50d2640 1 -- 172.21.15.178:0/674692599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ddb326b80 con 0x555ddb326220 2024-09-21T09:03:15.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.982+0000 7f6dd50d2640 1 --2- 172.21.15.178:0/674692599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb326220 0x555ddb326640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x555ddb30c530 tx=0x7f6dd00188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.982+0000 7f6cba7fc640 1 -- 172.21.15.178:0/674692599 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dd0014450 con 0x555ddb326220 2024-09-21T09:03:15.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.982+0000 7f6cba7fc640 1 -- 172.21.15.178:0/674692599 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd00145f0 con 0x555ddb326220 2024-09-21T09:03:15.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.982+0000 7f6dd8b40800 1 -- 172.21.15.178:0/674692599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ddb326e10 con 0x555ddb326220 2024-09-21T09:03:15.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.982+0000 7f6cba7fc640 1 -- 172.21.15.178:0/674692599 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dd00148d0 con 0x555ddb326220 2024-09-21T09:03:15.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.982+0000 7f6dd8b40800 1 -- 172.21.15.178:0/674692599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ddb329af0 con 0x555ddb326220 2024-09-21T09:03:15.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.983+0000 7f6cba7fc640 1 -- 172.21.15.178:0/674692599 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6dd0011040 con 0x555ddb326220 2024-09-21T09:03:15.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.983+0000 7f6cba7fc640 1 --2- 172.21.15.178:0/674692599 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cac036b40 0x7f6cac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.983+0000 7f6cba7fc640 1 -- 172.21.15.178:0/674692599 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6dd001e070 con 0x555ddb326220 2024-09-21T09:03:15.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.983+0000 7f6dd48d1640 1 --2- 172.21.15.178:0/674692599 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cac036b40 0x7f6cac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.983+0000 7f6dd8b40800 1 Processor -- start 2024-09-21T09:03:15.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.983+0000 7f6dd48d1640 1 --2- 172.21.15.178:0/674692599 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cac036b40 0x7f6cac039000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x555ddb312f10 tx=0x7f6dc404b080 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.983+0000 7f6dd8b40800 1 -- start start 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.984+0000 7f6dd8b40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb332e60 0x555ddb333260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.984+0000 7f6dd8b40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555ddb304230 con 0x555ddb332e60 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.984+0000 7f6dd50d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb332e60 0x555ddb333260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.984+0000 7f6dd50d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb332e60 0x555ddb333260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55634/0 (socket says 172.21.15.178:55634) 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.984+0000 7f6dd50d2640 1 -- 172.21.15.178:0/201747793 learned_addr learned my addr 172.21.15.178:0/201747793 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.984+0000 7f6dd50d2640 1 -- 172.21.15.178:0/201747793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ddb333830 con 0x555ddb332e60 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.984+0000 7f6dd50d2640 1 --2- 172.21.15.178:0/201747793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb332e60 0x555ddb333260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6dd004cb80 tx=0x7f6dd003bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527b86a50d9cb5e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.984+0000 7f6cabfff640 1 -- 172.21.15.178:0/201747793 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dd00168f0 con 0x555ddb332e60 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.984+0000 7f6cabfff640 1 -- 172.21.15.178:0/201747793 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd0013c80 con 0x555ddb332e60 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.984+0000 7f6cabfff640 1 -- 172.21.15.178:0/201747793 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dd004e0d0 con 0x555ddb332e60 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.985+0000 7f6dd8b40800 1 -- 172.21.15.178:0/201747793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb332e60 msgr2=0x555ddb333260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.985+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/201747793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb332e60 0x555ddb333260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6dd004cb80 tx=0x7f6dd003bf60 comp rx=0 tx=0).stop 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.985+0000 7f6dd8b40800 1 -- 172.21.15.178:0/201747793 shutdown_connections 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.985+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/201747793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb332e60 0x555ddb333260 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:15.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.985+0000 7f6dd8b40800 1 -- 172.21.15.178:0/201747793 >> 172.21.15.178:0/201747793 conn(0x555ddb32f250 msgr2=0x555ddb32d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.985+0000 7f6dd8b40800 1 -- 172.21.15.178:0/201747793 shutdown_connections 2024-09-21T09:03:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.985+0000 7f6dd8b40800 1 -- 172.21.15.178:0/201747793 wait complete. 2024-09-21T09:03:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.985+0000 7f6dd8b40800 1 Processor -- start 2024-09-21T09:03:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.985+0000 7f6dd8b40800 1 -- start start 2024-09-21T09:03:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.985+0000 7f6dd8b40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb332e60 0x555ddb33a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.985+0000 7f6dd8b40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555ddb333e70 con 0x555ddb332e60 2024-09-21T09:03:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.986+0000 7f6dd50d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb332e60 0x555ddb33a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.986+0000 7f6dd50d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb332e60 0x555ddb33a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55650/0 (socket says 172.21.15.178:55650) 2024-09-21T09:03:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.986+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 learned_addr learned my addr 172.21.15.178:0/3016437320 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.986+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ddb33a8b0 con 0x555ddb332e60 2024-09-21T09:03:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.986+0000 7f6dd50d2640 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb332e60 0x555ddb33a370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6dd004cb80 tx=0x7f6dd004cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.986+0000 7f6caa7fc640 1 -- 172.21.15.178:0/3016437320 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dd0044030 con 0x555ddb332e60 2024-09-21T09:03:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.986+0000 7f6caa7fc640 1 -- 172.21.15.178:0/3016437320 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd0031070 con 0x555ddb332e60 2024-09-21T09:03:15.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.986+0000 7f6caa7fc640 1 -- 172.21.15.178:0/3016437320 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dd0013e30 con 0x555ddb332e60 2024-09-21T09:03:15.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.986+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ddb33ab40 con 0x555ddb332e60 2024-09-21T09:03:15.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.986+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ddb33d7f0 con 0x555ddb332e60 2024-09-21T09:03:15.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.987+0000 7f6caa7fc640 1 -- 172.21.15.178:0/3016437320 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6dd002ba60 con 0x555ddb332e60 2024-09-21T09:03:16.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.987+0000 7f6caa7fc640 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ca0036b90 0x7f6ca0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.987+0000 7f6caa7fc640 1 -- 172.21.15.178:0/3016437320 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6dd000e040 con 0x555ddb332e60 2024-09-21T09:03:16.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.987+0000 7f6dd48d1640 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ca0036b90 0x7f6ca0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.988+0000 7f6dd48d1640 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ca0036b90 0x7f6ca0039050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4044710 tx=0x7f6dc4036000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.988+0000 7f6dd8b40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.988+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555ddb345fd0 0x555ddb348490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.988+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb348be0 con 0x555ddb345fd0 2024-09-21T09:03:16.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.988+0000 7f6dcc0d0640 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555ddb345fd0 0x555ddb348490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.988+0000 7f6dcc0d0640 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555ddb345fd0 0x555ddb348490 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 20 realm 2024-09-21T09:03:16.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb349010 con 0x555ddb345fd0 2024-09-21T09:03:16.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:16.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb3498e0 con 0x555ddb345fd0 2024-09-21T09:03:16.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb349c80 con 0x555ddb345fd0 2024-09-21T09:03:16.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:16.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555ddb34a9e0 0x555ddb34cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.989+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb34d3e0 con 0x555ddb34a9e0 2024-09-21T09:03:16.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.990+0000 7f6dd50d2640 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555ddb34a9e0 0x555ddb34cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.990+0000 7f6dd50d2640 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555ddb34a9e0 0x555ddb34cdd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.990+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.990+0000 7f6dd8b40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:16.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.990+0000 7f6dd8b40800 20 searching for the correct realm 2024-09-21T09:03:16.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.990+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x555ddb34f350 0x555ddb351810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.990+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34f350 2024-09-21T09:03:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.990+0000 7f6dd48d1640 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x555ddb34f350 0x555ddb351810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.991+0000 7f6dd48d1640 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x555ddb34f350 0x555ddb351810 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.991+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.991+0000 7f6dd48d1640 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6dc403a040 0x7f6dc403f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.991+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x7f6dc403a040 2024-09-21T09:03:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.991+0000 7f6dcc0d0640 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6dc403a040 0x7f6dc403f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.991+0000 7f6dcc0d0640 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6dc403a040 0x7f6dc403f5f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.992+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.992+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34a9e0 2024-09-21T09:03:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.992+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.992+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb345fd0 2024-09-21T09:03:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.992+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.992+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb345fd0 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.992+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.992+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34a9e0 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.993+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.993+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34a9e0 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.993+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.993+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x7f6dc403a040 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.993+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.993+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34f350 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.993+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.993+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb345fd0 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.994+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.994+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34a9e0 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.994+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.994+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb345fd0 2024-09-21T09:03:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.994+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.994+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x7f6dc403a040 2024-09-21T09:03:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.994+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.994+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34f350 2024-09-21T09:03:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.994+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.994+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34f350 2024-09-21T09:03:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.995+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.995+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34a9e0 2024-09-21T09:03:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.995+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.995+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34f350 2024-09-21T09:03:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.995+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.995+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34f350 2024-09-21T09:03:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.995+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.995+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb345fd0 2024-09-21T09:03:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.996+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.996+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb345fd0 2024-09-21T09:03:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.996+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.996+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34a9e0 2024-09-21T09:03:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.996+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.996+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34f350 2024-09-21T09:03:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.997+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.997+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x7f6dc403a040 2024-09-21T09:03:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.997+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.997+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb345fd0 2024-09-21T09:03:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.997+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.997+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34a9e0 2024-09-21T09:03:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.997+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.997+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34f350 2024-09-21T09:03:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.998+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.998+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34a9e0 2024-09-21T09:03:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.998+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.998+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x7f6dc403a040 2024-09-21T09:03:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.998+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.998+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34f350 2024-09-21T09:03:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.998+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.998+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb34a9e0 2024-09-21T09:03:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x555ddb345fd0 2024-09-21T09:03:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555ddb351ee0 con 0x7f6dc403a040 2024-09-21T09:03:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dd8b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dd8b40800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dd8b40800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dd8b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dd8b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dd8b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dd8b40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb34e8c0 con 0x555ddb345fd0 2024-09-21T09:03:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dd8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dd8b40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:15.999+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb34d840 con 0x555ddb345fd0 2024-09-21T09:03:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb34e200 con 0x555ddb345fd0 2024-09-21T09:03:16.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:16.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 20 zone default found 2024-09-21T09:03:16.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 4 Realm: () 2024-09-21T09:03:16.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:16.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:16.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:16.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 20 zonegroup default 2024-09-21T09:03:16.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb3523c0 con 0x555ddb34a9e0 2024-09-21T09:03:16.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb354690 con 0x555ddb34f350 2024-09-21T09:03:16.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.000+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.001+0000 7f6dd8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.001+0000 7f6dd8b40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.001+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb354a30 con 0x555ddb34f350 2024-09-21T09:03:16.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.001+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.001+0000 7f6dd8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.001+0000 7f6dd8b40800 20 started sync module instance, tier type = 2024-09-21T09:03:16.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.001+0000 7f6dd8b40800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:16.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.001+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb353b20 con 0x7f6dc403a040 2024-09-21T09:03:16.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.002+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.002+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93861598019664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb353b20 con 0x7f6dc403a040 2024-09-21T09:03:16.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.002+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb355440 con 0x555ddb345fd0 2024-09-21T09:03:16.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.003+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93861598019664] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.003+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.003+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93861598017136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb355440 con 0x555ddb345fd0 2024-09-21T09:03:16.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.003+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb355ec0 con 0x555ddb34f350 2024-09-21T09:03:16.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.004+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.004+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93861598026160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb356790 con 0x555ddb34f350 2024-09-21T09:03:16.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.004+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb357280 con 0x7f6dc403a040 2024-09-21T09:03:16.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.004+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93861598017136] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.005+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.005+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93861598031184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb357670 con 0x7f6dc403a040 2024-09-21T09:03:16.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.005+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93861598026160] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.005+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb358070 con 0x555ddb345fd0 2024-09-21T09:03:16.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.006+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93861598031184] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.006+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.006+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93861598028592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb357b80 con 0x555ddb345fd0 2024-09-21T09:03:16.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.006+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb358540 con 0x555ddb34a9e0 2024-09-21T09:03:16.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.007+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.007+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93861598036112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb3584f0 con 0x555ddb34a9e0 2024-09-21T09:03:16.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.007+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb3594f0 con 0x555ddb34a9e0 2024-09-21T09:03:16.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.008+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93861598028592] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.008+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93861598036112] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.009+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.009+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93861598023568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb359000 con 0x555ddb34a9e0 2024-09-21T09:03:16.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.009+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb359a00 con 0x555ddb34a9e0 2024-09-21T09:03:16.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.010+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93861598023568] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.010+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.010+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93861598038240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb3599c0 con 0x555ddb34a9e0 2024-09-21T09:03:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.010+0000 7f6dd8b40800 20 add_watcher() i=0 2024-09-21T09:03:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.010+0000 7f6dd8b40800 20 add_watcher() i=1 2024-09-21T09:03:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.010+0000 7f6dd8b40800 20 add_watcher() i=2 2024-09-21T09:03:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.010+0000 7f6dd8b40800 20 add_watcher() i=3 2024-09-21T09:03:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.010+0000 7f6dd8b40800 20 add_watcher() i=4 2024-09-21T09:03:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.010+0000 7f6dd8b40800 20 add_watcher() i=5 2024-09-21T09:03:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.010+0000 7f6dd8b40800 20 add_watcher() i=6 2024-09-21T09:03:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.011+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93861598038240] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.011+0000 7f6dd8b40800 20 add_watcher() i=7 2024-09-21T09:03:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.011+0000 7f6dd8b40800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.011+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb35ce20 con 0x555ddb345fd0 2024-09-21T09:03:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.011+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.011+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93861598041824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb35a370 con 0x555ddb345fd0 2024-09-21T09:03:16.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.012+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93861598041824] v29'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.012+0000 7f6c8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:16.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.012+0000 7f6dd8b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:16.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.012+0000 7f6dd8b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:16.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.012+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb3658b0 con 0x555ddb345fd0 2024-09-21T09:03:16.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.013+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.013+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb365f80 con 0x555ddb34a9e0 2024-09-21T09:03:16.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.014+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.015+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb365f80 con 0x555ddb34f350 2024-09-21T09:03:16.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.015+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.016+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb366830 con 0x555ddb345fd0 2024-09-21T09:03:16.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.016+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.016+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb3615b0 con 0x7f6dc403a040 2024-09-21T09:03:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.017+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.017+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb3615b0 con 0x555ddb34f350 2024-09-21T09:03:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.018+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'15 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.018+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb3677e0 con 0x555ddb345fd0 2024-09-21T09:03:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.020+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.020+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb3677e0 con 0x555ddb34a9e0 2024-09-21T09:03:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.021+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'15 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.021+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb3677e0 con 0x7f6dc403a040 2024-09-21T09:03:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.022+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.022+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367870 con 0x555ddb34f350 2024-09-21T09:03:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.023+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.023+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367900 con 0x7f6dc403a040 2024-09-21T09:03:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.024+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.024+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367990 con 0x555ddb34a9e0 2024-09-21T09:03:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.025+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.025+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x7f6dc403a040 2024-09-21T09:03:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.025+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.026+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb34a9e0 2024-09-21T09:03:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.027+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'21 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.027+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb345fd0 2024-09-21T09:03:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.028+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.028+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb34f350 2024-09-21T09:03:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.029+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.029+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x7f6dc403a040 2024-09-21T09:03:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.030+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.030+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb34f350 2024-09-21T09:03:16.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.031+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.031+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb345fd0 2024-09-21T09:03:16.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.032+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.032+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb345fd0 2024-09-21T09:03:16.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.033+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.033+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb34f350 2024-09-21T09:03:16.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.034+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.034+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x7f6dc403a040 2024-09-21T09:03:16.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.035+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.035+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb34f350 2024-09-21T09:03:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.036+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.036+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb34f350 2024-09-21T09:03:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.037+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.037+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb34f350 2024-09-21T09:03:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.037+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.037+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb34f350 2024-09-21T09:03:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.038+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.038+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb34a9e0 2024-09-21T09:03:16.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.039+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.039+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb34f350 2024-09-21T09:03:16.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.040+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.040+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb34a9e0 2024-09-21T09:03:16.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.042+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.042+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb34f350 2024-09-21T09:03:16.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.043+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.043+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x555ddb34a9e0 2024-09-21T09:03:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.044+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.044+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb367ac0 con 0x7f6dc403a040 2024-09-21T09:03:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.045+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.045+0000 7f6c8a7e4640 20 reqs_thread_entry: start 2024-09-21T09:03:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.045+0000 7f6dd8b40800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.045+0000 7f6dd8b40800 20 Filter name: none 2024-09-21T09:03:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.046+0000 7f6c83fff640 20 reqs_thread_entry: start 2024-09-21T09:03:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.046+0000 7f6dd8b40800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-21T09:03:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.046+0000 7f6dd8b40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.046+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555ddb392f30 con 0x555ddb34a9e0 2024-09-21T09:03:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.046+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.046+0000 7f6dd8b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.046+0000 7f6dd8b40800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-21T09:03:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.046+0000 7f6dd8b40800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-21T09:03:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:could not remove user: unable to remove user, user does not exist 2024-09-21T09:03:16.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.047+0000 7f6c8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:16.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.047+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93861598041824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb364740 con 0x555ddb345fd0 2024-09-21T09:03:16.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.048+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93861598041824] v29'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.048+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93861598019664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb3596b0 con 0x7f6dc403a040 2024-09-21T09:03:16.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.049+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93861598019664] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.049+0000 7f6dd8b40800 20 remove_watcher() i=0 2024-09-21T09:03:16.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.049+0000 7f6dd8b40800 2 removed watcher, disabling cache 2024-09-21T09:03:16.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.049+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93861598017136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb354050 con 0x555ddb345fd0 2024-09-21T09:03:16.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.050+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93861598017136] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.050+0000 7f6dd8b40800 20 remove_watcher() i=1 2024-09-21T09:03:16.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.050+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93861598026160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb353670 con 0x555ddb34f350 2024-09-21T09:03:16.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.051+0000 7f6dd48d1640 1 -- 172.21.15.178:0/3016437320 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93861598026160] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc402dcf0 con 0x555ddb34f350 2024-09-21T09:03:16.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.051+0000 7f6dd8b40800 20 remove_watcher() i=2 2024-09-21T09:03:16.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.051+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93861598031184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb353670 con 0x7f6dc403a040 2024-09-21T09:03:16.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.052+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93861598031184] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x7f6dc403a040 2024-09-21T09:03:16.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.052+0000 7f6dd8b40800 20 remove_watcher() i=3 2024-09-21T09:03:16.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.052+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93861598028592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb356d50 con 0x555ddb345fd0 2024-09-21T09:03:16.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.053+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93861598028592] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc051070 con 0x555ddb345fd0 2024-09-21T09:03:16.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.053+0000 7f6dd8b40800 20 remove_watcher() i=4 2024-09-21T09:03:16.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.053+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93861598036112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb353670 con 0x555ddb34a9e0 2024-09-21T09:03:16.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.054+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93861598036112] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.054+0000 7f6dd8b40800 20 remove_watcher() i=5 2024-09-21T09:03:16.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.054+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93861598023568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb358090 con 0x555ddb34a9e0 2024-09-21T09:03:16.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.055+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93861598023568] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.055+0000 7f6dd8b40800 20 remove_watcher() i=6 2024-09-21T09:03:16.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.055+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93861598038240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555ddb353670 con 0x555ddb34a9e0 2024-09-21T09:03:16.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd50d2640 1 -- 172.21.15.178:0/3016437320 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93861598038240] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd002a070 con 0x555ddb34a9e0 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 20 remove_watcher() i=7 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555ddb34a9e0 msgr2=0x555ddb34cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555ddb34a9e0 0x555ddb34cdd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555ddb345fd0 msgr2=0x555ddb348490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555ddb345fd0 0x555ddb348490 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6dc403a040 msgr2=0x7f6dc403f5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6dc403a040 0x7f6dc403f5f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x555ddb34f350 msgr2=0x555ddb351810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x555ddb34f350 0x555ddb351810 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ca0036b90 msgr2=0x7f6ca0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ca0036b90 0x7f6ca0039050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4044710 tx=0x7f6dc4036000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb332e60 msgr2=0x555ddb33a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dcc0d0640 1 -- 172.21.15.178:0/3016437320 reap_dead start 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb332e60 0x555ddb33a370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6dd004cb80 tx=0x7f6dd004cb10 comp rx=0 tx=0).stop 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 shutdown_connections 2024-09-21T09:03:16.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/3016437320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb332e60 0x555ddb33a370 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 >> 172.21.15.178:0/3016437320 conn(0x555ddb32f250 msgr2=0x555ddb32d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 shutdown_connections 2024-09-21T09:03:16.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/3016437320 wait complete. 2024-09-21T09:03:16.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/674692599 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cac036b40 msgr2=0x7f6cac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/674692599 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cac036b40 0x7f6cac039000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x555ddb312f10 tx=0x7f6dc404b080 comp rx=0 tx=0).stop 2024-09-21T09:03:16.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/674692599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb326220 msgr2=0x555ddb326640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/674692599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb326220 0x555ddb326640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x555ddb30c530 tx=0x7f6dd00188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/674692599 shutdown_connections 2024-09-21T09:03:16.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/674692599 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cac036b40 0x7f6cac039000 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/674692599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb326220 0x555ddb326640 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/674692599 >> 172.21.15.178:0/674692599 conn(0x555ddb31b1b0 msgr2=0x555ddb31dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.056+0000 7f6dd8b40800 1 -- 172.21.15.178:0/674692599 shutdown_connections 2024-09-21T09:03:16.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 -- 172.21.15.178:0/674692599 wait complete. 2024-09-21T09:03:16.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555ddb314dd0 msgr2=0x555ddb3171c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555ddb314dd0 0x555ddb3171c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555ddb218db0 msgr2=0x555ddb3124f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555ddb218db0 0x555ddb3124f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cbc036b40 msgr2=0x7f6cbc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cbc036b40 0x7f6cbc039000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc057000 tx=0x7f6dbc052000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb1865f0 msgr2=0x555ddb30b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb1865f0 0x555ddb30b480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400b7c0 tx=0x7f6dc4000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 shutdown_connections 2024-09-21T09:03:16.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555ddb314dd0 0x555ddb3171c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555ddb218db0 0x555ddb3124f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cbc036b40 0x7f6cbc039000 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 --2- 172.21.15.178:0/1345342620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555ddb1865f0 0x555ddb30b480 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 >> 172.21.15.178:0/1345342620 conn(0x555ddb20cde0 msgr2=0x555ddb2fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 shutdown_connections 2024-09-21T09:03:16.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.057+0000 7f6dd8b40800 1 -- 172.21.15.178:0/1345342620 wait complete. 2024-09-21T09:03:16.067 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-21T09:03:16.067 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-21T09:03:16.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-21T09:03:16.068 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-21T09:03:16.112 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:16.112 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:16.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.111+0000 7f6d8820f800 1 Processor -- start 2024-09-21T09:03:16.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.111+0000 7f6d8820f800 1 -- start start 2024-09-21T09:03:16.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.111+0000 7f6d8820f800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x560e3cc41760 0x560e3cc41b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.111+0000 7f6d8820f800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560e3cb00b30 con 0x560e3cc420a0 2024-09-21T09:03:16.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.111+0000 7f6d8820f800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x560e3cae2360 con 0x560e3cc41760 2024-09-21T09:03:16.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.111+0000 7f6d85d03640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x560e3cc41760 0x560e3cc41b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.111+0000 7f6d85d03640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x560e3cc41760 0x560e3cc41b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55652/0 (socket says 172.21.15.178:55652) 2024-09-21T09:03:16.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.111+0000 7f6d85d03640 1 -- 172.21.15.178:0/2211945626 learned_addr learned my addr 172.21.15.178:0/2211945626 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.111+0000 7f6d85502640 1 --1- 172.21.15.178:0/2211945626 >> v1:172.21.15.44:6789/0 conn(0x560e3cc420a0 0x560e3cc46ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:58302/0 (socket says 172.21.15.178:58302) 2024-09-21T09:03:16.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.112+0000 7f6d85d03640 1 -- 172.21.15.178:0/2211945626 >> v1:172.21.15.44:6789/0 conn(0x560e3cc420a0 legacy=0x560e3cc46ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.112+0000 7f6d85d03640 1 -- 172.21.15.178:0/2211945626 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3cb08e00 con 0x560e3cc41760 2024-09-21T09:03:16.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.113+0000 7f6d85d03640 1 --2- 172.21.15.178:0/2211945626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cc41b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800a520 tx=0x7f6d78045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee6da99709ba4f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.113+0000 7f6d84d01640 1 -- 172.21.15.178:0/2211945626 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d78055070 con 0x560e3cc41760 2024-09-21T09:03:16.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.114+0000 7f6d84d01640 1 -- 172.21.15.178:0/2211945626 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d780515b0 con 0x560e3cc41760 2024-09-21T09:03:16.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.114+0000 7f6d84d01640 1 -- 172.21.15.178:0/2211945626 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d780518d0 con 0x560e3cc41760 2024-09-21T09:03:16.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.114+0000 7f6d8820f800 1 -- 172.21.15.178:0/2211945626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 msgr2=0x560e3cc41b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.114+0000 7f6d8820f800 1 --2- 172.21.15.178:0/2211945626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cc41b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800a520 tx=0x7f6d78045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.114+0000 7f6d8820f800 1 -- 172.21.15.178:0/2211945626 shutdown_connections 2024-09-21T09:03:16.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.114+0000 7f6d8820f800 1 --2- 172.21.15.178:0/2211945626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cc41b60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.114+0000 7f6d8820f800 1 -- 172.21.15.178:0/2211945626 >> 172.21.15.178:0/2211945626 conn(0x560e3cc3cff0 msgr2=0x560e3cc3f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.114+0000 7f6d8820f800 1 -- 172.21.15.178:0/2211945626 shutdown_connections 2024-09-21T09:03:16.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.114+0000 7f6d8820f800 1 -- 172.21.15.178:0/2211945626 wait complete. 2024-09-21T09:03:16.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.128+0000 7f6d8820f800 1 Processor -- start 2024-09-21T09:03:16.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.128+0000 7f6d8820f800 1 -- start start 2024-09-21T09:03:16.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.128+0000 7f6d8820f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cbb76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.128+0000 7f6d8820f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560e3cb8d330 con 0x560e3cc41760 2024-09-21T09:03:16.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.128+0000 7f6d85d03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cbb76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.128+0000 7f6d85d03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cbb76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55664/0 (socket says 172.21.15.178:55664) 2024-09-21T09:03:16.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.128+0000 7f6d85d03640 1 -- 172.21.15.178:0/4081107607 learned_addr learned my addr 172.21.15.178:0/4081107607 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.128+0000 7f6d85d03640 1 -- 172.21.15.178:0/4081107607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3cadabc0 con 0x560e3cc41760 2024-09-21T09:03:16.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.129+0000 7f6d85d03640 1 --2- 172.21.15.178:0/4081107607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cbb76c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6d78025da0 tx=0x7f6d78051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78aebfdbceb2cda1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.129+0000 7f6c73e07640 1 -- 172.21.15.178:0/4081107607 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d78051950 con 0x560e3cc41760 2024-09-21T09:03:16.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.129+0000 7f6c73e07640 1 -- 172.21.15.178:0/4081107607 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d78051af0 con 0x560e3cc41760 2024-09-21T09:03:16.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.129+0000 7f6c73e07640 1 -- 172.21.15.178:0/4081107607 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d78051dd0 con 0x560e3cc41760 2024-09-21T09:03:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.130+0000 7f6d8820f800 1 -- 172.21.15.178:0/4081107607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 msgr2=0x560e3cbb76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.130+0000 7f6d8820f800 1 --2- 172.21.15.178:0/4081107607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cbb76c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6d78025da0 tx=0x7f6d78051000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.130+0000 7f6d8820f800 1 -- 172.21.15.178:0/4081107607 shutdown_connections 2024-09-21T09:03:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.130+0000 7f6d8820f800 1 --2- 172.21.15.178:0/4081107607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cbb76c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.130+0000 7f6d8820f800 1 -- 172.21.15.178:0/4081107607 >> 172.21.15.178:0/4081107607 conn(0x560e3cc3cff0 msgr2=0x560e3cd2c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.130+0000 7f6d8820f800 1 -- 172.21.15.178:0/4081107607 shutdown_connections 2024-09-21T09:03:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.130+0000 7f6d8820f800 1 -- 172.21.15.178:0/4081107607 wait complete. 2024-09-21T09:03:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.130+0000 7f6d8820f800 1 Processor -- start 2024-09-21T09:03:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.130+0000 7f6d8820f800 1 -- start start 2024-09-21T09:03:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.130+0000 7f6d8820f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cd3a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.130+0000 7f6d8820f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560e3cc48640 con 0x560e3cc41760 2024-09-21T09:03:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.130+0000 7f6d85d03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cd3a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.130+0000 7f6d85d03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cd3a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55674/0 (socket says 172.21.15.178:55674) 2024-09-21T09:03:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.130+0000 7f6d85d03640 1 -- 172.21.15.178:0/2218393727 learned_addr learned my addr 172.21.15.178:0/2218393727 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.131+0000 7f6d85d03640 1 -- 172.21.15.178:0/2218393727 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3caeefe0 con 0x560e3cc41760 2024-09-21T09:03:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.131+0000 7f6d85d03640 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cd3a3a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6d78067040 tx=0x7f6d78002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.131+0000 7f6c72604640 1 -- 172.21.15.178:0/2218393727 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d78073070 con 0x560e3cc41760 2024-09-21T09:03:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.131+0000 7f6c72604640 1 -- 172.21.15.178:0/2218393727 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7805a450 con 0x560e3cc41760 2024-09-21T09:03:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.131+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e3cd3a8e0 con 0x560e3cc41760 2024-09-21T09:03:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.131+0000 7f6c72604640 1 -- 172.21.15.178:0/2218393727 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d7805a730 con 0x560e3cc41760 2024-09-21T09:03:16.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.131+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e3cd3ae60 con 0x560e3cc41760 2024-09-21T09:03:16.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.132+0000 7f6c72604640 1 -- 172.21.15.178:0/2218393727 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6d78076070 con 0x560e3cc41760 2024-09-21T09:03:16.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.132+0000 7f6c72604640 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c6c036b90 0x7f6c6c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.132+0000 7f6c72604640 1 -- 172.21.15.178:0/2218393727 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6d78062070 con 0x560e3cc41760 2024-09-21T09:03:16.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.132+0000 7f6d85502640 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c6c036b90 0x7f6c6c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.132+0000 7f6d8820f800 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560e3cc420a0 0x560e3cd41410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.132+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd41990 con 0x560e3cc420a0 2024-09-21T09:03:16.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.132+0000 7f6d86504640 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560e3cc420a0 0x560e3cd41410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.133+0000 7f6d85502640 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c6c036b90 0x7f6c6c039050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c000f60 tx=0x7f6d7c001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.133+0000 7f6d86504640 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560e3cc420a0 0x560e3cd41410 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.133+0000 7f6d86504640 1 -- 172.21.15.178:0/2218393727 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d8000a4a0 con 0x560e3cc420a0 2024-09-21T09:03:16.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.133+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd3e9e0 con 0x560e3cc420a0 2024-09-21T09:03:16.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.133+0000 7f6d86504640 1 -- 172.21.15.178:0/2218393727 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d8000a4a0 con 0x560e3cc420a0 2024-09-21T09:03:16.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.133+0000 7f6d8820f800 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560e3cd43cc0 0x560e3cd460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.133+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd467a0 con 0x560e3cd43cc0 2024-09-21T09:03:16.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.133+0000 7f6d85d03640 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560e3cd43cc0 0x560e3cd460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.134+0000 7f6d85d03640 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560e3cd43cc0 0x560e3cd460b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.134+0000 7f6d85d03640 1 -- 172.21.15.178:0/2218393727 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd43cc0 2024-09-21T09:03:16.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.134+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd42b60 con 0x560e3cc420a0 2024-09-21T09:03:16.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.134+0000 7f6d86504640 1 -- 172.21.15.178:0/2218393727 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d8000a4a0 con 0x560e3cc420a0 2024-09-21T09:03:16.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.134+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd43040 con 0x560e3cc420a0 2024-09-21T09:03:16.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.135+0000 7f6d86504640 1 -- 172.21.15.178:0/2218393727 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d8000a4a0 con 0x560e3cc420a0 2024-09-21T09:03:16.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.135+0000 7f6d8820f800 1 Processor -- start 2024-09-21T09:03:16.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.135+0000 7f6d8820f800 1 -- start start 2024-09-21T09:03:16.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.135+0000 7f6d8820f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd55120 0x560e3cd55540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.135+0000 7f6d8820f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560e3cadc580 con 0x560e3cd55120 2024-09-21T09:03:16.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.135+0000 7f6d86504640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd55120 0x560e3cd55540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.135+0000 7f6d86504640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd55120 0x560e3cd55540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55682/0 (socket says 172.21.15.178:55682) 2024-09-21T09:03:16.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.135+0000 7f6d86504640 1 -- 172.21.15.178:0/621100301 learned_addr learned my addr 172.21.15.178:0/621100301 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.136+0000 7f6d86504640 1 -- 172.21.15.178:0/621100301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3cd55a80 con 0x560e3cd55120 2024-09-21T09:03:16.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.136+0000 7f6d86504640 1 --2- 172.21.15.178:0/621100301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd55120 0x560e3cd55540 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x560e3cd41d70 tx=0x7f6d80018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.136+0000 7f6c6b7fe640 1 -- 172.21.15.178:0/621100301 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d80014450 con 0x560e3cd55120 2024-09-21T09:03:16.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.136+0000 7f6c6b7fe640 1 -- 172.21.15.178:0/621100301 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d80014610 con 0x560e3cd55120 2024-09-21T09:03:16.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.136+0000 7f6d8820f800 1 -- 172.21.15.178:0/621100301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e3cd55d10 con 0x560e3cd55120 2024-09-21T09:03:16.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.136+0000 7f6c6b7fe640 1 -- 172.21.15.178:0/621100301 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d80014930 con 0x560e3cd55120 2024-09-21T09:03:16.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.136+0000 7f6d8820f800 1 -- 172.21.15.178:0/621100301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e3cd589f0 con 0x560e3cd55120 2024-09-21T09:03:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.137+0000 7f6c6b7fe640 1 -- 172.21.15.178:0/621100301 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6d80011040 con 0x560e3cd55120 2024-09-21T09:03:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.137+0000 7f6c6b7fe640 1 --2- 172.21.15.178:0/621100301 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c60036b90 0x7f6c60039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.137+0000 7f6c6b7fe640 1 -- 172.21.15.178:0/621100301 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6d8001e070 con 0x560e3cd55120 2024-09-21T09:03:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.137+0000 7f6d85d03640 1 --2- 172.21.15.178:0/621100301 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c60036b90 0x7f6c60039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.137+0000 7f6d8820f800 1 Processor -- start 2024-09-21T09:03:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.137+0000 7f6d8820f800 1 -- start start 2024-09-21T09:03:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.137+0000 7f6d85d03640 1 --2- 172.21.15.178:0/621100301 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c60036b90 0x7f6c60039050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x560e3cd41e10 tx=0x7f6d780643b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.137+0000 7f6d8820f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd61d50 0x560e3cd62150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.137+0000 7f6d8820f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560e3cbb5ca0 con 0x560e3cd61d50 2024-09-21T09:03:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.138+0000 7f6d86504640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd61d50 0x560e3cd62150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.138+0000 7f6d86504640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd61d50 0x560e3cd62150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55690/0 (socket says 172.21.15.178:55690) 2024-09-21T09:03:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.138+0000 7f6d86504640 1 -- 172.21.15.178:0/2640691782 learned_addr learned my addr 172.21.15.178:0/2640691782 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.138+0000 7f6d86504640 1 -- 172.21.15.178:0/2640691782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3cd62720 con 0x560e3cd61d50 2024-09-21T09:03:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.138+0000 7f6d86504640 1 --2- 172.21.15.178:0/2640691782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd61d50 0x560e3cd62150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6d8004cb90 tx=0x7f6d80011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec390a1378a8a894 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.138+0000 7f6c697fa640 1 -- 172.21.15.178:0/2640691782 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d80044070 con 0x560e3cd61d50 2024-09-21T09:03:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.138+0000 7f6c697fa640 1 -- 172.21.15.178:0/2640691782 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d800167c0 con 0x560e3cd61d50 2024-09-21T09:03:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.138+0000 7f6c697fa640 1 -- 172.21.15.178:0/2640691782 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d80013ca0 con 0x560e3cd61d50 2024-09-21T09:03:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.139+0000 7f6d8820f800 1 -- 172.21.15.178:0/2640691782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd61d50 msgr2=0x560e3cd62150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.139+0000 7f6d8820f800 1 --2- 172.21.15.178:0/2640691782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd61d50 0x560e3cd62150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6d8004cb90 tx=0x7f6d80011700 comp rx=0 tx=0).stop 2024-09-21T09:03:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.139+0000 7f6d8820f800 1 -- 172.21.15.178:0/2640691782 shutdown_connections 2024-09-21T09:03:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.139+0000 7f6d8820f800 1 --2- 172.21.15.178:0/2640691782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd61d50 0x560e3cd62150 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.139+0000 7f6d8820f800 1 -- 172.21.15.178:0/2640691782 >> 172.21.15.178:0/2640691782 conn(0x560e3cd5e100 msgr2=0x560e3cd5c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.139+0000 7f6d8820f800 1 -- 172.21.15.178:0/2640691782 shutdown_connections 2024-09-21T09:03:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.139+0000 7f6d8820f800 1 -- 172.21.15.178:0/2640691782 wait complete. 2024-09-21T09:03:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.139+0000 7f6d8820f800 1 Processor -- start 2024-09-21T09:03:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.139+0000 7f6d8820f800 1 -- start start 2024-09-21T09:03:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.139+0000 7f6d8820f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd61d50 0x560e3cd691f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.139+0000 7f6d8820f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560e3cd62cf0 con 0x560e3cd61d50 2024-09-21T09:03:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.139+0000 7f6d86504640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd61d50 0x560e3cd691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.140+0000 7f6d86504640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd61d50 0x560e3cd691f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55696/0 (socket says 172.21.15.178:55696) 2024-09-21T09:03:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.140+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 learned_addr learned my addr 172.21.15.178:0/3626289376 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.140+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3cd69730 con 0x560e3cd61d50 2024-09-21T09:03:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.140+0000 7f6d86504640 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd61d50 0x560e3cd691f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6d8004bab0 tx=0x7f6d8004cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.140+0000 7f6c577fe640 1 -- 172.21.15.178:0/3626289376 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d80016440 con 0x560e3cd61d50 2024-09-21T09:03:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.140+0000 7f6c577fe640 1 -- 172.21.15.178:0/3626289376 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d8004e2e0 con 0x560e3cd61d50 2024-09-21T09:03:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.140+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e3cd699c0 con 0x560e3cd61d50 2024-09-21T09:03:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.140+0000 7f6c577fe640 1 -- 172.21.15.178:0/3626289376 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d80022a50 con 0x560e3cd61d50 2024-09-21T09:03:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.140+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e3cd6c670 con 0x560e3cd61d50 2024-09-21T09:03:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.141+0000 7f6c577fe640 1 -- 172.21.15.178:0/3626289376 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6d8003e020 con 0x560e3cd61d50 2024-09-21T09:03:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.141+0000 7f6c577fe640 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c50036b90 0x7f6c50039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.141+0000 7f6c577fe640 1 -- 172.21.15.178:0/3626289376 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6d8003c020 con 0x560e3cd61d50 2024-09-21T09:03:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.141+0000 7f6d85d03640 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c50036b90 0x7f6c50039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.142+0000 7f6d85d03640 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c50036b90 0x7f6c50039050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6d78064520 tx=0x7f6d78084000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.142+0000 7f6d8820f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.142+0000 7f6d8820f800 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560e3cd74ea0 0x560e3cd77360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.142+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd77ab0 con 0x560e3cd74ea0 2024-09-21T09:03:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.142+0000 7f6d85502640 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560e3cd74ea0 0x560e3cd77360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.142+0000 7f6d85502640 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560e3cd74ea0 0x560e3cd77360 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.142+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d7c00f610 con 0x560e3cd74ea0 2024-09-21T09:03:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.142+0000 7f6d8820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.142+0000 7f6d8820f800 20 realm 2024-09-21T09:03:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.142+0000 7f6d8820f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.142+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd742f0 con 0x560e3cd74ea0 2024-09-21T09:03:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d7c00f610 con 0x560e3cd74ea0 2024-09-21T09:03:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d8820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d8820f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d8820f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd785a0 con 0x560e3cd74ea0 2024-09-21T09:03:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d7c00f610 con 0x560e3cd74ea0 2024-09-21T09:03:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d8820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d8820f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd78e70 con 0x560e3cd74ea0 2024-09-21T09:03:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d7c00f610 con 0x560e3cd74ea0 2024-09-21T09:03:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d8820f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d8820f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d8820f800 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560e3cd79890 0x560e3cd7bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd79890 2024-09-21T09:03:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.143+0000 7f6d86504640 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560e3cd79890 0x560e3cd7bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.144+0000 7f6d86504640 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560e3cd79890 0x560e3cd7bc80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.144+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.144+0000 7f6d8820f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.144+0000 7f6d8820f800 20 searching for the correct realm 2024-09-21T09:03:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.144+0000 7f6d8820f800 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x560e3cd7e340 0x560e3cd80800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.144+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd80ed0 con 0x560e3cd7e340 2024-09-21T09:03:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.145+0000 7f6d85d03640 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x560e3cd7e340 0x560e3cd80800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.145+0000 7f6d85d03640 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x560e3cd7e340 0x560e3cd80800 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.145+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.145+0000 7f6d85d03640 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6d78078070 0x7f6d7808f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.145+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd80ed0 con 0x7f6d78078070 2024-09-21T09:03:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.145+0000 7f6d85502640 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6d78078070 0x7f6d7808f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.145+0000 7f6d85502640 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6d78078070 0x7f6d7808f670 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.146+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c00f610 con 0x7f6d78078070 2024-09-21T09:03:16.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.146+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd80ed0 con 0x560e3cd79890 2024-09-21T09:03:16.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.146+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.146+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd74ea0 2024-09-21T09:03:16.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.146+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c00f610 con 0x560e3cd74ea0 2024-09-21T09:03:16.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.146+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd74ea0 2024-09-21T09:03:16.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.147+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.147+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd79890 2024-09-21T09:03:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.147+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.147+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd79890 2024-09-21T09:03:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.147+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.147+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x7f6d78078070 2024-09-21T09:03:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.147+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.147+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd7e340 2024-09-21T09:03:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.148+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.148+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd74ea0 2024-09-21T09:03:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.148+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.148+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd79890 2024-09-21T09:03:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.148+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.148+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd74ea0 2024-09-21T09:03:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.148+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.148+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x7f6d78078070 2024-09-21T09:03:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.149+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.149+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd7e340 2024-09-21T09:03:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.149+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.149+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd7e340 2024-09-21T09:03:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.149+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.149+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd79890 2024-09-21T09:03:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.149+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.149+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd7e340 2024-09-21T09:03:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.150+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.150+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd7e340 2024-09-21T09:03:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.150+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.150+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd74ea0 2024-09-21T09:03:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.150+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.150+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd74ea0 2024-09-21T09:03:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.150+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.150+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd79890 2024-09-21T09:03:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.151+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.151+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd7e340 2024-09-21T09:03:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.151+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.151+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x7f6d78078070 2024-09-21T09:03:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.151+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.151+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd74ea0 2024-09-21T09:03:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.151+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.151+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd79890 2024-09-21T09:03:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.152+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.152+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd7e340 2024-09-21T09:03:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.152+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.152+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd79890 2024-09-21T09:03:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.152+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.152+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x7f6d78078070 2024-09-21T09:03:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.152+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.153+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd7e340 2024-09-21T09:03:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.153+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.153+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd79890 2024-09-21T09:03:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.153+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.153+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x560e3cd74ea0 2024-09-21T09:03:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.153+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.153+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7c370 con 0x7f6d78078070 2024-09-21T09:03:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.153+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.153+0000 7f6d8820f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7cc30 con 0x560e3cd74ea0 2024-09-21T09:03:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7d020 con 0x560e3cd74ea0 2024-09-21T09:03:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd7d440 con 0x560e3cd74ea0 2024-09-21T09:03:16.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:16.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 20 zone default found 2024-09-21T09:03:16.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 4 Realm: () 2024-09-21T09:03:16.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:16.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:16.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:16.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 20 zonegroup default 2024-09-21T09:03:16.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.154+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd81350 con 0x560e3cd79890 2024-09-21T09:03:16.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.155+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.155+0000 7f6d8820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.155+0000 7f6d8820f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.155+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd83160 con 0x560e3cd7e340 2024-09-21T09:03:16.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.155+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.155+0000 7f6d8820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.155+0000 7f6d8820f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.155+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd83610 con 0x560e3cd7e340 2024-09-21T09:03:16.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.155+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.155+0000 7f6d8820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.155+0000 7f6d8820f800 20 started sync module instance, tier type = 2024-09-21T09:03:16.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.155+0000 7f6d8820f800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:16.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.155+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd82570 con 0x7f6d78078070 2024-09-21T09:03:16.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.156+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.156+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94619150330480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd82570 con 0x7f6d78078070 2024-09-21T09:03:16.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.156+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd84090 con 0x560e3cd74ea0 2024-09-21T09:03:16.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.157+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94619150330480] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.157+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.157+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94619150335424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd82570 con 0x560e3cd74ea0 2024-09-21T09:03:16.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.157+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd84ae0 con 0x560e3cd7e340 2024-09-21T09:03:16.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.158+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94619150335424] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.159+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.159+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94619150328000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd824e0 con 0x560e3cd7e340 2024-09-21T09:03:16.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.159+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd858c0 con 0x7f6d78078070 2024-09-21T09:03:16.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.160+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.160+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94619150341040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd86160 con 0x7f6d78078070 2024-09-21T09:03:16.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.160+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd86c00 con 0x560e3cd74ea0 2024-09-21T09:03:16.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.160+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94619150328000] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.161+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.161+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94619150345936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd86bc0 con 0x560e3cd74ea0 2024-09-21T09:03:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.161+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd87610 con 0x560e3cd79890 2024-09-21T09:03:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.161+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94619150341040] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.162+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.162+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94619150343344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd87610 con 0x560e3cd79890 2024-09-21T09:03:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.162+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94619150345936] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.162+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd84f00 con 0x560e3cd79890 2024-09-21T09:03:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.163+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94619150343344] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.163+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.163+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94619150348640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd87580 con 0x560e3cd79890 2024-09-21T09:03:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.163+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd88570 con 0x560e3cd79890 2024-09-21T09:03:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.164+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94619150348640] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.164+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.164+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94619150351264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd88570 con 0x560e3cd79890 2024-09-21T09:03:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.164+0000 7f6d8820f800 20 add_watcher() i=0 2024-09-21T09:03:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.164+0000 7f6d8820f800 20 add_watcher() i=1 2024-09-21T09:03:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.164+0000 7f6d8820f800 20 add_watcher() i=2 2024-09-21T09:03:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.164+0000 7f6d8820f800 20 add_watcher() i=3 2024-09-21T09:03:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.164+0000 7f6d8820f800 20 add_watcher() i=4 2024-09-21T09:03:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.164+0000 7f6d8820f800 20 add_watcher() i=5 2024-09-21T09:03:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.164+0000 7f6d8820f800 20 add_watcher() i=6 2024-09-21T09:03:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.165+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94619150351264] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.165+0000 7f6d8820f800 20 add_watcher() i=7 2024-09-21T09:03:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.165+0000 7f6d8820f800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.165+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd8b9a0 con 0x560e3cd74ea0 2024-09-21T09:03:16.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.166+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.166+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94619150352320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd88ec0 con 0x560e3cd74ea0 2024-09-21T09:03:16.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.167+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94619150352320] v29'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.167+0000 7f6c377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:16.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.167+0000 7f6d8820f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:16.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.167+0000 7f6d8820f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:16.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.167+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd8b7e0 con 0x560e3cd74ea0 2024-09-21T09:03:16.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.168+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.168+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd94b50 con 0x560e3cd79890 2024-09-21T09:03:16.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.169+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.169+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd94b50 con 0x560e3cd7e340 2024-09-21T09:03:16.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.170+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.170+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd95610 con 0x560e3cd74ea0 2024-09-21T09:03:16.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.171+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.171+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd94140 con 0x7f6d78078070 2024-09-21T09:03:16.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.172+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.172+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd94140 con 0x560e3cd7e340 2024-09-21T09:03:16.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.173+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.173+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd95fa0 con 0x560e3cd74ea0 2024-09-21T09:03:16.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.174+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.174+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd95fa0 con 0x560e3cd79890 2024-09-21T09:03:16.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.175+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.175+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd95fa0 con 0x7f6d78078070 2024-09-21T09:03:16.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.176+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.176+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96030 con 0x560e3cd7e340 2024-09-21T09:03:16.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.177+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.177+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd965c0 con 0x7f6d78078070 2024-09-21T09:03:16.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.178+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.178+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96570 con 0x560e3cd79890 2024-09-21T09:03:16.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.179+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.179+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96570 con 0x7f6d78078070 2024-09-21T09:03:16.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.180+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.180+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd93a00 con 0x560e3cd79890 2024-09-21T09:03:16.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.182+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.182+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd93a00 con 0x560e3cd74ea0 2024-09-21T09:03:16.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.182+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.182+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96570 con 0x560e3cd7e340 2024-09-21T09:03:16.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.184+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.184+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96570 con 0x7f6d78078070 2024-09-21T09:03:16.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.185+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.185+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96570 con 0x560e3cd7e340 2024-09-21T09:03:16.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.186+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.186+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96640 con 0x560e3cd74ea0 2024-09-21T09:03:16.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.187+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.187+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96640 con 0x560e3cd74ea0 2024-09-21T09:03:16.189 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.187+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.189 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.187+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96640 con 0x560e3cd7e340 2024-09-21T09:03:16.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.188+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.188+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96640 con 0x7f6d78078070 2024-09-21T09:03:16.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.189+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.189+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96640 con 0x560e3cd7e340 2024-09-21T09:03:16.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.190+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.190+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96640 con 0x560e3cd7e340 2024-09-21T09:03:16.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.191+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.191+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96640 con 0x560e3cd7e340 2024-09-21T09:03:16.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.192+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.192+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96640 con 0x560e3cd7e340 2024-09-21T09:03:16.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.193+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.193+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96640 con 0x560e3cd79890 2024-09-21T09:03:16.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.194+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.194+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96640 con 0x560e3cd7e340 2024-09-21T09:03:16.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.195+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.195+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96640 con 0x560e3cd79890 2024-09-21T09:03:16.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.196+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.197+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96640 con 0x560e3cd7e340 2024-09-21T09:03:16.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.198+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.198+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96640 con 0x560e3cd79890 2024-09-21T09:03:16.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.199+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.199+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd96640 con 0x7f6d78078070 2024-09-21T09:03:16.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.200+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.200+0000 7f6c367fc640 20 reqs_thread_entry: start 2024-09-21T09:03:16.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.200+0000 7f6d8820f800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:16.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.200+0000 7f6d8820f800 20 Filter name: none 2024-09-21T09:03:16.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.200+0000 7f6ba7fff640 20 reqs_thread_entry: start 2024-09-21T09:03:16.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.200+0000 7f6d8820f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T09:03:16.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.200+0000 7f6d8820f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.200+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560e3cdc1640 con 0x560e3cd79890 2024-09-21T09:03:16.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.200+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.201+0000 7f6d8820f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.201+0000 7f6d8820f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-21T09:03:16.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.201+0000 7f6d8820f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T09:03:16.203 INFO:teuthology.orchestra.run.smithi178.stderr:could not remove user: unable to remove user, user does not exist 2024-09-21T09:03:16.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.201+0000 7f6c377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:16.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.201+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94619150352320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd94f90 con 0x560e3cd74ea0 2024-09-21T09:03:16.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.202+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94619150352320] v29'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.202+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94619150330480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd87fc0 con 0x7f6d78078070 2024-09-21T09:03:16.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.203+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94619150330480] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.203+0000 7f6d8820f800 20 remove_watcher() i=0 2024-09-21T09:03:16.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.203+0000 7f6d8820f800 2 removed watcher, disabling cache 2024-09-21T09:03:16.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.203+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94619150335424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd82a70 con 0x560e3cd74ea0 2024-09-21T09:03:16.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.205+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94619150335424] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.205+0000 7f6d8820f800 20 remove_watcher() i=1 2024-09-21T09:03:16.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.205+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94619150328000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd82a70 con 0x560e3cd7e340 2024-09-21T09:03:16.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.206+0000 7f6d85d03640 1 -- 172.21.15.178:0/3626289376 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94619150328000] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d78075030 con 0x560e3cd7e340 2024-09-21T09:03:16.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.206+0000 7f6d8820f800 20 remove_watcher() i=2 2024-09-21T09:03:16.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.206+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94619150341040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd82a70 con 0x7f6d78078070 2024-09-21T09:03:16.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.206+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94619150341040] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x7f6d78078070 2024-09-21T09:03:16.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.206+0000 7f6d8820f800 20 remove_watcher() i=3 2024-09-21T09:03:16.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.206+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94619150345936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd853b0 con 0x560e3cd74ea0 2024-09-21T09:03:16.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.208+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94619150345936] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02b040 con 0x560e3cd74ea0 2024-09-21T09:03:16.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.208+0000 7f6d8820f800 20 remove_watcher() i=4 2024-09-21T09:03:16.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.208+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94619150343344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd82a70 con 0x560e3cd79890 2024-09-21T09:03:16.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.210+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94619150343344] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.210+0000 7f6d8820f800 20 remove_watcher() i=5 2024-09-21T09:03:16.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.210+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94619150348640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd866d0 con 0x560e3cd79890 2024-09-21T09:03:16.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.211+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94619150348640] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.211+0000 7f6d8820f800 20 remove_watcher() i=6 2024-09-21T09:03:16.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.211+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94619150351264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560e3cd853b0 con 0x560e3cd79890 2024-09-21T09:03:16.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d86504640 1 -- 172.21.15.178:0/3626289376 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94619150351264] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8002a070 con 0x560e3cd79890 2024-09-21T09:03:16.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 20 remove_watcher() i=7 2024-09-21T09:03:16.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560e3cd79890 msgr2=0x560e3cd7bc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560e3cd79890 0x560e3cd7bc80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560e3cd74ea0 msgr2=0x560e3cd77360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560e3cd74ea0 0x560e3cd77360 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6d78078070 msgr2=0x7f6d7808f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6d78078070 0x7f6d7808f670 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x560e3cd7e340 msgr2=0x560e3cd80800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x560e3cd7e340 0x560e3cd80800 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c50036b90 msgr2=0x7f6c50039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c50036b90 0x7f6c50039050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6d78064520 tx=0x7f6d78084000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd61d50 msgr2=0x560e3cd691f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d85502640 1 -- 172.21.15.178:0/3626289376 reap_dead start 2024-09-21T09:03:16.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd61d50 0x560e3cd691f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6d8004bab0 tx=0x7f6d8004cb20 comp rx=0 tx=0).stop 2024-09-21T09:03:16.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 shutdown_connections 2024-09-21T09:03:16.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 --2- 172.21.15.178:0/3626289376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd61d50 0x560e3cd691f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.212+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 >> 172.21.15.178:0/3626289376 conn(0x560e3cd5e100 msgr2=0x560e3cd5c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 shutdown_connections 2024-09-21T09:03:16.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 -- 172.21.15.178:0/3626289376 wait complete. 2024-09-21T09:03:16.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 -- 172.21.15.178:0/621100301 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c60036b90 msgr2=0x7f6c60039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 --2- 172.21.15.178:0/621100301 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c60036b90 0x7f6c60039050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x560e3cd41e10 tx=0x7f6d780643b0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 -- 172.21.15.178:0/621100301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd55120 msgr2=0x560e3cd55540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 --2- 172.21.15.178:0/621100301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd55120 0x560e3cd55540 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x560e3cd41d70 tx=0x7f6d80018830 comp rx=0 tx=0).stop 2024-09-21T09:03:16.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 -- 172.21.15.178:0/621100301 shutdown_connections 2024-09-21T09:03:16.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 --2- 172.21.15.178:0/621100301 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c60036b90 0x7f6c60039050 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 --2- 172.21.15.178:0/621100301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cd55120 0x560e3cd55540 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 -- 172.21.15.178:0/621100301 >> 172.21.15.178:0/621100301 conn(0x560e3cd4a0b0 msgr2=0x560e3cd4cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 -- 172.21.15.178:0/621100301 shutdown_connections 2024-09-21T09:03:16.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 -- 172.21.15.178:0/621100301 wait complete. 2024-09-21T09:03:16.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560e3cd43cc0 msgr2=0x560e3cd460b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560e3cd43cc0 0x560e3cd460b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560e3cc420a0 msgr2=0x560e3cd41410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560e3cc420a0 0x560e3cd41410 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c6c036b90 msgr2=0x7f6c6c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c6c036b90 0x7f6c6c039050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c000f60 tx=0x7f6d7c001370 comp rx=0 tx=0).stop 2024-09-21T09:03:16.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 msgr2=0x560e3cd3a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cd3a3a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6d78067040 tx=0x7f6d78002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 shutdown_connections 2024-09-21T09:03:16.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560e3cd43cc0 0x560e3cd460b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560e3cc420a0 0x560e3cd41410 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6c6c036b90 0x7f6c6c039050 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 --2- 172.21.15.178:0/2218393727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e3cc41760 0x560e3cd3a3a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.213+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 >> 172.21.15.178:0/2218393727 conn(0x560e3cc3cff0 msgr2=0x560e3cbb61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.214+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 shutdown_connections 2024-09-21T09:03:16.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.214+0000 7f6d8820f800 1 -- 172.21.15.178:0/2218393727 wait complete. 2024-09-21T09:03:16.225 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-21T09:03:16.226 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-21T09:03:16.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-21T09:03:16.226 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-21T09:03:16.271 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:16.271 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:16.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.270+0000 7efe53333800 1 Processor -- start 2024-09-21T09:03:16.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.270+0000 7efe53333800 1 -- start start 2024-09-21T09:03:16.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.270+0000 7efe53333800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56469ba6edf0 0x56469bafe1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.270+0000 7efe53333800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56469b9bab30 con 0x56469bafe720 2024-09-21T09:03:16.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.270+0000 7efe53333800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x56469b99c360 con 0x56469ba6edf0 2024-09-21T09:03:16.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.270+0000 7efe4f024640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56469ba6edf0 0x56469bafe1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.270+0000 7efe47fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x56469bafe720 0x56469bb00b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:58304/0 (socket says 172.21.15.178:58304) 2024-09-21T09:03:16.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.270+0000 7efe47fff640 1 -- 172.21.15.178:0/4002044373 learned_addr learned my addr 172.21.15.178:0/4002044373 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:16.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.271+0000 7efe4f024640 1 -- 172.21.15.178:0/4002044373 >> v1:172.21.15.44:6789/0 conn(0x56469bafe720 legacy=0x56469bb00b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.271+0000 7efe4e823640 1 -- 172.21.15.178:0/4002044373 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1968643856 0 0) 0x56469b9bab30 con 0x56469bafe720 2024-09-21T09:03:16.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.271+0000 7efe4f024640 1 -- 172.21.15.178:0/4002044373 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56469b9c2e00 con 0x56469ba6edf0 2024-09-21T09:03:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.273+0000 7efe4f024640 1 --2- 172.21.15.178:0/4002044373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bafe1e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efe4000a470 tx=0x7efe40045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641e4e9b72fdfa64 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.273+0000 7efe4e823640 1 -- 172.21.15.178:0/4002044373 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe40053570 con 0x56469ba6edf0 2024-09-21T09:03:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.273+0000 7efe4e823640 1 -- 172.21.15.178:0/4002044373 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe40058070 con 0x56469ba6edf0 2024-09-21T09:03:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.273+0000 7efe4e823640 1 -- 172.21.15.178:0/4002044373 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe40053880 con 0x56469ba6edf0 2024-09-21T09:03:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.273+0000 7efe53333800 1 -- 172.21.15.178:0/4002044373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 msgr2=0x56469bafe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.273+0000 7efe53333800 1 --2- 172.21.15.178:0/4002044373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bafe1e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efe4000a470 tx=0x7efe40045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.273+0000 7efe53333800 1 -- 172.21.15.178:0/4002044373 shutdown_connections 2024-09-21T09:03:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.273+0000 7efe53333800 1 --2- 172.21.15.178:0/4002044373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bafe1e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.273+0000 7efe53333800 1 -- 172.21.15.178:0/4002044373 >> 172.21.15.178:0/4002044373 conn(0x56469baf5df0 msgr2=0x56469baf8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.273+0000 7efe53333800 1 -- 172.21.15.178:0/4002044373 shutdown_connections 2024-09-21T09:03:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.273+0000 7efe53333800 1 -- 172.21.15.178:0/4002044373 wait complete. 2024-09-21T09:03:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.287+0000 7efe53333800 1 Processor -- start 2024-09-21T09:03:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.287+0000 7efe53333800 1 -- start start 2024-09-21T09:03:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.287+0000 7efe53333800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bbea610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.287+0000 7efe53333800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56469ba47330 con 0x56469ba6edf0 2024-09-21T09:03:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.287+0000 7efe4f024640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bbea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.287+0000 7efe4f024640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bbea610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55716/0 (socket says 172.21.15.178:55716) 2024-09-21T09:03:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.287+0000 7efe4f024640 1 -- 172.21.15.178:0/1358645837 learned_addr learned my addr 172.21.15.178:0/1358645837 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.288+0000 7efe4f024640 1 -- 172.21.15.178:0/1358645837 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56469b994bc0 con 0x56469ba6edf0 2024-09-21T09:03:16.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.288+0000 7efe4f024640 1 --2- 172.21.15.178:0/1358645837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bbea610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efe40045f50 tx=0x7efe40051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1223119fb0280adc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.288+0000 7efd3d60a640 1 -- 172.21.15.178:0/1358645837 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe40053c20 con 0x56469ba6edf0 2024-09-21T09:03:16.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.288+0000 7efd3d60a640 1 -- 172.21.15.178:0/1358645837 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe40063030 con 0x56469ba6edf0 2024-09-21T09:03:16.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.288+0000 7efd3d60a640 1 -- 172.21.15.178:0/1358645837 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe40053440 con 0x56469ba6edf0 2024-09-21T09:03:16.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.289+0000 7efe53333800 1 -- 172.21.15.178:0/1358645837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 msgr2=0x56469bbea610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.289+0000 7efe53333800 1 --2- 172.21.15.178:0/1358645837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bbea610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efe40045f50 tx=0x7efe40051000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.289+0000 7efe53333800 1 -- 172.21.15.178:0/1358645837 shutdown_connections 2024-09-21T09:03:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.289+0000 7efe53333800 1 --2- 172.21.15.178:0/1358645837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bbea610 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.289+0000 7efe53333800 1 -- 172.21.15.178:0/1358645837 >> 172.21.15.178:0/1358645837 conn(0x56469baf5df0 msgr2=0x56469bbe5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.289+0000 7efe53333800 1 -- 172.21.15.178:0/1358645837 shutdown_connections 2024-09-21T09:03:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.289+0000 7efe53333800 1 -- 172.21.15.178:0/1358645837 wait complete. 2024-09-21T09:03:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.289+0000 7efe53333800 1 Processor -- start 2024-09-21T09:03:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.289+0000 7efe53333800 1 -- start start 2024-09-21T09:03:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.289+0000 7efe53333800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bafbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.289+0000 7efe53333800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56469bb025f0 con 0x56469ba6edf0 2024-09-21T09:03:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.289+0000 7efe4f024640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bafbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.289+0000 7efe4f024640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bafbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55724/0 (socket says 172.21.15.178:55724) 2024-09-21T09:03:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.289+0000 7efe4f024640 1 -- 172.21.15.178:0/2436319964 learned_addr learned my addr 172.21.15.178:0/2436319964 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.290+0000 7efe4f024640 1 -- 172.21.15.178:0/2436319964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56469b9a8fe0 con 0x56469ba6edf0 2024-09-21T09:03:16.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.290+0000 7efe4f024640 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bafbb10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe40045f20 tx=0x7efe40002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.290+0000 7efd3be07640 1 -- 172.21.15.178:0/2436319964 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe40053c20 con 0x56469ba6edf0 2024-09-21T09:03:16.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.290+0000 7efd3be07640 1 -- 172.21.15.178:0/2436319964 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe40053dc0 con 0x56469ba6edf0 2024-09-21T09:03:16.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.290+0000 7efd3be07640 1 -- 172.21.15.178:0/2436319964 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe40068550 con 0x56469ba6edf0 2024-09-21T09:03:16.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.290+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56469bafa200 con 0x56469ba6edf0 2024-09-21T09:03:16.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.290+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56469bafa720 con 0x56469ba6edf0 2024-09-21T09:03:16.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.291+0000 7efd3be07640 1 -- 172.21.15.178:0/2436319964 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efe40068740 con 0x56469ba6edf0 2024-09-21T09:03:16.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.291+0000 7efd3be07640 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd34036b40 0x7efd34039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.291+0000 7efd3be07640 1 -- 172.21.15.178:0/2436319964 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7efe40070070 con 0x56469ba6edf0 2024-09-21T09:03:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.291+0000 7efe47fff640 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd34036b40 0x7efd34039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.291+0000 7efe53333800 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56469bafe720 0x56469bbfb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.291+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bbfb840 con 0x56469bafe720 2024-09-21T09:03:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.291+0000 7efe4f825640 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56469bafe720 0x56469bbfb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.291+0000 7efe47fff640 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd34036b40 0x7efd34039000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe38000c00 tx=0x7efe380013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.292+0000 7efe4f825640 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56469bafe720 0x56469bbfb300 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.292+0000 7efe4f825640 1 -- 172.21.15.178:0/2436319964 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe4800a4a0 con 0x56469bafe720 2024-09-21T09:03:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.292+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bbfc090 con 0x56469bafe720 2024-09-21T09:03:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.292+0000 7efe4f825640 1 -- 172.21.15.178:0/2436319964 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efe4800a4a0 con 0x56469bafe720 2024-09-21T09:03:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.292+0000 7efe53333800 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56469bbfd9e0 0x56469bbffe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.292+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bc00610 con 0x56469bbfd9e0 2024-09-21T09:03:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.292+0000 7efe4f024640 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56469bbfd9e0 0x56469bbffe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.293+0000 7efe4f024640 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56469bbfd9e0 0x56469bbffe80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.293+0000 7efe4f024640 1 -- 172.21.15.178:0/2436319964 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efe40051070 con 0x56469bbfd9e0 2024-09-21T09:03:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.293+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bbfc8e0 con 0x56469bafe720 2024-09-21T09:03:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.293+0000 7efe4f825640 1 -- 172.21.15.178:0/2436319964 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efe4800a4a0 con 0x56469bafe720 2024-09-21T09:03:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.293+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bbfcc80 con 0x56469bafe720 2024-09-21T09:03:16.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.294+0000 7efe4f825640 1 -- 172.21.15.178:0/2436319964 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efe4800a4a0 con 0x56469bafe720 2024-09-21T09:03:16.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.294+0000 7efe53333800 1 Processor -- start 2024-09-21T09:03:16.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.294+0000 7efe53333800 1 -- start start 2024-09-21T09:03:16.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.294+0000 7efe53333800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc0ef00 0x56469bc0f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.294+0000 7efe53333800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56469bafc050 con 0x56469bc0ef00 2024-09-21T09:03:16.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.294+0000 7efe4f825640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc0ef00 0x56469bc0f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.294+0000 7efe4f825640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc0ef00 0x56469bc0f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55728/0 (socket says 172.21.15.178:55728) 2024-09-21T09:03:16.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.294+0000 7efe4f825640 1 -- 172.21.15.178:0/218175303 learned_addr learned my addr 172.21.15.178:0/218175303 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.295+0000 7efe4f825640 1 -- 172.21.15.178:0/218175303 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56469bc0f860 con 0x56469bc0ef00 2024-09-21T09:03:16.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.295+0000 7efe4f825640 1 --2- 172.21.15.178:0/218175303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc0ef00 0x56469bc0f320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x56469bafb500 tx=0x7efe48018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.295+0000 7efd39602640 1 -- 172.21.15.178:0/218175303 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe48014450 con 0x56469bc0ef00 2024-09-21T09:03:16.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.295+0000 7efd39602640 1 -- 172.21.15.178:0/218175303 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe480145f0 con 0x56469bc0ef00 2024-09-21T09:03:16.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.295+0000 7efe53333800 1 -- 172.21.15.178:0/218175303 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56469bc0faf0 con 0x56469bc0ef00 2024-09-21T09:03:16.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.295+0000 7efd39602640 1 -- 172.21.15.178:0/218175303 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe480148f0 con 0x56469bc0ef00 2024-09-21T09:03:16.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.295+0000 7efe53333800 1 -- 172.21.15.178:0/218175303 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56469bc127d0 con 0x56469bc0ef00 2024-09-21T09:03:16.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.296+0000 7efd39602640 1 -- 172.21.15.178:0/218175303 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efe48011040 con 0x56469bc0ef00 2024-09-21T09:03:16.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.296+0000 7efd39602640 1 --2- 172.21.15.178:0/218175303 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd28036b90 0x7efd28039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.296+0000 7efd39602640 1 -- 172.21.15.178:0/218175303 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7efe4801e070 con 0x56469bc0ef00 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.296+0000 7efe4f024640 1 --2- 172.21.15.178:0/218175303 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd28036b90 0x7efd28039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.296+0000 7efe53333800 1 Processor -- start 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.296+0000 7efe53333800 1 -- start start 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.297+0000 7efe4f024640 1 --2- 172.21.15.178:0/218175303 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd28036b90 0x7efd28039050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x56469bafab70 tx=0x7efe4008ee10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.297+0000 7efe53333800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc1bb80 0x56469bc1bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.297+0000 7efe53333800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56469b996580 con 0x56469bc1bb80 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.297+0000 7efe4f825640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc1bb80 0x56469bc1bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.297+0000 7efe4f825640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc1bb80 0x56469bc1bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55738/0 (socket says 172.21.15.178:55738) 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.297+0000 7efe4f825640 1 -- 172.21.15.178:0/2781946554 learned_addr learned my addr 172.21.15.178:0/2781946554 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.297+0000 7efe4f825640 1 -- 172.21.15.178:0/2781946554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56469bc1c550 con 0x56469bc1bb80 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.297+0000 7efe4f825640 1 --2- 172.21.15.178:0/2781946554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc1bb80 0x56469bc1bf80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efe4804cce0 tx=0x7efe4804cfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b92fabbef049e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.298+0000 7efd32ffd640 1 -- 172.21.15.178:0/2781946554 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe48013ca0 con 0x56469bc1bb80 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.298+0000 7efd32ffd640 1 -- 172.21.15.178:0/2781946554 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe48013e40 con 0x56469bc1bb80 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.298+0000 7efd32ffd640 1 -- 172.21.15.178:0/2781946554 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe480133b0 con 0x56469bc1bb80 2024-09-21T09:03:16.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.298+0000 7efe53333800 1 -- 172.21.15.178:0/2781946554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc1bb80 msgr2=0x56469bc1bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.298+0000 7efe53333800 1 --2- 172.21.15.178:0/2781946554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc1bb80 0x56469bc1bf80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efe4804cce0 tx=0x7efe4804cfb0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.298+0000 7efe53333800 1 -- 172.21.15.178:0/2781946554 shutdown_connections 2024-09-21T09:03:16.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.298+0000 7efe53333800 1 --2- 172.21.15.178:0/2781946554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc1bb80 0x56469bc1bf80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.298+0000 7efe53333800 1 -- 172.21.15.178:0/2781946554 >> 172.21.15.178:0/2781946554 conn(0x56469bc17ee0 msgr2=0x56469bc15fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.298+0000 7efe53333800 1 -- 172.21.15.178:0/2781946554 shutdown_connections 2024-09-21T09:03:16.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.298+0000 7efe53333800 1 -- 172.21.15.178:0/2781946554 wait complete. 2024-09-21T09:03:16.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.298+0000 7efe53333800 1 Processor -- start 2024-09-21T09:03:16.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.298+0000 7efe53333800 1 -- start start 2024-09-21T09:03:16.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.299+0000 7efe53333800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc1bb80 0x56469bc22ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.299+0000 7efe53333800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56469bc1ca40 con 0x56469bc1bb80 2024-09-21T09:03:16.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.299+0000 7efe4f825640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc1bb80 0x56469bc22ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.299+0000 7efe4f825640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc1bb80 0x56469bc22ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55744/0 (socket says 172.21.15.178:55744) 2024-09-21T09:03:16.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.299+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 learned_addr learned my addr 172.21.15.178:0/4241914030 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.299+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56469bc23410 con 0x56469bc1bb80 2024-09-21T09:03:16.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.299+0000 7efe4f825640 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc1bb80 0x56469bc22ed0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efe4804cce0 tx=0x7efe4804cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.299+0000 7efd317fa640 1 -- 172.21.15.178:0/4241914030 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe4802bb90 con 0x56469bc1bb80 2024-09-21T09:03:16.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.299+0000 7efd317fa640 1 -- 172.21.15.178:0/4241914030 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe4802bd30 con 0x56469bc1bb80 2024-09-21T09:03:16.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.299+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56469bc236a0 con 0x56469bc1bb80 2024-09-21T09:03:16.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.299+0000 7efd317fa640 1 -- 172.21.15.178:0/4241914030 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe48022b80 con 0x56469bc1bb80 2024-09-21T09:03:16.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.299+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56469bc26350 con 0x56469bc1bb80 2024-09-21T09:03:16.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.300+0000 7efd317fa640 1 -- 172.21.15.178:0/4241914030 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efe48022d20 con 0x56469bc1bb80 2024-09-21T09:03:16.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.300+0000 7efd317fa640 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd18036b90 0x7efd18039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.300+0000 7efd317fa640 1 -- 172.21.15.178:0/4241914030 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7efe48034070 con 0x56469bc1bb80 2024-09-21T09:03:16.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.301+0000 7efe4f024640 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd18036b90 0x7efd18039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.301+0000 7efe4f024640 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd18036b90 0x7efd18039050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe40000c00 tx=0x7efe40093000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.301+0000 7efe53333800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.301+0000 7efe53333800 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56469bc2eb40 0x56469bc31000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.301+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bc31750 con 0x56469bc2eb40 2024-09-21T09:03:16.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.301+0000 7efe47fff640 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56469bc2eb40 0x56469bc31000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe47fff640 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56469bc2eb40 0x56469bc31000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe3800f5f0 con 0x56469bc2eb40 2024-09-21T09:03:16.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe53333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe53333800 20 realm 2024-09-21T09:03:16.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe53333800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bc2df90 con 0x56469bc2eb40 2024-09-21T09:03:16.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe3800f5f0 con 0x56469bc2eb40 2024-09-21T09:03:16.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe53333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe53333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:16.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe53333800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bc32240 con 0x56469bc2eb40 2024-09-21T09:03:16.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe3800f5f0 con 0x56469bc2eb40 2024-09-21T09:03:16.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe53333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe53333800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bc32b10 con 0x56469bc2eb40 2024-09-21T09:03:16.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efe3800f5f0 con 0x56469bc2eb40 2024-09-21T09:03:16.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe53333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:16.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe53333800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.302+0000 7efe53333800 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56469bc33530 0x56469bc35920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.303+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bc36090 con 0x56469bc33530 2024-09-21T09:03:16.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.303+0000 7efe4f825640 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56469bc33530 0x56469bc35920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.303+0000 7efe4f825640 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56469bc33530 0x56469bc35920 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.303+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.303+0000 7efe53333800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:16.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.303+0000 7efe53333800 20 searching for the correct realm 2024-09-21T09:03:16.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.303+0000 7efe53333800 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56469bc38040 0x56469bc3a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.303+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc38040 2024-09-21T09:03:16.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.303+0000 7efe4f024640 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56469bc38040 0x56469bc3a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.304+0000 7efe4f024640 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56469bc38040 0x56469bc3a500 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.304+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.304+0000 7efe4f024640 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7efe4005f040 0x7efe4005e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.304+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x7efe4005f040 2024-09-21T09:03:16.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.304+0000 7efe47fff640 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7efe4005f040 0x7efe4005e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.304+0000 7efe47fff640 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7efe4005f040 0x7efe4005e440 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.305+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3800f5f0 con 0x7efe4005f040 2024-09-21T09:03:16.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.305+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc33530 2024-09-21T09:03:16.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.305+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.305+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc2eb40 2024-09-21T09:03:16.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.305+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3800f5f0 con 0x56469bc2eb40 2024-09-21T09:03:16.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.305+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc2eb40 2024-09-21T09:03:16.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.305+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.305+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc33530 2024-09-21T09:03:16.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.306+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.306+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc33530 2024-09-21T09:03:16.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.306+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.306+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x7efe4005f040 2024-09-21T09:03:16.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.306+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.306+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc38040 2024-09-21T09:03:16.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.306+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.306+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc2eb40 2024-09-21T09:03:16.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.307+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.307+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc33530 2024-09-21T09:03:16.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.307+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.307+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc2eb40 2024-09-21T09:03:16.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.307+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.307+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x7efe4005f040 2024-09-21T09:03:16.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.307+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.308+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc38040 2024-09-21T09:03:16.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.308+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.308+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc38040 2024-09-21T09:03:16.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.308+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.308+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc33530 2024-09-21T09:03:16.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.309+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.309+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc38040 2024-09-21T09:03:16.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.309+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.309+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc38040 2024-09-21T09:03:16.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.309+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.309+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc2eb40 2024-09-21T09:03:16.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.309+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.309+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc2eb40 2024-09-21T09:03:16.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.309+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.309+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc33530 2024-09-21T09:03:16.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.310+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.310+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc38040 2024-09-21T09:03:16.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.310+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.310+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x7efe4005f040 2024-09-21T09:03:16.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.310+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.310+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc2eb40 2024-09-21T09:03:16.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.310+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.310+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc33530 2024-09-21T09:03:16.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.311+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.311+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc38040 2024-09-21T09:03:16.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.311+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.311+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc33530 2024-09-21T09:03:16.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.311+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.311+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x7efe4005f040 2024-09-21T09:03:16.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.311+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.311+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc38040 2024-09-21T09:03:16.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc33530 2024-09-21T09:03:16.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x56469bc2eb40 2024-09-21T09:03:16.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3abd0 con 0x7efe4005f040 2024-09-21T09:03:16.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe53333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:16.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe53333800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe53333800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe53333800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe53333800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe53333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe53333800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bc36a50 con 0x56469bc2eb40 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.312+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bc372f0 con 0x56469bc2eb40 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bc36690 con 0x56469bc2eb40 2024-09-21T09:03:16.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 20 zone default found 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 4 Realm: () 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 20 zonegroup default 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3b050 con 0x56469bc33530 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.313+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3d300 con 0x56469bc38040 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.314+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.314+0000 7efe53333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.314+0000 7efe53333800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.314+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3d6a0 con 0x56469bc38040 2024-09-21T09:03:16.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.314+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.314+0000 7efe53333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.314+0000 7efe53333800 20 started sync module instance, tier type = 2024-09-21T09:03:16.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.314+0000 7efe53333800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:16.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.314+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3c790 con 0x7efe4005f040 2024-09-21T09:03:16.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.315+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.315+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94861260999824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3c790 con 0x7efe4005f040 2024-09-21T09:03:16.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.315+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3e0b0 con 0x56469bc2eb40 2024-09-21T09:03:16.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.316+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94861260999824] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.316+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.316+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94861261004256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3c790 con 0x56469bc2eb40 2024-09-21T09:03:16.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.316+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3eb40 con 0x56469bc38040 2024-09-21T09:03:16.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.317+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.317+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94861261006352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3f3e0 con 0x56469bc38040 2024-09-21T09:03:16.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.317+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3fea0 con 0x7efe4005f040 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.317+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94861261004256] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.318+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94861261006352] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.318+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.318+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94861261008688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3c2e0 con 0x7efe4005f040 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.318+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc40780 con 0x56469bc2eb40 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.319+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.319+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94861261013520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc40b70 con 0x56469bc2eb40 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.319+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc41670 con 0x56469bc33530 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.319+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94861261008688] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.320+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.320+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94861261017440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc41630 con 0x56469bc33530 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.320+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94861261013520] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.320+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc41630 con 0x56469bc33530 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.321+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94861261017440] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.322+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.322+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94861261011312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc41c00 con 0x56469bc33530 2024-09-21T09:03:16.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.322+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc425c0 con 0x56469bc33530 2024-09-21T09:03:16.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.323+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.323+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94861261011312] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.323+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94861261021456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc42530 con 0x56469bc33530 2024-09-21T09:03:16.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.323+0000 7efe53333800 20 add_watcher() i=0 2024-09-21T09:03:16.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.323+0000 7efe53333800 20 add_watcher() i=1 2024-09-21T09:03:16.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.323+0000 7efe53333800 20 add_watcher() i=2 2024-09-21T09:03:16.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.323+0000 7efe53333800 20 add_watcher() i=3 2024-09-21T09:03:16.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.323+0000 7efe53333800 20 add_watcher() i=4 2024-09-21T09:03:16.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.323+0000 7efe53333800 20 add_watcher() i=5 2024-09-21T09:03:16.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.323+0000 7efe53333800 20 add_watcher() i=6 2024-09-21T09:03:16.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.324+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94861261021456] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.324+0000 7efe53333800 20 add_watcher() i=7 2024-09-21T09:03:16.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.324+0000 7efe53333800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:16.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.324+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bc45a20 con 0x56469bc2eb40 2024-09-21T09:03:16.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.324+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.324+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94861261014576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc42ea0 con 0x56469bc2eb40 2024-09-21T09:03:16.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.325+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94861261014576] v29'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.325+0000 7efd05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:16.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.325+0000 7efe53333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:16.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.325+0000 7efe53333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:16.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.325+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4e490 con 0x56469bc2eb40 2024-09-21T09:03:16.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.327+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.327+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4eb60 con 0x56469bc33530 2024-09-21T09:03:16.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.328+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.328+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4eb60 con 0x56469bc38040 2024-09-21T09:03:16.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.329+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.329+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4f170 con 0x56469bc2eb40 2024-09-21T09:03:16.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.330+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.330+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4f620 con 0x7efe4005f040 2024-09-21T09:03:16.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.330+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.331+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4fb90 con 0x56469bc38040 2024-09-21T09:03:16.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.331+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.331+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4fb90 con 0x56469bc2eb40 2024-09-21T09:03:16.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.333+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.333+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4fe50 con 0x56469bc33530 2024-09-21T09:03:16.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.334+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.334+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4fe50 con 0x7efe4005f040 2024-09-21T09:03:16.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.335+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.335+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4fe50 con 0x56469bc38040 2024-09-21T09:03:16.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.336+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.336+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4fe50 con 0x7efe4005f040 2024-09-21T09:03:16.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.337+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.337+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4fdd0 con 0x56469bc33530 2024-09-21T09:03:16.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.338+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.338+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4fec0 con 0x7efe4005f040 2024-09-21T09:03:16.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.339+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.339+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4fec0 con 0x56469bc33530 2024-09-21T09:03:16.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.340+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.340+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4fe60 con 0x56469bc2eb40 2024-09-21T09:03:16.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.341+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.341+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4fe60 con 0x56469bc38040 2024-09-21T09:03:16.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.342+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.342+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc50400 con 0x7efe4005f040 2024-09-21T09:03:16.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.343+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.343+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc50400 con 0x56469bc38040 2024-09-21T09:03:16.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.344+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.344+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc50400 con 0x56469bc2eb40 2024-09-21T09:03:16.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.345+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.345+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc50400 con 0x56469bc2eb40 2024-09-21T09:03:16.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.346+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.346+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc50400 con 0x56469bc38040 2024-09-21T09:03:16.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.347+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.347+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc50400 con 0x7efe4005f040 2024-09-21T09:03:16.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.348+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.348+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc50400 con 0x56469bc38040 2024-09-21T09:03:16.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.349+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.349+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc50400 con 0x56469bc38040 2024-09-21T09:03:16.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.350+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.350+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc50400 con 0x56469bc38040 2024-09-21T09:03:16.352 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.351+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.352 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.351+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc50400 con 0x56469bc38040 2024-09-21T09:03:16.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.352+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.352+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc50400 con 0x56469bc33530 2024-09-21T09:03:16.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.353+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.353+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc50400 con 0x56469bc38040 2024-09-21T09:03:16.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.354+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.354+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc50400 con 0x56469bc33530 2024-09-21T09:03:16.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.355+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.355+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc50400 con 0x56469bc38040 2024-09-21T09:03:16.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.356+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.356+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4ef80 con 0x56469bc33530 2024-09-21T09:03:16.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.357+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.357+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4ef80 con 0x7efe4005f040 2024-09-21T09:03:16.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.358+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.358+0000 7efd04fe1640 20 reqs_thread_entry: start 2024-09-21T09:03:16.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.358+0000 7efe53333800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:16.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.358+0000 7efe53333800 20 Filter name: none 2024-09-21T09:03:16.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.358+0000 7efc7e7fc640 20 reqs_thread_entry: start 2024-09-21T09:03:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.358+0000 7efe53333800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.358+0000 7efe53333800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.358+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56469bc7b0f0 con 0x56469bc2eb40 2024-09-21T09:03:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.358+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.358+0000 7efe53333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.358+0000 7efe53333800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-21T09:03:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.359+0000 7efe53333800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:could not remove user: unable to remove user, user does not exist 2024-09-21T09:03:16.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.359+0000 7efd05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:16.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.359+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94861261014576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4bb70 con 0x56469bc2eb40 2024-09-21T09:03:16.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.360+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94861261014576] v29'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.360+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94861260999824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc4bb70 con 0x7efe4005f040 2024-09-21T09:03:16.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.361+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94861260999824] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.361+0000 7efe53333800 20 remove_watcher() i=0 2024-09-21T09:03:16.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.361+0000 7efe53333800 2 removed watcher, disabling cache 2024-09-21T09:03:16.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.361+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94861261004256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3cc90 con 0x56469bc2eb40 2024-09-21T09:03:16.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.362+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94861261004256] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.362+0000 7efe53333800 20 remove_watcher() i=1 2024-09-21T09:03:16.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.362+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94861261006352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3cc90 con 0x56469bc38040 2024-09-21T09:03:16.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.363+0000 7efe4f024640 1 -- 172.21.15.178:0/4241914030 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94861261006352] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4008a040 con 0x56469bc38040 2024-09-21T09:03:16.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.363+0000 7efe53333800 20 remove_watcher() i=2 2024-09-21T09:03:16.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.363+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94861261008688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3e610 con 0x7efe4005f040 2024-09-21T09:03:16.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.364+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94861261008688] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x7efe4005f040 2024-09-21T09:03:16.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.364+0000 7efe53333800 20 remove_watcher() i=3 2024-09-21T09:03:16.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.364+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94861261013520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc3cc90 con 0x56469bc2eb40 2024-09-21T09:03:16.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.365+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94861261013520] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3802b040 con 0x56469bc2eb40 2024-09-21T09:03:16.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.365+0000 7efe53333800 20 remove_watcher() i=4 2024-09-21T09:03:16.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.365+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94861261017440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc406c0 con 0x56469bc33530 2024-09-21T09:03:16.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.366+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94861261017440] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.366+0000 7efe53333800 20 remove_watcher() i=5 2024-09-21T09:03:16.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.366+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94861261011312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc406c0 con 0x56469bc33530 2024-09-21T09:03:16.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.367+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94861261011312] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.367+0000 7efe53333800 20 remove_watcher() i=6 2024-09-21T09:03:16.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.367+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94861261021456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56469bc406c0 con 0x56469bc33530 2024-09-21T09:03:16.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe4f825640 1 -- 172.21.15.178:0/4241914030 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94861261021456] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802a070 con 0x56469bc33530 2024-09-21T09:03:16.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 20 remove_watcher() i=7 2024-09-21T09:03:16.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56469bc33530 msgr2=0x56469bc35920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56469bc33530 0x56469bc35920 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56469bc2eb40 msgr2=0x56469bc31000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56469bc2eb40 0x56469bc31000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7efe4005f040 msgr2=0x7efe4005e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7efe4005f040 0x7efe4005e440 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56469bc38040 msgr2=0x56469bc3a500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56469bc38040 0x56469bc3a500 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd18036b90 msgr2=0x7efd18039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd18036b90 0x7efd18039050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe40000c00 tx=0x7efe40093000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc1bb80 msgr2=0x56469bc22ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe47fff640 1 -- 172.21.15.178:0/4241914030 reap_dead start 2024-09-21T09:03:16.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc1bb80 0x56469bc22ed0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efe4804cce0 tx=0x7efe4804cc70 comp rx=0 tx=0).stop 2024-09-21T09:03:16.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 shutdown_connections 2024-09-21T09:03:16.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 --2- 172.21.15.178:0/4241914030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc1bb80 0x56469bc22ed0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 >> 172.21.15.178:0/4241914030 conn(0x56469bc17ee0 msgr2=0x56469bc15fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 shutdown_connections 2024-09-21T09:03:16.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.368+0000 7efe53333800 1 -- 172.21.15.178:0/4241914030 wait complete. 2024-09-21T09:03:16.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 -- 172.21.15.178:0/218175303 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd28036b90 msgr2=0x7efd28039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 --2- 172.21.15.178:0/218175303 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd28036b90 0x7efd28039050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x56469bafab70 tx=0x7efe4008ee10 comp rx=0 tx=0).stop 2024-09-21T09:03:16.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 -- 172.21.15.178:0/218175303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc0ef00 msgr2=0x56469bc0f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 --2- 172.21.15.178:0/218175303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc0ef00 0x56469bc0f320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x56469bafb500 tx=0x7efe48018830 comp rx=0 tx=0).stop 2024-09-21T09:03:16.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 -- 172.21.15.178:0/218175303 shutdown_connections 2024-09-21T09:03:16.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 --2- 172.21.15.178:0/218175303 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd28036b90 0x7efd28039050 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 --2- 172.21.15.178:0/218175303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469bc0ef00 0x56469bc0f320 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 -- 172.21.15.178:0/218175303 >> 172.21.15.178:0/218175303 conn(0x56469bc03e90 msgr2=0x56469bc06a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 -- 172.21.15.178:0/218175303 shutdown_connections 2024-09-21T09:03:16.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 -- 172.21.15.178:0/218175303 wait complete. 2024-09-21T09:03:16.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56469bbfd9e0 msgr2=0x56469bbffe80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56469bbfd9e0 0x56469bbffe80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56469bafe720 msgr2=0x56469bbfb300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56469bafe720 0x56469bbfb300 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd34036b40 msgr2=0x7efd34039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd34036b40 0x7efd34039000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe38000c00 tx=0x7efe380013b0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 msgr2=0x56469bafbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bafbb10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe40045f20 tx=0x7efe40002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 shutdown_connections 2024-09-21T09:03:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56469bbfd9e0 0x56469bbffe80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56469bafe720 0x56469bbfb300 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd34036b40 0x7efd34039000 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 --2- 172.21.15.178:0/2436319964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56469ba6edf0 0x56469bafbb10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 >> 172.21.15.178:0/2436319964 conn(0x56469baf5df0 msgr2=0x56469bbe4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 shutdown_connections 2024-09-21T09:03:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.369+0000 7efe53333800 1 -- 172.21.15.178:0/2436319964 wait complete. 2024-09-21T09:03:16.379 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-21T09:03:16.379 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-21T09:03:16.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-21T09:03:16.380 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-21T09:03:16.425 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.425+0000 7f357480e800 1 Processor -- start 2024-09-21T09:03:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.425+0000 7f357480e800 1 -- start start 2024-09-21T09:03:16.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.425+0000 7f357480e800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55eeb1c82ee0 0x55eeb1d14690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.425+0000 7f357480e800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eeb1bceb30 con 0x55eeb1d14bd0 2024-09-21T09:03:16.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.425+0000 7f357480e800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55eeb1bb0360 con 0x55eeb1c82ee0 2024-09-21T09:03:16.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.425+0000 7f356ff75640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55eeb1c82ee0 0x55eeb1d14690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.425+0000 7f356ff75640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55eeb1c82ee0 0x55eeb1d14690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55754/0 (socket says 172.21.15.178:55754) 2024-09-21T09:03:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.425+0000 7f356ff75640 1 -- 172.21.15.178:0/4066047697 learned_addr learned my addr 172.21.15.178:0/4066047697 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.425+0000 7f3567774640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55eeb1d14bd0 0x55eeb1d16fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:58312/0 (socket says 172.21.15.178:58312) 2024-09-21T09:03:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.425+0000 7f356ff75640 1 -- 172.21.15.178:0/4066047697 >> v1:172.21.15.44:6789/0 conn(0x55eeb1d14bd0 legacy=0x55eeb1d16fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.425+0000 7f356ff75640 1 -- 172.21.15.178:0/4066047697 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb1bd6e00 con 0x55eeb1c82ee0 2024-09-21T09:03:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.427+0000 7f356ff75640 1 --2- 172.21.15.178:0/4066047697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1d14690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f356000a520 tx=0x7f3560045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9917e3c1fa7684a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.427+0000 7f356f774640 1 -- 172.21.15.178:0/4066047697 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3560055070 con 0x55eeb1c82ee0 2024-09-21T09:03:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.427+0000 7f356f774640 1 -- 172.21.15.178:0/4066047697 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35600515b0 con 0x55eeb1c82ee0 2024-09-21T09:03:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.427+0000 7f356f774640 1 -- 172.21.15.178:0/4066047697 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35600518d0 con 0x55eeb1c82ee0 2024-09-21T09:03:16.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.428+0000 7f357480e800 1 -- 172.21.15.178:0/4066047697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 msgr2=0x55eeb1d14690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.428+0000 7f357480e800 1 --2- 172.21.15.178:0/4066047697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1d14690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f356000a520 tx=0x7f3560045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.428+0000 7f357480e800 1 -- 172.21.15.178:0/4066047697 shutdown_connections 2024-09-21T09:03:16.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.428+0000 7f357480e800 1 --2- 172.21.15.178:0/4066047697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1d14690 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.428+0000 7f357480e800 1 -- 172.21.15.178:0/4066047697 >> 172.21.15.178:0/4066047697 conn(0x55eeb1d09e40 msgr2=0x55eeb1d0c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.428+0000 7f357480e800 1 -- 172.21.15.178:0/4066047697 shutdown_connections 2024-09-21T09:03:16.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.428+0000 7f357480e800 1 -- 172.21.15.178:0/4066047697 wait complete. 2024-09-21T09:03:16.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.441+0000 7f357480e800 1 Processor -- start 2024-09-21T09:03:16.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.442+0000 7f357480e800 1 -- start start 2024-09-21T09:03:16.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.442+0000 7f357480e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1e00b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.442+0000 7f357480e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eeb1c5b350 con 0x55eeb1c82ee0 2024-09-21T09:03:16.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.442+0000 7f356ff75640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1e00b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.442+0000 7f356ff75640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1e00b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55770/0 (socket says 172.21.15.178:55770) 2024-09-21T09:03:16.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.442+0000 7f356ff75640 1 -- 172.21.15.178:0/230243021 learned_addr learned my addr 172.21.15.178:0/230243021 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.442+0000 7f356ff75640 1 -- 172.21.15.178:0/230243021 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb1ba8bc0 con 0x55eeb1c82ee0 2024-09-21T09:03:16.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.443+0000 7f356ff75640 1 --2- 172.21.15.178:0/230243021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1e00b40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3560025da0 tx=0x7f3560051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c68de37c03c898 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.443+0000 7f345de0b640 1 -- 172.21.15.178:0/230243021 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3560051950 con 0x55eeb1c82ee0 2024-09-21T09:03:16.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.443+0000 7f345de0b640 1 -- 172.21.15.178:0/230243021 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3560051af0 con 0x55eeb1c82ee0 2024-09-21T09:03:16.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.443+0000 7f345de0b640 1 -- 172.21.15.178:0/230243021 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3560051dd0 con 0x55eeb1c82ee0 2024-09-21T09:03:16.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.443+0000 7f357480e800 1 -- 172.21.15.178:0/230243021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 msgr2=0x55eeb1e00b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.443+0000 7f357480e800 1 --2- 172.21.15.178:0/230243021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1e00b40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3560025da0 tx=0x7f3560051000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.443+0000 7f357480e800 1 -- 172.21.15.178:0/230243021 shutdown_connections 2024-09-21T09:03:16.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.443+0000 7f357480e800 1 --2- 172.21.15.178:0/230243021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1e00b40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.443+0000 7f357480e800 1 -- 172.21.15.178:0/230243021 >> 172.21.15.178:0/230243021 conn(0x55eeb1d09e40 msgr2=0x55eeb1dfc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.444+0000 7f357480e800 1 -- 172.21.15.178:0/230243021 shutdown_connections 2024-09-21T09:03:16.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.444+0000 7f357480e800 1 -- 172.21.15.178:0/230243021 wait complete. 2024-09-21T09:03:16.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.444+0000 7f357480e800 1 Processor -- start 2024-09-21T09:03:16.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.444+0000 7f357480e800 1 -- start start 2024-09-21T09:03:16.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.444+0000 7f357480e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1e08470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.444+0000 7f357480e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eeb1d18980 con 0x55eeb1c82ee0 2024-09-21T09:03:16.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.444+0000 7f356ff75640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1e08470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.444+0000 7f356ff75640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1e08470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55774/0 (socket says 172.21.15.178:55774) 2024-09-21T09:03:16.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.444+0000 7f356ff75640 1 -- 172.21.15.178:0/1191106452 learned_addr learned my addr 172.21.15.178:0/1191106452 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.444+0000 7f356ff75640 1 -- 172.21.15.178:0/1191106452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb1bbcfe0 con 0x55eeb1c82ee0 2024-09-21T09:03:16.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.445+0000 7f356ff75640 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1e08470 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3560067040 tx=0x7f3560002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.445+0000 7f3457fff640 1 -- 172.21.15.178:0/1191106452 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3560073070 con 0x55eeb1c82ee0 2024-09-21T09:03:16.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.445+0000 7f3457fff640 1 -- 172.21.15.178:0/1191106452 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356005a450 con 0x55eeb1c82ee0 2024-09-21T09:03:16.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.445+0000 7f357480e800 1 -- 172.21.15.178:0/1191106452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eeb1e089b0 con 0x55eeb1c82ee0 2024-09-21T09:03:16.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.445+0000 7f3457fff640 1 -- 172.21.15.178:0/1191106452 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356005a730 con 0x55eeb1c82ee0 2024-09-21T09:03:16.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.445+0000 7f357480e800 1 -- 172.21.15.178:0/1191106452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb1e08f30 con 0x55eeb1c82ee0 2024-09-21T09:03:16.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.446+0000 7f357480e800 1 Processor -- start 2024-09-21T09:03:16.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.446+0000 7f357480e800 1 -- start start 2024-09-21T09:03:16.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.446+0000 7f3457fff640 1 -- 172.21.15.178:0/1191106452 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3560076070 con 0x55eeb1c82ee0 2024-09-21T09:03:16.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.446+0000 7f357480e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e15210 0x55eeb1e15610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.446+0000 7f357480e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eeb1baa580 con 0x55eeb1e15210 2024-09-21T09:03:16.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.446+0000 7f3457fff640 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3458036b40 0x7f3458039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.446+0000 7f3457fff640 1 -- 172.21.15.178:0/1191106452 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3560062070 con 0x55eeb1c82ee0 2024-09-21T09:03:16.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.446+0000 7f3570776640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e15210 0x55eeb1e15610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.446+0000 7f3570776640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e15210 0x55eeb1e15610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55784/0 (socket says 172.21.15.178:55784) 2024-09-21T09:03:16.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.446+0000 7f356ff75640 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3458036b40 0x7f3458039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.446+0000 7f3570776640 1 -- 172.21.15.178:0/210374054 learned_addr learned my addr 172.21.15.178:0/210374054 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.446+0000 7f3570776640 1 -- 172.21.15.178:0/210374054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb1e15b50 con 0x55eeb1e15210 2024-09-21T09:03:16.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.446+0000 7f356ff75640 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3458036b40 0x7f3458039000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f356006efd0 tx=0x7f356006ee80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.446+0000 7f3570776640 1 --2- 172.21.15.178:0/210374054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e15210 0x55eeb1e15610 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f356800a430 tx=0x7f356800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2e4ae50bb73fea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.447+0000 7f3455ffb640 1 -- 172.21.15.178:0/210374054 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3568015070 con 0x55eeb1e15210 2024-09-21T09:03:16.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.447+0000 7f3455ffb640 1 -- 172.21.15.178:0/210374054 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3568001670 con 0x55eeb1e15210 2024-09-21T09:03:16.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.447+0000 7f3455ffb640 1 -- 172.21.15.178:0/210374054 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3568001990 con 0x55eeb1e15210 2024-09-21T09:03:16.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.447+0000 7f357480e800 1 -- 172.21.15.178:0/210374054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e15210 msgr2=0x55eeb1e15610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.447+0000 7f357480e800 1 --2- 172.21.15.178:0/210374054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e15210 0x55eeb1e15610 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f356800a430 tx=0x7f356800a8f0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.447+0000 7f357480e800 1 -- 172.21.15.178:0/210374054 shutdown_connections 2024-09-21T09:03:16.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.447+0000 7f357480e800 1 --2- 172.21.15.178:0/210374054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e15210 0x55eeb1e15610 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.447+0000 7f357480e800 1 -- 172.21.15.178:0/210374054 >> 172.21.15.178:0/210374054 conn(0x55eeb1d14bd0 msgr2=0x55eeb1e10990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.447+0000 7f357480e800 1 -- 172.21.15.178:0/210374054 shutdown_connections 2024-09-21T09:03:16.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.447+0000 7f357480e800 1 -- 172.21.15.178:0/210374054 wait complete. 2024-09-21T09:03:16.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.447+0000 7f357480e800 1 Processor -- start 2024-09-21T09:03:16.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.447+0000 7f357480e800 1 -- start start 2024-09-21T09:03:16.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.447+0000 7f357480e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e15210 0x55eeb1e1c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.447+0000 7f357480e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eeb1e16500 con 0x55eeb1e15210 2024-09-21T09:03:16.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.448+0000 7f3570776640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e15210 0x55eeb1e1c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.448+0000 7f3570776640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e15210 0x55eeb1e1c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55790/0 (socket says 172.21.15.178:55790) 2024-09-21T09:03:16.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.448+0000 7f3570776640 1 -- 172.21.15.178:0/591998561 learned_addr learned my addr 172.21.15.178:0/591998561 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.448+0000 7f3570776640 1 -- 172.21.15.178:0/591998561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb1e1ccf0 con 0x55eeb1e15210 2024-09-21T09:03:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.448+0000 7f3570776640 1 --2- 172.21.15.178:0/591998561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e15210 0x55eeb1e1c7b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f356800a930 tx=0x7f3568003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.448+0000 7f344ffff640 1 -- 172.21.15.178:0/591998561 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3568020020 con 0x55eeb1e15210 2024-09-21T09:03:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.448+0000 7f344ffff640 1 -- 172.21.15.178:0/591998561 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35680108b0 con 0x55eeb1e15210 2024-09-21T09:03:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.448+0000 7f357480e800 1 -- 172.21.15.178:0/591998561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eeb1e1cf80 con 0x55eeb1e15210 2024-09-21T09:03:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.448+0000 7f344ffff640 1 -- 172.21.15.178:0/591998561 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3568015040 con 0x55eeb1e15210 2024-09-21T09:03:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.448+0000 7f357480e800 1 -- 172.21.15.178:0/591998561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb1e1fc30 con 0x55eeb1e15210 2024-09-21T09:03:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.449+0000 7f344ffff640 1 -- 172.21.15.178:0/591998561 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3568023020 con 0x55eeb1e15210 2024-09-21T09:03:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.449+0000 7f344ffff640 1 --2- 172.21.15.178:0/591998561 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3448036b90 0x7f3448039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.449+0000 7f344ffff640 1 -- 172.21.15.178:0/591998561 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f356804c100 con 0x55eeb1e15210 2024-09-21T09:03:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.449+0000 7f3567774640 1 --2- 172.21.15.178:0/591998561 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3448036b90 0x7f3448039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.450+0000 7f357480e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.450+0000 7f357480e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:16.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.450+0000 7f3567774640 1 --2- 172.21.15.178:0/591998561 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3448036b90 0x7f3448039050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3558000f60 tx=0x7f35580012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.450+0000 7f357480e800 1 Processor -- start 2024-09-21T09:03:16.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.450+0000 7f357480e800 1 -- start start 2024-09-21T09:03:16.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.450+0000 7f357480e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e36840 0x55eeb1e36c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.450+0000 7f357480e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eeb1e01230 con 0x55eeb1e36840 2024-09-21T09:03:16.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.450+0000 7f356ff75640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e36840 0x55eeb1e36c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.450+0000 7f356ff75640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e36840 0x55eeb1e36c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55794/0 (socket says 172.21.15.178:55794) 2024-09-21T09:03:16.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.450+0000 7f356ff75640 1 -- 172.21.15.178:0/2364474858 learned_addr learned my addr 172.21.15.178:0/2364474858 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.451+0000 7f356ff75640 1 -- 172.21.15.178:0/2364474858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb1e37230 con 0x55eeb1e36840 2024-09-21T09:03:16.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.451+0000 7f356ff75640 1 --2- 172.21.15.178:0/2364474858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e36840 0x55eeb1e36c60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f356001bb60 tx=0x7f3560081f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.451+0000 7f33e7fff640 1 -- 172.21.15.178:0/2364474858 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356009c070 con 0x55eeb1e36840 2024-09-21T09:03:16.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.451+0000 7f33e7fff640 1 -- 172.21.15.178:0/2364474858 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3560064aa0 con 0x55eeb1e36840 2024-09-21T09:03:16.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.451+0000 7f357480e800 1 -- 172.21.15.178:0/2364474858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eeb1e39e80 con 0x55eeb1e36840 2024-09-21T09:03:16.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.451+0000 7f33e7fff640 1 -- 172.21.15.178:0/2364474858 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356006e3c0 con 0x55eeb1e36840 2024-09-21T09:03:16.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.451+0000 7f357480e800 1 -- 172.21.15.178:0/2364474858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb1e3a260 con 0x55eeb1e36840 2024-09-21T09:03:16.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.452+0000 7f33e7fff640 1 -- 172.21.15.178:0/2364474858 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f356009f070 con 0x55eeb1e36840 2024-09-21T09:03:16.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.452+0000 7f33e7fff640 1 --2- 172.21.15.178:0/2364474858 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f33b0036b90 0x7f33b0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.452+0000 7f33e7fff640 1 -- 172.21.15.178:0/2364474858 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3560089070 con 0x55eeb1e36840 2024-09-21T09:03:16.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.452+0000 7f3567774640 1 --2- 172.21.15.178:0/2364474858 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f33b0036b90 0x7f33b0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.452+0000 7f33e5ffb640 20 reqs_thread_entry: start 2024-09-21T09:03:16.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.452+0000 7f3567774640 1 --2- 172.21.15.178:0/2364474858 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f33b0036b90 0x7f33b0039050 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3558001ed0 tx=0x7f355800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.452+0000 7f357480e800 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eeb1e441f0 0x55eeb1e46660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.452+0000 7f357480e800 1 -- 172.21.15.178:0/1191106452 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eeb1e46d30 con 0x55eeb1e441f0 2024-09-21T09:03:16.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.453+0000 7f3570776640 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eeb1e441f0 0x55eeb1e46660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.453+0000 7f3570776640 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eeb1e441f0 0x55eeb1e46660 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.453+0000 7f3570776640 1 -- 172.21.15.178:0/1191106452 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3568010d70 con 0x55eeb1e441f0 2024-09-21T09:03:16.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.453+0000 7f357480e800 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eeb1e48b00 0x55eeb1e4aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.453+0000 7f357480e800 1 -- 172.21.15.178:0/1191106452 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:2 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eeb1e4b590 con 0x55eeb1e48b00 2024-09-21T09:03:16.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.453+0000 7f356ff75640 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eeb1e48b00 0x55eeb1e4aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.454+0000 7f356ff75640 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eeb1e48b00 0x55eeb1e4aef0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.454+0000 7f356ff75640 1 -- 172.21.15.178:0/1191106452 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(2 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f356009e030 con 0x55eeb1e48b00 2024-09-21T09:03:16.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.454+0000 7f357480e800 1 -- 172.21.15.178:0/1191106452 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eeb1e47fb0 con 0x55eeb1e48b00 2024-09-21T09:03:16.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.455+0000 7f356ff75640 1 -- 172.21.15.178:0/1191106452 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [stat,call,call,writefull 0~993] v29'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f356009e030 con 0x55eeb1e48b00 2024-09-21T09:03:16.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.456+0000 7f357480e800 1 -- 172.21.15.178:0/591998561 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3448036b90 msgr2=0x7f3448039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.456+0000 7f357480e800 1 --2- 172.21.15.178:0/591998561 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3448036b90 0x7f3448039050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3558000f60 tx=0x7f35580012f0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.456+0000 7f357480e800 1 -- 172.21.15.178:0/591998561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e15210 msgr2=0x55eeb1e1c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.456+0000 7f357480e800 1 --2- 172.21.15.178:0/591998561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e15210 0x55eeb1e1c7b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f356800a930 tx=0x7f3568003370 comp rx=0 tx=0).stop 2024-09-21T09:03:16.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.456+0000 7f357480e800 1 -- 172.21.15.178:0/591998561 shutdown_connections 2024-09-21T09:03:16.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.456+0000 7f357480e800 1 --2- 172.21.15.178:0/591998561 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3448036b90 0x7f3448039050 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.456+0000 7f357480e800 1 --2- 172.21.15.178:0/591998561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e15210 0x55eeb1e1c7b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.456+0000 7f357480e800 1 -- 172.21.15.178:0/591998561 >> 172.21.15.178:0/591998561 conn(0x55eeb1d14bd0 msgr2=0x55eeb1e10560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.456+0000 7f357480e800 1 -- 172.21.15.178:0/591998561 shutdown_connections 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.456+0000 7f357480e800 1 -- 172.21.15.178:0/591998561 wait complete. 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 -- 172.21.15.178:0/2364474858 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f33b0036b90 msgr2=0x7f33b0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 --2- 172.21.15.178:0/2364474858 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f33b0036b90 0x7f33b0039050 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3558001ed0 tx=0x7f355800f000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 -- 172.21.15.178:0/2364474858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e36840 msgr2=0x55eeb1e36c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 --2- 172.21.15.178:0/2364474858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e36840 0x55eeb1e36c60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f356001bb60 tx=0x7f3560081f00 comp rx=0 tx=0).stop 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 -- 172.21.15.178:0/2364474858 shutdown_connections 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 --2- 172.21.15.178:0/2364474858 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f33b0036b90 0x7f33b0039050 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 --2- 172.21.15.178:0/2364474858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1e36840 0x55eeb1e36c60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 -- 172.21.15.178:0/2364474858 >> 172.21.15.178:0/2364474858 conn(0x55eeb1e2b750 msgr2=0x55eeb1e2e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 -- 172.21.15.178:0/2364474858 shutdown_connections 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 -- 172.21.15.178:0/2364474858 wait complete. 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 -- 172.21.15.178:0/1191106452 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eeb1e48b00 msgr2=0x55eeb1e4aef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eeb1e48b00 0x55eeb1e4aef0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 -- 172.21.15.178:0/1191106452 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eeb1e441f0 msgr2=0x55eeb1e46660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eeb1e441f0 0x55eeb1e46660 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 -- 172.21.15.178:0/1191106452 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3458036b40 msgr2=0x7f3458039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3458036b40 0x7f3458039000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f356006efd0 tx=0x7f356006ee80 comp rx=0 tx=0).stop 2024-09-21T09:03:16.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 -- 172.21.15.178:0/1191106452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 msgr2=0x55eeb1e08470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1e08470 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3560067040 tx=0x7f3560002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 -- 172.21.15.178:0/1191106452 shutdown_connections 2024-09-21T09:03:16.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eeb1e48b00 0x55eeb1e4aef0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eeb1e441f0 0x55eeb1e46660 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3458036b40 0x7f3458039000 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 --2- 172.21.15.178:0/1191106452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eeb1c82ee0 0x55eeb1e08470 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 -- 172.21.15.178:0/1191106452 >> 172.21.15.178:0/1191106452 conn(0x55eeb1d09e40 msgr2=0x55eeb1dfadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 -- 172.21.15.178:0/1191106452 shutdown_connections 2024-09-21T09:03:16.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.457+0000 7f357480e800 1 -- 172.21.15.178:0/1191106452 wait complete. 2024-09-21T09:03:16.467 INFO:teuthology.orchestra.run.smithi178.stdout:{"id":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-21T09:03:16.468 DEBUG:tasks.util.rgw: json result: {'id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-21T09:03:16.469 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-21T09:03:16.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-21T09:03:16.469 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-21T09:03:16.511 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:16.511 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:16.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.510+0000 7fb92f335800 1 Processor -- start 2024-09-21T09:03:16.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.510+0000 7fb92f335800 1 -- start start 2024-09-21T09:03:16.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.510+0000 7fb92f335800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x562ec3699540 0x562ec3699940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.510+0000 7fb92f335800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562ec3559b30 con 0x562ec3699e80 2024-09-21T09:03:16.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.510+0000 7fb92f335800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x562ec353b360 con 0x562ec3699540 2024-09-21T09:03:16.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.511+0000 7fb92b0ee640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x562ec3699540 0x562ec3699940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.511+0000 7fb92b0ee640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x562ec3699540 0x562ec3699940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55806/0 (socket says 172.21.15.178:55806) 2024-09-21T09:03:16.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.511+0000 7fb92a8ed640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x562ec3699e80 0x562ec369ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:58320/0 (socket says 172.21.15.178:58320) 2024-09-21T09:03:16.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.511+0000 7fb92b0ee640 1 -- 172.21.15.178:0/3261384833 learned_addr learned my addr 172.21.15.178:0/3261384833 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.511+0000 7fb92b0ee640 1 -- 172.21.15.178:0/3261384833 >> v1:172.21.15.44:6789/0 conn(0x562ec3699e80 legacy=0x562ec369ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.511+0000 7fb92a0ec640 1 -- 172.21.15.178:0/3261384833 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2069769845 0 0) 0x562ec3559b30 con 0x562ec3699e80 2024-09-21T09:03:16.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.511+0000 7fb92b0ee640 1 -- 172.21.15.178:0/3261384833 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec3561e00 con 0x562ec3699540 2024-09-21T09:03:16.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.513+0000 7fb92b0ee640 1 --2- 172.21.15.178:0/3261384833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec3699940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb91c005fd0 tx=0x7fb91c045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1532423bd86c30bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.513+0000 7fb92a0ec640 1 -- 172.21.15.178:0/3261384833 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb91c04e600 con 0x562ec3699540 2024-09-21T09:03:16.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.513+0000 7fb92a0ec640 1 -- 172.21.15.178:0/3261384833 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c04e7a0 con 0x562ec3699540 2024-09-21T09:03:16.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.513+0000 7fb92a0ec640 1 -- 172.21.15.178:0/3261384833 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb91c04eaa0 con 0x562ec3699540 2024-09-21T09:03:16.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.513+0000 7fb92f335800 1 -- 172.21.15.178:0/3261384833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 msgr2=0x562ec3699940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.513+0000 7fb92f335800 1 --2- 172.21.15.178:0/3261384833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec3699940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb91c005fd0 tx=0x7fb91c045cf0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.513+0000 7fb92f335800 1 -- 172.21.15.178:0/3261384833 shutdown_connections 2024-09-21T09:03:16.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.513+0000 7fb92f335800 1 --2- 172.21.15.178:0/3261384833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec3699940 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.513+0000 7fb92f335800 1 -- 172.21.15.178:0/3261384833 >> 172.21.15.178:0/3261384833 conn(0x562ec3694dd0 msgr2=0x562ec36971f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.513+0000 7fb92f335800 1 -- 172.21.15.178:0/3261384833 shutdown_connections 2024-09-21T09:03:16.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.513+0000 7fb92f335800 1 -- 172.21.15.178:0/3261384833 wait complete. 2024-09-21T09:03:16.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.527+0000 7fb92f335800 1 Processor -- start 2024-09-21T09:03:16.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.527+0000 7fb92f335800 1 -- start start 2024-09-21T09:03:16.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.527+0000 7fb92f335800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec37854b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.527+0000 7fb92f335800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562ec35e6320 con 0x562ec3699540 2024-09-21T09:03:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.527+0000 7fb92b0ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec37854b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.528+0000 7fb92b0ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec37854b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55814/0 (socket says 172.21.15.178:55814) 2024-09-21T09:03:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.528+0000 7fb92b0ee640 1 -- 172.21.15.178:0/492420353 learned_addr learned my addr 172.21.15.178:0/492420353 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.528+0000 7fb92b0ee640 1 -- 172.21.15.178:0/492420353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec3533bc0 con 0x562ec3699540 2024-09-21T09:03:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.528+0000 7fb92b0ee640 1 --2- 172.21.15.178:0/492420353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec37854b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00a190 tx=0x7fb91c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38c0e1c91b72d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.528+0000 7fb81960a640 1 -- 172.21.15.178:0/492420353 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb91c065020 con 0x562ec3699540 2024-09-21T09:03:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.528+0000 7fb81960a640 1 -- 172.21.15.178:0/492420353 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c05c040 con 0x562ec3699540 2024-09-21T09:03:16.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.528+0000 7fb81960a640 1 -- 172.21.15.178:0/492420353 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb91c04ebb0 con 0x562ec3699540 2024-09-21T09:03:16.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.529+0000 7fb92f335800 1 -- 172.21.15.178:0/492420353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 msgr2=0x562ec37854b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.529+0000 7fb92f335800 1 --2- 172.21.15.178:0/492420353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec37854b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00a190 tx=0x7fb91c050000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.529+0000 7fb92f335800 1 -- 172.21.15.178:0/492420353 shutdown_connections 2024-09-21T09:03:16.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.529+0000 7fb92f335800 1 --2- 172.21.15.178:0/492420353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec37854b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.529+0000 7fb92f335800 1 -- 172.21.15.178:0/492420353 >> 172.21.15.178:0/492420353 conn(0x562ec3694dd0 msgr2=0x562ec3787b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.529+0000 7fb92f335800 1 -- 172.21.15.178:0/492420353 shutdown_connections 2024-09-21T09:03:16.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.529+0000 7fb92f335800 1 -- 172.21.15.178:0/492420353 wait complete. 2024-09-21T09:03:16.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.529+0000 7fb92f335800 1 Processor -- start 2024-09-21T09:03:16.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.529+0000 7fb92f335800 1 -- start start 2024-09-21T09:03:16.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.529+0000 7fb92f335800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec3793170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.529+0000 7fb92f335800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562ec36a0560 con 0x562ec3699540 2024-09-21T09:03:16.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.530+0000 7fb92b0ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec3793170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.530+0000 7fb92b0ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec3793170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55828/0 (socket says 172.21.15.178:55828) 2024-09-21T09:03:16.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.530+0000 7fb92b0ee640 1 -- 172.21.15.178:0/4140141831 learned_addr learned my addr 172.21.15.178:0/4140141831 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.530+0000 7fb92b0ee640 1 -- 172.21.15.178:0/4140141831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec3547fe0 con 0x562ec3699540 2024-09-21T09:03:16.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.530+0000 7fb92b0ee640 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec3793170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb91c045d30 tx=0x7fb91c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.530+0000 7fb817e07640 1 -- 172.21.15.178:0/4140141831 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb91c065030 con 0x562ec3699540 2024-09-21T09:03:16.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.530+0000 7fb817e07640 1 -- 172.21.15.178:0/4140141831 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c04ee50 con 0x562ec3699540 2024-09-21T09:03:16.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.530+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ec37936b0 con 0x562ec3699540 2024-09-21T09:03:16.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.530+0000 7fb817e07640 1 -- 172.21.15.178:0/4140141831 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb91c06c5e0 con 0x562ec3699540 2024-09-21T09:03:16.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.530+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ec3793c30 con 0x562ec3699540 2024-09-21T09:03:16.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.531+0000 7fb817e07640 1 -- 172.21.15.178:0/4140141831 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb91c06c780 con 0x562ec3699540 2024-09-21T09:03:16.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.531+0000 7fb817e07640 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb810036b90 0x7fb810039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.531+0000 7fb817e07640 1 -- 172.21.15.178:0/4140141831 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb91c090a00 con 0x562ec3699540 2024-09-21T09:03:16.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.531+0000 7fb92a8ed640 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb810036b90 0x7fb810039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.531+0000 7fb92f335800 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562ec3699e80 0x562ec379a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.531+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec379a760 con 0x562ec3699e80 2024-09-21T09:03:16.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.531+0000 7fb92b8ef640 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562ec3699e80 0x562ec379a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.532+0000 7fb92a8ed640 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb810036b90 0x7fb810039050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb920000c00 tx=0x7fb9200013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.532+0000 7fb92b8ef640 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562ec3699e80 0x562ec379a1e0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.532+0000 7fb92b8ef640 1 -- 172.21.15.178:0/4140141831 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x562ec3699e80 2024-09-21T09:03:16.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.532+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec3797770 con 0x562ec3699e80 2024-09-21T09:03:16.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.532+0000 7fb92b8ef640 1 -- 172.21.15.178:0/4140141831 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9240083e0 con 0x562ec3699e80 2024-09-21T09:03:16.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.532+0000 7fb92f335800 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562ec379ca50 0x562ec379ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.532+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec379f510 con 0x562ec379ca50 2024-09-21T09:03:16.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.533+0000 7fb92b0ee640 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562ec379ca50 0x562ec379ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.533+0000 7fb92b0ee640 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562ec379ca50 0x562ec379ee40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.533+0000 7fb92b0ee640 1 -- 172.21.15.178:0/4140141831 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb91c07b070 con 0x562ec379ca50 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.533+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec379b8f0 con 0x562ec3699e80 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.533+0000 7fb92b8ef640 1 -- 172.21.15.178:0/4140141831 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb9240083e0 con 0x562ec3699e80 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.533+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec379bd90 con 0x562ec3699e80 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.534+0000 7fb92b8ef640 1 -- 172.21.15.178:0/4140141831 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb9240083e0 con 0x562ec3699e80 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.534+0000 7fb92f335800 1 Processor -- start 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.534+0000 7fb92f335800 1 -- start start 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.534+0000 7fb92f335800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37adee0 0x562ec37ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.534+0000 7fb92f335800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562ec3535580 con 0x562ec37adee0 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.534+0000 7fb92b8ef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37adee0 0x562ec37ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.535+0000 7fb92b8ef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37adee0 0x562ec37ae300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55832/0 (socket says 172.21.15.178:55832) 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.535+0000 7fb92b8ef640 1 -- 172.21.15.178:0/1362963123 learned_addr learned my addr 172.21.15.178:0/1362963123 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.535+0000 7fb92b8ef640 1 -- 172.21.15.178:0/1362963123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec37ae840 con 0x562ec37adee0 2024-09-21T09:03:16.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.535+0000 7fb92b8ef640 1 --2- 172.21.15.178:0/1362963123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37adee0 0x562ec37ae300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x562ec3794220 tx=0x7fb92400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.535+0000 7fb815602640 1 -- 172.21.15.178:0/1362963123 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb924007d00 con 0x562ec37adee0 2024-09-21T09:03:16.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.535+0000 7fb815602640 1 -- 172.21.15.178:0/1362963123 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb92401e020 con 0x562ec37adee0 2024-09-21T09:03:16.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.535+0000 7fb92f335800 1 -- 172.21.15.178:0/1362963123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ec37aead0 con 0x562ec37adee0 2024-09-21T09:03:16.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.535+0000 7fb815602640 1 -- 172.21.15.178:0/1362963123 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb924019420 con 0x562ec37adee0 2024-09-21T09:03:16.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.535+0000 7fb92f335800 1 -- 172.21.15.178:0/1362963123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ec37b17b0 con 0x562ec37adee0 2024-09-21T09:03:16.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.536+0000 7fb815602640 1 -- 172.21.15.178:0/1362963123 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb924016040 con 0x562ec37adee0 2024-09-21T09:03:16.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.536+0000 7fb815602640 1 --2- 172.21.15.178:0/1362963123 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb804036b90 0x7fb804039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.536+0000 7fb815602640 1 -- 172.21.15.178:0/1362963123 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb92401f030 con 0x562ec37adee0 2024-09-21T09:03:16.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.536+0000 7fb92b0ee640 1 --2- 172.21.15.178:0/1362963123 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb804036b90 0x7fb804039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.536+0000 7fb92f335800 1 Processor -- start 2024-09-21T09:03:16.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.536+0000 7fb92b0ee640 1 --2- 172.21.15.178:0/1362963123 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb804036b90 0x7fb804039050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x562ec379ab80 tx=0x7fb91c061420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.536+0000 7fb92f335800 1 -- start start 2024-09-21T09:03:16.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.537+0000 7fb92f335800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37baae0 0x562ec37baee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.537+0000 7fb92f335800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562ec3783ac0 con 0x562ec37baae0 2024-09-21T09:03:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.537+0000 7fb92b8ef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37baae0 0x562ec37baee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.537+0000 7fb92b8ef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37baae0 0x562ec37baee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55844/0 (socket says 172.21.15.178:55844) 2024-09-21T09:03:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.537+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2492652507 learned_addr learned my addr 172.21.15.178:0/2492652507 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.537+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2492652507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec37bb4b0 con 0x562ec37baae0 2024-09-21T09:03:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.537+0000 7fb92b8ef640 1 --2- 172.21.15.178:0/2492652507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37baae0 0x562ec37baee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb924022470 tx=0x7fb924017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb35638aef8e94e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.537+0000 7fb80effd640 1 -- 172.21.15.178:0/2492652507 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb92401d030 con 0x562ec37baae0 2024-09-21T09:03:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.537+0000 7fb80effd640 1 -- 172.21.15.178:0/2492652507 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb924015d00 con 0x562ec37baae0 2024-09-21T09:03:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.537+0000 7fb80effd640 1 -- 172.21.15.178:0/2492652507 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9240197a0 con 0x562ec37baae0 2024-09-21T09:03:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.538+0000 7fb92f335800 1 -- 172.21.15.178:0/2492652507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37baae0 msgr2=0x562ec37baee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.538+0000 7fb92f335800 1 --2- 172.21.15.178:0/2492652507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37baae0 0x562ec37baee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb924022470 tx=0x7fb924017fa0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.538+0000 7fb92f335800 1 -- 172.21.15.178:0/2492652507 shutdown_connections 2024-09-21T09:03:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.538+0000 7fb92f335800 1 --2- 172.21.15.178:0/2492652507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37baae0 0x562ec37baee0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.538+0000 7fb92f335800 1 -- 172.21.15.178:0/2492652507 >> 172.21.15.178:0/2492652507 conn(0x562ec37b6e40 msgr2=0x562ec37b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.538+0000 7fb92f335800 1 -- 172.21.15.178:0/2492652507 shutdown_connections 2024-09-21T09:03:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.538+0000 7fb92f335800 1 -- 172.21.15.178:0/2492652507 wait complete. 2024-09-21T09:03:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.538+0000 7fb92f335800 1 Processor -- start 2024-09-21T09:03:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.538+0000 7fb92f335800 1 -- start start 2024-09-21T09:03:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.538+0000 7fb92f335800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37baae0 0x562ec37c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.538+0000 7fb92f335800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562ec37bbb20 con 0x562ec37baae0 2024-09-21T09:03:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.539+0000 7fb92b8ef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37baae0 0x562ec37c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.539+0000 7fb92b8ef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37baae0 0x562ec37c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55852/0 (socket says 172.21.15.178:55852) 2024-09-21T09:03:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.539+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 learned_addr learned my addr 172.21.15.178:0/2348311614 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.539+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec37c2490 con 0x562ec37baae0 2024-09-21T09:03:16.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.539+0000 7fb92b8ef640 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37baae0 0x562ec37c1f50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb924017fe0 tx=0x7fb92404ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.539+0000 7fb80d7fa640 1 -- 172.21.15.178:0/2348311614 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb924019b20 con 0x562ec37baae0 2024-09-21T09:03:16.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.539+0000 7fb80d7fa640 1 -- 172.21.15.178:0/2348311614 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9240153e0 con 0x562ec37baae0 2024-09-21T09:03:16.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.539+0000 7fb80d7fa640 1 -- 172.21.15.178:0/2348311614 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb924019cc0 con 0x562ec37baae0 2024-09-21T09:03:16.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.539+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ec37c2720 con 0x562ec37baae0 2024-09-21T09:03:16.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.539+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ec37c53d0 con 0x562ec37baae0 2024-09-21T09:03:16.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.540+0000 7fb80d7fa640 1 -- 172.21.15.178:0/2348311614 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb92402b350 con 0x562ec37baae0 2024-09-21T09:03:16.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.540+0000 7fb80d7fa640 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb7f4036ac0 0x7fb7f4038f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.540+0000 7fb80d7fa640 1 -- 172.21.15.178:0/2348311614 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb924043aa0 con 0x562ec37baae0 2024-09-21T09:03:16.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.540+0000 7fb92b0ee640 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb7f4036ac0 0x7fb7f4038f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.541+0000 7fb92f335800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.541+0000 7fb92f335800 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562ec37cd930 0x562ec37cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.541+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d0540 con 0x562ec37cd930 2024-09-21T09:03:16.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.541+0000 7fb92a8ed640 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562ec37cd930 0x562ec37cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.541+0000 7fb92b0ee640 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb7f4036ac0 0x7fb7f4038f80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb91c060c10 tx=0x7fb91c086000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.541+0000 7fb92a8ed640 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562ec37cd930 0x562ec37cfdf0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.541+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb92000f5f0 con 0x562ec37cd930 2024-09-21T09:03:16.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.541+0000 7fb92f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.541+0000 7fb92f335800 20 realm 2024-09-21T09:03:16.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.541+0000 7fb92f335800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.541+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec37ccd80 con 0x562ec37cd930 2024-09-21T09:03:16.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb92000f5f0 con 0x562ec37cd930 2024-09-21T09:03:16.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92f335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:16.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92f335800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d1020 con 0x562ec37cd930 2024-09-21T09:03:16.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb92000f5f0 con 0x562ec37cd930 2024-09-21T09:03:16.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92f335800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d18f0 con 0x562ec37cd930 2024-09-21T09:03:16.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb92000f5f0 con 0x562ec37cd930 2024-09-21T09:03:16.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92f335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:16.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92f335800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92f335800 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562ec37d21f0 0x562ec37d4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d4d60 con 0x562ec37d21f0 2024-09-21T09:03:16.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.542+0000 7fb92b8ef640 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562ec37d21f0 0x562ec37d4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.543+0000 7fb92b8ef640 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562ec37d21f0 0x562ec37d4600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.543+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.543+0000 7fb92f335800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.543+0000 7fb92f335800 20 searching for the correct realm 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.543+0000 7fb92f335800 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562ec37d6e00 0x562ec37d92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.543+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d6e00 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.543+0000 7fb92b0ee640 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562ec37d6e00 0x562ec37d92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.543+0000 7fb92b0ee640 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562ec37d6e00 0x562ec37d92c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.544+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.544+0000 7fb92b0ee640 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb91c090360 0x7fb91c0639c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.544+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x7fb91c090360 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.544+0000 7fb92a8ed640 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb91c090360 0x7fb91c0639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.544+0000 7fb92a8ed640 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb91c090360 0x7fb91c0639c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.544+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb92000f5f0 con 0x7fb91c090360 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.544+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d21f0 2024-09-21T09:03:16.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.544+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.545+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37cd930 2024-09-21T09:03:16.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.545+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb92000f5f0 con 0x562ec37cd930 2024-09-21T09:03:16.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.545+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37cd930 2024-09-21T09:03:16.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.545+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.545+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d21f0 2024-09-21T09:03:16.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.545+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.545+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d21f0 2024-09-21T09:03:16.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.546+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.546+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x7fb91c090360 2024-09-21T09:03:16.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.546+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb92002b040 con 0x7fb91c090360 2024-09-21T09:03:16.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.546+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d6e00 2024-09-21T09:03:16.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.546+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.546+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37cd930 2024-09-21T09:03:16.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.546+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.546+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d21f0 2024-09-21T09:03:16.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.547+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.547+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37cd930 2024-09-21T09:03:16.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.547+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.547+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x7fb91c090360 2024-09-21T09:03:16.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.547+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb92002b040 con 0x7fb91c090360 2024-09-21T09:03:16.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.547+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d6e00 2024-09-21T09:03:16.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.547+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.547+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d6e00 2024-09-21T09:03:16.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.548+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.548+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d21f0 2024-09-21T09:03:16.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.548+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.548+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d6e00 2024-09-21T09:03:16.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.548+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.548+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d6e00 2024-09-21T09:03:16.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.548+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.548+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37cd930 2024-09-21T09:03:16.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.548+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.548+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37cd930 2024-09-21T09:03:16.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.549+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.549+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d21f0 2024-09-21T09:03:16.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.549+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.549+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d6e00 2024-09-21T09:03:16.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.549+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.549+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x7fb91c090360 2024-09-21T09:03:16.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.549+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb92002b040 con 0x7fb91c090360 2024-09-21T09:03:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.549+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37cd930 2024-09-21T09:03:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.550+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.550+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d21f0 2024-09-21T09:03:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.550+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.550+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d6e00 2024-09-21T09:03:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.550+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.550+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d21f0 2024-09-21T09:03:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.551+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.551+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x7fb91c090360 2024-09-21T09:03:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.551+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb92002b040 con 0x7fb91c090360 2024-09-21T09:03:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.551+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d6e00 2024-09-21T09:03:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.551+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.551+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37d21f0 2024-09-21T09:03:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.551+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.551+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x562ec37cd930 2024-09-21T09:03:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9990 con 0x7fb91c090360 2024-09-21T09:03:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb92002b040 con 0x7fb91c090360 2024-09-21T09:03:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92f335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92f335800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92f335800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92f335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92f335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92f335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92f335800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d5800 con 0x562ec37cd930 2024-09-21T09:03:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92f335800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d5c80 con 0x562ec37cd930 2024-09-21T09:03:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92f335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92f335800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.552+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d6120 con 0x562ec37cd930 2024-09-21T09:03:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92f335800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92f335800 20 zone default found 2024-09-21T09:03:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92f335800 4 Realm: () 2024-09-21T09:03:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92f335800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92f335800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92f335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92f335800 20 zonegroup default 2024-09-21T09:03:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92f335800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec37d9e10 con 0x562ec37d21f0 2024-09-21T09:03:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92f335800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec37dc040 con 0x562ec37d6e00 2024-09-21T09:03:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.553+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.554+0000 7fb92f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.554+0000 7fb92f335800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.554+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec37dc3e0 con 0x562ec37d6e00 2024-09-21T09:03:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.554+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.554+0000 7fb92f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.554+0000 7fb92f335800 20 started sync module instance, tier type = 2024-09-21T09:03:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.554+0000 7fb92f335800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.554+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37db480 con 0x7fb91c090360 2024-09-21T09:03:16.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.555+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x7fb91c090360 2024-09-21T09:03:16.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.555+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94758848280736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37db480 con 0x7fb91c090360 2024-09-21T09:03:16.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.555+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37dcda0 con 0x562ec37cd930 2024-09-21T09:03:16.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.556+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94758848280736] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x7fb91c090360 2024-09-21T09:03:16.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.556+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.556+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94758848278960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37dcda0 con 0x562ec37cd930 2024-09-21T09:03:16.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.556+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37dd760 con 0x562ec37d6e00 2024-09-21T09:03:16.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.559+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94758848278960] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.559+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.559+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94758848284912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37dcd10 con 0x562ec37d6e00 2024-09-21T09:03:16.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.559+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37de5d0 con 0x7fb91c090360 2024-09-21T09:03:16.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.560+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94758848284912] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.560+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x7fb91c090360 2024-09-21T09:03:16.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.560+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94758848291104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37de9f0 con 0x7fb91c090360 2024-09-21T09:03:16.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.560+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37df3b0 con 0x562ec37cd930 2024-09-21T09:03:16.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.561+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94758848291104] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x7fb91c090360 2024-09-21T09:03:16.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.561+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.561+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94758848292640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37df3b0 con 0x562ec37cd930 2024-09-21T09:03:16.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.561+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37dfd70 con 0x562ec37d21f0 2024-09-21T09:03:16.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.562+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.562+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94758848292640] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.562+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94758848295136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37dfd70 con 0x562ec37d21f0 2024-09-21T09:03:16.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.562+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37e0730 con 0x562ec37d21f0 2024-09-21T09:03:16.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.563+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94758848295136] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.563+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.563+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94758848297152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37e0910 con 0x562ec37d21f0 2024-09-21T09:03:16.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.563+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37e1160 con 0x562ec37d21f0 2024-09-21T09:03:16.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.564+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94758848297152] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.564+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.564+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94758848300608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37e0ff0 con 0x562ec37d21f0 2024-09-21T09:03:16.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.564+0000 7fb92f335800 20 add_watcher() i=0 2024-09-21T09:03:16.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.564+0000 7fb92f335800 20 add_watcher() i=1 2024-09-21T09:03:16.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.564+0000 7fb92f335800 20 add_watcher() i=2 2024-09-21T09:03:16.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.564+0000 7fb92f335800 20 add_watcher() i=3 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.564+0000 7fb92f335800 20 add_watcher() i=4 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.564+0000 7fb92f335800 20 add_watcher() i=5 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.564+0000 7fb92f335800 20 add_watcher() i=6 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.565+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94758848300608] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.565+0000 7fb92f335800 20 add_watcher() i=7 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.565+0000 7fb92f335800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.565+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec37e45b0 con 0x562ec37cd930 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.566+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.566+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94758848301728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec37e1ad0 con 0x562ec37cd930 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.567+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94758848301728] v29'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.567+0000 7fb7e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.567+0000 7fb92f335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.567+0000 7fb92f335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.567+0000 7fb92f335800 5 note: GC not initialized 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.567+0000 7fb7e0fe1640 20 reqs_thread_entry: start 2024-09-21T09:03:16.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.567+0000 7fb92f335800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.567+0000 7fb92f335800 20 Filter name: none 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.567+0000 7fb75a7fc640 20 reqs_thread_entry: start 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.567+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec3817e40 con 0x562ec37cd930 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.568+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.568+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec3817e40 con 0x7fb91c090360 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.568+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x7fb91c090360 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.568+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec3817e00 con 0x562ec37cd930 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.568+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.568+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec3817e00 con 0x562ec37d6e00 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.568+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.568+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec3818310 con 0x562ec37d6e00 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.569+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.569+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec3818740 con 0x562ec37d6e00 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.569+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.569+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec3818740 con 0x562ec37cd930 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.569+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.569+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec3818740 con 0x562ec37cd930 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.569+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.569+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec3818740 con 0x562ec37d6e00 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.569+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.569+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186f0 con 0x562ec37d6e00 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.570+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.570+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186d0 con 0x562ec37d21f0 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.570+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.570+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186d0 con 0x562ec37cd930 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.570+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.570+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186d0 con 0x7fb91c090360 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.571+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x7fb91c090360 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.571+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186d0 con 0x562ec37d6e00 2024-09-21T09:03:16.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.571+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.571+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d21f0 2024-09-21T09:03:16.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.571+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.571+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d21f0 2024-09-21T09:03:16.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.572+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.572+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d6e00 2024-09-21T09:03:16.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.572+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.572+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d21f0 2024-09-21T09:03:16.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.572+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.572+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37cd930 2024-09-21T09:03:16.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.572+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.572+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d6e00 2024-09-21T09:03:16.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.572+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.573+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d21f0 2024-09-21T09:03:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.573+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.573+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x7fb91c090360 2024-09-21T09:03:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.573+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x7fb91c090360 2024-09-21T09:03:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.573+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d21f0 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.573+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.573+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37cd930 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.574+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.574+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37cd930 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.574+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.574+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d6e00 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.574+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.574+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37cd930 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.574+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.574+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37cd930 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.574+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.574+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d6e00 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.575+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.575+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d6e00 2024-09-21T09:03:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.575+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.575+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d6e00 2024-09-21T09:03:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.575+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.575+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d21f0 2024-09-21T09:03:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.576+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.576+0000 7fb7e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.576+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94758848301728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37cd930 2024-09-21T09:03:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.577+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94758848301728] v29'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.577+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94758848280736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x7fb91c090360 2024-09-21T09:03:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.578+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94758848280736] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x7fb91c090360 2024-09-21T09:03:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.578+0000 7fb92f335800 20 remove_watcher() i=0 2024-09-21T09:03:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.578+0000 7fb92f335800 2 removed watcher, disabling cache 2024-09-21T09:03:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.578+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94758848278960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37cd930 2024-09-21T09:03:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.579+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94758848278960] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.579+0000 7fb92f335800 20 remove_watcher() i=1 2024-09-21T09:03:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.579+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94758848284912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d6e00 2024-09-21T09:03:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.580+0000 7fb92b0ee640 1 -- 172.21.15.178:0/2348311614 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94758848284912] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c099070 con 0x562ec37d6e00 2024-09-21T09:03:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.580+0000 7fb92f335800 20 remove_watcher() i=2 2024-09-21T09:03:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.580+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94758848291104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x7fb91c090360 2024-09-21T09:03:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.581+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94758848291104] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x7fb91c090360 2024-09-21T09:03:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.581+0000 7fb92f335800 20 remove_watcher() i=3 2024-09-21T09:03:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.581+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94758848292640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37cd930 2024-09-21T09:03:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.582+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94758848292640] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb92002b040 con 0x562ec37cd930 2024-09-21T09:03:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.582+0000 7fb92f335800 20 remove_watcher() i=4 2024-09-21T09:03:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.582+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94758848295136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d21f0 2024-09-21T09:03:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.584+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94758848295136] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.584+0000 7fb92f335800 20 remove_watcher() i=5 2024-09-21T09:03:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.584+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94758848297152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d21f0 2024-09-21T09:03:16.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.585+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94758848297152] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.585+0000 7fb92f335800 20 remove_watcher() i=6 2024-09-21T09:03:16.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.585+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94758848300608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562ec38186b0 con 0x562ec37d21f0 2024-09-21T09:03:16.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92b8ef640 1 -- 172.21.15.178:0/2348311614 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94758848300608] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb924056040 con 0x562ec37d21f0 2024-09-21T09:03:16.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 20 remove_watcher() i=7 2024-09-21T09:03:16.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562ec37d21f0 msgr2=0x562ec37d4600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562ec37d21f0 0x562ec37d4600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562ec37cd930 msgr2=0x562ec37cfdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562ec37cd930 0x562ec37cfdf0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb91c090360 msgr2=0x7fb91c0639c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb91c090360 0x7fb91c0639c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562ec37d6e00 msgr2=0x562ec37d92c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562ec37d6e00 0x562ec37d92c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb7f4036ac0 msgr2=0x7fb7f4038f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb7f4036ac0 0x7fb7f4038f80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb91c060c10 tx=0x7fb91c086000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37baae0 msgr2=0x562ec37c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 --2- 172.21.15.178:0/2348311614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37baae0 0x562ec37c1f50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb924017fe0 tx=0x7fb92404ce20 comp rx=0 tx=0).stop 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 reap_dead start 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92a8ed640 1 -- 172.21.15.178:0/2348311614 reap_dead start 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 shutdown_connections 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 >> 172.21.15.178:0/2348311614 conn(0x562ec37b6e40 msgr2=0x562ec37b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 shutdown_connections 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 -- 172.21.15.178:0/2348311614 wait complete. 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 -- 172.21.15.178:0/1362963123 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb804036b90 msgr2=0x7fb804039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 --2- 172.21.15.178:0/1362963123 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb804036b90 0x7fb804039050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x562ec379ab80 tx=0x7fb91c061420 comp rx=0 tx=0).stop 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 -- 172.21.15.178:0/1362963123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37adee0 msgr2=0x562ec37ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.586+0000 7fb92f335800 1 --2- 172.21.15.178:0/1362963123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37adee0 0x562ec37ae300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x562ec3794220 tx=0x7fb92400aec0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 -- 172.21.15.178:0/1362963123 shutdown_connections 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 --2- 172.21.15.178:0/1362963123 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb804036b90 0x7fb804039050 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 --2- 172.21.15.178:0/1362963123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec37adee0 0x562ec37ae300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 -- 172.21.15.178:0/1362963123 >> 172.21.15.178:0/1362963123 conn(0x562ec37a2e70 msgr2=0x562ec37a59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 -- 172.21.15.178:0/1362963123 shutdown_connections 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 -- 172.21.15.178:0/1362963123 wait complete. 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562ec379ca50 msgr2=0x562ec379ee40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562ec379ca50 0x562ec379ee40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562ec3699e80 msgr2=0x562ec379a1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562ec3699e80 0x562ec379a1e0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb810036b90 msgr2=0x7fb810039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb810036b90 0x7fb810039050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb920000c00 tx=0x7fb9200013b0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 msgr2=0x562ec3793170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec3793170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb91c045d30 tx=0x7fb91c003330 comp rx=0 tx=0).stop 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 shutdown_connections 2024-09-21T09:03:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562ec379ca50 0x562ec379ee40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562ec3699e80 0x562ec379a1e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb810036b90 0x7fb810039050 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 --2- 172.21.15.178:0/4140141831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec3699540 0x562ec3793170 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 >> 172.21.15.178:0/4140141831 conn(0x562ec3694dd0 msgr2=0x562ec37827e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 shutdown_connections 2024-09-21T09:03:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.587+0000 7fb92f335800 1 -- 172.21.15.178:0/4140141831 wait complete. 2024-09-21T09:03:16.597 INFO:teuthology.orchestra.run.smithi178.stdout:{"entries":[],"summary":[]} 2024-09-21T09:03:16.597 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-21T09:03:16.597 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T09:03:16.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T09:03:16.598 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T09:03:16.682 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:16.682 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:16.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.681+0000 7fd1de098800 1 Processor -- start 2024-09-21T09:03:16.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.681+0000 7fd1de098800 1 -- start start 2024-09-21T09:03:16.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.681+0000 7fd1de098800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x561cd7e89610 0x561cd7f18270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.681+0000 7fd1de098800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561cd7dd4b30 con 0x561cd7f187b0 2024-09-21T09:03:16.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.681+0000 7fd1de098800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x561cd7db6360 con 0x561cd7e89610 2024-09-21T09:03:16.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.682+0000 7fd1dbb8c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x561cd7e89610 0x561cd7f18270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.682+0000 7fd1d338b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x561cd7f187b0 0x561cd7f1aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:58336/0 (socket says 172.21.15.178:58336) 2024-09-21T09:03:16.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.682+0000 7fd1dbb8c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x561cd7e89610 0x561cd7f18270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55866/0 (socket says 172.21.15.178:55866) 2024-09-21T09:03:16.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.682+0000 7fd1d338b640 1 -- 172.21.15.178:0/2607020469 learned_addr learned my addr 172.21.15.178:0/2607020469 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:16.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.682+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/2607020469 >> v1:172.21.15.44:6789/0 conn(0x561cd7f187b0 legacy=0x561cd7f1aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.682+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/2607020469 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cd7ddce00 con 0x561cd7e89610 2024-09-21T09:03:16.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.684+0000 7fd1dbb8c640 1 --2- 172.21.15.178:0/2607020469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd7f18270 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00a470 tx=0x7fd1cc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a404c32fd9c2dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.684+0000 7fd1db38b640 1 -- 172.21.15.178:0/2607020469 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc053570 con 0x561cd7e89610 2024-09-21T09:03:16.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.684+0000 7fd1db38b640 1 -- 172.21.15.178:0/2607020469 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1cc058070 con 0x561cd7e89610 2024-09-21T09:03:16.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.684+0000 7fd1db38b640 1 -- 172.21.15.178:0/2607020469 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc053880 con 0x561cd7e89610 2024-09-21T09:03:16.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.684+0000 7fd1de098800 1 -- 172.21.15.178:0/2607020469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 msgr2=0x561cd7f18270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.684+0000 7fd1de098800 1 --2- 172.21.15.178:0/2607020469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd7f18270 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00a470 tx=0x7fd1cc045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:16.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.684+0000 7fd1de098800 1 -- 172.21.15.178:0/2607020469 shutdown_connections 2024-09-21T09:03:16.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.684+0000 7fd1de098800 1 --2- 172.21.15.178:0/2607020469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd7f18270 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.684+0000 7fd1de098800 1 -- 172.21.15.178:0/2607020469 >> 172.21.15.178:0/2607020469 conn(0x561cd7f0fde0 msgr2=0x561cd7f12200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.684+0000 7fd1de098800 1 -- 172.21.15.178:0/2607020469 shutdown_connections 2024-09-21T09:03:16.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.684+0000 7fd1de098800 1 -- 172.21.15.178:0/2607020469 wait complete. 2024-09-21T09:03:16.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.698+0000 7fd1de098800 1 Processor -- start 2024-09-21T09:03:16.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.698+0000 7fd1de098800 1 -- start start 2024-09-21T09:03:16.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.698+0000 7fd1de098800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd7f15b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.698+0000 7fd1de098800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561cd7e61330 con 0x561cd7e89610 2024-09-21T09:03:16.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.699+0000 7fd1dbb8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd7f15b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.699+0000 7fd1dbb8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd7f15b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55868/0 (socket says 172.21.15.178:55868) 2024-09-21T09:03:16.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.699+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/2011292369 learned_addr learned my addr 172.21.15.178:0/2011292369 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.699+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/2011292369 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cd7daebc0 con 0x561cd7e89610 2024-09-21T09:03:16.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.699+0000 7fd1dbb8c640 1 --2- 172.21.15.178:0/2011292369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd7f15b80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc025c20 tx=0x7fd1cc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2587aad745a410f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.699+0000 7fd0c9e0b640 1 -- 172.21.15.178:0/2011292369 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc05c580 con 0x561cd7e89610 2024-09-21T09:03:16.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.699+0000 7fd0c9e0b640 1 -- 172.21.15.178:0/2011292369 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1cc063030 con 0x561cd7e89610 2024-09-21T09:03:16.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.699+0000 7fd0c9e0b640 1 -- 172.21.15.178:0/2011292369 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc05c850 con 0x561cd7e89610 2024-09-21T09:03:16.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.700+0000 7fd1de098800 1 -- 172.21.15.178:0/2011292369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 msgr2=0x561cd7f15b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.700+0000 7fd1de098800 1 --2- 172.21.15.178:0/2011292369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd7f15b80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc025c20 tx=0x7fd1cc051000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.700+0000 7fd1de098800 1 -- 172.21.15.178:0/2011292369 shutdown_connections 2024-09-21T09:03:16.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.700+0000 7fd1de098800 1 --2- 172.21.15.178:0/2011292369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd7f15b80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.700+0000 7fd1de098800 1 -- 172.21.15.178:0/2011292369 >> 172.21.15.178:0/2011292369 conn(0x561cd7f0fde0 msgr2=0x561cd8000240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.700+0000 7fd1de098800 1 -- 172.21.15.178:0/2011292369 shutdown_connections 2024-09-21T09:03:16.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.700+0000 7fd1de098800 1 -- 172.21.15.178:0/2011292369 wait complete. 2024-09-21T09:03:16.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.700+0000 7fd1de098800 1 Processor -- start 2024-09-21T09:03:16.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.700+0000 7fd1de098800 1 -- start start 2024-09-21T09:03:16.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.701+0000 7fd1de098800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd800e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.701+0000 7fd1de098800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561cd7f1c680 con 0x561cd7e89610 2024-09-21T09:03:16.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.701+0000 7fd1dbb8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd800e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.701+0000 7fd1dbb8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd800e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55870/0 (socket says 172.21.15.178:55870) 2024-09-21T09:03:16.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.701+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/2566238926 learned_addr learned my addr 172.21.15.178:0/2566238926 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.701+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/2566238926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cd7dc2fe0 con 0x561cd7e89610 2024-09-21T09:03:16.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.701+0000 7fd1dbb8c640 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd800e380 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00a330 tx=0x7fd1cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.702+0000 7fd0c3fff640 1 -- 172.21.15.178:0/2566238926 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc06c030 con 0x561cd7e89610 2024-09-21T09:03:16.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.702+0000 7fd0c3fff640 1 -- 172.21.15.178:0/2566238926 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1cc05c580 con 0x561cd7e89610 2024-09-21T09:03:16.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.702+0000 7fd0c3fff640 1 -- 172.21.15.178:0/2566238926 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc05c860 con 0x561cd7e89610 2024-09-21T09:03:16.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.702+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cd800e8c0 con 0x561cd7e89610 2024-09-21T09:03:16.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.702+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cd800ee40 con 0x561cd7e89610 2024-09-21T09:03:16.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.702+0000 7fd0c3fff640 1 -- 172.21.15.178:0/2566238926 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd1cc053440 con 0x561cd7e89610 2024-09-21T09:03:16.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.703+0000 7fd0c3fff640 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0c4036b90 0x7fd0c4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.703+0000 7fd0c3fff640 1 -- 172.21.15.178:0/2566238926 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fd1cc070020 con 0x561cd7e89610 2024-09-21T09:03:16.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.703+0000 7fd1d338b640 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0c4036b90 0x7fd0c4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.703+0000 7fd1de098800 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cd7f187b0 0x561cd80153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.703+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd8015970 con 0x561cd7f187b0 2024-09-21T09:03:16.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.703+0000 7fd1dc38d640 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cd7f187b0 0x561cd80153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.703+0000 7fd1d338b640 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0c4036b90 0x7fd0c4039050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4000f60 tx=0x7fd1c40012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.703+0000 7fd1dc38d640 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cd7f187b0 0x561cd80153f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.703+0000 7fd1dc38d640 1 -- 172.21.15.178:0/2566238926 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1d400a4a0 con 0x561cd7f187b0 2024-09-21T09:03:16.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.703+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd80129c0 con 0x561cd7f187b0 2024-09-21T09:03:16.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.704+0000 7fd1dc38d640 1 -- 172.21.15.178:0/2566238926 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd1d400a4a0 con 0x561cd7f187b0 2024-09-21T09:03:16.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.704+0000 7fd1de098800 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cd8017cf0 0x561cd801a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.704+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd801a7d0 con 0x561cd8017cf0 2024-09-21T09:03:16.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.704+0000 7fd1dbb8c640 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cd8017cf0 0x561cd801a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.704+0000 7fd1dbb8c640 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cd8017cf0 0x561cd801a0e0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.705+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/2566238926 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd1cc07b070 con 0x561cd8017cf0 2024-09-21T09:03:16.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.705+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd8016b90 con 0x561cd7f187b0 2024-09-21T09:03:16.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.705+0000 7fd1dc38d640 1 -- 172.21.15.178:0/2566238926 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd1d400a4a0 con 0x561cd7f187b0 2024-09-21T09:03:16.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.705+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd8017070 con 0x561cd7f187b0 2024-09-21T09:03:16.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.705+0000 7fd1dc38d640 1 -- 172.21.15.178:0/2566238926 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd1d400a4a0 con 0x561cd7f187b0 2024-09-21T09:03:16.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.705+0000 7fd1de098800 1 Processor -- start 2024-09-21T09:03:16.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.706+0000 7fd1de098800 1 -- start start 2024-09-21T09:03:16.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.706+0000 7fd1de098800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8029150 0x561cd8029570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.706+0000 7fd1de098800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561cd7db0580 con 0x561cd8029150 2024-09-21T09:03:16.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.706+0000 7fd1dc38d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8029150 0x561cd8029570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.706+0000 7fd1dc38d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8029150 0x561cd8029570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55876/0 (socket says 172.21.15.178:55876) 2024-09-21T09:03:16.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.706+0000 7fd1dc38d640 1 -- 172.21.15.178:0/377068497 learned_addr learned my addr 172.21.15.178:0/377068497 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.706+0000 7fd1dc38d640 1 -- 172.21.15.178:0/377068497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cd8029ab0 con 0x561cd8029150 2024-09-21T09:03:16.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.706+0000 7fd1dc38d640 1 --2- 172.21.15.178:0/377068497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8029150 0x561cd8029570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x561cd8015d50 tx=0x7fd1d4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.707+0000 7fd0c17fa640 1 -- 172.21.15.178:0/377068497 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d4014450 con 0x561cd8029150 2024-09-21T09:03:16.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.707+0000 7fd0c17fa640 1 -- 172.21.15.178:0/377068497 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d4014610 con 0x561cd8029150 2024-09-21T09:03:16.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.707+0000 7fd1de098800 1 -- 172.21.15.178:0/377068497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cd8029d40 con 0x561cd8029150 2024-09-21T09:03:16.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.707+0000 7fd0c17fa640 1 -- 172.21.15.178:0/377068497 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d4014930 con 0x561cd8029150 2024-09-21T09:03:16.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.707+0000 7fd1de098800 1 -- 172.21.15.178:0/377068497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cd802ca20 con 0x561cd8029150 2024-09-21T09:03:16.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.707+0000 7fd0c17fa640 1 -- 172.21.15.178:0/377068497 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd1d4011040 con 0x561cd8029150 2024-09-21T09:03:16.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.707+0000 7fd0c17fa640 1 --2- 172.21.15.178:0/377068497 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0b4036b90 0x7fd0b4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.708+0000 7fd0c17fa640 1 -- 172.21.15.178:0/377068497 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fd1d401e070 con 0x561cd8029150 2024-09-21T09:03:16.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.708+0000 7fd1dbb8c640 1 --2- 172.21.15.178:0/377068497 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0b4036b90 0x7fd0b4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.708+0000 7fd1de098800 1 Processor -- start 2024-09-21T09:03:16.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.708+0000 7fd1de098800 1 -- start start 2024-09-21T09:03:16.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.708+0000 7fd1dbb8c640 1 --2- 172.21.15.178:0/377068497 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0b4036b90 0x7fd0b4039050 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x561cd8015e40 tx=0x7fd1cc000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.708+0000 7fd1de098800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8035d60 0x561cd8036160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.708+0000 7fd1de098800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561cd7f14220 con 0x561cd8035d60 2024-09-21T09:03:16.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.708+0000 7fd1dc38d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8035d60 0x561cd8036160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.708+0000 7fd1dc38d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8035d60 0x561cd8036160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55890/0 (socket says 172.21.15.178:55890) 2024-09-21T09:03:16.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.708+0000 7fd1dc38d640 1 -- 172.21.15.178:0/1881291598 learned_addr learned my addr 172.21.15.178:0/1881291598 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.709+0000 7fd1dc38d640 1 -- 172.21.15.178:0/1881291598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cd80366a0 con 0x561cd8035d60 2024-09-21T09:03:16.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.709+0000 7fd1dc38d640 1 --2- 172.21.15.178:0/1881291598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8035d60 0x561cd8036160 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd1d404ccb0 tx=0x7fd1d4011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8b1adbfaf60d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.709+0000 7fd0baffd640 1 -- 172.21.15.178:0/1881291598 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d4016940 con 0x561cd8035d60 2024-09-21T09:03:16.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.709+0000 7fd0baffd640 1 -- 172.21.15.178:0/1881291598 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d4014ad0 con 0x561cd8035d60 2024-09-21T09:03:16.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.709+0000 7fd0baffd640 1 -- 172.21.15.178:0/1881291598 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d4046aa0 con 0x561cd8035d60 2024-09-21T09:03:16.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.709+0000 7fd1de098800 1 -- 172.21.15.178:0/1881291598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8035d60 msgr2=0x561cd8036160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.709+0000 7fd1de098800 1 --2- 172.21.15.178:0/1881291598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8035d60 0x561cd8036160 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd1d404ccb0 tx=0x7fd1d4011970 comp rx=0 tx=0).stop 2024-09-21T09:03:16.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.709+0000 7fd1de098800 1 -- 172.21.15.178:0/1881291598 shutdown_connections 2024-09-21T09:03:16.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.709+0000 7fd1de098800 1 --2- 172.21.15.178:0/1881291598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8035d60 0x561cd8036160 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.709+0000 7fd1de098800 1 -- 172.21.15.178:0/1881291598 >> 172.21.15.178:0/1881291598 conn(0x561cd8032110 msgr2=0x561cd8030210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.709+0000 7fd1de098800 1 -- 172.21.15.178:0/1881291598 shutdown_connections 2024-09-21T09:03:16.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.709+0000 7fd1de098800 1 -- 172.21.15.178:0/1881291598 wait complete. 2024-09-21T09:03:16.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.710+0000 7fd1de098800 1 Processor -- start 2024-09-21T09:03:16.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.710+0000 7fd1de098800 1 -- start start 2024-09-21T09:03:16.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.710+0000 7fd1de098800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8035d60 0x561cd803d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.710+0000 7fd1de098800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561cd8036d40 con 0x561cd8035d60 2024-09-21T09:03:16.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.710+0000 7fd1dc38d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8035d60 0x561cd803d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.710+0000 7fd1dc38d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8035d60 0x561cd803d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55898/0 (socket says 172.21.15.178:55898) 2024-09-21T09:03:16.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.710+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 learned_addr learned my addr 172.21.15.178:0/3780347919 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.710+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cd803d7a0 con 0x561cd8035d60 2024-09-21T09:03:16.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.710+0000 7fd1dc38d640 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8035d60 0x561cd803d260 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd1d404bbd0 tx=0x7fd1d404cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.711+0000 7fd0b97fa640 1 -- 172.21.15.178:0/3780347919 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d4016940 con 0x561cd8035d60 2024-09-21T09:03:16.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.711+0000 7fd0b97fa640 1 -- 172.21.15.178:0/3780347919 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d4014c80 con 0x561cd8035d60 2024-09-21T09:03:16.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.711+0000 7fd0b97fa640 1 -- 172.21.15.178:0/3780347919 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d404e4a0 con 0x561cd8035d60 2024-09-21T09:03:16.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.711+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cd803da30 con 0x561cd8035d60 2024-09-21T09:03:16.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.711+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cd80406e0 con 0x561cd8035d60 2024-09-21T09:03:16.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.711+0000 7fd0b97fa640 1 -- 172.21.15.178:0/3780347919 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd1d40133b0 con 0x561cd8035d60 2024-09-21T09:03:16.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.712+0000 7fd0b97fa640 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0a4036b40 0x7fd0a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.712+0000 7fd0b97fa640 1 -- 172.21.15.178:0/3780347919 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fd1d4034070 con 0x561cd8035d60 2024-09-21T09:03:16.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.712+0000 7fd1dbb8c640 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0a4036b40 0x7fd0a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.712+0000 7fd1de098800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.712+0000 7fd1de098800 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cd8048ec0 0x561cd804b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.712+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd804bad0 con 0x561cd8048ec0 2024-09-21T09:03:16.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.712+0000 7fd1d338b640 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cd8048ec0 0x561cd804b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.712+0000 7fd1dbb8c640 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0a4036b40 0x7fd0a4039000 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x561cd801abd0 tx=0x7fd1cc086000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.712+0000 7fd1d338b640 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cd8048ec0 0x561cd804b380 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1c4009050 con 0x561cd8048ec0 2024-09-21T09:03:16.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 20 realm 2024-09-21T09:03:16.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd8048310 con 0x561cd8048ec0 2024-09-21T09:03:16.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1c4009050 con 0x561cd8048ec0 2024-09-21T09:03:16.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:16.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd804c5b0 con 0x561cd8048ec0 2024-09-21T09:03:16.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1c4009050 con 0x561cd8048ec0 2024-09-21T09:03:16.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd804ce80 con 0x561cd8048ec0 2024-09-21T09:03:16.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd1c4009050 con 0x561cd8048ec0 2024-09-21T09:03:16.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:16.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cd804d730 0x561cd804fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.713+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd8050260 con 0x561cd804d730 2024-09-21T09:03:16.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.714+0000 7fd1dc38d640 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cd804d730 0x561cd804fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.714+0000 7fd1dc38d640 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cd804d730 0x561cd804fb20 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.714+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.714+0000 7fd1de098800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:16.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.714+0000 7fd1de098800 20 searching for the correct realm 2024-09-21T09:03:16.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.714+0000 7fd1de098800 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x561cd8052310 0x561cd80547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.714+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8052310 2024-09-21T09:03:16.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.714+0000 7fd1dbb8c640 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x561cd8052310 0x561cd80547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.715+0000 7fd1dbb8c640 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x561cd8052310 0x561cd80547d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.715+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1cc099070 con 0x561cd8052310 2024-09-21T09:03:16.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.715+0000 7fd1dbb8c640 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd1cc05c070 0x7fd1cc053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.715+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x7fd1cc05c070 2024-09-21T09:03:16.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.715+0000 7fd1d338b640 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd1cc05c070 0x7fd1cc053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.715+0000 7fd1d338b640 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd1cc05c070 0x7fd1cc053730 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.715+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c4009050 con 0x7fd1cc05c070 2024-09-21T09:03:16.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.715+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd804d730 2024-09-21T09:03:16.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.716+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.716+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8048ec0 2024-09-21T09:03:16.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.716+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c4009050 con 0x561cd8048ec0 2024-09-21T09:03:16.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.716+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8048ec0 2024-09-21T09:03:16.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.716+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c4029040 con 0x561cd8048ec0 2024-09-21T09:03:16.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.716+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd804d730 2024-09-21T09:03:16.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.716+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.716+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd804d730 2024-09-21T09:03:16.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.717+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.717+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x7fd1cc05c070 2024-09-21T09:03:16.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.717+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c4029040 con 0x7fd1cc05c070 2024-09-21T09:03:16.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.717+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8052310 2024-09-21T09:03:16.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.717+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1cc099070 con 0x561cd8052310 2024-09-21T09:03:16.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.717+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8048ec0 2024-09-21T09:03:16.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.717+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c4029040 con 0x561cd8048ec0 2024-09-21T09:03:16.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.717+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd804d730 2024-09-21T09:03:16.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.718+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.718+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8048ec0 2024-09-21T09:03:16.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.718+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c4029040 con 0x561cd8048ec0 2024-09-21T09:03:16.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.718+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x7fd1cc05c070 2024-09-21T09:03:16.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.718+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd1c4029040 con 0x7fd1cc05c070 2024-09-21T09:03:16.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.718+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8052310 2024-09-21T09:03:16.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.718+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1cc099070 con 0x561cd8052310 2024-09-21T09:03:16.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.718+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8052310 2024-09-21T09:03:16.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.719+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1cc099070 con 0x561cd8052310 2024-09-21T09:03:16.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.719+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd804d730 2024-09-21T09:03:16.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.719+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.719+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8052310 2024-09-21T09:03:16.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.719+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1cc099070 con 0x561cd8052310 2024-09-21T09:03:16.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.719+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8052310 2024-09-21T09:03:16.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.719+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1cc099070 con 0x561cd8052310 2024-09-21T09:03:16.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.719+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8048ec0 2024-09-21T09:03:16.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.719+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd1c4029040 con 0x561cd8048ec0 2024-09-21T09:03:16.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.719+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8048ec0 2024-09-21T09:03:16.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.720+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd1c4029040 con 0x561cd8048ec0 2024-09-21T09:03:16.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.720+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd804d730 2024-09-21T09:03:16.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.720+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.720+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8052310 2024-09-21T09:03:16.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.720+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1cc099070 con 0x561cd8052310 2024-09-21T09:03:16.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.720+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x7fd1cc05c070 2024-09-21T09:03:16.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.720+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c4029040 con 0x7fd1cc05c070 2024-09-21T09:03:16.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.720+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8048ec0 2024-09-21T09:03:16.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.721+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c4029040 con 0x561cd8048ec0 2024-09-21T09:03:16.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.721+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd804d730 2024-09-21T09:03:16.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.721+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.721+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8052310 2024-09-21T09:03:16.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.721+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1cc099070 con 0x561cd8052310 2024-09-21T09:03:16.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.721+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd804d730 2024-09-21T09:03:16.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.721+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.721+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x7fd1cc05c070 2024-09-21T09:03:16.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.722+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c4029040 con 0x7fd1cc05c070 2024-09-21T09:03:16.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.722+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8052310 2024-09-21T09:03:16.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.722+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1cc099070 con 0x561cd8052310 2024-09-21T09:03:16.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.722+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd804d730 2024-09-21T09:03:16.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.722+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.722+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x561cd8048ec0 2024-09-21T09:03:16.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.722+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd1c4029040 con 0x561cd8048ec0 2024-09-21T09:03:16.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.722+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cd8054ea0 con 0x7fd1cc05c070 2024-09-21T09:03:16.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c4029040 con 0x7fd1cc05c070 2024-09-21T09:03:16.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:16.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:16.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:16.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:16.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:16.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:16.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd8050d40 con 0x561cd8048ec0 2024-09-21T09:03:16.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1c4029040 con 0x561cd8048ec0 2024-09-21T09:03:16.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd80511c0 con 0x561cd8048ec0 2024-09-21T09:03:16.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd1c4029040 con 0x561cd8048ec0 2024-09-21T09:03:16.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd80516a0 con 0x561cd8048ec0 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd1c403d040 con 0x561cd8048ec0 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 zone default found 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 4 Realm: () 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 zonegroup default 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.723+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd8055320 con 0x561cd804d730 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.724+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.724+0000 7fd1de098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.724+0000 7fd1de098800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.724+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd8057550 con 0x561cd8052310 2024-09-21T09:03:16.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.724+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd1cc099070 con 0x561cd8052310 2024-09-21T09:03:16.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.724+0000 7fd1de098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.724+0000 7fd1de098800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.724+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd80578f0 con 0x561cd8052310 2024-09-21T09:03:16.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.724+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd1cc099070 con 0x561cd8052310 2024-09-21T09:03:16.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.724+0000 7fd1de098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.724+0000 7fd1de098800 20 started sync module instance, tier type = 2024-09-21T09:03:16.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.724+0000 7fd1de098800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:16.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.724+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd8056990 con 0x7fd1cc05c070 2024-09-21T09:03:16.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.725+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x7fd1cc05c070 2024-09-21T09:03:16.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.725+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94681883307392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd8056990 con 0x7fd1cc05c070 2024-09-21T09:03:16.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.725+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd80582b0 con 0x561cd8048ec0 2024-09-21T09:03:16.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.726+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94681883307392] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x7fd1cc05c070 2024-09-21T09:03:16.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.726+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x561cd8048ec0 2024-09-21T09:03:16.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.726+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94681883305456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd80582b0 con 0x561cd8048ec0 2024-09-21T09:03:16.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.726+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd8058c70 con 0x561cd8052310 2024-09-21T09:03:16.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.727+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1cc099070 con 0x561cd8052310 2024-09-21T09:03:16.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.727+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94681883314112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd80594c0 con 0x561cd8052310 2024-09-21T09:03:16.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.727+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd8059fe0 con 0x7fd1cc05c070 2024-09-21T09:03:16.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.727+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94681883305456] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x561cd8048ec0 2024-09-21T09:03:16.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.728+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x7fd1cc05c070 2024-09-21T09:03:16.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.728+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94681883314112] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1cc099070 con 0x561cd8052310 2024-09-21T09:03:16.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.728+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94681883318960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd805a3d0 con 0x7fd1cc05c070 2024-09-21T09:03:16.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.728+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd8059010 con 0x561cd8048ec0 2024-09-21T09:03:16.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.729+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x561cd8048ec0 2024-09-21T09:03:16.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.729+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94681883316240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd805ad90 con 0x561cd8048ec0 2024-09-21T09:03:16.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.729+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd805b7c0 con 0x561cd804d730 2024-09-21T09:03:16.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.729+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94681883318960] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x7fd1cc05c070 2024-09-21T09:03:16.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.730+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.730+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94681883311616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd805b780 con 0x561cd804d730 2024-09-21T09:03:16.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.730+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd805c240 con 0x561cd804d730 2024-09-21T09:03:16.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.731+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94681883316240] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x561cd8048ec0 2024-09-21T09:03:16.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.731+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94681883311616] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.731+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.731+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94681883322592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd805b330 con 0x561cd804d730 2024-09-21T09:03:16.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.731+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd805c8d0 con 0x561cd804d730 2024-09-21T09:03:16.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.732+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94681883322592] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.732+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.732+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94681883327824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd805c8d0 con 0x561cd804d730 2024-09-21T09:03:16.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.732+0000 7fd1de098800 20 add_watcher() i=0 2024-09-21T09:03:16.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.732+0000 7fd1de098800 20 add_watcher() i=1 2024-09-21T09:03:16.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.732+0000 7fd1de098800 20 add_watcher() i=2 2024-09-21T09:03:16.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.732+0000 7fd1de098800 20 add_watcher() i=3 2024-09-21T09:03:16.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.732+0000 7fd1de098800 20 add_watcher() i=4 2024-09-21T09:03:16.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.732+0000 7fd1de098800 20 add_watcher() i=5 2024-09-21T09:03:16.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.732+0000 7fd1de098800 20 add_watcher() i=6 2024-09-21T09:03:16.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.733+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94681883327824] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.733+0000 7fd1de098800 20 add_watcher() i=7 2024-09-21T09:03:16.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.733+0000 7fd1de098800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:16.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.733+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd805fae0 con 0x561cd8048ec0 2024-09-21T09:03:16.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.734+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd1c403d040 con 0x561cd8048ec0 2024-09-21T09:03:16.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.734+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94681883329568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd805ccf0 con 0x561cd8048ec0 2024-09-21T09:03:16.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.734+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94681883329568] v29'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x561cd8048ec0 2024-09-21T09:03:16.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.735+0000 7fd091fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:16.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.735+0000 7fd1de098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:16.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.735+0000 7fd1de098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:16.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.735+0000 7fd1de098800 5 note: GC not initialized 2024-09-21T09:03:16.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.735+0000 7fd090fe1640 20 reqs_thread_entry: start 2024-09-21T09:03:16.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.735+0000 7fd1de098800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:16.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.735+0000 7fd1de098800 20 Filter name: none 2024-09-21T09:03:16.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.735+0000 7fd00a7fc640 20 reqs_thread_entry: start 2024-09-21T09:03:16.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.735+0000 7fd1de098800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.735+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cd8092ba0 con 0x561cd8048ec0 2024-09-21T09:03:16.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.735+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x561cd8048ec0 2024-09-21T09:03:16.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.735+0000 7fd1de098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.749 INFO:teuthology.orchestra.run.smithi178.stderr:could not fetch user info: no user info saved 2024-09-21T09:03:16.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.736+0000 7fd091fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:16.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.736+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94681883329568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd8092b60 con 0x561cd8048ec0 2024-09-21T09:03:16.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.737+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94681883329568] v29'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x561cd8048ec0 2024-09-21T09:03:16.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.737+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94681883307392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd8090970 con 0x7fd1cc05c070 2024-09-21T09:03:16.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.738+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94681883307392] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x7fd1cc05c070 2024-09-21T09:03:16.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.738+0000 7fd1de098800 20 remove_watcher() i=0 2024-09-21T09:03:16.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.738+0000 7fd1de098800 2 removed watcher, disabling cache 2024-09-21T09:03:16.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.738+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94681883305456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd8090970 con 0x561cd8048ec0 2024-09-21T09:03:16.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.739+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94681883305456] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x561cd8048ec0 2024-09-21T09:03:16.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.739+0000 7fd1de098800 20 remove_watcher() i=1 2024-09-21T09:03:16.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.739+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94681883314112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd8090970 con 0x561cd8052310 2024-09-21T09:03:16.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.740+0000 7fd1dbb8c640 1 -- 172.21.15.178:0/3780347919 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94681883314112] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1cc099070 con 0x561cd8052310 2024-09-21T09:03:16.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.740+0000 7fd1de098800 20 remove_watcher() i=2 2024-09-21T09:03:16.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.740+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94681883318960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd8092b60 con 0x7fd1cc05c070 2024-09-21T09:03:16.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.741+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94681883318960] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x7fd1cc05c070 2024-09-21T09:03:16.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.741+0000 7fd1de098800 20 remove_watcher() i=3 2024-09-21T09:03:16.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.741+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94681883316240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd8092b60 con 0x561cd8048ec0 2024-09-21T09:03:16.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.742+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94681883316240] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c403d040 con 0x561cd8048ec0 2024-09-21T09:03:16.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.742+0000 7fd1de098800 20 remove_watcher() i=4 2024-09-21T09:03:16.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.742+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94681883311616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd8092b60 con 0x561cd804d730 2024-09-21T09:03:16.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.743+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94681883311616] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.743+0000 7fd1de098800 20 remove_watcher() i=5 2024-09-21T09:03:16.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.743+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94681883322592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd8092b60 con 0x561cd804d730 2024-09-21T09:03:16.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.744+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94681883322592] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.744+0000 7fd1de098800 20 remove_watcher() i=6 2024-09-21T09:03:16.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.744+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94681883327824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cd8092b60 con 0x561cd804d730 2024-09-21T09:03:16.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1dc38d640 1 -- 172.21.15.178:0/3780347919 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94681883327824] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1d402a070 con 0x561cd804d730 2024-09-21T09:03:16.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 20 remove_watcher() i=7 2024-09-21T09:03:16.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cd804d730 msgr2=0x561cd804fb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cd804d730 0x561cd804fb20 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cd8048ec0 msgr2=0x561cd804b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cd8048ec0 0x561cd804b380 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd1cc05c070 msgr2=0x7fd1cc053730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd1cc05c070 0x7fd1cc053730 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x561cd8052310 msgr2=0x561cd80547d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x561cd8052310 0x561cd80547d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0a4036b40 msgr2=0x7fd0a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0a4036b40 0x7fd0a4039000 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x561cd801abd0 tx=0x7fd1cc086000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8035d60 msgr2=0x561cd803d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1d338b640 1 -- 172.21.15.178:0/3780347919 reap_dead start 2024-09-21T09:03:16.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8035d60 0x561cd803d260 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd1d404bbd0 tx=0x7fd1d404cc40 comp rx=0 tx=0).stop 2024-09-21T09:03:16.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 shutdown_connections 2024-09-21T09:03:16.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 --2- 172.21.15.178:0/3780347919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8035d60 0x561cd803d260 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 >> 172.21.15.178:0/3780347919 conn(0x561cd8032110 msgr2=0x561cd80301e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 shutdown_connections 2024-09-21T09:03:16.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 -- 172.21.15.178:0/3780347919 wait complete. 2024-09-21T09:03:16.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 -- 172.21.15.178:0/377068497 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0b4036b90 msgr2=0x7fd0b4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 --2- 172.21.15.178:0/377068497 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0b4036b90 0x7fd0b4039050 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x561cd8015e40 tx=0x7fd1cc000bc0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 -- 172.21.15.178:0/377068497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8029150 msgr2=0x561cd8029570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 --2- 172.21.15.178:0/377068497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8029150 0x561cd8029570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x561cd8015d50 tx=0x7fd1d4018830 comp rx=0 tx=0).stop 2024-09-21T09:03:16.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 -- 172.21.15.178:0/377068497 shutdown_connections 2024-09-21T09:03:16.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.745+0000 7fd1de098800 1 --2- 172.21.15.178:0/377068497 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0b4036b90 0x7fd0b4039050 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 --2- 172.21.15.178:0/377068497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd8029150 0x561cd8029570 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 -- 172.21.15.178:0/377068497 >> 172.21.15.178:0/377068497 conn(0x561cd801e0e0 msgr2=0x561cd8020c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 -- 172.21.15.178:0/377068497 shutdown_connections 2024-09-21T09:03:16.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 -- 172.21.15.178:0/377068497 wait complete. 2024-09-21T09:03:16.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cd8017cf0 msgr2=0x561cd801a0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cd8017cf0 0x561cd801a0e0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cd7f187b0 msgr2=0x561cd80153f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cd7f187b0 0x561cd80153f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0c4036b90 msgr2=0x7fd0c4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0c4036b90 0x7fd0c4039050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4000f60 tx=0x7fd1c40012b0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 msgr2=0x561cd800e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd800e380 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00a330 tx=0x7fd1cc002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 shutdown_connections 2024-09-21T09:03:16.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cd8017cf0 0x561cd801a0e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cd7f187b0 0x561cd80153f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0c4036b90 0x7fd0c4039050 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 --2- 172.21.15.178:0/2566238926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cd7e89610 0x561cd800e380 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 >> 172.21.15.178:0/2566238926 conn(0x561cd7f0fde0 msgr2=0x561cd7fffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 shutdown_connections 2024-09-21T09:03:16.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.746+0000 7fd1de098800 1 -- 172.21.15.178:0/2566238926 wait complete. 2024-09-21T09:03:16.757 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T09:03:16.757 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-21T09:03:16.757 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-21T09:03:16.757 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-21T09:03:16.811 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:16.811 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:16.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.810+0000 7f41f3610800 1 Processor -- start 2024-09-21T09:03:16.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.810+0000 7f41f3610800 1 -- start start 2024-09-21T09:03:16.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.810+0000 7f41f3610800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5597f6d91510 0x5597f6d91910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.810+0000 7f41f3610800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5597f6c51b30 con 0x5597f6d91e50 2024-09-21T09:03:16.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.810+0000 7f41f3610800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5597f6c33360 con 0x5597f6d91510 2024-09-21T09:03:16.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.811+0000 7f41eecf7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5597f6d91510 0x5597f6d91910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.811+0000 7f41eecf7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5597f6d91510 0x5597f6d91910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55914/0 (socket says 172.21.15.178:55914) 2024-09-21T09:03:16.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.811+0000 7f41eecf7640 1 -- 172.21.15.178:0/3670816619 learned_addr learned my addr 172.21.15.178:0/3670816619 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.811+0000 7f41eecf7640 1 -- 172.21.15.178:0/3670816619 >> v1:172.21.15.44:6789/0 conn(0x5597f6d91e50 legacy=0x5597f6d969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.811+0000 7f41eecf7640 1 -- 172.21.15.178:0/3670816619 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f6c59e00 con 0x5597f6d91510 2024-09-21T09:03:16.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.813+0000 7f41eecf7640 1 --2- 172.21.15.178:0/3670816619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6d91910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f41e000a520 tx=0x7f41e0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f5a5e00ce5f81d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.813+0000 7f41edcf5640 1 -- 172.21.15.178:0/3670816619 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e0055070 con 0x5597f6d91510 2024-09-21T09:03:16.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.813+0000 7f41edcf5640 1 -- 172.21.15.178:0/3670816619 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e00515b0 con 0x5597f6d91510 2024-09-21T09:03:16.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.813+0000 7f41edcf5640 1 -- 172.21.15.178:0/3670816619 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e00518d0 con 0x5597f6d91510 2024-09-21T09:03:16.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.814+0000 7f41f3610800 1 -- 172.21.15.178:0/3670816619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 msgr2=0x5597f6d91910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.814+0000 7f41f3610800 1 --2- 172.21.15.178:0/3670816619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6d91910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f41e000a520 tx=0x7f41e0045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.814+0000 7f41f3610800 1 -- 172.21.15.178:0/3670816619 shutdown_connections 2024-09-21T09:03:16.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.814+0000 7f41f3610800 1 --2- 172.21.15.178:0/3670816619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6d91910 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.814+0000 7f41f3610800 1 -- 172.21.15.178:0/3670816619 >> 172.21.15.178:0/3670816619 conn(0x5597f6d8ce00 msgr2=0x5597f6d8f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.814+0000 7f41f3610800 1 -- 172.21.15.178:0/3670816619 shutdown_connections 2024-09-21T09:03:16.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.814+0000 7f41f3610800 1 -- 172.21.15.178:0/3670816619 wait complete. 2024-09-21T09:03:16.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.827+0000 7f41f3610800 1 Processor -- start 2024-09-21T09:03:16.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.827+0000 7f41f3610800 1 -- start start 2024-09-21T09:03:16.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.827+0000 7f41f3610800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6e808a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.827+0000 7f41f3610800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5597f6cde450 con 0x5597f6d91510 2024-09-21T09:03:16.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.828+0000 7f41eecf7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6e808a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.828+0000 7f41eecf7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6e808a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55926/0 (socket says 172.21.15.178:55926) 2024-09-21T09:03:16.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.828+0000 7f41eecf7640 1 -- 172.21.15.178:0/1255731607 learned_addr learned my addr 172.21.15.178:0/1255731607 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.828+0000 7f41eecf7640 1 -- 172.21.15.178:0/1255731607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f6c2bbc0 con 0x5597f6d91510 2024-09-21T09:03:16.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.828+0000 7f41eecf7640 1 --2- 172.21.15.178:0/1255731607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6e808a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f41e0025da0 tx=0x7f41e0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3de77d935a56501 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.828+0000 7f40dce09640 1 -- 172.21.15.178:0/1255731607 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e0051950 con 0x5597f6d91510 2024-09-21T09:03:16.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.828+0000 7f40dce09640 1 -- 172.21.15.178:0/1255731607 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e0051af0 con 0x5597f6d91510 2024-09-21T09:03:16.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.828+0000 7f40dce09640 1 -- 172.21.15.178:0/1255731607 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e0051dd0 con 0x5597f6d91510 2024-09-21T09:03:16.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.829+0000 7f41f3610800 1 -- 172.21.15.178:0/1255731607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 msgr2=0x5597f6e808a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.829+0000 7f41f3610800 1 --2- 172.21.15.178:0/1255731607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6e808a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f41e0025da0 tx=0x7f41e0051000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.829+0000 7f41f3610800 1 -- 172.21.15.178:0/1255731607 shutdown_connections 2024-09-21T09:03:16.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.829+0000 7f41f3610800 1 --2- 172.21.15.178:0/1255731607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6e808a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.829+0000 7f41f3610800 1 -- 172.21.15.178:0/1255731607 >> 172.21.15.178:0/1255731607 conn(0x5597f6d8ce00 msgr2=0x5597f6e7c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.829+0000 7f41f3610800 1 -- 172.21.15.178:0/1255731607 shutdown_connections 2024-09-21T09:03:16.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.829+0000 7f41f3610800 1 -- 172.21.15.178:0/1255731607 wait complete. 2024-09-21T09:03:16.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.829+0000 7f41f3610800 1 Processor -- start 2024-09-21T09:03:16.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.829+0000 7f41f3610800 1 -- start start 2024-09-21T09:03:16.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.829+0000 7f41f3610800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6e881f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.829+0000 7f41f3610800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5597f6d98530 con 0x5597f6d91510 2024-09-21T09:03:16.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.830+0000 7f41eecf7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6e881f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.830+0000 7f41eecf7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6e881f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55932/0 (socket says 172.21.15.178:55932) 2024-09-21T09:03:16.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.830+0000 7f41eecf7640 1 -- 172.21.15.178:0/1593683099 learned_addr learned my addr 172.21.15.178:0/1593683099 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.830+0000 7f41eecf7640 1 -- 172.21.15.178:0/1593683099 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f6c3ffe0 con 0x5597f6d91510 2024-09-21T09:03:16.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.830+0000 7f41eecf7640 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6e881f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f41e0067040 tx=0x7f41e0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.830+0000 7f40db606640 1 -- 172.21.15.178:0/1593683099 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e007a070 con 0x5597f6d91510 2024-09-21T09:03:16.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.830+0000 7f40db606640 1 -- 172.21.15.178:0/1593683099 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e005a450 con 0x5597f6d91510 2024-09-21T09:03:16.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.830+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597f6e88730 con 0x5597f6d91510 2024-09-21T09:03:16.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.830+0000 7f40db606640 1 -- 172.21.15.178:0/1593683099 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e005a730 con 0x5597f6d91510 2024-09-21T09:03:16.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.830+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597f6e88cb0 con 0x5597f6d91510 2024-09-21T09:03:16.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.831+0000 7f40db606640 1 -- 172.21.15.178:0/1593683099 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f41e007d070 con 0x5597f6d91510 2024-09-21T09:03:16.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.831+0000 7f40db606640 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40d4036b40 0x7f40d4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.831+0000 7f40db606640 1 -- 172.21.15.178:0/1593683099 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f41e0062070 con 0x5597f6d91510 2024-09-21T09:03:16.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.831+0000 7f41ee4f6640 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40d4036b40 0x7f40d4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.831+0000 7f41f3610800 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5597f6d91e50 0x5597f6e8e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.831+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6e8e6f0 con 0x5597f6d91e50 2024-09-21T09:03:16.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.831+0000 7f41ef4f8640 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5597f6d91e50 0x5597f6e8e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.832+0000 7f41ee4f6640 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40d4036b40 0x7f40d4039000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41e4001e10 tx=0x7f41e4001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.832+0000 7f41ef4f8640 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5597f6d91e50 0x5597f6e8e1b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.832+0000 7f41ef4f8640 1 -- 172.21.15.178:0/1593683099 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41e800a4a0 con 0x5597f6d91e50 2024-09-21T09:03:16.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.832+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6e8b780 con 0x5597f6d91e50 2024-09-21T09:03:16.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.832+0000 7f41ef4f8640 1 -- 172.21.15.178:0/1593683099 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41e800a4a0 con 0x5597f6d91e50 2024-09-21T09:03:16.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.832+0000 7f41f3610800 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5597f6e90a20 0x5597f6e92e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.832+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6e934b0 con 0x5597f6e90a20 2024-09-21T09:03:16.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.832+0000 7f41eecf7640 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5597f6e90a20 0x5597f6e92e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.833+0000 7f41eecf7640 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5597f6e90a20 0x5597f6e92e10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.833+0000 7f41eecf7640 1 -- 172.21.15.178:0/1593683099 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6e90a20 2024-09-21T09:03:16.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.833+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6e8f890 con 0x5597f6d91e50 2024-09-21T09:03:16.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.833+0000 7f41ef4f8640 1 -- 172.21.15.178:0/1593683099 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41e800a4a0 con 0x5597f6d91e50 2024-09-21T09:03:16.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.833+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6e8fd70 con 0x5597f6d91e50 2024-09-21T09:03:16.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.834+0000 7f41ef4f8640 1 -- 172.21.15.178:0/1593683099 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f41e800a4a0 con 0x5597f6d91e50 2024-09-21T09:03:16.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.834+0000 7f41f3610800 1 Processor -- start 2024-09-21T09:03:16.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.834+0000 7f41f3610800 1 -- start start 2024-09-21T09:03:16.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.834+0000 7f41f3610800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6ea1dd0 0x5597f6ea21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.834+0000 7f41f3610800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5597f6c2d580 con 0x5597f6ea1dd0 2024-09-21T09:03:16.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.834+0000 7f41ef4f8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6ea1dd0 0x5597f6ea21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.834+0000 7f41ef4f8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6ea1dd0 0x5597f6ea21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55946/0 (socket says 172.21.15.178:55946) 2024-09-21T09:03:16.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.834+0000 7f41ef4f8640 1 -- 172.21.15.178:0/1495134247 learned_addr learned my addr 172.21.15.178:0/1495134247 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.835+0000 7f41ef4f8640 1 -- 172.21.15.178:0/1495134247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f6ea2730 con 0x5597f6ea1dd0 2024-09-21T09:03:16.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.835+0000 7f41ef4f8640 1 --2- 172.21.15.178:0/1495134247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6ea1dd0 0x5597f6ea21f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5597f6e892a0 tx=0x7f41e80188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.835+0000 7f40d8e01640 1 -- 172.21.15.178:0/1495134247 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e8014450 con 0x5597f6ea1dd0 2024-09-21T09:03:16.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.835+0000 7f40d8e01640 1 -- 172.21.15.178:0/1495134247 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e80145f0 con 0x5597f6ea1dd0 2024-09-21T09:03:16.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.835+0000 7f40d8e01640 1 -- 172.21.15.178:0/1495134247 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e80148d0 con 0x5597f6ea1dd0 2024-09-21T09:03:16.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.835+0000 7f41f3610800 1 -- 172.21.15.178:0/1495134247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597f6ea29c0 con 0x5597f6ea1dd0 2024-09-21T09:03:16.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.835+0000 7f41f3610800 1 -- 172.21.15.178:0/1495134247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597f6ea56a0 con 0x5597f6ea1dd0 2024-09-21T09:03:16.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.836+0000 7f40d8e01640 1 -- 172.21.15.178:0/1495134247 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f41e8011040 con 0x5597f6ea1dd0 2024-09-21T09:03:16.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.836+0000 7f40d8e01640 1 --2- 172.21.15.178:0/1495134247 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40c8036b90 0x7f40c8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.836+0000 7f40d8e01640 1 -- 172.21.15.178:0/1495134247 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f41e801e070 con 0x5597f6ea1dd0 2024-09-21T09:03:16.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.836+0000 7f41eecf7640 1 --2- 172.21.15.178:0/1495134247 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40c8036b90 0x7f40c8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.836+0000 7f41f3610800 1 Processor -- start 2024-09-21T09:03:16.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.836+0000 7f41f3610800 1 -- start start 2024-09-21T09:03:16.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.836+0000 7f41eecf7640 1 --2- 172.21.15.178:0/1495134247 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40c8036b90 0x7f40c8039050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f41e001bb90 tx=0x7f41e0090950 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.836+0000 7f41f3610800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6eaea00 0x5597f6eaee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.836+0000 7f41f3610800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5597f6e80f90 con 0x5597f6eaea00 2024-09-21T09:03:16.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.837+0000 7f41ef4f8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6eaea00 0x5597f6eaee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.837+0000 7f41ef4f8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6eaea00 0x5597f6eaee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55960/0 (socket says 172.21.15.178:55960) 2024-09-21T09:03:16.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.837+0000 7f41ef4f8640 1 -- 172.21.15.178:0/3546003993 learned_addr learned my addr 172.21.15.178:0/3546003993 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.837+0000 7f41ef4f8640 1 -- 172.21.15.178:0/3546003993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f6eaf3d0 con 0x5597f6eaea00 2024-09-21T09:03:16.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.837+0000 7f41ef4f8640 1 --2- 172.21.15.178:0/3546003993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6eaea00 0x5597f6eaee00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f41e804cb80 tx=0x7f41e8011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e62a436428dc943 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.837+0000 7f40d27fc640 1 -- 172.21.15.178:0/3546003993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e8013dc0 con 0x5597f6eaea00 2024-09-21T09:03:16.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.837+0000 7f40d27fc640 1 -- 172.21.15.178:0/3546003993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e804e0d0 con 0x5597f6eaea00 2024-09-21T09:03:16.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.837+0000 7f40d27fc640 1 -- 172.21.15.178:0/3546003993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e804e3d0 con 0x5597f6eaea00 2024-09-21T09:03:16.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.838+0000 7f41f3610800 1 -- 172.21.15.178:0/3546003993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6eaea00 msgr2=0x5597f6eaee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.838+0000 7f41f3610800 1 --2- 172.21.15.178:0/3546003993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6eaea00 0x5597f6eaee00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f41e804cb80 tx=0x7f41e8011970 comp rx=0 tx=0).stop 2024-09-21T09:03:16.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.838+0000 7f41f3610800 1 -- 172.21.15.178:0/3546003993 shutdown_connections 2024-09-21T09:03:16.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.838+0000 7f41f3610800 1 --2- 172.21.15.178:0/3546003993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6eaea00 0x5597f6eaee00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.838+0000 7f41f3610800 1 -- 172.21.15.178:0/3546003993 >> 172.21.15.178:0/3546003993 conn(0x5597f6eaad60 msgr2=0x5597f6ea8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.838+0000 7f41f3610800 1 -- 172.21.15.178:0/3546003993 shutdown_connections 2024-09-21T09:03:16.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.838+0000 7f41f3610800 1 -- 172.21.15.178:0/3546003993 wait complete. 2024-09-21T09:03:16.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.838+0000 7f41f3610800 1 Processor -- start 2024-09-21T09:03:16.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.838+0000 7f41f3610800 1 -- start start 2024-09-21T09:03:16.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.838+0000 7f41f3610800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6eaea00 0x5597f6eb5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.838+0000 7f41f3610800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5597f6eaf9a0 con 0x5597f6eaea00 2024-09-21T09:03:16.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.838+0000 7f41ef4f8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6eaea00 0x5597f6eb5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.838+0000 7f41ef4f8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6eaea00 0x5597f6eb5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55976/0 (socket says 172.21.15.178:55976) 2024-09-21T09:03:16.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.838+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 learned_addr learned my addr 172.21.15.178:0/2318393555 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.839+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f6eb6430 con 0x5597f6eaea00 2024-09-21T09:03:16.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.839+0000 7f41ef4f8640 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6eaea00 0x5597f6eb5ef0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f41e804cb80 tx=0x7f41e804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.839+0000 7f40d0ff9640 1 -- 172.21.15.178:0/2318393555 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e8044030 con 0x5597f6eaea00 2024-09-21T09:03:16.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.839+0000 7f40d0ff9640 1 -- 172.21.15.178:0/2318393555 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e802bb90 con 0x5597f6eaea00 2024-09-21T09:03:16.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.839+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597f6eb66c0 con 0x5597f6eaea00 2024-09-21T09:03:16.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.839+0000 7f40d0ff9640 1 -- 172.21.15.178:0/2318393555 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e8022a80 con 0x5597f6eaea00 2024-09-21T09:03:16.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.839+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597f6eb9370 con 0x5597f6eaea00 2024-09-21T09:03:16.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.840+0000 7f40d0ff9640 1 -- 172.21.15.178:0/2318393555 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f41e8022c20 con 0x5597f6eaea00 2024-09-21T09:03:16.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.840+0000 7f40d0ff9640 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40b8036b90 0x7f40b8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.840+0000 7f40d0ff9640 1 -- 172.21.15.178:0/2318393555 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f41e8045070 con 0x5597f6eaea00 2024-09-21T09:03:16.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.840+0000 7f41eecf7640 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40b8036b90 0x7f40b8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.840+0000 7f41eecf7640 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40b8036b90 0x7f40b8039050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41e001bb60 tx=0x7f41e008c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.841+0000 7f41f3610800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.841+0000 7f41f3610800 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5597f6ec1b60 0x5597f6ec4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.841+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ec4770 con 0x5597f6ec1b60 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.841+0000 7f41ee4f6640 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5597f6ec1b60 0x5597f6ec4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.841+0000 7f41ee4f6640 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5597f6ec1b60 0x5597f6ec4020 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.841+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41e400bdb0 con 0x5597f6ec1b60 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.841+0000 7f41f3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.841+0000 7f41f3610800 20 realm 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.841+0000 7f41f3610800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.841+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ec0fb0 con 0x5597f6ec1b60 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41e400bdb0 con 0x5597f6ec1b60 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41f3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41f3610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41f3610800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ec5260 con 0x5597f6ec1b60 2024-09-21T09:03:16.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41e400bdb0 con 0x5597f6ec1b60 2024-09-21T09:03:16.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41f3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41f3610800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ec5b30 con 0x5597f6ec1b60 2024-09-21T09:03:16.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41e400bdb0 con 0x5597f6ec1b60 2024-09-21T09:03:16.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41f3610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:16.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41f3610800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41f3610800 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5597f6ec6550 0x5597f6ec8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ec9080 con 0x5597f6ec6550 2024-09-21T09:03:16.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.842+0000 7f41ef4f8640 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5597f6ec6550 0x5597f6ec8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.843+0000 7f41ef4f8640 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5597f6ec6550 0x5597f6ec8940 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.843+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.843+0000 7f41f3610800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:16.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.843+0000 7f41f3610800 20 searching for the correct realm 2024-09-21T09:03:16.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.843+0000 7f41f3610800 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5597f6ecb030 0x5597f6ecd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.843+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ecb030 2024-09-21T09:03:16.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.843+0000 7f41eecf7640 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5597f6ecb030 0x5597f6ecd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.843+0000 7f41eecf7640 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5597f6ecb030 0x5597f6ecd4f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.844+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6ecb030 2024-09-21T09:03:16.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.844+0000 7f41eecf7640 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f41e007f060 0x7f41e0055070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.844+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x7f41e007f060 2024-09-21T09:03:16.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.844+0000 7f41ee4f6640 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f41e007f060 0x7f41e0055070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.844+0000 7f41ee4f6640 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f41e007f060 0x7f41e0055070 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.844+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e400bdb0 con 0x7f41e007f060 2024-09-21T09:03:16.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.844+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ec6550 2024-09-21T09:03:16.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.844+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.844+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ec1b60 2024-09-21T09:03:16.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.845+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e400bdb0 con 0x5597f6ec1b60 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.845+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ec1b60 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.845+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.845+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ec6550 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.845+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.845+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ec6550 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.846+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.846+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x7f41e007f060 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.846+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.846+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ecb030 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.846+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6ecb030 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.846+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ec1b60 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.846+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.846+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ec6550 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.847+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.847+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ec1b60 2024-09-21T09:03:16.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.847+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.847+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x7f41e007f060 2024-09-21T09:03:16.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.847+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.847+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ecb030 2024-09-21T09:03:16.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.847+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6ecb030 2024-09-21T09:03:16.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.847+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ecb030 2024-09-21T09:03:16.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.847+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6ecb030 2024-09-21T09:03:16.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.847+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ec6550 2024-09-21T09:03:16.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.848+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.848+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ecb030 2024-09-21T09:03:16.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.848+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6ecb030 2024-09-21T09:03:16.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.848+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecdbc0 con 0x5597f6ecb030 2024-09-21T09:03:16.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.848+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6ecb030 2024-09-21T09:03:16.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.848+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f41e00b6040 con 0x5597f6ec1b60 2024-09-21T09:03:16.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.848+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.848+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f41e00b6040 con 0x5597f6ec1b60 2024-09-21T09:03:16.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.849+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.849+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f41e00b6040 con 0x5597f6ec6550 2024-09-21T09:03:16.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.849+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.849+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f41e00b6040 con 0x5597f6ecb030 2024-09-21T09:03:16.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.849+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6ecb030 2024-09-21T09:03:16.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.849+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f41e00b6040 con 0x7f41e007f060 2024-09-21T09:03:16.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.849+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.849+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f41e00b6040 con 0x5597f6ec1b60 2024-09-21T09:03:16.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.850+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.850+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f41e00b6040 con 0x5597f6ec6550 2024-09-21T09:03:16.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.850+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.850+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f41e00b6040 con 0x5597f6ecb030 2024-09-21T09:03:16.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.850+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6ecb030 2024-09-21T09:03:16.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.850+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f41e00b6040 con 0x5597f6ec6550 2024-09-21T09:03:16.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.850+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.850+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f41e00b6040 con 0x7f41e007f060 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.851+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.851+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f41e00b6040 con 0x5597f6ecb030 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.851+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6ecb030 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.851+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f41e00b6040 con 0x5597f6ec6550 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.851+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.851+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f41e00b6040 con 0x5597f6ec1b60 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.851+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.851+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f41e00b6040 con 0x7f41e007f060 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:16.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:16.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:16.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ec9a40 con 0x5597f6ec1b60 2024-09-21T09:03:16.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ec9680 con 0x5597f6ec1b60 2024-09-21T09:03:16.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:16.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6eca420 con 0x5597f6ec1b60 2024-09-21T09:03:16.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:16.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 zone default found 2024-09-21T09:03:16.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 4 Realm: () 2024-09-21T09:03:16.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:16.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:16.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:16.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 zonegroup default 2024-09-21T09:03:16.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.852+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ece0a0 con 0x5597f6ec6550 2024-09-21T09:03:16.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.853+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.853+0000 7f41f3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.853+0000 7f41f3610800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.853+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed0370 con 0x5597f6ecb030 2024-09-21T09:03:16.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.853+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6ecb030 2024-09-21T09:03:16.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.853+0000 7f41f3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.853+0000 7f41f3610800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.853+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed0710 con 0x5597f6ecb030 2024-09-21T09:03:16.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.853+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6ecb030 2024-09-21T09:03:16.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.853+0000 7f41f3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.853+0000 7f41f3610800 20 started sync module instance, tier type = 2024-09-21T09:03:16.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.853+0000 7f41f3610800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:16.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.853+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecf7b0 con 0x7f41e007f060 2024-09-21T09:03:16.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.854+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.854+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94111171149024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecf7b0 con 0x7f41e007f060 2024-09-21T09:03:16.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.854+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed1130 con 0x5597f6ec1b60 2024-09-21T09:03:16.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.855+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94111171149024] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.855+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.855+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94111171152928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecf7b0 con 0x5597f6ec1b60 2024-09-21T09:03:16.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.855+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed1bc0 con 0x5597f6ecb030 2024-09-21T09:03:16.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.856+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94111171152928] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.856+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6ecb030 2024-09-21T09:03:16.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.856+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94111171146496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecf720 con 0x5597f6ecb030 2024-09-21T09:03:16.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.856+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed2a80 con 0x7f41e007f060 2024-09-21T09:03:16.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.857+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94111171146496] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6ecb030 2024-09-21T09:03:16.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.858+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.858+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94111171159504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed2ea0 con 0x7f41e007f060 2024-09-21T09:03:16.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.858+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed3860 con 0x5597f6ec1b60 2024-09-21T09:03:16.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.859+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94111171159504] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.859+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.859+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94111171161040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed3860 con 0x5597f6ec1b60 2024-09-21T09:03:16.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.859+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed4150 con 0x5597f6ec6550 2024-09-21T09:03:16.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.860+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94111171161040] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.860+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.860+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94111171163536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed4540 con 0x5597f6ec6550 2024-09-21T09:03:16.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.860+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed4f40 con 0x5597f6ec6550 2024-09-21T09:03:16.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.861+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94111171163536] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.861+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.861+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94111171164592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed4f00 con 0x5597f6ec6550 2024-09-21T09:03:16.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.861+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed59f0 con 0x5597f6ec6550 2024-09-21T09:03:16.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.862+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.862+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94111171171520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed5e60 con 0x5597f6ec6550 2024-09-21T09:03:16.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.862+0000 7f41f3610800 20 add_watcher() i=0 2024-09-21T09:03:16.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.862+0000 7f41f3610800 20 add_watcher() i=1 2024-09-21T09:03:16.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.862+0000 7f41f3610800 20 add_watcher() i=2 2024-09-21T09:03:16.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.862+0000 7f41f3610800 20 add_watcher() i=3 2024-09-21T09:03:16.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.862+0000 7f41f3610800 20 add_watcher() i=4 2024-09-21T09:03:16.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.862+0000 7f41f3610800 20 add_watcher() i=5 2024-09-21T09:03:16.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.862+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94111171164592] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.862+0000 7f41f3610800 20 add_watcher() i=6 2024-09-21T09:03:16.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.863+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94111171171520] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.863+0000 7f41f3610800 20 add_watcher() i=7 2024-09-21T09:03:16.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.863+0000 7f41f3610800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:16.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.863+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed5e60 con 0x5597f6ec1b60 2024-09-21T09:03:16.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.863+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.863+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94111171172784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed5dd0 con 0x5597f6ec1b60 2024-09-21T09:03:16.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.864+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94111171172784] v29'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.864+0000 7f40a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:16.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.864+0000 7f41f3610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:16.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.864+0000 7f41f3610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:16.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.864+0000 7f41f3610800 5 note: GC not initialized 2024-09-21T09:03:16.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.864+0000 7f401ffff640 20 reqs_thread_entry: start 2024-09-21T09:03:16.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.864+0000 7f41f3610800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:16.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 20 Filter name: none 2024-09-21T09:03:16.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f401dffb640 20 reqs_thread_entry: start 2024-09-21T09:03:16.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:16.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6f0c3b0 con 0x5597f6ec1b60 2024-09-21T09:03:16.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-21T09:03:16.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:16.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-21T09:03:16.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6f0a9f0 con 0x5597f6ec1b60 2024-09-21T09:03:16.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-21T09:03:16.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-21T09:03:16.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-21T09:03:16.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.865+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6f0a9f0 con 0x5597f6ec6550 2024-09-21T09:03:16.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.866+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.866+0000 7f41f3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.866+0000 7f41f3610800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-21T09:03:16.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.866+0000 7f41f3610800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-21T09:03:16.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.866+0000 7f41f3610800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-21T09:03:16.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.866+0000 7f41f3610800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-21T09:03:16.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.866+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6f0b2e0 con 0x5597f6ec1b60 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.867+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v29'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.867+0000 7f41f3610800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.867+0000 7f41f3610800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.867+0000 7f41f3610800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.867+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94111171391344 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6f0fe50 con 0x5597f6ec1b60 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.867+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== watch-notify(notify (1) cookie 94111171161040 notify 124554051584 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5597f6f0b680 con 0x5597f6ec1b60 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.867+0000 7f40d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051584 cookie 94111171161040 notifier 4294 bl.length()=567 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.867+0000 7f40d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.867+0000 7f40d27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.867+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(66 notify.4 [notify cookie 94111171391344 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.867+0000 7f40d27fc640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f40b4003ea0 con 0x5597f6ec1b60 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.867+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.867+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== watch-notify(notify_complete (2) cookie 94111171391344 notify 124554051584 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5597f6f0bf60 con 0x5597f6ec1b60 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.867+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6f0af70 con 0x5597f6ec1b60 2024-09-21T09:03:16.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.869+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.869+0000 7f41f3610800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-21T09:03:16.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.869+0000 7f41f3610800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-21T09:03:16.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.869+0000 7f41f3610800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-21T09:03:16.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.869+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94111171391344 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6f10280 con 0x7f41e007f060 2024-09-21T09:03:16.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.869+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== watch-notify(notify (1) cookie 94111171159504 notify 124554051584 ret 0) ==== 211+0+0 (crc 0 0 0) 0x5597f6f0bf60 con 0x7f41e007f060 2024-09-21T09:03:16.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.869+0000 7f40d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051584 cookie 94111171159504 notifier 4294 bl.length()=169 2024-09-21T09:03:16.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.869+0000 7f40d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-21T09:03:16.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.869+0000 7f40d27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-21T09:03:16.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.869+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(69 notify.3 [notify cookie 94111171391344 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.869+0000 7f40d27fc640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f40b4003ea0 con 0x7f41e007f060 2024-09-21T09:03:16.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.869+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.869+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== watch-notify(notify_complete (2) cookie 94111171391344 notify 124554051584 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5597f6c51b30 con 0x7f41e007f060 2024-09-21T09:03:16.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.869+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6f0df90 con 0x5597f6ec6550 2024-09-21T09:03:16.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.870+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.870+0000 7f41f3610800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-21T09:03:16.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.870+0000 7f41f3610800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-21T09:03:16.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.870+0000 7f41f3610800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-21T09:03:16.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.870+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94111171402112 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5597f6f0df90 con 0x7f41e007f060 2024-09-21T09:03:16.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.871+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== watch-notify(notify (1) cookie 94111171159504 notify 124554051585 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5597f6c51b30 con 0x7f41e007f060 2024-09-21T09:03:16.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.871+0000 7f40d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051585 cookie 94111171159504 notifier 4294 bl.length()=177 2024-09-21T09:03:16.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.871+0000 7f40d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-21T09:03:16.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.871+0000 7f40d1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-21T09:03:16.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.871+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(72 notify.3 [notify cookie 94111171402112 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.871+0000 7f40d1ffb640 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f4024003400 con 0x7f41e007f060 2024-09-21T09:03:16.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.871+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.871+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== watch-notify(notify_complete (2) cookie 94111171402112 notify 124554051585 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f41e402eaf0 con 0x7f41e007f060 2024-09-21T09:03:16.884 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:16.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.872+0000 7f40a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:16.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.872+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94111171172784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6f0a070 con 0x5597f6ec1b60 2024-09-21T09:03:16.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.873+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94111171172784] v29'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.873+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94111171149024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6f0a070 con 0x7f41e007f060 2024-09-21T09:03:16.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.874+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94111171149024] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.874+0000 7f41f3610800 20 remove_watcher() i=0 2024-09-21T09:03:16.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.874+0000 7f41f3610800 2 removed watcher, disabling cache 2024-09-21T09:03:16.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.874+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94111171152928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6f0a070 con 0x5597f6ec1b60 2024-09-21T09:03:16.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.875+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94111171152928] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.875+0000 7f41f3610800 20 remove_watcher() i=1 2024-09-21T09:03:16.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.875+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94111171146496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6f0a070 con 0x5597f6ecb030 2024-09-21T09:03:16.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.876+0000 7f41eecf7640 1 -- 172.21.15.178:0/2318393555 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94111171146496] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e007c030 con 0x5597f6ecb030 2024-09-21T09:03:16.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.876+0000 7f41f3610800 20 remove_watcher() i=2 2024-09-21T09:03:16.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.876+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94111171159504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecfce0 con 0x7f41e007f060 2024-09-21T09:03:16.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.877+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94111171159504] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x7f41e007f060 2024-09-21T09:03:16.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.877+0000 7f41f3610800 20 remove_watcher() i=3 2024-09-21T09:03:16.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.877+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94111171161040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed0c20 con 0x5597f6ec1b60 2024-09-21T09:03:16.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.878+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94111171161040] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e402a040 con 0x5597f6ec1b60 2024-09-21T09:03:16.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.878+0000 7f41f3610800 20 remove_watcher() i=4 2024-09-21T09:03:16.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.878+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94111171163536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecf300 con 0x5597f6ec6550 2024-09-21T09:03:16.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.879+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94111171163536] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.879+0000 7f41f3610800 20 remove_watcher() i=5 2024-09-21T09:03:16.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.879+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94111171164592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ed25d0 con 0x5597f6ec6550 2024-09-21T09:03:16.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.880+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94111171164592] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.880+0000 7f41f3610800 20 remove_watcher() i=6 2024-09-21T09:03:16.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.880+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94111171171520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5597f6ecfce0 con 0x5597f6ec6550 2024-09-21T09:03:16.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41ef4f8640 1 -- 172.21.15.178:0/2318393555 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94111171171520] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41e802a070 con 0x5597f6ec6550 2024-09-21T09:03:16.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 20 remove_watcher() i=7 2024-09-21T09:03:16.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5597f6ec6550 msgr2=0x5597f6ec8940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5597f6ec6550 0x5597f6ec8940 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5597f6ec1b60 msgr2=0x5597f6ec4020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5597f6ec1b60 0x5597f6ec4020 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f41e007f060 msgr2=0x7f41e0055070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f41e007f060 0x7f41e0055070 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5597f6ecb030 msgr2=0x5597f6ecd4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5597f6ecb030 0x5597f6ecd4f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40b8036b90 msgr2=0x7f40b8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40b8036b90 0x7f40b8039050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41e001bb60 tx=0x7f41e008c000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6eaea00 msgr2=0x5597f6eb5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 --2- 172.21.15.178:0/2318393555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6eaea00 0x5597f6eb5ef0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f41e804cb80 tx=0x7f41e804cb10 comp rx=0 tx=0).stop 2024-09-21T09:03:16.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 reap_dead start 2024-09-21T09:03:16.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41ee4f6640 1 -- 172.21.15.178:0/2318393555 reap_dead start 2024-09-21T09:03:16.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 shutdown_connections 2024-09-21T09:03:16.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 >> 172.21.15.178:0/2318393555 conn(0x5597f6eaad60 msgr2=0x5597f6ea8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 shutdown_connections 2024-09-21T09:03:16.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 -- 172.21.15.178:0/2318393555 wait complete. 2024-09-21T09:03:16.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 -- 172.21.15.178:0/1495134247 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40c8036b90 msgr2=0x7f40c8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 --2- 172.21.15.178:0/1495134247 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40c8036b90 0x7f40c8039050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f41e001bb90 tx=0x7f41e0090950 comp rx=0 tx=0).stop 2024-09-21T09:03:16.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 -- 172.21.15.178:0/1495134247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6ea1dd0 msgr2=0x5597f6ea21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.881+0000 7f41f3610800 1 --2- 172.21.15.178:0/1495134247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6ea1dd0 0x5597f6ea21f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5597f6e892a0 tx=0x7f41e80188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 -- 172.21.15.178:0/1495134247 shutdown_connections 2024-09-21T09:03:16.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 --2- 172.21.15.178:0/1495134247 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40c8036b90 0x7f40c8039050 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 --2- 172.21.15.178:0/1495134247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6ea1dd0 0x5597f6ea21f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 -- 172.21.15.178:0/1495134247 >> 172.21.15.178:0/1495134247 conn(0x5597f6e96d60 msgr2=0x5597f6e998e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 -- 172.21.15.178:0/1495134247 shutdown_connections 2024-09-21T09:03:16.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 -- 172.21.15.178:0/1495134247 wait complete. 2024-09-21T09:03:16.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5597f6e90a20 msgr2=0x5597f6e92e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5597f6e90a20 0x5597f6e92e10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5597f6d91e50 msgr2=0x5597f6e8e1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5597f6d91e50 0x5597f6e8e1b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40d4036b40 msgr2=0x7f40d4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40d4036b40 0x7f40d4039000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41e4001e10 tx=0x7f41e4001390 comp rx=0 tx=0).stop 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 msgr2=0x5597f6e881f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6e881f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f41e0067040 tx=0x7f41e0002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 shutdown_connections 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5597f6e90a20 0x5597f6e92e10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5597f6d91e50 0x5597f6e8e1b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f40d4036b40 0x7f40d4039000 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 --2- 172.21.15.178:0/1593683099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f6d91510 0x5597f6e881f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 >> 172.21.15.178:0/1593683099 conn(0x5597f6d8ce00 msgr2=0x5597f6e7aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 shutdown_connections 2024-09-21T09:03:16.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.882+0000 7f41f3610800 1 -- 172.21.15.178:0/1593683099 wait complete. 2024-09-21T09:03:16.894 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:16.894 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-21T09:03:16.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-21T09:03:16.895 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-21T09:03:16.942 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:16.942 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:16.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.941+0000 7f8c2ab51800 1 Processor -- start 2024-09-21T09:03:16.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.941+0000 7f8c2ab51800 1 -- start start 2024-09-21T09:03:16.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.942+0000 7f8c2ab51800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56460819ee30 0x56460822e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.942+0000 7f8c2ab51800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5646080eab30 con 0x56460822e720 2024-09-21T09:03:16.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.942+0000 7f8c2ab51800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5646080cc360 con 0x56460819ee30 2024-09-21T09:03:16.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.942+0000 7f8c28645640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56460819ee30 0x56460822e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.942+0000 7f8c28645640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56460819ee30 0x56460822e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55980/0 (socket says 172.21.15.178:55980) 2024-09-21T09:03:16.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.942+0000 7f8c27e44640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x56460822e720 0x564608230b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:58350/0 (socket says 172.21.15.178:58350) 2024-09-21T09:03:16.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.942+0000 7f8c28645640 1 -- 172.21.15.178:0/1230156815 learned_addr learned my addr 172.21.15.178:0/1230156815 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.942+0000 7f8c28645640 1 -- 172.21.15.178:0/1230156815 >> v1:172.21.15.44:6789/0 conn(0x56460822e720 legacy=0x564608230b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.942+0000 7f8c28645640 1 -- 172.21.15.178:0/1230156815 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646080f2e00 con 0x56460819ee30 2024-09-21T09:03:16.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.944+0000 7f8c28645640 1 --2- 172.21.15.178:0/1230156815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460822e1e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8c18005fd0 tx=0x7f8c18045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894e74a4d6603d6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.944+0000 7f8c27643640 1 -- 172.21.15.178:0/1230156815 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c1804e600 con 0x56460819ee30 2024-09-21T09:03:16.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.944+0000 7f8c27643640 1 -- 172.21.15.178:0/1230156815 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1804e7a0 con 0x56460819ee30 2024-09-21T09:03:16.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.944+0000 7f8c27643640 1 -- 172.21.15.178:0/1230156815 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c1804eaa0 con 0x56460819ee30 2024-09-21T09:03:16.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.945+0000 7f8c2ab51800 1 -- 172.21.15.178:0/1230156815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 msgr2=0x56460822e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.945+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/1230156815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460822e1e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8c18005fd0 tx=0x7f8c18045cf0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.945+0000 7f8c2ab51800 1 -- 172.21.15.178:0/1230156815 shutdown_connections 2024-09-21T09:03:16.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.945+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/1230156815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460822e1e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.945+0000 7f8c2ab51800 1 -- 172.21.15.178:0/1230156815 >> 172.21.15.178:0/1230156815 conn(0x564608225e10 msgr2=0x564608228230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.945+0000 7f8c2ab51800 1 -- 172.21.15.178:0/1230156815 shutdown_connections 2024-09-21T09:03:16.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.945+0000 7f8c2ab51800 1 -- 172.21.15.178:0/1230156815 wait complete. 2024-09-21T09:03:16.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.958+0000 7f8c2ab51800 1 Processor -- start 2024-09-21T09:03:16.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.958+0000 7f8c2ab51800 1 -- start start 2024-09-21T09:03:16.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.959+0000 7f8c2ab51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460831a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.959+0000 7f8c2ab51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564608177350 con 0x56460819ee30 2024-09-21T09:03:16.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.959+0000 7f8c28645640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460831a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.959+0000 7f8c28645640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460831a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55996/0 (socket says 172.21.15.178:55996) 2024-09-21T09:03:16.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.959+0000 7f8c28645640 1 -- 172.21.15.178:0/2131243664 learned_addr learned my addr 172.21.15.178:0/2131243664 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.959+0000 7f8c28645640 1 -- 172.21.15.178:0/2131243664 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646080c4bc0 con 0x56460819ee30 2024-09-21T09:03:16.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.959+0000 7f8c28645640 1 --2- 172.21.15.178:0/2131243664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460831a880 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8c18045d30 tx=0x7f8c18050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2b721febfa67e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.960+0000 7f8b1660c640 1 -- 172.21.15.178:0/2131243664 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c1804eb40 con 0x56460819ee30 2024-09-21T09:03:16.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.960+0000 7f8b1660c640 1 -- 172.21.15.178:0/2131243664 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1805c040 con 0x56460819ee30 2024-09-21T09:03:16.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.960+0000 7f8b1660c640 1 -- 172.21.15.178:0/2131243664 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c1804ee10 con 0x56460819ee30 2024-09-21T09:03:16.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.960+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2131243664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 msgr2=0x56460831a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.960+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2131243664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460831a880 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8c18045d30 tx=0x7f8c18050000 comp rx=0 tx=0).stop 2024-09-21T09:03:16.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.960+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2131243664 shutdown_connections 2024-09-21T09:03:16.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.960+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2131243664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460831a880 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.960+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2131243664 >> 172.21.15.178:0/2131243664 conn(0x564608225e10 msgr2=0x564608316240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.960+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2131243664 shutdown_connections 2024-09-21T09:03:16.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.960+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2131243664 wait complete. 2024-09-21T09:03:16.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.961+0000 7f8c2ab51800 1 Processor -- start 2024-09-21T09:03:16.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.961+0000 7f8c2ab51800 1 -- start start 2024-09-21T09:03:16.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.961+0000 7f8c2ab51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460822bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.961+0000 7f8c2ab51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564608232620 con 0x56460819ee30 2024-09-21T09:03:16.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.961+0000 7f8c28645640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460822bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.961+0000 7f8c28645640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460822bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:55998/0 (socket says 172.21.15.178:55998) 2024-09-21T09:03:16.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.961+0000 7f8c28645640 1 -- 172.21.15.178:0/169142911 learned_addr learned my addr 172.21.15.178:0/169142911 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.961+0000 7f8c28645640 1 -- 172.21.15.178:0/169142911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646080d8fe0 con 0x56460819ee30 2024-09-21T09:03:16.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.962+0000 7f8c28645640 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460822bb10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c18045d30 tx=0x7f8c18003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.962+0000 7f8b14e09640 1 -- 172.21.15.178:0/169142911 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c18061420 con 0x56460819ee30 2024-09-21T09:03:16.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.962+0000 7f8b14e09640 1 -- 172.21.15.178:0/169142911 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c18070070 con 0x56460819ee30 2024-09-21T09:03:16.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.962+0000 7f8b14e09640 1 -- 172.21.15.178:0/169142911 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c180616f0 con 0x56460819ee30 2024-09-21T09:03:16.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.962+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56460822a200 con 0x56460819ee30 2024-09-21T09:03:16.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.962+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56460822a6a0 con 0x56460819ee30 2024-09-21T09:03:16.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.963+0000 7f8b14e09640 1 -- 172.21.15.178:0/169142911 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8c18061890 con 0x56460819ee30 2024-09-21T09:03:16.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.963+0000 7f8b14e09640 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8b10036b90 0x7f8b10039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.963+0000 7f8b14e09640 1 -- 172.21.15.178:0/169142911 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8c18066070 con 0x56460819ee30 2024-09-21T09:03:16.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.963+0000 7f8c27e44640 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8b10036b90 0x7f8b10039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.963+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56460822e720 0x56460832b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.963+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56460832bb10 con 0x56460822e720 2024-09-21T09:03:16.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.963+0000 7f8c28e46640 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56460822e720 0x56460832b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.963+0000 7f8c27e44640 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8b10036b90 0x7f8b10039050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8c10000f60 tx=0x7f8c10001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.963+0000 7f8c28e46640 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56460822e720 0x56460832b5d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.964+0000 7f8c28e46640 1 -- 172.21.15.178:0/169142911 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c200083e0 con 0x56460822e720 2024-09-21T09:03:16.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.964+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56460832c360 con 0x56460822e720 2024-09-21T09:03:16.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.964+0000 7f8c28e46640 1 -- 172.21.15.178:0/169142911 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c200083e0 con 0x56460822e720 2024-09-21T09:03:16.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.964+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56460832dc70 0x564608330110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.964+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646083308a0 con 0x56460832dc70 2024-09-21T09:03:16.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.964+0000 7f8c28645640 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56460832dc70 0x564608330110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.965+0000 7f8c28645640 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56460832dc70 0x564608330110 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.965+0000 7f8c28645640 1 -- 172.21.15.178:0/169142911 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8c1807c070 con 0x56460832dc70 2024-09-21T09:03:16.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.965+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56460832cbb0 con 0x56460822e720 2024-09-21T09:03:16.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.965+0000 7f8c28e46640 1 -- 172.21.15.178:0/169142911 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c200083e0 con 0x56460822e720 2024-09-21T09:03:16.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.965+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56460832cf50 con 0x56460822e720 2024-09-21T09:03:16.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.966+0000 7f8c28e46640 1 -- 172.21.15.178:0/169142911 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8c200083e0 con 0x56460822e720 2024-09-21T09:03:16.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.966+0000 7f8c2ab51800 1 Processor -- start 2024-09-21T09:03:16.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.966+0000 7f8c2ab51800 1 -- start start 2024-09-21T09:03:16.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.966+0000 7f8c2ab51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460833f260 0x56460833f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.966+0000 7f8c2ab51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56460822c050 con 0x56460833f260 2024-09-21T09:03:16.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.966+0000 7f8c28e46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460833f260 0x56460833f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.966+0000 7f8c28e46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460833f260 0x56460833f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:56000/0 (socket says 172.21.15.178:56000) 2024-09-21T09:03:16.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.966+0000 7f8c28e46640 1 -- 172.21.15.178:0/2688542557 learned_addr learned my addr 172.21.15.178:0/2688542557 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.966+0000 7f8c28e46640 1 -- 172.21.15.178:0/2688542557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56460833fbc0 con 0x56460833f260 2024-09-21T09:03:16.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.967+0000 7f8c28e46640 1 --2- 172.21.15.178:0/2688542557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460833f260 0x56460833f680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x56460822b500 tx=0x7f8c2000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.967+0000 7f8b0dffb640 1 -- 172.21.15.178:0/2688542557 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c20007d00 con 0x56460833f260 2024-09-21T09:03:16.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.967+0000 7f8b0dffb640 1 -- 172.21.15.178:0/2688542557 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2001e020 con 0x56460833f260 2024-09-21T09:03:16.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.967+0000 7f8b0dffb640 1 -- 172.21.15.178:0/2688542557 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c20019420 con 0x56460833f260 2024-09-21T09:03:16.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.967+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2688542557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56460833fe50 con 0x56460833f260 2024-09-21T09:03:16.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.967+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2688542557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564608342b30 con 0x56460833f260 2024-09-21T09:03:16.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.968+0000 7f8b0dffb640 1 -- 172.21.15.178:0/2688542557 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8c20016040 con 0x56460833f260 2024-09-21T09:03:16.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.968+0000 7f8b0dffb640 1 --2- 172.21.15.178:0/2688542557 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8b00036b90 0x7f8b00039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.968+0000 7f8b0dffb640 1 -- 172.21.15.178:0/2688542557 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8c2001f030 con 0x56460833f260 2024-09-21T09:03:16.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.968+0000 7f8c28645640 1 --2- 172.21.15.178:0/2688542557 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8b00036b90 0x7f8b00039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.968+0000 7f8c2ab51800 1 Processor -- start 2024-09-21T09:03:16.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.968+0000 7f8c28645640 1 --2- 172.21.15.178:0/2688542557 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8b00036b90 0x7f8b00039050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x56460822ab30 tx=0x7f8c18046130 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.968+0000 7f8c2ab51800 1 -- start start 2024-09-21T09:03:16.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.968+0000 7f8c2ab51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460834bdd0 0x56460834c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.968+0000 7f8c2ab51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5646080c6580 con 0x56460834bdd0 2024-09-21T09:03:16.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.969+0000 7f8c28e46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460834bdd0 0x56460834c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.969+0000 7f8c28e46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460834bdd0 0x56460834c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:56008/0 (socket says 172.21.15.178:56008) 2024-09-21T09:03:16.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.969+0000 7f8c28e46640 1 -- 172.21.15.178:0/3710435632 learned_addr learned my addr 172.21.15.178:0/3710435632 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.969+0000 7f8c28e46640 1 -- 172.21.15.178:0/3710435632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56460834c7a0 con 0x56460834bdd0 2024-09-21T09:03:16.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.969+0000 7f8c28e46640 1 --2- 172.21.15.178:0/3710435632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460834bdd0 0x56460834c1d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c20022470 tx=0x7f8c20017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a17f0facb3e8329 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.969+0000 7f8aff7fe640 1 -- 172.21.15.178:0/3710435632 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c2001d030 con 0x56460834bdd0 2024-09-21T09:03:16.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.969+0000 7f8aff7fe640 1 -- 172.21.15.178:0/3710435632 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c20015d00 con 0x56460834bdd0 2024-09-21T09:03:16.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.969+0000 7f8aff7fe640 1 -- 172.21.15.178:0/3710435632 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c200197a0 con 0x56460834bdd0 2024-09-21T09:03:16.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.970+0000 7f8c2ab51800 1 -- 172.21.15.178:0/3710435632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460834bdd0 msgr2=0x56460834c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:16.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.970+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/3710435632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460834bdd0 0x56460834c1d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c20022470 tx=0x7f8c20017fa0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.970+0000 7f8c2ab51800 1 -- 172.21.15.178:0/3710435632 shutdown_connections 2024-09-21T09:03:16.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.970+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/3710435632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460834bdd0 0x56460834c1d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:16.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.970+0000 7f8c2ab51800 1 -- 172.21.15.178:0/3710435632 >> 172.21.15.178:0/3710435632 conn(0x5646083481c0 msgr2=0x5646083462c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:16.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.970+0000 7f8c2ab51800 1 -- 172.21.15.178:0/3710435632 shutdown_connections 2024-09-21T09:03:16.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.970+0000 7f8c2ab51800 1 -- 172.21.15.178:0/3710435632 wait complete. 2024-09-21T09:03:16.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.970+0000 7f8c2ab51800 1 Processor -- start 2024-09-21T09:03:16.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.970+0000 7f8c2ab51800 1 -- start start 2024-09-21T09:03:16.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.970+0000 7f8c2ab51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460834bdd0 0x5646083531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.970+0000 7f8c2ab51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56460834cc90 con 0x56460834bdd0 2024-09-21T09:03:16.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.970+0000 7f8c28e46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460834bdd0 0x5646083531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.970+0000 7f8c28e46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460834bdd0 0x5646083531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:56016/0 (socket says 172.21.15.178:56016) 2024-09-21T09:03:16.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.970+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 learned_addr learned my addr 172.21.15.178:0/2483455674 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:16.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.971+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564608353730 con 0x56460834bdd0 2024-09-21T09:03:16.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.971+0000 7f8c28e46640 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460834bdd0 0x5646083531f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c20017fe0 tx=0x7f8c2004ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.971+0000 7f8afdffb640 1 -- 172.21.15.178:0/2483455674 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c20019b20 con 0x56460834bdd0 2024-09-21T09:03:16.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.971+0000 7f8afdffb640 1 -- 172.21.15.178:0/2483455674 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c200153e0 con 0x56460834bdd0 2024-09-21T09:03:16.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.971+0000 7f8afdffb640 1 -- 172.21.15.178:0/2483455674 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c20019cc0 con 0x56460834bdd0 2024-09-21T09:03:16.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.971+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646083539c0 con 0x56460834bdd0 2024-09-21T09:03:16.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.971+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564608356670 con 0x56460834bdd0 2024-09-21T09:03:16.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.972+0000 7f8afdffb640 1 -- 172.21.15.178:0/2483455674 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8c2002b350 con 0x56460834bdd0 2024-09-21T09:03:16.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.972+0000 7f8afdffb640 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8af0036ac0 0x7f8af0038f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.972+0000 7f8afdffb640 1 -- 172.21.15.178:0/2483455674 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8c20043aa0 con 0x56460834bdd0 2024-09-21T09:03:16.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.972+0000 7f8c28645640 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8af0036ac0 0x7f8af0038f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.972+0000 7f8c28645640 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8af0036ac0 0x7f8af0038f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8c1806cfd0 tx=0x7f8c18081000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.972+0000 7f8c2ab51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.973+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56460835ec20 0x5646083610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.973+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564608361830 con 0x56460835ec20 2024-09-21T09:03:16.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.973+0000 7f8c27e44640 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56460835ec20 0x5646083610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.973+0000 7f8c27e44640 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56460835ec20 0x5646083610e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.973+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c1000f610 con 0x56460835ec20 2024-09-21T09:03:16.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.973+0000 7f8c2ab51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.973+0000 7f8c2ab51800 20 realm 2024-09-21T09:03:16.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.973+0000 7f8c2ab51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.973+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56460835e070 con 0x56460835ec20 2024-09-21T09:03:16.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.973+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c1000f610 con 0x56460835ec20 2024-09-21T09:03:16.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.973+0000 7f8c2ab51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.973+0000 7f8c2ab51800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:16.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.973+0000 7f8c2ab51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.973+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564608362320 con 0x56460835ec20 2024-09-21T09:03:16.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.974+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c1000f610 con 0x56460835ec20 2024-09-21T09:03:16.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.974+0000 7f8c2ab51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.974+0000 7f8c2ab51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.974+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564608362bf0 con 0x56460835ec20 2024-09-21T09:03:16.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.974+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c1000f610 con 0x56460835ec20 2024-09-21T09:03:16.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.974+0000 7f8c2ab51800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:16.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.974+0000 7f8c2ab51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.974+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564608363610 0x564608365a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.974+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646083660f0 con 0x564608363610 2024-09-21T09:03:16.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.974+0000 7f8c28e46640 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564608363610 0x564608365a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.974+0000 7f8c28e46640 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564608363610 0x564608365a00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.975+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:16.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.975+0000 7f8c2ab51800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:16.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.975+0000 7f8c2ab51800 20 searching for the correct realm 2024-09-21T09:03:16.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.975+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5646083680c0 0x56460836a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.975+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x5646083680c0 2024-09-21T09:03:16.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.975+0000 7f8c28645640 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5646083680c0 0x56460836a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.975+0000 7f8c28645640 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5646083680c0 0x56460836a580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.975+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1807c070 con 0x5646083680c0 2024-09-21T09:03:16.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.975+0000 7f8c28645640 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8c1809c070 0x7f8c1806b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:16.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.975+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x7f8c1809c070 2024-09-21T09:03:16.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.975+0000 7f8c27e44640 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8c1809c070 0x7f8c1806b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:16.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.976+0000 7f8c27e44640 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8c1809c070 0x7f8c1806b3f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:16.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.976+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1000f610 con 0x7f8c1809c070 2024-09-21T09:03:16.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.976+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x564608363610 2024-09-21T09:03:16.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.976+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:16.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.976+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x56460835ec20 2024-09-21T09:03:16.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.977+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1000f610 con 0x56460835ec20 2024-09-21T09:03:16.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.977+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x56460835ec20 2024-09-21T09:03:16.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.977+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:16.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.977+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x564608363610 2024-09-21T09:03:16.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.977+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:16.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.977+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x564608363610 2024-09-21T09:03:16.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.978+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:16.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.978+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x7f8c1809c070 2024-09-21T09:03:16.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.978+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002b040 con 0x7f8c1809c070 2024-09-21T09:03:16.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.978+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x5646083680c0 2024-09-21T09:03:16.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.978+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1807c070 con 0x5646083680c0 2024-09-21T09:03:16.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.978+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x56460835ec20 2024-09-21T09:03:16.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.978+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:16.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.978+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x564608363610 2024-09-21T09:03:16.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.979+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:16.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.979+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x56460835ec20 2024-09-21T09:03:16.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.979+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:16.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.979+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x7f8c1809c070 2024-09-21T09:03:16.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.979+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8c1002b040 con 0x7f8c1809c070 2024-09-21T09:03:16.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.979+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x5646083680c0 2024-09-21T09:03:16.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.979+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180ab040 con 0x5646083680c0 2024-09-21T09:03:16.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.979+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x5646083680c0 2024-09-21T09:03:16.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.979+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180ab040 con 0x5646083680c0 2024-09-21T09:03:16.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.980+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x564608363610 2024-09-21T09:03:16.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.980+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:16.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.980+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x5646083680c0 2024-09-21T09:03:16.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.980+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180ab040 con 0x5646083680c0 2024-09-21T09:03:16.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.980+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x5646083680c0 2024-09-21T09:03:16.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.980+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180ab040 con 0x5646083680c0 2024-09-21T09:03:16.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.980+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x56460835ec20 2024-09-21T09:03:16.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.980+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:16.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.980+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x56460835ec20 2024-09-21T09:03:16.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.981+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:16.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.981+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x564608363610 2024-09-21T09:03:16.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.981+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:16.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.981+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x5646083680c0 2024-09-21T09:03:16.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.981+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180ab040 con 0x5646083680c0 2024-09-21T09:03:16.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.981+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x7f8c1809c070 2024-09-21T09:03:16.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.981+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002b040 con 0x7f8c1809c070 2024-09-21T09:03:16.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.981+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x56460835ec20 2024-09-21T09:03:16.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.982+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:16.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.982+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x564608363610 2024-09-21T09:03:16.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.982+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:16.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.982+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x5646083680c0 2024-09-21T09:03:16.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.982+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180ab040 con 0x5646083680c0 2024-09-21T09:03:16.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.982+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x564608363610 2024-09-21T09:03:16.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.983+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:16.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.983+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x7f8c1809c070 2024-09-21T09:03:16.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.983+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002b040 con 0x7f8c1809c070 2024-09-21T09:03:16.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.983+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x5646083680c0 2024-09-21T09:03:16.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.983+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180ab040 con 0x5646083680c0 2024-09-21T09:03:16.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.983+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x564608363610 2024-09-21T09:03:16.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.983+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:16.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.983+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x56460835ec20 2024-09-21T09:03:16.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:16.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56460836ac50 con 0x7f8c1809c070 2024-09-21T09:03:16.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002b040 con 0x7f8c1809c070 2024-09-21T09:03:16.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c2ab51800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:16.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c2ab51800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:16.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c2ab51800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:16.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c2ab51800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:16.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c2ab51800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:16.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c2ab51800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:16.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c2ab51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564608366ab0 con 0x56460835ec20 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c2ab51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c2ab51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646083666f0 con 0x56460835ec20 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c2ab51800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c2ab51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.984+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564608367450 con 0x56460835ec20 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 20 zone default found 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 4 Realm: () 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:16.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:16.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 20 zonegroup default 2024-09-21T09:03:16.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564608366f90 con 0x564608363610 2024-09-21T09:03:16.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:16.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56460836d460 con 0x5646083680c0 2024-09-21T09:03:16.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c180ab040 con 0x5646083680c0 2024-09-21T09:03:16.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:16.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56460836d800 con 0x5646083680c0 2024-09-21T09:03:16.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c180ab040 con 0x5646083680c0 2024-09-21T09:03:16.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:16.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 20 started sync module instance, tier type = 2024-09-21T09:03:16.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:16.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.985+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56460836c8a0 con 0x7f8c1809c070 2024-09-21T09:03:16.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.986+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x7f8c1809c070 2024-09-21T09:03:16.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.986+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94858785508816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56460836c8a0 con 0x7f8c1809c070 2024-09-21T09:03:16.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.986+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56460836e250 con 0x56460835ec20 2024-09-21T09:03:16.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.987+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94858785508816] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x7f8c1809c070 2024-09-21T09:03:16.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.987+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:16.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.987+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94858785512768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56460836c8a0 con 0x56460835ec20 2024-09-21T09:03:16.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.988+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56460836ece0 con 0x5646083680c0 2024-09-21T09:03:17.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.989+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94858785512768] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:17.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.989+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c180ab040 con 0x5646083680c0 2024-09-21T09:03:17.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.989+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94858785506288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56460836c810 con 0x5646083680c0 2024-09-21T09:03:17.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.989+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56460836fba0 con 0x7f8c1809c070 2024-09-21T09:03:17.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.990+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94858785506288] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c180ab040 con 0x5646083680c0 2024-09-21T09:03:17.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.990+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x7f8c1809c070 2024-09-21T09:03:17.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.990+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94858785519344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56460836ffc0 con 0x7f8c1809c070 2024-09-21T09:03:17.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.990+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564608370870 con 0x56460835ec20 2024-09-21T09:03:17.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.991+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:17.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.991+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94858785521600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646083703e0 con 0x56460835ec20 2024-09-21T09:03:17.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.991+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646083717e0 con 0x564608363610 2024-09-21T09:03:17.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.991+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94858785519344] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x7f8c1809c070 2024-09-21T09:03:17.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.992+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94858785521600] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:17.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.992+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:17.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.992+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94858785524880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646083717a0 con 0x564608363610 2024-09-21T09:03:17.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.992+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564608372080 con 0x564608363610 2024-09-21T09:03:17.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.993+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:17.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.993+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94858785528704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564608372450 con 0x564608363610 2024-09-21T09:03:17.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.993+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564608372ca0 con 0x564608363610 2024-09-21T09:03:17.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.993+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94858785524880] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:17.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.994+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94858785528704] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:17.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.994+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:17.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.994+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94858785529760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564608372870 con 0x564608363610 2024-09-21T09:03:17.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.994+0000 7f8c2ab51800 20 add_watcher() i=0 2024-09-21T09:03:17.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.994+0000 7f8c2ab51800 20 add_watcher() i=1 2024-09-21T09:03:17.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.994+0000 7f8c2ab51800 20 add_watcher() i=2 2024-09-21T09:03:17.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.994+0000 7f8c2ab51800 20 add_watcher() i=3 2024-09-21T09:03:17.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.994+0000 7f8c2ab51800 20 add_watcher() i=4 2024-09-21T09:03:17.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.994+0000 7f8c2ab51800 20 add_watcher() i=5 2024-09-21T09:03:17.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.994+0000 7f8c2ab51800 20 add_watcher() i=6 2024-09-21T09:03:17.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.995+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94858785529760] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:17.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.995+0000 7f8c2ab51800 20 add_watcher() i=7 2024-09-21T09:03:17.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.995+0000 7f8c2ab51800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:17.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.995+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564608375a80 con 0x56460835ec20 2024-09-21T09:03:17.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.995+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:17.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.995+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94858785531184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564608372e00 con 0x56460835ec20 2024-09-21T09:03:17.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.996+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94858785531184] v29'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:17.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.996+0000 7f8adefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.996+0000 7f8c2ab51800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:17.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.996+0000 7f8c2ab51800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:17.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.996+0000 7f8c2ab51800 5 note: GC not initialized 2024-09-21T09:03:17.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.997+0000 7f8addfdb640 20 reqs_thread_entry: start 2024-09-21T09:03:17.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.997+0000 7f8c2ab51800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:17.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.997+0000 7f8c2ab51800 20 Filter name: none 2024-09-21T09:03:17.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.997+0000 7f8a4f7fe640 20 reqs_thread_entry: start 2024-09-21T09:03:17.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.997+0000 7f8c2ab51800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T09:03:17.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.997+0000 7f8c2ab51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.997+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646083a8f40 con 0x564608363610 2024-09-21T09:03:17.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.997+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:17.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.997+0000 7f8c2ab51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.997+0000 7f8c2ab51800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-21T09:03:17.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.997+0000 7f8c2ab51800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T09:03:17.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.997+0000 7f8c2ab51800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-21T09:03:17.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.997+0000 7f8c2ab51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646083a7580 con 0x56460835ec20 2024-09-21T09:03:17.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:17.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c2ab51800 20 rados_obj.operate() r=0 bl.length=7 2024-09-21T09:03:17.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c2ab51800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-21T09:03:17.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c2ab51800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-21T09:03:17.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c2ab51800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:17.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c2ab51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646083a7970 con 0x56460835ec20 2024-09-21T09:03:17.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:17.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c2ab51800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:17.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c2ab51800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:17.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c2ab51800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:17.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c2ab51800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:17.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c2ab51800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-21T09:03:17.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.998+0000 7f8c2ab51800 20 get_user_info_from_index found 0 xattrs 2024-09-21T09:03:17.010 INFO:teuthology.orchestra.run.smithi178.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-21T09:03:17.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.999+0000 7f8adefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:16.999+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94858785531184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564608375270 con 0x56460835ec20 2024-09-21T09:03:17.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.000+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94858785531184] v29'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:17.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.000+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94858785508816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646083a6c90 con 0x7f8c1809c070 2024-09-21T09:03:17.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.001+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94858785508816] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x7f8c1809c070 2024-09-21T09:03:17.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.001+0000 7f8c2ab51800 20 remove_watcher() i=0 2024-09-21T09:03:17.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.001+0000 7f8c2ab51800 2 removed watcher, disabling cache 2024-09-21T09:03:17.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.001+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94858785512768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646083a6c90 con 0x56460835ec20 2024-09-21T09:03:17.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.002+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94858785512768] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:17.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.002+0000 7f8c2ab51800 20 remove_watcher() i=1 2024-09-21T09:03:17.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.002+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94858785506288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646083a6c90 con 0x5646083680c0 2024-09-21T09:03:17.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.003+0000 7f8c28645640 1 -- 172.21.15.178:0/2483455674 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94858785506288] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c180ab040 con 0x5646083680c0 2024-09-21T09:03:17.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.003+0000 7f8c2ab51800 20 remove_watcher() i=2 2024-09-21T09:03:17.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.003+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94858785519344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646083a6c90 con 0x7f8c1809c070 2024-09-21T09:03:17.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.004+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94858785519344] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x7f8c1809c070 2024-09-21T09:03:17.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.004+0000 7f8c2ab51800 20 remove_watcher() i=3 2024-09-21T09:03:17.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.004+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94858785521600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646083a6c90 con 0x56460835ec20 2024-09-21T09:03:17.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.005+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94858785521600] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002b040 con 0x56460835ec20 2024-09-21T09:03:17.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.005+0000 7f8c2ab51800 20 remove_watcher() i=4 2024-09-21T09:03:17.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.005+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94858785524880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646083a6c90 con 0x564608363610 2024-09-21T09:03:17.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.006+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94858785524880] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:17.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.006+0000 7f8c2ab51800 20 remove_watcher() i=5 2024-09-21T09:03:17.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.006+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94858785528704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646083a6c90 con 0x564608363610 2024-09-21T09:03:17.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.007+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94858785528704] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:17.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.007+0000 7f8c2ab51800 20 remove_watcher() i=6 2024-09-21T09:03:17.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.007+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94858785529760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646083a6c90 con 0x564608363610 2024-09-21T09:03:17.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c28e46640 1 -- 172.21.15.178:0/2483455674 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94858785529760] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c20056040 con 0x564608363610 2024-09-21T09:03:17.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 20 remove_watcher() i=7 2024-09-21T09:03:17.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564608363610 msgr2=0x564608365a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564608363610 0x564608365a00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56460835ec20 msgr2=0x5646083610e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56460835ec20 0x5646083610e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8c1809c070 msgr2=0x7f8c1806b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8c1809c070 0x7f8c1806b3f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5646083680c0 msgr2=0x56460836a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5646083680c0 0x56460836a580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8af0036ac0 msgr2=0x7f8af0038f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8af0036ac0 0x7f8af0038f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8c1806cfd0 tx=0x7f8c18081000 comp rx=0 tx=0).stop 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c27e44640 1 -- 172.21.15.178:0/2483455674 reap_dead start 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460834bdd0 msgr2=0x5646083531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460834bdd0 0x5646083531f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c20017fe0 tx=0x7f8c2004ce20 comp rx=0 tx=0).stop 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 shutdown_connections 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2483455674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460834bdd0 0x5646083531f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 >> 172.21.15.178:0/2483455674 conn(0x5646083481c0 msgr2=0x564608346290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 shutdown_connections 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2483455674 wait complete. 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2688542557 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8b00036b90 msgr2=0x7f8b00039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2688542557 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8b00036b90 0x7f8b00039050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x56460822ab30 tx=0x7f8c18046130 comp rx=0 tx=0).stop 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2688542557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460833f260 msgr2=0x56460833f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2688542557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460833f260 0x56460833f680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x56460822b500 tx=0x7f8c2000aec0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2688542557 shutdown_connections 2024-09-21T09:03:17.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2688542557 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8b00036b90 0x7f8b00039050 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/2688542557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460833f260 0x56460833f680 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2688542557 >> 172.21.15.178:0/2688542557 conn(0x5646083341f0 msgr2=0x564608336d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2688542557 shutdown_connections 2024-09-21T09:03:17.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.008+0000 7f8c2ab51800 1 -- 172.21.15.178:0/2688542557 wait complete. 2024-09-21T09:03:17.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56460832dc70 msgr2=0x564608330110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56460832dc70 0x564608330110 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56460822e720 msgr2=0x56460832b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56460822e720 0x56460832b5d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8b10036b90 msgr2=0x7f8b10039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8b10036b90 0x7f8b10039050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8c10000f60 tx=0x7f8c10001370 comp rx=0 tx=0).stop 2024-09-21T09:03:17.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 msgr2=0x56460822bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460822bb10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c18045d30 tx=0x7f8c18003330 comp rx=0 tx=0).stop 2024-09-21T09:03:17.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 shutdown_connections 2024-09-21T09:03:17.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56460832dc70 0x564608330110 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56460822e720 0x56460832b5d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8b10036b90 0x7f8b10039050 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 --2- 172.21.15.178:0/169142911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56460819ee30 0x56460822bb10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 >> 172.21.15.178:0/169142911 conn(0x564608225e10 msgr2=0x564608314af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 shutdown_connections 2024-09-21T09:03:17.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.009+0000 7f8c2ab51800 1 -- 172.21.15.178:0/169142911 wait complete. 2024-09-21T09:03:17.019 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-21T09:03:17.020 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T09:03:17.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T09:03:17.020 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T09:03:17.064 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:17.064 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:17.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.063+0000 7f31ba011800 1 Processor -- start 2024-09-21T09:03:17.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.063+0000 7f31ba011800 1 -- start start 2024-09-21T09:03:17.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.063+0000 7f31ba011800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x564f5069f550 0x564f5069f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.064+0000 7f31ba011800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564f5055fb30 con 0x564f5069fe90 2024-09-21T09:03:17.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.064+0000 7f31ba011800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x564f50541360 con 0x564f5069f550 2024-09-21T09:03:17.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.064+0000 7f31b583b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x564f5069f550 0x564f5069f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.064+0000 7f31b583b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x564f5069f550 0x564f5069f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:56018/0 (socket says 172.21.15.178:56018) 2024-09-21T09:03:17.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.064+0000 7f31b583b640 1 -- 172.21.15.178:0/1579457786 learned_addr learned my addr 172.21.15.178:0/1579457786 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.064+0000 7f31b583b640 1 -- 172.21.15.178:0/1579457786 >> v1:172.21.15.44:6789/0 conn(0x564f5069fe90 legacy=0x564f506a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.064+0000 7f31b583b640 1 -- 172.21.15.178:0/1579457786 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f50567e00 con 0x564f5069f550 2024-09-21T09:03:17.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.064+0000 7f31b503a640 1 -- 172.21.15.178:0/1579457786 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1251962137 0 0) 0x564f5055fb30 con 0x564f5069fe90 2024-09-21T09:03:17.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.066+0000 7f31b583b640 1 --2- 172.21.15.178:0/1579457786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f5069f950 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f31a800a520 tx=0x7f31a8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff6ecbf5888395c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.066+0000 7f31b503a640 1 -- 172.21.15.178:0/1579457786 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a8055070 con 0x564f5069f550 2024-09-21T09:03:17.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.066+0000 7f31b503a640 1 -- 172.21.15.178:0/1579457786 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a80515b0 con 0x564f5069f550 2024-09-21T09:03:17.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.066+0000 7f31b503a640 1 -- 172.21.15.178:0/1579457786 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a80518d0 con 0x564f5069f550 2024-09-21T09:03:17.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.067+0000 7f31ba011800 1 -- 172.21.15.178:0/1579457786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 msgr2=0x564f5069f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.067+0000 7f31ba011800 1 --2- 172.21.15.178:0/1579457786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f5069f950 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f31a800a520 tx=0x7f31a8045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.067+0000 7f31ba011800 1 -- 172.21.15.178:0/1579457786 shutdown_connections 2024-09-21T09:03:17.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.067+0000 7f31ba011800 1 --2- 172.21.15.178:0/1579457786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f5069f950 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.067+0000 7f31ba011800 1 -- 172.21.15.178:0/1579457786 >> 172.21.15.178:0/1579457786 conn(0x564f5069ade0 msgr2=0x564f5069d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.067+0000 7f31ba011800 1 -- 172.21.15.178:0/1579457786 shutdown_connections 2024-09-21T09:03:17.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.067+0000 7f31ba011800 1 -- 172.21.15.178:0/1579457786 wait complete. 2024-09-21T09:03:17.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.080+0000 7f31ba011800 1 Processor -- start 2024-09-21T09:03:17.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.080+0000 7f31ba011800 1 -- start start 2024-09-21T09:03:17.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.080+0000 7f31ba011800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f506145a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.080+0000 7f31ba011800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564f505ec330 con 0x564f5069f550 2024-09-21T09:03:17.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.081+0000 7f31b583b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f506145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.081+0000 7f31b583b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f506145a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:56026/0 (socket says 172.21.15.178:56026) 2024-09-21T09:03:17.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.081+0000 7f31b583b640 1 -- 172.21.15.178:0/3807001466 learned_addr learned my addr 172.21.15.178:0/3807001466 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.081+0000 7f31b583b640 1 -- 172.21.15.178:0/3807001466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f50539bc0 con 0x564f5069f550 2024-09-21T09:03:17.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.081+0000 7f31b583b640 1 --2- 172.21.15.178:0/3807001466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f506145a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f31a8000c00 tx=0x7f31a8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1709a14698dbea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.082+0000 7f30a3e07640 1 -- 172.21.15.178:0/3807001466 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a80519d0 con 0x564f5069f550 2024-09-21T09:03:17.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.082+0000 7f30a3e07640 1 -- 172.21.15.178:0/3807001466 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a8051b70 con 0x564f5069f550 2024-09-21T09:03:17.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.082+0000 7f30a3e07640 1 -- 172.21.15.178:0/3807001466 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a8051e50 con 0x564f5069f550 2024-09-21T09:03:17.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.082+0000 7f31ba011800 1 -- 172.21.15.178:0/3807001466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 msgr2=0x564f506145a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.082+0000 7f31ba011800 1 --2- 172.21.15.178:0/3807001466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f506145a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f31a8000c00 tx=0x7f31a8051000 comp rx=0 tx=0).stop 2024-09-21T09:03:17.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.082+0000 7f31ba011800 1 -- 172.21.15.178:0/3807001466 shutdown_connections 2024-09-21T09:03:17.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.082+0000 7f31ba011800 1 --2- 172.21.15.178:0/3807001466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f506145a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.082+0000 7f31ba011800 1 -- 172.21.15.178:0/3807001466 >> 172.21.15.178:0/3807001466 conn(0x564f5069ade0 msgr2=0x564f50789f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.082+0000 7f31ba011800 1 -- 172.21.15.178:0/3807001466 shutdown_connections 2024-09-21T09:03:17.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.082+0000 7f31ba011800 1 -- 172.21.15.178:0/3807001466 wait complete. 2024-09-21T09:03:17.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.083+0000 7f31ba011800 1 Processor -- start 2024-09-21T09:03:17.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.083+0000 7f31ba011800 1 -- start start 2024-09-21T09:03:17.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.083+0000 7f31ba011800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f50796e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.083+0000 7f31ba011800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564f506a6570 con 0x564f5069f550 2024-09-21T09:03:17.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.083+0000 7f31b583b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f50796e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.083+0000 7f31b583b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f50796e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:56040/0 (socket says 172.21.15.178:56040) 2024-09-21T09:03:17.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.083+0000 7f31b583b640 1 -- 172.21.15.178:0/2628968120 learned_addr learned my addr 172.21.15.178:0/2628968120 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.084+0000 7f31b583b640 1 -- 172.21.15.178:0/2628968120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f5054dfe0 con 0x564f5069f550 2024-09-21T09:03:17.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.084+0000 7f31b583b640 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f50796e90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f31a800a520 tx=0x7f31a8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.084+0000 7f30a2604640 1 -- 172.21.15.178:0/2628968120 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a8073070 con 0x564f5069f550 2024-09-21T09:03:17.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.084+0000 7f30a2604640 1 -- 172.21.15.178:0/2628968120 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a805a580 con 0x564f5069f550 2024-09-21T09:03:17.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.084+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f507973d0 con 0x564f5069f550 2024-09-21T09:03:17.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.084+0000 7f30a2604640 1 -- 172.21.15.178:0/2628968120 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a805a8a0 con 0x564f5069f550 2024-09-21T09:03:17.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.084+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f50797950 con 0x564f5069f550 2024-09-21T09:03:17.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.085+0000 7f30a2604640 1 -- 172.21.15.178:0/2628968120 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f31a8076070 con 0x564f5069f550 2024-09-21T09:03:17.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.085+0000 7f30a2604640 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f309c036b90 0x7f309c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.085+0000 7f30a2604640 1 -- 172.21.15.178:0/2628968120 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f31a8062070 con 0x564f5069f550 2024-09-21T09:03:17.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.085+0000 7f31ad03a640 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f309c036b90 0x7f309c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.085+0000 7f31ba011800 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564f5069fe90 0x564f5079df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.085+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f5079e4d0 con 0x564f5069fe90 2024-09-21T09:03:17.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.086+0000 7f31b603c640 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564f5069fe90 0x564f5079df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.086+0000 7f31ad03a640 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f309c036b90 0x7f309c039050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f31a0000f60 tx=0x7f31a00013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.086+0000 7f31b603c640 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564f5069fe90 0x564f5079df00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.086+0000 7f31b603c640 1 -- 172.21.15.178:0/2628968120 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31b000a4a0 con 0x564f5069fe90 2024-09-21T09:03:17.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.086+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f5079b4b0 con 0x564f5069fe90 2024-09-21T09:03:17.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.086+0000 7f31b603c640 1 -- 172.21.15.178:0/2628968120 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31b000a4a0 con 0x564f5069fe90 2024-09-21T09:03:17.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.086+0000 7f31ba011800 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564f507a0800 0x564f507a2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.086+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f507a3290 con 0x564f507a0800 2024-09-21T09:03:17.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.087+0000 7f31b583b640 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564f507a0800 0x564f507a2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.087+0000 7f31b583b640 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564f507a0800 0x564f507a2bf0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.087+0000 7f31b583b640 1 -- 172.21.15.178:0/2628968120 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f31a807f070 con 0x564f507a0800 2024-09-21T09:03:17.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.087+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f5079f6a0 con 0x564f5069fe90 2024-09-21T09:03:17.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.087+0000 7f31b603c640 1 -- 172.21.15.178:0/2628968120 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31b000a4a0 con 0x564f5069fe90 2024-09-21T09:03:17.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.087+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f5079fb40 con 0x564f5069fe90 2024-09-21T09:03:17.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.088+0000 7f31b603c640 1 -- 172.21.15.178:0/2628968120 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f31b000a4a0 con 0x564f5069fe90 2024-09-21T09:03:17.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.088+0000 7f31ba011800 1 Processor -- start 2024-09-21T09:03:17.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.088+0000 7f31ba011800 1 -- start start 2024-09-21T09:03:17.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.088+0000 7f31ba011800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507b1c10 0x564f507b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.088+0000 7f31ba011800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564f5053b580 con 0x564f507b1c10 2024-09-21T09:03:17.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.088+0000 7f31b603c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507b1c10 0x564f507b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.089+0000 7f31b603c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507b1c10 0x564f507b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:56056/0 (socket says 172.21.15.178:56056) 2024-09-21T09:03:17.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.089+0000 7f31b603c640 1 -- 172.21.15.178:0/1807880877 learned_addr learned my addr 172.21.15.178:0/1807880877 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.089+0000 7f31b603c640 1 -- 172.21.15.178:0/1807880877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f507b2570 con 0x564f507b1c10 2024-09-21T09:03:17.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.089+0000 7f31b603c640 1 --2- 172.21.15.178:0/1807880877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507b1c10 0x564f507b2030 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x564f5079e8d0 tx=0x7f31b0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.089+0000 7f309b7fe640 1 -- 172.21.15.178:0/1807880877 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b0014450 con 0x564f507b1c10 2024-09-21T09:03:17.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.089+0000 7f309b7fe640 1 -- 172.21.15.178:0/1807880877 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b00145f0 con 0x564f507b1c10 2024-09-21T09:03:17.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.089+0000 7f31ba011800 1 -- 172.21.15.178:0/1807880877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f507b2800 con 0x564f507b1c10 2024-09-21T09:03:17.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.089+0000 7f309b7fe640 1 -- 172.21.15.178:0/1807880877 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b0014910 con 0x564f507b1c10 2024-09-21T09:03:17.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.089+0000 7f31ba011800 1 -- 172.21.15.178:0/1807880877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f507b54e0 con 0x564f507b1c10 2024-09-21T09:03:17.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.090+0000 7f309b7fe640 1 -- 172.21.15.178:0/1807880877 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f31b0011040 con 0x564f507b1c10 2024-09-21T09:03:17.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.090+0000 7f309b7fe640 1 --2- 172.21.15.178:0/1807880877 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3090036b90 0x7f3090039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.090+0000 7f309b7fe640 1 -- 172.21.15.178:0/1807880877 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f31b001e070 con 0x564f507b1c10 2024-09-21T09:03:17.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.090+0000 7f31b583b640 1 --2- 172.21.15.178:0/1807880877 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3090036b90 0x7f3090039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.090+0000 7f31ba011800 1 Processor -- start 2024-09-21T09:03:17.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.090+0000 7f31b583b640 1 --2- 172.21.15.178:0/1807880877 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3090036b90 0x7f3090039050 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x564f5079e940 tx=0x7f31a8050f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.090+0000 7f31ba011800 1 -- start start 2024-09-21T09:03:17.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.091+0000 7f31ba011800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507be890 0x564f507bec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.091+0000 7f31ba011800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564f507924e0 con 0x564f507be890 2024-09-21T09:03:17.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.091+0000 7f31b603c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507be890 0x564f507bec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.091+0000 7f31b603c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507be890 0x564f507bec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:56066/0 (socket says 172.21.15.178:56066) 2024-09-21T09:03:17.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.091+0000 7f31b603c640 1 -- 172.21.15.178:0/175894658 learned_addr learned my addr 172.21.15.178:0/175894658 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.091+0000 7f31b603c640 1 -- 172.21.15.178:0/175894658 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f507bf260 con 0x564f507be890 2024-09-21T09:03:17.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.091+0000 7f31b603c640 1 --2- 172.21.15.178:0/175894658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507be890 0x564f507bec90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f31b004cd00 tx=0x7f31b004cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7ddc7e4438f48b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.091+0000 7f30997fa640 1 -- 172.21.15.178:0/175894658 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b0028040 con 0x564f507be890 2024-09-21T09:03:17.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.091+0000 7f30997fa640 1 -- 172.21.15.178:0/175894658 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b0014be0 con 0x564f507be890 2024-09-21T09:03:17.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.091+0000 7f30997fa640 1 -- 172.21.15.178:0/175894658 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b0046ac0 con 0x564f507be890 2024-09-21T09:03:17.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.092+0000 7f31ba011800 1 -- 172.21.15.178:0/175894658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507be890 msgr2=0x564f507bec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.092+0000 7f31ba011800 1 --2- 172.21.15.178:0/175894658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507be890 0x564f507bec90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f31b004cd00 tx=0x7f31b004cfa0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.092+0000 7f31ba011800 1 -- 172.21.15.178:0/175894658 shutdown_connections 2024-09-21T09:03:17.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.092+0000 7f31ba011800 1 --2- 172.21.15.178:0/175894658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507be890 0x564f507bec90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.092+0000 7f31ba011800 1 -- 172.21.15.178:0/175894658 >> 172.21.15.178:0/175894658 conn(0x564f507babf0 msgr2=0x564f507b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.092+0000 7f31ba011800 1 -- 172.21.15.178:0/175894658 shutdown_connections 2024-09-21T09:03:17.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.092+0000 7f31ba011800 1 -- 172.21.15.178:0/175894658 wait complete. 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.092+0000 7f31ba011800 1 Processor -- start 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.092+0000 7f31ba011800 1 -- start start 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.092+0000 7f31ba011800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507be890 0x564f5078fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.092+0000 7f31ba011800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564f507bf910 con 0x564f507be890 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.092+0000 7f31b603c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507be890 0x564f5078fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.092+0000 7f31b603c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507be890 0x564f5078fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:56068/0 (socket says 172.21.15.178:56068) 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.092+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 learned_addr learned my addr 172.21.15.178:0/1949069032 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.093+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f5078e410 con 0x564f507be890 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.093+0000 7f31b603c640 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507be890 0x564f5078fd20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x564f507b98a0 tx=0x7f31b004cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.093+0000 7f30877fe640 1 -- 172.21.15.178:0/1949069032 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b0028030 con 0x564f507be890 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.093+0000 7f30877fe640 1 -- 172.21.15.178:0/1949069032 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b004a040 con 0x564f507be890 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.093+0000 7f30877fe640 1 -- 172.21.15.178:0/1949069032 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b004e400 con 0x564f507be890 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.093+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f5078e6a0 con 0x564f507be890 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.093+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f5078eba0 con 0x564f507be890 2024-09-21T09:03:17.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.094+0000 7f30877fe640 1 -- 172.21.15.178:0/1949069032 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f31b002b350 con 0x564f507be890 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.094+0000 7f30877fe640 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3080036b90 0x7f3080039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.094+0000 7f30877fe640 1 -- 172.21.15.178:0/1949069032 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f31b0042030 con 0x564f507be890 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.094+0000 7f31b583b640 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3080036b90 0x7f3080039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.094+0000 7f31ba011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.094+0000 7f31ba011800 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564f507d3bc0 0x564f507d6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.094+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f507d67d0 con 0x564f507d3bc0 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.095+0000 7f31b583b640 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3080036b90 0x7f3080039050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f31a8067040 tx=0x7f31a8089000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.095+0000 7f31ad03a640 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564f507d3bc0 0x564f507d6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.095+0000 7f31ad03a640 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564f507d3bc0 0x564f507d6080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.095+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31a0010510 con 0x564f507d3bc0 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.095+0000 7f31ba011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.095+0000 7f31ba011800 20 realm 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.095+0000 7f31ba011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.095+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f507d3010 con 0x564f507d3bc0 2024-09-21T09:03:17.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.095+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31a0010510 con 0x564f507d3bc0 2024-09-21T09:03:17.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.095+0000 7f31ba011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.095+0000 7f31ba011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:17.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.095+0000 7f31ba011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.095+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f507d72b0 con 0x564f507d3bc0 2024-09-21T09:03:17.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.096+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31a0010510 con 0x564f507d3bc0 2024-09-21T09:03:17.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.096+0000 7f31ba011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.096+0000 7f31ba011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.096+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f507d7b80 con 0x564f507d3bc0 2024-09-21T09:03:17.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.096+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31a0010510 con 0x564f507d3bc0 2024-09-21T09:03:17.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.096+0000 7f31ba011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.096+0000 7f31ba011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.096+0000 7f31ba011800 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564f507d8480 0x564f507da870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.096+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f507dafd0 con 0x564f507d8480 2024-09-21T09:03:17.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.096+0000 7f31b603c640 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564f507d8480 0x564f507da870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.096+0000 7f31b603c640 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564f507d8480 0x564f507da870 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.097+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.097+0000 7f31ba011800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:17.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.097+0000 7f31ba011800 20 searching for the correct realm 2024-09-21T09:03:17.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.097+0000 7f31ba011800 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564f507dd080 0x564f507df540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.097+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507dd080 2024-09-21T09:03:17.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.097+0000 7f31b583b640 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564f507dd080 0x564f507df540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.097+0000 7f31b583b640 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564f507dd080 0x564f507df540 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.097+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a807f070 con 0x564f507dd080 2024-09-21T09:03:17.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.097+0000 7f31b583b640 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f31a8078070 0x7f31a8068120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.097+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x7f31a8078070 2024-09-21T09:03:17.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.097+0000 7f31ad03a640 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f31a8078070 0x7f31a8068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.098+0000 7f31ad03a640 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f31a8078070 0x7f31a8068120 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.098+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a0010510 con 0x7f31a8078070 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.098+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d8480 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.098+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.098+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d3bc0 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.098+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a0010510 con 0x564f507d3bc0 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.098+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d3bc0 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.099+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.099+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d8480 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.099+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.099+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d8480 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.099+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.099+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x7f31a8078070 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.099+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a002a040 con 0x7f31a8078070 2024-09-21T09:03:17.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.099+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507dd080 2024-09-21T09:03:17.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.100+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a807f070 con 0x564f507dd080 2024-09-21T09:03:17.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.100+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d3bc0 2024-09-21T09:03:17.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.100+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.100+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d8480 2024-09-21T09:03:17.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.100+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.100+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d3bc0 2024-09-21T09:03:17.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.100+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.100+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x7f31a8078070 2024-09-21T09:03:17.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.101+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f31a002a040 con 0x7f31a8078070 2024-09-21T09:03:17.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.101+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507dd080 2024-09-21T09:03:17.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.101+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a807f070 con 0x564f507dd080 2024-09-21T09:03:17.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.101+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507dd080 2024-09-21T09:03:17.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.101+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a807f070 con 0x564f507dd080 2024-09-21T09:03:17.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.101+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d8480 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.101+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.101+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507dd080 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.102+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a807f070 con 0x564f507dd080 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.102+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507dd080 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.102+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a807f070 con 0x564f507dd080 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.102+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d3bc0 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.102+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.102+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d3bc0 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.102+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.102+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d8480 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.103+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.103+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507dd080 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.103+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a807f070 con 0x564f507dd080 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.103+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x7f31a8078070 2024-09-21T09:03:17.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.103+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a002a040 con 0x7f31a8078070 2024-09-21T09:03:17.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.103+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d3bc0 2024-09-21T09:03:17.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.103+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.103+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d8480 2024-09-21T09:03:17.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.104+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.104+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507dd080 2024-09-21T09:03:17.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.104+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a807f070 con 0x564f507dd080 2024-09-21T09:03:17.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.104+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d8480 2024-09-21T09:03:17.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.104+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.104+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x7f31a8078070 2024-09-21T09:03:17.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.104+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a002a040 con 0x7f31a8078070 2024-09-21T09:03:17.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.104+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507dd080 2024-09-21T09:03:17.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.104+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a807f070 con 0x564f507dd080 2024-09-21T09:03:17.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d8480 2024-09-21T09:03:17.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x564f507d3bc0 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564f507dfc10 con 0x7f31a8078070 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a002a040 con 0x7f31a8078070 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ba011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ba011800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ba011800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ba011800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ba011800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ba011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ba011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f507dba80 con 0x564f507d3bc0 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ba011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ba011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.105+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f507dbea0 con 0x564f507d3bc0 2024-09-21T09:03:17.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f507dc340 con 0x564f507d3bc0 2024-09-21T09:03:17.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:17.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 20 zone default found 2024-09-21T09:03:17.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 4 Realm: () 2024-09-21T09:03:17.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:17.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:17.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:17.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 20 zonegroup default 2024-09-21T09:03:17.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f507e0090 con 0x564f507d8480 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.106+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f507e22c0 con 0x564f507dd080 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.107+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31a807f070 con 0x564f507dd080 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.107+0000 7f31ba011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.107+0000 7f31ba011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.107+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f507e2660 con 0x564f507dd080 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.107+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31a807f070 con 0x564f507dd080 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.107+0000 7f31ba011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.107+0000 7f31ba011800 20 started sync module instance, tier type = 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.107+0000 7f31ba011800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.107+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e1700 con 0x7f31a8078070 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.108+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x7f31a8078070 2024-09-21T09:03:17.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.108+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94898652846880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e1700 con 0x7f31a8078070 2024-09-21T09:03:17.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.108+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e3020 con 0x564f507d3bc0 2024-09-21T09:03:17.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.109+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94898652846880] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x7f31a8078070 2024-09-21T09:03:17.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.109+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.109+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94898652845104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e3020 con 0x564f507d3bc0 2024-09-21T09:03:17.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.109+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e39e0 con 0x564f507dd080 2024-09-21T09:03:17.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.110+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a807f070 con 0x564f507dd080 2024-09-21T09:03:17.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.110+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94898652853552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e4230 con 0x564f507dd080 2024-09-21T09:03:17.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.110+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e4cd0 con 0x7f31a8078070 2024-09-21T09:03:17.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.110+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94898652845104] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.111+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94898652853552] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a807f070 con 0x564f507dd080 2024-09-21T09:03:17.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.111+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x7f31a8078070 2024-09-21T09:03:17.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.111+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94898652855680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e2b70 con 0x7f31a8078070 2024-09-21T09:03:17.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.111+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e5570 con 0x564f507d3bc0 2024-09-21T09:03:17.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.112+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.112+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94898652860480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e59a0 con 0x564f507d3bc0 2024-09-21T09:03:17.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.112+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e6270 con 0x564f507d8480 2024-09-21T09:03:17.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.112+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94898652855680] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x7f31a8078070 2024-09-21T09:03:17.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.113+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.113+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94898652858272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e6ac0 con 0x564f507d8480 2024-09-21T09:03:17.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.113+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94898652860480] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.113+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e6ac0 con 0x564f507d8480 2024-09-21T09:03:17.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.116+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94898652858272] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.116+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.116+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94898652866064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e6ee0 con 0x564f507d8480 2024-09-21T09:03:17.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.116+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e7770 con 0x564f507d8480 2024-09-21T09:03:17.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.117+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94898652866064] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.117+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.117+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94898652867120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e7950 con 0x564f507d8480 2024-09-21T09:03:17.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.117+0000 7f31ba011800 20 add_watcher() i=0 2024-09-21T09:03:17.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.117+0000 7f31ba011800 20 add_watcher() i=1 2024-09-21T09:03:17.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.117+0000 7f31ba011800 20 add_watcher() i=2 2024-09-21T09:03:17.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.117+0000 7f31ba011800 20 add_watcher() i=3 2024-09-21T09:03:17.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.117+0000 7f31ba011800 20 add_watcher() i=4 2024-09-21T09:03:17.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.117+0000 7f31ba011800 20 add_watcher() i=5 2024-09-21T09:03:17.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.117+0000 7f31ba011800 20 add_watcher() i=6 2024-09-21T09:03:17.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.118+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94898652867120] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.118+0000 7f31ba011800 20 add_watcher() i=7 2024-09-21T09:03:17.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.118+0000 7f31ba011800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:17.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.118+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f507ead20 con 0x564f507d3bc0 2024-09-21T09:03:17.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.119+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.119+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94898652870720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e8110 con 0x564f507d3bc0 2024-09-21T09:03:17.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.120+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94898652870720] v29'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.120+0000 7f30677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.120+0000 7f31ba011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:17.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.120+0000 7f31ba011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:17.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.120+0000 7f31ba011800 5 note: GC not initialized 2024-09-21T09:03:17.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.120+0000 7f30667fc640 20 reqs_thread_entry: start 2024-09-21T09:03:17.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.120+0000 7f31ba011800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:17.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.120+0000 7f31ba011800 20 Filter name: none 2024-09-21T09:03:17.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.120+0000 7f2fd7fff640 20 reqs_thread_entry: start 2024-09-21T09:03:17.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.120+0000 7f31ba011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.120+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564f5081db80 con 0x564f507d3bc0 2024-09-21T09:03:17.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.121+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.121+0000 7f31ba011800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:17.129 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:17.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.122+0000 7f30677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.122+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94898652870720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507d12d0 con 0x564f507d3bc0 2024-09-21T09:03:17.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.123+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94898652870720] v29'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.123+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94898652846880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e7840 con 0x7f31a8078070 2024-09-21T09:03:17.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.123+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94898652846880] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x7f31a8078070 2024-09-21T09:03:17.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.124+0000 7f31ba011800 20 remove_watcher() i=0 2024-09-21T09:03:17.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.124+0000 7f31ba011800 2 removed watcher, disabling cache 2024-09-21T09:03:17.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.124+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94898652845104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e7840 con 0x564f507d3bc0 2024-09-21T09:03:17.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.125+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94898652845104] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.125+0000 7f31ba011800 20 remove_watcher() i=1 2024-09-21T09:03:17.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.125+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94898652853552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e1430 con 0x564f507dd080 2024-09-21T09:03:17.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.126+0000 7f31b583b640 1 -- 172.21.15.178:0/1949069032 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94898652853552] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a807f070 con 0x564f507dd080 2024-09-21T09:03:17.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.126+0000 7f31ba011800 20 remove_watcher() i=2 2024-09-21T09:03:17.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.126+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94898652855680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e7840 con 0x7f31a8078070 2024-09-21T09:03:17.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.127+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94898652855680] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x7f31a8078070 2024-09-21T09:03:17.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.127+0000 7f31ba011800 20 remove_watcher() i=3 2024-09-21T09:03:17.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.127+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94898652860480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e3530 con 0x564f507d3bc0 2024-09-21T09:03:17.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.128+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94898652860480] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a002a040 con 0x564f507d3bc0 2024-09-21T09:03:17.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.128+0000 7f31ba011800 20 remove_watcher() i=4 2024-09-21T09:03:17.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.128+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94898652858272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e3d80 con 0x564f507d8480 2024-09-21T09:03:17.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.129+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94898652858272] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.129+0000 7f31ba011800 20 remove_watcher() i=5 2024-09-21T09:03:17.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.129+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94898652866064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e7840 con 0x564f507d8480 2024-09-21T09:03:17.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.130+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94898652866064] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.130+0000 7f31ba011800 20 remove_watcher() i=6 2024-09-21T09:03:17.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.130+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94898652867120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564f507e5040 con 0x564f507d8480 2024-09-21T09:03:17.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31b603c640 1 -- 172.21.15.178:0/1949069032 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94898652867120] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b0035020 con 0x564f507d8480 2024-09-21T09:03:17.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 20 remove_watcher() i=7 2024-09-21T09:03:17.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564f507d8480 msgr2=0x564f507da870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564f507d8480 0x564f507da870 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564f507d3bc0 msgr2=0x564f507d6080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564f507d3bc0 0x564f507d6080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f31a8078070 msgr2=0x7f31a8068120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f31a8078070 0x7f31a8068120 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564f507dd080 msgr2=0x564f507df540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564f507dd080 0x564f507df540 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3080036b90 msgr2=0x7f3080039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3080036b90 0x7f3080039050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f31a8067040 tx=0x7f31a8089000 comp rx=0 tx=0).stop 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507be890 msgr2=0x564f5078fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ad03a640 1 -- 172.21.15.178:0/1949069032 reap_dead start 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507be890 0x564f5078fd20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x564f507b98a0 tx=0x7f31b004cc60 comp rx=0 tx=0).stop 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 shutdown_connections 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 --2- 172.21.15.178:0/1949069032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507be890 0x564f5078fd20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 >> 172.21.15.178:0/1949069032 conn(0x564f507babf0 msgr2=0x564f507b8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 shutdown_connections 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 -- 172.21.15.178:0/1949069032 wait complete. 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 -- 172.21.15.178:0/1807880877 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3090036b90 msgr2=0x7f3090039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 --2- 172.21.15.178:0/1807880877 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3090036b90 0x7f3090039050 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x564f5079e940 tx=0x7f31a8050f90 comp rx=0 tx=0).stop 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 -- 172.21.15.178:0/1807880877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507b1c10 msgr2=0x564f507b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 --2- 172.21.15.178:0/1807880877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507b1c10 0x564f507b2030 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x564f5079e8d0 tx=0x7f31b0018830 comp rx=0 tx=0).stop 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 -- 172.21.15.178:0/1807880877 shutdown_connections 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 --2- 172.21.15.178:0/1807880877 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3090036b90 0x7f3090039050 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 --2- 172.21.15.178:0/1807880877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f507b1c10 0x564f507b2030 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.131+0000 7f31ba011800 1 -- 172.21.15.178:0/1807880877 >> 172.21.15.178:0/1807880877 conn(0x564f507a6ba0 msgr2=0x564f507a9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 -- 172.21.15.178:0/1807880877 shutdown_connections 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 -- 172.21.15.178:0/1807880877 wait complete. 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564f507a0800 msgr2=0x564f507a2bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564f507a0800 0x564f507a2bf0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564f5069fe90 msgr2=0x564f5079df00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564f5069fe90 0x564f5079df00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f309c036b90 msgr2=0x7f309c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f309c036b90 0x7f309c039050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f31a0000f60 tx=0x7f31a00013f0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 msgr2=0x564f50796e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f50796e90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f31a800a520 tx=0x7f31a8002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 shutdown_connections 2024-09-21T09:03:17.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564f507a0800 0x564f507a2bf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564f5069fe90 0x564f5079df00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f309c036b90 0x7f309c039050 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 --2- 172.21.15.178:0/2628968120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f5069f550 0x564f50796e90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 >> 172.21.15.178:0/2628968120 conn(0x564f5069ade0 msgr2=0x564f507887f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 shutdown_connections 2024-09-21T09:03:17.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.132+0000 7f31ba011800 1 -- 172.21.15.178:0/2628968120 wait complete. 2024-09-21T09:03:17.142 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:17.142 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-21T09:03:17.142 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-21T09:03:17.143 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-21T09:03:17.188 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:17.188 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:17.189 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.187+0000 7f02a37af800 1 Processor -- start 2024-09-21T09:03:17.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.187+0000 7f02a37af800 1 -- start start 2024-09-21T09:03:17.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.187+0000 7f02a37af800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55a37f748550 0x55a37f748950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.187+0000 7f02a37af800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a37f608b30 con 0x55a37f748e90 2024-09-21T09:03:17.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.187+0000 7f02a37af800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55a37f5ea360 con 0x55a37f748550 2024-09-21T09:03:17.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.188+0000 7f02a12a3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55a37f748550 0x55a37f748950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.188+0000 7f02a12a3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55a37f748550 0x55a37f748950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42178/0 (socket says 172.21.15.178:42178) 2024-09-21T09:03:17.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.188+0000 7f02a12a3640 1 -- 172.21.15.178:0/3170026375 learned_addr learned my addr 172.21.15.178:0/3170026375 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.188+0000 7f02a12a3640 1 -- 172.21.15.178:0/3170026375 >> v1:172.21.15.44:6789/0 conn(0x55a37f748e90 legacy=0x55a37f74da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.188+0000 7f02a12a3640 1 -- 172.21.15.178:0/3170026375 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a37f610e00 con 0x55a37f748550 2024-09-21T09:03:17.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.188+0000 7f02a0aa2640 1 -- 172.21.15.178:0/3170026375 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958911005 0 0) 0x55a37f608b30 con 0x55a37f748e90 2024-09-21T09:03:17.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.190+0000 7f02a12a3640 1 --2- 172.21.15.178:0/3170026375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f748950 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f029400a520 tx=0x7f0294045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3e4e93c039ea76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.190+0000 7f02a0aa2640 1 -- 172.21.15.178:0/3170026375 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0294055070 con 0x55a37f748550 2024-09-21T09:03:17.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.190+0000 7f02a0aa2640 1 -- 172.21.15.178:0/3170026375 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02940515b0 con 0x55a37f748550 2024-09-21T09:03:17.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.190+0000 7f02a0aa2640 1 -- 172.21.15.178:0/3170026375 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02940518d0 con 0x55a37f748550 2024-09-21T09:03:17.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.190+0000 7f02a37af800 1 -- 172.21.15.178:0/3170026375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 msgr2=0x55a37f748950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.190+0000 7f02a37af800 1 --2- 172.21.15.178:0/3170026375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f748950 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f029400a520 tx=0x7f0294045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.190+0000 7f02a37af800 1 -- 172.21.15.178:0/3170026375 shutdown_connections 2024-09-21T09:03:17.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.190+0000 7f02a37af800 1 --2- 172.21.15.178:0/3170026375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f748950 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.190+0000 7f02a37af800 1 -- 172.21.15.178:0/3170026375 >> 172.21.15.178:0/3170026375 conn(0x55a37f743de0 msgr2=0x55a37f746200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.190+0000 7f02a37af800 1 -- 172.21.15.178:0/3170026375 shutdown_connections 2024-09-21T09:03:17.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.190+0000 7f02a37af800 1 -- 172.21.15.178:0/3170026375 wait complete. 2024-09-21T09:03:17.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.204+0000 7f02a37af800 1 Processor -- start 2024-09-21T09:03:17.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.204+0000 7f02a37af800 1 -- start start 2024-09-21T09:03:17.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.204+0000 7f02a37af800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f6bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.204+0000 7f02a37af800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a37f695330 con 0x55a37f748550 2024-09-21T09:03:17.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.204+0000 7f02a12a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f6bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.204+0000 7f02a12a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f6bd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42194/0 (socket says 172.21.15.178:42194) 2024-09-21T09:03:17.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.204+0000 7f02a12a3640 1 -- 172.21.15.178:0/2966457379 learned_addr learned my addr 172.21.15.178:0/2966457379 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.205+0000 7f02a12a3640 1 -- 172.21.15.178:0/2966457379 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a37f5e2bc0 con 0x55a37f748550 2024-09-21T09:03:17.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.205+0000 7f02a12a3640 1 --2- 172.21.15.178:0/2966457379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f6bd5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0294000c00 tx=0x7f0294051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8740a9b6af8bc888 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.205+0000 7f018f606640 1 -- 172.21.15.178:0/2966457379 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02940519d0 con 0x55a37f748550 2024-09-21T09:03:17.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.205+0000 7f018f606640 1 -- 172.21.15.178:0/2966457379 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0294051b70 con 0x55a37f748550 2024-09-21T09:03:17.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.205+0000 7f018f606640 1 -- 172.21.15.178:0/2966457379 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0294051e50 con 0x55a37f748550 2024-09-21T09:03:17.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.206+0000 7f02a37af800 1 -- 172.21.15.178:0/2966457379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 msgr2=0x55a37f6bd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.206+0000 7f02a37af800 1 --2- 172.21.15.178:0/2966457379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f6bd5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0294000c00 tx=0x7f0294051000 comp rx=0 tx=0).stop 2024-09-21T09:03:17.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.206+0000 7f02a37af800 1 -- 172.21.15.178:0/2966457379 shutdown_connections 2024-09-21T09:03:17.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.206+0000 7f02a37af800 1 --2- 172.21.15.178:0/2966457379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f6bd5a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.206+0000 7f02a37af800 1 -- 172.21.15.178:0/2966457379 >> 172.21.15.178:0/2966457379 conn(0x55a37f743de0 msgr2=0x55a37f832f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.206+0000 7f02a37af800 1 -- 172.21.15.178:0/2966457379 shutdown_connections 2024-09-21T09:03:17.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.206+0000 7f02a37af800 1 -- 172.21.15.178:0/2966457379 wait complete. 2024-09-21T09:03:17.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.206+0000 7f02a37af800 1 Processor -- start 2024-09-21T09:03:17.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.206+0000 7f02a37af800 1 -- start start 2024-09-21T09:03:17.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.206+0000 7f02a37af800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f83fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.206+0000 7f02a37af800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a37f74f570 con 0x55a37f748550 2024-09-21T09:03:17.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.207+0000 7f02a12a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f83fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.207+0000 7f02a12a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f83fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42196/0 (socket says 172.21.15.178:42196) 2024-09-21T09:03:17.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.207+0000 7f02a12a3640 1 -- 172.21.15.178:0/174108475 learned_addr learned my addr 172.21.15.178:0/174108475 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.207+0000 7f02a12a3640 1 -- 172.21.15.178:0/174108475 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a37f5f6fe0 con 0x55a37f748550 2024-09-21T09:03:17.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.207+0000 7f02a12a3640 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f83fe90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f029400a520 tx=0x7f0294002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.208+0000 7f018de03640 1 -- 172.21.15.178:0/174108475 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0294073070 con 0x55a37f748550 2024-09-21T09:03:17.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.208+0000 7f018de03640 1 -- 172.21.15.178:0/174108475 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f029405a580 con 0x55a37f748550 2024-09-21T09:03:17.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.208+0000 7f018de03640 1 -- 172.21.15.178:0/174108475 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f029405a8a0 con 0x55a37f748550 2024-09-21T09:03:17.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.208+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a37f8403d0 con 0x55a37f748550 2024-09-21T09:03:17.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.208+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a37f840950 con 0x55a37f748550 2024-09-21T09:03:17.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.208+0000 7f018de03640 1 -- 172.21.15.178:0/174108475 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0294076070 con 0x55a37f748550 2024-09-21T09:03:17.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.209+0000 7f018de03640 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0188036b90 0x7f0188039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.209+0000 7f018de03640 1 -- 172.21.15.178:0/174108475 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f0294062070 con 0x55a37f748550 2024-09-21T09:03:17.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.209+0000 7f029bfff640 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0188036b90 0x7f0188039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.209+0000 7f02a37af800 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a37f748e90 0x55a37f846f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.209+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f847500 con 0x55a37f748e90 2024-09-21T09:03:17.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.209+0000 7f02a1aa4640 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a37f748e90 0x55a37f846f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.209+0000 7f029bfff640 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0188036b90 0x7f0188039050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f028c000f60 tx=0x7f028c0013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.209+0000 7f02a1aa4640 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a37f748e90 0x55a37f846f00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.209+0000 7f02a1aa4640 1 -- 172.21.15.178:0/174108475 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f029c00a4a0 con 0x55a37f748e90 2024-09-21T09:03:17.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.209+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f844490 con 0x55a37f748e90 2024-09-21T09:03:17.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.210+0000 7f02a1aa4640 1 -- 172.21.15.178:0/174108475 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f029c00a4a0 con 0x55a37f748e90 2024-09-21T09:03:17.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.210+0000 7f02a37af800 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a37f849810 0x55a37f84bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.210+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f84c2a0 con 0x55a37f849810 2024-09-21T09:03:17.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.210+0000 7f02a12a3640 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a37f849810 0x55a37f84bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.210+0000 7f02a12a3640 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a37f849810 0x55a37f84bc00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.211+0000 7f02a12a3640 1 -- 172.21.15.178:0/174108475 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f029407f070 con 0x55a37f849810 2024-09-21T09:03:17.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.211+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f8486b0 con 0x55a37f748e90 2024-09-21T09:03:17.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.211+0000 7f02a1aa4640 1 -- 172.21.15.178:0/174108475 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f029c00a4a0 con 0x55a37f748e90 2024-09-21T09:03:17.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.211+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f848b10 con 0x55a37f748e90 2024-09-21T09:03:17.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.211+0000 7f02a1aa4640 1 -- 172.21.15.178:0/174108475 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f029c00a4a0 con 0x55a37f748e90 2024-09-21T09:03:17.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.211+0000 7f02a37af800 1 Processor -- start 2024-09-21T09:03:17.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.212+0000 7f02a37af800 1 -- start start 2024-09-21T09:03:17.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.212+0000 7f02a37af800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f838da0 0x55a37f8373f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.212+0000 7f02a37af800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a37f5e4580 con 0x55a37f838da0 2024-09-21T09:03:17.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.212+0000 7f02a1aa4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f838da0 0x55a37f8373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.212+0000 7f02a1aa4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f838da0 0x55a37f8373f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42202/0 (socket says 172.21.15.178:42202) 2024-09-21T09:03:17.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.212+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1966275308 learned_addr learned my addr 172.21.15.178:0/1966275308 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.212+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1966275308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a37f8391c0 con 0x55a37f838da0 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.212+0000 7f02a1aa4640 1 --2- 172.21.15.178:0/1966275308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f838da0 0x55a37f8373f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55a37f8478e0 tx=0x7f029c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.212+0000 7f0186ffd640 1 -- 172.21.15.178:0/1966275308 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f029c014450 con 0x55a37f838da0 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.212+0000 7f0186ffd640 1 -- 172.21.15.178:0/1966275308 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f029c014610 con 0x55a37f838da0 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.212+0000 7f0186ffd640 1 -- 172.21.15.178:0/1966275308 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f029c014930 con 0x55a37f838da0 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.212+0000 7f02a37af800 1 -- 172.21.15.178:0/1966275308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a37f8379f0 con 0x55a37f838da0 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.213+0000 7f02a37af800 1 -- 172.21.15.178:0/1966275308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a37f837ef0 con 0x55a37f838da0 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.213+0000 7f0186ffd640 1 -- 172.21.15.178:0/1966275308 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f029c011040 con 0x55a37f838da0 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.213+0000 7f0186ffd640 1 --2- 172.21.15.178:0/1966275308 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f017c036b90 0x7f017c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.213+0000 7f0186ffd640 1 -- 172.21.15.178:0/1966275308 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f029c01e070 con 0x55a37f838da0 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.214+0000 7f02a12a3640 1 --2- 172.21.15.178:0/1966275308 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f017c036b90 0x7f017c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.214+0000 7f02a37af800 1 Processor -- start 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.214+0000 7f02a12a3640 1 --2- 172.21.15.178:0/1966275308 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f017c036b90 0x7f017c039050 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55a37f847910 tx=0x7f0294050f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.214+0000 7f02a37af800 1 -- start start 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.214+0000 7f02a37af800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f869a90 0x55a37f869e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.214+0000 7f02a37af800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a37f83b4e0 con 0x55a37f869a90 2024-09-21T09:03:17.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.214+0000 7f02a1aa4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f869a90 0x55a37f869e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.214+0000 7f02a1aa4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f869a90 0x55a37f869e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42206/0 (socket says 172.21.15.178:42206) 2024-09-21T09:03:17.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.214+0000 7f02a1aa4640 1 -- 172.21.15.178:0/2917704920 learned_addr learned my addr 172.21.15.178:0/2917704920 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.215+0000 7f02a1aa4640 1 -- 172.21.15.178:0/2917704920 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a37f86a460 con 0x55a37f869a90 2024-09-21T09:03:17.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.215+0000 7f02a1aa4640 1 --2- 172.21.15.178:0/2917704920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f869a90 0x55a37f869e90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f029c04cb90 tx=0x7f029c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7105277fceb5a72d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.215+0000 7f0184ff9640 1 -- 172.21.15.178:0/2917704920 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f029c044070 con 0x55a37f869a90 2024-09-21T09:03:17.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.215+0000 7f0184ff9640 1 -- 172.21.15.178:0/2917704920 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f029c013c90 con 0x55a37f869a90 2024-09-21T09:03:17.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.215+0000 7f0184ff9640 1 -- 172.21.15.178:0/2917704920 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f029c014ad0 con 0x55a37f869a90 2024-09-21T09:03:17.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.215+0000 7f02a37af800 1 -- 172.21.15.178:0/2917704920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f869a90 msgr2=0x55a37f869e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.215+0000 7f02a37af800 1 --2- 172.21.15.178:0/2917704920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f869a90 0x55a37f869e90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f029c04cb90 tx=0x7f029c011700 comp rx=0 tx=0).stop 2024-09-21T09:03:17.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.215+0000 7f02a37af800 1 -- 172.21.15.178:0/2917704920 shutdown_connections 2024-09-21T09:03:17.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.215+0000 7f02a37af800 1 --2- 172.21.15.178:0/2917704920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f869a90 0x55a37f869e90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.215+0000 7f02a37af800 1 -- 172.21.15.178:0/2917704920 >> 172.21.15.178:0/2917704920 conn(0x55a37f865df0 msgr2=0x55a37f863ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.215+0000 7f02a37af800 1 -- 172.21.15.178:0/2917704920 shutdown_connections 2024-09-21T09:03:17.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.215+0000 7f02a37af800 1 -- 172.21.15.178:0/2917704920 wait complete. 2024-09-21T09:03:17.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.216+0000 7f02a37af800 1 Processor -- start 2024-09-21T09:03:17.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.216+0000 7f02a37af800 1 -- start start 2024-09-21T09:03:17.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.216+0000 7f02a37af800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f869a90 0x55a37f870f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.216+0000 7f02a37af800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a37f86aa20 con 0x55a37f869a90 2024-09-21T09:03:17.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.216+0000 7f02a1aa4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f869a90 0x55a37f870f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.216+0000 7f02a1aa4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f869a90 0x55a37f870f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42220/0 (socket says 172.21.15.178:42220) 2024-09-21T09:03:17.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.216+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 learned_addr learned my addr 172.21.15.178:0/1889394082 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.216+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a37f8714b0 con 0x55a37f869a90 2024-09-21T09:03:17.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.217+0000 7f02a1aa4640 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f869a90 0x55a37f870f70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f029c016ad0 tx=0x7f029c04cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.217+0000 7f0172ffd640 1 -- 172.21.15.178:0/1889394082 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f029c016440 con 0x55a37f869a90 2024-09-21T09:03:17.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.217+0000 7f0172ffd640 1 -- 172.21.15.178:0/1889394082 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f029c013e40 con 0x55a37f869a90 2024-09-21T09:03:17.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.217+0000 7f0172ffd640 1 -- 172.21.15.178:0/1889394082 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f029c02b4e0 con 0x55a37f869a90 2024-09-21T09:03:17.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.217+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a37f871740 con 0x55a37f869a90 2024-09-21T09:03:17.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.217+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a37f8743f0 con 0x55a37f869a90 2024-09-21T09:03:17.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.217+0000 7f0172ffd640 1 -- 172.21.15.178:0/1889394082 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f029c03e020 con 0x55a37f869a90 2024-09-21T09:03:17.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.218+0000 7f0172ffd640 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f016c036b40 0x7f016c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.218+0000 7f0172ffd640 1 -- 172.21.15.178:0/1889394082 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f029c03c020 con 0x55a37f869a90 2024-09-21T09:03:17.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.218+0000 7f02a12a3640 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f016c036b40 0x7f016c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.218+0000 7f02a12a3640 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f016c036b40 0x7f016c039000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f029408f570 tx=0x7f0294089000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.218+0000 7f02a37af800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.218+0000 7f02a37af800 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a37f87cc20 0x55a37f87f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.218+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f87f830 con 0x55a37f87cc20 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.218+0000 7f029bfff640 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a37f87cc20 0x55a37f87f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f029bfff640 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a37f87cc20 0x55a37f87f0e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f028c010510 con 0x55a37f87cc20 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f02a37af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f02a37af800 20 realm 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f02a37af800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f87c070 con 0x55a37f87cc20 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f028c010510 con 0x55a37f87cc20 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f02a37af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f02a37af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f02a37af800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f880320 con 0x55a37f87cc20 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f028c010510 con 0x55a37f87cc20 2024-09-21T09:03:17.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f02a37af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f02a37af800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.219+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f880bf0 con 0x55a37f87cc20 2024-09-21T09:03:17.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.220+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f028c010510 con 0x55a37f87cc20 2024-09-21T09:03:17.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.220+0000 7f02a37af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.220+0000 7f02a37af800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.220+0000 7f02a37af800 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a37f881610 0x55a37f883a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.220+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f881610 2024-09-21T09:03:17.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.220+0000 7f02a1aa4640 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a37f881610 0x55a37f883a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.220+0000 7f02a1aa4640 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a37f881610 0x55a37f883a00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.221+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.221+0000 7f02a37af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:17.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.221+0000 7f02a37af800 20 searching for the correct realm 2024-09-21T09:03:17.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.221+0000 7f02a37af800 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a37f8860d0 0x55a37f888590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.221+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f888c60 con 0x55a37f8860d0 2024-09-21T09:03:17.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.221+0000 7f02a12a3640 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a37f8860d0 0x55a37f888590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.221+0000 7f02a12a3640 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a37f8860d0 0x55a37f888590 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.221+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029407f070 con 0x55a37f8860d0 2024-09-21T09:03:17.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.221+0000 7f02a12a3640 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f0294078070 0x7f0294068120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.221+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f888c60 con 0x7f0294078070 2024-09-21T09:03:17.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.222+0000 7f029bfff640 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f0294078070 0x7f0294068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.222+0000 7f029bfff640 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f0294078070 0x7f0294068120 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.222+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f028c010510 con 0x7f0294078070 2024-09-21T09:03:17.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.222+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f888c60 con 0x55a37f881610 2024-09-21T09:03:17.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.222+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.222+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f87cc20 2024-09-21T09:03:17.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.223+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f028c010510 con 0x55a37f87cc20 2024-09-21T09:03:17.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.223+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f87cc20 2024-09-21T09:03:17.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.223+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.223+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f881610 2024-09-21T09:03:17.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.223+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.223+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f881610 2024-09-21T09:03:17.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.223+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.223+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x7f0294078070 2024-09-21T09:03:17.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.224+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f028c02a040 con 0x7f0294078070 2024-09-21T09:03:17.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.224+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f8860d0 2024-09-21T09:03:17.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.224+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029407f070 con 0x55a37f8860d0 2024-09-21T09:03:17.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.224+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f87cc20 2024-09-21T09:03:17.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.224+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.224+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f881610 2024-09-21T09:03:17.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.224+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.224+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f87cc20 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.225+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.225+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x7f0294078070 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.225+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f028c02a040 con 0x7f0294078070 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.225+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f8860d0 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.225+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029407f070 con 0x55a37f8860d0 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.225+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f8860d0 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.225+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029407f070 con 0x55a37f8860d0 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.225+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f881610 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.226+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.226+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f8860d0 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.226+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029407f070 con 0x55a37f8860d0 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.226+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f8860d0 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.226+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029407f070 con 0x55a37f8860d0 2024-09-21T09:03:17.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.226+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f87cc20 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.226+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.226+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f87cc20 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.226+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.227+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f881610 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.227+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.227+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f8860d0 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.227+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029407f070 con 0x55a37f8860d0 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.227+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x7f0294078070 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.227+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f028c02a040 con 0x7f0294078070 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.227+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f87cc20 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.227+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.227+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f881610 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.228+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.228+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f8860d0 2024-09-21T09:03:17.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.228+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029407f070 con 0x55a37f8860d0 2024-09-21T09:03:17.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.228+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f881610 2024-09-21T09:03:17.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.228+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.228+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x7f0294078070 2024-09-21T09:03:17.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.229+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f028c02a040 con 0x7f0294078070 2024-09-21T09:03:17.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.229+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f8860d0 2024-09-21T09:03:17.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.229+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029407f070 con 0x55a37f8860d0 2024-09-21T09:03:17.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.229+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f881610 2024-09-21T09:03:17.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.229+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.229+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x55a37f87cc20 2024-09-21T09:03:17.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884140 con 0x7f0294078070 2024-09-21T09:03:17.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f028c02a040 con 0x7f0294078070 2024-09-21T09:03:17.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f02a37af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:17.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f02a37af800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f02a37af800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f02a37af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f02a37af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f02a37af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f02a37af800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f8844e0 con 0x55a37f87cc20 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f02a37af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f02a37af800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f8848d0 con 0x55a37f87cc20 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f02a37af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f02a37af800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.230+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f884cf0 con 0x55a37f87cc20 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 20 zone default found 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 4 Realm: () 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 20 zonegroup default 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f8890e0 con 0x55a37f881610 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88ae60 con 0x55a37f8860d0 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f029407f070 con 0x55a37f8860d0 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.231+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88b2c0 con 0x55a37f8860d0 2024-09-21T09:03:17.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.232+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f029407f070 con 0x55a37f8860d0 2024-09-21T09:03:17.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.232+0000 7f02a37af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.232+0000 7f02a37af800 20 started sync module instance, tier type = 2024-09-21T09:03:17.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.232+0000 7f02a37af800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:17.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.232+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88a300 con 0x7f0294078070 2024-09-21T09:03:17.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.233+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x7f0294078070 2024-09-21T09:03:17.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.233+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94160707692576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88a300 con 0x7f0294078070 2024-09-21T09:03:17.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.233+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88be10 con 0x55a37f87cc20 2024-09-21T09:03:17.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.233+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94160707692576] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x7f0294078070 2024-09-21T09:03:17.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.234+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.234+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94160707696864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88a300 con 0x55a37f87cc20 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.234+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88c880 con 0x55a37f8860d0 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.235+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94160707696864] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.235+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f029407f070 con 0x55a37f8860d0 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.235+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94160707690064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88a270 con 0x55a37f8860d0 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.235+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88d640 con 0x7f0294078070 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.236+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94160707690064] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f029407f070 con 0x55a37f8860d0 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.236+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x7f0294078070 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.236+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94160707701920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88da60 con 0x7f0294078070 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.236+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88e480 con 0x55a37f87cc20 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.237+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.237+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94160707706736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88e440 con 0x55a37f87cc20 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.237+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88f3c0 con 0x55a37f881610 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.237+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94160707701920] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x7f0294078070 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.238+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94160707706736] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.238+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.238+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94160707710704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88f3c0 con 0x55a37f881610 2024-09-21T09:03:17.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.238+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88fc60 con 0x55a37f881610 2024-09-21T09:03:17.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.239+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94160707710704] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.240+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.240+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94160707709040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88f3c0 con 0x55a37f881610 2024-09-21T09:03:17.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.240+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f890300 con 0x55a37f881610 2024-09-21T09:03:17.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.240+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.240+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94160707714512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f890770 con 0x55a37f881610 2024-09-21T09:03:17.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.240+0000 7f02a37af800 20 add_watcher() i=0 2024-09-21T09:03:17.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.240+0000 7f02a37af800 20 add_watcher() i=1 2024-09-21T09:03:17.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.240+0000 7f02a37af800 20 add_watcher() i=2 2024-09-21T09:03:17.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.240+0000 7f02a37af800 20 add_watcher() i=3 2024-09-21T09:03:17.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.240+0000 7f02a37af800 20 add_watcher() i=4 2024-09-21T09:03:17.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.240+0000 7f02a37af800 20 add_watcher() i=5 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.241+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94160707709040] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.241+0000 7f02a37af800 20 add_watcher() i=6 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.241+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94160707714512] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.241+0000 7f02a37af800 20 add_watcher() i=7 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.241+0000 7f02a37af800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.241+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88f7b0 con 0x55a37f87cc20 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.242+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.242+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94160707715776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88f7b0 con 0x55a37f87cc20 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.242+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94160707715776] v29'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.243+0000 7f01577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.243+0000 7f02a37af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.243+0000 7f02a37af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.243+0000 7f02a37af800 5 note: GC not initialized 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.243+0000 7f01567e4640 20 reqs_thread_entry: start 2024-09-21T09:03:17.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.243+0000 7f02a37af800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.243+0000 7f02a37af800 20 Filter name: none 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.243+0000 7f00c7fff640 20 reqs_thread_entry: start 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.243+0000 7f02a37af800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.243+0000 7f02a37af800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.243+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f8c6cb0 con 0x55a37f87cc20 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.244+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.244+0000 7f02a37af800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.244+0000 7f02a37af800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.244+0000 7f02a37af800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.244+0000 7f02a37af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.244+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f8c6790 con 0x7f0294078070 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.244+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x7f0294078070 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.244+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f8ccf40 con 0x55a37f87cc20 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.245+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v29'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.245+0000 7f02a37af800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:17.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.245+0000 7f02a37af800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:17.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.245+0000 7f02a37af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:17.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.245+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94160707963856 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a37f8c9c60 con 0x55a37f87cc20 2024-09-21T09:03:17.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.245+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify (1) cookie 94160707706736 notify 124554051585 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f028c03e720 con 0x55a37f87cc20 2024-09-21T09:03:17.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.245+0000 7f0184ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051585 cookie 94160707706736 notifier 4315 bl.length()=567 2024-09-21T09:03:17.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.245+0000 7f0184ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:17.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.245+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(65 notify.4 [notify cookie 94160707963856 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.245+0000 7f0184ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:17.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.245+0000 7f0184ff9640 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f0164003ea0 con 0x55a37f87cc20 2024-09-21T09:03:17.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.246+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.246+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== watch-notify(notify_complete (2) cookie 94160707963856 notify 124554051585 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f028c03e8f0 con 0x55a37f87cc20 2024-09-21T09:03:17.252 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:17.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.246+0000 7f01577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.247+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94160707715776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f8c4a00 con 0x55a37f87cc20 2024-09-21T09:03:17.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.247+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94160707715776] v29'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.247+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94160707692576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f8c4a00 con 0x7f0294078070 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.248+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94160707692576] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x7f0294078070 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.248+0000 7f02a37af800 20 remove_watcher() i=0 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.248+0000 7f02a37af800 2 removed watcher, disabling cache 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.248+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94160707696864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f8c4a00 con 0x55a37f87cc20 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.250+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94160707696864] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.250+0000 7f02a37af800 20 remove_watcher() i=1 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.250+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94160707690064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f8c4a00 con 0x55a37f8860d0 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.251+0000 7f02a12a3640 1 -- 172.21.15.178:0/1889394082 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94160707690064] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f029407f070 con 0x55a37f8860d0 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.251+0000 7f02a37af800 20 remove_watcher() i=2 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.251+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94160707701920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f889e50 con 0x7f0294078070 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.252+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94160707701920] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x7f0294078070 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.252+0000 7f02a37af800 20 remove_watcher() i=3 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.252+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94160707706736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88cca0 con 0x55a37f87cc20 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.253+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94160707706736] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f028c02a040 con 0x55a37f87cc20 2024-09-21T09:03:17.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.253+0000 7f02a37af800 20 remove_watcher() i=4 2024-09-21T09:03:17.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.253+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94160707710704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f889e50 con 0x55a37f881610 2024-09-21T09:03:17.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.254+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94160707710704] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.254+0000 7f02a37af800 20 remove_watcher() i=5 2024-09-21T09:03:17.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.254+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94160707709040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88df70 con 0x55a37f881610 2024-09-21T09:03:17.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.254+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94160707709040] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.255+0000 7f02a37af800 20 remove_watcher() i=6 2024-09-21T09:03:17.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.255+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94160707714512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a37f88cca0 con 0x55a37f881610 2024-09-21T09:03:17.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.255+0000 7f02a1aa4640 1 -- 172.21.15.178:0/1889394082 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94160707714512] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f029c02a070 con 0x55a37f881610 2024-09-21T09:03:17.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.255+0000 7f02a37af800 20 remove_watcher() i=7 2024-09-21T09:03:17.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a37f881610 msgr2=0x55a37f883a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a37f881610 0x55a37f883a00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a37f87cc20 msgr2=0x55a37f87f0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a37f87cc20 0x55a37f87f0e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f0294078070 msgr2=0x7f0294068120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f0294078070 0x7f0294068120 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a37f8860d0 msgr2=0x55a37f888590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a37f8860d0 0x55a37f888590 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f016c036b40 msgr2=0x7f016c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f016c036b40 0x7f016c039000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f029408f570 tx=0x7f0294089000 comp rx=0 tx=0).stop 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f869a90 msgr2=0x55a37f870f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 --2- 172.21.15.178:0/1889394082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f869a90 0x55a37f870f70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f029c016ad0 tx=0x7f029c04cb20 comp rx=0 tx=0).stop 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 reap_dead start 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f029bfff640 1 -- 172.21.15.178:0/1889394082 reap_dead start 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 shutdown_connections 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 >> 172.21.15.178:0/1889394082 conn(0x55a37f865df0 msgr2=0x55a37f863ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 shutdown_connections 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1889394082 wait complete. 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1966275308 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f017c036b90 msgr2=0x7f017c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 --2- 172.21.15.178:0/1966275308 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f017c036b90 0x7f017c039050 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55a37f847910 tx=0x7f0294050f90 comp rx=0 tx=0).stop 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1966275308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f838da0 msgr2=0x55a37f8373f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 --2- 172.21.15.178:0/1966275308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f838da0 0x55a37f8373f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55a37f8478e0 tx=0x7f029c018830 comp rx=0 tx=0).stop 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1966275308 shutdown_connections 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 --2- 172.21.15.178:0/1966275308 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f017c036b90 0x7f017c039050 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 --2- 172.21.15.178:0/1966275308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f838da0 0x55a37f8373f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1966275308 >> 172.21.15.178:0/1966275308 conn(0x55a37f84fbb0 msgr2=0x55a37f852730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1966275308 shutdown_connections 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/1966275308 wait complete. 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.256+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a37f849810 msgr2=0x55a37f84bc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a37f849810 0x55a37f84bc00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a37f748e90 msgr2=0x55a37f846f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a37f748e90 0x55a37f846f00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0188036b90 msgr2=0x7f0188039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0188036b90 0x7f0188039050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f028c000f60 tx=0x7f028c0013f0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 msgr2=0x55a37f83fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f83fe90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f029400a520 tx=0x7f0294002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 shutdown_connections 2024-09-21T09:03:17.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a37f849810 0x55a37f84bc00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a37f748e90 0x55a37f846f00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0188036b90 0x7f0188039050 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 --2- 172.21.15.178:0/174108475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a37f748550 0x55a37f83fe90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 >> 172.21.15.178:0/174108475 conn(0x55a37f743de0 msgr2=0x55a37f8317f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 shutdown_connections 2024-09-21T09:03:17.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.257+0000 7f02a37af800 1 -- 172.21.15.178:0/174108475 wait complete. 2024-09-21T09:03:17.267 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:17.267 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T09:03:17.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T09:03:17.267 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T09:03:17.311 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:17.311 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:17.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.310+0000 7ff4aec10800 1 Processor -- start 2024-09-21T09:03:17.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.311+0000 7ff4aec10800 1 -- start start 2024-09-21T09:03:17.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.311+0000 7ff4aec10800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5560f9cf1760 0x5560f9cf1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.311+0000 7ff4aec10800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5560f9bb0b30 con 0x5560f9cf20a0 2024-09-21T09:03:17.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.311+0000 7ff4aec10800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5560f9b92360 con 0x5560f9cf1760 2024-09-21T09:03:17.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.311+0000 7ff4aa3c6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5560f9cf1760 0x5560f9cf1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.311+0000 7ff4a3fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5560f9cf20a0 0x5560f9cf6ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46576/0 (socket says 172.21.15.178:46576) 2024-09-21T09:03:17.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.311+0000 7ff4a3fff640 1 -- 172.21.15.178:0/4188546409 learned_addr learned my addr 172.21.15.178:0/4188546409 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:17.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.311+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/4188546409 >> v1:172.21.15.44:6789/0 conn(0x5560f9cf20a0 legacy=0x5560f9cf6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.311+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/4188546409 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f9bb8e00 con 0x5560f9cf1760 2024-09-21T09:03:17.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.311+0000 7ff4a9bc5640 1 -- 172.21.15.178:0/4188546409 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578880002 0 0) 0x5560f9bb0b30 con 0x5560f9cf20a0 2024-09-21T09:03:17.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.313+0000 7ff4aa3c6640 1 --2- 172.21.15.178:0/4188546409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9cf1b60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00a470 tx=0x7ff49c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec94e43293dedb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.313+0000 7ff4a9bc5640 1 -- 172.21.15.178:0/4188546409 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49c053570 con 0x5560f9cf1760 2024-09-21T09:03:17.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.313+0000 7ff4a9bc5640 1 -- 172.21.15.178:0/4188546409 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49c058070 con 0x5560f9cf1760 2024-09-21T09:03:17.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.313+0000 7ff4a9bc5640 1 -- 172.21.15.178:0/4188546409 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49c053880 con 0x5560f9cf1760 2024-09-21T09:03:17.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.314+0000 7ff4aec10800 1 -- 172.21.15.178:0/4188546409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 msgr2=0x5560f9cf1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.314+0000 7ff4aec10800 1 --2- 172.21.15.178:0/4188546409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9cf1b60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00a470 tx=0x7ff49c045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:17.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.314+0000 7ff4aec10800 1 -- 172.21.15.178:0/4188546409 shutdown_connections 2024-09-21T09:03:17.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.314+0000 7ff4aec10800 1 --2- 172.21.15.178:0/4188546409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9cf1b60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.314+0000 7ff4aec10800 1 -- 172.21.15.178:0/4188546409 >> 172.21.15.178:0/4188546409 conn(0x5560f9cecff0 msgr2=0x5560f9cef410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.314+0000 7ff4aec10800 1 -- 172.21.15.178:0/4188546409 shutdown_connections 2024-09-21T09:03:17.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.314+0000 7ff4aec10800 1 -- 172.21.15.178:0/4188546409 wait complete. 2024-09-21T09:03:17.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.327+0000 7ff4aec10800 1 Processor -- start 2024-09-21T09:03:17.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.327+0000 7ff4aec10800 1 -- start start 2024-09-21T09:03:17.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.327+0000 7ff4aec10800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9de06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.328+0000 7ff4aec10800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5560f9c3d330 con 0x5560f9cf1760 2024-09-21T09:03:17.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.328+0000 7ff4aa3c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9de06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.328+0000 7ff4aa3c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9de06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42246/0 (socket says 172.21.15.178:42246) 2024-09-21T09:03:17.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.328+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/3510015765 learned_addr learned my addr 172.21.15.178:0/3510015765 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.328+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/3510015765 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f9b8abc0 con 0x5560f9cf1760 2024-09-21T09:03:17.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.328+0000 7ff4aa3c6640 1 --2- 172.21.15.178:0/3510015765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9de06c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff49c005870 tx=0x7ff49c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd73761818fb69a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.328+0000 7ff398608640 1 -- 172.21.15.178:0/3510015765 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49c05c580 con 0x5560f9cf1760 2024-09-21T09:03:17.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.328+0000 7ff398608640 1 -- 172.21.15.178:0/3510015765 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49c063030 con 0x5560f9cf1760 2024-09-21T09:03:17.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.328+0000 7ff398608640 1 -- 172.21.15.178:0/3510015765 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49c05c850 con 0x5560f9cf1760 2024-09-21T09:03:17.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.329+0000 7ff4aec10800 1 -- 172.21.15.178:0/3510015765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 msgr2=0x5560f9de06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.329+0000 7ff4aec10800 1 --2- 172.21.15.178:0/3510015765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9de06c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff49c005870 tx=0x7ff49c051000 comp rx=0 tx=0).stop 2024-09-21T09:03:17.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.329+0000 7ff4aec10800 1 -- 172.21.15.178:0/3510015765 shutdown_connections 2024-09-21T09:03:17.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.329+0000 7ff4aec10800 1 --2- 172.21.15.178:0/3510015765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9de06c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.329+0000 7ff4aec10800 1 -- 172.21.15.178:0/3510015765 >> 172.21.15.178:0/3510015765 conn(0x5560f9cecff0 msgr2=0x5560f9ddc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.329+0000 7ff4aec10800 1 -- 172.21.15.178:0/3510015765 shutdown_connections 2024-09-21T09:03:17.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.329+0000 7ff4aec10800 1 -- 172.21.15.178:0/3510015765 wait complete. 2024-09-21T09:03:17.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.329+0000 7ff4aec10800 1 Processor -- start 2024-09-21T09:03:17.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.330+0000 7ff4aec10800 1 -- start start 2024-09-21T09:03:17.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.330+0000 7ff4aec10800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9de7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.330+0000 7ff4aec10800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5560f9cf8640 con 0x5560f9cf1760 2024-09-21T09:03:17.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.330+0000 7ff4aa3c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9de7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.330+0000 7ff4aa3c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9de7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42256/0 (socket says 172.21.15.178:42256) 2024-09-21T09:03:17.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.330+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/4198775431 learned_addr learned my addr 172.21.15.178:0/4198775431 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.330+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/4198775431 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f9b9efe0 con 0x5560f9cf1760 2024-09-21T09:03:17.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.331+0000 7ff4aa3c6640 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9de7fa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff49c045f50 tx=0x7ff49c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.331+0000 7ff396e05640 1 -- 172.21.15.178:0/4198775431 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49c078070 con 0x5560f9cf1760 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.331+0000 7ff396e05640 1 -- 172.21.15.178:0/4198775431 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49c054a70 con 0x5560f9cf1760 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.331+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560f9de84e0 con 0x5560f9cf1760 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.331+0000 7ff396e05640 1 -- 172.21.15.178:0/4198775431 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49c054d50 con 0x5560f9cf1760 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.331+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f9de8a60 con 0x5560f9cf1760 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.331+0000 7ff396e05640 1 -- 172.21.15.178:0/4198775431 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff49c07b070 con 0x5560f9cf1760 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.332+0000 7ff396e05640 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff390036b90 0x7ff390039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.332+0000 7ff396e05640 1 -- 172.21.15.178:0/4198775431 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff49c070070 con 0x5560f9cf1760 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.332+0000 7ff4a3fff640 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff390036b90 0x7ff390039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.332+0000 7ff4aec10800 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5560f9cf20a0 0x5560f9def010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.332+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9def5e0 con 0x5560f9cf20a0 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.332+0000 7ff4aabc7640 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5560f9cf20a0 0x5560f9def010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.332+0000 7ff4a3fff640 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff390036b90 0x7ff390039050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff494000c00 tx=0x7ff4940013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.332+0000 7ff4aabc7640 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5560f9cf20a0 0x5560f9def010 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.333+0000 7ff4aabc7640 1 -- 172.21.15.178:0/4198775431 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4a400a4a0 con 0x5560f9cf20a0 2024-09-21T09:03:17.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.333+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9dec5c0 con 0x5560f9cf20a0 2024-09-21T09:03:17.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.333+0000 7ff4aabc7640 1 -- 172.21.15.178:0/4198775431 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff4a400a4a0 con 0x5560f9cf20a0 2024-09-21T09:03:17.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.333+0000 7ff4aec10800 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5560f9df18d0 0x5560f9df3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.333+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9df43b0 con 0x5560f9df18d0 2024-09-21T09:03:17.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.333+0000 7ff4aa3c6640 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5560f9df18d0 0x5560f9df3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.333+0000 7ff4aa3c6640 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5560f9df18d0 0x5560f9df3cc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.334+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/4198775431 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9df18d0 2024-09-21T09:03:17.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.334+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9df0770 con 0x5560f9cf20a0 2024-09-21T09:03:17.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.334+0000 7ff4aabc7640 1 -- 172.21.15.178:0/4198775431 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff4a400a4a0 con 0x5560f9cf20a0 2024-09-21T09:03:17.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.334+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9df0c50 con 0x5560f9cf20a0 2024-09-21T09:03:17.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.334+0000 7ff4aabc7640 1 -- 172.21.15.178:0/4198775431 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff4a400a4a0 con 0x5560f9cf20a0 2024-09-21T09:03:17.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.335+0000 7ff4aec10800 1 Processor -- start 2024-09-21T09:03:17.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.335+0000 7ff4aec10800 1 -- start start 2024-09-21T09:03:17.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.335+0000 7ff4aec10800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9c67740 0x5560f9c65d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.335+0000 7ff4aec10800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5560f9b8c580 con 0x5560f9c67740 2024-09-21T09:03:17.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.335+0000 7ff4aabc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9c67740 0x5560f9c65d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.335+0000 7ff4aabc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9c67740 0x5560f9c65d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42260/0 (socket says 172.21.15.178:42260) 2024-09-21T09:03:17.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.335+0000 7ff4aabc7640 1 -- 172.21.15.178:0/2739457607 learned_addr learned my addr 172.21.15.178:0/2739457607 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.335+0000 7ff4aabc7640 1 -- 172.21.15.178:0/2739457607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f9c67b60 con 0x5560f9c67740 2024-09-21T09:03:17.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.335+0000 7ff4aabc7640 1 --2- 172.21.15.178:0/2739457607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9c67740 0x5560f9c65d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x5560f9def9a0 tx=0x7ff4a4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.336+0000 7ff38ffff640 1 -- 172.21.15.178:0/2739457607 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a4014450 con 0x5560f9c67740 2024-09-21T09:03:17.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.336+0000 7ff38ffff640 1 -- 172.21.15.178:0/2739457607 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a4014610 con 0x5560f9c67740 2024-09-21T09:03:17.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.336+0000 7ff4aec10800 1 -- 172.21.15.178:0/2739457607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560f9c66390 con 0x5560f9c67740 2024-09-21T09:03:17.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.336+0000 7ff38ffff640 1 -- 172.21.15.178:0/2739457607 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a4014930 con 0x5560f9c67740 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.336+0000 7ff4aec10800 1 -- 172.21.15.178:0/2739457607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f9c66890 con 0x5560f9c67740 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.336+0000 7ff38ffff640 1 -- 172.21.15.178:0/2739457607 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff4a4011040 con 0x5560f9c67740 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.337+0000 7ff38ffff640 1 --2- 172.21.15.178:0/2739457607 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff384036b90 0x7ff384039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.337+0000 7ff38ffff640 1 -- 172.21.15.178:0/2739457607 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff4a401e070 con 0x5560f9c67740 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.337+0000 7ff4aa3c6640 1 --2- 172.21.15.178:0/2739457607 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff384036b90 0x7ff384039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.337+0000 7ff4aec10800 1 Processor -- start 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.337+0000 7ff4aec10800 1 -- start start 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.337+0000 7ff4aa3c6640 1 --2- 172.21.15.178:0/2739457607 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff384036b90 0x7ff384039050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x5560f9defa40 tx=0x7ff49c054f70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.337+0000 7ff4aec10800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9e11b90 0x5560f9e11f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.337+0000 7ff4aec10800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5560f9de0e10 con 0x5560f9e11b90 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.337+0000 7ff4aabc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9e11b90 0x5560f9e11f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.338+0000 7ff4aabc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9e11b90 0x5560f9e11f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42262/0 (socket says 172.21.15.178:42262) 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.338+0000 7ff4aabc7640 1 -- 172.21.15.178:0/950884026 learned_addr learned my addr 172.21.15.178:0/950884026 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.338+0000 7ff4aabc7640 1 -- 172.21.15.178:0/950884026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f9e12560 con 0x5560f9e11b90 2024-09-21T09:03:17.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.338+0000 7ff4aabc7640 1 --2- 172.21.15.178:0/950884026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9e11b90 0x5560f9e11f90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff4a404cb90 tx=0x7ff4a4011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3931aeea74df4d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.338+0000 7ff38dffb640 1 -- 172.21.15.178:0/950884026 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a4044070 con 0x5560f9e11b90 2024-09-21T09:03:17.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.338+0000 7ff38dffb640 1 -- 172.21.15.178:0/950884026 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a4013ca0 con 0x5560f9e11b90 2024-09-21T09:03:17.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.338+0000 7ff38dffb640 1 -- 172.21.15.178:0/950884026 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a4014ad0 con 0x5560f9e11b90 2024-09-21T09:03:17.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.338+0000 7ff4aec10800 1 -- 172.21.15.178:0/950884026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9e11b90 msgr2=0x5560f9e11f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.338+0000 7ff4aec10800 1 --2- 172.21.15.178:0/950884026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9e11b90 0x5560f9e11f90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff4a404cb90 tx=0x7ff4a4011700 comp rx=0 tx=0).stop 2024-09-21T09:03:17.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.339+0000 7ff4aec10800 1 -- 172.21.15.178:0/950884026 shutdown_connections 2024-09-21T09:03:17.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.339+0000 7ff4aec10800 1 --2- 172.21.15.178:0/950884026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9e11b90 0x5560f9e11f90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.339+0000 7ff4aec10800 1 -- 172.21.15.178:0/950884026 >> 172.21.15.178:0/950884026 conn(0x5560f9e0def0 msgr2=0x5560f9e0bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.339+0000 7ff4aec10800 1 -- 172.21.15.178:0/950884026 shutdown_connections 2024-09-21T09:03:17.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.339+0000 7ff4aec10800 1 -- 172.21.15.178:0/950884026 wait complete. 2024-09-21T09:03:17.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.339+0000 7ff4aec10800 1 Processor -- start 2024-09-21T09:03:17.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.339+0000 7ff4aec10800 1 -- start start 2024-09-21T09:03:17.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.339+0000 7ff4aec10800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9e11b90 0x5560f9e19060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.339+0000 7ff4aec10800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5560f9e12bd0 con 0x5560f9e11b90 2024-09-21T09:03:17.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.339+0000 7ff4aabc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9e11b90 0x5560f9e19060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.339+0000 7ff4aabc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9e11b90 0x5560f9e19060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42268/0 (socket says 172.21.15.178:42268) 2024-09-21T09:03:17.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.339+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 learned_addr learned my addr 172.21.15.178:0/1215146793 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.339+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f9e195a0 con 0x5560f9e11b90 2024-09-21T09:03:17.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.340+0000 7ff4aabc7640 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9e11b90 0x5560f9e19060 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40117d0 tx=0x7ff4a404cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.340+0000 7ff37bfff640 1 -- 172.21.15.178:0/1215146793 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a4016440 con 0x5560f9e11b90 2024-09-21T09:03:17.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.340+0000 7ff37bfff640 1 -- 172.21.15.178:0/1215146793 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a4013e50 con 0x5560f9e11b90 2024-09-21T09:03:17.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.340+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560f9e19830 con 0x5560f9e11b90 2024-09-21T09:03:17.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.340+0000 7ff37bfff640 1 -- 172.21.15.178:0/1215146793 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a4022c60 con 0x5560f9e11b90 2024-09-21T09:03:17.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.340+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f9e1c4e0 con 0x5560f9e11b90 2024-09-21T09:03:17.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.340+0000 7ff37bfff640 1 -- 172.21.15.178:0/1215146793 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff4a403e020 con 0x5560f9e11b90 2024-09-21T09:03:17.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.341+0000 7ff37bfff640 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff374036b40 0x7ff374039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.341+0000 7ff37bfff640 1 -- 172.21.15.178:0/1215146793 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff4a403c020 con 0x5560f9e11b90 2024-09-21T09:03:17.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.341+0000 7ff4aa3c6640 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff374036b40 0x7ff374039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.341+0000 7ff4aa3c6640 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff374036b40 0x7ff374039000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff49c07c730 tx=0x7ff49c08a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.341+0000 7ff4aec10800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.341+0000 7ff4aec10800 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5560f9e24cc0 0x5560f9e27180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.341+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e278d0 con 0x5560f9e24cc0 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.341+0000 7ff4a3fff640 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5560f9e24cc0 0x5560f9e27180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4a3fff640 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5560f9e24cc0 0x5560f9e27180 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff49400f5f0 con 0x5560f9e24cc0 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4aec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4aec10800 20 realm 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4aec10800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e24110 con 0x5560f9e24cc0 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff49400f5f0 con 0x5560f9e24cc0 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4aec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4aec10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4aec10800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e283b0 con 0x5560f9e24cc0 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff49400f5f0 con 0x5560f9e24cc0 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4aec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4aec10800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.342+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e28c80 con 0x5560f9e24cc0 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.343+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff49400f5f0 con 0x5560f9e24cc0 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.343+0000 7ff4aec10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.343+0000 7ff4aec10800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.343+0000 7ff4aec10800 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5560f9e29580 0x5560f9e2b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.343+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e29580 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.343+0000 7ff4aabc7640 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5560f9e29580 0x5560f9e2b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.343+0000 7ff4aabc7640 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5560f9e29580 0x5560f9e2b990 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.343+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.343+0000 7ff4aec10800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.343+0000 7ff4aec10800 20 searching for the correct realm 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.343+0000 7ff4aec10800 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5560f9e2e1a0 0x5560f9e30660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.343+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e30d30 con 0x5560f9e2e1a0 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.344+0000 7ff4aa3c6640 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5560f9e2e1a0 0x5560f9e30660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.344+0000 7ff4aa3c6640 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5560f9e2e1a0 0x5560f9e30660 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.344+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9e2e1a0 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.344+0000 7ff4aa3c6640 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff49c07d060 0x7ff49c08e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.344+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e30d30 con 0x7ff49c07d060 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.344+0000 7ff4a3fff640 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff49c07d060 0x7ff49c08e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.344+0000 7ff4a3fff640 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff49c07d060 0x7ff49c08e360 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.345+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49400f5f0 con 0x7ff49c07d060 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.345+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e30d30 con 0x5560f9e29580 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.345+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.345+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e24cc0 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.345+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49400f5f0 con 0x5560f9e24cc0 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.345+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e24cc0 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.346+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.346+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e29580 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.346+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.346+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e29580 2024-09-21T09:03:17.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.346+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.346+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x7ff49c07d060 2024-09-21T09:03:17.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.346+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49402b040 con 0x7ff49c07d060 2024-09-21T09:03:17.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.346+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e2e1a0 2024-09-21T09:03:17.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.346+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9e2e1a0 2024-09-21T09:03:17.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.346+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e24cc0 2024-09-21T09:03:17.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.347+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.347+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e29580 2024-09-21T09:03:17.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.347+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.347+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e24cc0 2024-09-21T09:03:17.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.348+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.348+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x7ff49c07d060 2024-09-21T09:03:17.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.348+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff49402b040 con 0x7ff49c07d060 2024-09-21T09:03:17.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.348+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e2e1a0 2024-09-21T09:03:17.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.348+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9e2e1a0 2024-09-21T09:03:17.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.348+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e2e1a0 2024-09-21T09:03:17.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.348+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9e2e1a0 2024-09-21T09:03:17.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.348+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e29580 2024-09-21T09:03:17.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.349+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.349+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e2e1a0 2024-09-21T09:03:17.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.349+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9e2e1a0 2024-09-21T09:03:17.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.349+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e2e1a0 2024-09-21T09:03:17.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.349+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9e2e1a0 2024-09-21T09:03:17.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.349+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e24cc0 2024-09-21T09:03:17.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.349+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.349+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e24cc0 2024-09-21T09:03:17.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.350+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.350+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e29580 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.350+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.350+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e2e1a0 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.350+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9e2e1a0 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.350+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x7ff49c07d060 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.350+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49402b040 con 0x7ff49c07d060 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.350+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e24cc0 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.350+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.350+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e29580 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.351+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.351+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e2e1a0 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.351+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9e2e1a0 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.351+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e29580 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.351+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.351+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x7ff49c07d060 2024-09-21T09:03:17.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.351+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49402b040 con 0x7ff49c07d060 2024-09-21T09:03:17.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.351+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e2e1a0 2024-09-21T09:03:17.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.352+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9e2e1a0 2024-09-21T09:03:17.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.352+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e29580 2024-09-21T09:03:17.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.352+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.352+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x5560f9e24cc0 2024-09-21T09:03:17.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.352+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.352+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2c0f0 con 0x7ff49c07d060 2024-09-21T09:03:17.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.352+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49402b040 con 0x7ff49c07d060 2024-09-21T09:03:17.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.352+0000 7ff4aec10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:17.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.352+0000 7ff4aec10800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:17.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.352+0000 7ff4aec10800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:17.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.352+0000 7ff4aec10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.352+0000 7ff4aec10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.352+0000 7ff4aec10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.352+0000 7ff4aec10800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2caa0 con 0x5560f9e24cc0 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2ce90 con 0x5560f9e24cc0 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2d2b0 con 0x5560f9e24cc0 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:17.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 20 zone default found 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 4 Realm: () 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 20 zonegroup default 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e2d6e0 con 0x5560f9e29580 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.353+0000 7ff4aec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.354+0000 7ff4aec10800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.354+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e32c20 con 0x5560f9e2e1a0 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.354+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9e2e1a0 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.354+0000 7ff4aec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.354+0000 7ff4aec10800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.354+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e330b0 con 0x5560f9e2e1a0 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.354+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9e2e1a0 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.354+0000 7ff4aec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.354+0000 7ff4aec10800 20 started sync module instance, tier type = 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.354+0000 7ff4aec10800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.354+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e32030 con 0x7ff49c07d060 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.355+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x7ff49c07d060 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.355+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93874997634384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e32030 con 0x7ff49c07d060 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.355+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e33c30 con 0x5560f9e24cc0 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.356+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93874997634384] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x7ff49c07d060 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.356+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.356+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93874997638912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e32030 con 0x5560f9e24cc0 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.356+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e346b0 con 0x5560f9e2e1a0 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.357+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93874997638912] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.357+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9e2e1a0 2024-09-21T09:03:17.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.358+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93874997631872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e31fa0 con 0x5560f9e2e1a0 2024-09-21T09:03:17.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.358+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e355a0 con 0x7ff49c07d060 2024-09-21T09:03:17.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.358+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x7ff49c07d060 2024-09-21T09:03:17.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.358+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93874997646032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e35d60 con 0x7ff49c07d060 2024-09-21T09:03:17.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.358+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e36860 con 0x5560f9e24cc0 2024-09-21T09:03:17.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.359+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93874997631872] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9e2e1a0 2024-09-21T09:03:17.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.359+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.360+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93874997650256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e36820 con 0x5560f9e24cc0 2024-09-21T09:03:17.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.360+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e372a0 con 0x5560f9e29580 2024-09-21T09:03:17.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.360+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93874997646032] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x7ff49c07d060 2024-09-21T09:03:17.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.361+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.361+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93874997650256] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.361+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93874997643984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e36df0 con 0x5560f9e29580 2024-09-21T09:03:17.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.361+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e37b40 con 0x5560f9e29580 2024-09-21T09:03:17.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.362+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93874997643984] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.362+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.362+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93874997647280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e36df0 con 0x5560f9e29580 2024-09-21T09:03:17.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.362+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e381e0 con 0x5560f9e29580 2024-09-21T09:03:17.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.363+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.363+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93874997647280] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.363+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93874997656752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e381a0 con 0x5560f9e29580 2024-09-21T09:03:17.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.363+0000 7ff4aec10800 20 add_watcher() i=0 2024-09-21T09:03:17.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.363+0000 7ff4aec10800 20 add_watcher() i=1 2024-09-21T09:03:17.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.363+0000 7ff4aec10800 20 add_watcher() i=2 2024-09-21T09:03:17.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.363+0000 7ff4aec10800 20 add_watcher() i=3 2024-09-21T09:03:17.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.363+0000 7ff4aec10800 20 add_watcher() i=4 2024-09-21T09:03:17.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.363+0000 7ff4aec10800 20 add_watcher() i=5 2024-09-21T09:03:17.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.363+0000 7ff4aec10800 20 add_watcher() i=6 2024-09-21T09:03:17.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.364+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93874997656752] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.364+0000 7ff4aec10800 20 add_watcher() i=7 2024-09-21T09:03:17.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.364+0000 7ff4aec10800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:17.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.364+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e37720 con 0x5560f9e24cc0 2024-09-21T09:03:17.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.364+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.364+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93874997659088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e37720 con 0x5560f9e24cc0 2024-09-21T09:03:17.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.365+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93874997659088] v29'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.365+0000 7ff360fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.365+0000 7ff4aec10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:17.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.365+0000 7ff4aec10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:17.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.365+0000 7ff4aec10800 5 note: GC not initialized 2024-09-21T09:03:17.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.365+0000 7ff2db7fe640 20 reqs_thread_entry: start 2024-09-21T09:03:17.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.365+0000 7ff4aec10800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:17.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.365+0000 7ff4aec10800 20 Filter name: none 2024-09-21T09:03:17.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.366+0000 7ff2d97fa640 20 reqs_thread_entry: start 2024-09-21T09:03:17.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.366+0000 7ff4aec10800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.366+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e6e5c0 con 0x5560f9e24cc0 2024-09-21T09:03:17.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.366+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.366+0000 7ff4aec10800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:17.374 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:17.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.367+0000 7ff360fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.367+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93874997659088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e6d3b0 con 0x5560f9e24cc0 2024-09-21T09:03:17.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.368+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93874997659088] v29'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.368+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93874997634384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e385d0 con 0x7ff49c07d060 2024-09-21T09:03:17.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.369+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93874997634384] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x7ff49c07d060 2024-09-21T09:03:17.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.369+0000 7ff4aec10800 20 remove_watcher() i=0 2024-09-21T09:03:17.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.369+0000 7ff4aec10800 2 removed watcher, disabling cache 2024-09-21T09:03:17.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.369+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93874997638912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e385d0 con 0x5560f9e24cc0 2024-09-21T09:03:17.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.370+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93874997638912] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.370+0000 7ff4aec10800 20 remove_watcher() i=1 2024-09-21T09:03:17.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.370+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93874997631872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e33700 con 0x5560f9e2e1a0 2024-09-21T09:03:17.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.371+0000 7ff4aa3c6640 1 -- 172.21.15.178:0/1215146793 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93874997631872] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49c07a030 con 0x5560f9e2e1a0 2024-09-21T09:03:17.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.371+0000 7ff4aec10800 20 remove_watcher() i=2 2024-09-21T09:03:17.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.371+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93874997646032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e385d0 con 0x7ff49c07d060 2024-09-21T09:03:17.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.372+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93874997646032] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x7ff49c07d060 2024-09-21T09:03:17.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.372+0000 7ff4aec10800 20 remove_watcher() i=3 2024-09-21T09:03:17.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.372+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93874997650256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e31b80 con 0x5560f9e24cc0 2024-09-21T09:03:17.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.373+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93874997650256] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49402b040 con 0x5560f9e24cc0 2024-09-21T09:03:17.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.373+0000 7ff4aec10800 20 remove_watcher() i=4 2024-09-21T09:03:17.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.373+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93874997643984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e352d0 con 0x5560f9e29580 2024-09-21T09:03:17.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.374+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93874997643984] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.374+0000 7ff4aec10800 20 remove_watcher() i=5 2024-09-21T09:03:17.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.374+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93874997647280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e31b80 con 0x5560f9e29580 2024-09-21T09:03:17.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.375+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93874997647280] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.375+0000 7ff4aec10800 20 remove_watcher() i=6 2024-09-21T09:03:17.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.375+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93874997656752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560f9e34ad0 con 0x5560f9e29580 2024-09-21T09:03:17.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aabc7640 1 -- 172.21.15.178:0/1215146793 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93874997656752] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a402a070 con 0x5560f9e29580 2024-09-21T09:03:17.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 20 remove_watcher() i=7 2024-09-21T09:03:17.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5560f9e29580 msgr2=0x5560f9e2b990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5560f9e29580 0x5560f9e2b990 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5560f9e24cc0 msgr2=0x5560f9e27180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5560f9e24cc0 0x5560f9e27180 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff49c07d060 msgr2=0x7ff49c08e360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff49c07d060 0x7ff49c08e360 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5560f9e2e1a0 msgr2=0x5560f9e30660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5560f9e2e1a0 0x5560f9e30660 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff374036b40 msgr2=0x7ff374039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff374036b40 0x7ff374039000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff49c07c730 tx=0x7ff49c08a000 comp rx=0 tx=0).stop 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9e11b90 msgr2=0x5560f9e19060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4a3fff640 1 -- 172.21.15.178:0/1215146793 reap_dead start 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9e11b90 0x5560f9e19060 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40117d0 tx=0x7ff4a404cb20 comp rx=0 tx=0).stop 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 shutdown_connections 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 --2- 172.21.15.178:0/1215146793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9e11b90 0x5560f9e19060 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 >> 172.21.15.178:0/1215146793 conn(0x5560f9e0def0 msgr2=0x5560f9e0bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 shutdown_connections 2024-09-21T09:03:17.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.376+0000 7ff4aec10800 1 -- 172.21.15.178:0/1215146793 wait complete. 2024-09-21T09:03:17.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 -- 172.21.15.178:0/2739457607 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff384036b90 msgr2=0x7ff384039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 --2- 172.21.15.178:0/2739457607 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff384036b90 0x7ff384039050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x5560f9defa40 tx=0x7ff49c054f70 comp rx=0 tx=0).stop 2024-09-21T09:03:17.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 -- 172.21.15.178:0/2739457607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9c67740 msgr2=0x5560f9c65d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 --2- 172.21.15.178:0/2739457607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9c67740 0x5560f9c65d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x5560f9def9a0 tx=0x7ff4a4018830 comp rx=0 tx=0).stop 2024-09-21T09:03:17.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 -- 172.21.15.178:0/2739457607 shutdown_connections 2024-09-21T09:03:17.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 --2- 172.21.15.178:0/2739457607 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff384036b90 0x7ff384039050 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 --2- 172.21.15.178:0/2739457607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9c67740 0x5560f9c65d90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 -- 172.21.15.178:0/2739457607 >> 172.21.15.178:0/2739457607 conn(0x5560f9df7cc0 msgr2=0x5560f9dfa840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 -- 172.21.15.178:0/2739457607 shutdown_connections 2024-09-21T09:03:17.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 -- 172.21.15.178:0/2739457607 wait complete. 2024-09-21T09:03:17.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5560f9df18d0 msgr2=0x5560f9df3cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5560f9df18d0 0x5560f9df3cc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5560f9cf20a0 msgr2=0x5560f9def010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5560f9cf20a0 0x5560f9def010 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff390036b90 msgr2=0x7ff390039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff390036b90 0x7ff390039050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff494000c00 tx=0x7ff4940013b0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 msgr2=0x5560f9de7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9de7fa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff49c045f50 tx=0x7ff49c002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 shutdown_connections 2024-09-21T09:03:17.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5560f9df18d0 0x5560f9df3cc0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5560f9cf20a0 0x5560f9def010 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff390036b90 0x7ff390039050 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 --2- 172.21.15.178:0/4198775431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560f9cf1760 0x5560f9de7fa0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 >> 172.21.15.178:0/4198775431 conn(0x5560f9cecff0 msgr2=0x5560f9dda8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 shutdown_connections 2024-09-21T09:03:17.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.377+0000 7ff4aec10800 1 -- 172.21.15.178:0/4198775431 wait complete. 2024-09-21T09:03:17.387 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:17.387 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-21T09:03:17.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-21T09:03:17.387 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-21T09:03:17.431 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:17.432 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:17.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.431+0000 7f2f31440800 1 Processor -- start 2024-09-21T09:03:17.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.431+0000 7f2f31440800 1 -- start start 2024-09-21T09:03:17.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.431+0000 7f2f31440800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55ecfc91a900 0x55ecfc91ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.431+0000 7f2f31440800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ecfc7d6b30 con 0x55ecfc9164c0 2024-09-21T09:03:17.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.431+0000 7f2f31440800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55ecfc7b8360 con 0x55ecfc91a900 2024-09-21T09:03:17.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.431+0000 7f2f2e733640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55ecfc91a900 0x55ecfc91ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.431+0000 7f2f2ef34640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55ecfc9164c0 0x55ecfc9168c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46588/0 (socket says 172.21.15.178:46588) 2024-09-21T09:03:17.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.431+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1425064010 learned_addr learned my addr 172.21.15.178:0/1425064010 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:17.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.431+0000 7f2f2e733640 1 -- 172.21.15.178:0/1425064010 >> v1:172.21.15.44:6789/0 conn(0x55ecfc9164c0 legacy=0x55ecfc9168c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.431+0000 7f2f2df32640 1 -- 172.21.15.178:0/1425064010 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4030400192 0 0) 0x55ecfc7d6b30 con 0x55ecfc9164c0 2024-09-21T09:03:17.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.431+0000 7f2f2e733640 1 -- 172.21.15.178:0/1425064010 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfc7dee00 con 0x55ecfc91a900 2024-09-21T09:03:17.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.433+0000 7f2f2e733640 1 --2- 172.21.15.178:0/1425064010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc91a900 0x55ecfc91ccf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000a470 tx=0x7f2f20045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1833fa1798414c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.433+0000 7f2f2df32640 1 -- 172.21.15.178:0/1425064010 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f20053570 con 0x55ecfc91a900 2024-09-21T09:03:17.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.433+0000 7f2f2df32640 1 -- 172.21.15.178:0/1425064010 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f20058070 con 0x55ecfc91a900 2024-09-21T09:03:17.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.433+0000 7f2f2df32640 1 -- 172.21.15.178:0/1425064010 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f20053880 con 0x55ecfc91a900 2024-09-21T09:03:17.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.434+0000 7f2f31440800 1 -- 172.21.15.178:0/1425064010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc91a900 msgr2=0x55ecfc91ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.434+0000 7f2f31440800 1 --2- 172.21.15.178:0/1425064010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc91a900 0x55ecfc91ccf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000a470 tx=0x7f2f20045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:17.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.434+0000 7f2f31440800 1 -- 172.21.15.178:0/1425064010 shutdown_connections 2024-09-21T09:03:17.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.434+0000 7f2f31440800 1 --2- 172.21.15.178:0/1425064010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc91a900 0x55ecfc91ccf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.434+0000 7f2f31440800 1 -- 172.21.15.178:0/1425064010 >> 172.21.15.178:0/1425064010 conn(0x55ecfc911df0 msgr2=0x55ecfc914210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.434+0000 7f2f31440800 1 -- 172.21.15.178:0/1425064010 shutdown_connections 2024-09-21T09:03:17.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.434+0000 7f2f31440800 1 -- 172.21.15.178:0/1425064010 wait complete. 2024-09-21T09:03:17.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.448+0000 7f2f31440800 1 Processor -- start 2024-09-21T09:03:17.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.448+0000 7f2f31440800 1 -- start start 2024-09-21T09:03:17.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.448+0000 7f2f31440800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc9164c0 0x55ecfc88ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.448+0000 7f2f31440800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ecfc863330 con 0x55ecfc9164c0 2024-09-21T09:03:17.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.448+0000 7f2f2ef34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc9164c0 0x55ecfc88ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.448+0000 7f2f2ef34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc9164c0 0x55ecfc88ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42290/0 (socket says 172.21.15.178:42290) 2024-09-21T09:03:17.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.448+0000 7f2f2ef34640 1 -- 172.21.15.178:0/2438164453 learned_addr learned my addr 172.21.15.178:0/2438164453 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.449+0000 7f2f2ef34640 1 -- 172.21.15.178:0/2438164453 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfc7b0bc0 con 0x55ecfc9164c0 2024-09-21T09:03:17.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.449+0000 7f2f2ef34640 1 --2- 172.21.15.178:0/2438164453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc9164c0 0x55ecfc88ad80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800b240 tx=0x7f2f1800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5783020755e9cd08 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.449+0000 7f2e1ce09640 1 -- 172.21.15.178:0/2438164453 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f18008070 con 0x55ecfc9164c0 2024-09-21T09:03:17.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.449+0000 7f2e1ce09640 1 -- 172.21.15.178:0/2438164453 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1800d500 con 0x55ecfc9164c0 2024-09-21T09:03:17.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.449+0000 7f2e1ce09640 1 -- 172.21.15.178:0/2438164453 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1800d860 con 0x55ecfc9164c0 2024-09-21T09:03:17.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.450+0000 7f2f31440800 1 -- 172.21.15.178:0/2438164453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc9164c0 msgr2=0x55ecfc88ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.450+0000 7f2f31440800 1 --2- 172.21.15.178:0/2438164453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc9164c0 0x55ecfc88ad80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800b240 tx=0x7f2f1800b700 comp rx=0 tx=0).stop 2024-09-21T09:03:17.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.450+0000 7f2f31440800 1 -- 172.21.15.178:0/2438164453 shutdown_connections 2024-09-21T09:03:17.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.450+0000 7f2f31440800 1 --2- 172.21.15.178:0/2438164453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc9164c0 0x55ecfc88ad80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.450+0000 7f2f31440800 1 -- 172.21.15.178:0/2438164453 >> 172.21.15.178:0/2438164453 conn(0x55ecfc911df0 msgr2=0x55ecfca00f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.450+0000 7f2f31440800 1 -- 172.21.15.178:0/2438164453 shutdown_connections 2024-09-21T09:03:17.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.450+0000 7f2f31440800 1 -- 172.21.15.178:0/2438164453 wait complete. 2024-09-21T09:03:17.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.450+0000 7f2f31440800 1 Processor -- start 2024-09-21T09:03:17.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.450+0000 7f2f31440800 1 -- start start 2024-09-21T09:03:17.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.450+0000 7f2f31440800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc9164c0 0x55ecfca0e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.450+0000 7f2f31440800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ecfc91d530 con 0x55ecfc9164c0 2024-09-21T09:03:17.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.451+0000 7f2f2ef34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc9164c0 0x55ecfca0e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.451+0000 7f2f2ef34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc9164c0 0x55ecfca0e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42296/0 (socket says 172.21.15.178:42296) 2024-09-21T09:03:17.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.451+0000 7f2f2ef34640 1 -- 172.21.15.178:0/3355080927 learned_addr learned my addr 172.21.15.178:0/3355080927 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.451+0000 7f2f2ef34640 1 -- 172.21.15.178:0/3355080927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfc7c4fe0 con 0x55ecfc9164c0 2024-09-21T09:03:17.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.451+0000 7f2f2ef34640 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc9164c0 0x55ecfca0e080 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55ecfc88a480 tx=0x7f2f18000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.451+0000 7f2e1b606640 1 -- 172.21.15.178:0/3355080927 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f18019870 con 0x55ecfc9164c0 2024-09-21T09:03:17.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.451+0000 7f2e1b606640 1 -- 172.21.15.178:0/3355080927 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f18019a10 con 0x55ecfc9164c0 2024-09-21T09:03:17.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.451+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecfca0e5c0 con 0x55ecfc9164c0 2024-09-21T09:03:17.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.451+0000 7f2e1b606640 1 -- 172.21.15.178:0/3355080927 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f18019d30 con 0x55ecfc9164c0 2024-09-21T09:03:17.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.451+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecfca0eae0 con 0x55ecfc9164c0 2024-09-21T09:03:17.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.452+0000 7f2e1b606640 1 -- 172.21.15.178:0/3355080927 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2f18017040 con 0x55ecfc9164c0 2024-09-21T09:03:17.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.452+0000 7f2e1b606640 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2e14036b90 0x7f2e14039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.452+0000 7f2e1b606640 1 -- 172.21.15.178:0/3355080927 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2f18015020 con 0x55ecfc9164c0 2024-09-21T09:03:17.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.452+0000 7f2f2e733640 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2e14036b90 0x7f2e14039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.453+0000 7f2f31440800 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ecfc91a900 0x55ecfca150f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.453+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca15670 con 0x55ecfc91a900 2024-09-21T09:03:17.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.453+0000 7f2f2f735640 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ecfc91a900 0x55ecfca150f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.453+0000 7f2f2e733640 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2e14036b90 0x7f2e14039050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2f20057000 tx=0x7f2f20052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.453+0000 7f2f2f735640 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ecfc91a900 0x55ecfca150f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.453+0000 7f2f2f735640 1 -- 172.21.15.178:0/3355080927 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f2800a4a0 con 0x55ecfc91a900 2024-09-21T09:03:17.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.453+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca126c0 con 0x55ecfc91a900 2024-09-21T09:03:17.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.454+0000 7f2f2f735640 1 -- 172.21.15.178:0/3355080927 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f2800a4a0 con 0x55ecfc91a900 2024-09-21T09:03:17.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.454+0000 7f2f31440800 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ecfca179a0 0x55ecfca19d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.454+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca1a430 con 0x55ecfca179a0 2024-09-21T09:03:17.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.454+0000 7f2f2ef34640 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ecfca179a0 0x55ecfca19d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.454+0000 7f2f2ef34640 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ecfca179a0 0x55ecfca19d90 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.454+0000 7f2f2ef34640 1 -- 172.21.15.178:0/3355080927 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca179a0 2024-09-21T09:03:17.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.455+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca16840 con 0x55ecfc91a900 2024-09-21T09:03:17.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.455+0000 7f2f2f735640 1 -- 172.21.15.178:0/3355080927 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f2800a4a0 con 0x55ecfc91a900 2024-09-21T09:03:17.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.455+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca16d20 con 0x55ecfc91a900 2024-09-21T09:03:17.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.455+0000 7f2f2f735640 1 -- 172.21.15.178:0/3355080927 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2f2800a4a0 con 0x55ecfc91a900 2024-09-21T09:03:17.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.455+0000 7f2f31440800 1 Processor -- start 2024-09-21T09:03:17.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.455+0000 7f2f31440800 1 -- start start 2024-09-21T09:03:17.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.456+0000 7f2f31440800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca28df0 0x55ecfca29210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.456+0000 7f2f31440800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ecfc7b2580 con 0x55ecfca28df0 2024-09-21T09:03:17.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.456+0000 7f2f2f735640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca28df0 0x55ecfca29210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.456+0000 7f2f2f735640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca28df0 0x55ecfca29210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42308/0 (socket says 172.21.15.178:42308) 2024-09-21T09:03:17.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.456+0000 7f2f2f735640 1 -- 172.21.15.178:0/2845491238 learned_addr learned my addr 172.21.15.178:0/2845491238 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.456+0000 7f2f2f735640 1 -- 172.21.15.178:0/2845491238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfca29750 con 0x55ecfca28df0 2024-09-21T09:03:17.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.456+0000 7f2f2f735640 1 --2- 172.21.15.178:0/2845491238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca28df0 0x55ecfca29210 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55ecfca0f130 tx=0x7f2f280188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.456+0000 7f2e18e01640 1 -- 172.21.15.178:0/2845491238 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f28014450 con 0x55ecfca28df0 2024-09-21T09:03:17.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.456+0000 7f2e18e01640 1 -- 172.21.15.178:0/2845491238 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f280145f0 con 0x55ecfca28df0 2024-09-21T09:03:17.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.456+0000 7f2f31440800 1 -- 172.21.15.178:0/2845491238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecfca299e0 con 0x55ecfca28df0 2024-09-21T09:03:17.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.456+0000 7f2e18e01640 1 -- 172.21.15.178:0/2845491238 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f280148d0 con 0x55ecfca28df0 2024-09-21T09:03:17.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.456+0000 7f2f31440800 1 -- 172.21.15.178:0/2845491238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecfca2c6c0 con 0x55ecfca28df0 2024-09-21T09:03:17.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.457+0000 7f2e18e01640 1 -- 172.21.15.178:0/2845491238 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2f28011040 con 0x55ecfca28df0 2024-09-21T09:03:17.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.457+0000 7f2e18e01640 1 --2- 172.21.15.178:0/2845491238 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2e08036b90 0x7f2e08039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.457+0000 7f2e18e01640 1 -- 172.21.15.178:0/2845491238 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2f2801e070 con 0x55ecfca28df0 2024-09-21T09:03:17.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.457+0000 7f2f2ef34640 1 --2- 172.21.15.178:0/2845491238 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2e08036b90 0x7f2e08039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.458+0000 7f2f31440800 1 Processor -- start 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.458+0000 7f2f2ef34640 1 --2- 172.21.15.178:0/2845491238 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2e08036b90 0x7f2e08039050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55ecfca15ac0 tx=0x7f2f1801b520 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.458+0000 7f2f31440800 1 -- start start 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.458+0000 7f2f31440800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca35a70 0x55ecfca35e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.458+0000 7f2f31440800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ecfca09540 con 0x55ecfca35a70 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.458+0000 7f2f2f735640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca35a70 0x55ecfca35e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.458+0000 7f2f2f735640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca35a70 0x55ecfca35e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42324/0 (socket says 172.21.15.178:42324) 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.458+0000 7f2f2f735640 1 -- 172.21.15.178:0/3012697776 learned_addr learned my addr 172.21.15.178:0/3012697776 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.458+0000 7f2f2f735640 1 -- 172.21.15.178:0/3012697776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfca36440 con 0x55ecfca35a70 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.458+0000 7f2f2f735640 1 --2- 172.21.15.178:0/3012697776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca35a70 0x55ecfca35e70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2f2804cbb0 tx=0x7f2f2803bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d478d8a745cb1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.459+0000 7f2e127fc640 1 -- 172.21.15.178:0/3012697776 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f280167c0 con 0x55ecfca35a70 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.459+0000 7f2e127fc640 1 -- 172.21.15.178:0/3012697776 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f28013ca0 con 0x55ecfca35a70 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.459+0000 7f2e127fc640 1 -- 172.21.15.178:0/3012697776 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f28016960 con 0x55ecfca35a70 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.459+0000 7f2f31440800 1 -- 172.21.15.178:0/3012697776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca35a70 msgr2=0x55ecfca35e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.459+0000 7f2f31440800 1 --2- 172.21.15.178:0/3012697776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca35a70 0x55ecfca35e70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2f2804cbb0 tx=0x7f2f2803bf60 comp rx=0 tx=0).stop 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.459+0000 7f2f31440800 1 -- 172.21.15.178:0/3012697776 shutdown_connections 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.459+0000 7f2f31440800 1 --2- 172.21.15.178:0/3012697776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca35a70 0x55ecfca35e70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.459+0000 7f2f31440800 1 -- 172.21.15.178:0/3012697776 >> 172.21.15.178:0/3012697776 conn(0x55ecfca31dd0 msgr2=0x55ecfca2fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.459+0000 7f2f31440800 1 -- 172.21.15.178:0/3012697776 shutdown_connections 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.459+0000 7f2f31440800 1 -- 172.21.15.178:0/3012697776 wait complete. 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.459+0000 7f2f31440800 1 Processor -- start 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.459+0000 7f2f31440800 1 -- start start 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.460+0000 7f2f31440800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca35a70 0x55ecfca3cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.460+0000 7f2f31440800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ecfca36ab0 con 0x55ecfca35a70 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.460+0000 7f2f2f735640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca35a70 0x55ecfca3cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.460+0000 7f2f2f735640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca35a70 0x55ecfca3cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42336/0 (socket says 172.21.15.178:42336) 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.460+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 learned_addr learned my addr 172.21.15.178:0/1898588926 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.460+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfca3d470 con 0x55ecfca35a70 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.460+0000 7f2f2f735640 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca35a70 0x55ecfca3cf30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2f280119b0 tx=0x7f2f2804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.460+0000 7f2e10ff9640 1 -- 172.21.15.178:0/1898588926 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f28044070 con 0x55ecfca35a70 2024-09-21T09:03:17.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.460+0000 7f2e10ff9640 1 -- 172.21.15.178:0/1898588926 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f28013e50 con 0x55ecfca35a70 2024-09-21T09:03:17.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.460+0000 7f2e10ff9640 1 -- 172.21.15.178:0/1898588926 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f28014a70 con 0x55ecfca35a70 2024-09-21T09:03:17.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.460+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecfca3d700 con 0x55ecfca35a70 2024-09-21T09:03:17.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.460+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecfca403b0 con 0x55ecfca35a70 2024-09-21T09:03:17.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.461+0000 7f2e10ff9640 1 -- 172.21.15.178:0/1898588926 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2f28014c10 con 0x55ecfca35a70 2024-09-21T09:03:17.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.461+0000 7f2e10ff9640 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2df8036b40 0x7f2df8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.461+0000 7f2e10ff9640 1 -- 172.21.15.178:0/1898588926 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2f2800e040 con 0x55ecfca35a70 2024-09-21T09:03:17.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.461+0000 7f2f2ef34640 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2df8036b40 0x7f2df8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.462+0000 7f2f2ef34640 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2df8036b40 0x7f2df8039000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800bc50 tx=0x7f2f18040f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.462+0000 7f2f31440800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.462+0000 7f2f31440800 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ecfca48c60 0x55ecfca4b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.462+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca4b870 con 0x55ecfca48c60 2024-09-21T09:03:17.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.462+0000 7f2f2e733640 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ecfca48c60 0x55ecfca4b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.462+0000 7f2f2e733640 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ecfca48c60 0x55ecfca4b120 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 20 realm 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca4bca0 con 0x55ecfca48c60 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca4c570 con 0x55ecfca48c60 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca4c910 con 0x55ecfca48c60 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ecfca4d670 0x55ecfca4fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.463+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca50070 con 0x55ecfca4d670 2024-09-21T09:03:17.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.464+0000 7f2f2f735640 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ecfca4d670 0x55ecfca4fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.464+0000 7f2f2f735640 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ecfca4d670 0x55ecfca4fa60 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.464+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.464+0000 7f2f31440800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:17.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.464+0000 7f2f31440800 20 searching for the correct realm 2024-09-21T09:03:17.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.464+0000 7f2f31440800 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ecfca52000 0x55ecfca544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.464+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca52000 2024-09-21T09:03:17.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.464+0000 7f2f2ef34640 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ecfca52000 0x55ecfca544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.465+0000 7f2f2ef34640 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ecfca52000 0x55ecfca544c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.465+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca52000 2024-09-21T09:03:17.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.465+0000 7f2f2ef34640 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f2f18053040 0x7f2f1801c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.465+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x7f2f18053040 2024-09-21T09:03:17.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.465+0000 7f2f2e733640 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f2f18053040 0x7f2f1801c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.465+0000 7f2f2e733640 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f2f18053040 0x7f2f1801c610 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.466+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f20051070 con 0x7f2f18053040 2024-09-21T09:03:17.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.466+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca4d670 2024-09-21T09:03:17.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.466+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.466+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca48c60 2024-09-21T09:03:17.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.466+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.466+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca48c60 2024-09-21T09:03:17.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.466+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.466+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca4d670 2024-09-21T09:03:17.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.467+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.467+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca4d670 2024-09-21T09:03:17.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.467+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.467+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x7f2f18053040 2024-09-21T09:03:17.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.467+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f20051070 con 0x7f2f18053040 2024-09-21T09:03:17.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.467+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca52000 2024-09-21T09:03:17.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.467+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca52000 2024-09-21T09:03:17.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.467+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca48c60 2024-09-21T09:03:17.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.468+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.468+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca4d670 2024-09-21T09:03:17.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.468+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.468+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca48c60 2024-09-21T09:03:17.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.468+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.468+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x7f2f18053040 2024-09-21T09:03:17.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.468+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2f20051070 con 0x7f2f18053040 2024-09-21T09:03:17.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.468+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca52000 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.468+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca52000 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.468+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca52000 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.469+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca52000 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.469+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca4d670 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.469+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.469+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca52000 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.469+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca52000 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.469+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca52000 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.469+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca52000 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.469+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca48c60 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.470+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.470+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca48c60 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.470+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.470+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca4d670 2024-09-21T09:03:17.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.470+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.470+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca52000 2024-09-21T09:03:17.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.471+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca52000 2024-09-21T09:03:17.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.471+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x7f2f18053040 2024-09-21T09:03:17.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.471+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f20051070 con 0x7f2f18053040 2024-09-21T09:03:17.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.471+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca48c60 2024-09-21T09:03:17.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.471+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.471+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca4d670 2024-09-21T09:03:17.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.471+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.471+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca52000 2024-09-21T09:03:17.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.472+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca52000 2024-09-21T09:03:17.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.472+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca4d670 2024-09-21T09:03:17.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.472+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.472+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x7f2f18053040 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.472+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f20051070 con 0x7f2f18053040 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.472+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca52000 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.472+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca52000 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.472+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca4d670 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.473+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.473+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x55ecfca48c60 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.473+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.473+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca54b90 con 0x7f2f18053040 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.473+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f20051070 con 0x7f2f18053040 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.473+0000 7f2f31440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.473+0000 7f2f31440800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.473+0000 7f2f31440800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.473+0000 7f2f31440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:17.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.473+0000 7f2f31440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.473+0000 7f2f31440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.473+0000 7f2f31440800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.473+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca51550 con 0x55ecfca48c60 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca50500 con 0x55ecfca48c60 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca50ec0 con 0x55ecfca48c60 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 20 zone default found 2024-09-21T09:03:17.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 4 Realm: () 2024-09-21T09:03:17.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:17.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:17.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:17.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 20 zonegroup default 2024-09-21T09:03:17.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.474+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca554c0 con 0x55ecfca4d670 2024-09-21T09:03:17.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.475+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.475+0000 7f2f31440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.475+0000 7f2f31440800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.475+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca57740 con 0x55ecfca52000 2024-09-21T09:03:17.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.475+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca52000 2024-09-21T09:03:17.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.475+0000 7f2f31440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.475+0000 7f2f31440800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.475+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca57ae0 con 0x55ecfca52000 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.475+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca52000 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.475+0000 7f2f31440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.475+0000 7f2f31440800 20 started sync module instance, tier type = 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.475+0000 7f2f31440800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.475+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca56b80 con 0x7f2f18053040 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.476+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x7f2f18053040 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.476+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94476339343536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca56b80 con 0x7f2f18053040 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.476+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca584e0 con 0x55ecfca48c60 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.477+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94476339343536] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x7f2f18053040 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.477+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.477+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94476339347440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca56b80 con 0x55ecfca48c60 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.477+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca58f30 con 0x55ecfca52000 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.478+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94476339347440] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.479+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca52000 2024-09-21T09:03:17.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.479+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94476339341008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca56af0 con 0x55ecfca52000 2024-09-21T09:03:17.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.479+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca59df0 con 0x7f2f18053040 2024-09-21T09:03:17.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.480+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x7f2f18053040 2024-09-21T09:03:17.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.480+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94476339341008] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca52000 2024-09-21T09:03:17.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.480+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94476339354400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca5a550 con 0x7f2f18053040 2024-09-21T09:03:17.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.480+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca59320 con 0x55ecfca48c60 2024-09-21T09:03:17.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.481+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.481+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94476339358528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca59320 con 0x55ecfca48c60 2024-09-21T09:03:17.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.481+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca5ba30 con 0x55ecfca4d670 2024-09-21T09:03:17.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.481+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94476339354400] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x7f2f18053040 2024-09-21T09:03:17.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.482+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.482+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94476339361152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca5be50 con 0x55ecfca4d670 2024-09-21T09:03:17.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.482+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca5c850 con 0x55ecfca4d670 2024-09-21T09:03:17.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.482+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94476339358528] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.484+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.484+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94476339359584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca5c810 con 0x55ecfca4d670 2024-09-21T09:03:17.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.484+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca5d260 con 0x55ecfca4d670 2024-09-21T09:03:17.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.484+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94476339361152] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.485+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.485+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94476339367248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca5d220 con 0x55ecfca4d670 2024-09-21T09:03:17.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.485+0000 7f2f31440800 20 add_watcher() i=0 2024-09-21T09:03:17.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.485+0000 7f2f31440800 20 add_watcher() i=1 2024-09-21T09:03:17.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.485+0000 7f2f31440800 20 add_watcher() i=2 2024-09-21T09:03:17.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.485+0000 7f2f31440800 20 add_watcher() i=3 2024-09-21T09:03:17.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.485+0000 7f2f31440800 20 add_watcher() i=4 2024-09-21T09:03:17.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.485+0000 7f2f31440800 20 add_watcher() i=5 2024-09-21T09:03:17.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.485+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94476339359584] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.485+0000 7f2f31440800 20 add_watcher() i=6 2024-09-21T09:03:17.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.487+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94476339367248] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.487+0000 7f2f31440800 20 add_watcher() i=7 2024-09-21T09:03:17.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.487+0000 7f2f31440800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:17.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.487+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca5c360 con 0x55ecfca48c60 2024-09-21T09:03:17.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.487+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.487+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94476339355552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca5c360 con 0x55ecfca48c60 2024-09-21T09:03:17.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.488+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94476339355552] v29'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.488+0000 7f2de57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.488+0000 7f2f31440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:17.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.488+0000 7f2f31440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:17.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.488+0000 7f2f31440800 5 note: GC not initialized 2024-09-21T09:03:17.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.488+0000 7f2d5ffff640 20 reqs_thread_entry: start 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.489+0000 7f2f31440800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.489+0000 7f2f31440800 20 Filter name: none 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.489+0000 7f2d5dffb640 20 reqs_thread_entry: start 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.489+0000 7f2f31440800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.489+0000 7f2f31440800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.489+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca93560 con 0x55ecfca48c60 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.489+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.489+0000 7f2f31440800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.489+0000 7f2f31440800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.489+0000 7f2f31440800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.489+0000 7f2f31440800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.489+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca93040 con 0x7f2f18053040 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.489+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x7f2f18053040 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.489+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca99820 con 0x55ecfca48c60 2024-09-21T09:03:17.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.490+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v29'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.490+0000 7f2f31440800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:17.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.490+0000 7f2f31440800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:17.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.490+0000 7f2f31440800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:17.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.490+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94476339614896 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca96540 con 0x55ecfca48c60 2024-09-21T09:03:17.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.491+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify (1) cookie 94476339358528 notify 124554051586 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55ecfc7dee00 con 0x55ecfca48c60 2024-09-21T09:03:17.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.491+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(65 notify.4 [notify cookie 94476339614896 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.491+0000 7f2e127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051586 cookie 94476339358528 notifier 4329 bl.length()=567 2024-09-21T09:03:17.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.491+0000 7f2e127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:17.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.491+0000 7f2e127fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:17.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.491+0000 7f2e127fc640 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f2df4003ea0 con 0x55ecfca48c60 2024-09-21T09:03:17.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.491+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== watch-notify(notify_complete (2) cookie 94476339614896 notify 124554051586 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2f200876b0 con 0x55ecfca48c60 2024-09-21T09:03:17.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.491+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.497 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:17.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.492+0000 7f2de57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.492+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94476339355552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca912b0 con 0x55ecfca48c60 2024-09-21T09:03:17.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.493+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94476339355552] v29'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.493+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94476339343536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca912b0 con 0x7f2f18053040 2024-09-21T09:03:17.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.494+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94476339343536] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x7f2f18053040 2024-09-21T09:03:17.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.494+0000 7f2f31440800 20 remove_watcher() i=0 2024-09-21T09:03:17.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.494+0000 7f2f31440800 2 removed watcher, disabling cache 2024-09-21T09:03:17.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.494+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94476339347440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca912b0 con 0x55ecfca48c60 2024-09-21T09:03:17.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.495+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94476339347440] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.495+0000 7f2f31440800 20 remove_watcher() i=1 2024-09-21T09:03:17.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.495+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94476339341008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca912b0 con 0x55ecfca52000 2024-09-21T09:03:17.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.496+0000 7f2f2ef34640 1 -- 172.21.15.178:0/1898588926 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94476339341008] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1802d070 con 0x55ecfca52000 2024-09-21T09:03:17.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.496+0000 7f2f31440800 20 remove_watcher() i=2 2024-09-21T09:03:17.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.496+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94476339354400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca570b0 con 0x7f2f18053040 2024-09-21T09:03:17.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.497+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94476339354400] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x7f2f18053040 2024-09-21T09:03:17.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.497+0000 7f2f31440800 20 remove_watcher() i=3 2024-09-21T09:03:17.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.497+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94476339358528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca57ff0 con 0x55ecfca48c60 2024-09-21T09:03:17.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.498+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94476339358528] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f20051070 con 0x55ecfca48c60 2024-09-21T09:03:17.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.498+0000 7f2f31440800 20 remove_watcher() i=4 2024-09-21T09:03:17.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.498+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94476339361152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca566d0 con 0x55ecfca4d670 2024-09-21T09:03:17.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.499+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94476339361152] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.499+0000 7f2f31440800 20 remove_watcher() i=5 2024-09-21T09:03:17.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.499+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94476339359584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca59b20 con 0x55ecfca4d670 2024-09-21T09:03:17.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.500+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94476339359584] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.500+0000 7f2f31440800 20 remove_watcher() i=6 2024-09-21T09:03:17.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.500+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94476339367248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ecfca570b0 con 0x55ecfca4d670 2024-09-21T09:03:17.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f2f735640 1 -- 172.21.15.178:0/1898588926 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94476339367248] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28034020 con 0x55ecfca4d670 2024-09-21T09:03:17.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 20 remove_watcher() i=7 2024-09-21T09:03:17.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ecfca4d670 msgr2=0x55ecfca4fa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ecfca4d670 0x55ecfca4fa60 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ecfca48c60 msgr2=0x55ecfca4b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ecfca48c60 0x55ecfca4b120 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f2f18053040 msgr2=0x7f2f1801c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f2f18053040 0x7f2f1801c610 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ecfca52000 msgr2=0x55ecfca544c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ecfca52000 0x55ecfca544c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2df8036b40 msgr2=0x7f2df8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2df8036b40 0x7f2df8039000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800bc50 tx=0x7f2f18040f90 comp rx=0 tx=0).stop 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f2e733640 1 -- 172.21.15.178:0/1898588926 reap_dead start 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca35a70 msgr2=0x55ecfca3cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca35a70 0x55ecfca3cf30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2f280119b0 tx=0x7f2f2804cb10 comp rx=0 tx=0).stop 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 shutdown_connections 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 --2- 172.21.15.178:0/1898588926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca35a70 0x55ecfca3cf30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 >> 172.21.15.178:0/1898588926 conn(0x55ecfca31dd0 msgr2=0x55ecfca2fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 shutdown_connections 2024-09-21T09:03:17.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 -- 172.21.15.178:0/1898588926 wait complete. 2024-09-21T09:03:17.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 -- 172.21.15.178:0/2845491238 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2e08036b90 msgr2=0x7f2e08039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 --2- 172.21.15.178:0/2845491238 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2e08036b90 0x7f2e08039050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55ecfca15ac0 tx=0x7f2f1801b520 comp rx=0 tx=0).stop 2024-09-21T09:03:17.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 -- 172.21.15.178:0/2845491238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca28df0 msgr2=0x55ecfca29210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 --2- 172.21.15.178:0/2845491238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca28df0 0x55ecfca29210 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55ecfca0f130 tx=0x7f2f280188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 -- 172.21.15.178:0/2845491238 shutdown_connections 2024-09-21T09:03:17.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 --2- 172.21.15.178:0/2845491238 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2e08036b90 0x7f2e08039050 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 --2- 172.21.15.178:0/2845491238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfca28df0 0x55ecfca29210 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.501+0000 7f2f31440800 1 -- 172.21.15.178:0/2845491238 >> 172.21.15.178:0/2845491238 conn(0x55ecfca1dd80 msgr2=0x55ecfca20900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 -- 172.21.15.178:0/2845491238 shutdown_connections 2024-09-21T09:03:17.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 -- 172.21.15.178:0/2845491238 wait complete. 2024-09-21T09:03:17.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ecfca179a0 msgr2=0x55ecfca19d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ecfca179a0 0x55ecfca19d90 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ecfc91a900 msgr2=0x55ecfca150f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ecfc91a900 0x55ecfca150f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2e14036b90 msgr2=0x7f2e14039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2e14036b90 0x7f2e14039050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2f20057000 tx=0x7f2f20052000 comp rx=0 tx=0).stop 2024-09-21T09:03:17.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc9164c0 msgr2=0x55ecfca0e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc9164c0 0x55ecfca0e080 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55ecfc88a480 tx=0x7f2f18000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 shutdown_connections 2024-09-21T09:03:17.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ecfca179a0 0x55ecfca19d90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ecfc91a900 0x55ecfca150f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2e14036b90 0x7f2e14039050 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 --2- 172.21.15.178:0/3355080927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ecfc9164c0 0x55ecfca0e080 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 >> 172.21.15.178:0/3355080927 conn(0x55ecfc911df0 msgr2=0x55ecfc9ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 shutdown_connections 2024-09-21T09:03:17.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.502+0000 7f2f31440800 1 -- 172.21.15.178:0/3355080927 wait complete. 2024-09-21T09:03:17.512 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:17.512 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T09:03:17.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T09:03:17.513 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T09:03:17.556 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:17.557 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:17.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.555+0000 7f11f8f51800 1 Processor -- start 2024-09-21T09:03:17.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.556+0000 7f11f8f51800 1 -- start start 2024-09-21T09:03:17.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.556+0000 7f11f8f51800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56109e268a00 0x56109e26adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.556+0000 7f11f8f51800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56109e123b30 con 0x56109e2645c0 2024-09-21T09:03:17.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.556+0000 7f11f8f51800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x56109e105360 con 0x56109e268a00 2024-09-21T09:03:17.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.556+0000 7f11ee244640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56109e268a00 0x56109e26adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.556+0000 7f11f6a45640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x56109e2645c0 0x56109e2649c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46592/0 (socket says 172.21.15.178:46592) 2024-09-21T09:03:17.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.556+0000 7f11f6a45640 1 -- 172.21.15.178:0/841491866 learned_addr learned my addr 172.21.15.178:0/841491866 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:17.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.556+0000 7f11ee244640 1 -- 172.21.15.178:0/841491866 >> v1:172.21.15.44:6789/0 conn(0x56109e2645c0 legacy=0x56109e2649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.556+0000 7f11ee244640 1 -- 172.21.15.178:0/841491866 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109e12be00 con 0x56109e268a00 2024-09-21T09:03:17.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.558+0000 7f11ee244640 1 --2- 172.21.15.178:0/841491866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e268a00 0x56109e26adf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f11e000a470 tx=0x7f11e0045880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd185aa61f7036c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.558+0000 7f11f6244640 1 -- 172.21.15.178:0/841491866 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11e0059070 con 0x56109e268a00 2024-09-21T09:03:17.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.558+0000 7f11f6244640 1 -- 172.21.15.178:0/841491866 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e0054570 con 0x56109e268a00 2024-09-21T09:03:17.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.558+0000 7f11f6244640 1 -- 172.21.15.178:0/841491866 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11e0054870 con 0x56109e268a00 2024-09-21T09:03:17.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.559+0000 7f11f8f51800 1 -- 172.21.15.178:0/841491866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e268a00 msgr2=0x56109e26adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.559+0000 7f11f8f51800 1 --2- 172.21.15.178:0/841491866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e268a00 0x56109e26adf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f11e000a470 tx=0x7f11e0045880 comp rx=0 tx=0).stop 2024-09-21T09:03:17.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.559+0000 7f11f8f51800 1 -- 172.21.15.178:0/841491866 shutdown_connections 2024-09-21T09:03:17.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.559+0000 7f11f8f51800 1 --2- 172.21.15.178:0/841491866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e268a00 0x56109e26adf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.559+0000 7f11f8f51800 1 -- 172.21.15.178:0/841491866 >> 172.21.15.178:0/841491866 conn(0x56109e25fed0 msgr2=0x56109e2622f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.559+0000 7f11f8f51800 1 -- 172.21.15.178:0/841491866 shutdown_connections 2024-09-21T09:03:17.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.559+0000 7f11f8f51800 1 -- 172.21.15.178:0/841491866 wait complete. 2024-09-21T09:03:17.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.573+0000 7f11f8f51800 1 Processor -- start 2024-09-21T09:03:17.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.573+0000 7f11f8f51800 1 -- start start 2024-09-21T09:03:17.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.573+0000 7f11f8f51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e2645c0 0x56109e353890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.573+0000 7f11f8f51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56109e1b0330 con 0x56109e2645c0 2024-09-21T09:03:17.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.573+0000 7f11f6a45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e2645c0 0x56109e353890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.573+0000 7f11f6a45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e2645c0 0x56109e353890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42358/0 (socket says 172.21.15.178:42358) 2024-09-21T09:03:17.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.573+0000 7f11f6a45640 1 -- 172.21.15.178:0/2058848743 learned_addr learned my addr 172.21.15.178:0/2058848743 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.574+0000 7f11f6a45640 1 -- 172.21.15.178:0/2058848743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109e0fdbc0 con 0x56109e2645c0 2024-09-21T09:03:17.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.574+0000 7f11f6a45640 1 --2- 172.21.15.178:0/2058848743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e2645c0 0x56109e353890 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f11e800b560 tx=0x7f11e800ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6247394edaeb693e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.574+0000 7f10e4e09640 1 -- 172.21.15.178:0/2058848743 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11e8008070 con 0x56109e2645c0 2024-09-21T09:03:17.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.574+0000 7f10e4e09640 1 -- 172.21.15.178:0/2058848743 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e800d5c0 con 0x56109e2645c0 2024-09-21T09:03:17.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.574+0000 7f10e4e09640 1 -- 172.21.15.178:0/2058848743 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11e800d8e0 con 0x56109e2645c0 2024-09-21T09:03:17.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.575+0000 7f11f8f51800 1 -- 172.21.15.178:0/2058848743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e2645c0 msgr2=0x56109e353890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.575+0000 7f11f8f51800 1 --2- 172.21.15.178:0/2058848743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e2645c0 0x56109e353890 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f11e800b560 tx=0x7f11e800ba20 comp rx=0 tx=0).stop 2024-09-21T09:03:17.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.575+0000 7f11f8f51800 1 -- 172.21.15.178:0/2058848743 shutdown_connections 2024-09-21T09:03:17.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.575+0000 7f11f8f51800 1 --2- 172.21.15.178:0/2058848743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e2645c0 0x56109e353890 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.575+0000 7f11f8f51800 1 -- 172.21.15.178:0/2058848743 >> 172.21.15.178:0/2058848743 conn(0x56109e25fed0 msgr2=0x56109e34f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.575+0000 7f11f8f51800 1 -- 172.21.15.178:0/2058848743 shutdown_connections 2024-09-21T09:03:17.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.575+0000 7f11f8f51800 1 -- 172.21.15.178:0/2058848743 wait complete. 2024-09-21T09:03:17.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.575+0000 7f11f8f51800 1 Processor -- start 2024-09-21T09:03:17.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.575+0000 7f11f8f51800 1 -- start start 2024-09-21T09:03:17.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.575+0000 7f11f8f51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e2645c0 0x56109e35b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.575+0000 7f11f8f51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56109e26b630 con 0x56109e2645c0 2024-09-21T09:03:17.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.575+0000 7f11f6a45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e2645c0 0x56109e35b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.575+0000 7f11f6a45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e2645c0 0x56109e35b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42366/0 (socket says 172.21.15.178:42366) 2024-09-21T09:03:17.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.575+0000 7f11f6a45640 1 -- 172.21.15.178:0/2682853339 learned_addr learned my addr 172.21.15.178:0/2682853339 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.576+0000 7f11f6a45640 1 -- 172.21.15.178:0/2682853339 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109e111fe0 con 0x56109e2645c0 2024-09-21T09:03:17.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.576+0000 7f11f6a45640 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e2645c0 0x56109e35b340 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f11e800b500 tx=0x7f11e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.576+0000 7f10e3606640 1 -- 172.21.15.178:0/2682853339 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11e800f9d0 con 0x56109e2645c0 2024-09-21T09:03:17.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.576+0000 7f10e3606640 1 -- 172.21.15.178:0/2682853339 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e800fb70 con 0x56109e2645c0 2024-09-21T09:03:17.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.576+0000 7f10e3606640 1 -- 172.21.15.178:0/2682853339 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11e800fe50 con 0x56109e2645c0 2024-09-21T09:03:17.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.576+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56109e35b880 con 0x56109e2645c0 2024-09-21T09:03:17.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.576+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56109e35bda0 con 0x56109e2645c0 2024-09-21T09:03:17.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.577+0000 7f10e3606640 1 -- 172.21.15.178:0/2682853339 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f11e8017040 con 0x56109e2645c0 2024-09-21T09:03:17.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.577+0000 7f10e3606640 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10dc036d30 0x7f10dc0391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.577+0000 7f10e3606640 1 -- 172.21.15.178:0/2682853339 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f11e8015020 con 0x56109e2645c0 2024-09-21T09:03:17.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.577+0000 7f11ee244640 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10dc036d30 0x7f10dc0391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.577+0000 7f11f8f51800 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56109e268a00 0x56109e3623b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.577+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e3628f0 con 0x56109e268a00 2024-09-21T09:03:17.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.577+0000 7f11f7246640 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56109e268a00 0x56109e3623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.578+0000 7f11ee244640 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10dc036d30 0x7f10dc0391f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f11e0056000 tx=0x7f11e0050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.578+0000 7f11f7246640 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56109e268a00 0x56109e3623b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.578+0000 7f11f7246640 1 -- 172.21.15.178:0/2682853339 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11f000a4a0 con 0x56109e268a00 2024-09-21T09:03:17.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.578+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e35f980 con 0x56109e268a00 2024-09-21T09:03:17.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.578+0000 7f11f7246640 1 -- 172.21.15.178:0/2682853339 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f11f000a4a0 con 0x56109e268a00 2024-09-21T09:03:17.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.578+0000 7f11f8f51800 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56109e364c20 0x56109e367010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.578+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e367700 con 0x56109e364c20 2024-09-21T09:03:17.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.579+0000 7f11f6a45640 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56109e364c20 0x56109e367010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.579+0000 7f11f6a45640 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56109e364c20 0x56109e367010 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.579+0000 7f11f6a45640 1 -- 172.21.15.178:0/2682853339 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f11e802d070 con 0x56109e364c20 2024-09-21T09:03:17.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.579+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e363ac0 con 0x56109e268a00 2024-09-21T09:03:17.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.580+0000 7f11f7246640 1 -- 172.21.15.178:0/2682853339 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f11f000a4a0 con 0x56109e268a00 2024-09-21T09:03:17.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.580+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e363fa0 con 0x56109e268a00 2024-09-21T09:03:17.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.580+0000 7f11f7246640 1 -- 172.21.15.178:0/2682853339 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f11f000a4a0 con 0x56109e268a00 2024-09-21T09:03:17.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.580+0000 7f11f8f51800 1 Processor -- start 2024-09-21T09:03:17.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.580+0000 7f11f8f51800 1 -- start start 2024-09-21T09:03:17.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.580+0000 7f11f8f51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e1d9f20 0x56109e1d8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.580+0000 7f11f8f51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56109e0ff580 con 0x56109e1d9f20 2024-09-21T09:03:17.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.581+0000 7f11f7246640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e1d9f20 0x56109e1d8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.581+0000 7f11f7246640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e1d9f20 0x56109e1d8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42380/0 (socket says 172.21.15.178:42380) 2024-09-21T09:03:17.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.581+0000 7f11f7246640 1 -- 172.21.15.178:0/435385562 learned_addr learned my addr 172.21.15.178:0/435385562 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.581+0000 7f11f7246640 1 -- 172.21.15.178:0/435385562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109e1da340 con 0x56109e1d9f20 2024-09-21T09:03:17.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.581+0000 7f11f7246640 1 --2- 172.21.15.178:0/435385562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e1d9f20 0x56109e1d8570 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x56109e362cd0 tx=0x7f11f0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.581+0000 7f10e0e01640 1 -- 172.21.15.178:0/435385562 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11f0014450 con 0x56109e1d9f20 2024-09-21T09:03:17.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.581+0000 7f10e0e01640 1 -- 172.21.15.178:0/435385562 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f0014610 con 0x56109e1d9f20 2024-09-21T09:03:17.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.581+0000 7f10e0e01640 1 -- 172.21.15.178:0/435385562 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11f0014930 con 0x56109e1d9f20 2024-09-21T09:03:17.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.581+0000 7f11f8f51800 1 -- 172.21.15.178:0/435385562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56109e1d8b70 con 0x56109e1d9f20 2024-09-21T09:03:17.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.581+0000 7f11f8f51800 1 -- 172.21.15.178:0/435385562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56109e1d9070 con 0x56109e1d9f20 2024-09-21T09:03:17.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.582+0000 7f10e0e01640 1 -- 172.21.15.178:0/435385562 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f11f0011040 con 0x56109e1d9f20 2024-09-21T09:03:17.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.582+0000 7f10e0e01640 1 --2- 172.21.15.178:0/435385562 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10d0036b90 0x7f10d0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.582+0000 7f10e0e01640 1 -- 172.21.15.178:0/435385562 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f11f001e070 con 0x56109e1d9f20 2024-09-21T09:03:17.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.582+0000 7f11f6a45640 1 --2- 172.21.15.178:0/435385562 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10d0036b90 0x7f10d0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.582+0000 7f11f8f51800 1 Processor -- start 2024-09-21T09:03:17.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.583+0000 7f11f8f51800 1 -- start start 2024-09-21T09:03:17.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.583+0000 7f11f6a45640 1 --2- 172.21.15.178:0/435385562 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10d0036b90 0x7f10d0039050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x56109e362d70 tx=0x7f11e800ba20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.583+0000 7f11f8f51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e384e70 0x56109e385270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.583+0000 7f11f8f51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56109e354040 con 0x56109e384e70 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.583+0000 7f11f7246640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e384e70 0x56109e385270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.583+0000 7f11f7246640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e384e70 0x56109e385270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42384/0 (socket says 172.21.15.178:42384) 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.583+0000 7f11f7246640 1 -- 172.21.15.178:0/22226992 learned_addr learned my addr 172.21.15.178:0/22226992 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.583+0000 7f11f7246640 1 -- 172.21.15.178:0/22226992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109e385840 con 0x56109e384e70 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.583+0000 7f11f7246640 1 --2- 172.21.15.178:0/22226992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e384e70 0x56109e385270 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f11f004cb90 tx=0x7f11f0011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc281f47eb9db101 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.584+0000 7f10da7fc640 1 -- 172.21.15.178:0/22226992 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11f0044070 con 0x56109e384e70 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.584+0000 7f10da7fc640 1 -- 172.21.15.178:0/22226992 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f00167c0 con 0x56109e384e70 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.584+0000 7f10da7fc640 1 -- 172.21.15.178:0/22226992 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11f0013ca0 con 0x56109e384e70 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.584+0000 7f11f8f51800 1 -- 172.21.15.178:0/22226992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e384e70 msgr2=0x56109e385270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.584+0000 7f11f8f51800 1 --2- 172.21.15.178:0/22226992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e384e70 0x56109e385270 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f11f004cb90 tx=0x7f11f0011700 comp rx=0 tx=0).stop 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.584+0000 7f11f8f51800 1 -- 172.21.15.178:0/22226992 shutdown_connections 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.584+0000 7f11f8f51800 1 --2- 172.21.15.178:0/22226992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e384e70 0x56109e385270 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.584+0000 7f11f8f51800 1 -- 172.21.15.178:0/22226992 >> 172.21.15.178:0/22226992 conn(0x56109e3811d0 msgr2=0x56109e37f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.584+0000 7f11f8f51800 1 -- 172.21.15.178:0/22226992 shutdown_connections 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.584+0000 7f11f8f51800 1 -- 172.21.15.178:0/22226992 wait complete. 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.584+0000 7f11f8f51800 1 Processor -- start 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.584+0000 7f11f8f51800 1 -- start start 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.585+0000 7f11f8f51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e384e70 0x56109e38c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.585+0000 7f11f8f51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56109e385dc0 con 0x56109e384e70 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.585+0000 7f11f7246640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e384e70 0x56109e38c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.585+0000 7f11f7246640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e384e70 0x56109e38c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42396/0 (socket says 172.21.15.178:42396) 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.585+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 learned_addr learned my addr 172.21.15.178:0/1971292276 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.585+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109e38c7c0 con 0x56109e384e70 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.585+0000 7f11f7246640 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e384e70 0x56109e38c280 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f11f004bab0 tx=0x7f11f004cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.585+0000 7f10d8ff9640 1 -- 172.21.15.178:0/1971292276 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11f0016440 con 0x56109e384e70 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.585+0000 7f10d8ff9640 1 -- 172.21.15.178:0/1971292276 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f004e2e0 con 0x56109e384e70 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.585+0000 7f10d8ff9640 1 -- 172.21.15.178:0/1971292276 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11f0022a50 con 0x56109e384e70 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.585+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56109e38ca50 con 0x56109e384e70 2024-09-21T09:03:17.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.585+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56109e38f700 con 0x56109e384e70 2024-09-21T09:03:17.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.586+0000 7f10d8ff9640 1 -- 172.21.15.178:0/1971292276 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f11f003e020 con 0x56109e384e70 2024-09-21T09:03:17.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.586+0000 7f10d8ff9640 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10c0036b90 0x7f10c0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.586+0000 7f10d8ff9640 1 -- 172.21.15.178:0/1971292276 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f11f003c020 con 0x56109e384e70 2024-09-21T09:03:17.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.586+0000 7f11f6a45640 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10c0036b90 0x7f10c0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.586+0000 7f11f8f51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11f8f51800 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56109e397ee0 0x56109e39a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e39aaf0 con 0x56109e397ee0 2024-09-21T09:03:17.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11f6a45640 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10c0036b90 0x7f10c0039050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f11e8018980 tx=0x7f11e8033040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11ee244640 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56109e397ee0 0x56109e39a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11ee244640 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56109e397ee0 0x56109e39a3a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11f8f51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11f8f51800 20 realm 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11f8f51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e39aec0 con 0x56109e397ee0 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11f8f51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11f8f51800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11f8f51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.587+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e39b790 con 0x56109e397ee0 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.588+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.588+0000 7f11f8f51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.588+0000 7f11f8f51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.588+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e39bb30 con 0x56109e397ee0 2024-09-21T09:03:17.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.588+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.588+0000 7f11f8f51800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.588+0000 7f11f8f51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.588+0000 7f11f8f51800 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56109e39c5e0 0x56109e39e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.588+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e39c5e0 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.588+0000 7f11f7246640 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56109e39c5e0 0x56109e39e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.589+0000 7f11f7246640 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56109e39c5e0 0x56109e39e9d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.589+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.589+0000 7f11f8f51800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.589+0000 7f11f8f51800 20 searching for the correct realm 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.589+0000 7f11f8f51800 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56109e3a11e0 0x56109e3a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.589+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a3d70 con 0x56109e3a11e0 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.589+0000 7f11f6a45640 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56109e3a11e0 0x56109e3a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.589+0000 7f11f6a45640 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56109e3a11e0 0x56109e3a36a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.590+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e802d070 con 0x56109e3a11e0 2024-09-21T09:03:17.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.590+0000 7f11f6a45640 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f11e8019470 0x7f11e801c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.590+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a3d70 con 0x7f11e8019470 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.590+0000 7f11ee244640 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f11e8019470 0x7f11e801c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.590+0000 7f11ee244640 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f11e8019470 0x7f11e801c5e0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.590+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e0054840 con 0x7f11e8019470 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.590+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a3d70 con 0x56109e39c5e0 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.590+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.590+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e397ee0 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.591+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.591+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e397ee0 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.591+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.591+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e39c5e0 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.591+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.591+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e39c5e0 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.592+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.592+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x7f11e8019470 2024-09-21T09:03:17.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.592+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e0054840 con 0x7f11e8019470 2024-09-21T09:03:17.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.592+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e3a11e0 2024-09-21T09:03:17.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.592+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e802d070 con 0x56109e3a11e0 2024-09-21T09:03:17.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.592+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e397ee0 2024-09-21T09:03:17.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.592+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.592+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e39c5e0 2024-09-21T09:03:17.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.593+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.593+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e397ee0 2024-09-21T09:03:17.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.593+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.593+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x7f11e8019470 2024-09-21T09:03:17.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.593+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f11e0054840 con 0x7f11e8019470 2024-09-21T09:03:17.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.593+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e3a11e0 2024-09-21T09:03:17.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.593+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e802d070 con 0x56109e3a11e0 2024-09-21T09:03:17.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.593+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e3a11e0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.593+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e802d070 con 0x56109e3a11e0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.593+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e39c5e0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.594+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.594+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e3a11e0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.594+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e802d070 con 0x56109e3a11e0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.594+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e3a11e0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.594+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e802d070 con 0x56109e3a11e0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.594+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e397ee0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.594+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.594+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e397ee0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.595+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.595+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e39c5e0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.595+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.595+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e3a11e0 2024-09-21T09:03:17.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.595+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e802d070 con 0x56109e3a11e0 2024-09-21T09:03:17.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.595+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x7f11e8019470 2024-09-21T09:03:17.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.595+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e0054840 con 0x7f11e8019470 2024-09-21T09:03:17.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.595+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e397ee0 2024-09-21T09:03:17.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.595+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.596+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e39c5e0 2024-09-21T09:03:17.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.596+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.596+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e3a11e0 2024-09-21T09:03:17.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.596+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e802d070 con 0x56109e3a11e0 2024-09-21T09:03:17.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.596+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e39c5e0 2024-09-21T09:03:17.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.596+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.596+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x7f11e8019470 2024-09-21T09:03:17.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.597+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e0054840 con 0x7f11e8019470 2024-09-21T09:03:17.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.597+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e3a11e0 2024-09-21T09:03:17.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.597+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e802d070 con 0x56109e3a11e0 2024-09-21T09:03:17.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.597+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e39c5e0 2024-09-21T09:03:17.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.597+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.597+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x56109e397ee0 2024-09-21T09:03:17.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.597+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.597+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56109e39f130 con 0x7f11e8019470 2024-09-21T09:03:17.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11e0054840 con 0x7f11e8019470 2024-09-21T09:03:17.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:17.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:17.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:17.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e39fae0 con 0x56109e397ee0 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e39fed0 con 0x56109e397ee0 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a02f0 con 0x56109e397ee0 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:17.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 zone default found 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 4 Realm: () 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 zonegroup default 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.598+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a0720 con 0x56109e39c5e0 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.599+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.599+0000 7f11f8f51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.599+0000 7f11f8f51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.599+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a6080 con 0x56109e3a11e0 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.599+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f11e802d070 con 0x56109e3a11e0 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.599+0000 7f11f8f51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.599+0000 7f11f8f51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.599+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a6420 con 0x56109e3a11e0 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.600+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f11e802d070 con 0x56109e3a11e0 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.600+0000 7f11f8f51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.600+0000 7f11f8f51800 20 started sync module instance, tier type = 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.600+0000 7f11f8f51800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.600+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a54c0 con 0x7f11e8019470 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.601+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x7f11e8019470 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.601+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94629374089440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a54c0 con 0x7f11e8019470 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.601+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a6de0 con 0x56109e397ee0 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.602+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94629374089440] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x7f11e8019470 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.602+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.602+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94629374087664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a6de0 con 0x56109e397ee0 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.602+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a77a0 con 0x56109e3a11e0 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.603+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94629374087664] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.603+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e802d070 con 0x56109e3a11e0 2024-09-21T09:03:17.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.603+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94629374093616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a6d50 con 0x56109e3a11e0 2024-09-21T09:03:17.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.603+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a8660 con 0x7f11e8019470 2024-09-21T09:03:17.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.604+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94629374093616] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e802d070 con 0x56109e3a11e0 2024-09-21T09:03:17.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.604+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x7f11e8019470 2024-09-21T09:03:17.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.604+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94629374099888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a8a80 con 0x7f11e8019470 2024-09-21T09:03:17.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.604+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a9440 con 0x56109e397ee0 2024-09-21T09:03:17.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.605+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94629374099888] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x7f11e8019470 2024-09-21T09:03:17.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.605+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.605+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94629374101424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a9440 con 0x56109e397ee0 2024-09-21T09:03:17.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.605+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a9e00 con 0x56109e39c5e0 2024-09-21T09:03:17.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.606+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.606+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94629374105936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3aa220 con 0x56109e39c5e0 2024-09-21T09:03:17.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.606+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3aad20 con 0x56109e39c5e0 2024-09-21T09:03:17.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.606+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94629374101424] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.607+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94629374105936] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.607+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.607+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94629374109712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a9df0 con 0x56109e39c5e0 2024-09-21T09:03:17.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.607+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3ab3b0 con 0x56109e39c5e0 2024-09-21T09:03:17.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.609+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94629374109712] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.609+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.609+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94629374103440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3ab3b0 con 0x56109e39c5e0 2024-09-21T09:03:17.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.609+0000 7f11f8f51800 20 add_watcher() i=0 2024-09-21T09:03:17.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.609+0000 7f11f8f51800 20 add_watcher() i=1 2024-09-21T09:03:17.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.609+0000 7f11f8f51800 20 add_watcher() i=2 2024-09-21T09:03:17.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.609+0000 7f11f8f51800 20 add_watcher() i=3 2024-09-21T09:03:17.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.609+0000 7f11f8f51800 20 add_watcher() i=4 2024-09-21T09:03:17.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.609+0000 7f11f8f51800 20 add_watcher() i=5 2024-09-21T09:03:17.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.609+0000 7f11f8f51800 20 add_watcher() i=6 2024-09-21T09:03:17.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.610+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94629374103440] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.610+0000 7f11f8f51800 20 add_watcher() i=7 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.610+0000 7f11f8f51800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.610+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e3ae5d0 con 0x56109e397ee0 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.610+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.610+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94629374111856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3ab940 con 0x56109e397ee0 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.611+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94629374111856] v29'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.611+0000 7f10ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.611+0000 7f11f8f51800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.611+0000 7f11f8f51800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.611+0000 7f11f8f51800 5 note: GC not initialized 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.611+0000 7f1027fff640 20 reqs_thread_entry: start 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.611+0000 7f11f8f51800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.612+0000 7f11f8f51800 20 Filter name: none 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.612+0000 7f1025ffb640 20 reqs_thread_entry: start 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.612+0000 7f11f8f51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.612+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56109e3e1550 con 0x56109e397ee0 2024-09-21T09:03:17.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.612+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.612+0000 7f11f8f51800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:17.619 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:17.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.613+0000 7f10ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.613+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94629374111856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3ad670 con 0x56109e397ee0 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.614+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94629374111856] v29'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.614+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94629374089440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3ab070 con 0x7f11e8019470 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.615+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94629374089440] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x7f11e8019470 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.615+0000 7f11f8f51800 20 remove_watcher() i=0 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.615+0000 7f11f8f51800 2 removed watcher, disabling cache 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.615+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94629374087664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3ab070 con 0x56109e397ee0 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.616+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94629374087664] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.616+0000 7f11f8f51800 20 remove_watcher() i=1 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.616+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94629374093616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a51f0 con 0x56109e3a11e0 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.617+0000 7f11f6a45640 1 -- 172.21.15.178:0/1971292276 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94629374093616] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e802d070 con 0x56109e3a11e0 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.617+0000 7f11f8f51800 20 remove_watcher() i=2 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.617+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94629374099888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3ab070 con 0x7f11e8019470 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.618+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94629374099888] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x7f11e8019470 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.618+0000 7f11f8f51800 20 remove_watcher() i=3 2024-09-21T09:03:17.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.618+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94629374101424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a6930 con 0x56109e397ee0 2024-09-21T09:03:17.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.619+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94629374101424] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11e0054840 con 0x56109e397ee0 2024-09-21T09:03:17.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.619+0000 7f11f8f51800 20 remove_watcher() i=4 2024-09-21T09:03:17.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.619+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94629374105936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a81b0 con 0x56109e39c5e0 2024-09-21T09:03:17.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.620+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94629374105936] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.620+0000 7f11f8f51800 20 remove_watcher() i=5 2024-09-21T09:03:17.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.620+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94629374109712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3ab070 con 0x56109e39c5e0 2024-09-21T09:03:17.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.621+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94629374109712] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.621+0000 7f11f8f51800 20 remove_watcher() i=6 2024-09-21T09:03:17.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.621+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94629374103440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56109e3a87b0 con 0x56109e39c5e0 2024-09-21T09:03:17.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f7246640 1 -- 172.21.15.178:0/1971292276 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94629374103440] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f002a070 con 0x56109e39c5e0 2024-09-21T09:03:17.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 20 remove_watcher() i=7 2024-09-21T09:03:17.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56109e39c5e0 msgr2=0x56109e39e9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56109e39c5e0 0x56109e39e9d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56109e397ee0 msgr2=0x56109e39a3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56109e397ee0 0x56109e39a3a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f11e8019470 msgr2=0x7f11e801c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f11e8019470 0x7f11e801c5e0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56109e3a11e0 msgr2=0x56109e3a36a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56109e3a11e0 0x56109e3a36a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10c0036b90 msgr2=0x7f10c0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10c0036b90 0x7f10c0039050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f11e8018980 tx=0x7f11e8033040 comp rx=0 tx=0).stop 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e384e70 msgr2=0x56109e38c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e384e70 0x56109e38c280 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f11f004bab0 tx=0x7f11f004cb20 comp rx=0 tx=0).stop 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11ee244640 1 -- 172.21.15.178:0/1971292276 reap_dead start 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 shutdown_connections 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 --2- 172.21.15.178:0/1971292276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e384e70 0x56109e38c280 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 >> 172.21.15.178:0/1971292276 conn(0x56109e3811d0 msgr2=0x56109e37f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 shutdown_connections 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.622+0000 7f11f8f51800 1 -- 172.21.15.178:0/1971292276 wait complete. 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 -- 172.21.15.178:0/435385562 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10d0036b90 msgr2=0x7f10d0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 --2- 172.21.15.178:0/435385562 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10d0036b90 0x7f10d0039050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x56109e362d70 tx=0x7f11e800ba20 comp rx=0 tx=0).stop 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 -- 172.21.15.178:0/435385562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e1d9f20 msgr2=0x56109e1d8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 --2- 172.21.15.178:0/435385562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e1d9f20 0x56109e1d8570 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x56109e362cd0 tx=0x7f11f0018830 comp rx=0 tx=0).stop 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 -- 172.21.15.178:0/435385562 shutdown_connections 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 --2- 172.21.15.178:0/435385562 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10d0036b90 0x7f10d0039050 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 --2- 172.21.15.178:0/435385562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e1d9f20 0x56109e1d8570 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 -- 172.21.15.178:0/435385562 >> 172.21.15.178:0/435385562 conn(0x56109e36afa0 msgr2=0x56109e36db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 -- 172.21.15.178:0/435385562 shutdown_connections 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 -- 172.21.15.178:0/435385562 wait complete. 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56109e364c20 msgr2=0x56109e367010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56109e364c20 0x56109e367010 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56109e268a00 msgr2=0x56109e3623b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56109e268a00 0x56109e3623b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10dc036d30 msgr2=0x7f10dc0391f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10dc036d30 0x7f10dc0391f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f11e0056000 tx=0x7f11e0050000 comp rx=0 tx=0).stop 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e2645c0 msgr2=0x56109e35b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e2645c0 0x56109e35b340 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f11e800b500 tx=0x7f11e8000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 shutdown_connections 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56109e364c20 0x56109e367010 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56109e268a00 0x56109e3623b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f10dc036d30 0x7f10dc0391f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 --2- 172.21.15.178:0/2682853339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56109e2645c0 0x56109e35b340 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 >> 172.21.15.178:0/2682853339 conn(0x56109e25fed0 msgr2=0x56109e34db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 shutdown_connections 2024-09-21T09:03:17.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.623+0000 7f11f8f51800 1 -- 172.21.15.178:0/2682853339 wait complete. 2024-09-21T09:03:17.634 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:17.634 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-21T09:03:17.634 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-21T09:03:17.634 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-21T09:03:17.682 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:17.682 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:17.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.681+0000 7ff556924800 1 Processor -- start 2024-09-21T09:03:17.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.681+0000 7ff556924800 1 -- start start 2024-09-21T09:03:17.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.681+0000 7ff556924800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5627f26b3dd0 0x5627f26b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.681+0000 7ff556924800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5627f256cb30 con 0x5627f2621610 2024-09-21T09:03:17.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.681+0000 7ff556924800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5627f254e360 con 0x5627f26b3dd0 2024-09-21T09:03:17.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.681+0000 7ff551eab640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5627f26b3dd0 0x5627f26b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.681+0000 7ff5526ac640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5627f2621610 0x5627f26b26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46600/0 (socket says 172.21.15.178:46600) 2024-09-21T09:03:17.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.681+0000 7ff5526ac640 1 -- 172.21.15.178:0/922617621 learned_addr learned my addr 172.21.15.178:0/922617621 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:17.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.682+0000 7ff5516aa640 1 -- 172.21.15.178:0/922617621 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3286530579 0 0) 0x5627f256cb30 con 0x5627f2621610 2024-09-21T09:03:17.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.682+0000 7ff5516aa640 1 -- 172.21.15.178:0/922617621 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff53c001e10 con 0x5627f2621610 2024-09-21T09:03:17.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.682+0000 7ff551eab640 1 -- 172.21.15.178:0/922617621 >> v1:172.21.15.44:6789/0 conn(0x5627f2621610 legacy=0x5627f26b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.682+0000 7ff551eab640 1 -- 172.21.15.178:0/922617621 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f2574e00 con 0x5627f26b3dd0 2024-09-21T09:03:17.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.684+0000 7ff551eab640 1 --2- 172.21.15.178:0/922617621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f26b3dd0 0x5627f26b61c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff54800a470 tx=0x7ff548045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c054bbb774903dab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.684+0000 7ff5516aa640 1 -- 172.21.15.178:0/922617621 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff548059070 con 0x5627f26b3dd0 2024-09-21T09:03:17.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.684+0000 7ff5516aa640 1 -- 172.21.15.178:0/922617621 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff548054570 con 0x5627f26b3dd0 2024-09-21T09:03:17.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.684+0000 7ff5516aa640 1 -- 172.21.15.178:0/922617621 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff548054870 con 0x5627f26b3dd0 2024-09-21T09:03:17.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.684+0000 7ff556924800 1 -- 172.21.15.178:0/922617621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f26b3dd0 msgr2=0x5627f26b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.684+0000 7ff556924800 1 --2- 172.21.15.178:0/922617621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f26b3dd0 0x5627f26b61c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff54800a470 tx=0x7ff548045920 comp rx=0 tx=0).stop 2024-09-21T09:03:17.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.684+0000 7ff556924800 1 -- 172.21.15.178:0/922617621 shutdown_connections 2024-09-21T09:03:17.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.684+0000 7ff556924800 1 --2- 172.21.15.178:0/922617621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f26b3dd0 0x5627f26b61c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.684+0000 7ff556924800 1 -- 172.21.15.178:0/922617621 >> 172.21.15.178:0/922617621 conn(0x5627f26a7e00 msgr2=0x5627f26aa220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.684+0000 7ff556924800 1 -- 172.21.15.178:0/922617621 shutdown_connections 2024-09-21T09:03:17.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.684+0000 7ff556924800 1 -- 172.21.15.178:0/922617621 wait complete. 2024-09-21T09:03:17.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.698+0000 7ff556924800 1 Processor -- start 2024-09-21T09:03:17.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.698+0000 7ff556924800 1 -- start start 2024-09-21T09:03:17.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.698+0000 7ff556924800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f2621610 0x5627f279e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.698+0000 7ff556924800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5627f25f9350 con 0x5627f2621610 2024-09-21T09:03:17.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.698+0000 7ff5526ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f2621610 0x5627f279e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.699+0000 7ff5526ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f2621610 0x5627f279e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42404/0 (socket says 172.21.15.178:42404) 2024-09-21T09:03:17.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.699+0000 7ff5526ac640 1 -- 172.21.15.178:0/2625227538 learned_addr learned my addr 172.21.15.178:0/2625227538 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.699+0000 7ff5526ac640 1 -- 172.21.15.178:0/2625227538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f2546bc0 con 0x5627f2621610 2024-09-21T09:03:17.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.699+0000 7ff5526ac640 1 --2- 172.21.15.178:0/2625227538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f2621610 0x5627f279e990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff544001680 tx=0x7ff544001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14a34ca187a599e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.699+0000 7ff440608640 1 -- 172.21.15.178:0/2625227538 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff544016070 con 0x5627f2621610 2024-09-21T09:03:17.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.699+0000 7ff440608640 1 -- 172.21.15.178:0/2625227538 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff544004520 con 0x5627f2621610 2024-09-21T09:03:17.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.699+0000 7ff440608640 1 -- 172.21.15.178:0/2625227538 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff544004880 con 0x5627f2621610 2024-09-21T09:03:17.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.700+0000 7ff556924800 1 -- 172.21.15.178:0/2625227538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f2621610 msgr2=0x5627f279e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.700+0000 7ff556924800 1 --2- 172.21.15.178:0/2625227538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f2621610 0x5627f279e990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff544001680 tx=0x7ff544001b40 comp rx=0 tx=0).stop 2024-09-21T09:03:17.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.700+0000 7ff556924800 1 -- 172.21.15.178:0/2625227538 shutdown_connections 2024-09-21T09:03:17.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.700+0000 7ff556924800 1 --2- 172.21.15.178:0/2625227538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f2621610 0x5627f279e990 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.700+0000 7ff556924800 1 -- 172.21.15.178:0/2625227538 >> 172.21.15.178:0/2625227538 conn(0x5627f26a7e00 msgr2=0x5627f279a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.700+0000 7ff556924800 1 -- 172.21.15.178:0/2625227538 shutdown_connections 2024-09-21T09:03:17.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.700+0000 7ff556924800 1 -- 172.21.15.178:0/2625227538 wait complete. 2024-09-21T09:03:17.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.700+0000 7ff556924800 1 Processor -- start 2024-09-21T09:03:17.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.700+0000 7ff556924800 1 -- start start 2024-09-21T09:03:17.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.700+0000 7ff556924800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f26b3dd0 0x5627f27a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.700+0000 7ff556924800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5627f26b69a0 con 0x5627f26b3dd0 2024-09-21T09:03:17.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.701+0000 7ff5526ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f26b3dd0 0x5627f27a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.701+0000 7ff5526ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f26b3dd0 0x5627f27a65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42406/0 (socket says 172.21.15.178:42406) 2024-09-21T09:03:17.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.701+0000 7ff5526ac640 1 -- 172.21.15.178:0/851534358 learned_addr learned my addr 172.21.15.178:0/851534358 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.701+0000 7ff5526ac640 1 -- 172.21.15.178:0/851534358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f255afe0 con 0x5627f26b3dd0 2024-09-21T09:03:17.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.701+0000 7ff5526ac640 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f26b3dd0 0x5627f27a65e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff544014040 tx=0x7ff544001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.701+0000 7ff43ee05640 1 -- 172.21.15.178:0/851534358 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff544016070 con 0x5627f26b3dd0 2024-09-21T09:03:17.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.701+0000 7ff43ee05640 1 -- 172.21.15.178:0/851534358 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff544011740 con 0x5627f26b3dd0 2024-09-21T09:03:17.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.701+0000 7ff43ee05640 1 -- 172.21.15.178:0/851534358 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff544011a60 con 0x5627f26b3dd0 2024-09-21T09:03:17.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.701+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627f27a6b20 con 0x5627f26b3dd0 2024-09-21T09:03:17.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.701+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627f27a7040 con 0x5627f26b3dd0 2024-09-21T09:03:17.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.702+0000 7ff43ee05640 1 -- 172.21.15.178:0/851534358 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff544024020 con 0x5627f26b3dd0 2024-09-21T09:03:17.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.702+0000 7ff43ee05640 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff438036b90 0x7ff438039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.702+0000 7ff43ee05640 1 -- 172.21.15.178:0/851534358 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff544022020 con 0x5627f26b3dd0 2024-09-21T09:03:17.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.702+0000 7ff551eab640 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff438036b90 0x7ff438039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.702+0000 7ff556924800 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5627f27ab640 0x5627f27ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.703+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27adf70 con 0x5627f27ab640 2024-09-21T09:03:17.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.703+0000 7ff552ead640 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5627f27ab640 0x5627f27ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.703+0000 7ff551eab640 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff438036b90 0x7ff438039050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x5627f2620d50 tx=0x7ff548050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.703+0000 7ff552ead640 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5627f27ab640 0x5627f27ada30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.703+0000 7ff552ead640 1 -- 172.21.15.178:0/851534358 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff54c0083e0 con 0x5627f27ab640 2024-09-21T09:03:17.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.703+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27aab70 con 0x5627f27ab640 2024-09-21T09:03:17.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.703+0000 7ff552ead640 1 -- 172.21.15.178:0/851534358 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff54c0083e0 con 0x5627f27ab640 2024-09-21T09:03:17.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.704+0000 7ff556924800 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5627f27b0060 0x5627f27b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.704+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27b2cb0 con 0x5627f27b0060 2024-09-21T09:03:17.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.704+0000 7ff5526ac640 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5627f27b0060 0x5627f27b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.704+0000 7ff5526ac640 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5627f27b0060 0x5627f27b2520 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.704+0000 7ff5526ac640 1 -- 172.21.15.178:0/851534358 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27b0060 2024-09-21T09:03:17.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.704+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27ae830 con 0x5627f27ab640 2024-09-21T09:03:17.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.705+0000 7ff552ead640 1 -- 172.21.15.178:0/851534358 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff54c0083e0 con 0x5627f27ab640 2024-09-21T09:03:17.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.705+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27aec50 con 0x5627f27ab640 2024-09-21T09:03:17.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.705+0000 7ff552ead640 1 -- 172.21.15.178:0/851534358 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff54c0083e0 con 0x5627f27ab640 2024-09-21T09:03:17.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.705+0000 7ff556924800 1 Processor -- start 2024-09-21T09:03:17.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.705+0000 7ff556924800 1 -- start start 2024-09-21T09:03:17.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.705+0000 7ff556924800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27c1630 0x5627f27c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.705+0000 7ff556924800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5627f2548580 con 0x5627f27c1630 2024-09-21T09:03:17.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.706+0000 7ff552ead640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27c1630 0x5627f27c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.706+0000 7ff552ead640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27c1630 0x5627f27c1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42410/0 (socket says 172.21.15.178:42410) 2024-09-21T09:03:17.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.706+0000 7ff552ead640 1 -- 172.21.15.178:0/2391999537 learned_addr learned my addr 172.21.15.178:0/2391999537 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.706+0000 7ff552ead640 1 -- 172.21.15.178:0/2391999537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f27c1f90 con 0x5627f27c1630 2024-09-21T09:03:17.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.706+0000 7ff552ead640 1 --2- 172.21.15.178:0/2391999537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27c1630 0x5627f27c1a50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5627f27a79e0 tx=0x7ff54c00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.706+0000 7ff437fff640 1 -- 172.21.15.178:0/2391999537 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff54c010d50 con 0x5627f27c1630 2024-09-21T09:03:17.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.706+0000 7ff437fff640 1 -- 172.21.15.178:0/2391999537 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54c01f020 con 0x5627f27c1630 2024-09-21T09:03:17.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.706+0000 7ff556924800 1 -- 172.21.15.178:0/2391999537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627f27c2220 con 0x5627f27c1630 2024-09-21T09:03:17.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.706+0000 7ff437fff640 1 -- 172.21.15.178:0/2391999537 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff54c01a430 con 0x5627f27c1630 2024-09-21T09:03:17.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.706+0000 7ff556924800 1 -- 172.21.15.178:0/2391999537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627f27c4f00 con 0x5627f27c1630 2024-09-21T09:03:17.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.707+0000 7ff437fff640 1 -- 172.21.15.178:0/2391999537 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff54c013030 con 0x5627f27c1630 2024-09-21T09:03:17.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.707+0000 7ff437fff640 1 --2- 172.21.15.178:0/2391999537 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff42c036b90 0x7ff42c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.707+0000 7ff437fff640 1 -- 172.21.15.178:0/2391999537 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff54c020030 con 0x5627f27c1630 2024-09-21T09:03:17.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.707+0000 7ff5526ac640 1 --2- 172.21.15.178:0/2391999537 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff42c036b90 0x7ff42c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.708+0000 7ff556924800 1 Processor -- start 2024-09-21T09:03:17.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.708+0000 7ff556924800 1 -- start start 2024-09-21T09:03:17.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.708+0000 7ff5526ac640 1 --2- 172.21.15.178:0/2391999537 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff42c036b90 0x7ff42c039050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5627f27af3d0 tx=0x7ff54401be40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.708+0000 7ff556924800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27ce230 0x5627f27ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.708+0000 7ff556924800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5627f279f140 con 0x5627f27ce230 2024-09-21T09:03:17.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.708+0000 7ff552ead640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27ce230 0x5627f27ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.708+0000 7ff552ead640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27ce230 0x5627f27ce630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42426/0 (socket says 172.21.15.178:42426) 2024-09-21T09:03:17.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.708+0000 7ff552ead640 1 -- 172.21.15.178:0/669206093 learned_addr learned my addr 172.21.15.178:0/669206093 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.708+0000 7ff552ead640 1 -- 172.21.15.178:0/669206093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f27cec00 con 0x5627f27ce230 2024-09-21T09:03:17.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.708+0000 7ff552ead640 1 --2- 172.21.15.178:0/669206093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27ce230 0x5627f27ce630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff54c04d390 tx=0x7ff54c018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a817fb40dc9bb86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.709+0000 7ff435ffb640 1 -- 172.21.15.178:0/669206093 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff54c01e030 con 0x5627f27ce230 2024-09-21T09:03:17.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.709+0000 7ff435ffb640 1 -- 172.21.15.178:0/669206093 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54c046070 con 0x5627f27ce230 2024-09-21T09:03:17.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.709+0000 7ff435ffb640 1 -- 172.21.15.178:0/669206093 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff54c024410 con 0x5627f27ce230 2024-09-21T09:03:17.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.709+0000 7ff556924800 1 -- 172.21.15.178:0/669206093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27ce230 msgr2=0x5627f27ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.709+0000 7ff556924800 1 --2- 172.21.15.178:0/669206093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27ce230 0x5627f27ce630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff54c04d390 tx=0x7ff54c018fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.709+0000 7ff556924800 1 -- 172.21.15.178:0/669206093 shutdown_connections 2024-09-21T09:03:17.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.709+0000 7ff556924800 1 --2- 172.21.15.178:0/669206093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27ce230 0x5627f27ce630 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.709+0000 7ff556924800 1 -- 172.21.15.178:0/669206093 >> 172.21.15.178:0/669206093 conn(0x5627f27ca590 msgr2=0x5627f27c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.709+0000 7ff556924800 1 -- 172.21.15.178:0/669206093 shutdown_connections 2024-09-21T09:03:17.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.709+0000 7ff556924800 1 -- 172.21.15.178:0/669206093 wait complete. 2024-09-21T09:03:17.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.709+0000 7ff556924800 1 Processor -- start 2024-09-21T09:03:17.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.709+0000 7ff556924800 1 -- start start 2024-09-21T09:03:17.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.710+0000 7ff556924800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27ce230 0x5627f27d56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.710+0000 7ff556924800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5627f27cf270 con 0x5627f27ce230 2024-09-21T09:03:17.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.710+0000 7ff552ead640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27ce230 0x5627f27d56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.710+0000 7ff552ead640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27ce230 0x5627f27d56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42428/0 (socket says 172.21.15.178:42428) 2024-09-21T09:03:17.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.710+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 learned_addr learned my addr 172.21.15.178:0/10595105 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.710+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f27d5be0 con 0x5627f27ce230 2024-09-21T09:03:17.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.710+0000 7ff552ead640 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27ce230 0x5627f27d56a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff54c04c080 tx=0x7ff54c04d0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.710+0000 7ff423fff640 1 -- 172.21.15.178:0/10595105 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff54c0189b0 con 0x5627f27ce230 2024-09-21T09:03:17.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.710+0000 7ff423fff640 1 -- 172.21.15.178:0/10595105 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54c0233c0 con 0x5627f27ce230 2024-09-21T09:03:17.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.710+0000 7ff423fff640 1 -- 172.21.15.178:0/10595105 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff54c0163f0 con 0x5627f27ce230 2024-09-21T09:03:17.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.710+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627f27d5e70 con 0x5627f27ce230 2024-09-21T09:03:17.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.710+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627f27d8b20 con 0x5627f27ce230 2024-09-21T09:03:17.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.711+0000 7ff423fff640 1 -- 172.21.15.178:0/10595105 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff54c007370 con 0x5627f27ce230 2024-09-21T09:03:17.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.711+0000 7ff423fff640 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff41c036b40 0x7ff41c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.711+0000 7ff423fff640 1 -- 172.21.15.178:0/10595105 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff54c035070 con 0x5627f27ce230 2024-09-21T09:03:17.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.711+0000 7ff5526ac640 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff41c036b40 0x7ff41c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.712+0000 7ff5526ac640 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff41c036b40 0x7ff41c039000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff54401beb0 tx=0x7ff544032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.712+0000 7ff556924800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.712+0000 7ff556924800 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5627f27e1170 0x5627f27e3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.712+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e3d80 con 0x5627f27e1170 2024-09-21T09:03:17.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.712+0000 7ff551eab640 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5627f27e1170 0x5627f27e3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff551eab640 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5627f27e1170 0x5627f27e3630 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 20 realm 2024-09-21T09:03:17.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e41b0 con 0x5627f27e1170 2024-09-21T09:03:17.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:17.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e4a80 con 0x5627f27e1170 2024-09-21T09:03:17.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e4e20 con 0x5627f27e1170 2024-09-21T09:03:17.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5627f27e5b80 0x5627f27e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.713+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e5b80 2024-09-21T09:03:17.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.714+0000 7ff552ead640 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5627f27e5b80 0x5627f27e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.714+0000 7ff552ead640 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5627f27e5b80 0x5627f27e7f70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.714+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.714+0000 7ff556924800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:17.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.714+0000 7ff556924800 20 searching for the correct realm 2024-09-21T09:03:17.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.715+0000 7ff556924800 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5627f27ea570 0x5627f27eca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.715+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27ed100 con 0x5627f27ea570 2024-09-21T09:03:17.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.715+0000 7ff5526ac640 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5627f27ea570 0x5627f27eca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.715+0000 7ff5526ac640 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5627f27ea570 0x5627f27eca30 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.715+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.715+0000 7ff5526ac640 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x5627f2621610 0x7ff54404b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.715+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27ed100 con 0x5627f2621610 2024-09-21T09:03:17.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.715+0000 7ff551eab640 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x5627f2621610 0x7ff54404b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.716+0000 7ff551eab640 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x5627f2621610 0x7ff54404b3d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.716+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54805c040 con 0x5627f2621610 2024-09-21T09:03:17.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.716+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27ed100 con 0x5627f27e5b80 2024-09-21T09:03:17.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.716+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.716+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e1170 2024-09-21T09:03:17.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.716+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.716+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e1170 2024-09-21T09:03:17.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.716+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.717+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e5b80 2024-09-21T09:03:17.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.717+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.717+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e5b80 2024-09-21T09:03:17.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.717+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.717+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f2621610 2024-09-21T09:03:17.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.717+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54805c040 con 0x5627f2621610 2024-09-21T09:03:17.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.717+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27ea570 2024-09-21T09:03:17.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.717+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.717+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e1170 2024-09-21T09:03:17.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.718+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.718+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e5b80 2024-09-21T09:03:17.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.718+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.718+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e1170 2024-09-21T09:03:17.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.718+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.718+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f2621610 2024-09-21T09:03:17.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.718+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff54805c040 con 0x5627f2621610 2024-09-21T09:03:17.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.718+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27ea570 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.719+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.719+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27ea570 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.719+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.719+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e5b80 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.719+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.719+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27ea570 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.719+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.719+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27ea570 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.720+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.720+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e1170 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.720+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.720+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e1170 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.720+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.720+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e5b80 2024-09-21T09:03:17.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.720+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.720+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27ea570 2024-09-21T09:03:17.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.720+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.720+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f2621610 2024-09-21T09:03:17.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.721+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54805c040 con 0x5627f2621610 2024-09-21T09:03:17.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.721+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e1170 2024-09-21T09:03:17.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.721+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.721+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e5b80 2024-09-21T09:03:17.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.721+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.721+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27ea570 2024-09-21T09:03:17.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.721+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.721+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e5b80 2024-09-21T09:03:17.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.722+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.722+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f2621610 2024-09-21T09:03:17.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.722+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54805c040 con 0x5627f2621610 2024-09-21T09:03:17.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.722+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27ea570 2024-09-21T09:03:17.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.722+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.722+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e5b80 2024-09-21T09:03:17.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.722+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.722+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f27e1170 2024-09-21T09:03:17.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e85c0 con 0x5627f2621610 2024-09-21T09:03:17.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54805c040 con 0x5627f2621610 2024-09-21T09:03:17.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff556924800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:17.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff556924800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:17.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff556924800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:17.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff556924800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:17.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff556924800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:17.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff556924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:17.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff556924800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e8e80 con 0x5627f27e1170 2024-09-21T09:03:17.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff556924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff556924800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e9270 con 0x5627f27e1170 2024-09-21T09:03:17.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff556924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff556924800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.723+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27e9270 con 0x5627f27e1170 2024-09-21T09:03:17.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:17.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 20 zone default found 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 4 Realm: () 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 20 zonegroup default 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27ed580 con 0x5627f27e5b80 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27ef300 con 0x5627f27ea570 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27ef6a0 con 0x5627f27ea570 2024-09-21T09:03:17.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 20 started sync module instance, tier type = 2024-09-21T09:03:17.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:17.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.724+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27ee7a0 con 0x5627f2621610 2024-09-21T09:03:17.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.725+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f2621610 2024-09-21T09:03:17.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.725+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94729572117696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27ee7a0 con 0x5627f2621610 2024-09-21T09:03:17.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.725+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27eff70 con 0x5627f27e1170 2024-09-21T09:03:17.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.726+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94729572117696] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f2621610 2024-09-21T09:03:17.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.726+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.726+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94729572121152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27ee7a0 con 0x5627f27e1170 2024-09-21T09:03:17.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.727+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27f0a20 con 0x5627f27ea570 2024-09-21T09:03:17.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.728+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94729572121152] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.728+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.728+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94729572115184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27ee710 con 0x5627f27ea570 2024-09-21T09:03:17.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.728+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27f18e0 con 0x5627f2621610 2024-09-21T09:03:17.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.729+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94729572115184] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.729+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f2621610 2024-09-21T09:03:17.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.729+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94729572127792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27f1850 con 0x5627f2621610 2024-09-21T09:03:17.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.729+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27f2630 con 0x5627f27e1170 2024-09-21T09:03:17.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.730+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94729572127792] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f2621610 2024-09-21T09:03:17.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.730+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.730+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94729572129856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27f2510 con 0x5627f27e1170 2024-09-21T09:03:17.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.730+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27f3070 con 0x5627f27e5b80 2024-09-21T09:03:17.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.731+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.731+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94729572133824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27f2fe0 con 0x5627f27e5b80 2024-09-21T09:03:17.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.731+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27f4020 con 0x5627f27e5b80 2024-09-21T09:03:17.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.731+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94729572129856] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.732+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94729572133824] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.732+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.732+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94729572130912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27f3b30 con 0x5627f27e5b80 2024-09-21T09:03:17.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.732+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27f48c0 con 0x5627f27e5b80 2024-09-21T09:03:17.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.733+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.733+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94729572130912] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.733+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94729572140048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27f3b30 con 0x5627f27e5b80 2024-09-21T09:03:17.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.733+0000 7ff556924800 20 add_watcher() i=0 2024-09-21T09:03:17.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.733+0000 7ff556924800 20 add_watcher() i=1 2024-09-21T09:03:17.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.733+0000 7ff556924800 20 add_watcher() i=2 2024-09-21T09:03:17.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.733+0000 7ff556924800 20 add_watcher() i=3 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.733+0000 7ff556924800 20 add_watcher() i=4 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.733+0000 7ff556924800 20 add_watcher() i=5 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.733+0000 7ff556924800 20 add_watcher() i=6 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.734+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94729572140048] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.734+0000 7ff556924800 20 add_watcher() i=7 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.734+0000 7ff556924800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.734+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f27f3480 con 0x5627f27e1170 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.734+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.734+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94729572141104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f27f3480 con 0x5627f27e1170 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.735+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94729572141104] v29'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.735+0000 7ff408fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.735+0000 7ff556924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.735+0000 7ff556924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.735+0000 7ff556924800 5 note: GC not initialized 2024-09-21T09:03:17.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff3837fe640 20 reqs_thread_entry: start 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff556924800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff556924800 20 Filter name: none 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff3817fa640 20 reqs_thread_entry: start 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff556924800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff556924800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f282ae40 con 0x5627f27e1170 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff556924800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff556924800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff556924800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff556924800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff556924800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff556924800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.736+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f282b8b0 con 0x5627f27e5b80 2024-09-21T09:03:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.737+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.737+0000 7ff556924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.737+0000 7ff556924800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-21T09:03:17.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.737+0000 7ff556924800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T09:03:17.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.737+0000 7ff556924800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-21T09:03:17.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.737+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f2831290 con 0x5627f27e1170 2024-09-21T09:03:17.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.738+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v29'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.738+0000 7ff556924800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:17.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.738+0000 7ff556924800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:17.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.738+0000 7ff556924800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:17.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.738+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94729572387920 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f282c8f0 con 0x5627f27e1170 2024-09-21T09:03:17.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.738+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify (1) cookie 94729572129856 notify 124554051587 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7ff548075040 con 0x5627f27e1170 2024-09-21T09:03:17.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.738+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(65 notify.4 [notify cookie 94729572387920 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.738+0000 7ff4357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051587 cookie 94729572129856 notifier 4343 bl.length()=678 2024-09-21T09:03:17.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.738+0000 7ff4357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:17.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.738+0000 7ff4357fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:17.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.738+0000 7ff4357fa640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff388003430 con 0x5627f27e1170 2024-09-21T09:03:17.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.739+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== watch-notify(notify_complete (2) cookie 94729572387920 notify 124554051587 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff548068040 con 0x5627f27e1170 2024-09-21T09:03:17.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.739+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.739+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f2830c50 con 0x5627f27e5b80 2024-09-21T09:03:17.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.740+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.740+0000 7ff556924800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T09:03:17.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.740+0000 7ff556924800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T09:03:17.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.740+0000 7ff556924800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T09:03:17.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.740+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94729572387920 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627f282c440 con 0x5627f27ea570 2024-09-21T09:03:17.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.740+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== watch-notify(notify (1) cookie 94729572115184 notify 124554051584 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5627f27a7040 con 0x5627f27ea570 2024-09-21T09:03:17.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.740+0000 7ff4357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051584 cookie 94729572115184 notifier 4343 bl.length()=177 2024-09-21T09:03:17.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.740+0000 7ff4357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T09:03:17.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.740+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(68 notify.2 [notify cookie 94729572387920 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.740+0000 7ff4357fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T09:03:17.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.740+0000 7ff4357fa640 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7ff388003430 con 0x5627f27ea570 2024-09-21T09:03:17.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.740+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.740+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== watch-notify(notify_complete (2) cookie 94729572387920 notify 124554051584 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5627f27a6b20 con 0x5627f27ea570 2024-09-21T09:03:17.751 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-21T09:03:17.738153Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:17.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.741+0000 7ff408fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.741+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94729572141104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f282cd20 con 0x5627f27e1170 2024-09-21T09:03:17.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.742+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94729572141104] v29'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.742+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94729572117696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f2828b00 con 0x5627f2621610 2024-09-21T09:03:17.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.743+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94729572117696] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f2621610 2024-09-21T09:03:17.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.743+0000 7ff556924800 20 remove_watcher() i=0 2024-09-21T09:03:17.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.743+0000 7ff556924800 2 removed watcher, disabling cache 2024-09-21T09:03:17.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.743+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94729572121152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f2828b00 con 0x5627f27e1170 2024-09-21T09:03:17.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.744+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94729572121152] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.744+0000 7ff556924800 20 remove_watcher() i=1 2024-09-21T09:03:17.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.744+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94729572115184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f2828b00 con 0x5627f27ea570 2024-09-21T09:03:17.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.745+0000 7ff5526ac640 1 -- 172.21.15.178:0/10595105 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94729572115184] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400f070 con 0x5627f27ea570 2024-09-21T09:03:17.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.745+0000 7ff556924800 20 remove_watcher() i=2 2024-09-21T09:03:17.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.745+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94729572127792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f2828b00 con 0x5627f2621610 2024-09-21T09:03:17.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.746+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94729572127792] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f2621610 2024-09-21T09:03:17.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.746+0000 7ff556924800 20 remove_watcher() i=3 2024-09-21T09:03:17.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.746+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94729572129856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f2828b00 con 0x5627f27e1170 2024-09-21T09:03:17.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.747+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94729572129856] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54805c040 con 0x5627f27e1170 2024-09-21T09:03:17.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.747+0000 7ff556924800 20 remove_watcher() i=4 2024-09-21T09:03:17.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.747+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94729572133824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f2828b00 con 0x5627f27e5b80 2024-09-21T09:03:17.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.748+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94729572133824] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.748+0000 7ff556924800 20 remove_watcher() i=5 2024-09-21T09:03:17.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.748+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94729572130912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f2828b00 con 0x5627f27e5b80 2024-09-21T09:03:17.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.749+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94729572130912] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.749+0000 7ff556924800 20 remove_watcher() i=6 2024-09-21T09:03:17.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.749+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94729572140048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627f2828b00 con 0x5627f27e5b80 2024-09-21T09:03:17.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff552ead640 1 -- 172.21.15.178:0/10595105 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94729572140048] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54c02b070 con 0x5627f27e5b80 2024-09-21T09:03:17.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff556924800 20 remove_watcher() i=7 2024-09-21T09:03:17.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5627f27e5b80 msgr2=0x5627f27e7f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff556924800 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5627f27e5b80 0x5627f27e7f70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5627f27e1170 msgr2=0x5627f27e3630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff556924800 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5627f27e1170 0x5627f27e3630 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x5627f2621610 msgr2=0x7ff54404b3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff556924800 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x5627f2621610 0x7ff54404b3d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5627f27ea570 msgr2=0x5627f27eca30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff556924800 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5627f27ea570 0x5627f27eca30 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff41c036b40 msgr2=0x7ff41c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff556924800 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff41c036b40 0x7ff41c039000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff54401beb0 tx=0x7ff544032000 comp rx=0 tx=0).stop 2024-09-21T09:03:17.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27ce230 msgr2=0x5627f27d56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff556924800 1 --2- 172.21.15.178:0/10595105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27ce230 0x5627f27d56a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff54c04c080 tx=0x7ff54c04d0a0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 reap_dead start 2024-09-21T09:03:17.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.750+0000 7ff551eab640 1 -- 172.21.15.178:0/10595105 reap_dead start 2024-09-21T09:03:17.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 shutdown_connections 2024-09-21T09:03:17.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 >> 172.21.15.178:0/10595105 conn(0x5627f27ca590 msgr2=0x5627f27c8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 shutdown_connections 2024-09-21T09:03:17.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/10595105 wait complete. 2024-09-21T09:03:17.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/2391999537 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff42c036b90 msgr2=0x7ff42c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 --2- 172.21.15.178:0/2391999537 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff42c036b90 0x7ff42c039050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5627f27af3d0 tx=0x7ff54401be40 comp rx=0 tx=0).stop 2024-09-21T09:03:17.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/2391999537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27c1630 msgr2=0x5627f27c1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 --2- 172.21.15.178:0/2391999537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27c1630 0x5627f27c1a50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5627f27a79e0 tx=0x7ff54c00aec0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/2391999537 shutdown_connections 2024-09-21T09:03:17.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 --2- 172.21.15.178:0/2391999537 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff42c036b90 0x7ff42c039050 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 --2- 172.21.15.178:0/2391999537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f27c1630 0x5627f27c1a50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/2391999537 >> 172.21.15.178:0/2391999537 conn(0x5627f27b65c0 msgr2=0x5627f27b9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/2391999537 shutdown_connections 2024-09-21T09:03:17.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/2391999537 wait complete. 2024-09-21T09:03:17.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5627f27b0060 msgr2=0x5627f27b2520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5627f27b0060 0x5627f27b2520 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5627f27ab640 msgr2=0x5627f27ada30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5627f27ab640 0x5627f27ada30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff438036b90 msgr2=0x7ff438039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff438036b90 0x7ff438039050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x5627f2620d50 tx=0x7ff548050000 comp rx=0 tx=0).stop 2024-09-21T09:03:17.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f26b3dd0 msgr2=0x5627f27a65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f26b3dd0 0x5627f27a65e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff544014040 tx=0x7ff544001250 comp rx=0 tx=0).stop 2024-09-21T09:03:17.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 shutdown_connections 2024-09-21T09:03:17.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.751+0000 7ff556924800 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5627f27b0060 0x5627f27b2520 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.752+0000 7ff556924800 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5627f27ab640 0x5627f27ada30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.752+0000 7ff556924800 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff438036b90 0x7ff438039050 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.752+0000 7ff556924800 1 --2- 172.21.15.178:0/851534358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627f26b3dd0 0x5627f27a65e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.752+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 >> 172.21.15.178:0/851534358 conn(0x5627f26a7e00 msgr2=0x5627f2798bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.752+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 shutdown_connections 2024-09-21T09:03:17.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.752+0000 7ff556924800 1 -- 172.21.15.178:0/851534358 wait complete. 2024-09-21T09:03:17.762 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-21T09:03:17.738153Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:17.762 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T09:03:17.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T09:03:17.762 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T09:03:17.806 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:17.806 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:17.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.805+0000 7f3bb8321800 1 Processor -- start 2024-09-21T09:03:17.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.805+0000 7f3bb8321800 1 -- start start 2024-09-21T09:03:17.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.805+0000 7f3bb8321800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556b344556b0 0x556b344e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.805+0000 7f3bb8321800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b343a0b30 con 0x556b344e4710 2024-09-21T09:03:17.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.805+0000 7f3bb8321800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x556b34382360 con 0x556b344556b0 2024-09-21T09:03:17.808 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.806+0000 7f3bb40ac640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556b344556b0 0x556b344e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.808 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.806+0000 7f3bb38ab640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x556b344e4710 0x556b344e6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46602/0 (socket says 172.21.15.178:46602) 2024-09-21T09:03:17.808 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.806+0000 7f3bb38ab640 1 -- 172.21.15.178:0/1014405797 learned_addr learned my addr 172.21.15.178:0/1014405797 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:17.808 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.806+0000 7f3bb40ac640 1 -- 172.21.15.178:0/1014405797 >> v1:172.21.15.44:6789/0 conn(0x556b344e4710 legacy=0x556b344e6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.808 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.806+0000 7f3bb30aa640 1 -- 172.21.15.178:0/1014405797 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2894984288 0 0) 0x556b343a0b30 con 0x556b344e4710 2024-09-21T09:03:17.808 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.806+0000 7f3bb40ac640 1 -- 172.21.15.178:0/1014405797 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b343a8e00 con 0x556b344556b0 2024-09-21T09:03:17.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.808+0000 7f3bb40ac640 1 --2- 172.21.15.178:0/1014405797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b344e41d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4005fd0 tx=0x7f3ba4045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97791368bdf0be45 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.808+0000 7f3bb30aa640 1 -- 172.21.15.178:0/1014405797 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba4058530 con 0x556b344556b0 2024-09-21T09:03:17.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.808+0000 7f3bb30aa640 1 -- 172.21.15.178:0/1014405797 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba40586d0 con 0x556b344556b0 2024-09-21T09:03:17.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.808+0000 7f3bb30aa640 1 -- 172.21.15.178:0/1014405797 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba40589d0 con 0x556b344556b0 2024-09-21T09:03:17.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.808+0000 7f3bb8321800 1 -- 172.21.15.178:0/1014405797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 msgr2=0x556b344e41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.808+0000 7f3bb8321800 1 --2- 172.21.15.178:0/1014405797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b344e41d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4005fd0 tx=0x7f3ba4045c30 comp rx=0 tx=0).stop 2024-09-21T09:03:17.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.808+0000 7f3bb8321800 1 -- 172.21.15.178:0/1014405797 shutdown_connections 2024-09-21T09:03:17.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.808+0000 7f3bb8321800 1 --2- 172.21.15.178:0/1014405797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b344e41d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.808+0000 7f3bb8321800 1 -- 172.21.15.178:0/1014405797 >> 172.21.15.178:0/1014405797 conn(0x556b344dbde0 msgr2=0x556b344de200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.808+0000 7f3bb8321800 1 -- 172.21.15.178:0/1014405797 shutdown_connections 2024-09-21T09:03:17.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.808+0000 7f3bb8321800 1 -- 172.21.15.178:0/1014405797 wait complete. 2024-09-21T09:03:17.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.822+0000 7f3bb8321800 1 Processor -- start 2024-09-21T09:03:17.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.822+0000 7f3bb8321800 1 -- start start 2024-09-21T09:03:17.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.822+0000 7f3bb8321800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b345d0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.822+0000 7f3bb8321800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556b3442d330 con 0x556b344556b0 2024-09-21T09:03:17.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.822+0000 7f3bb40ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b345d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.822+0000 7f3bb40ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b345d0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42446/0 (socket says 172.21.15.178:42446) 2024-09-21T09:03:17.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.822+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2745013610 learned_addr learned my addr 172.21.15.178:0/2745013610 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.823+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2745013610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b3437abc0 con 0x556b344556b0 2024-09-21T09:03:17.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.823+0000 7f3bb40ac640 1 --2- 172.21.15.178:0/2745013610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b345d0740 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400a3f0 tx=0x7f3ba4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d72a94c0fdfc1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.823+0000 7f3aa260c640 1 -- 172.21.15.178:0/2745013610 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba4068070 con 0x556b344556b0 2024-09-21T09:03:17.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.823+0000 7f3aa260c640 1 -- 172.21.15.178:0/2745013610 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba4058880 con 0x556b344556b0 2024-09-21T09:03:17.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.823+0000 7f3aa260c640 1 -- 172.21.15.178:0/2745013610 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba4058b60 con 0x556b344556b0 2024-09-21T09:03:17.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.824+0000 7f3bb8321800 1 -- 172.21.15.178:0/2745013610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 msgr2=0x556b345d0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.824+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2745013610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b345d0740 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400a3f0 tx=0x7f3ba4051000 comp rx=0 tx=0).stop 2024-09-21T09:03:17.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.824+0000 7f3bb8321800 1 -- 172.21.15.178:0/2745013610 shutdown_connections 2024-09-21T09:03:17.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.824+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2745013610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b345d0740 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.824+0000 7f3bb8321800 1 -- 172.21.15.178:0/2745013610 >> 172.21.15.178:0/2745013610 conn(0x556b344dbde0 msgr2=0x556b345cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.824+0000 7f3bb8321800 1 -- 172.21.15.178:0/2745013610 shutdown_connections 2024-09-21T09:03:17.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.824+0000 7f3bb8321800 1 -- 172.21.15.178:0/2745013610 wait complete. 2024-09-21T09:03:17.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.824+0000 7f3bb8321800 1 Processor -- start 2024-09-21T09:03:17.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.824+0000 7f3bb8321800 1 -- start start 2024-09-21T09:03:17.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.824+0000 7f3bb8321800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b345d7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.824+0000 7f3bb8321800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556b344e8680 con 0x556b344556b0 2024-09-21T09:03:17.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.825+0000 7f3bb40ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b345d7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.825+0000 7f3bb40ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b345d7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42458/0 (socket says 172.21.15.178:42458) 2024-09-21T09:03:17.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.825+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2033635484 learned_addr learned my addr 172.21.15.178:0/2033635484 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.825+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2033635484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b3438efe0 con 0x556b344556b0 2024-09-21T09:03:17.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.825+0000 7f3bb40ac640 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b345d7f00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400a3f0 tx=0x7f3ba4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.825+0000 7f3aa0e09640 1 -- 172.21.15.178:0/2033635484 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba4068040 con 0x556b344556b0 2024-09-21T09:03:17.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.825+0000 7f3aa0e09640 1 -- 172.21.15.178:0/2033635484 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba4071070 con 0x556b344556b0 2024-09-21T09:03:17.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.825+0000 7f3aa0e09640 1 -- 172.21.15.178:0/2033635484 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ba4063970 con 0x556b344556b0 2024-09-21T09:03:17.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.825+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b345d8440 con 0x556b344556b0 2024-09-21T09:03:17.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.826+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b345d8960 con 0x556b344556b0 2024-09-21T09:03:17.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.826+0000 7f3aa0e09640 1 -- 172.21.15.178:0/2033635484 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3ba406b070 con 0x556b344556b0 2024-09-21T09:03:17.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.827+0000 7f3aa0e09640 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a9c036b90 0x7f3a9c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.827+0000 7f3aa0e09640 1 -- 172.21.15.178:0/2033635484 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3ba408ffe0 con 0x556b344556b0 2024-09-21T09:03:17.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.827+0000 7f3bb38ab640 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a9c036b90 0x7f3a9c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.827+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556b344e4710 0x556b345def70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.827+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b345df4f0 con 0x556b344e4710 2024-09-21T09:03:17.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.827+0000 7f3bb48ad640 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556b344e4710 0x556b345def70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.827+0000 7f3bb38ab640 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a9c036b90 0x7f3a9c039050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c000c00 tx=0x7f3b9c0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.827+0000 7f3bb48ad640 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556b344e4710 0x556b345def70 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.827+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2033635484 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b344e4710 2024-09-21T09:03:17.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.827+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b345dc500 con 0x556b344e4710 2024-09-21T09:03:17.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.828+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2033635484 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b344e4710 2024-09-21T09:03:17.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.828+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556b345e1800 0x556b345e3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.828+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b345e42c0 con 0x556b345e1800 2024-09-21T09:03:17.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.828+0000 7f3bb40ac640 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556b345e1800 0x556b345e3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.829+0000 7f3bb40ac640 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556b345e1800 0x556b345e3bf0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.829+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2033635484 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b345e1800 2024-09-21T09:03:17.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.829+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b345e06a0 con 0x556b344e4710 2024-09-21T09:03:17.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.829+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2033635484 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b344e4710 2024-09-21T09:03:17.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.829+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b345e0b40 con 0x556b344e4710 2024-09-21T09:03:17.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.830+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2033635484 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b344e4710 2024-09-21T09:03:17.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.830+0000 7f3bb8321800 1 Processor -- start 2024-09-21T09:03:17.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.830+0000 7f3bb8321800 1 -- start start 2024-09-21T09:03:17.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.830+0000 7f3bb8321800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b345f2c80 0x556b345f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.830+0000 7f3bb8321800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556b3437c580 con 0x556b345f2c80 2024-09-21T09:03:17.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.830+0000 7f3bb48ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b345f2c80 0x556b345f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.830+0000 7f3bb48ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b345f2c80 0x556b345f30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42460/0 (socket says 172.21.15.178:42460) 2024-09-21T09:03:17.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.830+0000 7f3bb48ad640 1 -- 172.21.15.178:0/1821616691 learned_addr learned my addr 172.21.15.178:0/1821616691 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.831+0000 7f3bb48ad640 1 -- 172.21.15.178:0/1821616691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b345f35e0 con 0x556b345f2c80 2024-09-21T09:03:17.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.831+0000 7f3bb48ad640 1 --2- 172.21.15.178:0/1821616691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b345f2c80 0x556b345f30a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x556b345d8dd0 tx=0x7f3bac00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.831+0000 7f3a99ffb640 1 -- 172.21.15.178:0/1821616691 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bac007d00 con 0x556b345f2c80 2024-09-21T09:03:17.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.831+0000 7f3a99ffb640 1 -- 172.21.15.178:0/1821616691 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bac01e020 con 0x556b345f2c80 2024-09-21T09:03:17.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.831+0000 7f3bb8321800 1 -- 172.21.15.178:0/1821616691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b345f3870 con 0x556b345f2c80 2024-09-21T09:03:17.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.831+0000 7f3a99ffb640 1 -- 172.21.15.178:0/1821616691 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bac019420 con 0x556b345f2c80 2024-09-21T09:03:17.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.831+0000 7f3bb8321800 1 -- 172.21.15.178:0/1821616691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b345f6550 con 0x556b345f2c80 2024-09-21T09:03:17.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.832+0000 7f3a99ffb640 1 -- 172.21.15.178:0/1821616691 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3bac016040 con 0x556b345f2c80 2024-09-21T09:03:17.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.832+0000 7f3a99ffb640 1 --2- 172.21.15.178:0/1821616691 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a8c036b90 0x7f3a8c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.832+0000 7f3a99ffb640 1 -- 172.21.15.178:0/1821616691 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3bac01f030 con 0x556b345f2c80 2024-09-21T09:03:17.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.832+0000 7f3bb40ac640 1 --2- 172.21.15.178:0/1821616691 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a8c036b90 0x7f3a8c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.832+0000 7f3bb8321800 1 Processor -- start 2024-09-21T09:03:17.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.832+0000 7f3bb8321800 1 -- start start 2024-09-21T09:03:17.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.832+0000 7f3bb40ac640 1 --2- 172.21.15.178:0/1821616691 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a8c036b90 0x7f3a8c039050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x556b345df930 tx=0x7f3ba4082040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.832+0000 7f3bb8321800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344e0200 0x556b344e0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.832+0000 7f3bb8321800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556b345d0e30 con 0x556b344e0200 2024-09-21T09:03:17.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.833+0000 7f3bb48ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344e0200 0x556b344e0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.833+0000 7f3bb48ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344e0200 0x556b344e0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42468/0 (socket says 172.21.15.178:42468) 2024-09-21T09:03:17.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.833+0000 7f3bb48ad640 1 -- 172.21.15.178:0/48173698 learned_addr learned my addr 172.21.15.178:0/48173698 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.833+0000 7f3bb48ad640 1 -- 172.21.15.178:0/48173698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b344e0b40 con 0x556b344e0200 2024-09-21T09:03:17.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.833+0000 7f3bb48ad640 1 --2- 172.21.15.178:0/48173698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344e0200 0x556b344e0600 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3bac018010 tx=0x7f3bac014630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed28eb70fe52a711 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.833+0000 7f3a937fe640 1 -- 172.21.15.178:0/48173698 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bac01d040 con 0x556b344e0200 2024-09-21T09:03:17.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.833+0000 7f3a937fe640 1 -- 172.21.15.178:0/48173698 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bac04a070 con 0x556b344e0200 2024-09-21T09:03:17.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.833+0000 7f3a937fe640 1 -- 172.21.15.178:0/48173698 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bac014980 con 0x556b344e0200 2024-09-21T09:03:17.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.834+0000 7f3bb8321800 1 -- 172.21.15.178:0/48173698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344e0200 msgr2=0x556b344e0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.834+0000 7f3bb8321800 1 --2- 172.21.15.178:0/48173698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344e0200 0x556b344e0600 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3bac018010 tx=0x7f3bac014630 comp rx=0 tx=0).stop 2024-09-21T09:03:17.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.834+0000 7f3bb8321800 1 -- 172.21.15.178:0/48173698 shutdown_connections 2024-09-21T09:03:17.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.834+0000 7f3bb8321800 1 --2- 172.21.15.178:0/48173698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344e0200 0x556b344e0600 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.834+0000 7f3bb8321800 1 -- 172.21.15.178:0/48173698 >> 172.21.15.178:0/48173698 conn(0x556b345fbce0 msgr2=0x556b345f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.834+0000 7f3bb8321800 1 -- 172.21.15.178:0/48173698 shutdown_connections 2024-09-21T09:03:17.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.834+0000 7f3bb8321800 1 -- 172.21.15.178:0/48173698 wait complete. 2024-09-21T09:03:17.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.834+0000 7f3bb8321800 1 Processor -- start 2024-09-21T09:03:17.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.834+0000 7f3bb8321800 1 -- start start 2024-09-21T09:03:17.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.834+0000 7f3bb8321800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344e0200 0x556b34609040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.834+0000 7f3bb8321800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556b344e1280 con 0x556b344e0200 2024-09-21T09:03:17.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.834+0000 7f3bb48ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344e0200 0x556b34609040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.834+0000 7f3bb48ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344e0200 0x556b34609040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42472/0 (socket says 172.21.15.178:42472) 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.834+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 learned_addr learned my addr 172.21.15.178:0/2868075993 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.835+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b34609580 con 0x556b344e0200 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.835+0000 7f3bb48ad640 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344e0200 0x556b34609040 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3bac018010 tx=0x7f3bac04ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.835+0000 7f3a91ffb640 1 -- 172.21.15.178:0/2868075993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bac01d030 con 0x556b344e0200 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.835+0000 7f3a91ffb640 1 -- 172.21.15.178:0/2868075993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bac04b720 con 0x556b344e0200 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.835+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b34609810 con 0x556b344e0200 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.835+0000 7f3a91ffb640 1 -- 172.21.15.178:0/2868075993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bac0196f0 con 0x556b344e0200 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.835+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b3460c4c0 con 0x556b344e0200 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.836+0000 7f3a91ffb640 1 -- 172.21.15.178:0/2868075993 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3bac019890 con 0x556b344e0200 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.836+0000 7f3a91ffb640 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a84036b40 0x7f3a84039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.836+0000 7f3a91ffb640 1 -- 172.21.15.178:0/2868075993 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3bac034030 con 0x556b344e0200 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.836+0000 7f3bb40ac640 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a84036b40 0x7f3a84039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.836+0000 7f3bb8321800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.836+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556b34614ab0 0x556b34616f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.836+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b346176c0 con 0x556b34614ab0 2024-09-21T09:03:17.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.837+0000 7f3bb38ab640 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556b34614ab0 0x556b34616f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.837+0000 7f3bb40ac640 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a84036b40 0x7f3a84039000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ba406bf40 tx=0x7f3ba408b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.837+0000 7f3bb38ab640 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556b34614ab0 0x556b34616f70 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.837+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b9c00f5a0 con 0x556b34614ab0 2024-09-21T09:03:17.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.837+0000 7f3bb8321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.837+0000 7f3bb8321800 20 realm 2024-09-21T09:03:17.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.837+0000 7f3bb8321800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.837+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b34613f00 con 0x556b34614ab0 2024-09-21T09:03:17.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.837+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b9c00f5a0 con 0x556b34614ab0 2024-09-21T09:03:17.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.837+0000 7f3bb8321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.837+0000 7f3bb8321800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:17.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.837+0000 7f3bb8321800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.837+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b346181a0 con 0x556b34614ab0 2024-09-21T09:03:17.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.837+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b9c00f5a0 con 0x556b34614ab0 2024-09-21T09:03:17.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.838+0000 7f3bb8321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.838+0000 7f3bb8321800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.838+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b34618a70 con 0x556b34614ab0 2024-09-21T09:03:17.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.838+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b9c00f5a0 con 0x556b34614ab0 2024-09-21T09:03:17.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.838+0000 7f3bb8321800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.838+0000 7f3bb8321800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.838+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556b34619370 0x556b3461b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.838+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b3461bee0 con 0x556b34619370 2024-09-21T09:03:17.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.838+0000 7f3bb48ad640 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556b34619370 0x556b3461b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.838+0000 7f3bb48ad640 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556b34619370 0x556b3461b780 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.839+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.839+0000 7f3bb8321800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:17.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.839+0000 7f3bb8321800 20 searching for the correct realm 2024-09-21T09:03:17.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.839+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556b3461df90 0x556b34620450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.839+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b3461df90 2024-09-21T09:03:17.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.839+0000 7f3bb40ac640 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556b3461df90 0x556b34620450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.839+0000 7f3bb40ac640 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556b3461df90 0x556b34620450 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.839+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b3461df90 2024-09-21T09:03:17.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.839+0000 7f3bb40ac640 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3ba40a3040 0x7f3ba4082490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.839+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x7f3ba40a3040 2024-09-21T09:03:17.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.840+0000 7f3bb38ab640 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3ba40a3040 0x7f3ba4082490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.840+0000 7f3bb38ab640 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3ba40a3040 0x7f3ba4082490 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.840+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9c00f5a0 con 0x7f3ba40a3040 2024-09-21T09:03:17.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.840+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34619370 2024-09-21T09:03:17.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.840+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.840+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34614ab0 2024-09-21T09:03:17.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.841+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9c00f5a0 con 0x556b34614ab0 2024-09-21T09:03:17.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.841+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34614ab0 2024-09-21T09:03:17.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.841+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.841+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34619370 2024-09-21T09:03:17.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.841+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.841+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34619370 2024-09-21T09:03:17.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.841+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.841+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x7f3ba40a3040 2024-09-21T09:03:17.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.842+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9c02b040 con 0x7f3ba40a3040 2024-09-21T09:03:17.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.842+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b3461df90 2024-09-21T09:03:17.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.842+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b3461df90 2024-09-21T09:03:17.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.842+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34614ab0 2024-09-21T09:03:17.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.842+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.842+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34619370 2024-09-21T09:03:17.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.843+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.843+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34614ab0 2024-09-21T09:03:17.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.843+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.843+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x7f3ba40a3040 2024-09-21T09:03:17.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.843+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3b9c02b040 con 0x7f3ba40a3040 2024-09-21T09:03:17.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.843+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b3461df90 2024-09-21T09:03:17.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.843+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b3461df90 2024-09-21T09:03:17.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.843+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b3461df90 2024-09-21T09:03:17.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.844+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b3461df90 2024-09-21T09:03:17.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.844+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34619370 2024-09-21T09:03:17.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.844+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.844+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b3461df90 2024-09-21T09:03:17.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.844+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b3461df90 2024-09-21T09:03:17.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.844+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b3461df90 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.844+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b3461df90 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.845+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34614ab0 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.845+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.845+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34614ab0 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.845+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.845+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34619370 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.845+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.845+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b3461df90 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.846+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b3461df90 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.846+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x7f3ba40a3040 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.846+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9c02b040 con 0x7f3ba40a3040 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.846+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34614ab0 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.846+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.846+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34619370 2024-09-21T09:03:17.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.846+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.846+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b3461df90 2024-09-21T09:03:17.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.847+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b3461df90 2024-09-21T09:03:17.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.847+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34619370 2024-09-21T09:03:17.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.847+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.847+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x7f3ba40a3040 2024-09-21T09:03:17.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.847+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9c02b040 con 0x7f3ba40a3040 2024-09-21T09:03:17.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.847+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b3461df90 2024-09-21T09:03:17.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.847+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b3461df90 2024-09-21T09:03:17.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.847+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34619370 2024-09-21T09:03:17.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x556b34614ab0 2024-09-21T09:03:17.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556b34620b20 con 0x7f3ba40a3040 2024-09-21T09:03:17.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9c02b040 con 0x7f3ba40a3040 2024-09-21T09:03:17.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb8321800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:17.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb8321800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:17.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb8321800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:17.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb8321800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:17.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb8321800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:17.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb8321800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:17.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb8321800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b3461c990 con 0x556b34614ab0 2024-09-21T09:03:17.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb8321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb8321800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.848+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b3461ce10 con 0x556b34614ab0 2024-09-21T09:03:17.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b3461d2f0 con 0x556b34614ab0 2024-09-21T09:03:17.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:17.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 20 zone default found 2024-09-21T09:03:17.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 4 Realm: () 2024-09-21T09:03:17.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:17.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:17.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:17.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 20 zonegroup default 2024-09-21T09:03:17.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b34620fa0 con 0x556b34619370 2024-09-21T09:03:17.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b346231d0 con 0x556b3461df90 2024-09-21T09:03:17.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b3461df90 2024-09-21T09:03:17.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.849+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b34623570 con 0x556b3461df90 2024-09-21T09:03:17.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.850+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b3461df90 2024-09-21T09:03:17.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.850+0000 7f3bb8321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.850+0000 7f3bb8321800 20 started sync module instance, tier type = 2024-09-21T09:03:17.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.850+0000 7f3bb8321800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:17.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.850+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34622610 con 0x7f3ba40a3040 2024-09-21T09:03:17.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.851+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x7f3ba40a3040 2024-09-21T09:03:17.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.851+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93918928710192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34622610 con 0x7f3ba40a3040 2024-09-21T09:03:17.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.851+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34623e00 con 0x556b34614ab0 2024-09-21T09:03:17.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.852+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93918928710192] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x7f3ba40a3040 2024-09-21T09:03:17.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.852+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.852+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93918928714000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34622610 con 0x556b34614ab0 2024-09-21T09:03:17.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.852+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34624870 con 0x556b3461df90 2024-09-21T09:03:17.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.853+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93918928714000] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.853+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b3461df90 2024-09-21T09:03:17.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.853+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93918928707936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34622580 con 0x556b3461df90 2024-09-21T09:03:17.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.853+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34625630 con 0x7f3ba40a3040 2024-09-21T09:03:17.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.854+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93918928707936] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b3461df90 2024-09-21T09:03:17.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.854+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x7f3ba40a3040 2024-09-21T09:03:17.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.854+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93918928718944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34625a20 con 0x7f3ba40a3040 2024-09-21T09:03:17.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.854+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34626440 con 0x556b34614ab0 2024-09-21T09:03:17.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.855+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93918928718944] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x7f3ba40a3040 2024-09-21T09:03:17.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.856+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.856+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93918928723760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34626400 con 0x556b34614ab0 2024-09-21T09:03:17.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.856+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34626e50 con 0x556b34619370 2024-09-21T09:03:17.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.857+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.857+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93918928723760] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.857+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93918928720000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34626e50 con 0x556b34619370 2024-09-21T09:03:17.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.857+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b346278a0 con 0x556b34619370 2024-09-21T09:03:17.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.858+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93918928720000] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.858+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.858+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93918928729008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34627a80 con 0x556b34619370 2024-09-21T09:03:17.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.858+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34628310 con 0x556b34619370 2024-09-21T09:03:17.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.859+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.859+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93918928729008] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.859+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93918928730752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b346289c0 con 0x556b34619370 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.859+0000 7f3bb8321800 20 add_watcher() i=0 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.859+0000 7f3bb8321800 20 add_watcher() i=1 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.859+0000 7f3bb8321800 20 add_watcher() i=2 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.859+0000 7f3bb8321800 20 add_watcher() i=3 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.859+0000 7f3bb8321800 20 add_watcher() i=4 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.859+0000 7f3bb8321800 20 add_watcher() i=5 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.859+0000 7f3bb8321800 20 add_watcher() i=6 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.860+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93918928730752] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.860+0000 7f3bb8321800 20 add_watcher() i=7 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.860+0000 7f3bb8321800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.860+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b3462b920 con 0x556b34614ab0 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.860+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.860+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93918928733248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34628d10 con 0x556b34614ab0 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.861+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93918928733248] v29'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.861+0000 7f3a6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.861+0000 7f3bb8321800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:17.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.861+0000 7f3bb8321800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:17.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.861+0000 7f3bb8321800 5 note: GC not initialized 2024-09-21T09:03:17.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.862+0000 7f3a697e2640 20 reqs_thread_entry: start 2024-09-21T09:03:17.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.862+0000 7f3bb8321800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:17.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.862+0000 7f3bb8321800 20 Filter name: none 2024-09-21T09:03:17.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.862+0000 7f39daffd640 20 reqs_thread_entry: start 2024-09-21T09:03:17.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.862+0000 7f3bb8321800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.862+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556b3465e680 con 0x556b34614ab0 2024-09-21T09:03:17.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.862+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.862+0000 7f3bb8321800 20 rados_obj.operate() r=0 bl.length=502 2024-09-21T09:03:17.871 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-21T09:03:17.738153Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:17.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.863+0000 7f3a6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.863+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93918928733248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b3465d0f0 con 0x556b34614ab0 2024-09-21T09:03:17.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.864+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93918928733248] v29'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.864+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93918928710192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b3465c470 con 0x7f3ba40a3040 2024-09-21T09:03:17.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.865+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93918928710192] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x7f3ba40a3040 2024-09-21T09:03:17.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.865+0000 7f3bb8321800 20 remove_watcher() i=0 2024-09-21T09:03:17.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.865+0000 7f3bb8321800 2 removed watcher, disabling cache 2024-09-21T09:03:17.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.865+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93918928714000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b3465c470 con 0x556b34614ab0 2024-09-21T09:03:17.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.866+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93918928714000] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.866+0000 7f3bb8321800 20 remove_watcher() i=1 2024-09-21T09:03:17.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.866+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93918928707936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b3465c470 con 0x556b3461df90 2024-09-21T09:03:17.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.867+0000 7f3bb40ac640 1 -- 172.21.15.178:0/2868075993 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93918928707936] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ba4063cf0 con 0x556b3461df90 2024-09-21T09:03:17.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.867+0000 7f3bb8321800 20 remove_watcher() i=2 2024-09-21T09:03:17.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.867+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93918928718944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34623910 con 0x7f3ba40a3040 2024-09-21T09:03:17.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.868+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93918928718944] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x7f3ba40a3040 2024-09-21T09:03:17.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.868+0000 7f3bb8321800 20 remove_watcher() i=3 2024-09-21T09:03:17.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.868+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93918928723760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34622160 con 0x556b34614ab0 2024-09-21T09:03:17.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.869+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93918928723760] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b9c02b040 con 0x556b34614ab0 2024-09-21T09:03:17.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.869+0000 7f3bb8321800 20 remove_watcher() i=4 2024-09-21T09:03:17.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.869+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93918928720000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34624c60 con 0x556b34619370 2024-09-21T09:03:17.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.870+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93918928720000] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.870+0000 7f3bb8321800 20 remove_watcher() i=5 2024-09-21T09:03:17.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.870+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93918928729008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34623910 con 0x556b34619370 2024-09-21T09:03:17.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.871+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93918928729008] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.871+0000 7f3bb8321800 20 remove_watcher() i=6 2024-09-21T09:03:17.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.871+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93918928730752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556b34625110 con 0x556b34619370 2024-09-21T09:03:17.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb48ad640 1 -- 172.21.15.178:0/2868075993 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93918928730752] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bac0083e0 con 0x556b34619370 2024-09-21T09:03:17.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb8321800 20 remove_watcher() i=7 2024-09-21T09:03:17.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556b34619370 msgr2=0x556b3461b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556b34619370 0x556b3461b780 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556b34614ab0 msgr2=0x556b34616f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556b34614ab0 0x556b34616f70 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3ba40a3040 msgr2=0x7f3ba4082490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3ba40a3040 0x7f3ba4082490 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556b3461df90 msgr2=0x556b34620450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556b3461df90 0x556b34620450 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a84036b40 msgr2=0x7f3a84039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a84036b40 0x7f3a84039000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ba406bf40 tx=0x7f3ba408b000 comp rx=0 tx=0).stop 2024-09-21T09:03:17.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344e0200 msgr2=0x556b34609040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2868075993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344e0200 0x556b34609040 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3bac018010 tx=0x7f3bac04ca70 comp rx=0 tx=0).stop 2024-09-21T09:03:17.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 reap_dead start 2024-09-21T09:03:17.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.872+0000 7f3bb38ab640 1 -- 172.21.15.178:0/2868075993 reap_dead start 2024-09-21T09:03:17.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 shutdown_connections 2024-09-21T09:03:17.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 >> 172.21.15.178:0/2868075993 conn(0x556b345fbce0 msgr2=0x556b345f9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 shutdown_connections 2024-09-21T09:03:17.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 -- 172.21.15.178:0/2868075993 wait complete. 2024-09-21T09:03:17.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 -- 172.21.15.178:0/1821616691 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a8c036b90 msgr2=0x7f3a8c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 --2- 172.21.15.178:0/1821616691 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a8c036b90 0x7f3a8c039050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x556b345df930 tx=0x7f3ba4082040 comp rx=0 tx=0).stop 2024-09-21T09:03:17.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 -- 172.21.15.178:0/1821616691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b345f2c80 msgr2=0x556b345f30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 --2- 172.21.15.178:0/1821616691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b345f2c80 0x556b345f30a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x556b345d8dd0 tx=0x7f3bac00aec0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 -- 172.21.15.178:0/1821616691 shutdown_connections 2024-09-21T09:03:17.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 --2- 172.21.15.178:0/1821616691 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a8c036b90 0x7f3a8c039050 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 --2- 172.21.15.178:0/1821616691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b345f2c80 0x556b345f30a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 -- 172.21.15.178:0/1821616691 >> 172.21.15.178:0/1821616691 conn(0x556b345e7c10 msgr2=0x556b345ea790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 -- 172.21.15.178:0/1821616691 shutdown_connections 2024-09-21T09:03:17.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 -- 172.21.15.178:0/1821616691 wait complete. 2024-09-21T09:03:17.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556b345e1800 msgr2=0x556b345e3bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556b345e1800 0x556b345e3bf0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556b344e4710 msgr2=0x556b345def70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556b344e4710 0x556b345def70 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a9c036b90 msgr2=0x7f3a9c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a9c036b90 0x7f3a9c039050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c000c00 tx=0x7f3b9c0013b0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 msgr2=0x556b345d7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.873+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b345d7f00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400a3f0 tx=0x7f3ba4003330 comp rx=0 tx=0).stop 2024-09-21T09:03:17.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.874+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 shutdown_connections 2024-09-21T09:03:17.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.874+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556b345e1800 0x556b345e3bf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.874+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556b344e4710 0x556b345def70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.874+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a9c036b90 0x7f3a9c039050 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.874+0000 7f3bb8321800 1 --2- 172.21.15.178:0/2033635484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b344556b0 0x556b345d7f00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.874+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 >> 172.21.15.178:0/2033635484 conn(0x556b344dbde0 msgr2=0x556b345ca970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.874+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 shutdown_connections 2024-09-21T09:03:17.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.874+0000 7f3bb8321800 1 -- 172.21.15.178:0/2033635484 wait complete. 2024-09-21T09:03:17.884 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-21T09:03:17.738153Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:17.884 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-21T09:03:17.884 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-21T09:03:17.884 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-21T09:03:17.931 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:17.931 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:17.932 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.930+0000 7f859200f800 1 Processor -- start 2024-09-21T09:03:17.932 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.930+0000 7f859200f800 1 -- start start 2024-09-21T09:03:17.932 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.930+0000 7f859200f800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5562abade650 0x5562abb6d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.932 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.930+0000 7f859200f800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5562aba29b30 con 0x5562abb6d720 2024-09-21T09:03:17.932 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.930+0000 7f859200f800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5562aba0b360 con 0x5562abade650 2024-09-21T09:03:17.932 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.930+0000 7f858d667640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5562abade650 0x5562abb6d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.932 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.930+0000 7f8587fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5562abb6d720 0x5562abb6fb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46614/0 (socket says 172.21.15.178:46614) 2024-09-21T09:03:17.932 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.930+0000 7f8587fff640 1 -- 172.21.15.178:0/3219282509 learned_addr learned my addr 172.21.15.178:0/3219282509 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:17.933 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.931+0000 7f858d667640 1 -- 172.21.15.178:0/3219282509 >> v1:172.21.15.44:6789/0 conn(0x5562abb6d720 legacy=0x5562abb6fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.933 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.931+0000 7f858ce66640 1 -- 172.21.15.178:0/3219282509 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371575789 0 0) 0x5562aba29b30 con 0x5562abb6d720 2024-09-21T09:03:17.933 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.931+0000 7f858d667640 1 -- 172.21.15.178:0/3219282509 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562aba31e00 con 0x5562abade650 2024-09-21T09:03:17.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.932+0000 7f858d667640 1 --2- 172.21.15.178:0/3219282509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abb6d1e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f858000a470 tx=0x7f8580045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3585db13f7cd49fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.932+0000 7f858ce66640 1 -- 172.21.15.178:0/3219282509 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8580053570 con 0x5562abade650 2024-09-21T09:03:17.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.933+0000 7f858ce66640 1 -- 172.21.15.178:0/3219282509 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8580058070 con 0x5562abade650 2024-09-21T09:03:17.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.933+0000 7f858ce66640 1 -- 172.21.15.178:0/3219282509 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8580053880 con 0x5562abade650 2024-09-21T09:03:17.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.933+0000 7f859200f800 1 -- 172.21.15.178:0/3219282509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 msgr2=0x5562abb6d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.933+0000 7f859200f800 1 --2- 172.21.15.178:0/3219282509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abb6d1e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f858000a470 tx=0x7f8580045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:17.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.933+0000 7f859200f800 1 -- 172.21.15.178:0/3219282509 shutdown_connections 2024-09-21T09:03:17.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.933+0000 7f859200f800 1 --2- 172.21.15.178:0/3219282509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abb6d1e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.933+0000 7f859200f800 1 -- 172.21.15.178:0/3219282509 >> 172.21.15.178:0/3219282509 conn(0x5562abb64db0 msgr2=0x5562abb671d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.933+0000 7f859200f800 1 -- 172.21.15.178:0/3219282509 shutdown_connections 2024-09-21T09:03:17.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.933+0000 7f859200f800 1 -- 172.21.15.178:0/3219282509 wait complete. 2024-09-21T09:03:17.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.947+0000 7f859200f800 1 Processor -- start 2024-09-21T09:03:17.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.947+0000 7f859200f800 1 -- start start 2024-09-21T09:03:17.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.947+0000 7f859200f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abb6ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.947+0000 7f859200f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5562abab6360 con 0x5562abade650 2024-09-21T09:03:17.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.947+0000 7f858d667640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abb6ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.947+0000 7f858d667640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abb6ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42488/0 (socket says 172.21.15.178:42488) 2024-09-21T09:03:17.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.947+0000 7f858d667640 1 -- 172.21.15.178:0/4114896546 learned_addr learned my addr 172.21.15.178:0/4114896546 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.947+0000 7f858d667640 1 -- 172.21.15.178:0/4114896546 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562aba03bc0 con 0x5562abade650 2024-09-21T09:03:17.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.948+0000 7f858d667640 1 --2- 172.21.15.178:0/4114896546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abb6ab10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8580005870 tx=0x7f8580051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba1d0a88a905e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.948+0000 7f847b606640 1 -- 172.21.15.178:0/4114896546 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f858005c580 con 0x5562abade650 2024-09-21T09:03:17.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.948+0000 7f847b606640 1 -- 172.21.15.178:0/4114896546 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8580063030 con 0x5562abade650 2024-09-21T09:03:17.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.948+0000 7f847b606640 1 -- 172.21.15.178:0/4114896546 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f858005c850 con 0x5562abade650 2024-09-21T09:03:17.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.948+0000 7f859200f800 1 -- 172.21.15.178:0/4114896546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 msgr2=0x5562abb6ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.948+0000 7f859200f800 1 --2- 172.21.15.178:0/4114896546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abb6ab10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8580005870 tx=0x7f8580051000 comp rx=0 tx=0).stop 2024-09-21T09:03:17.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.948+0000 7f859200f800 1 -- 172.21.15.178:0/4114896546 shutdown_connections 2024-09-21T09:03:17.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.948+0000 7f859200f800 1 --2- 172.21.15.178:0/4114896546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abb6ab10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.948+0000 7f859200f800 1 -- 172.21.15.178:0/4114896546 >> 172.21.15.178:0/4114896546 conn(0x5562abb64db0 msgr2=0x5562abc550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.948+0000 7f859200f800 1 -- 172.21.15.178:0/4114896546 shutdown_connections 2024-09-21T09:03:17.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.949+0000 7f859200f800 1 -- 172.21.15.178:0/4114896546 wait complete. 2024-09-21T09:03:17.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.949+0000 7f859200f800 1 Processor -- start 2024-09-21T09:03:17.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.949+0000 7f859200f800 1 -- start start 2024-09-21T09:03:17.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.949+0000 7f859200f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abc631d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.949+0000 7f859200f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5562abb71620 con 0x5562abade650 2024-09-21T09:03:17.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.949+0000 7f858d667640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abc631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.949+0000 7f858d667640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abc631d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42490/0 (socket says 172.21.15.178:42490) 2024-09-21T09:03:17.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.949+0000 7f858d667640 1 -- 172.21.15.178:0/3043280847 learned_addr learned my addr 172.21.15.178:0/3043280847 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.950+0000 7f858d667640 1 -- 172.21.15.178:0/3043280847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562aba17fe0 con 0x5562abade650 2024-09-21T09:03:17.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.950+0000 7f858d667640 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abc631d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8580045f50 tx=0x7f8580002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.950+0000 7f8479e03640 1 -- 172.21.15.178:0/3043280847 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8580078070 con 0x5562abade650 2024-09-21T09:03:17.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.950+0000 7f8479e03640 1 -- 172.21.15.178:0/3043280847 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8580054a70 con 0x5562abade650 2024-09-21T09:03:17.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.950+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562abc63710 con 0x5562abade650 2024-09-21T09:03:17.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.950+0000 7f8479e03640 1 -- 172.21.15.178:0/3043280847 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8580054d50 con 0x5562abade650 2024-09-21T09:03:17.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.950+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562abc63c90 con 0x5562abade650 2024-09-21T09:03:17.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.951+0000 7f8479e03640 1 -- 172.21.15.178:0/3043280847 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f858007b070 con 0x5562abade650 2024-09-21T09:03:17.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.951+0000 7f8479e03640 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8474036b90 0x7f8474039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.951+0000 7f8479e03640 1 -- 172.21.15.178:0/3043280847 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8580070070 con 0x5562abade650 2024-09-21T09:03:17.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.951+0000 7f8587fff640 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8474036b90 0x7f8474039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.951+0000 7f859200f800 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5562abb6d720 0x5562abc6a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.951+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abc6a7d0 con 0x5562abb6d720 2024-09-21T09:03:17.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.951+0000 7f858de68640 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5562abb6d720 0x5562abc6a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.952+0000 7f8587fff640 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8474036b90 0x7f8474039050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8578000c00 tx=0x7f85780013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.952+0000 7f858de68640 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5562abb6d720 0x5562abc6a240 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.952+0000 7f858de68640 1 -- 172.21.15.178:0/3043280847 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f858800a4a0 con 0x5562abb6d720 2024-09-21T09:03:17.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.952+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abc677f0 con 0x5562abb6d720 2024-09-21T09:03:17.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.952+0000 7f858de68640 1 -- 172.21.15.178:0/3043280847 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f858800a4a0 con 0x5562abb6d720 2024-09-21T09:03:17.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.952+0000 7f859200f800 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5562abc6cb00 0x5562abc6eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.952+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abc6f5e0 con 0x5562abc6cb00 2024-09-21T09:03:17.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.953+0000 7f858d667640 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5562abc6cb00 0x5562abc6eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.953+0000 7f858d667640 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5562abc6cb00 0x5562abc6eef0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.953+0000 7f858d667640 1 -- 172.21.15.178:0/3043280847 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f858007a030 con 0x5562abc6cb00 2024-09-21T09:03:17.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.953+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abc6b9a0 con 0x5562abb6d720 2024-09-21T09:03:17.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.953+0000 7f858de68640 1 -- 172.21.15.178:0/3043280847 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f858800a4a0 con 0x5562abb6d720 2024-09-21T09:03:17.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.953+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abc6be80 con 0x5562abb6d720 2024-09-21T09:03:17.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.954+0000 7f858de68640 1 -- 172.21.15.178:0/3043280847 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f858800a4a0 con 0x5562abb6d720 2024-09-21T09:03:17.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.954+0000 7f859200f800 1 Processor -- start 2024-09-21T09:03:17.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.954+0000 7f859200f800 1 -- start start 2024-09-21T09:03:17.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.954+0000 7f859200f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc7df60 0x5562abc7e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.954+0000 7f859200f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5562aba05580 con 0x5562abc7df60 2024-09-21T09:03:17.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.954+0000 7f858de68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc7df60 0x5562abc7e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.954+0000 7f858de68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc7df60 0x5562abc7e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42492/0 (socket says 172.21.15.178:42492) 2024-09-21T09:03:17.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.954+0000 7f858de68640 1 -- 172.21.15.178:0/1418611932 learned_addr learned my addr 172.21.15.178:0/1418611932 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.955+0000 7f858de68640 1 -- 172.21.15.178:0/1418611932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562abc7e8c0 con 0x5562abc7df60 2024-09-21T09:03:17.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.955+0000 7f858de68640 1 --2- 172.21.15.178:0/1418611932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc7df60 0x5562abc7e380 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x5562abc6abd0 tx=0x7f8588018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.955+0000 7f8472ffd640 1 -- 172.21.15.178:0/1418611932 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8588014450 con 0x5562abc7df60 2024-09-21T09:03:17.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.955+0000 7f8472ffd640 1 -- 172.21.15.178:0/1418611932 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8588014610 con 0x5562abc7df60 2024-09-21T09:03:17.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.955+0000 7f8472ffd640 1 -- 172.21.15.178:0/1418611932 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8588014930 con 0x5562abc7df60 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.955+0000 7f859200f800 1 -- 172.21.15.178:0/1418611932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562abc7eb50 con 0x5562abc7df60 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.955+0000 7f859200f800 1 -- 172.21.15.178:0/1418611932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562abc81830 con 0x5562abc7df60 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.956+0000 7f8472ffd640 1 -- 172.21.15.178:0/1418611932 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8588011040 con 0x5562abc7df60 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.956+0000 7f8472ffd640 1 --2- 172.21.15.178:0/1418611932 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8464036b90 0x7f8464039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.956+0000 7f8472ffd640 1 -- 172.21.15.178:0/1418611932 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f858801e070 con 0x5562abc7df60 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.956+0000 7f858d667640 1 --2- 172.21.15.178:0/1418611932 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8464036b90 0x7f8464039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.956+0000 7f859200f800 1 Processor -- start 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.956+0000 7f858d667640 1 --2- 172.21.15.178:0/1418611932 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8464036b90 0x7f8464039050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x5562abc6ac70 tx=0x7f8580054f70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.956+0000 7f859200f800 1 -- start start 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.956+0000 7f859200f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc8ab30 0x5562abc8af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.956+0000 7f859200f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5562abb69180 con 0x5562abc8ab30 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.957+0000 7f858de68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc8ab30 0x5562abc8af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.957+0000 7f858de68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc8ab30 0x5562abc8af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42500/0 (socket says 172.21.15.178:42500) 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.957+0000 7f858de68640 1 -- 172.21.15.178:0/794792412 learned_addr learned my addr 172.21.15.178:0/794792412 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.957+0000 7f858de68640 1 -- 172.21.15.178:0/794792412 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562abc8b500 con 0x5562abc8ab30 2024-09-21T09:03:17.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.957+0000 7f858de68640 1 --2- 172.21.15.178:0/794792412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc8ab30 0x5562abc8af30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f858804cbc0 tx=0x7f8588011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f162bf90ce965ca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.957+0000 7f8470ff9640 1 -- 172.21.15.178:0/794792412 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8588040150 con 0x5562abc8ab30 2024-09-21T09:03:17.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.957+0000 7f8470ff9640 1 -- 172.21.15.178:0/794792412 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85880167e0 con 0x5562abc8ab30 2024-09-21T09:03:17.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.957+0000 7f8470ff9640 1 -- 172.21.15.178:0/794792412 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8588014ad0 con 0x5562abc8ab30 2024-09-21T09:03:17.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.958+0000 7f859200f800 1 -- 172.21.15.178:0/794792412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc8ab30 msgr2=0x5562abc8af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:17.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.958+0000 7f859200f800 1 --2- 172.21.15.178:0/794792412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc8ab30 0x5562abc8af30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f858804cbc0 tx=0x7f8588011b10 comp rx=0 tx=0).stop 2024-09-21T09:03:17.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.958+0000 7f859200f800 1 -- 172.21.15.178:0/794792412 shutdown_connections 2024-09-21T09:03:17.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.958+0000 7f859200f800 1 --2- 172.21.15.178:0/794792412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc8ab30 0x5562abc8af30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:17.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.958+0000 7f859200f800 1 -- 172.21.15.178:0/794792412 >> 172.21.15.178:0/794792412 conn(0x5562abc86f20 msgr2=0x5562abc85020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:17.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.958+0000 7f859200f800 1 -- 172.21.15.178:0/794792412 shutdown_connections 2024-09-21T09:03:17.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.958+0000 7f859200f800 1 -- 172.21.15.178:0/794792412 wait complete. 2024-09-21T09:03:17.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.958+0000 7f859200f800 1 Processor -- start 2024-09-21T09:03:17.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.958+0000 7f859200f800 1 -- start start 2024-09-21T09:03:17.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.958+0000 7f859200f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc8ab30 0x5562abc92040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.958+0000 7f859200f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5562abc8bb40 con 0x5562abc8ab30 2024-09-21T09:03:17.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.958+0000 7f858de68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc8ab30 0x5562abc92040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.958+0000 7f858de68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc8ab30 0x5562abc92040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42516/0 (socket says 172.21.15.178:42516) 2024-09-21T09:03:17.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.958+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 learned_addr learned my addr 172.21.15.178:0/2274384692 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:17.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.959+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562abc92580 con 0x5562abc8ab30 2024-09-21T09:03:17.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.959+0000 7f858de68640 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc8ab30 0x5562abc92040 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8588011fd0 tx=0x7f858804cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.959+0000 7f8462ffd640 1 -- 172.21.15.178:0/2274384692 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8588011510 con 0x5562abc8ab30 2024-09-21T09:03:17.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.959+0000 7f8462ffd640 1 -- 172.21.15.178:0/2274384692 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85880116b0 con 0x5562abc8ab30 2024-09-21T09:03:17.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.959+0000 7f8462ffd640 1 -- 172.21.15.178:0/2274384692 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f858804e0d0 con 0x5562abc8ab30 2024-09-21T09:03:17.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.959+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562abc92810 con 0x5562abc8ab30 2024-09-21T09:03:17.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.959+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562abc954c0 con 0x5562abc8ab30 2024-09-21T09:03:17.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.960+0000 7f8462ffd640 1 -- 172.21.15.178:0/2274384692 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f858804e270 con 0x5562abc8ab30 2024-09-21T09:03:17.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.960+0000 7f8462ffd640 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8458036b40 0x7f8458039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.960+0000 7f8462ffd640 1 -- 172.21.15.178:0/2274384692 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8588033030 con 0x5562abc8ab30 2024-09-21T09:03:17.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.960+0000 7f858d667640 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8458036b40 0x7f8458039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.960+0000 7f858d667640 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8458036b40 0x7f8458039000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f858007c730 tx=0x7f858008a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.960+0000 7f859200f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.960+0000 7f859200f800 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5562abc9dcb0 0x5562abca0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.960+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abca08c0 con 0x5562abc9dcb0 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f8587fff640 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5562abc9dcb0 0x5562abca0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f8587fff640 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5562abc9dcb0 0x5562abca0170 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f857800f5f0 con 0x5562abc9dcb0 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f859200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f859200f800 20 realm 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f859200f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abc9d100 con 0x5562abc9dcb0 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f857800f5f0 con 0x5562abc9dcb0 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f859200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f859200f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f859200f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abca13b0 con 0x5562abc9dcb0 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f857800f5f0 con 0x5562abc9dcb0 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f859200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f859200f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.961+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abca1c80 con 0x5562abc9dcb0 2024-09-21T09:03:17.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.962+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f857800f5f0 con 0x5562abc9dcb0 2024-09-21T09:03:17.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.962+0000 7f859200f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.962+0000 7f859200f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.962+0000 7f859200f800 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5562abca26a0 0x5562abca4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.962+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abca5200 con 0x5562abca26a0 2024-09-21T09:03:17.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.962+0000 7f858de68640 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5562abca26a0 0x5562abca4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.962+0000 7f858de68640 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5562abca26a0 0x5562abca4a90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.963+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.963+0000 7f859200f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:17.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.963+0000 7f859200f800 20 searching for the correct realm 2024-09-21T09:03:17.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.963+0000 7f859200f800 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5562abca71b0 0x5562abca9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.963+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca71b0 2024-09-21T09:03:17.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.963+0000 7f858d667640 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5562abca71b0 0x5562abca9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.963+0000 7f858d667640 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5562abca71b0 0x5562abca9670 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.963+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.963+0000 7f858d667640 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f858007d060 0x7f858008e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:17.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.963+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x7f858007d060 2024-09-21T09:03:17.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.963+0000 7f8587fff640 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f858007d060 0x7f858008e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:17.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.964+0000 7f8587fff640 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f858007d060 0x7f858008e360 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:17.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.964+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857800f5f0 con 0x7f858007d060 2024-09-21T09:03:17.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.964+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca26a0 2024-09-21T09:03:17.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.964+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.964+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abc9dcb0 2024-09-21T09:03:17.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.965+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857800f5f0 con 0x5562abc9dcb0 2024-09-21T09:03:17.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.965+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abc9dcb0 2024-09-21T09:03:17.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.965+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.965+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca26a0 2024-09-21T09:03:17.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.965+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.965+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca26a0 2024-09-21T09:03:17.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.965+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.965+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x7f858007d060 2024-09-21T09:03:17.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.966+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857802b040 con 0x7f858007d060 2024-09-21T09:03:17.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.966+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca71b0 2024-09-21T09:03:17.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.966+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.966+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abc9dcb0 2024-09-21T09:03:17.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.966+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.966+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca26a0 2024-09-21T09:03:17.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.966+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.966+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abc9dcb0 2024-09-21T09:03:17.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.967+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.967+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x7f858007d060 2024-09-21T09:03:17.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.967+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f857802b040 con 0x7f858007d060 2024-09-21T09:03:17.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.967+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca71b0 2024-09-21T09:03:17.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.967+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.967+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca71b0 2024-09-21T09:03:17.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.967+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.967+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca26a0 2024-09-21T09:03:17.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.968+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.968+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca71b0 2024-09-21T09:03:17.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.968+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.968+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca71b0 2024-09-21T09:03:17.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.968+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.968+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abc9dcb0 2024-09-21T09:03:17.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.968+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.968+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abc9dcb0 2024-09-21T09:03:17.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.968+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.968+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca26a0 2024-09-21T09:03:17.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.969+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.969+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca71b0 2024-09-21T09:03:17.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.969+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.969+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x7f858007d060 2024-09-21T09:03:17.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.969+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857802b040 con 0x7f858007d060 2024-09-21T09:03:17.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.969+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abc9dcb0 2024-09-21T09:03:17.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.969+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.969+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca26a0 2024-09-21T09:03:17.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.970+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.970+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca71b0 2024-09-21T09:03:17.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.970+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.970+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca26a0 2024-09-21T09:03:17.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.970+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.970+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x7f858007d060 2024-09-21T09:03:17.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.970+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857802b040 con 0x7f858007d060 2024-09-21T09:03:17.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.970+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca71b0 2024-09-21T09:03:17.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abca26a0 2024-09-21T09:03:17.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x5562abc9dcb0 2024-09-21T09:03:17.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5562abca9d40 con 0x7f858007d060 2024-09-21T09:03:17.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857802b040 con 0x7f858007d060 2024-09-21T09:03:17.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f859200f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:17.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f859200f800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:17.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f859200f800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:17.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f859200f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:17.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f859200f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:17.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f859200f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:17.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f859200f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.971+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abca5bc0 con 0x5562abc9dcb0 2024-09-21T09:03:17.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abca5800 con 0x5562abc9dcb0 2024-09-21T09:03:17.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:17.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abca6560 con 0x5562abc9dcb0 2024-09-21T09:03:17.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:17.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 20 zone default found 2024-09-21T09:03:17.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 4 Realm: () 2024-09-21T09:03:17.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:17.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:17.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:17.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 20 zonegroup default 2024-09-21T09:03:17.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abcaa200 con 0x5562abca26a0 2024-09-21T09:03:17.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.972+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abcac4d0 con 0x5562abca71b0 2024-09-21T09:03:17.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.973+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.973+0000 7f859200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.973+0000 7f859200f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.973+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abcac870 con 0x5562abca71b0 2024-09-21T09:03:17.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.973+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.973+0000 7f859200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.973+0000 7f859200f800 20 started sync module instance, tier type = 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.973+0000 7f859200f800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.973+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcab960 con 0x7f858007d060 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.974+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857802b040 con 0x7f858007d060 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.974+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93882277346992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcab960 con 0x7f858007d060 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.974+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcad280 con 0x5562abc9dcb0 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.975+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93882277346992] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857802b040 con 0x7f858007d060 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.975+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.975+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93882277344912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcad280 con 0x5562abc9dcb0 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.975+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcadc40 con 0x5562abca71b0 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.976+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93882277344912] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.976+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.977+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93882277350864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcad1f0 con 0x5562abca71b0 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.977+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcaeb00 con 0x7f858007d060 2024-09-21T09:03:17.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.978+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93882277350864] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.978+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857802b040 con 0x7f858007d060 2024-09-21T09:03:17.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.978+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93882277357136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcaef20 con 0x7f858007d060 2024-09-21T09:03:17.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.978+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcaf8e0 con 0x5562abc9dcb0 2024-09-21T09:03:17.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.979+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.979+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93882277357136] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857802b040 con 0x7f858007d060 2024-09-21T09:03:17.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.979+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93882277360688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcafd00 con 0x5562abc9dcb0 2024-09-21T09:03:17.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.979+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcaea70 con 0x5562abca26a0 2024-09-21T09:03:17.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.980+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.980+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93882277364368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcb0b60 con 0x5562abca26a0 2024-09-21T09:03:17.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.980+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93882277360688] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.980+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcb1560 con 0x5562abca26a0 2024-09-21T09:03:17.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.981+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.981+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93882277361744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcb1520 con 0x5562abca26a0 2024-09-21T09:03:17.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.981+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcb1fc0 con 0x5562abca26a0 2024-09-21T09:03:17.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.981+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93882277364368] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.982+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93882277361744] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.982+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.982+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93882277370544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcb1070 con 0x5562abca26a0 2024-09-21T09:03:17.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.982+0000 7f859200f800 20 add_watcher() i=0 2024-09-21T09:03:17.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.982+0000 7f859200f800 20 add_watcher() i=1 2024-09-21T09:03:17.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.982+0000 7f859200f800 20 add_watcher() i=2 2024-09-21T09:03:17.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.982+0000 7f859200f800 20 add_watcher() i=3 2024-09-21T09:03:17.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.982+0000 7f859200f800 20 add_watcher() i=4 2024-09-21T09:03:17.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.982+0000 7f859200f800 20 add_watcher() i=5 2024-09-21T09:03:17.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.982+0000 7f859200f800 20 add_watcher() i=6 2024-09-21T09:03:17.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.983+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93882277370544] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.983+0000 7f859200f800 20 add_watcher() i=7 2024-09-21T09:03:17.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.983+0000 7f859200f800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:17.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.983+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abcb1070 con 0x5562abc9dcb0 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.983+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.983+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93882277365424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcb1070 con 0x5562abc9dcb0 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.984+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93882277365424] v29'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.984+0000 7f84437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.984+0000 7f859200f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.984+0000 7f859200f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.984+0000 7f859200f800 5 note: GC not initialized 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.985+0000 7f84427e4640 20 reqs_thread_entry: start 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.985+0000 7f859200f800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.985+0000 7f859200f800 20 Filter name: none 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.985+0000 7f83b3fff640 20 reqs_thread_entry: start 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.985+0000 7f859200f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.985+0000 7f859200f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.985+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abce83b0 con 0x5562abc9dcb0 2024-09-21T09:03:17.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.985+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.985+0000 7f859200f800 20 rados_obj.operate() r=0 bl.length=502 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.985+0000 7f859200f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.985+0000 7f859200f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.985+0000 7f859200f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.985+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abceea70 con 0x5562abc9dcb0 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.986+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v29'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.986+0000 7f859200f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.986+0000 7f859200f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.986+0000 7f859200f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.986+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93882277618736 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abcea090 con 0x5562abc9dcb0 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.987+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify (1) cookie 93882277360688 notify 124554051588 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f8578018040 con 0x5562abc9dcb0 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.987+0000 7f8470ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051588 cookie 93882277360688 notifier 4357 bl.length()=567 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.987+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(64 notify.4 [notify cookie 93882277618736 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.987+0000 7f8470ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:17.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.987+0000 7f8470ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:17.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.987+0000 7f8470ff9640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8450003ea0 con 0x5562abc9dcb0 2024-09-21T09:03:17.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.987+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:17.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.987+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== watch-notify(notify_complete (2) cookie 93882277618736 notify 124554051588 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f857803fa80 con 0x5562abc9dcb0 2024-09-21T09:03:17.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.987+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abcee430 con 0x5562abca26a0 2024-09-21T09:03:17.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.989+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v29'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:17.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.989+0000 7f859200f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T09:03:17.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.989+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93882277618736 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562abce9be0 con 0x5562abca71b0 2024-09-21T09:03:17.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.989+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== watch-notify(notify (1) cookie 93882277350864 notify 124554051585 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7f85800ae040 con 0x5562abca71b0 2024-09-21T09:03:17.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.989+0000 7f8470ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051585 cookie 93882277350864 notifier 4357 bl.length()=170 2024-09-21T09:03:17.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.989+0000 7f8470ff9640 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8450003ea0 con 0x5562abca71b0 2024-09-21T09:03:17.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.989+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 notify.2 [notify cookie 93882277618736 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.989+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:17.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.989+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== watch-notify(notify_complete (2) cookie 93882277618736 notify 124554051585 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5562abc63c90 con 0x5562abca71b0 2024-09-21T09:03:17.998 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:18.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.990+0000 7f84437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:18.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.990+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93882277365424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abce60b0 con 0x5562abc9dcb0 2024-09-21T09:03:18.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.991+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93882277365424] v29'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:18.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.991+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93882277346992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abce60b0 con 0x7f858007d060 2024-09-21T09:03:18.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.992+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93882277346992] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857802b040 con 0x7f858007d060 2024-09-21T09:03:18.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.992+0000 7f859200f800 20 remove_watcher() i=0 2024-09-21T09:03:18.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.992+0000 7f859200f800 2 removed watcher, disabling cache 2024-09-21T09:03:18.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.992+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93882277344912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abce60b0 con 0x5562abc9dcb0 2024-09-21T09:03:18.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.993+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93882277344912] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:18.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.993+0000 7f859200f800 20 remove_watcher() i=1 2024-09-21T09:03:18.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.993+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93882277350864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abce60b0 con 0x5562abca71b0 2024-09-21T09:03:18.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.994+0000 7f858d667640 1 -- 172.21.15.178:0/2274384692 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93882277350864] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f858007a030 con 0x5562abca71b0 2024-09-21T09:03:18.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.994+0000 7f859200f800 20 remove_watcher() i=2 2024-09-21T09:03:18.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.994+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93882277357136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abce60b0 con 0x7f858007d060 2024-09-21T09:03:18.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.995+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93882277357136] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857802b040 con 0x7f858007d060 2024-09-21T09:03:18.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.995+0000 7f859200f800 20 remove_watcher() i=3 2024-09-21T09:03:18.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.995+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93882277360688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abce60b0 con 0x5562abc9dcb0 2024-09-21T09:03:18.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.996+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93882277360688] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857802b040 con 0x5562abc9dcb0 2024-09-21T09:03:18.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.996+0000 7f859200f800 20 remove_watcher() i=4 2024-09-21T09:03:18.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.996+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93882277364368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abce60b0 con 0x5562abca26a0 2024-09-21T09:03:18.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.997+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93882277364368] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:18.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.997+0000 7f859200f800 20 remove_watcher() i=5 2024-09-21T09:03:18.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.997+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93882277361744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abce60b0 con 0x5562abca26a0 2024-09-21T09:03:18.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.999+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93882277361744] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:18.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.999+0000 7f859200f800 20 remove_watcher() i=6 2024-09-21T09:03:18.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:17.999+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93882277370544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562abce60b0 con 0x5562abca26a0 2024-09-21T09:03:18.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f858de68640 1 -- 172.21.15.178:0/2274384692 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93882277370544] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f858802a070 con 0x5562abca26a0 2024-09-21T09:03:18.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 20 remove_watcher() i=7 2024-09-21T09:03:18.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5562abca26a0 msgr2=0x5562abca4a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5562abca26a0 0x5562abca4a90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5562abc9dcb0 msgr2=0x5562abca0170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5562abc9dcb0 0x5562abca0170 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f858007d060 msgr2=0x7f858008e360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f858007d060 0x7f858008e360 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5562abca71b0 msgr2=0x5562abca9670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5562abca71b0 0x5562abca9670 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8458036b40 msgr2=0x7f8458039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8458036b40 0x7f8458039000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f858007c730 tx=0x7f858008a000 comp rx=0 tx=0).stop 2024-09-21T09:03:18.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc8ab30 msgr2=0x5562abc92040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 --2- 172.21.15.178:0/2274384692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc8ab30 0x5562abc92040 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8588011fd0 tx=0x7f858804cb50 comp rx=0 tx=0).stop 2024-09-21T09:03:18.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 reap_dead start 2024-09-21T09:03:18.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f8587fff640 1 -- 172.21.15.178:0/2274384692 reap_dead start 2024-09-21T09:03:18.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 shutdown_connections 2024-09-21T09:03:18.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 >> 172.21.15.178:0/2274384692 conn(0x5562abc86f20 msgr2=0x5562abc84ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 shutdown_connections 2024-09-21T09:03:18.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/2274384692 wait complete. 2024-09-21T09:03:18.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/1418611932 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8464036b90 msgr2=0x7f8464039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 --2- 172.21.15.178:0/1418611932 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8464036b90 0x7f8464039050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x5562abc6ac70 tx=0x7f8580054f70 comp rx=0 tx=0).stop 2024-09-21T09:03:18.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/1418611932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc7df60 msgr2=0x5562abc7e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 --2- 172.21.15.178:0/1418611932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc7df60 0x5562abc7e380 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x5562abc6abd0 tx=0x7f8588018830 comp rx=0 tx=0).stop 2024-09-21T09:03:18.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/1418611932 shutdown_connections 2024-09-21T09:03:18.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 --2- 172.21.15.178:0/1418611932 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8464036b90 0x7f8464039050 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 --2- 172.21.15.178:0/1418611932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abc7df60 0x5562abc7e380 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/1418611932 >> 172.21.15.178:0/1418611932 conn(0x5562abc72ef0 msgr2=0x5562abc75a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/1418611932 shutdown_connections 2024-09-21T09:03:18.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.000+0000 7f859200f800 1 -- 172.21.15.178:0/1418611932 wait complete. 2024-09-21T09:03:18.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5562abc6cb00 msgr2=0x5562abc6eef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5562abc6cb00 0x5562abc6eef0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5562abb6d720 msgr2=0x5562abc6a240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5562abb6d720 0x5562abc6a240 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8474036b90 msgr2=0x7f8474039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8474036b90 0x7f8474039050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8578000c00 tx=0x7f85780013b0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 msgr2=0x5562abc631d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abc631d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8580045f50 tx=0x7f8580002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 shutdown_connections 2024-09-21T09:03:18.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5562abc6cb00 0x5562abc6eef0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5562abb6d720 0x5562abc6a240 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8474036b90 0x7f8474039050 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 --2- 172.21.15.178:0/3043280847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562abade650 0x5562abc631d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 >> 172.21.15.178:0/3043280847 conn(0x5562abb64db0 msgr2=0x5562abc54c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 shutdown_connections 2024-09-21T09:03:18.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.001+0000 7f859200f800 1 -- 172.21.15.178:0/3043280847 wait complete. 2024-09-21T09:03:18.013 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:18.013 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-21T09:03:18.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-21T09:03:18.014 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-21T09:03:18.060 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:18.060 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:18.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.059+0000 7f9a5042f800 1 Processor -- start 2024-09-21T09:03:18.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.059+0000 7f9a5042f800 1 -- start start 2024-09-21T09:03:18.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.059+0000 7f9a5042f800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55eff435a630 0x55eff43eb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.059+0000 7f9a5042f800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eff42a5b30 con 0x55eff43ebb40 2024-09-21T09:03:18.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.059+0000 7f9a5042f800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55eff4287360 con 0x55eff435a630 2024-09-21T09:03:18.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.060+0000 7f9a4b6ee640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55eff435a630 0x55eff43eb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.060+0000 7f9a4b6ee640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55eff435a630 0x55eff43eb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42522/0 (socket says 172.21.15.178:42522) 2024-09-21T09:03:18.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.060+0000 7f9a4aeed640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55eff43ebb40 0x55eff43edf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46620/0 (socket says 172.21.15.178:46620) 2024-09-21T09:03:18.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.060+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2415003243 learned_addr learned my addr 172.21.15.178:0/2415003243 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.060+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2415003243 >> v1:172.21.15.44:6789/0 conn(0x55eff43ebb40 legacy=0x55eff43edf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.060+0000 7f9a4a6ec640 1 -- 172.21.15.178:0/2415003243 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2746655635 0 0) 0x55eff42a5b30 con 0x55eff43ebb40 2024-09-21T09:03:18.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.060+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2415003243 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff42ade00 con 0x55eff435a630 2024-09-21T09:03:18.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.062+0000 7f9a4b6ee640 1 --2- 172.21.15.178:0/2415003243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff43eb600 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00a520 tx=0x7f9a3c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3cf74aa82ae730 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.062+0000 7f9a4a6ec640 1 -- 172.21.15.178:0/2415003243 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a3c055070 con 0x55eff435a630 2024-09-21T09:03:18.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.062+0000 7f9a4a6ec640 1 -- 172.21.15.178:0/2415003243 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a3c0515b0 con 0x55eff435a630 2024-09-21T09:03:18.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.062+0000 7f9a4a6ec640 1 -- 172.21.15.178:0/2415003243 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a3c0518d0 con 0x55eff435a630 2024-09-21T09:03:18.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.062+0000 7f9a5042f800 1 -- 172.21.15.178:0/2415003243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 msgr2=0x55eff43eb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.062+0000 7f9a5042f800 1 --2- 172.21.15.178:0/2415003243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff43eb600 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00a520 tx=0x7f9a3c045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.062+0000 7f9a5042f800 1 -- 172.21.15.178:0/2415003243 shutdown_connections 2024-09-21T09:03:18.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.062+0000 7f9a5042f800 1 --2- 172.21.15.178:0/2415003243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff43eb600 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.062+0000 7f9a5042f800 1 -- 172.21.15.178:0/2415003243 >> 172.21.15.178:0/2415003243 conn(0x55eff43e0db0 msgr2=0x55eff43e31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.063+0000 7f9a5042f800 1 -- 172.21.15.178:0/2415003243 shutdown_connections 2024-09-21T09:03:18.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.063+0000 7f9a5042f800 1 -- 172.21.15.178:0/2415003243 wait complete. 2024-09-21T09:03:18.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.076+0000 7f9a5042f800 1 Processor -- start 2024-09-21T09:03:18.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.076+0000 7f9a5042f800 1 -- start start 2024-09-21T09:03:18.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.076+0000 7f9a5042f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff44d7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.076+0000 7f9a5042f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eff4332360 con 0x55eff435a630 2024-09-21T09:03:18.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.077+0000 7f9a4b6ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff44d7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.077+0000 7f9a4b6ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff44d7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42528/0 (socket says 172.21.15.178:42528) 2024-09-21T09:03:18.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.077+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2566211381 learned_addr learned my addr 172.21.15.178:0/2566211381 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.077+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2566211381 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff427fbc0 con 0x55eff435a630 2024-09-21T09:03:18.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.077+0000 7f9a4b6ee640 1 --2- 172.21.15.178:0/2566211381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff44d7830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c025da0 tx=0x7f9a3c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c36f30866415134 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.077+0000 7f993960a640 1 -- 172.21.15.178:0/2566211381 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a3c051ac0 con 0x55eff435a630 2024-09-21T09:03:18.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.077+0000 7f993960a640 1 -- 172.21.15.178:0/2566211381 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a3c051c60 con 0x55eff435a630 2024-09-21T09:03:18.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.077+0000 7f993960a640 1 -- 172.21.15.178:0/2566211381 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a3c066460 con 0x55eff435a630 2024-09-21T09:03:18.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.078+0000 7f9a5042f800 1 -- 172.21.15.178:0/2566211381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 msgr2=0x55eff44d7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.078+0000 7f9a5042f800 1 --2- 172.21.15.178:0/2566211381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff44d7830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c025da0 tx=0x7f9a3c051000 comp rx=0 tx=0).stop 2024-09-21T09:03:18.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.078+0000 7f9a5042f800 1 -- 172.21.15.178:0/2566211381 shutdown_connections 2024-09-21T09:03:18.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.078+0000 7f9a5042f800 1 --2- 172.21.15.178:0/2566211381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff44d7830 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.078+0000 7f9a5042f800 1 -- 172.21.15.178:0/2566211381 >> 172.21.15.178:0/2566211381 conn(0x55eff43e0db0 msgr2=0x55eff44d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.078+0000 7f9a5042f800 1 -- 172.21.15.178:0/2566211381 shutdown_connections 2024-09-21T09:03:18.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.078+0000 7f9a5042f800 1 -- 172.21.15.178:0/2566211381 wait complete. 2024-09-21T09:03:18.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.078+0000 7f9a5042f800 1 Processor -- start 2024-09-21T09:03:18.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.079+0000 7f9a5042f800 1 -- start start 2024-09-21T09:03:18.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.079+0000 7f9a5042f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff44df1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.079+0000 7f9a5042f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eff43ef920 con 0x55eff435a630 2024-09-21T09:03:18.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.079+0000 7f9a4b6ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff44df1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.079+0000 7f9a4b6ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff44df1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42530/0 (socket says 172.21.15.178:42530) 2024-09-21T09:03:18.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.079+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/3828086448 learned_addr learned my addr 172.21.15.178:0/3828086448 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.079+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/3828086448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff4293fe0 con 0x55eff435a630 2024-09-21T09:03:18.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.079+0000 7f9a4b6ee640 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff44df1b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0460a0 tx=0x7f9a3c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.080+0000 7f9937e07640 1 -- 172.21.15.178:0/3828086448 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a3c066650 con 0x55eff435a630 2024-09-21T09:03:18.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.080+0000 7f9937e07640 1 -- 172.21.15.178:0/3828086448 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a3c066810 con 0x55eff435a630 2024-09-21T09:03:18.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.080+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eff44df6f0 con 0x55eff435a630 2024-09-21T09:03:18.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.080+0000 7f9937e07640 1 -- 172.21.15.178:0/3828086448 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a3c066b30 con 0x55eff435a630 2024-09-21T09:03:18.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.080+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eff44dfc10 con 0x55eff435a630 2024-09-21T09:03:18.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.080+0000 7f9937e07640 1 -- 172.21.15.178:0/3828086448 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9a3c079060 con 0x55eff435a630 2024-09-21T09:03:18.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.080+0000 7f9937e07640 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9930036b90 0x7f9930039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.081+0000 7f9937e07640 1 -- 172.21.15.178:0/3828086448 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9a3c062070 con 0x55eff435a630 2024-09-21T09:03:18.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.081+0000 7f9a4aeed640 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9930036b90 0x7f9930039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.081+0000 7f9a5042f800 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eff43ebb40 0x55eff44e6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.081+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff44e67f0 con 0x55eff43ebb40 2024-09-21T09:03:18.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.081+0000 7f9a4beef640 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eff43ebb40 0x55eff44e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.081+0000 7f9a4aeed640 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9930036b90 0x7f9930039050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a40000c00 tx=0x7f9a400013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.081+0000 7f9a4beef640 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eff43ebb40 0x55eff44e6220 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.081+0000 7f9a4beef640 1 -- 172.21.15.178:0/3828086448 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a4400a4a0 con 0x55eff43ebb40 2024-09-21T09:03:18.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.081+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff44e37d0 con 0x55eff43ebb40 2024-09-21T09:03:18.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.082+0000 7f9a4beef640 1 -- 172.21.15.178:0/3828086448 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a4400a4a0 con 0x55eff43ebb40 2024-09-21T09:03:18.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.082+0000 7f9a5042f800 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eff44e8ae0 0x55eff44eaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.082+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff44eb570 con 0x55eff44e8ae0 2024-09-21T09:03:18.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.082+0000 7f9a4b6ee640 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eff44e8ae0 0x55eff44eaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.082+0000 7f9a4b6ee640 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eff44e8ae0 0x55eff44eaed0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.083+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/3828086448 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff44e8ae0 2024-09-21T09:03:18.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.083+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff44e7950 con 0x55eff43ebb40 2024-09-21T09:03:18.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.083+0000 7f9a4beef640 1 -- 172.21.15.178:0/3828086448 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a4400a4a0 con 0x55eff43ebb40 2024-09-21T09:03:18.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.083+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff44e7e30 con 0x55eff43ebb40 2024-09-21T09:03:18.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.083+0000 7f9a4beef640 1 -- 172.21.15.178:0/3828086448 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9a4400a4a0 con 0x55eff43ebb40 2024-09-21T09:03:18.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.083+0000 7f9a5042f800 1 Processor -- start 2024-09-21T09:03:18.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.084+0000 7f9a5042f800 1 -- start start 2024-09-21T09:03:18.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.084+0000 7f9a5042f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff44f9f00 0x55eff44fa320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.084+0000 7f9a5042f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eff4281580 con 0x55eff44f9f00 2024-09-21T09:03:18.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.084+0000 7f9a4beef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff44f9f00 0x55eff44fa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.084+0000 7f9a4beef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff44f9f00 0x55eff44fa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42546/0 (socket says 172.21.15.178:42546) 2024-09-21T09:03:18.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.084+0000 7f9a4beef640 1 -- 172.21.15.178:0/4003374334 learned_addr learned my addr 172.21.15.178:0/4003374334 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.084+0000 7f9a4beef640 1 -- 172.21.15.178:0/4003374334 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff44fa860 con 0x55eff44f9f00 2024-09-21T09:03:18.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.084+0000 7f9a4beef640 1 --2- 172.21.15.178:0/4003374334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff44f9f00 0x55eff44fa320 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55eff44e0260 tx=0x7f9a440188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.084+0000 7f9935602640 1 -- 172.21.15.178:0/4003374334 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a44014450 con 0x55eff44f9f00 2024-09-21T09:03:18.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.084+0000 7f9935602640 1 -- 172.21.15.178:0/4003374334 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a440145f0 con 0x55eff44f9f00 2024-09-21T09:03:18.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.085+0000 7f9a5042f800 1 -- 172.21.15.178:0/4003374334 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eff44faaf0 con 0x55eff44f9f00 2024-09-21T09:03:18.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.085+0000 7f9935602640 1 -- 172.21.15.178:0/4003374334 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a440148d0 con 0x55eff44f9f00 2024-09-21T09:03:18.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.085+0000 7f9a5042f800 1 -- 172.21.15.178:0/4003374334 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eff44fd7d0 con 0x55eff44f9f00 2024-09-21T09:03:18.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.085+0000 7f9935602640 1 -- 172.21.15.178:0/4003374334 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9a44011040 con 0x55eff44f9f00 2024-09-21T09:03:18.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.085+0000 7f9935602640 1 --2- 172.21.15.178:0/4003374334 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9924036b40 0x7f9924039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.086+0000 7f9935602640 1 -- 172.21.15.178:0/4003374334 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9a4401e070 con 0x55eff44f9f00 2024-09-21T09:03:18.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.086+0000 7f9a4b6ee640 1 --2- 172.21.15.178:0/4003374334 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9924036b40 0x7f9924039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.086+0000 7f9a5042f800 1 Processor -- start 2024-09-21T09:03:18.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.086+0000 7f9a4b6ee640 1 --2- 172.21.15.178:0/4003374334 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9924036b40 0x7f9924039000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c08e700 tx=0x7f9a3c066eb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.086+0000 7f9a5042f800 1 -- start start 2024-09-21T09:03:18.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.086+0000 7f9a5042f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff4506b80 0x55eff4506f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.086+0000 7f9a5042f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eff44d7f20 con 0x55eff4506b80 2024-09-21T09:03:18.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.086+0000 7f9a4beef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff4506b80 0x55eff4506f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.086+0000 7f9a4beef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff4506b80 0x55eff4506f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42548/0 (socket says 172.21.15.178:42548) 2024-09-21T09:03:18.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.086+0000 7f9a4beef640 1 -- 172.21.15.178:0/472788526 learned_addr learned my addr 172.21.15.178:0/472788526 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.087+0000 7f9a4beef640 1 -- 172.21.15.178:0/472788526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff4507550 con 0x55eff4506b80 2024-09-21T09:03:18.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.087+0000 7f9a4beef640 1 --2- 172.21.15.178:0/472788526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff4506b80 0x55eff4506f80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9a4404cb80 tx=0x7f9a4403bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b26df21dda6d23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.087+0000 7f992effd640 1 -- 172.21.15.178:0/472788526 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a44040210 con 0x55eff4506b80 2024-09-21T09:03:18.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.087+0000 7f992effd640 1 -- 172.21.15.178:0/472788526 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a44013c80 con 0x55eff4506b80 2024-09-21T09:03:18.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.087+0000 7f992effd640 1 -- 172.21.15.178:0/472788526 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a4404e0d0 con 0x55eff4506b80 2024-09-21T09:03:18.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.087+0000 7f9a5042f800 1 -- 172.21.15.178:0/472788526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff4506b80 msgr2=0x55eff4506f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.087+0000 7f9a5042f800 1 --2- 172.21.15.178:0/472788526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff4506b80 0x55eff4506f80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9a4404cb80 tx=0x7f9a4403bf60 comp rx=0 tx=0).stop 2024-09-21T09:03:18.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.087+0000 7f9a5042f800 1 -- 172.21.15.178:0/472788526 shutdown_connections 2024-09-21T09:03:18.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.087+0000 7f9a5042f800 1 --2- 172.21.15.178:0/472788526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff4506b80 0x55eff4506f80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.087+0000 7f9a5042f800 1 -- 172.21.15.178:0/472788526 >> 172.21.15.178:0/472788526 conn(0x55eff4502ee0 msgr2=0x55eff4501030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.087+0000 7f9a5042f800 1 -- 172.21.15.178:0/472788526 shutdown_connections 2024-09-21T09:03:18.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.087+0000 7f9a5042f800 1 -- 172.21.15.178:0/472788526 wait complete. 2024-09-21T09:03:18.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.088+0000 7f9a5042f800 1 Processor -- start 2024-09-21T09:03:18.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.088+0000 7f9a5042f800 1 -- start start 2024-09-21T09:03:18.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.088+0000 7f9a5042f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff4506b80 0x55eff450e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.088+0000 7f9a5042f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eff4507b20 con 0x55eff4506b80 2024-09-21T09:03:18.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.088+0000 7f9a4beef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff4506b80 0x55eff450e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.088+0000 7f9a4beef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff4506b80 0x55eff450e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42564/0 (socket says 172.21.15.178:42564) 2024-09-21T09:03:18.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.088+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 learned_addr learned my addr 172.21.15.178:0/2591339107 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.088+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff450e5b0 con 0x55eff4506b80 2024-09-21T09:03:18.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.088+0000 7f9a4beef640 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff4506b80 0x55eff450e070 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9a4403e040 tx=0x7f9a4404cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.089+0000 7f992d7fa640 1 -- 172.21.15.178:0/2591339107 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a44044030 con 0x55eff4506b80 2024-09-21T09:03:18.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.089+0000 7f992d7fa640 1 -- 172.21.15.178:0/2591339107 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a44040210 con 0x55eff4506b80 2024-09-21T09:03:18.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.089+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eff450e840 con 0x55eff4506b80 2024-09-21T09:03:18.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.089+0000 7f992d7fa640 1 -- 172.21.15.178:0/2591339107 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a44013e30 con 0x55eff4506b80 2024-09-21T09:03:18.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.089+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eff45114f0 con 0x55eff4506b80 2024-09-21T09:03:18.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.089+0000 7f992d7fa640 1 -- 172.21.15.178:0/2591339107 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9a4402bc70 con 0x55eff4506b80 2024-09-21T09:03:18.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.090+0000 7f992d7fa640 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9914036af0 0x7f9914038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.090+0000 7f992d7fa640 1 -- 172.21.15.178:0/2591339107 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9a44045070 con 0x55eff4506b80 2024-09-21T09:03:18.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.090+0000 7f9a4b6ee640 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9914036af0 0x7f9914038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.090+0000 7f9a4b6ee640 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9914036af0 0x7f9914038fb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55eff44eb970 tx=0x7f9a3c088000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.090+0000 7f9a5042f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.090+0000 7f9a5042f800 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eff4519c10 0x55eff451c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.090+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff451c820 con 0x55eff4519c10 2024-09-21T09:03:18.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.090+0000 7f9a4aeed640 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eff4519c10 0x55eff451c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a4aeed640 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eff4519c10 0x55eff451c0d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a4000f5f0 con 0x55eff4519c10 2024-09-21T09:03:18.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a5042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a5042f800 20 realm 2024-09-21T09:03:18.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a5042f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff4519060 con 0x55eff4519c10 2024-09-21T09:03:18.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a4000f5f0 con 0x55eff4519c10 2024-09-21T09:03:18.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a5042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a5042f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:18.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a5042f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff451d310 con 0x55eff4519c10 2024-09-21T09:03:18.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a4000f5f0 con 0x55eff4519c10 2024-09-21T09:03:18.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a5042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a5042f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.091+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff451dbe0 con 0x55eff4519c10 2024-09-21T09:03:18.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.092+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a4000f5f0 con 0x55eff4519c10 2024-09-21T09:03:18.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.092+0000 7f9a5042f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:18.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.092+0000 7f9a5042f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.092+0000 7f9a5042f800 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eff451e600 0x55eff45209f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.092+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff4521160 con 0x55eff451e600 2024-09-21T09:03:18.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.092+0000 7f9a4beef640 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eff451e600 0x55eff45209f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.092+0000 7f9a4beef640 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eff451e600 0x55eff45209f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.093+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.093+0000 7f9a5042f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:18.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.093+0000 7f9a5042f800 20 searching for the correct realm 2024-09-21T09:03:18.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.093+0000 7f9a5042f800 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55eff4523130 0x55eff45255f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.093+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4523130 2024-09-21T09:03:18.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.093+0000 7f9a4b6ee640 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55eff4523130 0x55eff45255f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.093+0000 7f9a4b6ee640 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55eff4523130 0x55eff45255f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.093+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff4523130 2024-09-21T09:03:18.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.093+0000 7f9a4b6ee640 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9a3c088070 0x7f9a3c0659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.093+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x7f9a3c088070 2024-09-21T09:03:18.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.093+0000 7f9a4aeed640 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9a3c088070 0x7f9a3c0659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.094+0000 7f9a4aeed640 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9a3c088070 0x7f9a3c0659c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.094+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4000f5f0 con 0x7f9a3c088070 2024-09-21T09:03:18.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.094+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff451e600 2024-09-21T09:03:18.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.094+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.094+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4519c10 2024-09-21T09:03:18.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.095+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4000f5f0 con 0x55eff4519c10 2024-09-21T09:03:18.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.095+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4519c10 2024-09-21T09:03:18.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.095+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.095+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff451e600 2024-09-21T09:03:18.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.095+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.095+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff451e600 2024-09-21T09:03:18.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.095+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.095+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x7f9a3c088070 2024-09-21T09:03:18.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.096+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4002b040 con 0x7f9a3c088070 2024-09-21T09:03:18.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.096+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4523130 2024-09-21T09:03:18.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.096+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff4523130 2024-09-21T09:03:18.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.096+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4519c10 2024-09-21T09:03:18.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.096+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.096+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff451e600 2024-09-21T09:03:18.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.096+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.097+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4519c10 2024-09-21T09:03:18.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.097+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.097+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x7f9a3c088070 2024-09-21T09:03:18.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.097+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9a4002b040 con 0x7f9a3c088070 2024-09-21T09:03:18.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.097+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4523130 2024-09-21T09:03:18.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.097+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff4523130 2024-09-21T09:03:18.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.097+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4523130 2024-09-21T09:03:18.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.097+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff4523130 2024-09-21T09:03:18.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.097+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff451e600 2024-09-21T09:03:18.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.098+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.098+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4523130 2024-09-21T09:03:18.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.098+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff4523130 2024-09-21T09:03:18.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.098+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4523130 2024-09-21T09:03:18.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.098+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff4523130 2024-09-21T09:03:18.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.098+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4519c10 2024-09-21T09:03:18.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.098+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.098+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4519c10 2024-09-21T09:03:18.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.099+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.099+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff451e600 2024-09-21T09:03:18.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.099+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.099+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4523130 2024-09-21T09:03:18.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.099+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff4523130 2024-09-21T09:03:18.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.099+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x7f9a3c088070 2024-09-21T09:03:18.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.099+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4002b040 con 0x7f9a3c088070 2024-09-21T09:03:18.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.099+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4519c10 2024-09-21T09:03:18.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.100+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.100+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff451e600 2024-09-21T09:03:18.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.100+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.100+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4523130 2024-09-21T09:03:18.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.100+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff4523130 2024-09-21T09:03:18.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.100+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff451e600 2024-09-21T09:03:18.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.101+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.101+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x7f9a3c088070 2024-09-21T09:03:18.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.101+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4002b040 con 0x7f9a3c088070 2024-09-21T09:03:18.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.101+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4523130 2024-09-21T09:03:18.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.101+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff4523130 2024-09-21T09:03:18.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.101+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff451e600 2024-09-21T09:03:18.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.101+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.101+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x55eff4519c10 2024-09-21T09:03:18.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eff4525cc0 con 0x7f9a3c088070 2024-09-21T09:03:18.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a4002b040 con 0x7f9a3c088070 2024-09-21T09:03:18.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a5042f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:18.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a5042f800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:18.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a5042f800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:18.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a5042f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:18.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a5042f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:18.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a5042f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:18.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a5042f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff4521b20 con 0x55eff4519c10 2024-09-21T09:03:18.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a5042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a5042f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff4521730 con 0x55eff4519c10 2024-09-21T09:03:18.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.102+0000 7f9a5042f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:18.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff4522450 con 0x55eff4519c10 2024-09-21T09:03:18.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:18.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 20 zone default found 2024-09-21T09:03:18.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 4 Realm: () 2024-09-21T09:03:18.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:18.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:18.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:18.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 20 zonegroup default 2024-09-21T09:03:18.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff4526140 con 0x55eff451e600 2024-09-21T09:03:18.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff45283e0 con 0x55eff4523130 2024-09-21T09:03:18.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff4523130 2024-09-21T09:03:18.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.103+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff4528780 con 0x55eff4523130 2024-09-21T09:03:18.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.104+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff4523130 2024-09-21T09:03:18.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.104+0000 7f9a5042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.104+0000 7f9a5042f800 20 started sync module instance, tier type = 2024-09-21T09:03:18.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.104+0000 7f9a5042f800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:18.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.104+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff4527870 con 0x7f9a3c088070 2024-09-21T09:03:18.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.105+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x7f9a3c088070 2024-09-21T09:03:18.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.105+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94489084591504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff4527870 con 0x7f9a3c088070 2024-09-21T09:03:18.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.105+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff4529180 con 0x55eff4519c10 2024-09-21T09:03:18.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.106+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94489084591504] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x7f9a3c088070 2024-09-21T09:03:18.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.106+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.106+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94489084595344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff4527870 con 0x55eff4519c10 2024-09-21T09:03:18.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.106+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff4529bf0 con 0x55eff4523130 2024-09-21T09:03:18.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.107+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff4523130 2024-09-21T09:03:18.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.107+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94489084597984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff452a4c0 con 0x55eff4523130 2024-09-21T09:03:18.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.107+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff452af60 con 0x7f9a3c088070 2024-09-21T09:03:18.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.107+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94489084595344] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.108+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94489084597984] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff4523130 2024-09-21T09:03:18.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.108+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x7f9a3c088070 2024-09-21T09:03:18.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.108+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94489084600336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff45273c0 con 0x7f9a3c088070 2024-09-21T09:03:18.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.108+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff452b800 con 0x55eff4519c10 2024-09-21T09:03:18.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.109+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.109+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94489084605184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff452b720 con 0x55eff4519c10 2024-09-21T09:03:18.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.109+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff452c720 con 0x55eff451e600 2024-09-21T09:03:18.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.109+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94489084600336] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x7f9a3c088070 2024-09-21T09:03:18.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.110+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94489084605184] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.110+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.110+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94489084607472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff452aa30 con 0x55eff451e600 2024-09-21T09:03:18.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.110+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff452cfc0 con 0x55eff451e600 2024-09-21T09:03:18.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.111+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94489084607472] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.111+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.111+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94489084609040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff452cf70 con 0x55eff451e600 2024-09-21T09:03:18.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.111+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff452d9d0 con 0x55eff451e600 2024-09-21T09:03:18.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.112+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.112+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94489084609040] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.113+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94489084613808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff452de80 con 0x55eff451e600 2024-09-21T09:03:18.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.113+0000 7f9a5042f800 20 add_watcher() i=0 2024-09-21T09:03:18.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.113+0000 7f9a5042f800 20 add_watcher() i=1 2024-09-21T09:03:18.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.113+0000 7f9a5042f800 20 add_watcher() i=2 2024-09-21T09:03:18.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.113+0000 7f9a5042f800 20 add_watcher() i=3 2024-09-21T09:03:18.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.113+0000 7f9a5042f800 20 add_watcher() i=4 2024-09-21T09:03:18.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.113+0000 7f9a5042f800 20 add_watcher() i=5 2024-09-21T09:03:18.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.113+0000 7f9a5042f800 20 add_watcher() i=6 2024-09-21T09:03:18.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.113+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94489084613808] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.113+0000 7f9a5042f800 20 add_watcher() i=7 2024-09-21T09:03:18.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.113+0000 7f9a5042f800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:18.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.113+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff452de80 con 0x55eff4519c10 2024-09-21T09:03:18.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.114+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.114+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94489084615120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff452de30 con 0x55eff4519c10 2024-09-21T09:03:18.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.115+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94489084615120] v29'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.115+0000 7f9901fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:18.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.115+0000 7f9a5042f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:18.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.115+0000 7f9a5042f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:18.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.115+0000 7f9a5042f800 5 note: GC not initialized 2024-09-21T09:03:18.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.115+0000 7f9900fe1640 20 reqs_thread_entry: start 2024-09-21T09:03:18.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.115+0000 7f9a5042f800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:18.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.115+0000 7f9a5042f800 20 Filter name: none 2024-09-21T09:03:18.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.115+0000 7f987a7fc640 20 reqs_thread_entry: start 2024-09-21T09:03:18.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.115+0000 7f9a5042f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:18.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.115+0000 7f9a5042f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.115+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff4564300 con 0x55eff4519c10 2024-09-21T09:03:18.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.116+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.116+0000 7f9a5042f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:18.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.116+0000 7f9a5042f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:18.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.116+0000 7f9a5042f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:18.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.116+0000 7f9a5042f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:18.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.116+0000 7f9a5042f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-21T09:03:18.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.116+0000 7f9a5042f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.116+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff4563e50 con 0x55eff4519c10 2024-09-21T09:03:18.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.116+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.116+0000 7f9a5042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.116+0000 7f9a5042f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-21T09:03:18.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.116+0000 7f9a5042f800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-21T09:03:18.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.116+0000 7f9a5042f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-21T09:03:18.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.116+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff456ab50 con 0x55eff4519c10 2024-09-21T09:03:18.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.117+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v29'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.117+0000 7f9a5042f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:18.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.117+0000 7f9a5042f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:18.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.117+0000 7f9a5042f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:18.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.117+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94489084863760 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff45662b0 con 0x55eff4519c10 2024-09-21T09:03:18.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.117+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== watch-notify(notify (1) cookie 94489084605184 notify 124554051589 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f9a40018040 con 0x55eff4519c10 2024-09-21T09:03:18.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.117+0000 7f992effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051589 cookie 94489084605184 notifier 4364 bl.length()=732 2024-09-21T09:03:18.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.117+0000 7f992effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:18.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.117+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(65 notify.4 [notify cookie 94489084863760 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.117+0000 7f992effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:18.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.117+0000 7f992effd640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9910003ea0 con 0x55eff4519c10 2024-09-21T09:03:18.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.118+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.118+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== watch-notify(notify_complete (2) cookie 94489084863760 notify 124554051589 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9a4002fac0 con 0x55eff4519c10 2024-09-21T09:03:18.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.118+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff456a510 con 0x55eff4519c10 2024-09-21T09:03:18.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.119+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.119+0000 7f9a5042f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-21T09:03:18.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.119+0000 7f9a5042f800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-21T09:03:18.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.119+0000 7f9a5042f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-21T09:03:18.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.119+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94489084863760 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eff4566260 con 0x7f9a3c088070 2024-09-21T09:03:18.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.119+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== watch-notify(notify (1) cookie 94489084591504 notify 124554051586 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f9a4002fac0 con 0x7f9a3c088070 2024-09-21T09:03:18.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.119+0000 7f992effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051586 cookie 94489084591504 notifier 4364 bl.length()=166 2024-09-21T09:03:18.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.119+0000 7f992effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-21T09:03:18.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.119+0000 7f992effd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-21T09:03:18.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.119+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(68 notify.0 [notify cookie 94489084863760 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9a4002b040 con 0x7f9a3c088070 2024-09-21T09:03:18.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.119+0000 7f992effd640 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9910003ea0 con 0x7f9a3c088070 2024-09-21T09:03:18.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.120+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== watch-notify(notify_complete (2) cookie 94489084863760 notify 124554051586 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9a4002fe30 con 0x7f9a3c088070 2024-09-21T09:03:18.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.120+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x7f9a3c088070 2024-09-21T09:03:18.143 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"mz2bSqvz6vgNVQF50Omh5FuPNS7YzA7lhZIidZAy","active":true,"create_date":"2024-09-21T09:03:18.117367Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:18.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.120+0000 7f9901fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:18.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.120+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94489084615120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff4569db0 con 0x55eff4519c10 2024-09-21T09:03:18.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.121+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94489084615120] v29'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.121+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94489084591504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff4569db0 con 0x7f9a3c088070 2024-09-21T09:03:18.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.122+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94489084591504] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x7f9a3c088070 2024-09-21T09:03:18.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.122+0000 7f9a5042f800 20 remove_watcher() i=0 2024-09-21T09:03:18.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.122+0000 7f9a5042f800 2 removed watcher, disabling cache 2024-09-21T09:03:18.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.122+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94489084595344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff4569db0 con 0x55eff4519c10 2024-09-21T09:03:18.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.123+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94489084595344] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.124+0000 7f9a5042f800 20 remove_watcher() i=1 2024-09-21T09:03:18.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.124+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94489084597984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff4569db0 con 0x55eff4523130 2024-09-21T09:03:18.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.125+0000 7f9a4b6ee640 1 -- 172.21.15.178:0/2591339107 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94489084597984] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a3c057030 con 0x55eff4523130 2024-09-21T09:03:18.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.125+0000 7f9a5042f800 20 remove_watcher() i=2 2024-09-21T09:03:18.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.125+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94489084600336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff4562050 con 0x7f9a3c088070 2024-09-21T09:03:18.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.126+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94489084600336] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x7f9a3c088070 2024-09-21T09:03:18.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.126+0000 7f9a5042f800 20 remove_watcher() i=3 2024-09-21T09:03:18.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.126+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94489084605184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff4562050 con 0x55eff4519c10 2024-09-21T09:03:18.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.127+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94489084605184] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4002b040 con 0x55eff4519c10 2024-09-21T09:03:18.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.127+0000 7f9a5042f800 20 remove_watcher() i=4 2024-09-21T09:03:18.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.127+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94489084607472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff4562050 con 0x55eff451e600 2024-09-21T09:03:18.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.128+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94489084607472] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.128+0000 7f9a5042f800 20 remove_watcher() i=5 2024-09-21T09:03:18.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.128+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94489084609040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff4562050 con 0x55eff451e600 2024-09-21T09:03:18.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.129+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94489084609040] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.129+0000 7f9a5042f800 20 remove_watcher() i=6 2024-09-21T09:03:18.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.129+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94489084613808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eff4562050 con 0x55eff451e600 2024-09-21T09:03:18.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.129+0000 7f9a4beef640 1 -- 172.21.15.178:0/2591339107 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94489084613808] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a4402a070 con 0x55eff451e600 2024-09-21T09:03:18.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.129+0000 7f9a5042f800 20 remove_watcher() i=7 2024-09-21T09:03:18.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eff451e600 msgr2=0x55eff45209f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eff451e600 0x55eff45209f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eff4519c10 msgr2=0x55eff451c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eff4519c10 0x55eff451c0d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9a3c088070 msgr2=0x7f9a3c0659c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9a3c088070 0x7f9a3c0659c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55eff4523130 msgr2=0x55eff45255f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55eff4523130 0x55eff45255f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9914036af0 msgr2=0x7f9914038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9914036af0 0x7f9914038fb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55eff44eb970 tx=0x7f9a3c088000 comp rx=0 tx=0).stop 2024-09-21T09:03:18.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a4aeed640 1 -- 172.21.15.178:0/2591339107 reap_dead start 2024-09-21T09:03:18.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff4506b80 msgr2=0x55eff450e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff4506b80 0x55eff450e070 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9a4403e040 tx=0x7f9a4404cb10 comp rx=0 tx=0).stop 2024-09-21T09:03:18.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 shutdown_connections 2024-09-21T09:03:18.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 --2- 172.21.15.178:0/2591339107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff4506b80 0x55eff450e070 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 >> 172.21.15.178:0/2591339107 conn(0x55eff4502ee0 msgr2=0x55eff4500fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 shutdown_connections 2024-09-21T09:03:18.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/2591339107 wait complete. 2024-09-21T09:03:18.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/4003374334 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9924036b40 msgr2=0x7f9924039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 --2- 172.21.15.178:0/4003374334 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9924036b40 0x7f9924039000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c08e700 tx=0x7f9a3c066eb0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/4003374334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff44f9f00 msgr2=0x55eff44fa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 --2- 172.21.15.178:0/4003374334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff44f9f00 0x55eff44fa320 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55eff44e0260 tx=0x7f9a440188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/4003374334 shutdown_connections 2024-09-21T09:03:18.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 --2- 172.21.15.178:0/4003374334 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9924036b40 0x7f9924039000 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 --2- 172.21.15.178:0/4003374334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff44f9f00 0x55eff44fa320 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/4003374334 >> 172.21.15.178:0/4003374334 conn(0x55eff44eee90 msgr2=0x55eff44f1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/4003374334 shutdown_connections 2024-09-21T09:03:18.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.130+0000 7f9a5042f800 1 -- 172.21.15.178:0/4003374334 wait complete. 2024-09-21T09:03:18.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eff44e8ae0 msgr2=0x55eff44eaed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eff44e8ae0 0x55eff44eaed0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eff43ebb40 msgr2=0x55eff44e6220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eff43ebb40 0x55eff44e6220 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9930036b90 msgr2=0x7f9930039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9930036b90 0x7f9930039050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a40000c00 tx=0x7f9a400013b0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 msgr2=0x55eff44df1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff44df1b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0460a0 tx=0x7f9a3c003020 comp rx=0 tx=0).stop 2024-09-21T09:03:18.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 shutdown_connections 2024-09-21T09:03:18.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55eff44e8ae0 0x55eff44eaed0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55eff43ebb40 0x55eff44e6220 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9930036b90 0x7f9930039050 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 --2- 172.21.15.178:0/3828086448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eff435a630 0x55eff44df1b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 >> 172.21.15.178:0/3828086448 conn(0x55eff43e0db0 msgr2=0x55eff44d1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 shutdown_connections 2024-09-21T09:03:18.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.131+0000 7f9a5042f800 1 -- 172.21.15.178:0/3828086448 wait complete. 2024-09-21T09:03:18.154 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'mz2bSqvz6vgNVQF50Omh5FuPNS7YzA7lhZIidZAy', 'active': True, 'create_date': '2024-09-21T09:03:18.117367Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:18.154 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-21T09:03:18.154 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-21T09:03:18.155 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-21T09:03:18.203 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:18.203 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:18.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.202+0000 7fba3b933800 1 Processor -- start 2024-09-21T09:03:18.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.202+0000 7fba3b933800 1 -- start start 2024-09-21T09:03:18.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.202+0000 7fba3b933800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55e039e10a90 0x55e039e12e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.202+0000 7fba3b933800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e039ccbb30 con 0x55e039e0a9b0 2024-09-21T09:03:18.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.202+0000 7fba3b933800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55e039cad360 con 0x55e039e10a90 2024-09-21T09:03:18.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.203+0000 7fba36e23640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55e039e10a90 0x55e039e12e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.203+0000 7fba37624640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55e039e0a9b0 0x55e039e0adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46630/0 (socket says 172.21.15.178:46630) 2024-09-21T09:03:18.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.203+0000 7fba37624640 1 -- 172.21.15.178:0/1722535178 learned_addr learned my addr 172.21.15.178:0/1722535178 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:18.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.203+0000 7fba36622640 1 -- 172.21.15.178:0/1722535178 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494593018 0 0) 0x55e039ccbb30 con 0x55e039e0a9b0 2024-09-21T09:03:18.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.203+0000 7fba36622640 1 -- 172.21.15.178:0/1722535178 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba20001e10 con 0x55e039e0a9b0 2024-09-21T09:03:18.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.203+0000 7fba36e23640 1 -- 172.21.15.178:0/1722535178 >> v1:172.21.15.44:6789/0 conn(0x55e039e0a9b0 legacy=0x55e039e0adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.203+0000 7fba36e23640 1 -- 172.21.15.178:0/1722535178 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e039cd3e00 con 0x55e039e10a90 2024-09-21T09:03:18.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.205+0000 7fba36e23640 1 --2- 172.21.15.178:0/1722535178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e10a90 0x55e039e12e80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00a470 tx=0x7fba2c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07e8a23a546ca94 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.205+0000 7fba36622640 1 -- 172.21.15.178:0/1722535178 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba2c059070 con 0x55e039e10a90 2024-09-21T09:03:18.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.205+0000 7fba36622640 1 -- 172.21.15.178:0/1722535178 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba2c054570 con 0x55e039e10a90 2024-09-21T09:03:18.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.205+0000 7fba36622640 1 -- 172.21.15.178:0/1722535178 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba2c054870 con 0x55e039e10a90 2024-09-21T09:03:18.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.205+0000 7fba3b933800 1 -- 172.21.15.178:0/1722535178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e10a90 msgr2=0x55e039e12e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.205+0000 7fba3b933800 1 --2- 172.21.15.178:0/1722535178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e10a90 0x55e039e12e80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00a470 tx=0x7fba2c045920 comp rx=0 tx=0).stop 2024-09-21T09:03:18.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.205+0000 7fba3b933800 1 -- 172.21.15.178:0/1722535178 shutdown_connections 2024-09-21T09:03:18.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.205+0000 7fba3b933800 1 --2- 172.21.15.178:0/1722535178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e10a90 0x55e039e12e80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.205+0000 7fba3b933800 1 -- 172.21.15.178:0/1722535178 >> 172.21.15.178:0/1722535178 conn(0x55e039e065e0 msgr2=0x55e039e08a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.205+0000 7fba3b933800 1 -- 172.21.15.178:0/1722535178 shutdown_connections 2024-09-21T09:03:18.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.205+0000 7fba3b933800 1 -- 172.21.15.178:0/1722535178 wait complete. 2024-09-21T09:03:18.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.220+0000 7fba3b933800 1 Processor -- start 2024-09-21T09:03:18.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.220+0000 7fba3b933800 1 -- start start 2024-09-21T09:03:18.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.220+0000 7fba3b933800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e0a9b0 0x55e039efb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.220+0000 7fba3b933800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e039d58350 con 0x55e039e0a9b0 2024-09-21T09:03:18.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.220+0000 7fba37624640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e0a9b0 0x55e039efb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.220+0000 7fba37624640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e0a9b0 0x55e039efb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42570/0 (socket says 172.21.15.178:42570) 2024-09-21T09:03:18.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.220+0000 7fba37624640 1 -- 172.21.15.178:0/1928768766 learned_addr learned my addr 172.21.15.178:0/1928768766 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.221+0000 7fba37624640 1 -- 172.21.15.178:0/1928768766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e039ca5bc0 con 0x55e039e0a9b0 2024-09-21T09:03:18.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.221+0000 7fba37624640 1 --2- 172.21.15.178:0/1928768766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e0a9b0 0x55e039efb6f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fba28001680 tx=0x7fba28001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4910b3a8aac479c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.221+0000 7fb92560a640 1 -- 172.21.15.178:0/1928768766 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba28016070 con 0x55e039e0a9b0 2024-09-21T09:03:18.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.221+0000 7fb92560a640 1 -- 172.21.15.178:0/1928768766 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba28004520 con 0x55e039e0a9b0 2024-09-21T09:03:18.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.221+0000 7fb92560a640 1 -- 172.21.15.178:0/1928768766 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba28004880 con 0x55e039e0a9b0 2024-09-21T09:03:18.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.222+0000 7fba3b933800 1 -- 172.21.15.178:0/1928768766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e0a9b0 msgr2=0x55e039efb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.222+0000 7fba3b933800 1 --2- 172.21.15.178:0/1928768766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e0a9b0 0x55e039efb6f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fba28001680 tx=0x7fba28001b40 comp rx=0 tx=0).stop 2024-09-21T09:03:18.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.222+0000 7fba3b933800 1 -- 172.21.15.178:0/1928768766 shutdown_connections 2024-09-21T09:03:18.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.222+0000 7fba3b933800 1 --2- 172.21.15.178:0/1928768766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e0a9b0 0x55e039efb6f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.222+0000 7fba3b933800 1 -- 172.21.15.178:0/1928768766 >> 172.21.15.178:0/1928768766 conn(0x55e039e065e0 msgr2=0x55e039ef70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.222+0000 7fba3b933800 1 -- 172.21.15.178:0/1928768766 shutdown_connections 2024-09-21T09:03:18.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.222+0000 7fba3b933800 1 -- 172.21.15.178:0/1928768766 wait complete. 2024-09-21T09:03:18.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.222+0000 7fba3b933800 1 Processor -- start 2024-09-21T09:03:18.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.222+0000 7fba3b933800 1 -- start start 2024-09-21T09:03:18.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.223+0000 7fba3b933800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e0a9b0 0x55e039e0d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.223+0000 7fba3b933800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e039e136c0 con 0x55e039e0a9b0 2024-09-21T09:03:18.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.223+0000 7fba37624640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e0a9b0 0x55e039e0d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.223+0000 7fba37624640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e0a9b0 0x55e039e0d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42586/0 (socket says 172.21.15.178:42586) 2024-09-21T09:03:18.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.223+0000 7fba37624640 1 -- 172.21.15.178:0/2876585962 learned_addr learned my addr 172.21.15.178:0/2876585962 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.223+0000 7fba37624640 1 -- 172.21.15.178:0/2876585962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e039cb9fe0 con 0x55e039e0a9b0 2024-09-21T09:03:18.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.223+0000 7fba37624640 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e0a9b0 0x55e039e0d350 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fba28014040 tx=0x7fba28001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.223+0000 7fb923e07640 1 -- 172.21.15.178:0/2876585962 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba28021020 con 0x55e039e0a9b0 2024-09-21T09:03:18.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.223+0000 7fb923e07640 1 -- 172.21.15.178:0/2876585962 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba28011530 con 0x55e039e0a9b0 2024-09-21T09:03:18.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.223+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e039e0ba40 con 0x55e039e0a9b0 2024-09-21T09:03:18.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.224+0000 7fb923e07640 1 -- 172.21.15.178:0/2876585962 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba28016040 con 0x55e039e0a9b0 2024-09-21T09:03:18.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.224+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e039e0bea0 con 0x55e039e0a9b0 2024-09-21T09:03:18.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.224+0000 7fb923e07640 1 -- 172.21.15.178:0/2876585962 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fba28024020 con 0x55e039e0a9b0 2024-09-21T09:03:18.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.224+0000 7fb923e07640 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb91c036b90 0x7fb91c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.224+0000 7fb923e07640 1 -- 172.21.15.178:0/2876585962 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fba2804bdc0 con 0x55e039e0a9b0 2024-09-21T09:03:18.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.224+0000 7fba36e23640 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb91c036b90 0x7fb91c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.225+0000 7fba3b933800 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e039e10a90 0x55e039f0c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.225+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f0ca50 con 0x55e039e10a90 2024-09-21T09:03:18.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.225+0000 7fba37e25640 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e039e10a90 0x55e039f0c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.225+0000 7fba36e23640 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb91c036b90 0x7fb91c039050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55e039e0b7b0 tx=0x7fba2c050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.225+0000 7fba37e25640 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e039e10a90 0x55e039f0c510 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.225+0000 7fba37e25640 1 -- 172.21.15.178:0/2876585962 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba300083e0 con 0x55e039e10a90 2024-09-21T09:03:18.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.225+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f0cdf0 con 0x55e039e10a90 2024-09-21T09:03:18.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.225+0000 7fba37e25640 1 -- 172.21.15.178:0/2876585962 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba300083e0 con 0x55e039e10a90 2024-09-21T09:03:18.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.226+0000 7fba3b933800 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e039f0eb60 0x55e039f10f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.226+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f11640 con 0x55e039f0eb60 2024-09-21T09:03:18.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.226+0000 7fba37624640 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e039f0eb60 0x55e039f10f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.226+0000 7fba37624640 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e039f0eb60 0x55e039f10f50 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.227+0000 7fba37624640 1 -- 172.21.15.178:0/2876585962 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f0eb60 2024-09-21T09:03:18.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.227+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f0da00 con 0x55e039e10a90 2024-09-21T09:03:18.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.227+0000 7fba37e25640 1 -- 172.21.15.178:0/2876585962 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba300083e0 con 0x55e039e10a90 2024-09-21T09:03:18.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.227+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f0dec0 con 0x55e039e10a90 2024-09-21T09:03:18.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.227+0000 7fba37e25640 1 -- 172.21.15.178:0/2876585962 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fba300083e0 con 0x55e039e10a90 2024-09-21T09:03:18.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.227+0000 7fba3b933800 1 Processor -- start 2024-09-21T09:03:18.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.227+0000 7fba3b933800 1 -- start start 2024-09-21T09:03:18.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.228+0000 7fba3b933800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f1ff90 0x55e039f203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.228+0000 7fba3b933800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e039ca7580 con 0x55e039f1ff90 2024-09-21T09:03:18.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.228+0000 7fba37e25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f1ff90 0x55e039f203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.228+0000 7fba37e25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f1ff90 0x55e039f203b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42588/0 (socket says 172.21.15.178:42588) 2024-09-21T09:03:18.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.228+0000 7fba37e25640 1 -- 172.21.15.178:0/347588767 learned_addr learned my addr 172.21.15.178:0/347588767 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.228+0000 7fba37e25640 1 -- 172.21.15.178:0/347588767 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e039f208f0 con 0x55e039f1ff90 2024-09-21T09:03:18.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.228+0000 7fba37e25640 1 --2- 172.21.15.178:0/347588767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f1ff90 0x55e039f203b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55e039e0da00 tx=0x7fba3000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.228+0000 7fb921602640 1 -- 172.21.15.178:0/347588767 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba30007d00 con 0x55e039f1ff90 2024-09-21T09:03:18.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.228+0000 7fb921602640 1 -- 172.21.15.178:0/347588767 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3001e020 con 0x55e039f1ff90 2024-09-21T09:03:18.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.228+0000 7fba3b933800 1 -- 172.21.15.178:0/347588767 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e039f20b80 con 0x55e039f1ff90 2024-09-21T09:03:18.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.228+0000 7fb921602640 1 -- 172.21.15.178:0/347588767 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba30019420 con 0x55e039f1ff90 2024-09-21T09:03:18.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.228+0000 7fba3b933800 1 -- 172.21.15.178:0/347588767 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e039f23860 con 0x55e039f1ff90 2024-09-21T09:03:18.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.229+0000 7fb921602640 1 -- 172.21.15.178:0/347588767 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fba30016040 con 0x55e039f1ff90 2024-09-21T09:03:18.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.229+0000 7fb921602640 1 --2- 172.21.15.178:0/347588767 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb910036b90 0x7fb910039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.229+0000 7fb921602640 1 -- 172.21.15.178:0/347588767 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fba3001f030 con 0x55e039f1ff90 2024-09-21T09:03:18.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.229+0000 7fba37624640 1 --2- 172.21.15.178:0/347588767 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb910036b90 0x7fb910039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.230+0000 7fba3b933800 1 Processor -- start 2024-09-21T09:03:18.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.230+0000 7fba37624640 1 --2- 172.21.15.178:0/347588767 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb910036b90 0x7fb910039050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x55e039e0c160 tx=0x7fba2801d400 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.230+0000 7fba3b933800 1 -- start start 2024-09-21T09:03:18.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.230+0000 7fba3b933800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f2cc70 0x55e039f2d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.230+0000 7fba3b933800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e039efbea0 con 0x55e039f2cc70 2024-09-21T09:03:18.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.230+0000 7fba37e25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f2cc70 0x55e039f2d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.230+0000 7fba37e25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f2cc70 0x55e039f2d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42596/0 (socket says 172.21.15.178:42596) 2024-09-21T09:03:18.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.230+0000 7fba37e25640 1 -- 172.21.15.178:0/982559984 learned_addr learned my addr 172.21.15.178:0/982559984 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.230+0000 7fba37e25640 1 -- 172.21.15.178:0/982559984 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e039f2d640 con 0x55e039f2cc70 2024-09-21T09:03:18.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.230+0000 7fba37e25640 1 --2- 172.21.15.178:0/982559984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f2cc70 0x55e039f2d070 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fba3004cb50 tx=0x7fba30015500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1d7300725e4733 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.231+0000 7fb91affd640 1 -- 172.21.15.178:0/982559984 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba3001d040 con 0x55e039f2cc70 2024-09-21T09:03:18.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.231+0000 7fb91affd640 1 -- 172.21.15.178:0/982559984 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba300183b0 con 0x55e039f2cc70 2024-09-21T09:03:18.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.231+0000 7fb91affd640 1 -- 172.21.15.178:0/982559984 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba30014340 con 0x55e039f2cc70 2024-09-21T09:03:18.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.231+0000 7fba3b933800 1 -- 172.21.15.178:0/982559984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f2cc70 msgr2=0x55e039f2d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.231+0000 7fba3b933800 1 --2- 172.21.15.178:0/982559984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f2cc70 0x55e039f2d070 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fba3004cb50 tx=0x7fba30015500 comp rx=0 tx=0).stop 2024-09-21T09:03:18.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.231+0000 7fba3b933800 1 -- 172.21.15.178:0/982559984 shutdown_connections 2024-09-21T09:03:18.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.231+0000 7fba3b933800 1 --2- 172.21.15.178:0/982559984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f2cc70 0x55e039f2d070 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.231+0000 7fba3b933800 1 -- 172.21.15.178:0/982559984 >> 172.21.15.178:0/982559984 conn(0x55e039f28fd0 msgr2=0x55e039f270d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.231+0000 7fba3b933800 1 -- 172.21.15.178:0/982559984 shutdown_connections 2024-09-21T09:03:18.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.231+0000 7fba3b933800 1 -- 172.21.15.178:0/982559984 wait complete. 2024-09-21T09:03:18.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.231+0000 7fba3b933800 1 Processor -- start 2024-09-21T09:03:18.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.231+0000 7fba3b933800 1 -- start start 2024-09-21T09:03:18.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.232+0000 7fba3b933800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f2cc70 0x55e039f34200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.232+0000 7fba3b933800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e039f2dcb0 con 0x55e039f2cc70 2024-09-21T09:03:18.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.232+0000 7fba37e25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f2cc70 0x55e039f34200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.232+0000 7fba37e25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f2cc70 0x55e039f34200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42610/0 (socket says 172.21.15.178:42610) 2024-09-21T09:03:18.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.232+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 learned_addr learned my addr 172.21.15.178:0/1616270840 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.232+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e039f34740 con 0x55e039f2cc70 2024-09-21T09:03:18.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.232+0000 7fba37e25640 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f2cc70 0x55e039f34200 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fba3004ba90 tx=0x7fba3004cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.232+0000 7fb9197fa640 1 -- 172.21.15.178:0/1616270840 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba3001d070 con 0x55e039f2cc70 2024-09-21T09:03:18.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.232+0000 7fb9197fa640 1 -- 172.21.15.178:0/1616270840 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba300158c0 con 0x55e039f2cc70 2024-09-21T09:03:18.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.232+0000 7fb9197fa640 1 -- 172.21.15.178:0/1616270840 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba30017740 con 0x55e039f2cc70 2024-09-21T09:03:18.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.232+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e039f349d0 con 0x55e039f2cc70 2024-09-21T09:03:18.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.232+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e039f349d0 con 0x55e039f2cc70 2024-09-21T09:03:18.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.233+0000 7fb9197fa640 1 -- 172.21.15.178:0/1616270840 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fba30017960 con 0x55e039f2cc70 2024-09-21T09:03:18.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.233+0000 7fb9197fa640 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb900036b40 0x7fb900039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.233+0000 7fb9197fa640 1 -- 172.21.15.178:0/1616270840 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fba30035ab0 con 0x55e039f2cc70 2024-09-21T09:03:18.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.233+0000 7fba37624640 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb900036b40 0x7fb900039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.233+0000 7fba37624640 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb900036b40 0x7fb900039000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fba28018fd0 tx=0x7fba28041000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.234+0000 7fba3b933800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.234+0000 7fba3b933800 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e039f3fac0 0x55e039f41f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.234+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f426d0 con 0x55e039f3fac0 2024-09-21T09:03:18.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.234+0000 7fba36e23640 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e039f3fac0 0x55e039f41f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba36e23640 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e039f3fac0 0x55e039f41f80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba3b933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba3b933800 20 realm 2024-09-21T09:03:18.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba3b933800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f42b00 con 0x55e039f3fac0 2024-09-21T09:03:18.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba3b933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba3b933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:18.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba3b933800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f433d0 con 0x55e039f3fac0 2024-09-21T09:03:18.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba3b933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba3b933800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.235+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f43770 con 0x55e039f3fac0 2024-09-21T09:03:18.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.236+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.236+0000 7fba3b933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:18.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.236+0000 7fba3b933800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.236+0000 7fba3b933800 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e039f444d0 0x55e039f468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.236+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f46f10 con 0x55e039f444d0 2024-09-21T09:03:18.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.236+0000 7fba37e25640 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e039f444d0 0x55e039f468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.236+0000 7fba37e25640 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e039f444d0 0x55e039f468c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.237+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.237+0000 7fba3b933800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:18.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.237+0000 7fba3b933800 20 searching for the correct realm 2024-09-21T09:03:18.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.237+0000 7fba3b933800 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e039f48ec0 0x55e039f4b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.237+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f48ec0 2024-09-21T09:03:18.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.237+0000 7fba37624640 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e039f48ec0 0x55e039f4b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.237+0000 7fba37624640 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e039f48ec0 0x55e039f4b380 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.237+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f48ec0 2024-09-21T09:03:18.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.237+0000 7fba37624640 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fba28026020 0x7fba280439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.237+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x7fba28026020 2024-09-21T09:03:18.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.237+0000 7fba36e23640 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fba28026020 0x7fba280439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.238+0000 7fba36e23640 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fba28026020 0x7fba280439f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.238+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2c05c040 con 0x7fba28026020 2024-09-21T09:03:18.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.238+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f444d0 2024-09-21T09:03:18.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.238+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.238+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f3fac0 2024-09-21T09:03:18.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.238+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.238+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f3fac0 2024-09-21T09:03:18.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.239+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.239+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f444d0 2024-09-21T09:03:18.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.239+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.239+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f444d0 2024-09-21T09:03:18.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.239+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.239+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x7fba28026020 2024-09-21T09:03:18.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.239+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2c05c040 con 0x7fba28026020 2024-09-21T09:03:18.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.239+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f48ec0 2024-09-21T09:03:18.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.240+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f48ec0 2024-09-21T09:03:18.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.240+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f3fac0 2024-09-21T09:03:18.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.240+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.240+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f444d0 2024-09-21T09:03:18.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.240+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.240+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f3fac0 2024-09-21T09:03:18.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.240+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.240+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x7fba28026020 2024-09-21T09:03:18.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.241+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fba2c05c040 con 0x7fba28026020 2024-09-21T09:03:18.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.241+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f48ec0 2024-09-21T09:03:18.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.241+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f48ec0 2024-09-21T09:03:18.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.241+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f48ec0 2024-09-21T09:03:18.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.241+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f48ec0 2024-09-21T09:03:18.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.241+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f444d0 2024-09-21T09:03:18.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.241+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.241+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f48ec0 2024-09-21T09:03:18.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.242+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f48ec0 2024-09-21T09:03:18.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.242+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f48ec0 2024-09-21T09:03:18.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.242+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f48ec0 2024-09-21T09:03:18.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.242+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f3fac0 2024-09-21T09:03:18.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.242+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.242+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f3fac0 2024-09-21T09:03:18.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.242+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.242+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f444d0 2024-09-21T09:03:18.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.243+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.243+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f48ec0 2024-09-21T09:03:18.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.243+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f48ec0 2024-09-21T09:03:18.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.243+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x7fba28026020 2024-09-21T09:03:18.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.243+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2c05c040 con 0x7fba28026020 2024-09-21T09:03:18.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.243+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f3fac0 2024-09-21T09:03:18.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.243+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.243+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f444d0 2024-09-21T09:03:18.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.244+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.244+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f48ec0 2024-09-21T09:03:18.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.244+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f48ec0 2024-09-21T09:03:18.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.244+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f444d0 2024-09-21T09:03:18.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.244+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.244+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x7fba28026020 2024-09-21T09:03:18.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.244+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2c05c040 con 0x7fba28026020 2024-09-21T09:03:18.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.244+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f48ec0 2024-09-21T09:03:18.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.244+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f48ec0 2024-09-21T09:03:18.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.244+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f444d0 2024-09-21T09:03:18.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x55e039f3fac0 2024-09-21T09:03:18.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ba50 con 0x7fba28026020 2024-09-21T09:03:18.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba2c05c040 con 0x7fba28026020 2024-09-21T09:03:18.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba3b933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:18.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba3b933800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:18.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba3b933800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:18.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba3b933800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:18.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba3b933800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:18.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba3b933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:18.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba3b933800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f47860 con 0x55e039f3fac0 2024-09-21T09:03:18.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba3b933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba3b933800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.245+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f48100 con 0x55e039f3fac0 2024-09-21T09:03:18.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:18.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f474a0 con 0x55e039f3fac0 2024-09-21T09:03:18.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:18.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 20 zone default found 2024-09-21T09:03:18.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 4 Realm: () 2024-09-21T09:03:18.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:18.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:18.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:18.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 20 zonegroup default 2024-09-21T09:03:18.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4bed0 con 0x55e039f444d0 2024-09-21T09:03:18.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.246+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4dcb0 con 0x55e039f48ec0 2024-09-21T09:03:18.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.247+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f48ec0 2024-09-21T09:03:18.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.247+0000 7fba3b933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.247+0000 7fba3b933800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.247+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4e140 con 0x55e039f48ec0 2024-09-21T09:03:18.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.247+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f48ec0 2024-09-21T09:03:18.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.247+0000 7fba3b933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.247+0000 7fba3b933800 20 started sync module instance, tier type = 2024-09-21T09:03:18.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.247+0000 7fba3b933800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:18.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.247+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4d0f0 con 0x7fba28026020 2024-09-21T09:03:18.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.248+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x7fba28026020 2024-09-21T09:03:18.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.248+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94421533382160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4d0f0 con 0x7fba28026020 2024-09-21T09:03:18.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.248+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4ec20 con 0x55e039f3fac0 2024-09-21T09:03:18.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.249+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94421533382160] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x7fba28026020 2024-09-21T09:03:18.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.249+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.249+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94421533386512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4d0f0 con 0x55e039f3fac0 2024-09-21T09:03:18.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.249+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4f690 con 0x55e039f48ec0 2024-09-21T09:03:18.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.250+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94421533386512] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.251+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f48ec0 2024-09-21T09:03:18.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.251+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94421533379648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f4d060 con 0x55e039f48ec0 2024-09-21T09:03:18.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.251+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f50580 con 0x7fba28026020 2024-09-21T09:03:18.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.252+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94421533379648] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f48ec0 2024-09-21T09:03:18.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.252+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x7fba28026020 2024-09-21T09:03:18.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.252+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94421533393104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f509a0 con 0x7fba28026020 2024-09-21T09:03:18.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.252+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f51360 con 0x55e039f3fac0 2024-09-21T09:03:18.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.253+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.253+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94421533396656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f51780 con 0x55e039f3fac0 2024-09-21T09:03:18.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.253+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f52240 con 0x55e039f444d0 2024-09-21T09:03:18.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.253+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94421533393104] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x7fba28026020 2024-09-21T09:03:18.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.254+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.254+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94421533400432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f52240 con 0x55e039f444d0 2024-09-21T09:03:18.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.254+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f52c80 con 0x55e039f444d0 2024-09-21T09:03:18.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.254+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94421533396656] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.255+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.255+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94421533402960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f52c40 con 0x55e039f444d0 2024-09-21T09:03:18.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.255+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f53700 con 0x55e039f444d0 2024-09-21T09:03:18.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.255+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94421533400432] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.256+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94421533402960] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.256+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.256+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94421533397712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f504f0 con 0x55e039f444d0 2024-09-21T09:03:18.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.256+0000 7fba3b933800 20 add_watcher() i=0 2024-09-21T09:03:18.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.256+0000 7fba3b933800 20 add_watcher() i=1 2024-09-21T09:03:18.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.256+0000 7fba3b933800 20 add_watcher() i=2 2024-09-21T09:03:18.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.256+0000 7fba3b933800 20 add_watcher() i=3 2024-09-21T09:03:18.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.256+0000 7fba3b933800 20 add_watcher() i=4 2024-09-21T09:03:18.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.256+0000 7fba3b933800 20 add_watcher() i=5 2024-09-21T09:03:18.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.256+0000 7fba3b933800 20 add_watcher() i=6 2024-09-21T09:03:18.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.256+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94421533397712] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.257+0000 7fba3b933800 20 add_watcher() i=7 2024-09-21T09:03:18.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.257+0000 7fba3b933800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:18.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.257+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f566f0 con 0x55e039f3fac0 2024-09-21T09:03:18.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.257+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.257+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94421533405648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f53ba0 con 0x55e039f3fac0 2024-09-21T09:03:18.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.258+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94421533405648] v29'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.258+0000 7fb8edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:18.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.258+0000 7fba3b933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:18.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.258+0000 7fba3b933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.258+0000 7fba3b933800 5 note: GC not initialized 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.258+0000 7fb8ecfe1640 20 reqs_thread_entry: start 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.258+0000 7fba3b933800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.259+0000 7fba3b933800 20 Filter name: none 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.259+0000 7fb8667fc640 20 reqs_thread_entry: start 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.259+0000 7fba3b933800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.259+0000 7fba3b933800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.259+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f89a50 con 0x55e039f3fac0 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.259+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.259+0000 7fba3b933800 20 rados_obj.operate() r=0 bl.length=556 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.259+0000 7fba3b933800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.259+0000 7fba3b933800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.259+0000 7fba3b933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.259+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f902a0 con 0x55e039f3fac0 2024-09-21T09:03:18.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.260+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v29'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.260+0000 7fba3b933800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:18.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.260+0000 7fba3b933800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:18.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.260+0000 7fba3b933800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:18.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.260+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94421533654112 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e039f8b920 con 0x55e039f3fac0 2024-09-21T09:03:18.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.260+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify (1) cookie 94421533396656 notify 124554051590 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fba2c075040 con 0x55e039f3fac0 2024-09-21T09:03:18.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.261+0000 7fb91affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051590 cookie 94421533396656 notifier 4371 bl.length()=732 2024-09-21T09:03:18.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.261+0000 7fb91affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:18.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.261+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(64 notify.4 [notify cookie 94421533654112 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.261+0000 7fb91affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:18.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.261+0000 7fb91affd640 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fb8fc003ea0 con 0x55e039f3fac0 2024-09-21T09:03:18.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.261+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.261+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== watch-notify(notify_complete (2) cookie 94421533654112 notify 124554051590 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fba2c068040 con 0x55e039f3fac0 2024-09-21T09:03:18.282 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:18.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.262+0000 7fb8edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:18.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.262+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94421533405648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f8b470 con 0x55e039f3fac0 2024-09-21T09:03:18.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.263+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94421533405648] v29'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.263+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94421533382160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f87760 con 0x7fba28026020 2024-09-21T09:03:18.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.264+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94421533382160] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x7fba28026020 2024-09-21T09:03:18.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.264+0000 7fba3b933800 20 remove_watcher() i=0 2024-09-21T09:03:18.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.264+0000 7fba3b933800 2 removed watcher, disabling cache 2024-09-21T09:03:18.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.264+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94421533386512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f87760 con 0x55e039f3fac0 2024-09-21T09:03:18.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.265+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94421533386512] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.265+0000 7fba3b933800 20 remove_watcher() i=1 2024-09-21T09:03:18.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.265+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94421533379648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f87760 con 0x55e039f48ec0 2024-09-21T09:03:18.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.266+0000 7fba37624640 1 -- 172.21.15.178:0/1616270840 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94421533379648] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2800f070 con 0x55e039f48ec0 2024-09-21T09:03:18.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.266+0000 7fba3b933800 20 remove_watcher() i=2 2024-09-21T09:03:18.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.266+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94421533393104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f8b920 con 0x7fba28026020 2024-09-21T09:03:18.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.267+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94421533393104] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x7fba28026020 2024-09-21T09:03:18.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.267+0000 7fba3b933800 20 remove_watcher() i=3 2024-09-21T09:03:18.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.267+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94421533396656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f8b920 con 0x55e039f3fac0 2024-09-21T09:03:18.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.268+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94421533396656] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba2c05c040 con 0x55e039f3fac0 2024-09-21T09:03:18.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.268+0000 7fba3b933800 20 remove_watcher() i=4 2024-09-21T09:03:18.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.268+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94421533400432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f8b920 con 0x55e039f444d0 2024-09-21T09:03:18.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.269+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94421533400432] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.269+0000 7fba3b933800 20 remove_watcher() i=5 2024-09-21T09:03:18.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.269+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94421533402960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f8b920 con 0x55e039f444d0 2024-09-21T09:03:18.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.270+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94421533402960] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.270+0000 7fba3b933800 20 remove_watcher() i=6 2024-09-21T09:03:18.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.270+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94421533397712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e039f8b920 con 0x55e039f444d0 2024-09-21T09:03:18.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba37e25640 1 -- 172.21.15.178:0/1616270840 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94421533397712] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3003b070 con 0x55e039f444d0 2024-09-21T09:03:18.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 20 remove_watcher() i=7 2024-09-21T09:03:18.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e039f444d0 msgr2=0x55e039f468c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e039f444d0 0x55e039f468c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e039f3fac0 msgr2=0x55e039f41f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e039f3fac0 0x55e039f41f80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fba28026020 msgr2=0x7fba280439f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fba28026020 0x7fba280439f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e039f48ec0 msgr2=0x55e039f4b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e039f48ec0 0x55e039f4b380 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb900036b40 msgr2=0x7fb900039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb900036b40 0x7fb900039000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fba28018fd0 tx=0x7fba28041000 comp rx=0 tx=0).stop 2024-09-21T09:03:18.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f2cc70 msgr2=0x55e039f34200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba36e23640 1 -- 172.21.15.178:0/1616270840 reap_dead start 2024-09-21T09:03:18.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f2cc70 0x55e039f34200 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fba3004ba90 tx=0x7fba3004cab0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 shutdown_connections 2024-09-21T09:03:18.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 --2- 172.21.15.178:0/1616270840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f2cc70 0x55e039f34200 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 >> 172.21.15.178:0/1616270840 conn(0x55e039f28fd0 msgr2=0x55e039f270a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 shutdown_connections 2024-09-21T09:03:18.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.271+0000 7fba3b933800 1 -- 172.21.15.178:0/1616270840 wait complete. 2024-09-21T09:03:18.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 -- 172.21.15.178:0/347588767 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb910036b90 msgr2=0x7fb910039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 --2- 172.21.15.178:0/347588767 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb910036b90 0x7fb910039050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x55e039e0c160 tx=0x7fba2801d400 comp rx=0 tx=0).stop 2024-09-21T09:03:18.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 -- 172.21.15.178:0/347588767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f1ff90 msgr2=0x55e039f203b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 --2- 172.21.15.178:0/347588767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f1ff90 0x55e039f203b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55e039e0da00 tx=0x7fba3000aec0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 -- 172.21.15.178:0/347588767 shutdown_connections 2024-09-21T09:03:18.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 --2- 172.21.15.178:0/347588767 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb910036b90 0x7fb910039050 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 --2- 172.21.15.178:0/347588767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039f1ff90 0x55e039f203b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 -- 172.21.15.178:0/347588767 >> 172.21.15.178:0/347588767 conn(0x55e039f14f50 msgr2=0x55e039f17ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 -- 172.21.15.178:0/347588767 shutdown_connections 2024-09-21T09:03:18.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 -- 172.21.15.178:0/347588767 wait complete. 2024-09-21T09:03:18.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e039f0eb60 msgr2=0x55e039f10f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e039f0eb60 0x55e039f10f50 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e039e10a90 msgr2=0x55e039f0c510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e039e10a90 0x55e039f0c510 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb91c036b90 msgr2=0x7fb91c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb91c036b90 0x7fb91c039050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55e039e0b7b0 tx=0x7fba2c050000 comp rx=0 tx=0).stop 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e0a9b0 msgr2=0x55e039e0d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e0a9b0 0x55e039e0d350 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fba28014040 tx=0x7fba28001250 comp rx=0 tx=0).stop 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 shutdown_connections 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e039f0eb60 0x55e039f10f50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e039e10a90 0x55e039f0c510 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb91c036b90 0x7fb91c039050 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 --2- 172.21.15.178:0/2876585962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e039e0a9b0 0x55e039e0d350 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 >> 172.21.15.178:0/2876585962 conn(0x55e039e065e0 msgr2=0x55e039ef5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 shutdown_connections 2024-09-21T09:03:18.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.272+0000 7fba3b933800 1 -- 172.21.15.178:0/2876585962 wait complete. 2024-09-21T09:03:18.293 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:18.293 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T09:03:18.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T09:03:18.293 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T09:03:18.337 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:18.337 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:18.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.336+0000 7f7307f2b800 1 Processor -- start 2024-09-21T09:03:18.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.336+0000 7f7307f2b800 1 -- start start 2024-09-21T09:03:18.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.336+0000 7f7307f2b800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x563639e75d00 0x563639e780f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.336+0000 7f7307f2b800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563639d2eb30 con 0x563639de2df0 2024-09-21T09:03:18.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.336+0000 7f7307f2b800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x563639d10360 con 0x563639e75d00 2024-09-21T09:03:18.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.337+0000 7f73033c2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x563639e75d00 0x563639e780f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.337+0000 7f73033c2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x563639e75d00 0x563639e780f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42626/0 (socket says 172.21.15.178:42626) 2024-09-21T09:03:18.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.337+0000 7f7303bc3640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x563639de2df0 0x563639e745e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46646/0 (socket says 172.21.15.178:46646) 2024-09-21T09:03:18.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.337+0000 7f73033c2640 1 -- 172.21.15.178:0/675483740 learned_addr learned my addr 172.21.15.178:0/675483740 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.337+0000 7f73033c2640 1 -- 172.21.15.178:0/675483740 >> v1:172.21.15.44:6789/0 conn(0x563639de2df0 legacy=0x563639e745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.337+0000 7f73033c2640 1 -- 172.21.15.178:0/675483740 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563639d36e00 con 0x563639e75d00 2024-09-21T09:03:18.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.339+0000 7f73033c2640 1 --2- 172.21.15.178:0/675483740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639e75d00 0x563639e780f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f72f800a520 tx=0x7f72f8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5633348d1eb2b6c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.339+0000 7f7302bc1640 1 -- 172.21.15.178:0/675483740 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f8055070 con 0x563639e75d00 2024-09-21T09:03:18.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.339+0000 7f7302bc1640 1 -- 172.21.15.178:0/675483740 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f80515b0 con 0x563639e75d00 2024-09-21T09:03:18.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.339+0000 7f7302bc1640 1 -- 172.21.15.178:0/675483740 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f80518d0 con 0x563639e75d00 2024-09-21T09:03:18.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.339+0000 7f7307f2b800 1 -- 172.21.15.178:0/675483740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639e75d00 msgr2=0x563639e780f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.339+0000 7f7307f2b800 1 --2- 172.21.15.178:0/675483740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639e75d00 0x563639e780f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f72f800a520 tx=0x7f72f8045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.339+0000 7f7307f2b800 1 -- 172.21.15.178:0/675483740 shutdown_connections 2024-09-21T09:03:18.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.339+0000 7f7307f2b800 1 --2- 172.21.15.178:0/675483740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639e75d00 0x563639e780f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.339+0000 7f7307f2b800 1 -- 172.21.15.178:0/675483740 >> 172.21.15.178:0/675483740 conn(0x563639e69df0 msgr2=0x563639e6c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.339+0000 7f7307f2b800 1 -- 172.21.15.178:0/675483740 shutdown_connections 2024-09-21T09:03:18.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.339+0000 7f7307f2b800 1 -- 172.21.15.178:0/675483740 wait complete. 2024-09-21T09:03:18.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.353+0000 7f7307f2b800 1 Processor -- start 2024-09-21T09:03:18.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.353+0000 7f7307f2b800 1 -- start start 2024-09-21T09:03:18.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.353+0000 7f7307f2b800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639de2df0 0x563639f60a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.353+0000 7f7307f2b800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563639dbb330 con 0x563639de2df0 2024-09-21T09:03:18.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.354+0000 7f7303bc3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639de2df0 0x563639f60a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.354+0000 7f7303bc3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639de2df0 0x563639f60a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42636/0 (socket says 172.21.15.178:42636) 2024-09-21T09:03:18.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.354+0000 7f7303bc3640 1 -- 172.21.15.178:0/1001960303 learned_addr learned my addr 172.21.15.178:0/1001960303 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.354+0000 7f7303bc3640 1 -- 172.21.15.178:0/1001960303 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563639d08bc0 con 0x563639de2df0 2024-09-21T09:03:18.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.354+0000 7f7303bc3640 1 --2- 172.21.15.178:0/1001960303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639de2df0 0x563639f60a60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f72f400b230 tx=0x7f72f400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99fc33729174443 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.354+0000 7f71f1e0b640 1 -- 172.21.15.178:0/1001960303 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f400e5c0 con 0x563639de2df0 2024-09-21T09:03:18.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.354+0000 7f71f1e0b640 1 -- 172.21.15.178:0/1001960303 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f4006070 con 0x563639de2df0 2024-09-21T09:03:18.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.354+0000 7f71f1e0b640 1 -- 172.21.15.178:0/1001960303 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f400e890 con 0x563639de2df0 2024-09-21T09:03:18.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.355+0000 7f7307f2b800 1 -- 172.21.15.178:0/1001960303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639de2df0 msgr2=0x563639f60a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.355+0000 7f7307f2b800 1 --2- 172.21.15.178:0/1001960303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639de2df0 0x563639f60a60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f72f400b230 tx=0x7f72f400b6f0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.355+0000 7f7307f2b800 1 -- 172.21.15.178:0/1001960303 shutdown_connections 2024-09-21T09:03:18.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.355+0000 7f7307f2b800 1 --2- 172.21.15.178:0/1001960303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639de2df0 0x563639f60a60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.355+0000 7f7307f2b800 1 -- 172.21.15.178:0/1001960303 >> 172.21.15.178:0/1001960303 conn(0x563639e69df0 msgr2=0x563639f5c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.355+0000 7f7307f2b800 1 -- 172.21.15.178:0/1001960303 shutdown_connections 2024-09-21T09:03:18.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.355+0000 7f7307f2b800 1 -- 172.21.15.178:0/1001960303 wait complete. 2024-09-21T09:03:18.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.355+0000 7f7307f2b800 1 Processor -- start 2024-09-21T09:03:18.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.355+0000 7f7307f2b800 1 -- start start 2024-09-21T09:03:18.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.355+0000 7f7307f2b800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639de2df0 0x563639f68470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.355+0000 7f7307f2b800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563639e78900 con 0x563639de2df0 2024-09-21T09:03:18.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.356+0000 7f7303bc3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639de2df0 0x563639f68470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.356+0000 7f7303bc3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639de2df0 0x563639f68470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42640/0 (socket says 172.21.15.178:42640) 2024-09-21T09:03:18.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.356+0000 7f7303bc3640 1 -- 172.21.15.178:0/3810710206 learned_addr learned my addr 172.21.15.178:0/3810710206 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.356+0000 7f7303bc3640 1 -- 172.21.15.178:0/3810710206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563639d1cfe0 con 0x563639de2df0 2024-09-21T09:03:18.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.356+0000 7f7303bc3640 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639de2df0 0x563639f68470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f72f4000fd0 tx=0x7f72f4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.356+0000 7f71ebfff640 1 -- 172.21.15.178:0/3810710206 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f400f8d0 con 0x563639de2df0 2024-09-21T09:03:18.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.356+0000 7f71ebfff640 1 -- 172.21.15.178:0/3810710206 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f400fa90 con 0x563639de2df0 2024-09-21T09:03:18.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.356+0000 7f71ebfff640 1 -- 172.21.15.178:0/3810710206 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f400fdb0 con 0x563639de2df0 2024-09-21T09:03:18.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.356+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563639f689b0 con 0x563639de2df0 2024-09-21T09:03:18.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.356+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563639f68ed0 con 0x563639de2df0 2024-09-21T09:03:18.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.357+0000 7f71ebfff640 1 -- 172.21.15.178:0/3810710206 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f72f4017070 con 0x563639de2df0 2024-09-21T09:03:18.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.357+0000 7f71ebfff640 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71ec036b40 0x7f71ec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.357+0000 7f71ebfff640 1 -- 172.21.15.178:0/3810710206 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f72f4015020 con 0x563639de2df0 2024-09-21T09:03:18.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.357+0000 7f73033c2640 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71ec036b40 0x7f71ec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.358+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563639e75d00 0x563639f6f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.358+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639f6fa60 con 0x563639e75d00 2024-09-21T09:03:18.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.358+0000 7f73043c4640 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563639e75d00 0x563639f6f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.358+0000 7f73033c2640 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71ec036b40 0x7f71ec039000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f72f8057000 tx=0x7f72f8052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.358+0000 7f73043c4640 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563639e75d00 0x563639f6f4e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.358+0000 7f73043c4640 1 -- 172.21.15.178:0/3810710206 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72fc00a4a0 con 0x563639e75d00 2024-09-21T09:03:18.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.358+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639f6cab0 con 0x563639e75d00 2024-09-21T09:03:18.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.358+0000 7f73043c4640 1 -- 172.21.15.178:0/3810710206 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72fc00a4a0 con 0x563639e75d00 2024-09-21T09:03:18.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.359+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563639f71d90 0x563639f74180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.359+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639f74820 con 0x563639f71d90 2024-09-21T09:03:18.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.359+0000 7f7303bc3640 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563639f71d90 0x563639f74180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.359+0000 7f7303bc3640 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563639f71d90 0x563639f74180 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.359+0000 7f7303bc3640 1 -- 172.21.15.178:0/3810710206 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72f402e070 con 0x563639f71d90 2024-09-21T09:03:18.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.359+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639f70c30 con 0x563639e75d00 2024-09-21T09:03:18.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.360+0000 7f73043c4640 1 -- 172.21.15.178:0/3810710206 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72fc00a4a0 con 0x563639e75d00 2024-09-21T09:03:18.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.360+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639f71110 con 0x563639e75d00 2024-09-21T09:03:18.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.360+0000 7f73043c4640 1 -- 172.21.15.178:0/3810710206 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f72fc00a4a0 con 0x563639e75d00 2024-09-21T09:03:18.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.360+0000 7f7307f2b800 1 Processor -- start 2024-09-21T09:03:18.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.360+0000 7f7307f2b800 1 -- start start 2024-09-21T09:03:18.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.360+0000 7f7307f2b800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f831e0 0x563639f83600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.360+0000 7f7307f2b800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563639d0a580 con 0x563639f831e0 2024-09-21T09:03:18.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.361+0000 7f73043c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f831e0 0x563639f83600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.361+0000 7f73043c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f831e0 0x563639f83600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42646/0 (socket says 172.21.15.178:42646) 2024-09-21T09:03:18.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.361+0000 7f73043c4640 1 -- 172.21.15.178:0/3666386360 learned_addr learned my addr 172.21.15.178:0/3666386360 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.361+0000 7f73043c4640 1 -- 172.21.15.178:0/3666386360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563639f83b40 con 0x563639f831e0 2024-09-21T09:03:18.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.361+0000 7f73043c4640 1 --2- 172.21.15.178:0/3666386360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f831e0 0x563639f83600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x563639f69520 tx=0x7f72fc0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.361+0000 7f71e97fa640 1 -- 172.21.15.178:0/3666386360 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc014450 con 0x563639f831e0 2024-09-21T09:03:18.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.361+0000 7f71e97fa640 1 -- 172.21.15.178:0/3666386360 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72fc0145f0 con 0x563639f831e0 2024-09-21T09:03:18.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.361+0000 7f71e97fa640 1 -- 172.21.15.178:0/3666386360 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc0148d0 con 0x563639f831e0 2024-09-21T09:03:18.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.361+0000 7f7307f2b800 1 -- 172.21.15.178:0/3666386360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563639f83dd0 con 0x563639f831e0 2024-09-21T09:03:18.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.361+0000 7f7307f2b800 1 -- 172.21.15.178:0/3666386360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563639f86ab0 con 0x563639f831e0 2024-09-21T09:03:18.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.362+0000 7f71e97fa640 1 -- 172.21.15.178:0/3666386360 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f72fc011040 con 0x563639f831e0 2024-09-21T09:03:18.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.362+0000 7f71e97fa640 1 --2- 172.21.15.178:0/3666386360 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71dc036b90 0x7f71dc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.362+0000 7f71e97fa640 1 -- 172.21.15.178:0/3666386360 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f72fc01e070 con 0x563639f831e0 2024-09-21T09:03:18.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.362+0000 7f7303bc3640 1 --2- 172.21.15.178:0/3666386360 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71dc036b90 0x7f71dc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.362+0000 7f7307f2b800 1 Processor -- start 2024-09-21T09:03:18.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.363+0000 7f7303bc3640 1 --2- 172.21.15.178:0/3666386360 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71dc036b90 0x7f71dc039050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x563639f6feb0 tx=0x7f72f401d4d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.363+0000 7f7307f2b800 1 -- start start 2024-09-21T09:03:18.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.363+0000 7f7307f2b800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f8fe60 0x563639f90260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.363+0000 7f7307f2b800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563639f61210 con 0x563639f8fe60 2024-09-21T09:03:18.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.363+0000 7f73043c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f8fe60 0x563639f90260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.363+0000 7f73043c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f8fe60 0x563639f90260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42652/0 (socket says 172.21.15.178:42652) 2024-09-21T09:03:18.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.363+0000 7f73043c4640 1 -- 172.21.15.178:0/3232382190 learned_addr learned my addr 172.21.15.178:0/3232382190 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.363+0000 7f73043c4640 1 -- 172.21.15.178:0/3232382190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563639f90830 con 0x563639f8fe60 2024-09-21T09:03:18.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.363+0000 7f73043c4640 1 --2- 172.21.15.178:0/3232382190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f8fe60 0x563639f90260 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f72fc04cbb0 tx=0x7f72fc011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84a2f4a1ba849cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.363+0000 7f71e2ffd640 1 -- 172.21.15.178:0/3232382190 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc013dc0 con 0x563639f8fe60 2024-09-21T09:03:18.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.363+0000 7f71e2ffd640 1 -- 172.21.15.178:0/3232382190 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72fc04e0d0 con 0x563639f8fe60 2024-09-21T09:03:18.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.363+0000 7f71e2ffd640 1 -- 172.21.15.178:0/3232382190 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc04e3b0 con 0x563639f8fe60 2024-09-21T09:03:18.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.364+0000 7f7307f2b800 1 -- 172.21.15.178:0/3232382190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f8fe60 msgr2=0x563639f90260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.364+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3232382190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f8fe60 0x563639f90260 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f72fc04cbb0 tx=0x7f72fc011970 comp rx=0 tx=0).stop 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.364+0000 7f7307f2b800 1 -- 172.21.15.178:0/3232382190 shutdown_connections 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.364+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3232382190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f8fe60 0x563639f90260 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.364+0000 7f7307f2b800 1 -- 172.21.15.178:0/3232382190 >> 172.21.15.178:0/3232382190 conn(0x563639f8c1c0 msgr2=0x563639f8a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.364+0000 7f7307f2b800 1 -- 172.21.15.178:0/3232382190 shutdown_connections 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.364+0000 7f7307f2b800 1 -- 172.21.15.178:0/3232382190 wait complete. 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.364+0000 7f7307f2b800 1 Processor -- start 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.364+0000 7f7307f2b800 1 -- start start 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.364+0000 7f7307f2b800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f8fe60 0x563639f97320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.364+0000 7f7307f2b800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563639f90ea0 con 0x563639f8fe60 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.365+0000 7f73043c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f8fe60 0x563639f97320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.365+0000 7f73043c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f8fe60 0x563639f97320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42666/0 (socket says 172.21.15.178:42666) 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.365+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 learned_addr learned my addr 172.21.15.178:0/1858907252 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.365+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563639f97860 con 0x563639f8fe60 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.365+0000 7f73043c4640 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f8fe60 0x563639f97320 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f72fc011be0 tx=0x7f72fc04cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.365+0000 7f71e17fa640 1 -- 172.21.15.178:0/1858907252 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc044030 con 0x563639f8fe60 2024-09-21T09:03:18.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.365+0000 7f71e17fa640 1 -- 172.21.15.178:0/1858907252 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72fc02ba60 con 0x563639f8fe60 2024-09-21T09:03:18.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.365+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563639f97af0 con 0x563639f8fe60 2024-09-21T09:03:18.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.365+0000 7f71e17fa640 1 -- 172.21.15.178:0/1858907252 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc02bd40 con 0x563639f8fe60 2024-09-21T09:03:18.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.365+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563639f9a7a0 con 0x563639f8fe60 2024-09-21T09:03:18.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.366+0000 7f71e17fa640 1 -- 172.21.15.178:0/1858907252 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f72fc022a80 con 0x563639f8fe60 2024-09-21T09:03:18.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.366+0000 7f71e17fa640 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71cc036b90 0x7f71cc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.366+0000 7f71e17fa640 1 -- 172.21.15.178:0/1858907252 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f72fc045070 con 0x563639f8fe60 2024-09-21T09:03:18.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.366+0000 7f7303bc3640 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71cc036b90 0x7f71cc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.367+0000 7f7303bc3640 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71cc036b90 0x7f71cc039050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f72f4029000 tx=0x7f72f4033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.367+0000 7f7307f2b800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.367+0000 7f7307f2b800 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563639fa3010 0x563639fa54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.367+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639fa5c20 con 0x563639fa3010 2024-09-21T09:03:18.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.367+0000 7f73033c2640 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563639fa3010 0x563639fa54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.367+0000 7f73033c2640 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563639fa3010 0x563639fa54d0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.367+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.367+0000 7f7307f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.367+0000 7f7307f2b800 20 realm 2024-09-21T09:03:18.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.367+0000 7f7307f2b800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.367+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639fa6050 con 0x563639fa3010 2024-09-21T09:03:18.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.368+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.368+0000 7f7307f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.368+0000 7f7307f2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:18.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.368+0000 7f7307f2b800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.368+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639fa6920 con 0x563639fa3010 2024-09-21T09:03:18.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.368+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.368+0000 7f7307f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.368+0000 7f7307f2b800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.368+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639fa6cc0 con 0x563639fa3010 2024-09-21T09:03:18.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.368+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.368+0000 7f7307f2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:18.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.368+0000 7f7307f2b800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.368+0000 7f7307f2b800 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563639fa7a20 0x563639fa9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.368+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639faa350 con 0x563639fa7a20 2024-09-21T09:03:18.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.369+0000 7f73043c4640 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563639fa7a20 0x563639fa9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.369+0000 7f73043c4640 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563639fa7a20 0x563639fa9e10 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.369+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.369+0000 7f7307f2b800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:18.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.369+0000 7f7307f2b800 20 searching for the correct realm 2024-09-21T09:03:18.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.369+0000 7f7307f2b800 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563639fac390 0x563639fae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.369+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563639faef20 con 0x563639fac390 2024-09-21T09:03:18.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.369+0000 7f7303bc3640 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563639fac390 0x563639fae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.370+0000 7f7303bc3640 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563639fac390 0x563639fae850 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.370+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f4044d70 con 0x563639fac390 2024-09-21T09:03:18.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.370+0000 7f7303bc3640 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f72f400f070 0x7f72f4019820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.370+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563639faef20 con 0x7f72f400f070 2024-09-21T09:03:18.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.370+0000 7f73033c2640 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f72f400f070 0x7f72f4019820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.370+0000 7f73033c2640 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f72f400f070 0x7f72f4019820 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.370+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f8057030 con 0x7f72f400f070 2024-09-21T09:03:18.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.370+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563639faef20 con 0x563639fa7a20 2024-09-21T09:03:18.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.371+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.371+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563639faef20 con 0x563639fa3010 2024-09-21T09:03:18.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.371+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.371+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563639faef20 con 0x563639fa3010 2024-09-21T09:03:18.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.371+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.371+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563639faef20 con 0x563639fa7a20 2024-09-21T09:03:18.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.372+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.372+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563639faef20 con 0x563639fa7a20 2024-09-21T09:03:18.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.372+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.372+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563639faef20 con 0x7f72f400f070 2024-09-21T09:03:18.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.372+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f8057030 con 0x7f72f400f070 2024-09-21T09:03:18.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.372+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563639faef20 con 0x563639fac390 2024-09-21T09:03:18.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.373+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f4044d70 con 0x563639fac390 2024-09-21T09:03:18.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.373+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563639faef20 con 0x563639fa3010 2024-09-21T09:03:18.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.373+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.373+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563639faef20 con 0x563639fa7a20 2024-09-21T09:03:18.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.373+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.373+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563639faef20 con 0x563639fa3010 2024-09-21T09:03:18.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.373+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.373+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563639faef20 con 0x7f72f400f070 2024-09-21T09:03:18.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.374+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f72f8057030 con 0x7f72f400f070 2024-09-21T09:03:18.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.374+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563639faef20 con 0x563639fac390 2024-09-21T09:03:18.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.374+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f4044d70 con 0x563639fac390 2024-09-21T09:03:18.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.374+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fac390 2024-09-21T09:03:18.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.374+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f4044d70 con 0x563639fac390 2024-09-21T09:03:18.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.374+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fa7a20 2024-09-21T09:03:18.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.374+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.374+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fac390 2024-09-21T09:03:18.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.375+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f4044d70 con 0x563639fac390 2024-09-21T09:03:18.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.375+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fac390 2024-09-21T09:03:18.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.375+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f4044d70 con 0x563639fac390 2024-09-21T09:03:18.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.375+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fa3010 2024-09-21T09:03:18.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.375+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.375+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fa3010 2024-09-21T09:03:18.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.375+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.375+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fa7a20 2024-09-21T09:03:18.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.376+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.376+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fac390 2024-09-21T09:03:18.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.376+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f4044d70 con 0x563639fac390 2024-09-21T09:03:18.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.376+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x7f72f400f070 2024-09-21T09:03:18.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.376+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f8057030 con 0x7f72f400f070 2024-09-21T09:03:18.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.376+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fa3010 2024-09-21T09:03:18.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.376+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.376+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fa7a20 2024-09-21T09:03:18.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.377+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.377+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fac390 2024-09-21T09:03:18.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.377+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f4044d70 con 0x563639fac390 2024-09-21T09:03:18.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.377+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fa7a20 2024-09-21T09:03:18.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.377+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.377+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x7f72f400f070 2024-09-21T09:03:18.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.377+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f8057030 con 0x7f72f400f070 2024-09-21T09:03:18.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.377+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fac390 2024-09-21T09:03:18.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f4044d70 con 0x563639fac390 2024-09-21T09:03:18.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fa7a20 2024-09-21T09:03:18.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x563639fa3010 2024-09-21T09:03:18.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72f405d040 con 0x7f72f400f070 2024-09-21T09:03:18.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f8057030 con 0x7f72f400f070 2024-09-21T09:03:18.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f7307f2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:18.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f7307f2b800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:18.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f7307f2b800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:18.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f7307f2b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:18.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f7307f2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:18.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f7307f2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:18.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f7307f2b800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.378+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639faad90 con 0x563639fa3010 2024-09-21T09:03:18.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639fab210 con 0x563639fa3010 2024-09-21T09:03:18.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:18.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639fab6f0 con 0x563639fa3010 2024-09-21T09:03:18.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:18.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 20 zone default found 2024-09-21T09:03:18.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 4 Realm: () 2024-09-21T09:03:18.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:18.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:18.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:18.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 20 zonegroup default 2024-09-21T09:03:18.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.379+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639faf3a0 con 0x563639fa7a20 2024-09-21T09:03:18.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.380+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.380+0000 7f7307f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.380+0000 7f7307f2b800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.380+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639fb15d0 con 0x563639fac390 2024-09-21T09:03:18.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.380+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72f4044d70 con 0x563639fac390 2024-09-21T09:03:18.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.380+0000 7f7307f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.380+0000 7f7307f2b800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.380+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639fb1970 con 0x563639fac390 2024-09-21T09:03:18.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.380+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72f4044d70 con 0x563639fac390 2024-09-21T09:03:18.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.380+0000 7f7307f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.380+0000 7f7307f2b800 20 started sync module instance, tier type = 2024-09-21T09:03:18.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.380+0000 7f7307f2b800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:18.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.380+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb0a10 con 0x7f72f400f070 2024-09-21T09:03:18.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.381+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x7f72f400f070 2024-09-21T09:03:18.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.381+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94790900977152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb0a10 con 0x7f72f400f070 2024-09-21T09:03:18.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.381+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb2330 con 0x563639fa3010 2024-09-21T09:03:18.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.382+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.382+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94790900981376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb2790 con 0x563639fa3010 2024-09-21T09:03:18.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.382+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94790900977152] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x7f72f400f070 2024-09-21T09:03:18.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.382+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb3290 con 0x563639fac390 2024-09-21T09:03:18.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.383+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94790900981376] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.383+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f4044d70 con 0x563639fac390 2024-09-21T09:03:18.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.383+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94790900975024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb22a0 con 0x563639fac390 2024-09-21T09:03:18.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.383+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb3c50 con 0x7f72f400f070 2024-09-21T09:03:18.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.384+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94790900975024] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f4044d70 con 0x563639fac390 2024-09-21T09:03:18.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.384+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x7f72f400f070 2024-09-21T09:03:18.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.384+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94790900987808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb4070 con 0x7f72f400f070 2024-09-21T09:03:18.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.385+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb4900 con 0x563639fa3010 2024-09-21T09:03:18.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.385+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.386+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94790900987808] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x7f72f400f070 2024-09-21T09:03:18.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.386+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94790900990064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb4490 con 0x563639fa3010 2024-09-21T09:03:18.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.386+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb3c00 con 0x563639fa7a20 2024-09-21T09:03:18.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.386+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94790900990064] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.387+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.387+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94790900993264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb57f0 con 0x563639fa7a20 2024-09-21T09:03:18.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.387+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb60c0 con 0x563639fa7a20 2024-09-21T09:03:18.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.388+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94790900993264] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.388+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.388+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94790900994880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb5c10 con 0x563639fa7a20 2024-09-21T09:03:18.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.388+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb6b50 con 0x563639fa7a20 2024-09-21T09:03:18.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.389+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.389+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94790900994880] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.389+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94790900999712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb6fc0 con 0x563639fa7a20 2024-09-21T09:03:18.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.389+0000 7f7307f2b800 20 add_watcher() i=0 2024-09-21T09:03:18.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.389+0000 7f7307f2b800 20 add_watcher() i=1 2024-09-21T09:03:18.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.389+0000 7f7307f2b800 20 add_watcher() i=2 2024-09-21T09:03:18.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.389+0000 7f7307f2b800 20 add_watcher() i=3 2024-09-21T09:03:18.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.389+0000 7f7307f2b800 20 add_watcher() i=4 2024-09-21T09:03:18.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.389+0000 7f7307f2b800 20 add_watcher() i=5 2024-09-21T09:03:18.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.389+0000 7f7307f2b800 20 add_watcher() i=6 2024-09-21T09:03:18.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.390+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94790900999712] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.390+0000 7f7307f2b800 20 add_watcher() i=7 2024-09-21T09:03:18.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.390+0000 7f7307f2b800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:18.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.390+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639fb6fc0 con 0x563639fa3010 2024-09-21T09:03:18.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.390+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.390+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94790901000976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb7860 con 0x563639fa3010 2024-09-21T09:03:18.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.391+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94790901000976] v29'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.391+0000 7f71b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:18.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.391+0000 7f7307f2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:18.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.391+0000 7f7307f2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:18.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.391+0000 7f7307f2b800 5 note: GC not initialized 2024-09-21T09:03:18.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.391+0000 7f71b8fe1640 20 reqs_thread_entry: start 2024-09-21T09:03:18.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.391+0000 7f7307f2b800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:18.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.392+0000 7f7307f2b800 20 Filter name: none 2024-09-21T09:03:18.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.392+0000 7f71327fc640 20 reqs_thread_entry: start 2024-09-21T09:03:18.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.392+0000 7f7307f2b800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.392+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563639feced0 con 0x563639fa3010 2024-09-21T09:03:18.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.392+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.392+0000 7f7307f2b800 20 rados_obj.operate() r=0 bl.length=556 2024-09-21T09:03:18.405 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:18.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.393+0000 7f71b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:18.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.393+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94790901000976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639feb920 con 0x563639fa3010 2024-09-21T09:03:18.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.394+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94790901000976] v29'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.394+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94790900977152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb6b10 con 0x7f72f400f070 2024-09-21T09:03:18.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.395+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94790900977152] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x7f72f400f070 2024-09-21T09:03:18.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.395+0000 7f7307f2b800 20 remove_watcher() i=0 2024-09-21T09:03:18.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.395+0000 7f7307f2b800 2 removed watcher, disabling cache 2024-09-21T09:03:18.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.395+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94790900981376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb6b10 con 0x563639fa3010 2024-09-21T09:03:18.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.396+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94790900981376] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.396+0000 7f7307f2b800 20 remove_watcher() i=1 2024-09-21T09:03:18.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.396+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94790900975024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb1e80 con 0x563639fac390 2024-09-21T09:03:18.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.397+0000 7f7303bc3640 1 -- 172.21.15.178:0/1858907252 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94790900975024] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f4044d70 con 0x563639fac390 2024-09-21T09:03:18.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.397+0000 7f7307f2b800 20 remove_watcher() i=2 2024-09-21T09:03:18.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.397+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94790900987808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb6b10 con 0x7f72f400f070 2024-09-21T09:03:18.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.398+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94790900987808] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x7f72f400f070 2024-09-21T09:03:18.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.398+0000 7f7307f2b800 20 remove_watcher() i=3 2024-09-21T09:03:18.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.398+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94790900990064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb05b0 con 0x563639fa3010 2024-09-21T09:03:18.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.399+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94790900990064] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f8057030 con 0x563639fa3010 2024-09-21T09:03:18.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.399+0000 7f7307f2b800 20 remove_watcher() i=4 2024-09-21T09:03:18.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.399+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94790900993264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb37a0 con 0x563639fa7a20 2024-09-21T09:03:18.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.400+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94790900993264] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.400+0000 7f7307f2b800 20 remove_watcher() i=5 2024-09-21T09:03:18.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.400+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94790900994880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb6b10 con 0x563639fa7a20 2024-09-21T09:03:18.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.401+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94790900994880] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.401+0000 7f7307f2b800 20 remove_watcher() i=6 2024-09-21T09:03:18.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.401+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94790900999712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563639fb05b0 con 0x563639fa7a20 2024-09-21T09:03:18.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f73043c4640 1 -- 172.21.15.178:0/1858907252 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94790900999712] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72fc02a070 con 0x563639fa7a20 2024-09-21T09:03:18.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 20 remove_watcher() i=7 2024-09-21T09:03:18.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563639fa7a20 msgr2=0x563639fa9e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563639fa7a20 0x563639fa9e10 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563639fa3010 msgr2=0x563639fa54d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563639fa3010 0x563639fa54d0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f72f400f070 msgr2=0x7f72f4019820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f72f400f070 0x7f72f4019820 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563639fac390 msgr2=0x563639fae850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563639fac390 0x563639fae850 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71cc036b90 msgr2=0x7f71cc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71cc036b90 0x7f71cc039050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f72f4029000 tx=0x7f72f4033000 comp rx=0 tx=0).stop 2024-09-21T09:03:18.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f8fe60 msgr2=0x563639f97320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f73033c2640 1 -- 172.21.15.178:0/1858907252 reap_dead start 2024-09-21T09:03:18.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f8fe60 0x563639f97320 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f72fc011be0 tx=0x7f72fc04cb10 comp rx=0 tx=0).stop 2024-09-21T09:03:18.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 shutdown_connections 2024-09-21T09:03:18.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 --2- 172.21.15.178:0/1858907252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f8fe60 0x563639f97320 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 >> 172.21.15.178:0/1858907252 conn(0x563639f8c1c0 msgr2=0x563639f8a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 shutdown_connections 2024-09-21T09:03:18.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.402+0000 7f7307f2b800 1 -- 172.21.15.178:0/1858907252 wait complete. 2024-09-21T09:03:18.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 -- 172.21.15.178:0/3666386360 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71dc036b90 msgr2=0x7f71dc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3666386360 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71dc036b90 0x7f71dc039050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x563639f6feb0 tx=0x7f72f401d4d0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 -- 172.21.15.178:0/3666386360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f831e0 msgr2=0x563639f83600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3666386360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f831e0 0x563639f83600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x563639f69520 tx=0x7f72fc0188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 -- 172.21.15.178:0/3666386360 shutdown_connections 2024-09-21T09:03:18.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3666386360 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71dc036b90 0x7f71dc039050 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3666386360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639f831e0 0x563639f83600 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 -- 172.21.15.178:0/3666386360 >> 172.21.15.178:0/3666386360 conn(0x563639f78170 msgr2=0x563639f7acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 -- 172.21.15.178:0/3666386360 shutdown_connections 2024-09-21T09:03:18.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 -- 172.21.15.178:0/3666386360 wait complete. 2024-09-21T09:03:18.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563639f71d90 msgr2=0x563639f74180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563639f71d90 0x563639f74180 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563639e75d00 msgr2=0x563639f6f4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563639e75d00 0x563639f6f4e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71ec036b40 msgr2=0x7f71ec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71ec036b40 0x7f71ec039000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f72f8057000 tx=0x7f72f8052000 comp rx=0 tx=0).stop 2024-09-21T09:03:18.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639de2df0 msgr2=0x563639f68470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639de2df0 0x563639f68470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f72f4000fd0 tx=0x7f72f4000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 shutdown_connections 2024-09-21T09:03:18.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563639f71d90 0x563639f74180 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563639e75d00 0x563639f6f4e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f71ec036b40 0x7f71ec039000 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 --2- 172.21.15.178:0/3810710206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563639de2df0 0x563639f68470 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 >> 172.21.15.178:0/3810710206 conn(0x563639e69df0 msgr2=0x563639f5acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 shutdown_connections 2024-09-21T09:03:18.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.403+0000 7f7307f2b800 1 -- 172.21.15.178:0/3810710206 wait complete. 2024-09-21T09:03:18.416 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:18.416 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T09:03:18.416 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T09:03:18.416 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T09:03:18.500 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:18.500 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:18.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.499+0000 7f5124c87800 1 Processor -- start 2024-09-21T09:03:18.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.499+0000 7f5124c87800 1 -- start start 2024-09-21T09:03:18.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.499+0000 7f5124c87800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556361886630 0x556361915250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.499+0000 7f5124c87800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5563617d1b30 con 0x556361915790 2024-09-21T09:03:18.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.499+0000 7f5124c87800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5563617b3360 con 0x556361886630 2024-09-21T09:03:18.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.499+0000 7f512277b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556361886630 0x556361915250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.499+0000 7f5119f7a640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x556361915790 0x556361917b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46660/0 (socket says 172.21.15.178:46660) 2024-09-21T09:03:18.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.499+0000 7f5119f7a640 1 -- 172.21.15.178:0/4173618425 learned_addr learned my addr 172.21.15.178:0/4173618425 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:18.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.500+0000 7f512277b640 1 -- 172.21.15.178:0/4173618425 >> v1:172.21.15.44:6789/0 conn(0x556361915790 legacy=0x556361917b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.500+0000 7f512277b640 1 -- 172.21.15.178:0/4173618425 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563617d9e00 con 0x556361886630 2024-09-21T09:03:18.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.502+0000 7f512277b640 1 --2- 172.21.15.178:0/4173618425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361915250 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f511400a470 tx=0x7f5114045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b457cb5d103f2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.502+0000 7f5121f7a640 1 -- 172.21.15.178:0/4173618425 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5114053570 con 0x556361886630 2024-09-21T09:03:18.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.502+0000 7f5121f7a640 1 -- 172.21.15.178:0/4173618425 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5114058070 con 0x556361886630 2024-09-21T09:03:18.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.502+0000 7f5121f7a640 1 -- 172.21.15.178:0/4173618425 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5114053880 con 0x556361886630 2024-09-21T09:03:18.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.502+0000 7f5124c87800 1 -- 172.21.15.178:0/4173618425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 msgr2=0x556361915250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.502+0000 7f5124c87800 1 --2- 172.21.15.178:0/4173618425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361915250 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f511400a470 tx=0x7f5114045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:18.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.502+0000 7f5124c87800 1 -- 172.21.15.178:0/4173618425 shutdown_connections 2024-09-21T09:03:18.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.502+0000 7f5124c87800 1 --2- 172.21.15.178:0/4173618425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361915250 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.502+0000 7f5124c87800 1 -- 172.21.15.178:0/4173618425 >> 172.21.15.178:0/4173618425 conn(0x55636190cde0 msgr2=0x55636190f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.502+0000 7f5124c87800 1 -- 172.21.15.178:0/4173618425 shutdown_connections 2024-09-21T09:03:18.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.502+0000 7f5124c87800 1 -- 172.21.15.178:0/4173618425 wait complete. 2024-09-21T09:03:18.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.516+0000 7f5124c87800 1 Processor -- start 2024-09-21T09:03:18.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.516+0000 7f5124c87800 1 -- start start 2024-09-21T09:03:18.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.516+0000 7f5124c87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361912b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.516+0000 7f5124c87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55636185e330 con 0x556361886630 2024-09-21T09:03:18.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.516+0000 7f512277b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361912b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.516+0000 7f512277b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361912b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42684/0 (socket says 172.21.15.178:42684) 2024-09-21T09:03:18.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.516+0000 7f512277b640 1 -- 172.21.15.178:0/3166327535 learned_addr learned my addr 172.21.15.178:0/3166327535 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.517+0000 7f512277b640 1 -- 172.21.15.178:0/3166327535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563617abbc0 con 0x556361886630 2024-09-21T09:03:18.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.517+0000 7f512277b640 1 --2- 172.21.15.178:0/3166327535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361912b80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5114025c20 tx=0x7f5114051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2b813625b5609a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.517+0000 7f5010608640 1 -- 172.21.15.178:0/3166327535 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f511405c580 con 0x556361886630 2024-09-21T09:03:18.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.517+0000 7f5010608640 1 -- 172.21.15.178:0/3166327535 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5114063030 con 0x556361886630 2024-09-21T09:03:18.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.517+0000 7f5010608640 1 -- 172.21.15.178:0/3166327535 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f511405c850 con 0x556361886630 2024-09-21T09:03:18.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.518+0000 7f5124c87800 1 -- 172.21.15.178:0/3166327535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 msgr2=0x556361912b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.518+0000 7f5124c87800 1 --2- 172.21.15.178:0/3166327535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361912b80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5114025c20 tx=0x7f5114051000 comp rx=0 tx=0).stop 2024-09-21T09:03:18.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.518+0000 7f5124c87800 1 -- 172.21.15.178:0/3166327535 shutdown_connections 2024-09-21T09:03:18.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.518+0000 7f5124c87800 1 --2- 172.21.15.178:0/3166327535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361912b80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.518+0000 7f5124c87800 1 -- 172.21.15.178:0/3166327535 >> 172.21.15.178:0/3166327535 conn(0x55636190cde0 msgr2=0x5563619fd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.518+0000 7f5124c87800 1 -- 172.21.15.178:0/3166327535 shutdown_connections 2024-09-21T09:03:18.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.518+0000 7f5124c87800 1 -- 172.21.15.178:0/3166327535 wait complete. 2024-09-21T09:03:18.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.518+0000 7f5124c87800 1 Processor -- start 2024-09-21T09:03:18.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.518+0000 7f5124c87800 1 -- start start 2024-09-21T09:03:18.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.518+0000 7f5124c87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361a0b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.518+0000 7f5124c87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556361919690 con 0x556361886630 2024-09-21T09:03:18.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.519+0000 7f512277b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361a0b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.519+0000 7f512277b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361a0b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42698/0 (socket says 172.21.15.178:42698) 2024-09-21T09:03:18.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.519+0000 7f512277b640 1 -- 172.21.15.178:0/1557029628 learned_addr learned my addr 172.21.15.178:0/1557029628 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.519+0000 7f512277b640 1 -- 172.21.15.178:0/1557029628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563617bffe0 con 0x556361886630 2024-09-21T09:03:18.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.519+0000 7f512277b640 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361a0b490 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x556361912280 tx=0x7f5114002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.519+0000 7f500ee05640 1 -- 172.21.15.178:0/1557029628 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5114054ad0 con 0x556361886630 2024-09-21T09:03:18.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.519+0000 7f500ee05640 1 -- 172.21.15.178:0/1557029628 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5114054c70 con 0x556361886630 2024-09-21T09:03:18.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.519+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556361a0b9d0 con 0x556361886630 2024-09-21T09:03:18.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.519+0000 7f500ee05640 1 -- 172.21.15.178:0/1557029628 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5114068420 con 0x556361886630 2024-09-21T09:03:18.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.519+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556361a0bef0 con 0x556361886630 2024-09-21T09:03:18.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.520+0000 7f500ee05640 1 -- 172.21.15.178:0/1557029628 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f51140685c0 con 0x556361886630 2024-09-21T09:03:18.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.520+0000 7f500ee05640 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5008036b90 0x7f5008039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.520+0000 7f500ee05640 1 -- 172.21.15.178:0/1557029628 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f5114070030 con 0x556361886630 2024-09-21T09:03:18.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.520+0000 7f5119f7a640 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5008036b90 0x7f5008039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.521+0000 7f5124c87800 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556361915790 0x556361a12500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.521+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a12a80 con 0x556361915790 2024-09-21T09:03:18.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.521+0000 7f5122f7c640 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556361915790 0x556361a12500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.521+0000 7f5119f7a640 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5008036b90 0x7f5008039050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f510c000f60 tx=0x7f510c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.521+0000 7f5122f7c640 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556361915790 0x556361a12500 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.521+0000 7f5122f7c640 1 -- 172.21.15.178:0/1557029628 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f511c00a4a0 con 0x556361915790 2024-09-21T09:03:18.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.521+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a0fad0 con 0x556361915790 2024-09-21T09:03:18.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.521+0000 7f5122f7c640 1 -- 172.21.15.178:0/1557029628 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f511c00a4a0 con 0x556361915790 2024-09-21T09:03:18.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.521+0000 7f5124c87800 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556361a14dd0 0x556361a171c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.521+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a17860 con 0x556361a14dd0 2024-09-21T09:03:18.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.522+0000 7f512277b640 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556361a14dd0 0x556361a171c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.522+0000 7f512277b640 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556361a14dd0 0x556361a171c0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.522+0000 7f512277b640 1 -- 172.21.15.178:0/1557029628 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5114051070 con 0x556361a14dd0 2024-09-21T09:03:18.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.522+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a13c40 con 0x556361915790 2024-09-21T09:03:18.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.523+0000 7f5122f7c640 1 -- 172.21.15.178:0/1557029628 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f511c00a4a0 con 0x556361915790 2024-09-21T09:03:18.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.523+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a14120 con 0x556361915790 2024-09-21T09:03:18.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.523+0000 7f5122f7c640 1 -- 172.21.15.178:0/1557029628 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f511c00a4a0 con 0x556361915790 2024-09-21T09:03:18.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.523+0000 7f5124c87800 1 Processor -- start 2024-09-21T09:03:18.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.523+0000 7f5124c87800 1 -- start start 2024-09-21T09:03:18.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.524+0000 7f5124c87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a26180 0x556361a265a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.524+0000 7f5124c87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5563617ad580 con 0x556361a26180 2024-09-21T09:03:18.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.524+0000 7f5122f7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a26180 0x556361a265a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.524+0000 7f5122f7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a26180 0x556361a265a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42712/0 (socket says 172.21.15.178:42712) 2024-09-21T09:03:18.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.524+0000 7f5122f7c640 1 -- 172.21.15.178:0/3002338690 learned_addr learned my addr 172.21.15.178:0/3002338690 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.524+0000 7f5122f7c640 1 -- 172.21.15.178:0/3002338690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556361a26ae0 con 0x556361a26180 2024-09-21T09:03:18.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.524+0000 7f5122f7c640 1 --2- 172.21.15.178:0/3002338690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a26180 0x556361a265a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x556361a0c6b0 tx=0x7f511c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.524+0000 7f5007fff640 1 -- 172.21.15.178:0/3002338690 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f511c014450 con 0x556361a26180 2024-09-21T09:03:18.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.524+0000 7f5007fff640 1 -- 172.21.15.178:0/3002338690 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f511c0145f0 con 0x556361a26180 2024-09-21T09:03:18.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.524+0000 7f5124c87800 1 -- 172.21.15.178:0/3002338690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556361a26d70 con 0x556361a26180 2024-09-21T09:03:18.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.524+0000 7f5007fff640 1 -- 172.21.15.178:0/3002338690 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f511c0148d0 con 0x556361a26180 2024-09-21T09:03:18.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.524+0000 7f5124c87800 1 -- 172.21.15.178:0/3002338690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556361a29a50 con 0x556361a26180 2024-09-21T09:03:18.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.525+0000 7f5007fff640 1 -- 172.21.15.178:0/3002338690 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f511c011040 con 0x556361a26180 2024-09-21T09:03:18.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.525+0000 7f5007fff640 1 --2- 172.21.15.178:0/3002338690 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4ffc036b90 0x7f4ffc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.525+0000 7f5007fff640 1 -- 172.21.15.178:0/3002338690 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f511c01e070 con 0x556361a26180 2024-09-21T09:03:18.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.525+0000 7f512277b640 1 --2- 172.21.15.178:0/3002338690 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4ffc036b90 0x7f4ffc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.526+0000 7f5124c87800 1 Processor -- start 2024-09-21T09:03:18.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.526+0000 7f5124c87800 1 -- start start 2024-09-21T09:03:18.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.526+0000 7f512277b640 1 --2- 172.21.15.178:0/3002338690 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4ffc036b90 0x7f4ffc039050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f511408f1c0 tx=0x7f5114060ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.526+0000 7f5124c87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a32db0 0x556361a331b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.526+0000 7f5124c87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5563619111f0 con 0x556361a32db0 2024-09-21T09:03:18.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.526+0000 7f5122f7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a32db0 0x556361a331b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.526+0000 7f5122f7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a32db0 0x556361a331b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42714/0 (socket says 172.21.15.178:42714) 2024-09-21T09:03:18.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.526+0000 7f5122f7c640 1 -- 172.21.15.178:0/324745507 learned_addr learned my addr 172.21.15.178:0/324745507 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.526+0000 7f5122f7c640 1 -- 172.21.15.178:0/324745507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556361a33780 con 0x556361a32db0 2024-09-21T09:03:18.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.527+0000 7f5122f7c640 1 --2- 172.21.15.178:0/324745507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a32db0 0x556361a331b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f511c04cb40 tx=0x7f511c011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b94467ad928680 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.527+0000 7f5005ffb640 1 -- 172.21.15.178:0/324745507 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f511c013cb0 con 0x556361a32db0 2024-09-21T09:03:18.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.527+0000 7f5005ffb640 1 -- 172.21.15.178:0/324745507 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f511c04e0d0 con 0x556361a32db0 2024-09-21T09:03:18.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.527+0000 7f5005ffb640 1 -- 172.21.15.178:0/324745507 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f511c04e3f0 con 0x556361a32db0 2024-09-21T09:03:18.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.527+0000 7f5124c87800 1 -- 172.21.15.178:0/324745507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a32db0 msgr2=0x556361a331b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.527+0000 7f5124c87800 1 --2- 172.21.15.178:0/324745507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a32db0 0x556361a331b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f511c04cb40 tx=0x7f511c011970 comp rx=0 tx=0).stop 2024-09-21T09:03:18.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.527+0000 7f5124c87800 1 -- 172.21.15.178:0/324745507 shutdown_connections 2024-09-21T09:03:18.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.527+0000 7f5124c87800 1 --2- 172.21.15.178:0/324745507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a32db0 0x556361a331b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.527+0000 7f5124c87800 1 -- 172.21.15.178:0/324745507 >> 172.21.15.178:0/324745507 conn(0x556361a2f110 msgr2=0x556361a2d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.527+0000 7f5124c87800 1 -- 172.21.15.178:0/324745507 shutdown_connections 2024-09-21T09:03:18.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.527+0000 7f5124c87800 1 -- 172.21.15.178:0/324745507 wait complete. 2024-09-21T09:03:18.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.527+0000 7f5124c87800 1 Processor -- start 2024-09-21T09:03:18.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.527+0000 7f5124c87800 1 -- start start 2024-09-21T09:03:18.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.528+0000 7f5124c87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a32db0 0x556361a3a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.528+0000 7f5124c87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556361a33d50 con 0x556361a32db0 2024-09-21T09:03:18.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.528+0000 7f5122f7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a32db0 0x556361a3a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.528+0000 7f5122f7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a32db0 0x556361a3a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42722/0 (socket says 172.21.15.178:42722) 2024-09-21T09:03:18.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.528+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 learned_addr learned my addr 172.21.15.178:0/1915708313 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.528+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556361a3a7a0 con 0x556361a32db0 2024-09-21T09:03:18.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.528+0000 7f5122f7c640 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a32db0 0x556361a3a260 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f511c011e10 tx=0x7f511c04cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.528+0000 7f4ff3fff640 1 -- 172.21.15.178:0/1915708313 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f511c016440 con 0x556361a32db0 2024-09-21T09:03:18.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.528+0000 7f4ff3fff640 1 -- 172.21.15.178:0/1915708313 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f511c02bc70 con 0x556361a32db0 2024-09-21T09:03:18.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.528+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556361a3aa30 con 0x556361a32db0 2024-09-21T09:03:18.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.528+0000 7f4ff3fff640 1 -- 172.21.15.178:0/1915708313 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f511c022a50 con 0x556361a32db0 2024-09-21T09:03:18.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.529+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556361a3d6e0 con 0x556361a32db0 2024-09-21T09:03:18.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.529+0000 7f4ff3fff640 1 -- 172.21.15.178:0/1915708313 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f511c022bf0 con 0x556361a32db0 2024-09-21T09:03:18.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.529+0000 7f4ff3fff640 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4fec036b90 0x7f4fec039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.530+0000 7f4ff3fff640 1 -- 172.21.15.178:0/1915708313 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f511c00e040 con 0x556361a32db0 2024-09-21T09:03:18.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.530+0000 7f512277b640 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4fec036b90 0x7f4fec039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.530+0000 7f5124c87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.530+0000 7f5124c87800 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556361a45e80 0x556361a48340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.530+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a48a90 con 0x556361a45e80 2024-09-21T09:03:18.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.530+0000 7f5119f7a640 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556361a45e80 0x556361a48340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.530+0000 7f512277b640 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4fec036b90 0x7f4fec039050 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f51140547e0 tx=0x7f5114094000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.530+0000 7f5119f7a640 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556361a45e80 0x556361a48340 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f510c009050 con 0x556361a45e80 2024-09-21T09:03:18.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 20 realm 2024-09-21T09:03:18.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a452d0 con 0x556361a45e80 2024-09-21T09:03:18.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f510c009050 con 0x556361a45e80 2024-09-21T09:03:18.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:18.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a49570 con 0x556361a45e80 2024-09-21T09:03:18.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f510c009050 con 0x556361a45e80 2024-09-21T09:03:18.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a49e40 con 0x556361a45e80 2024-09-21T09:03:18.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f510c009050 con 0x556361a45e80 2024-09-21T09:03:18.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:18.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556361a4a6f0 0x556361a4cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.531+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a4d240 con 0x556361a4a6f0 2024-09-21T09:03:18.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.532+0000 7f5122f7c640 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556361a4a6f0 0x556361a4cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.532+0000 7f5122f7c640 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556361a4a6f0 0x556361a4cae0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.532+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.532+0000 7f5124c87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:18.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.532+0000 7f5124c87800 20 searching for the correct realm 2024-09-21T09:03:18.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.532+0000 7f5124c87800 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556361a4f2f0 0x556361a517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.532+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4f2f0 2024-09-21T09:03:18.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.532+0000 7f512277b640 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556361a4f2f0 0x556361a517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.533+0000 7f512277b640 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556361a4f2f0 0x556361a517b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.533+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511409a040 con 0x556361a4f2f0 2024-09-21T09:03:18.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.533+0000 7f512277b640 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f511408c040 0x7f51140688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.533+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x7f511408c040 2024-09-21T09:03:18.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.533+0000 7f5119f7a640 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f511408c040 0x7f51140688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.533+0000 7f5119f7a640 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f511408c040 0x7f51140688b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.533+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c009050 con 0x7f511408c040 2024-09-21T09:03:18.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.533+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4a6f0 2024-09-21T09:03:18.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.534+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.534+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a45e80 2024-09-21T09:03:18.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.534+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c009050 con 0x556361a45e80 2024-09-21T09:03:18.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.534+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a45e80 2024-09-21T09:03:18.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.534+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c029040 con 0x556361a45e80 2024-09-21T09:03:18.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.534+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4a6f0 2024-09-21T09:03:18.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.535+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.535+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4a6f0 2024-09-21T09:03:18.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.535+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.535+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x7f511408c040 2024-09-21T09:03:18.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.535+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c029040 con 0x7f511408c040 2024-09-21T09:03:18.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.535+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4f2f0 2024-09-21T09:03:18.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.535+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511409a040 con 0x556361a4f2f0 2024-09-21T09:03:18.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.535+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a45e80 2024-09-21T09:03:18.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.535+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c029040 con 0x556361a45e80 2024-09-21T09:03:18.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.535+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4a6f0 2024-09-21T09:03:18.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.536+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.536+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a45e80 2024-09-21T09:03:18.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.536+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c029040 con 0x556361a45e80 2024-09-21T09:03:18.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.536+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x7f511408c040 2024-09-21T09:03:18.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.536+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f510c029040 con 0x7f511408c040 2024-09-21T09:03:18.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.536+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4f2f0 2024-09-21T09:03:18.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.536+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511409a040 con 0x556361a4f2f0 2024-09-21T09:03:18.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.536+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4f2f0 2024-09-21T09:03:18.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.537+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511409a040 con 0x556361a4f2f0 2024-09-21T09:03:18.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.537+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4a6f0 2024-09-21T09:03:18.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.537+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.537+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4f2f0 2024-09-21T09:03:18.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.537+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511409a040 con 0x556361a4f2f0 2024-09-21T09:03:18.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.537+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4f2f0 2024-09-21T09:03:18.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.537+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511409a040 con 0x556361a4f2f0 2024-09-21T09:03:18.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.537+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a45e80 2024-09-21T09:03:18.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.538+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f510c029040 con 0x556361a45e80 2024-09-21T09:03:18.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.538+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a45e80 2024-09-21T09:03:18.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.538+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f510c029040 con 0x556361a45e80 2024-09-21T09:03:18.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.538+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4a6f0 2024-09-21T09:03:18.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.538+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.538+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4f2f0 2024-09-21T09:03:18.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.538+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511409a040 con 0x556361a4f2f0 2024-09-21T09:03:18.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.539+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x7f511408c040 2024-09-21T09:03:18.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.539+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c029040 con 0x7f511408c040 2024-09-21T09:03:18.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.539+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a45e80 2024-09-21T09:03:18.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.539+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c029040 con 0x556361a45e80 2024-09-21T09:03:18.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.539+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4a6f0 2024-09-21T09:03:18.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.539+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.539+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4f2f0 2024-09-21T09:03:18.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.539+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511409a040 con 0x556361a4f2f0 2024-09-21T09:03:18.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.539+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4a6f0 2024-09-21T09:03:18.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.540+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.540+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x7f511408c040 2024-09-21T09:03:18.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.540+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c029040 con 0x7f511408c040 2024-09-21T09:03:18.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.540+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4f2f0 2024-09-21T09:03:18.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.540+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511409a040 con 0x556361a4f2f0 2024-09-21T09:03:18.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.540+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a4a6f0 2024-09-21T09:03:18.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x556361a45e80 2024-09-21T09:03:18.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f510c029040 con 0x556361a45e80 2024-09-21T09:03:18.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556361a51e80 con 0x7f511408c040 2024-09-21T09:03:18.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c029040 con 0x7f511408c040 2024-09-21T09:03:18.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5124c87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:18.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5124c87800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:18.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5124c87800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:18.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5124c87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:18.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5124c87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:18.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5124c87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:18.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5124c87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a4dcf0 con 0x556361a45e80 2024-09-21T09:03:18.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f510c029040 con 0x556361a45e80 2024-09-21T09:03:18.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5124c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5124c87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.541+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a4e170 con 0x556361a45e80 2024-09-21T09:03:18.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f510c029040 con 0x556361a45e80 2024-09-21T09:03:18.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:18.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a4e650 con 0x556361a45e80 2024-09-21T09:03:18.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f510c03d040 con 0x556361a45e80 2024-09-21T09:03:18.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:18.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 20 zone default found 2024-09-21T09:03:18.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 4 Realm: () 2024-09-21T09:03:18.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:18.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:18.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:18.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 20 zonegroup default 2024-09-21T09:03:18.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a52300 con 0x556361a4a6f0 2024-09-21T09:03:18.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.542+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a54530 con 0x556361a4f2f0 2024-09-21T09:03:18.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.543+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f511409a040 con 0x556361a4f2f0 2024-09-21T09:03:18.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.543+0000 7f5124c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.543+0000 7f5124c87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.543+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a548d0 con 0x556361a4f2f0 2024-09-21T09:03:18.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.543+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f511409a040 con 0x556361a4f2f0 2024-09-21T09:03:18.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.543+0000 7f5124c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.543+0000 7f5124c87800 20 started sync module instance, tier type = 2024-09-21T09:03:18.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.543+0000 7f5124c87800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:18.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.543+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a53970 con 0x7f511408c040 2024-09-21T09:03:18.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.544+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f510c03d040 con 0x7f511408c040 2024-09-21T09:03:18.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.544+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93885328342368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a53970 con 0x7f511408c040 2024-09-21T09:03:18.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.544+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a55290 con 0x556361a45e80 2024-09-21T09:03:18.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.545+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93885328342368] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f510c03d040 con 0x7f511408c040 2024-09-21T09:03:18.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.545+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f510c03d040 con 0x556361a45e80 2024-09-21T09:03:18.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.545+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93885328347072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a53970 con 0x556361a45e80 2024-09-21T09:03:18.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.545+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a55d00 con 0x556361a4f2f0 2024-09-21T09:03:18.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.546+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511409a040 con 0x556361a4f2f0 2024-09-21T09:03:18.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.546+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93885328349168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a565d0 con 0x556361a4f2f0 2024-09-21T09:03:18.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.546+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a57070 con 0x7f511408c040 2024-09-21T09:03:18.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.546+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93885328347072] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f510c03d040 con 0x556361a45e80 2024-09-21T09:03:18.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.547+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f510c03d040 con 0x7f511408c040 2024-09-21T09:03:18.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.547+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93885328349168] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511409a040 con 0x556361a4f2f0 2024-09-21T09:03:18.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.547+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93885328354112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a534c0 con 0x7f511408c040 2024-09-21T09:03:18.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.547+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a57950 con 0x556361a45e80 2024-09-21T09:03:18.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.548+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f510c03d040 con 0x556361a45e80 2024-09-21T09:03:18.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.548+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93885328356368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a57d80 con 0x556361a45e80 2024-09-21T09:03:18.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.548+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a58850 con 0x556361a4a6f0 2024-09-21T09:03:18.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.548+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93885328354112] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f510c03d040 con 0x7f511408c040 2024-09-21T09:03:18.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.549+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93885328356368] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f510c03d040 con 0x556361a45e80 2024-09-21T09:03:18.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.549+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.549+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93885328360256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a57830 con 0x556361a4a6f0 2024-09-21T09:03:18.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.549+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a59120 con 0x556361a4a6f0 2024-09-21T09:03:18.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.551+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.551+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93885328362480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a59560 con 0x556361a4a6f0 2024-09-21T09:03:18.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.551+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93885328360256] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.551+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a56160 con 0x556361a4a6f0 2024-09-21T09:03:18.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.552+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.552+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93885328362480] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.552+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93885328351584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a59b50 con 0x556361a4a6f0 2024-09-21T09:03:18.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.552+0000 7f5124c87800 20 add_watcher() i=0 2024-09-21T09:03:18.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.552+0000 7f5124c87800 20 add_watcher() i=1 2024-09-21T09:03:18.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.552+0000 7f5124c87800 20 add_watcher() i=2 2024-09-21T09:03:18.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.552+0000 7f5124c87800 20 add_watcher() i=3 2024-09-21T09:03:18.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.552+0000 7f5124c87800 20 add_watcher() i=4 2024-09-21T09:03:18.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.552+0000 7f5124c87800 20 add_watcher() i=5 2024-09-21T09:03:18.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.552+0000 7f5124c87800 20 add_watcher() i=6 2024-09-21T09:03:18.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.552+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93885328351584] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.552+0000 7f5124c87800 20 add_watcher() i=7 2024-09-21T09:03:18.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.552+0000 7f5124c87800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:18.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.552+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a5cf80 con 0x556361a45e80 2024-09-21T09:03:18.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.553+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f510c03d040 con 0x556361a45e80 2024-09-21T09:03:18.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.553+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93885328363536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a5a440 con 0x556361a45e80 2024-09-21T09:03:18.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.554+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93885328363536] v29'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f510c03d040 con 0x556361a45e80 2024-09-21T09:03:18.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.554+0000 7f4fd8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:18.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.554+0000 7f5124c87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:18.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.554+0000 7f5124c87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:18.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.554+0000 7f5124c87800 5 note: GC not initialized 2024-09-21T09:03:18.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.554+0000 7f4f537fe640 20 reqs_thread_entry: start 2024-09-21T09:03:18.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.554+0000 7f5124c87800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:18.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.554+0000 7f5124c87800 20 Filter name: none 2024-09-21T09:03:18.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.554+0000 7f4f517fa640 20 reqs_thread_entry: start 2024-09-21T09:03:18.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.554+0000 7f5124c87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.554+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556361a8fee0 con 0x556361a45e80 2024-09-21T09:03:18.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.555+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f510c03d040 con 0x556361a45e80 2024-09-21T09:03:18.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.555+0000 7f5124c87800 20 rados_obj.operate() r=0 bl.length=556 2024-09-21T09:03:18.577 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:18.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.556+0000 7f4fd8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:18.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.556+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93885328363536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a8e950 con 0x556361a45e80 2024-09-21T09:03:18.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.557+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93885328363536] v29'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f510c03d040 con 0x556361a45e80 2024-09-21T09:03:18.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.557+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93885328342368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a59010 con 0x7f511408c040 2024-09-21T09:03:18.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.557+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93885328342368] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f510c03d040 con 0x7f511408c040 2024-09-21T09:03:18.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.557+0000 7f5124c87800 20 remove_watcher() i=0 2024-09-21T09:03:18.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.557+0000 7f5124c87800 2 removed watcher, disabling cache 2024-09-21T09:03:18.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.557+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93885328347072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a59010 con 0x556361a45e80 2024-09-21T09:03:18.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.558+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93885328347072] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f510c03d040 con 0x556361a45e80 2024-09-21T09:03:18.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.559+0000 7f5124c87800 20 remove_watcher() i=1 2024-09-21T09:03:18.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.559+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93885328349168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a54fc0 con 0x556361a4f2f0 2024-09-21T09:03:18.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.560+0000 7f512277b640 1 -- 172.21.15.178:0/1915708313 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93885328349168] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511409a040 con 0x556361a4f2f0 2024-09-21T09:03:18.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.560+0000 7f5124c87800 20 remove_watcher() i=2 2024-09-21T09:03:18.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.560+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93885328354112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a59010 con 0x7f511408c040 2024-09-21T09:03:18.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.561+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93885328354112] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f510c03d040 con 0x7f511408c040 2024-09-21T09:03:18.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.561+0000 7f5124c87800 20 remove_watcher() i=3 2024-09-21T09:03:18.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.561+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93885328356368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a557f0 con 0x556361a45e80 2024-09-21T09:03:18.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.562+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93885328356368] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f510c03d040 con 0x556361a45e80 2024-09-21T09:03:18.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.562+0000 7f5124c87800 20 remove_watcher() i=4 2024-09-21T09:03:18.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.562+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93885328360256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a56b40 con 0x556361a4a6f0 2024-09-21T09:03:18.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.563+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93885328360256] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.563+0000 7f5124c87800 20 remove_watcher() i=5 2024-09-21T09:03:18.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.563+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93885328362480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a59010 con 0x556361a4a6f0 2024-09-21T09:03:18.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.564+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93885328362480] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.564+0000 7f5124c87800 20 remove_watcher() i=6 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.564+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93885328351584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556361a57410 con 0x556361a4a6f0 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5122f7c640 1 -- 172.21.15.178:0/1915708313 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93885328351584] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c02a070 con 0x556361a4a6f0 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 20 remove_watcher() i=7 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556361a4a6f0 msgr2=0x556361a4cae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556361a4a6f0 0x556361a4cae0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556361a45e80 msgr2=0x556361a48340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556361a45e80 0x556361a48340 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f511408c040 msgr2=0x7f51140688b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f511408c040 0x7f51140688b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556361a4f2f0 msgr2=0x556361a517b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556361a4f2f0 0x556361a517b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4fec036b90 msgr2=0x7f4fec039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4fec036b90 0x7f4fec039050 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f51140547e0 tx=0x7f5114094000 comp rx=0 tx=0).stop 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a32db0 msgr2=0x556361a3a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5119f7a640 1 -- 172.21.15.178:0/1915708313 reap_dead start 2024-09-21T09:03:18.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a32db0 0x556361a3a260 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f511c011e10 tx=0x7f511c04cad0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 shutdown_connections 2024-09-21T09:03:18.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.565+0000 7f5124c87800 1 --2- 172.21.15.178:0/1915708313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a32db0 0x556361a3a260 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 >> 172.21.15.178:0/1915708313 conn(0x556361a2f110 msgr2=0x556361a2d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 shutdown_connections 2024-09-21T09:03:18.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/1915708313 wait complete. 2024-09-21T09:03:18.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/3002338690 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4ffc036b90 msgr2=0x7f4ffc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 --2- 172.21.15.178:0/3002338690 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4ffc036b90 0x7f4ffc039050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f511408f1c0 tx=0x7f5114060ee0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/3002338690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a26180 msgr2=0x556361a265a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 --2- 172.21.15.178:0/3002338690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a26180 0x556361a265a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x556361a0c6b0 tx=0x7f511c0188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/3002338690 shutdown_connections 2024-09-21T09:03:18.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 --2- 172.21.15.178:0/3002338690 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4ffc036b90 0x7f4ffc039050 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 --2- 172.21.15.178:0/3002338690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361a26180 0x556361a265a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/3002338690 >> 172.21.15.178:0/3002338690 conn(0x556361a1b110 msgr2=0x556361a1dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/3002338690 shutdown_connections 2024-09-21T09:03:18.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/3002338690 wait complete. 2024-09-21T09:03:18.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556361a14dd0 msgr2=0x556361a171c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556361a14dd0 0x556361a171c0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556361915790 msgr2=0x556361a12500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556361915790 0x556361a12500 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5008036b90 msgr2=0x7f5008039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5008036b90 0x7f5008039050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f510c000f60 tx=0x7f510c0012b0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 msgr2=0x556361a0b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361a0b490 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x556361912280 tx=0x7f5114002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 shutdown_connections 2024-09-21T09:03:18.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556361a14dd0 0x556361a171c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556361915790 0x556361a12500 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5008036b90 0x7f5008039050 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 --2- 172.21.15.178:0/1557029628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556361886630 0x556361a0b490 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.566+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 >> 172.21.15.178:0/1557029628 conn(0x55636190cde0 msgr2=0x5563619fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.567+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 shutdown_connections 2024-09-21T09:03:18.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.567+0000 7f5124c87800 1 -- 172.21.15.178:0/1557029628 wait complete. 2024-09-21T09:03:18.588 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:18.588 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-21T09:03:18.588 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-21T09:03:18.588 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-21T09:03:18.636 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:18.637 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:18.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.635+0000 7fcaa9d40800 1 Processor -- start 2024-09-21T09:03:18.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.635+0000 7fcaa9d40800 1 -- start start 2024-09-21T09:03:18.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.635+0000 7fcaa9d40800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55ac389aedd0 0x55ac389b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.635+0000 7fcaa9d40800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ac38867b30 con 0x55ac3891c610 2024-09-21T09:03:18.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.635+0000 7fcaa9d40800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55ac38849360 con 0x55ac389aedd0 2024-09-21T09:03:18.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.636+0000 7fcaa52c9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55ac389aedd0 0x55ac389b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.636+0000 7fcaa5aca640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55ac3891c610 0x55ac389ad6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46670/0 (socket says 172.21.15.178:46670) 2024-09-21T09:03:18.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.636+0000 7fcaa5aca640 1 -- 172.21.15.178:0/4212255339 learned_addr learned my addr 172.21.15.178:0/4212255339 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:18.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.636+0000 7fcaa52c9640 1 -- 172.21.15.178:0/4212255339 >> v1:172.21.15.44:6789/0 conn(0x55ac3891c610 legacy=0x55ac389ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.636+0000 7fcaa52c9640 1 -- 172.21.15.178:0/4212255339 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac3886fe00 con 0x55ac389aedd0 2024-09-21T09:03:18.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.638+0000 7fcaa52c9640 1 --2- 172.21.15.178:0/4212255339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac389aedd0 0x55ac389b11c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00a470 tx=0x7fca9c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf754bf4fdccccf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.638+0000 7fcaa4ac8640 1 -- 172.21.15.178:0/4212255339 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9c053570 con 0x55ac389aedd0 2024-09-21T09:03:18.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.638+0000 7fcaa4ac8640 1 -- 172.21.15.178:0/4212255339 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9c058070 con 0x55ac389aedd0 2024-09-21T09:03:18.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.638+0000 7fcaa4ac8640 1 -- 172.21.15.178:0/4212255339 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9c053880 con 0x55ac389aedd0 2024-09-21T09:03:18.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.639+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4212255339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac389aedd0 msgr2=0x55ac389b11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.639+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/4212255339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac389aedd0 0x55ac389b11c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00a470 tx=0x7fca9c045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:18.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.639+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4212255339 shutdown_connections 2024-09-21T09:03:18.642 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.639+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/4212255339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac389aedd0 0x55ac389b11c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.642 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.639+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4212255339 >> 172.21.15.178:0/4212255339 conn(0x55ac389a2e00 msgr2=0x55ac389a5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.642 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.639+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4212255339 shutdown_connections 2024-09-21T09:03:18.642 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.639+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4212255339 wait complete. 2024-09-21T09:03:18.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.652+0000 7fcaa9d40800 1 Processor -- start 2024-09-21T09:03:18.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.652+0000 7fcaa9d40800 1 -- start start 2024-09-21T09:03:18.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.653+0000 7fcaa9d40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac3891c610 0x55ac38a99b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.653+0000 7fcaa9d40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ac388f4350 con 0x55ac3891c610 2024-09-21T09:03:18.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.653+0000 7fcaa5aca640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac3891c610 0x55ac38a99b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.653+0000 7fcaa5aca640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac3891c610 0x55ac38a99b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42738/0 (socket says 172.21.15.178:42738) 2024-09-21T09:03:18.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.653+0000 7fcaa5aca640 1 -- 172.21.15.178:0/2847623340 learned_addr learned my addr 172.21.15.178:0/2847623340 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.653+0000 7fcaa5aca640 1 -- 172.21.15.178:0/2847623340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac38841bc0 con 0x55ac3891c610 2024-09-21T09:03:18.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.653+0000 7fcaa5aca640 1 --2- 172.21.15.178:0/2847623340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac3891c610 0x55ac38a99b20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fca980017a0 tx=0x7fca98001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35a141d905841e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.653+0000 7fc993e07640 1 -- 172.21.15.178:0/2847623340 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca98016070 con 0x55ac3891c610 2024-09-21T09:03:18.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.653+0000 7fc993e07640 1 -- 172.21.15.178:0/2847623340 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca98004520 con 0x55ac3891c610 2024-09-21T09:03:18.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.653+0000 7fc993e07640 1 -- 172.21.15.178:0/2847623340 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca98004820 con 0x55ac3891c610 2024-09-21T09:03:18.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.654+0000 7fcaa9d40800 1 -- 172.21.15.178:0/2847623340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac3891c610 msgr2=0x55ac38a99b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.654+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/2847623340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac3891c610 0x55ac38a99b20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fca980017a0 tx=0x7fca98001c60 comp rx=0 tx=0).stop 2024-09-21T09:03:18.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.654+0000 7fcaa9d40800 1 -- 172.21.15.178:0/2847623340 shutdown_connections 2024-09-21T09:03:18.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.654+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/2847623340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac3891c610 0x55ac38a99b20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.654+0000 7fcaa9d40800 1 -- 172.21.15.178:0/2847623340 >> 172.21.15.178:0/2847623340 conn(0x55ac389a2e00 msgr2=0x55ac38a954e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.654+0000 7fcaa9d40800 1 -- 172.21.15.178:0/2847623340 shutdown_connections 2024-09-21T09:03:18.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.654+0000 7fcaa9d40800 1 -- 172.21.15.178:0/2847623340 wait complete. 2024-09-21T09:03:18.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.654+0000 7fcaa9d40800 1 Processor -- start 2024-09-21T09:03:18.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.655+0000 7fcaa9d40800 1 -- start start 2024-09-21T09:03:18.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.655+0000 7fcaa9d40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac3891c610 0x55ac38aa1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.655+0000 7fcaa9d40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ac389b19a0 con 0x55ac3891c610 2024-09-21T09:03:18.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.655+0000 7fcaa5aca640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac3891c610 0x55ac38aa1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.655+0000 7fcaa5aca640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac3891c610 0x55ac38aa1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42742/0 (socket says 172.21.15.178:42742) 2024-09-21T09:03:18.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.655+0000 7fcaa5aca640 1 -- 172.21.15.178:0/4244967042 learned_addr learned my addr 172.21.15.178:0/4244967042 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.655+0000 7fcaa5aca640 1 -- 172.21.15.178:0/4244967042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac38855fe0 con 0x55ac3891c610 2024-09-21T09:03:18.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.655+0000 7fcaa5aca640 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac3891c610 0x55ac38aa1580 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fca98000f80 tx=0x7fca98001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.655+0000 7fc992604640 1 -- 172.21.15.178:0/4244967042 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca98016040 con 0x55ac3891c610 2024-09-21T09:03:18.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.655+0000 7fc992604640 1 -- 172.21.15.178:0/4244967042 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca98011530 con 0x55ac3891c610 2024-09-21T09:03:18.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.655+0000 7fc992604640 1 -- 172.21.15.178:0/4244967042 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca98011890 con 0x55ac3891c610 2024-09-21T09:03:18.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.655+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac38aa1ac0 con 0x55ac3891c610 2024-09-21T09:03:18.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.656+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac38aa2040 con 0x55ac3891c610 2024-09-21T09:03:18.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.656+0000 7fc992604640 1 -- 172.21.15.178:0/4244967042 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca9801c3f0 con 0x55ac3891c610 2024-09-21T09:03:18.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.656+0000 7fc992604640 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc98c036b90 0x7fc98c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.657+0000 7fc992604640 1 -- 172.21.15.178:0/4244967042 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fca9804bad0 con 0x55ac3891c610 2024-09-21T09:03:18.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.657+0000 7fcaa52c9640 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc98c036b90 0x7fc98c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.657+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ac389aedd0 0x55ac38aa8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.657+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aa8ba0 con 0x55ac389aedd0 2024-09-21T09:03:18.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.657+0000 7fcaa62cb640 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ac389aedd0 0x55ac38aa8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.657+0000 7fcaa52c9640 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc98c036b90 0x7fc98c039050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca9c057000 tx=0x7fca9c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.657+0000 7fcaa62cb640 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ac389aedd0 0x55ac38aa8530 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.657+0000 7fcaa62cb640 1 -- 172.21.15.178:0/4244967042 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcaa00083e0 con 0x55ac389aedd0 2024-09-21T09:03:18.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.657+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aa5b80 con 0x55ac389aedd0 2024-09-21T09:03:18.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.658+0000 7fcaa62cb640 1 -- 172.21.15.178:0/4244967042 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcaa00083e0 con 0x55ac389aedd0 2024-09-21T09:03:18.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.658+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ac38aaaed0 0x55ac38aad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.658+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aad990 con 0x55ac38aaaed0 2024-09-21T09:03:18.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.658+0000 7fcaa5aca640 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ac38aaaed0 0x55ac38aad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.658+0000 7fcaa5aca640 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ac38aaaed0 0x55ac38aad2c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.658+0000 7fcaa5aca640 1 -- 172.21.15.178:0/4244967042 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca98019050 con 0x55ac38aaaed0 2024-09-21T09:03:18.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.659+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aa9d70 con 0x55ac389aedd0 2024-09-21T09:03:18.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.659+0000 7fcaa62cb640 1 -- 172.21.15.178:0/4244967042 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcaa00083e0 con 0x55ac389aedd0 2024-09-21T09:03:18.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.659+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aaa210 con 0x55ac389aedd0 2024-09-21T09:03:18.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.659+0000 7fcaa62cb640 1 -- 172.21.15.178:0/4244967042 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcaa00083e0 con 0x55ac389aedd0 2024-09-21T09:03:18.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.659+0000 7fcaa9d40800 1 Processor -- start 2024-09-21T09:03:18.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.659+0000 7fcaa9d40800 1 -- start start 2024-09-21T09:03:18.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.660+0000 7fcaa9d40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38abc360 0x55ac38abc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.660+0000 7fcaa9d40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ac38843580 con 0x55ac38abc360 2024-09-21T09:03:18.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.660+0000 7fcaa62cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38abc360 0x55ac38abc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.660+0000 7fcaa62cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38abc360 0x55ac38abc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42746/0 (socket says 172.21.15.178:42746) 2024-09-21T09:03:18.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.660+0000 7fcaa62cb640 1 -- 172.21.15.178:0/2600369020 learned_addr learned my addr 172.21.15.178:0/2600369020 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.660+0000 7fcaa62cb640 1 -- 172.21.15.178:0/2600369020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac38abccc0 con 0x55ac38abc360 2024-09-21T09:03:18.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.660+0000 7fcaa62cb640 1 --2- 172.21.15.178:0/2600369020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38abc360 0x55ac38abc780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55ac38aa2630 tx=0x7fcaa000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.660+0000 7fc98b7fe640 1 -- 172.21.15.178:0/2600369020 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaa0007d00 con 0x55ac38abc360 2024-09-21T09:03:18.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.660+0000 7fc98b7fe640 1 -- 172.21.15.178:0/2600369020 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa001e020 con 0x55ac38abc360 2024-09-21T09:03:18.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.660+0000 7fc98b7fe640 1 -- 172.21.15.178:0/2600369020 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaa0019420 con 0x55ac38abc360 2024-09-21T09:03:18.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.660+0000 7fcaa9d40800 1 -- 172.21.15.178:0/2600369020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac38abcf50 con 0x55ac38abc360 2024-09-21T09:03:18.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.660+0000 7fcaa9d40800 1 -- 172.21.15.178:0/2600369020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac38abfc30 con 0x55ac38abc360 2024-09-21T09:03:18.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.661+0000 7fc98b7fe640 1 -- 172.21.15.178:0/2600369020 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcaa0016040 con 0x55ac38abc360 2024-09-21T09:03:18.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.661+0000 7fc98b7fe640 1 --2- 172.21.15.178:0/2600369020 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc980036b90 0x7fc980039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.661+0000 7fc98b7fe640 1 -- 172.21.15.178:0/2600369020 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fcaa001f030 con 0x55ac38abc360 2024-09-21T09:03:18.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.661+0000 7fcaa5aca640 1 --2- 172.21.15.178:0/2600369020 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc980036b90 0x7fc980039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.662+0000 7fcaa9d40800 1 Processor -- start 2024-09-21T09:03:18.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.662+0000 7fcaa9d40800 1 -- start start 2024-09-21T09:03:18.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.662+0000 7fcaa5aca640 1 --2- 172.21.15.178:0/2600369020 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc980036b90 0x7fc980039050 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55ac38aa9000 tx=0x7fca980193e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.662+0000 7fcaa9d40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38ac8f60 0x55ac38ac9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.662+0000 7fcaa9d40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ac38a9a2d0 con 0x55ac38ac8f60 2024-09-21T09:03:18.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.662+0000 7fcaa62cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38ac8f60 0x55ac38ac9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.662+0000 7fcaa62cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38ac8f60 0x55ac38ac9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42758/0 (socket says 172.21.15.178:42758) 2024-09-21T09:03:18.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.662+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3970703650 learned_addr learned my addr 172.21.15.178:0/3970703650 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.662+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3970703650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac38ac9930 con 0x55ac38ac8f60 2024-09-21T09:03:18.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.662+0000 7fcaa62cb640 1 --2- 172.21.15.178:0/3970703650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38ac8f60 0x55ac38ac9360 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0022470 tx=0x7fcaa0017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45c0cd75d31150d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.663+0000 7fc9897fa640 1 -- 172.21.15.178:0/3970703650 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaa001d030 con 0x55ac38ac8f60 2024-09-21T09:03:18.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.663+0000 7fc9897fa640 1 -- 172.21.15.178:0/3970703650 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa0015d00 con 0x55ac38ac8f60 2024-09-21T09:03:18.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.663+0000 7fc9897fa640 1 -- 172.21.15.178:0/3970703650 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaa00197a0 con 0x55ac38ac8f60 2024-09-21T09:03:18.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.663+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3970703650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38ac8f60 msgr2=0x55ac38ac9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.663+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/3970703650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38ac8f60 0x55ac38ac9360 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0022470 tx=0x7fcaa0017fa0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.663+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3970703650 shutdown_connections 2024-09-21T09:03:18.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.663+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/3970703650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38ac8f60 0x55ac38ac9360 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.663+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3970703650 >> 172.21.15.178:0/3970703650 conn(0x55ac38ac52c0 msgr2=0x55ac38ac33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.663+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3970703650 shutdown_connections 2024-09-21T09:03:18.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.663+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3970703650 wait complete. 2024-09-21T09:03:18.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.663+0000 7fcaa9d40800 1 Processor -- start 2024-09-21T09:03:18.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.663+0000 7fcaa9d40800 1 -- start start 2024-09-21T09:03:18.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.664+0000 7fcaa9d40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38ac8f60 0x55ac38ad03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.664+0000 7fcaa9d40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ac38ac9fa0 con 0x55ac38ac8f60 2024-09-21T09:03:18.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.664+0000 7fcaa62cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38ac8f60 0x55ac38ad03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.664+0000 7fcaa62cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38ac8f60 0x55ac38ad03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42762/0 (socket says 172.21.15.178:42762) 2024-09-21T09:03:18.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.664+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 learned_addr learned my addr 172.21.15.178:0/3194566410 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.664+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac38ad0910 con 0x55ac38ac8f60 2024-09-21T09:03:18.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.664+0000 7fcaa62cb640 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38ac8f60 0x55ac38ad03d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0017fe0 tx=0x7fcaa004ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.664+0000 7fc9777fe640 1 -- 172.21.15.178:0/3194566410 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaa0019b20 con 0x55ac38ac8f60 2024-09-21T09:03:18.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.664+0000 7fc9777fe640 1 -- 172.21.15.178:0/3194566410 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa00153e0 con 0x55ac38ac8f60 2024-09-21T09:03:18.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.664+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac38ad0ba0 con 0x55ac38ac8f60 2024-09-21T09:03:18.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.664+0000 7fc9777fe640 1 -- 172.21.15.178:0/3194566410 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaa0019cc0 con 0x55ac38ac8f60 2024-09-21T09:03:18.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.664+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac38ad3850 con 0x55ac38ac8f60 2024-09-21T09:03:18.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.665+0000 7fc9777fe640 1 -- 172.21.15.178:0/3194566410 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcaa002b350 con 0x55ac38ac8f60 2024-09-21T09:03:18.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.665+0000 7fc9777fe640 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc970036ac0 0x7fc970038f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.665+0000 7fc9777fe640 1 -- 172.21.15.178:0/3194566410 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fcaa0043aa0 con 0x55ac38ac8f60 2024-09-21T09:03:18.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.665+0000 7fcaa5aca640 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc970036ac0 0x7fc970038f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.666+0000 7fcaa5aca640 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc970036ac0 0x7fc970038f80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fca980021b0 tx=0x7fca98043000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.666+0000 7fcaa9d40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.666+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ac38adbe10 0x55ac38ade2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.666+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38adea20 con 0x55ac38adbe10 2024-09-21T09:03:18.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.666+0000 7fcaa52c9640 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ac38adbe10 0x55ac38ade2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa52c9640 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ac38adbe10 0x55ac38ade2d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 20 realm 2024-09-21T09:03:18.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38adee50 con 0x55ac38adbe10 2024-09-21T09:03:18.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:18.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38adf720 con 0x55ac38adbe10 2024-09-21T09:03:18.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38adfac0 con 0x55ac38adbe10 2024-09-21T09:03:18.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:18.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ac38ae0820 0x55ac38ae2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.667+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae3220 con 0x55ac38ae0820 2024-09-21T09:03:18.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.668+0000 7fcaa62cb640 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ac38ae0820 0x55ac38ae2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.668+0000 7fcaa62cb640 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ac38ae0820 0x55ac38ae2c10 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.668+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.668+0000 7fcaa9d40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:18.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.668+0000 7fcaa9d40800 20 searching for the correct realm 2024-09-21T09:03:18.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.668+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ac38ae51b0 0x55ac38ae7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.668+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae51b0 2024-09-21T09:03:18.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.668+0000 7fcaa5aca640 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ac38ae51b0 0x55ac38ae7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.669+0000 7fcaa5aca640 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ac38ae51b0 0x55ac38ae7670 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.669+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca98019050 con 0x55ac38ae51b0 2024-09-21T09:03:18.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.669+0000 7fcaa5aca640 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fca9803d1a0 0x7fca9800f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.669+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x7fca9803d1a0 2024-09-21T09:03:18.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.669+0000 7fcaa52c9640 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fca9803d1a0 0x7fca9800f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.669+0000 7fcaa52c9640 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fca9803d1a0 0x7fca9800f300 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.670+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.670+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae0820 2024-09-21T09:03:18.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.670+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.670+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38adbe10 2024-09-21T09:03:18.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.670+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.670+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38adbe10 2024-09-21T09:03:18.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.670+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.670+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae0820 2024-09-21T09:03:18.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.671+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.671+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae0820 2024-09-21T09:03:18.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.671+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.671+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x7fca9803d1a0 2024-09-21T09:03:18.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.671+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.671+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae51b0 2024-09-21T09:03:18.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.671+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca98019050 con 0x55ac38ae51b0 2024-09-21T09:03:18.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.671+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38adbe10 2024-09-21T09:03:18.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.672+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.672+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae0820 2024-09-21T09:03:18.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.672+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.672+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38adbe10 2024-09-21T09:03:18.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.672+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.672+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x7fca9803d1a0 2024-09-21T09:03:18.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.672+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.672+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae51b0 2024-09-21T09:03:18.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.673+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca98019050 con 0x55ac38ae51b0 2024-09-21T09:03:18.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.673+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae51b0 2024-09-21T09:03:18.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.673+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca98019050 con 0x55ac38ae51b0 2024-09-21T09:03:18.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.673+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae0820 2024-09-21T09:03:18.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.673+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.673+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae51b0 2024-09-21T09:03:18.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.673+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca98019050 con 0x55ac38ae51b0 2024-09-21T09:03:18.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.673+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae51b0 2024-09-21T09:03:18.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.674+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca98019050 con 0x55ac38ae51b0 2024-09-21T09:03:18.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.674+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38adbe10 2024-09-21T09:03:18.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.674+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.674+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38adbe10 2024-09-21T09:03:18.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.674+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.674+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae0820 2024-09-21T09:03:18.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.674+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.674+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae51b0 2024-09-21T09:03:18.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.675+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca98019050 con 0x55ac38ae51b0 2024-09-21T09:03:18.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.675+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x7fca9803d1a0 2024-09-21T09:03:18.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.675+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.675+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38adbe10 2024-09-21T09:03:18.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.675+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.675+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae0820 2024-09-21T09:03:18.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.676+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.676+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae51b0 2024-09-21T09:03:18.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.676+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca98019050 con 0x55ac38ae51b0 2024-09-21T09:03:18.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.676+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae0820 2024-09-21T09:03:18.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.676+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.676+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x7fca9803d1a0 2024-09-21T09:03:18.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.677+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.677+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae51b0 2024-09-21T09:03:18.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.677+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca98019050 con 0x55ac38ae51b0 2024-09-21T09:03:18.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.677+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38ae0820 2024-09-21T09:03:18.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.677+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.677+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x55ac38adbe10 2024-09-21T09:03:18.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.677+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.677+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae7d40 con 0x7fca9803d1a0 2024-09-21T09:03:18.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:18.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:18.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:18.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:18.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:18.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:18.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae4700 con 0x55ac38adbe10 2024-09-21T09:03:18.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae3f70 con 0x55ac38adbe10 2024-09-21T09:03:18.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:18.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae36b0 con 0x55ac38adbe10 2024-09-21T09:03:18.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:18.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 zone default found 2024-09-21T09:03:18.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 4 Realm: () 2024-09-21T09:03:18.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:18.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:18.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:18.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 zonegroup default 2024-09-21T09:03:18.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.678+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae8670 con 0x55ac38ae0820 2024-09-21T09:03:18.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.679+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.679+0000 7fcaa9d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.679+0000 7fcaa9d40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.679+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aea8a0 con 0x55ac38ae51b0 2024-09-21T09:03:18.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.679+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca98019050 con 0x55ac38ae51b0 2024-09-21T09:03:18.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.679+0000 7fcaa9d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.679+0000 7fcaa9d40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.679+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aeac40 con 0x55ac38ae51b0 2024-09-21T09:03:18.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.679+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca98019050 con 0x55ac38ae51b0 2024-09-21T09:03:18.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.679+0000 7fcaa9d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.679+0000 7fcaa9d40800 20 started sync module instance, tier type = 2024-09-21T09:03:18.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.679+0000 7fcaa9d40800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:18.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.679+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae9d30 con 0x7fca9803d1a0 2024-09-21T09:03:18.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.680+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.680+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94198173704784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae9d30 con 0x7fca9803d1a0 2024-09-21T09:03:18.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.680+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aeb690 con 0x55ac38adbe10 2024-09-21T09:03:18.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.681+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94198173704784] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.681+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.681+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94198173708704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae9d30 con 0x55ac38adbe10 2024-09-21T09:03:18.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.681+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aec0e0 con 0x55ac38ae51b0 2024-09-21T09:03:18.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.683+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94198173708704] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.683+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca98019050 con 0x55ac38ae51b0 2024-09-21T09:03:18.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.683+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94198173702272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae9ca0 con 0x55ac38ae51b0 2024-09-21T09:03:18.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.683+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aece80 con 0x7fca9803d1a0 2024-09-21T09:03:18.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.684+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.684+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94198173714864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aed720 con 0x7fca9803d1a0 2024-09-21T09:03:18.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.684+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94198173702272] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca98019050 con 0x55ac38ae51b0 2024-09-21T09:03:18.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.684+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aee1e0 con 0x55ac38adbe10 2024-09-21T09:03:18.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.685+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.685+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94198173719728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aee1a0 con 0x55ac38adbe10 2024-09-21T09:03:18.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.685+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94198173714864] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.685+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aed270 con 0x55ac38ae0820 2024-09-21T09:03:18.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.686+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94198173719728] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.686+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.686+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94198173713664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aed200 con 0x55ac38ae0820 2024-09-21T09:03:18.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.686+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aef210 con 0x55ac38ae0820 2024-09-21T09:03:18.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.687+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94198173713664] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.688+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.688+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94198173722432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aef210 con 0x55ac38ae0820 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.688+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aefbd0 con 0x55ac38ae0820 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.688+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94198173722432] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.689+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.689+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94198173724480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aefbd0 con 0x55ac38ae0820 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.689+0000 7fcaa9d40800 20 add_watcher() i=0 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.689+0000 7fcaa9d40800 20 add_watcher() i=1 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.689+0000 7fcaa9d40800 20 add_watcher() i=2 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.689+0000 7fcaa9d40800 20 add_watcher() i=3 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.689+0000 7fcaa9d40800 20 add_watcher() i=4 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.689+0000 7fcaa9d40800 20 add_watcher() i=5 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.689+0000 7fcaa9d40800 20 add_watcher() i=6 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.689+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94198173724480] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.689+0000 7fcaa9d40800 20 add_watcher() i=7 2024-09-21T09:03:18.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.689+0000 7fcaa9d40800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:18.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.689+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38af2ee0 con 0x55ac38adbe10 2024-09-21T09:03:18.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.690+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.690+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94198173726864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38af0160 con 0x55ac38adbe10 2024-09-21T09:03:18.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.691+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94198173726864] v29'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.691+0000 7fc9577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:18.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.691+0000 7fcaa9d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:18.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.691+0000 7fcaa9d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:18.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.691+0000 7fcaa9d40800 5 note: GC not initialized 2024-09-21T09:03:18.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.691+0000 7fc9567fc640 20 reqs_thread_entry: start 2024-09-21T09:03:18.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.691+0000 7fcaa9d40800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:18.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 20 Filter name: none 2024-09-21T09:03:18.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fc8cbfff640 20 reqs_thread_entry: start 2024-09-21T09:03:18.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:18.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38b26370 con 0x55ac38adbe10 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 20 rados_obj.operate() r=0 bl.length=556 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38b27100 con 0x7fca9803d1a0 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.692+0000 7fcaa9d40800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-21T09:03:18.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.693+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38b2ced0 con 0x55ac38adbe10 2024-09-21T09:03:18.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.693+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v29'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.693+0000 7fcaa9d40800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:18.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.693+0000 7fcaa9d40800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:18.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.693+0000 7fcaa9d40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:18.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.694+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94198173976816 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38b299f0 con 0x55ac38adbe10 2024-09-21T09:03:18.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.694+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify (1) cookie 94198173719728 notify 124554051591 ret 0) ==== 891+0+0 (crc 0 0 0) 0x55ac3886fe00 con 0x55ac38adbe10 2024-09-21T09:03:18.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.694+0000 7fc9897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051591 cookie 94198173719728 notifier 4392 bl.length()=849 2024-09-21T09:03:18.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.694+0000 7fc9897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:18.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.694+0000 7fc9897fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:18.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.694+0000 7fc9897fa640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fc968003ea0 con 0x55ac38adbe10 2024-09-21T09:03:18.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.694+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(65 notify.4 [notify cookie 94198173976816 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.694+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.694+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== watch-notify(notify_complete (2) cookie 94198173976816 notify 124554051591 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fca9c087690 con 0x55ac38adbe10 2024-09-21T09:03:18.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.694+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38b2c8f0 con 0x7fca9803d1a0 2024-09-21T09:03:18.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.696+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.696+0000 7fcaa9d40800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-21T09:03:18.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.696+0000 7fcaa9d40800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-21T09:03:18.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.696+0000 7fcaa9d40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-21T09:03:18.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.696+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94198173976816 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ac38b299a0 con 0x7fca9803d1a0 2024-09-21T09:03:18.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.696+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== watch-notify(notify (1) cookie 94198173704784 notify 124554051587 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fca9c087690 con 0x7fca9803d1a0 2024-09-21T09:03:18.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.696+0000 7fc988ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051587 cookie 94198173704784 notifier 4392 bl.length()=166 2024-09-21T09:03:18.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.696+0000 7fc988ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-21T09:03:18.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.696+0000 7fc988ff9640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-21T09:03:18.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.696+0000 7fc988ff9640 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fc8d8003400 con 0x7fca9803d1a0 2024-09-21T09:03:18.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.696+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(68 notify.0 [notify cookie 94198173976816 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.696+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== watch-notify(notify_complete (2) cookie 94198173976816 notify 124554051587 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fca9c087a00 con 0x7fca9803d1a0 2024-09-21T09:03:18.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.696+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.716 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-21T09:03:18.693766Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:18.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.697+0000 7fc9577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:18.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.698+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94198173726864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38b24080 con 0x55ac38adbe10 2024-09-21T09:03:18.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.698+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94198173726864] v29'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.698+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94198173704784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38b24080 con 0x7fca9803d1a0 2024-09-21T09:03:18.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.700+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94198173704784] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.700+0000 7fcaa9d40800 20 remove_watcher() i=0 2024-09-21T09:03:18.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.700+0000 7fcaa9d40800 2 removed watcher, disabling cache 2024-09-21T09:03:18.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.700+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94198173708704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38b24080 con 0x55ac38adbe10 2024-09-21T09:03:18.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.701+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94198173708704] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.701+0000 7fcaa9d40800 20 remove_watcher() i=1 2024-09-21T09:03:18.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.701+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94198173702272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38b24080 con 0x55ac38ae51b0 2024-09-21T09:03:18.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.702+0000 7fcaa5aca640 1 -- 172.21.15.178:0/3194566410 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94198173702272] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca98019050 con 0x55ac38ae51b0 2024-09-21T09:03:18.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.702+0000 7fcaa9d40800 20 remove_watcher() i=2 2024-09-21T09:03:18.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.702+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94198173714864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aeb1a0 con 0x7fca9803d1a0 2024-09-21T09:03:18.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.703+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94198173714864] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x7fca9803d1a0 2024-09-21T09:03:18.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.703+0000 7fcaa9d40800 20 remove_watcher() i=3 2024-09-21T09:03:18.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.703+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94198173719728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae9880 con 0x55ac38adbe10 2024-09-21T09:03:18.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.704+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94198173719728] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c051070 con 0x55ac38adbe10 2024-09-21T09:03:18.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.704+0000 7fcaa9d40800 20 remove_watcher() i=4 2024-09-21T09:03:18.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.704+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94198173713664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aec9b0 con 0x55ac38ae0820 2024-09-21T09:03:18.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.705+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94198173713664] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.705+0000 7fcaa9d40800 20 remove_watcher() i=5 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.705+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94198173722432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38aeb1a0 con 0x55ac38ae0820 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.706+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94198173722432] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.706+0000 7fcaa9d40800 20 remove_watcher() i=6 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.706+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94198173724480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ac38ae9880 con 0x55ac38ae0820 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa62cb640 1 -- 172.21.15.178:0/3194566410 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94198173724480] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa0056040 con 0x55ac38ae0820 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 20 remove_watcher() i=7 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ac38ae0820 msgr2=0x55ac38ae2c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ac38ae0820 0x55ac38ae2c10 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ac38adbe10 msgr2=0x55ac38ade2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ac38adbe10 0x55ac38ade2d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fca9803d1a0 msgr2=0x7fca9800f300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fca9803d1a0 0x7fca9800f300 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ac38ae51b0 msgr2=0x55ac38ae7670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ac38ae51b0 0x55ac38ae7670 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc970036ac0 msgr2=0x7fc970038f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc970036ac0 0x7fc970038f80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fca980021b0 tx=0x7fca98043000 comp rx=0 tx=0).stop 2024-09-21T09:03:18.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38ac8f60 msgr2=0x55ac38ad03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa52c9640 1 -- 172.21.15.178:0/3194566410 reap_dead start 2024-09-21T09:03:18.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38ac8f60 0x55ac38ad03d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0017fe0 tx=0x7fcaa004ce20 comp rx=0 tx=0).stop 2024-09-21T09:03:18.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 shutdown_connections 2024-09-21T09:03:18.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/3194566410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38ac8f60 0x55ac38ad03d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 >> 172.21.15.178:0/3194566410 conn(0x55ac38ac52c0 msgr2=0x55ac38ac3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 shutdown_connections 2024-09-21T09:03:18.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 -- 172.21.15.178:0/3194566410 wait complete. 2024-09-21T09:03:18.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 -- 172.21.15.178:0/2600369020 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc980036b90 msgr2=0x7fc980039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/2600369020 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc980036b90 0x7fc980039050 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55ac38aa9000 tx=0x7fca980193e0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 -- 172.21.15.178:0/2600369020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38abc360 msgr2=0x55ac38abc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/2600369020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38abc360 0x55ac38abc780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55ac38aa2630 tx=0x7fcaa000aec0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 -- 172.21.15.178:0/2600369020 shutdown_connections 2024-09-21T09:03:18.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/2600369020 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc980036b90 0x7fc980039050 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/2600369020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac38abc360 0x55ac38abc780 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.707+0000 7fcaa9d40800 1 -- 172.21.15.178:0/2600369020 >> 172.21.15.178:0/2600369020 conn(0x55ac38ab12f0 msgr2=0x55ac38ab3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 -- 172.21.15.178:0/2600369020 shutdown_connections 2024-09-21T09:03:18.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 -- 172.21.15.178:0/2600369020 wait complete. 2024-09-21T09:03:18.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ac38aaaed0 msgr2=0x55ac38aad2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ac38aaaed0 0x55ac38aad2c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ac389aedd0 msgr2=0x55ac38aa8530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ac389aedd0 0x55ac38aa8530 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc98c036b90 msgr2=0x7fc98c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc98c036b90 0x7fc98c039050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca9c057000 tx=0x7fca9c052000 comp rx=0 tx=0).stop 2024-09-21T09:03:18.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac3891c610 msgr2=0x55ac38aa1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac3891c610 0x55ac38aa1580 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fca98000f80 tx=0x7fca98001250 comp rx=0 tx=0).stop 2024-09-21T09:03:18.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 shutdown_connections 2024-09-21T09:03:18.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ac38aaaed0 0x55ac38aad2c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ac389aedd0 0x55ac38aa8530 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc98c036b90 0x7fc98c039050 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 --2- 172.21.15.178:0/4244967042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac3891c610 0x55ac38aa1580 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 >> 172.21.15.178:0/4244967042 conn(0x55ac389a2e00 msgr2=0x55ac38a93d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 shutdown_connections 2024-09-21T09:03:18.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.708+0000 7fcaa9d40800 1 -- 172.21.15.178:0/4244967042 wait complete. 2024-09-21T09:03:18.727 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-21T09:03:18.693766Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:18.728 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T09:03:18.728 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T09:03:18.728 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T09:03:18.772 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:18.772 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:18.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.771+0000 7f7562926800 1 Processor -- start 2024-09-21T09:03:18.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.771+0000 7f7562926800 1 -- start start 2024-09-21T09:03:18.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.771+0000 7f7562926800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55dba0ce0990 0x55dba0cdf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.771+0000 7f7562926800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dba0c29b30 con 0x55dba0ce0590 2024-09-21T09:03:18.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.771+0000 7f7562926800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55dba0c0b360 con 0x55dba0ce0990 2024-09-21T09:03:18.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.771+0000 7f755dde2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55dba0ce0990 0x55dba0cdf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.771+0000 7f755e5e3640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55dba0ce0590 0x55dba0cded70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46676/0 (socket says 172.21.15.178:46676) 2024-09-21T09:03:18.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.771+0000 7f755e5e3640 1 -- 172.21.15.178:0/4076455191 learned_addr learned my addr 172.21.15.178:0/4076455191 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:18.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.772+0000 7f755d5e1640 1 -- 172.21.15.178:0/4076455191 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2187671690 0 0) 0x55dba0c29b30 con 0x55dba0ce0590 2024-09-21T09:03:18.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.772+0000 7f755d5e1640 1 -- 172.21.15.178:0/4076455191 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7548001e10 con 0x55dba0ce0590 2024-09-21T09:03:18.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.772+0000 7f755dde2640 1 -- 172.21.15.178:0/4076455191 >> v1:172.21.15.44:6789/0 conn(0x55dba0ce0590 legacy=0x55dba0cded70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.772+0000 7f755dde2640 1 -- 172.21.15.178:0/4076455191 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba0c31e00 con 0x55dba0ce0990 2024-09-21T09:03:18.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.773+0000 7f755dde2640 1 --2- 172.21.15.178:0/4076455191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0990 0x55dba0cdf550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f755400a470 tx=0x7f7554045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39c6cb776dd1f90 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.774+0000 7f755d5e1640 1 -- 172.21.15.178:0/4076455191 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7554059070 con 0x55dba0ce0990 2024-09-21T09:03:18.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.774+0000 7f755d5e1640 1 -- 172.21.15.178:0/4076455191 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7554054570 con 0x55dba0ce0990 2024-09-21T09:03:18.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.774+0000 7f755d5e1640 1 -- 172.21.15.178:0/4076455191 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7554054870 con 0x55dba0ce0990 2024-09-21T09:03:18.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.774+0000 7f7562926800 1 -- 172.21.15.178:0/4076455191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0990 msgr2=0x55dba0cdf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.774+0000 7f7562926800 1 --2- 172.21.15.178:0/4076455191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0990 0x55dba0cdf550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f755400a470 tx=0x7f7554045920 comp rx=0 tx=0).stop 2024-09-21T09:03:18.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.774+0000 7f7562926800 1 -- 172.21.15.178:0/4076455191 shutdown_connections 2024-09-21T09:03:18.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.774+0000 7f7562926800 1 --2- 172.21.15.178:0/4076455191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0990 0x55dba0cdf550 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.774+0000 7f7562926800 1 -- 172.21.15.178:0/4076455191 >> 172.21.15.178:0/4076455191 conn(0x55dba0d65ff0 msgr2=0x55dba0d68410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.774+0000 7f7562926800 1 -- 172.21.15.178:0/4076455191 shutdown_connections 2024-09-21T09:03:18.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.774+0000 7f7562926800 1 -- 172.21.15.178:0/4076455191 wait complete. 2024-09-21T09:03:18.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.788+0000 7f7562926800 1 Processor -- start 2024-09-21T09:03:18.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.788+0000 7f7562926800 1 -- start start 2024-09-21T09:03:18.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.788+0000 7f7562926800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0590 0x55dba0e5b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.788+0000 7f7562926800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dba0cb6330 con 0x55dba0ce0590 2024-09-21T09:03:18.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.788+0000 7f755e5e3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0590 0x55dba0e5b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.788+0000 7f755e5e3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0590 0x55dba0e5b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42784/0 (socket says 172.21.15.178:42784) 2024-09-21T09:03:18.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.788+0000 7f755e5e3640 1 -- 172.21.15.178:0/3741678336 learned_addr learned my addr 172.21.15.178:0/3741678336 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.789+0000 7f755e5e3640 1 -- 172.21.15.178:0/3741678336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba0c03bc0 con 0x55dba0ce0590 2024-09-21T09:03:18.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.789+0000 7f755e5e3640 1 --2- 172.21.15.178:0/3741678336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0590 0x55dba0e5b8c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7550001e30 tx=0x7f755000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2da60e572f2f10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.789+0000 7f744c608640 1 -- 172.21.15.178:0/3741678336 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7550012020 con 0x55dba0ce0590 2024-09-21T09:03:18.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.789+0000 7f744c608640 1 -- 172.21.15.178:0/3741678336 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755000e5a0 con 0x55dba0ce0590 2024-09-21T09:03:18.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.789+0000 7f744c608640 1 -- 172.21.15.178:0/3741678336 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755000e8e0 con 0x55dba0ce0590 2024-09-21T09:03:18.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.790+0000 7f7562926800 1 -- 172.21.15.178:0/3741678336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0590 msgr2=0x55dba0e5b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.790+0000 7f7562926800 1 --2- 172.21.15.178:0/3741678336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0590 0x55dba0e5b8c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7550001e30 tx=0x7f755000b780 comp rx=0 tx=0).stop 2024-09-21T09:03:18.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.790+0000 7f7562926800 1 -- 172.21.15.178:0/3741678336 shutdown_connections 2024-09-21T09:03:18.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.790+0000 7f7562926800 1 --2- 172.21.15.178:0/3741678336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0590 0x55dba0e5b8c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.790+0000 7f7562926800 1 -- 172.21.15.178:0/3741678336 >> 172.21.15.178:0/3741678336 conn(0x55dba0d65ff0 msgr2=0x55dba0e57280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.790+0000 7f7562926800 1 -- 172.21.15.178:0/3741678336 shutdown_connections 2024-09-21T09:03:18.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.790+0000 7f7562926800 1 -- 172.21.15.178:0/3741678336 wait complete. 2024-09-21T09:03:18.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.790+0000 7f7562926800 1 Processor -- start 2024-09-21T09:03:18.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.790+0000 7f7562926800 1 -- start start 2024-09-21T09:03:18.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.790+0000 7f7562926800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0590 0x55dba0e632e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.790+0000 7f7562926800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dba0d739a0 con 0x55dba0ce0590 2024-09-21T09:03:18.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.791+0000 7f755e5e3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0590 0x55dba0e632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.791+0000 7f755e5e3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0590 0x55dba0e632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42788/0 (socket says 172.21.15.178:42788) 2024-09-21T09:03:18.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.791+0000 7f755e5e3640 1 -- 172.21.15.178:0/2292229573 learned_addr learned my addr 172.21.15.178:0/2292229573 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.791+0000 7f755e5e3640 1 -- 172.21.15.178:0/2292229573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba0c17fe0 con 0x55dba0ce0590 2024-09-21T09:03:18.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.791+0000 7f755e5e3640 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0590 0x55dba0e632e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7550001e30 tx=0x7f7550000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.791+0000 7f744ae05640 1 -- 172.21.15.178:0/2292229573 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7550012030 con 0x55dba0ce0590 2024-09-21T09:03:18.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.791+0000 7f744ae05640 1 -- 172.21.15.178:0/2292229573 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7550001490 con 0x55dba0ce0590 2024-09-21T09:03:18.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.791+0000 7f744ae05640 1 -- 172.21.15.178:0/2292229573 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755001a8f0 con 0x55dba0ce0590 2024-09-21T09:03:18.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.791+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dba0e63820 con 0x55dba0ce0590 2024-09-21T09:03:18.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.791+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dba0e63d40 con 0x55dba0ce0590 2024-09-21T09:03:18.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.792+0000 7f744ae05640 1 -- 172.21.15.178:0/2292229573 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7550015020 con 0x55dba0ce0590 2024-09-21T09:03:18.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.792+0000 7f744ae05640 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7444036b90 0x7f7444039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.792+0000 7f744ae05640 1 -- 172.21.15.178:0/2292229573 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f7550020030 con 0x55dba0ce0590 2024-09-21T09:03:18.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.792+0000 7f755dde2640 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7444036b90 0x7f7444039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.792+0000 7f7562926800 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55dba0e68340 0x55dba0e6a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.792+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0e6ac70 con 0x55dba0e68340 2024-09-21T09:03:18.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.793+0000 7f755ede4640 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55dba0e68340 0x55dba0e6a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.793+0000 7f755dde2640 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7444036b90 0x7f7444039050 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55dba0cdfe10 tx=0x7f7554050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.793+0000 7f755ede4640 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55dba0e68340 0x55dba0e6a730 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.793+0000 7f755ede4640 1 -- 172.21.15.178:0/2292229573 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f755800a4a0 con 0x55dba0e68340 2024-09-21T09:03:18.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.793+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0e67870 con 0x55dba0e68340 2024-09-21T09:03:18.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.793+0000 7f755ede4640 1 -- 172.21.15.178:0/2292229573 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f755800a4a0 con 0x55dba0e68340 2024-09-21T09:03:18.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.793+0000 7f7562926800 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55dba0e6cda0 0x55dba0e6f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.793+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0e6f9f0 con 0x55dba0e6cda0 2024-09-21T09:03:18.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.794+0000 7f755e5e3640 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55dba0e6cda0 0x55dba0e6f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.794+0000 7f755e5e3640 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55dba0e6cda0 0x55dba0e6f260 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.794+0000 7f755e5e3640 1 -- 172.21.15.178:0/2292229573 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0e6cda0 2024-09-21T09:03:18.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.794+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0e6b550 con 0x55dba0e68340 2024-09-21T09:03:18.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.795+0000 7f755ede4640 1 -- 172.21.15.178:0/2292229573 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f755800a4a0 con 0x55dba0e68340 2024-09-21T09:03:18.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.795+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0e6b970 con 0x55dba0e68340 2024-09-21T09:03:18.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.795+0000 7f755ede4640 1 -- 172.21.15.178:0/2292229573 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f755800a4a0 con 0x55dba0e68340 2024-09-21T09:03:18.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.795+0000 7f7562926800 1 Processor -- start 2024-09-21T09:03:18.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.795+0000 7f7562926800 1 -- start start 2024-09-21T09:03:18.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.795+0000 7f7562926800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e7e340 0x55dba0e7e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.796+0000 7f7562926800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dba0c05580 con 0x55dba0e7e340 2024-09-21T09:03:18.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.796+0000 7f755ede4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e7e340 0x55dba0e7e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.796+0000 7f755ede4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e7e340 0x55dba0e7e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42790/0 (socket says 172.21.15.178:42790) 2024-09-21T09:03:18.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.796+0000 7f755ede4640 1 -- 172.21.15.178:0/3784749195 learned_addr learned my addr 172.21.15.178:0/3784749195 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.796+0000 7f755ede4640 1 -- 172.21.15.178:0/3784749195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba0e7eca0 con 0x55dba0e7e340 2024-09-21T09:03:18.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.796+0000 7f755ede4640 1 --2- 172.21.15.178:0/3784749195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e7e340 0x55dba0e7e760 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55dba0e6b070 tx=0x7f7558018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.796+0000 7f7443fff640 1 -- 172.21.15.178:0/3784749195 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7558014450 con 0x55dba0e7e340 2024-09-21T09:03:18.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.796+0000 7f7443fff640 1 -- 172.21.15.178:0/3784749195 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7558014610 con 0x55dba0e7e340 2024-09-21T09:03:18.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.796+0000 7f7562926800 1 -- 172.21.15.178:0/3784749195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dba0e7ef30 con 0x55dba0e7e340 2024-09-21T09:03:18.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.796+0000 7f7443fff640 1 -- 172.21.15.178:0/3784749195 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7558014930 con 0x55dba0e7e340 2024-09-21T09:03:18.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.796+0000 7f7562926800 1 -- 172.21.15.178:0/3784749195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dba0e81c10 con 0x55dba0e7e340 2024-09-21T09:03:18.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.797+0000 7f7443fff640 1 -- 172.21.15.178:0/3784749195 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7558011040 con 0x55dba0e7e340 2024-09-21T09:03:18.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.797+0000 7f7443fff640 1 --2- 172.21.15.178:0/3784749195 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7438036b90 0x7f7438039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.797+0000 7f7443fff640 1 -- 172.21.15.178:0/3784749195 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f755801e070 con 0x55dba0e7e340 2024-09-21T09:03:18.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.797+0000 7f755e5e3640 1 --2- 172.21.15.178:0/3784749195 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7438036b90 0x7f7438039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.798+0000 7f7562926800 1 Processor -- start 2024-09-21T09:03:18.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.798+0000 7f7562926800 1 -- start start 2024-09-21T09:03:18.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.798+0000 7f755e5e3640 1 --2- 172.21.15.178:0/3784749195 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7438036b90 0x7f7438039050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f755001af20 tx=0x7f75500189d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.798+0000 7f7562926800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e8afa0 0x55dba0e8b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.798+0000 7f7562926800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dba0e5c070 con 0x55dba0e8afa0 2024-09-21T09:03:18.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.798+0000 7f755ede4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e8afa0 0x55dba0e8b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.798+0000 7f755ede4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e8afa0 0x55dba0e8b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42800/0 (socket says 172.21.15.178:42800) 2024-09-21T09:03:18.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.798+0000 7f755ede4640 1 -- 172.21.15.178:0/3540237765 learned_addr learned my addr 172.21.15.178:0/3540237765 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.798+0000 7f755ede4640 1 -- 172.21.15.178:0/3540237765 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba0e8b970 con 0x55dba0e8afa0 2024-09-21T09:03:18.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.798+0000 7f755ede4640 1 --2- 172.21.15.178:0/3540237765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e8afa0 0x55dba0e8b3a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f755804cbe0 tx=0x7f7558011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca7ff870055c752 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.799+0000 7f7441ffb640 1 -- 172.21.15.178:0/3540237765 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75580167c0 con 0x55dba0e8afa0 2024-09-21T09:03:18.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.799+0000 7f7441ffb640 1 -- 172.21.15.178:0/3540237765 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7558013ca0 con 0x55dba0e8afa0 2024-09-21T09:03:18.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.799+0000 7f7441ffb640 1 -- 172.21.15.178:0/3540237765 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7558014ad0 con 0x55dba0e8afa0 2024-09-21T09:03:18.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.799+0000 7f7562926800 1 -- 172.21.15.178:0/3540237765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e8afa0 msgr2=0x55dba0e8b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.799+0000 7f7562926800 1 --2- 172.21.15.178:0/3540237765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e8afa0 0x55dba0e8b3a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f755804cbe0 tx=0x7f7558011700 comp rx=0 tx=0).stop 2024-09-21T09:03:18.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.799+0000 7f7562926800 1 -- 172.21.15.178:0/3540237765 shutdown_connections 2024-09-21T09:03:18.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.799+0000 7f7562926800 1 --2- 172.21.15.178:0/3540237765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e8afa0 0x55dba0e8b3a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.799+0000 7f7562926800 1 -- 172.21.15.178:0/3540237765 >> 172.21.15.178:0/3540237765 conn(0x55dba0e87300 msgr2=0x55dba0e85400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.799+0000 7f7562926800 1 -- 172.21.15.178:0/3540237765 shutdown_connections 2024-09-21T09:03:18.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.799+0000 7f7562926800 1 -- 172.21.15.178:0/3540237765 wait complete. 2024-09-21T09:03:18.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.799+0000 7f7562926800 1 Processor -- start 2024-09-21T09:03:18.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.799+0000 7f7562926800 1 -- start start 2024-09-21T09:03:18.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.800+0000 7f7562926800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e8afa0 0x55dba0e923b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.800+0000 7f7562926800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dba0e8bef0 con 0x55dba0e8afa0 2024-09-21T09:03:18.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.800+0000 7f755ede4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e8afa0 0x55dba0e923b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.800+0000 7f755ede4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e8afa0 0x55dba0e923b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42810/0 (socket says 172.21.15.178:42810) 2024-09-21T09:03:18.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.800+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 learned_addr learned my addr 172.21.15.178:0/1151518097 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.800+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba0e928f0 con 0x55dba0e8afa0 2024-09-21T09:03:18.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.800+0000 7f755ede4640 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e8afa0 0x55dba0e923b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f755804cbe0 tx=0x7f755804cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.800+0000 7f742ffff640 1 -- 172.21.15.178:0/1151518097 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7558022a50 con 0x55dba0e8afa0 2024-09-21T09:03:18.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.800+0000 7f742ffff640 1 -- 172.21.15.178:0/1151518097 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7558022bf0 con 0x55dba0e8afa0 2024-09-21T09:03:18.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.800+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dba0e92b80 con 0x55dba0e8afa0 2024-09-21T09:03:18.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.800+0000 7f742ffff640 1 -- 172.21.15.178:0/1151518097 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755804e090 con 0x55dba0e8afa0 2024-09-21T09:03:18.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.800+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dba0e95830 con 0x55dba0e8afa0 2024-09-21T09:03:18.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.801+0000 7f742ffff640 1 -- 172.21.15.178:0/1151518097 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7558040020 con 0x55dba0e8afa0 2024-09-21T09:03:18.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.801+0000 7f742ffff640 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7428036b90 0x7f7428039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.801+0000 7f742ffff640 1 -- 172.21.15.178:0/1151518097 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f755803e020 con 0x55dba0e8afa0 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.802+0000 7f755e5e3640 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7428036b90 0x7f7428039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.802+0000 7f7562926800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.802+0000 7f7562926800 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55dba0e9e020 0x55dba0ea04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.802+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea0c30 con 0x55dba0e9e020 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.802+0000 7f755dde2640 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55dba0e9e020 0x55dba0ea04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.802+0000 7f755e5e3640 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7428036b90 0x7f7428039050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f755000deb0 tx=0x7f7550035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.802+0000 7f755dde2640 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55dba0e9e020 0x55dba0ea04e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.802+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.802+0000 7f7562926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.802+0000 7f7562926800 20 realm 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.802+0000 7f7562926800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.802+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea1060 con 0x55dba0e9e020 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f7562926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f7562926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:18.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f7562926800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea1930 con 0x55dba0e9e020 2024-09-21T09:03:18.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f7562926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f7562926800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea1cd0 con 0x55dba0e9e020 2024-09-21T09:03:18.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f7562926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:18.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f7562926800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f7562926800 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55dba0ea2a30 0x55dba0ea4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea5360 con 0x55dba0ea2a30 2024-09-21T09:03:18.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.803+0000 7f755ede4640 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55dba0ea2a30 0x55dba0ea4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.804+0000 7f755ede4640 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55dba0ea2a30 0x55dba0ea4e20 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.804+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.804+0000 7f7562926800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:18.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.804+0000 7f7562926800 20 searching for the correct realm 2024-09-21T09:03:18.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.804+0000 7f7562926800 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55dba0ea73e0 0x55dba0ea98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.804+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea73e0 2024-09-21T09:03:18.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.804+0000 7f755e5e3640 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55dba0ea73e0 0x55dba0ea98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.804+0000 7f755e5e3640 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55dba0ea73e0 0x55dba0ea98a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.805+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0ea73e0 2024-09-21T09:03:18.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.805+0000 7f755e5e3640 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f7550017050 0x7f755000d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.805+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x7f7550017050 2024-09-21T09:03:18.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.805+0000 7f755dde2640 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f7550017050 0x7f755000d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.805+0000 7f755dde2640 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f7550017050 0x7f755000d3d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.805+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755405c040 con 0x7f7550017050 2024-09-21T09:03:18.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.805+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea2a30 2024-09-21T09:03:18.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.806+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.806+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0e9e020 2024-09-21T09:03:18.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.806+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.806+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0e9e020 2024-09-21T09:03:18.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.806+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.806+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea2a30 2024-09-21T09:03:18.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.807+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.807+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea2a30 2024-09-21T09:03:18.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.807+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.807+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x7f7550017050 2024-09-21T09:03:18.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.807+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755405c040 con 0x7f7550017050 2024-09-21T09:03:18.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.807+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea73e0 2024-09-21T09:03:18.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.807+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0ea73e0 2024-09-21T09:03:18.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.807+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0e9e020 2024-09-21T09:03:18.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.807+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.808+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea2a30 2024-09-21T09:03:18.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.808+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.808+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0e9e020 2024-09-21T09:03:18.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.808+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.808+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x7f7550017050 2024-09-21T09:03:18.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.808+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f755405c040 con 0x7f7550017050 2024-09-21T09:03:18.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.808+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea73e0 2024-09-21T09:03:18.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.808+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0ea73e0 2024-09-21T09:03:18.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.808+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea73e0 2024-09-21T09:03:18.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.809+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0ea73e0 2024-09-21T09:03:18.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.809+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea2a30 2024-09-21T09:03:18.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.809+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.809+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea73e0 2024-09-21T09:03:18.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.809+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0ea73e0 2024-09-21T09:03:18.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.809+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea73e0 2024-09-21T09:03:18.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.809+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0ea73e0 2024-09-21T09:03:18.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.809+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0e9e020 2024-09-21T09:03:18.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.810+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.810+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0e9e020 2024-09-21T09:03:18.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.810+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.810+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea2a30 2024-09-21T09:03:18.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.810+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.810+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea73e0 2024-09-21T09:03:18.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.810+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0ea73e0 2024-09-21T09:03:18.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.810+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x7f7550017050 2024-09-21T09:03:18.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.811+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755405c040 con 0x7f7550017050 2024-09-21T09:03:18.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.811+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0e9e020 2024-09-21T09:03:18.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.811+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.811+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea2a30 2024-09-21T09:03:18.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.811+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.811+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea73e0 2024-09-21T09:03:18.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.812+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0ea73e0 2024-09-21T09:03:18.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.812+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea2a30 2024-09-21T09:03:18.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.812+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.812+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x7f7550017050 2024-09-21T09:03:18.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.812+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755405c040 con 0x7f7550017050 2024-09-21T09:03:18.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.812+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea73e0 2024-09-21T09:03:18.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.812+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0ea73e0 2024-09-21T09:03:18.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.812+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0ea2a30 2024-09-21T09:03:18.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x55dba0e9e020 2024-09-21T09:03:18.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea9f70 con 0x7f7550017050 2024-09-21T09:03:18.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755405c040 con 0x7f7550017050 2024-09-21T09:03:18.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f7562926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:18.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f7562926800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:18.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f7562926800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:18.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f7562926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:18.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f7562926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:18.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f7562926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:18.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f7562926800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea5de0 con 0x55dba0e9e020 2024-09-21T09:03:18.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f7562926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f7562926800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.813+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea6230 con 0x55dba0e9e020 2024-09-21T09:03:18.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:18.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea6240 con 0x55dba0e9e020 2024-09-21T09:03:18.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:18.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 20 zone default found 2024-09-21T09:03:18.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 4 Realm: () 2024-09-21T09:03:18.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:18.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:18.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:18.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 20 zonegroup default 2024-09-21T09:03:18.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea66e0 con 0x55dba0ea2a30 2024-09-21T09:03:18.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ea5a20 con 0x55dba0ea73e0 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0ea73e0 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.814+0000 7f7562926800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.815+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eac390 con 0x55dba0ea73e0 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.815+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0ea73e0 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.815+0000 7f7562926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.815+0000 7f7562926800 20 started sync module instance, tier type = 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.815+0000 7f7562926800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.815+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eab710 con 0x7f7550017050 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.816+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755405c040 con 0x7f7550017050 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.816+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94401785936912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eab710 con 0x7f7550017050 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.816+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eacf10 con 0x55dba0e9e020 2024-09-21T09:03:18.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.817+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94401785936912] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755405c040 con 0x7f7550017050 2024-09-21T09:03:18.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.817+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.817+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94401785940544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eab710 con 0x55dba0e9e020 2024-09-21T09:03:18.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.817+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ead9d0 con 0x55dba0ea73e0 2024-09-21T09:03:18.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.818+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0ea73e0 2024-09-21T09:03:18.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.818+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94401785943200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eae270 con 0x55dba0ea73e0 2024-09-21T09:03:18.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.818+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eaed30 con 0x7f7550017050 2024-09-21T09:03:18.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.818+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94401785940544] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.819+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94401785943200] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0ea73e0 2024-09-21T09:03:18.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.819+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755405c040 con 0x7f7550017050 2024-09-21T09:03:18.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.819+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94401785945536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eab260 con 0x7f7550017050 2024-09-21T09:03:18.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.819+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eaf5d0 con 0x55dba0e9e020 2024-09-21T09:03:18.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.820+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94401785945536] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755405c040 con 0x7f7550017050 2024-09-21T09:03:18.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.820+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.820+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94401785948160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eaf550 con 0x55dba0e9e020 2024-09-21T09:03:18.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.820+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eaffe0 con 0x55dba0ea2a30 2024-09-21T09:03:18.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.821+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.821+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94401785953072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eb0830 con 0x55dba0ea2a30 2024-09-21T09:03:18.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.821+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eb12d0 con 0x55dba0ea2a30 2024-09-21T09:03:18.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.821+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94401785948160] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.822+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94401785953072] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.822+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.822+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94401785957792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eb03e0 con 0x55dba0ea2a30 2024-09-21T09:03:18.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.823+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eb1960 con 0x55dba0ea2a30 2024-09-21T09:03:18.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.823+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.823+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94401785957792] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.823+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94401785959600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eb1d80 con 0x55dba0ea2a30 2024-09-21T09:03:18.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.823+0000 7f7562926800 20 add_watcher() i=0 2024-09-21T09:03:18.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.823+0000 7f7562926800 20 add_watcher() i=1 2024-09-21T09:03:18.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.823+0000 7f7562926800 20 add_watcher() i=2 2024-09-21T09:03:18.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.823+0000 7f7562926800 20 add_watcher() i=3 2024-09-21T09:03:18.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.823+0000 7f7562926800 20 add_watcher() i=4 2024-09-21T09:03:18.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.823+0000 7f7562926800 20 add_watcher() i=5 2024-09-21T09:03:18.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.824+0000 7f7562926800 20 add_watcher() i=6 2024-09-21T09:03:18.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.824+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94401785959600] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.824+0000 7f7562926800 20 add_watcher() i=7 2024-09-21T09:03:18.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.824+0000 7f7562926800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:18.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.824+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eb4db0 con 0x55dba0e9e020 2024-09-21T09:03:18.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.825+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.825+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94401785960656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eb21a0 con 0x55dba0e9e020 2024-09-21T09:03:18.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.826+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94401785960656] v29'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.826+0000 7f7414fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:18.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.826+0000 7f7562926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:18.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.826+0000 7f7562926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:18.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.826+0000 7f7562926800 5 note: GC not initialized 2024-09-21T09:03:18.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.826+0000 7f738f7fe640 20 reqs_thread_entry: start 2024-09-21T09:03:18.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.826+0000 7f7562926800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:18.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.826+0000 7f7562926800 20 Filter name: none 2024-09-21T09:03:18.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.826+0000 7f738d7fa640 20 reqs_thread_entry: start 2024-09-21T09:03:18.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.826+0000 7f7562926800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.826+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ee7b70 con 0x55dba0e9e020 2024-09-21T09:03:18.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.827+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.827+0000 7f7562926800 20 rados_obj.operate() r=0 bl.length=673 2024-09-21T09:03:18.852 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-21T09:03:18.693766Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:18.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.828+0000 7f7414fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:18.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.828+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94401785960656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ee80b0 con 0x55dba0e9e020 2024-09-21T09:03:18.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.828+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94401785960656] v29'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.828+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94401785936912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ee80b0 con 0x7f7550017050 2024-09-21T09:03:18.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.829+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94401785936912] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755405c040 con 0x7f7550017050 2024-09-21T09:03:18.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.829+0000 7f7562926800 20 remove_watcher() i=0 2024-09-21T09:03:18.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.829+0000 7f7562926800 2 removed watcher, disabling cache 2024-09-21T09:03:18.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.829+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94401785940544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eabc10 con 0x55dba0e9e020 2024-09-21T09:03:18.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.831+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94401785940544] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.831+0000 7f7562926800 20 remove_watcher() i=1 2024-09-21T09:03:18.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.831+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94401785943200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eabc10 con 0x55dba0ea73e0 2024-09-21T09:03:18.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.832+0000 7f755e5e3640 1 -- 172.21.15.178:0/1151518097 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94401785943200] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755001ac70 con 0x55dba0ea73e0 2024-09-21T09:03:18.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.832+0000 7f7562926800 20 remove_watcher() i=2 2024-09-21T09:03:18.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.832+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94401785945536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ead4a0 con 0x7f7550017050 2024-09-21T09:03:18.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.833+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94401785945536] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755405c040 con 0x7f7550017050 2024-09-21T09:03:18.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.833+0000 7f7562926800 20 remove_watcher() i=3 2024-09-21T09:03:18.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.833+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94401785948160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eaddc0 con 0x55dba0e9e020 2024-09-21T09:03:18.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.834+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94401785948160] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755405c040 con 0x55dba0e9e020 2024-09-21T09:03:18.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.834+0000 7f7562926800 20 remove_watcher() i=4 2024-09-21T09:03:18.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.834+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94401785953072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ead4a0 con 0x55dba0ea2a30 2024-09-21T09:03:18.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.835+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94401785953072] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.835+0000 7f7562926800 20 remove_watcher() i=5 2024-09-21T09:03:18.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.835+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94401785957792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0eafb30 con 0x55dba0ea2a30 2024-09-21T09:03:18.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.836+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94401785957792] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.836+0000 7f7562926800 20 remove_watcher() i=6 2024-09-21T09:03:18.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.836+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94401785959600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dba0ead4a0 con 0x55dba0ea2a30 2024-09-21T09:03:18.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f755ede4640 1 -- 172.21.15.178:0/1151518097 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94401785959600] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7558036040 con 0x55dba0ea2a30 2024-09-21T09:03:18.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 20 remove_watcher() i=7 2024-09-21T09:03:18.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55dba0ea2a30 msgr2=0x55dba0ea4e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55dba0ea2a30 0x55dba0ea4e20 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55dba0e9e020 msgr2=0x55dba0ea04e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55dba0e9e020 0x55dba0ea04e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f7550017050 msgr2=0x7f755000d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f7550017050 0x7f755000d3d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55dba0ea73e0 msgr2=0x55dba0ea98a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55dba0ea73e0 0x55dba0ea98a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7428036b90 msgr2=0x7f7428039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7428036b90 0x7f7428039050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f755000deb0 tx=0x7f7550035000 comp rx=0 tx=0).stop 2024-09-21T09:03:18.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e8afa0 msgr2=0x55dba0e923b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 --2- 172.21.15.178:0/1151518097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e8afa0 0x55dba0e923b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f755804cbe0 tx=0x7f755804cb70 comp rx=0 tx=0).stop 2024-09-21T09:03:18.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 reap_dead start 2024-09-21T09:03:18.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f755dde2640 1 -- 172.21.15.178:0/1151518097 reap_dead start 2024-09-21T09:03:18.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 shutdown_connections 2024-09-21T09:03:18.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 >> 172.21.15.178:0/1151518097 conn(0x55dba0e87300 msgr2=0x55dba0e853d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 shutdown_connections 2024-09-21T09:03:18.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 -- 172.21.15.178:0/1151518097 wait complete. 2024-09-21T09:03:18.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 -- 172.21.15.178:0/3784749195 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7438036b90 msgr2=0x7f7438039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 --2- 172.21.15.178:0/3784749195 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7438036b90 0x7f7438039050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f755001af20 tx=0x7f75500189d0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 -- 172.21.15.178:0/3784749195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e7e340 msgr2=0x55dba0e7e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 --2- 172.21.15.178:0/3784749195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e7e340 0x55dba0e7e760 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55dba0e6b070 tx=0x7f7558018830 comp rx=0 tx=0).stop 2024-09-21T09:03:18.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 -- 172.21.15.178:0/3784749195 shutdown_connections 2024-09-21T09:03:18.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 --2- 172.21.15.178:0/3784749195 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7438036b90 0x7f7438039050 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.837+0000 7f7562926800 1 --2- 172.21.15.178:0/3784749195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0e7e340 0x55dba0e7e760 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 -- 172.21.15.178:0/3784749195 >> 172.21.15.178:0/3784749195 conn(0x55dba0e732d0 msgr2=0x55dba0e75e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 -- 172.21.15.178:0/3784749195 shutdown_connections 2024-09-21T09:03:18.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 -- 172.21.15.178:0/3784749195 wait complete. 2024-09-21T09:03:18.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55dba0e6cda0 msgr2=0x55dba0e6f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55dba0e6cda0 0x55dba0e6f260 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55dba0e68340 msgr2=0x55dba0e6a730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55dba0e68340 0x55dba0e6a730 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7444036b90 msgr2=0x7f7444039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7444036b90 0x7f7444039050 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55dba0cdfe10 tx=0x7f7554050000 comp rx=0 tx=0).stop 2024-09-21T09:03:18.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0590 msgr2=0x55dba0e632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0590 0x55dba0e632e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7550001e30 tx=0x7f7550000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 shutdown_connections 2024-09-21T09:03:18.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55dba0e6cda0 0x55dba0e6f260 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55dba0e68340 0x55dba0e6a730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7444036b90 0x7f7444039050 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 --2- 172.21.15.178:0/2292229573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dba0ce0590 0x55dba0e632e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 >> 172.21.15.178:0/2292229573 conn(0x55dba0d65ff0 msgr2=0x55dba0e55af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 shutdown_connections 2024-09-21T09:03:18.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.838+0000 7f7562926800 1 -- 172.21.15.178:0/2292229573 wait complete. 2024-09-21T09:03:18.862 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-21T09:03:18.693766Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:18.862 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-21T09:03:18.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-21T09:03:18.863 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-21T09:03:18.909 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:18.909 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:18.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.908+0000 7f2b02a87800 1 Processor -- start 2024-09-21T09:03:18.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.908+0000 7f2b02a87800 1 -- start start 2024-09-21T09:03:18.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.908+0000 7f2b02a87800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5638e8fda710 0x5638e8fdab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.908+0000 7f2b02a87800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5638e8e99b30 con 0x5638e8fdb050 2024-09-21T09:03:18.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.908+0000 7f2b02a87800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5638e8e7b360 con 0x5638e8fda710 2024-09-21T09:03:18.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.908+0000 7f2b0057b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5638e8fda710 0x5638e8fdab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.908+0000 7f2affd7a640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5638e8fdb050 0x5638e8fdfa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46684/0 (socket says 172.21.15.178:46684) 2024-09-21T09:03:18.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.908+0000 7f2affd7a640 1 -- 172.21.15.178:0/3625337195 learned_addr learned my addr 172.21.15.178:0/3625337195 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:18.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.909+0000 7f2b0057b640 1 -- 172.21.15.178:0/3625337195 >> v1:172.21.15.44:6789/0 conn(0x5638e8fdb050 legacy=0x5638e8fdfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.909+0000 7f2b0057b640 1 -- 172.21.15.178:0/3625337195 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638e8ea1e00 con 0x5638e8fda710 2024-09-21T09:03:18.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.910+0000 7f2b0057b640 1 --2- 172.21.15.178:0/3625337195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e8fdab10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2af000a470 tx=0x7f2af0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20986f326cf75f2f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.911+0000 7f2aff579640 1 -- 172.21.15.178:0/3625337195 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af0053570 con 0x5638e8fda710 2024-09-21T09:03:18.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.911+0000 7f2aff579640 1 -- 172.21.15.178:0/3625337195 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af0058070 con 0x5638e8fda710 2024-09-21T09:03:18.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.911+0000 7f2aff579640 1 -- 172.21.15.178:0/3625337195 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af0053880 con 0x5638e8fda710 2024-09-21T09:03:18.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.911+0000 7f2b02a87800 1 -- 172.21.15.178:0/3625337195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 msgr2=0x5638e8fdab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.911+0000 7f2b02a87800 1 --2- 172.21.15.178:0/3625337195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e8fdab10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2af000a470 tx=0x7f2af0045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:18.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.911+0000 7f2b02a87800 1 -- 172.21.15.178:0/3625337195 shutdown_connections 2024-09-21T09:03:18.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.911+0000 7f2b02a87800 1 --2- 172.21.15.178:0/3625337195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e8fdab10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.911+0000 7f2b02a87800 1 -- 172.21.15.178:0/3625337195 >> 172.21.15.178:0/3625337195 conn(0x5638e8fd5fe0 msgr2=0x5638e8fd8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.911+0000 7f2b02a87800 1 -- 172.21.15.178:0/3625337195 shutdown_connections 2024-09-21T09:03:18.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.911+0000 7f2b02a87800 1 -- 172.21.15.178:0/3625337195 wait complete. 2024-09-21T09:03:18.927 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.925+0000 7f2b02a87800 1 Processor -- start 2024-09-21T09:03:18.930 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.925+0000 7f2b02a87800 1 -- start start 2024-09-21T09:03:18.930 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.925+0000 7f2b02a87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e90c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.930 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.925+0000 7f2b02a87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5638e8f26360 con 0x5638e8fda710 2024-09-21T09:03:18.930 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.926+0000 7f2b0057b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e90c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.930 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.926+0000 7f2b0057b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e90c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42820/0 (socket says 172.21.15.178:42820) 2024-09-21T09:03:18.930 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.926+0000 7f2b0057b640 1 -- 172.21.15.178:0/3455282514 learned_addr learned my addr 172.21.15.178:0/3455282514 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.926+0000 7f2b0057b640 1 -- 172.21.15.178:0/3455282514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638e8e73bc0 con 0x5638e8fda710 2024-09-21T09:03:18.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.926+0000 7f2b0057b640 1 --2- 172.21.15.178:0/3455282514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e90c98a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2af0025c20 tx=0x7f2af0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1d64ff6b31c519 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.926+0000 7f29ee60c640 1 -- 172.21.15.178:0/3455282514 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af005c580 con 0x5638e8fda710 2024-09-21T09:03:18.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.926+0000 7f29ee60c640 1 -- 172.21.15.178:0/3455282514 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af0063030 con 0x5638e8fda710 2024-09-21T09:03:18.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.926+0000 7f29ee60c640 1 -- 172.21.15.178:0/3455282514 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af005c850 con 0x5638e8fda710 2024-09-21T09:03:18.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.927+0000 7f2b02a87800 1 -- 172.21.15.178:0/3455282514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 msgr2=0x5638e90c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.927+0000 7f2b02a87800 1 --2- 172.21.15.178:0/3455282514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e90c98a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2af0025c20 tx=0x7f2af0051000 comp rx=0 tx=0).stop 2024-09-21T09:03:18.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.927+0000 7f2b02a87800 1 -- 172.21.15.178:0/3455282514 shutdown_connections 2024-09-21T09:03:18.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.927+0000 7f2b02a87800 1 --2- 172.21.15.178:0/3455282514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e90c98a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.927+0000 7f2b02a87800 1 -- 172.21.15.178:0/3455282514 >> 172.21.15.178:0/3455282514 conn(0x5638e8fd5fe0 msgr2=0x5638e90c5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.927+0000 7f2b02a87800 1 -- 172.21.15.178:0/3455282514 shutdown_connections 2024-09-21T09:03:18.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.927+0000 7f2b02a87800 1 -- 172.21.15.178:0/3455282514 wait complete. 2024-09-21T09:03:18.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.927+0000 7f2b02a87800 1 Processor -- start 2024-09-21T09:03:18.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.927+0000 7f2b02a87800 1 -- start start 2024-09-21T09:03:18.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.928+0000 7f2b02a87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e90d1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.928+0000 7f2b02a87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5638e8fe15f0 con 0x5638e8fda710 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.928+0000 7f2b0057b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e90d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.928+0000 7f2b0057b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e90d1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42826/0 (socket says 172.21.15.178:42826) 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.928+0000 7f2b0057b640 1 -- 172.21.15.178:0/4148411363 learned_addr learned my addr 172.21.15.178:0/4148411363 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.928+0000 7f2b0057b640 1 -- 172.21.15.178:0/4148411363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638e8e87fe0 con 0x5638e8fda710 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.928+0000 7f2b0057b640 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e90d1220 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5638e90ca700 tx=0x7f2af0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.929+0000 7f29ece09640 1 -- 172.21.15.178:0/4148411363 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af0054ad0 con 0x5638e8fda710 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.929+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638e90d1760 con 0x5638e8fda710 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.929+0000 7f29ece09640 1 -- 172.21.15.178:0/4148411363 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af0054c70 con 0x5638e8fda710 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.929+0000 7f29ece09640 1 -- 172.21.15.178:0/4148411363 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af0068420 con 0x5638e8fda710 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.929+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638e90d1c80 con 0x5638e8fda710 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.929+0000 7f29ece09640 1 -- 172.21.15.178:0/4148411363 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2af00685c0 con 0x5638e8fda710 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.930+0000 7f29ece09640 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29e8036b40 0x7f29e8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.930+0000 7f29ece09640 1 -- 172.21.15.178:0/4148411363 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2af0070030 con 0x5638e8fda710 2024-09-21T09:03:18.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.930+0000 7f2affd7a640 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29e8036b40 0x7f29e8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.930+0000 7f2b02a87800 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5638e8fdb050 0x5638e90d8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.930+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e90d87d0 con 0x5638e8fdb050 2024-09-21T09:03:18.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.930+0000 7f2b00d7c640 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5638e8fdb050 0x5638e90d8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.930+0000 7f2affd7a640 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29e8036b40 0x7f29e8039000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2af4000f60 tx=0x7f2af40012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.930+0000 7f2b00d7c640 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5638e8fdb050 0x5638e90d8290 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.931+0000 7f2b00d7c640 1 -- 172.21.15.178:0/4148411363 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2af800a4a0 con 0x5638e8fdb050 2024-09-21T09:03:18.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.931+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e90d5860 con 0x5638e8fdb050 2024-09-21T09:03:18.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.931+0000 7f2b00d7c640 1 -- 172.21.15.178:0/4148411363 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2af800a4a0 con 0x5638e8fdb050 2024-09-21T09:03:18.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.931+0000 7f2b02a87800 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5638e90dab20 0x5638e90dcf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.931+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e90dd600 con 0x5638e90dab20 2024-09-21T09:03:18.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.931+0000 7f2b0057b640 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5638e90dab20 0x5638e90dcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.931+0000 7f2b0057b640 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5638e90dab20 0x5638e90dcf10 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.932+0000 7f2b0057b640 1 -- 172.21.15.178:0/4148411363 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2af0051070 con 0x5638e90dab20 2024-09-21T09:03:18.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.932+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e90d99c0 con 0x5638e8fdb050 2024-09-21T09:03:18.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.932+0000 7f2b00d7c640 1 -- 172.21.15.178:0/4148411363 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2af800a4a0 con 0x5638e8fdb050 2024-09-21T09:03:18.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.932+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e90d9ea0 con 0x5638e8fdb050 2024-09-21T09:03:18.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.932+0000 7f2b00d7c640 1 -- 172.21.15.178:0/4148411363 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2af800a4a0 con 0x5638e8fdb050 2024-09-21T09:03:18.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.932+0000 7f2b02a87800 1 Processor -- start 2024-09-21T09:03:18.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.933+0000 7f2b02a87800 1 -- start start 2024-09-21T09:03:18.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.933+0000 7f2b02a87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8f50760 0x5638e8f4edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.933+0000 7f2b02a87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5638e8e75580 con 0x5638e8f50760 2024-09-21T09:03:18.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.933+0000 7f2b00d7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8f50760 0x5638e8f4edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.933+0000 7f2b00d7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8f50760 0x5638e8f4edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42840/0 (socket says 172.21.15.178:42840) 2024-09-21T09:03:18.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.933+0000 7f2b00d7c640 1 -- 172.21.15.178:0/1105375670 learned_addr learned my addr 172.21.15.178:0/1105375670 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.933+0000 7f2b00d7c640 1 -- 172.21.15.178:0/1105375670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638e8f50b80 con 0x5638e8f50760 2024-09-21T09:03:18.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.933+0000 7f2b00d7c640 1 --2- 172.21.15.178:0/1105375670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8f50760 0x5638e8f4edb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5638e90d8bd0 tx=0x7f2af8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.933+0000 7f29e5ffb640 1 -- 172.21.15.178:0/1105375670 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af8014450 con 0x5638e8f50760 2024-09-21T09:03:18.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.933+0000 7f29e5ffb640 1 -- 172.21.15.178:0/1105375670 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af8014610 con 0x5638e8f50760 2024-09-21T09:03:18.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.934+0000 7f29e5ffb640 1 -- 172.21.15.178:0/1105375670 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af8014930 con 0x5638e8f50760 2024-09-21T09:03:18.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.934+0000 7f2b02a87800 1 -- 172.21.15.178:0/1105375670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638e8f4f3b0 con 0x5638e8f50760 2024-09-21T09:03:18.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.934+0000 7f2b02a87800 1 -- 172.21.15.178:0/1105375670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638e8f4f8b0 con 0x5638e8f50760 2024-09-21T09:03:18.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.934+0000 7f29e5ffb640 1 -- 172.21.15.178:0/1105375670 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2af8011040 con 0x5638e8f50760 2024-09-21T09:03:18.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.934+0000 7f29e5ffb640 1 --2- 172.21.15.178:0/1105375670 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29d8036b40 0x7f29d8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.935+0000 7f29e5ffb640 1 -- 172.21.15.178:0/1105375670 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2af801e070 con 0x5638e8f50760 2024-09-21T09:03:18.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.935+0000 7f2b0057b640 1 --2- 172.21.15.178:0/1105375670 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29d8036b40 0x7f29d8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.935+0000 7f2b02a87800 1 Processor -- start 2024-09-21T09:03:18.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.935+0000 7f2b02a87800 1 -- start start 2024-09-21T09:03:18.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.935+0000 7f2b0057b640 1 --2- 172.21.15.178:0/1105375670 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29d8036b40 0x7f29d8039000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x5638e90d8c70 tx=0x7f2af005e4c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.935+0000 7f2b02a87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e90fade0 0x5638e90fb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.935+0000 7f2b02a87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5638e90c9ff0 con 0x5638e90fade0 2024-09-21T09:03:18.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.935+0000 7f2b00d7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e90fade0 0x5638e90fb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.935+0000 7f2b00d7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e90fade0 0x5638e90fb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42848/0 (socket says 172.21.15.178:42848) 2024-09-21T09:03:18.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.935+0000 7f2b00d7c640 1 -- 172.21.15.178:0/3695491886 learned_addr learned my addr 172.21.15.178:0/3695491886 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.936+0000 7f2b00d7c640 1 -- 172.21.15.178:0/3695491886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638e90fb7b0 con 0x5638e90fade0 2024-09-21T09:03:18.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.936+0000 7f2b00d7c640 1 --2- 172.21.15.178:0/3695491886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e90fade0 0x5638e90fb1e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2af804cb80 tx=0x7f2af803bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c87def866857d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.936+0000 7f29d77fe640 1 -- 172.21.15.178:0/3695491886 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af80168f0 con 0x5638e90fade0 2024-09-21T09:03:18.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.936+0000 7f29d77fe640 1 -- 172.21.15.178:0/3695491886 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af8014ad0 con 0x5638e90fade0 2024-09-21T09:03:18.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.936+0000 7f29d77fe640 1 -- 172.21.15.178:0/3695491886 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af804e0d0 con 0x5638e90fade0 2024-09-21T09:03:18.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.936+0000 7f2b02a87800 1 -- 172.21.15.178:0/3695491886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e90fade0 msgr2=0x5638e90fb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:18.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.936+0000 7f2b02a87800 1 --2- 172.21.15.178:0/3695491886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e90fade0 0x5638e90fb1e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2af804cb80 tx=0x7f2af803bf60 comp rx=0 tx=0).stop 2024-09-21T09:03:18.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.936+0000 7f2b02a87800 1 -- 172.21.15.178:0/3695491886 shutdown_connections 2024-09-21T09:03:18.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.936+0000 7f2b02a87800 1 --2- 172.21.15.178:0/3695491886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e90fade0 0x5638e90fb1e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:18.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.936+0000 7f2b02a87800 1 -- 172.21.15.178:0/3695491886 >> 172.21.15.178:0/3695491886 conn(0x5638e90f7190 msgr2=0x5638e90f5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:18.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.937+0000 7f2b02a87800 1 -- 172.21.15.178:0/3695491886 shutdown_connections 2024-09-21T09:03:18.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.937+0000 7f2b02a87800 1 -- 172.21.15.178:0/3695491886 wait complete. 2024-09-21T09:03:18.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.937+0000 7f2b02a87800 1 Processor -- start 2024-09-21T09:03:18.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.937+0000 7f2b02a87800 1 -- start start 2024-09-21T09:03:18.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.937+0000 7f2b02a87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e90fade0 0x5638e9102230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.937+0000 7f2b02a87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5638e90fbd80 con 0x5638e90fade0 2024-09-21T09:03:18.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.937+0000 7f2b00d7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e90fade0 0x5638e9102230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.937+0000 7f2b00d7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e90fade0 0x5638e9102230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42860/0 (socket says 172.21.15.178:42860) 2024-09-21T09:03:18.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.937+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 learned_addr learned my addr 172.21.15.178:0/2363253893 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:18.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.937+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638e9102770 con 0x5638e90fade0 2024-09-21T09:03:18.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.938+0000 7f2b00d7c640 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e90fade0 0x5638e9102230 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2af803bfa0 tx=0x7f2af804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.938+0000 7f29d5ffb640 1 -- 172.21.15.178:0/2363253893 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af8044030 con 0x5638e90fade0 2024-09-21T09:03:18.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.938+0000 7f29d5ffb640 1 -- 172.21.15.178:0/2363253893 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af8014c80 con 0x5638e90fade0 2024-09-21T09:03:18.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.938+0000 7f29d5ffb640 1 -- 172.21.15.178:0/2363253893 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af804b270 con 0x5638e90fade0 2024-09-21T09:03:18.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.938+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638e9102a00 con 0x5638e90fade0 2024-09-21T09:03:18.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.938+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638e91056b0 con 0x5638e90fade0 2024-09-21T09:03:18.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.939+0000 7f29d5ffb640 1 -- 172.21.15.178:0/2363253893 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2af804b410 con 0x5638e90fade0 2024-09-21T09:03:18.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.939+0000 7f29d5ffb640 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29c8036b90 0x7f29c8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.939+0000 7f29d5ffb640 1 -- 172.21.15.178:0/2363253893 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2af8045070 con 0x5638e90fade0 2024-09-21T09:03:18.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.939+0000 7f2b0057b640 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29c8036b90 0x7f29c8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2b02a87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2b02a87800 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5638e910deb0 0x5638e9110370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e9110ac0 con 0x5638e910deb0 2024-09-21T09:03:18.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2b0057b640 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29c8036b90 0x7f29c8039050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2af0025c20 tx=0x7f2af0090000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2affd7a640 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5638e910deb0 0x5638e9110370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2affd7a640 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5638e910deb0 0x5638e9110370 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2af4009050 con 0x5638e910deb0 2024-09-21T09:03:18.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2b02a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2b02a87800 20 realm 2024-09-21T09:03:18.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2b02a87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e910d300 con 0x5638e910deb0 2024-09-21T09:03:18.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2af4009050 con 0x5638e910deb0 2024-09-21T09:03:18.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2b02a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2b02a87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:18.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2b02a87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.940+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e91115b0 con 0x5638e910deb0 2024-09-21T09:03:18.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.941+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2af4009050 con 0x5638e910deb0 2024-09-21T09:03:18.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.941+0000 7f2b02a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.941+0000 7f2b02a87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.941+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e9111e80 con 0x5638e910deb0 2024-09-21T09:03:18.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.941+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2af4009050 con 0x5638e910deb0 2024-09-21T09:03:18.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.941+0000 7f2b02a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:18.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.941+0000 7f2b02a87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.941+0000 7f2b02a87800 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5638e91127c0 0x5638e9114bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.941+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e9115340 con 0x5638e91127c0 2024-09-21T09:03:18.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.941+0000 7f2b00d7c640 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5638e91127c0 0x5638e9114bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.941+0000 7f2b00d7c640 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5638e91127c0 0x5638e9114bb0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.942+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.942+0000 7f2b02a87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:18.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.942+0000 7f2b02a87800 20 searching for the correct realm 2024-09-21T09:03:18.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.942+0000 7f2b02a87800 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5638e9117310 0x5638e91197d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.942+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e9117310 2024-09-21T09:03:18.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.942+0000 7f2b0057b640 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5638e9117310 0x5638e91197d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.942+0000 7f2b0057b640 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5638e9117310 0x5638e91197d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.942+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0051070 con 0x5638e9117310 2024-09-21T09:03:18.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.942+0000 7f2b0057b640 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f2af008c040 0x7f2af00688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:18.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.942+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x7f2af008c040 2024-09-21T09:03:18.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.942+0000 7f2affd7a640 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f2af008c040 0x7f2af00688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:18.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.943+0000 7f2affd7a640 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f2af008c040 0x7f2af00688b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:18.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.943+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af4009050 con 0x7f2af008c040 2024-09-21T09:03:18.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.943+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e91127c0 2024-09-21T09:03:18.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.943+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.943+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e910deb0 2024-09-21T09:03:18.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.944+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af4009050 con 0x5638e910deb0 2024-09-21T09:03:18.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.944+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e910deb0 2024-09-21T09:03:18.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.944+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af4029040 con 0x5638e910deb0 2024-09-21T09:03:18.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.944+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e91127c0 2024-09-21T09:03:18.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.944+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.944+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e91127c0 2024-09-21T09:03:18.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.945+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.945+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x7f2af008c040 2024-09-21T09:03:18.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.945+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af4029040 con 0x7f2af008c040 2024-09-21T09:03:18.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.945+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e9117310 2024-09-21T09:03:18.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.945+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0051070 con 0x5638e9117310 2024-09-21T09:03:18.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.945+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e910deb0 2024-09-21T09:03:18.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.945+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af4029040 con 0x5638e910deb0 2024-09-21T09:03:18.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.945+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e91127c0 2024-09-21T09:03:18.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.946+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.946+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e910deb0 2024-09-21T09:03:18.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.946+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af4029040 con 0x5638e910deb0 2024-09-21T09:03:18.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.946+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x7f2af008c040 2024-09-21T09:03:18.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.946+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2af4029040 con 0x7f2af008c040 2024-09-21T09:03:18.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.946+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e9117310 2024-09-21T09:03:18.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.946+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0051070 con 0x5638e9117310 2024-09-21T09:03:18.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.946+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e9117310 2024-09-21T09:03:18.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.947+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0051070 con 0x5638e9117310 2024-09-21T09:03:18.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.947+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e91127c0 2024-09-21T09:03:18.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.947+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.947+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e9117310 2024-09-21T09:03:18.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.947+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0051070 con 0x5638e9117310 2024-09-21T09:03:18.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.947+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e9117310 2024-09-21T09:03:18.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.947+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0051070 con 0x5638e9117310 2024-09-21T09:03:18.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.947+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e910deb0 2024-09-21T09:03:18.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.948+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2af4029040 con 0x5638e910deb0 2024-09-21T09:03:18.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.948+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e910deb0 2024-09-21T09:03:18.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.948+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2af4029040 con 0x5638e910deb0 2024-09-21T09:03:18.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.948+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e91127c0 2024-09-21T09:03:18.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.948+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.948+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e9117310 2024-09-21T09:03:18.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.948+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0051070 con 0x5638e9117310 2024-09-21T09:03:18.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.948+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x7f2af008c040 2024-09-21T09:03:18.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.949+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af4029040 con 0x7f2af008c040 2024-09-21T09:03:18.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.949+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e910deb0 2024-09-21T09:03:18.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.949+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af4029040 con 0x5638e910deb0 2024-09-21T09:03:18.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.949+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e91127c0 2024-09-21T09:03:18.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.949+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.949+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e9117310 2024-09-21T09:03:18.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.949+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0051070 con 0x5638e9117310 2024-09-21T09:03:18.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.949+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e91127c0 2024-09-21T09:03:18.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.950+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.950+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x7f2af008c040 2024-09-21T09:03:18.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.950+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af4029040 con 0x7f2af008c040 2024-09-21T09:03:18.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.950+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e9117310 2024-09-21T09:03:18.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.950+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0051070 con 0x5638e9117310 2024-09-21T09:03:18.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.950+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e91127c0 2024-09-21T09:03:18.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.951+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.951+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x5638e910deb0 2024-09-21T09:03:18.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.951+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2af4029040 con 0x5638e910deb0 2024-09-21T09:03:18.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.951+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638e9119ea0 con 0x7f2af008c040 2024-09-21T09:03:18.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.951+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af4029040 con 0x7f2af008c040 2024-09-21T09:03:18.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.951+0000 7f2b02a87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:18.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.951+0000 7f2b02a87800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:18.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.951+0000 7f2b02a87800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:18.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.951+0000 7f2b02a87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:18.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.951+0000 7f2b02a87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:18.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.951+0000 7f2b02a87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:18.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.951+0000 7f2b02a87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.951+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e9115d00 con 0x5638e910deb0 2024-09-21T09:03:18.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2af4029040 con 0x5638e910deb0 2024-09-21T09:03:18.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e9115940 con 0x5638e910deb0 2024-09-21T09:03:18.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2af4029040 con 0x5638e910deb0 2024-09-21T09:03:18.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:18.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e91166a0 con 0x5638e910deb0 2024-09-21T09:03:18.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:18.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:18.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 20 zone default found 2024-09-21T09:03:18.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 4 Realm: () 2024-09-21T09:03:18.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:18.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:18.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:18.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 20 zonegroup default 2024-09-21T09:03:18.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e911a340 con 0x5638e91127c0 2024-09-21T09:03:18.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.952+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e911c610 con 0x5638e9117310 2024-09-21T09:03:18.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.953+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2af0051070 con 0x5638e9117310 2024-09-21T09:03:18.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.953+0000 7f2b02a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.953+0000 7f2b02a87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.953+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e911c9b0 con 0x5638e9117310 2024-09-21T09:03:18.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.953+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2af0051070 con 0x5638e9117310 2024-09-21T09:03:18.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.953+0000 7f2b02a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:18.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.953+0000 7f2b02a87800 20 started sync module instance, tier type = 2024-09-21T09:03:18.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.953+0000 7f2b02a87800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:18.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.953+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911ba50 con 0x7f2af008c040 2024-09-21T09:03:18.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.954+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x7f2af008c040 2024-09-21T09:03:18.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.954+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94802428411728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911ba50 con 0x7f2af008c040 2024-09-21T09:03:18.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.954+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911d3b0 con 0x5638e910deb0 2024-09-21T09:03:18.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.955+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94802428411728] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x7f2af008c040 2024-09-21T09:03:18.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.955+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:18.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.955+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94802428415680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911ba50 con 0x5638e910deb0 2024-09-21T09:03:18.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.955+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911de00 con 0x5638e9117310 2024-09-21T09:03:18.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.956+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af0051070 con 0x5638e9117310 2024-09-21T09:03:18.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.956+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94802428418320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911e6a0 con 0x5638e9117310 2024-09-21T09:03:18.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.956+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911f140 con 0x7f2af008c040 2024-09-21T09:03:18.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.957+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94802428415680] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:18.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.957+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94802428418320] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af0051070 con 0x5638e9117310 2024-09-21T09:03:18.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.957+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x7f2af008c040 2024-09-21T09:03:18.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.957+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94802428420592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911b5a0 con 0x7f2af008c040 2024-09-21T09:03:18.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.957+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911f9e0 con 0x5638e910deb0 2024-09-21T09:03:18.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.958+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:18.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.958+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94802428425440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911f900 con 0x5638e910deb0 2024-09-21T09:03:18.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.958+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e9120900 con 0x5638e91127c0 2024-09-21T09:03:18.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.959+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94802428420592] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x7f2af008c040 2024-09-21T09:03:18.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.959+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.959+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94802428429296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e9120cf0 con 0x5638e91127c0 2024-09-21T09:03:18.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.960+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e91216f0 con 0x5638e91127c0 2024-09-21T09:03:18.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.960+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94802428425440] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:18.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.960+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94802428429296] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.961+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.961+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94802428423184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e9121200 con 0x5638e91127c0 2024-09-21T09:03:18.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.961+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e9121f90 con 0x5638e91127c0 2024-09-21T09:03:18.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.962+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.962+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94802428423184] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.962+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94802428434784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e9121d80 con 0x5638e91127c0 2024-09-21T09:03:18.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.962+0000 7f2b02a87800 20 add_watcher() i=0 2024-09-21T09:03:18.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.962+0000 7f2b02a87800 20 add_watcher() i=1 2024-09-21T09:03:18.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.962+0000 7f2b02a87800 20 add_watcher() i=2 2024-09-21T09:03:18.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.962+0000 7f2b02a87800 20 add_watcher() i=3 2024-09-21T09:03:18.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.962+0000 7f2b02a87800 20 add_watcher() i=4 2024-09-21T09:03:18.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.962+0000 7f2b02a87800 20 add_watcher() i=5 2024-09-21T09:03:18.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.962+0000 7f2b02a87800 20 add_watcher() i=6 2024-09-21T09:03:18.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.962+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94802428434784] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:18.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.962+0000 7f2b02a87800 20 add_watcher() i=7 2024-09-21T09:03:18.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.962+0000 7f2b02a87800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:18.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.963+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e9125260 con 0x5638e910deb0 2024-09-21T09:03:18.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.963+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:18.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.963+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94802428435840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e9122650 con 0x5638e910deb0 2024-09-21T09:03:18.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.964+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94802428435840] v29'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:18.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.964+0000 7f29b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:18.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.964+0000 7f2b02a87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:18.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.964+0000 7f2b02a87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:18.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.964+0000 7f2b02a87800 5 note: GC not initialized 2024-09-21T09:03:18.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.964+0000 7f29b5fdb640 20 reqs_thread_entry: start 2024-09-21T09:03:18.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.964+0000 7f2b02a87800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:18.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.964+0000 7f2b02a87800 20 Filter name: none 2024-09-21T09:03:18.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.964+0000 7f29277fe640 20 reqs_thread_entry: start 2024-09-21T09:03:18.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.964+0000 7f2b02a87800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:18.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.964+0000 7f2b02a87800 20 rados->read ofs=0 len=0 2024-09-21T09:03:18.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.964+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e91584c0 con 0x5638e910deb0 2024-09-21T09:03:18.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.965+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:18.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.965+0000 7f2b02a87800 20 rados_obj.operate() r=0 bl.length=673 2024-09-21T09:03:18.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.965+0000 7f2b02a87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:18.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.965+0000 7f2b02a87800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:18.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.965+0000 7f2b02a87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:18.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.965+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e915f0f0 con 0x5638e910deb0 2024-09-21T09:03:18.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.966+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v29'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:18.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.966+0000 7f2b02a87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:18.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.966+0000 7f2b02a87800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:18.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.966+0000 7f2b02a87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:19.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.966+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94802428684976 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e915a790 con 0x5638e910deb0 2024-09-21T09:03:19.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.966+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify (1) cookie 94802428425440 notify 124554051592 ret 0) ==== 800+0+0 (crc 0 0 0) 0x5638e8e99b30 con 0x5638e910deb0 2024-09-21T09:03:19.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.966+0000 7f29d77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051592 cookie 94802428425440 notifier 4406 bl.length()=758 2024-09-21T09:03:19.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.966+0000 7f29d77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:19.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.966+0000 7f29d77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:19.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.966+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(64 notify.4 [notify cookie 94802428684976 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:19.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.966+0000 7f29d77fe640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f29cc003ea0 con 0x5638e910deb0 2024-09-21T09:03:19.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.967+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:19.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.967+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== watch-notify(notify_complete (2) cookie 94802428684976 notify 124554051592 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2af402f5a0 con 0x5638e910deb0 2024-09-21T09:03:19.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.967+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e915eab0 con 0x5638e910deb0 2024-09-21T09:03:19.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.968+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(66 foo:foo1 [delete] v29'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:19.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.968+0000 7f2b02a87800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-21T09:03:19.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.968+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94802428684976 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638e915a2e0 con 0x7f2af008c040 2024-09-21T09:03:19.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.968+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== watch-notify(notify (1) cookie 94802428411728 notify 124554051588 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f2af402f5a0 con 0x7f2af008c040 2024-09-21T09:03:19.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.968+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.0 [notify cookie 94802428684976 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2af403d040 con 0x7f2af008c040 2024-09-21T09:03:19.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.968+0000 7f29d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051588 cookie 94802428411728 notifier 4406 bl.length()=159 2024-09-21T09:03:19.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.968+0000 7f29d6ffd640 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f29340032c0 con 0x7f2af008c040 2024-09-21T09:03:19.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.968+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== watch-notify(notify_complete (2) cookie 94802428684976 notify 124554051588 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2af402f910 con 0x7f2af008c040 2024-09-21T09:03:19.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.968+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x7f2af008c040 2024-09-21T09:03:19.002 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-21T09:03:18.693766Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:19.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.969+0000 7f29b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:19.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.969+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94802428435840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e9156210 con 0x5638e910deb0 2024-09-21T09:03:19.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.970+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94802428435840] v29'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:19.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.970+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94802428411728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e9156210 con 0x7f2af008c040 2024-09-21T09:03:19.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.971+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94802428411728] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x7f2af008c040 2024-09-21T09:03:19.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.971+0000 7f2b02a87800 20 remove_watcher() i=0 2024-09-21T09:03:19.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.971+0000 7f2b02a87800 2 removed watcher, disabling cache 2024-09-21T09:03:19.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.971+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94802428415680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e9156210 con 0x5638e910deb0 2024-09-21T09:03:19.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.972+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94802428415680] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:19.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.972+0000 7f2b02a87800 20 remove_watcher() i=1 2024-09-21T09:03:19.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.972+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94802428418320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e9156210 con 0x5638e9117310 2024-09-21T09:03:19.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.973+0000 7f2b0057b640 1 -- 172.21.15.178:0/2363253893 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94802428418320] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af0051070 con 0x5638e9117310 2024-09-21T09:03:19.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.973+0000 7f2b02a87800 20 remove_watcher() i=2 2024-09-21T09:03:19.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.973+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94802428420592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911cec0 con 0x7f2af008c040 2024-09-21T09:03:19.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.974+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94802428420592] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x7f2af008c040 2024-09-21T09:03:19.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.974+0000 7f2b02a87800 20 remove_watcher() i=3 2024-09-21T09:03:19.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.974+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94802428425440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911e1f0 con 0x5638e910deb0 2024-09-21T09:03:19.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.975+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94802428425440] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403d040 con 0x5638e910deb0 2024-09-21T09:03:19.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.975+0000 7f2b02a87800 20 remove_watcher() i=4 2024-09-21T09:03:19.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.975+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94802428429296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911cec0 con 0x5638e91127c0 2024-09-21T09:03:19.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.977+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94802428429296] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:19.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.977+0000 7f2b02a87800 20 remove_watcher() i=5 2024-09-21T09:03:19.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.977+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94802428423184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911f4e0 con 0x5638e91127c0 2024-09-21T09:03:19.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.978+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94802428423184] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:19.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.978+0000 7f2b02a87800 20 remove_watcher() i=6 2024-09-21T09:03:19.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.978+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94802428434784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638e911e1f0 con 0x5638e91127c0 2024-09-21T09:03:19.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b00d7c640 1 -- 172.21.15.178:0/2363253893 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94802428434784] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af802a070 con 0x5638e91127c0 2024-09-21T09:03:19.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 20 remove_watcher() i=7 2024-09-21T09:03:19.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5638e91127c0 msgr2=0x5638e9114bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5638e91127c0 0x5638e9114bb0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5638e910deb0 msgr2=0x5638e9110370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5638e910deb0 0x5638e9110370 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f2af008c040 msgr2=0x7f2af00688b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f2af008c040 0x7f2af00688b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5638e9117310 msgr2=0x5638e91197d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5638e9117310 0x5638e91197d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29c8036b90 msgr2=0x7f29c8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29c8036b90 0x7f29c8039050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2af0025c20 tx=0x7f2af0090000 comp rx=0 tx=0).stop 2024-09-21T09:03:19.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2affd7a640 1 -- 172.21.15.178:0/2363253893 reap_dead start 2024-09-21T09:03:19.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e90fade0 msgr2=0x5638e9102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e90fade0 0x5638e9102230 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2af803bfa0 tx=0x7f2af804cb10 comp rx=0 tx=0).stop 2024-09-21T09:03:19.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 shutdown_connections 2024-09-21T09:03:19.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 --2- 172.21.15.178:0/2363253893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e90fade0 0x5638e9102230 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 >> 172.21.15.178:0/2363253893 conn(0x5638e90f7190 msgr2=0x5638e90fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 shutdown_connections 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/2363253893 wait complete. 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/1105375670 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29d8036b40 msgr2=0x7f29d8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 --2- 172.21.15.178:0/1105375670 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29d8036b40 0x7f29d8039000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x5638e90d8c70 tx=0x7f2af005e4c0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/1105375670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8f50760 msgr2=0x5638e8f4edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 --2- 172.21.15.178:0/1105375670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8f50760 0x5638e8f4edb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5638e90d8bd0 tx=0x7f2af8018830 comp rx=0 tx=0).stop 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/1105375670 shutdown_connections 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 --2- 172.21.15.178:0/1105375670 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29d8036b40 0x7f29d8039000 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 --2- 172.21.15.178:0/1105375670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8f50760 0x5638e8f4edb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/1105375670 >> 172.21.15.178:0/1105375670 conn(0x5638e90e0f50 msgr2=0x5638e90e3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/1105375670 shutdown_connections 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.979+0000 7f2b02a87800 1 -- 172.21.15.178:0/1105375670 wait complete. 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5638e90dab20 msgr2=0x5638e90dcf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5638e90dab20 0x5638e90dcf10 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5638e8fdb050 msgr2=0x5638e90d8290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5638e8fdb050 0x5638e90d8290 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29e8036b40 msgr2=0x7f29e8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29e8036b40 0x7f29e8039000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2af4000f60 tx=0x7f2af40012b0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 msgr2=0x5638e90d1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e90d1220 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5638e90ca700 tx=0x7f2af0002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 shutdown_connections 2024-09-21T09:03:19.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5638e90dab20 0x5638e90dcf10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5638e8fdb050 0x5638e90d8290 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f29e8036b40 0x7f29e8039000 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 --2- 172.21.15.178:0/4148411363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638e8fda710 0x5638e90d1220 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 >> 172.21.15.178:0/4148411363 conn(0x5638e8fd5fe0 msgr2=0x5638e90c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 shutdown_connections 2024-09-21T09:03:19.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:18.980+0000 7f2b02a87800 1 -- 172.21.15.178:0/4148411363 wait complete. 2024-09-21T09:03:19.019 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-21T09:03:18.693766Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:19.019 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-21T09:03:19.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-21T09:03:19.019 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-21T09:03:19.063 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:19.063 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:19.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.062+0000 7f77bd10c800 1 Processor -- start 2024-09-21T09:03:19.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.062+0000 7f77bd10c800 1 -- start start 2024-09-21T09:03:19.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.063+0000 7f77bd10c800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556ff30a0db0 0x556ff30a31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.063+0000 7f77bd10c800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556ff2f59b30 con 0x556ff300e5f0 2024-09-21T09:03:19.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.063+0000 7f77bd10c800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x556ff2f3b360 con 0x556ff30a0db0 2024-09-21T09:03:19.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.063+0000 7f77b3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556ff30a0db0 0x556ff30a31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.063+0000 7f77bac00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x556ff300e5f0 0x556ff309f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46688/0 (socket says 172.21.15.178:46688) 2024-09-21T09:03:19.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.063+0000 7f77bac00640 1 -- 172.21.15.178:0/1649215196 learned_addr learned my addr 172.21.15.178:0/1649215196 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:19.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.063+0000 7f77b3fff640 1 -- 172.21.15.178:0/1649215196 >> v1:172.21.15.44:6789/0 conn(0x556ff300e5f0 legacy=0x556ff309f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.063+0000 7f77b3fff640 1 -- 172.21.15.178:0/1649215196 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ff2f61e00 con 0x556ff30a0db0 2024-09-21T09:03:19.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.065+0000 7f77b3fff640 1 --2- 172.21.15.178:0/1649215196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff30a0db0 0x556ff30a31a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f77a400a470 tx=0x7f77a4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53bf44c915ea52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.065+0000 7f77ba3ff640 1 -- 172.21.15.178:0/1649215196 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a4053570 con 0x556ff30a0db0 2024-09-21T09:03:19.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.065+0000 7f77ba3ff640 1 -- 172.21.15.178:0/1649215196 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a4058070 con 0x556ff30a0db0 2024-09-21T09:03:19.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.065+0000 7f77ba3ff640 1 -- 172.21.15.178:0/1649215196 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a4053880 con 0x556ff30a0db0 2024-09-21T09:03:19.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.066+0000 7f77bd10c800 1 -- 172.21.15.178:0/1649215196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff30a0db0 msgr2=0x556ff30a31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.066+0000 7f77bd10c800 1 --2- 172.21.15.178:0/1649215196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff30a0db0 0x556ff30a31a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f77a400a470 tx=0x7f77a4045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:19.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.066+0000 7f77bd10c800 1 -- 172.21.15.178:0/1649215196 shutdown_connections 2024-09-21T09:03:19.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.066+0000 7f77bd10c800 1 --2- 172.21.15.178:0/1649215196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff30a0db0 0x556ff30a31a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.066+0000 7f77bd10c800 1 -- 172.21.15.178:0/1649215196 >> 172.21.15.178:0/1649215196 conn(0x556ff3094de0 msgr2=0x556ff3097200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.066+0000 7f77bd10c800 1 -- 172.21.15.178:0/1649215196 shutdown_connections 2024-09-21T09:03:19.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.066+0000 7f77bd10c800 1 -- 172.21.15.178:0/1649215196 wait complete. 2024-09-21T09:03:19.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.079+0000 7f77bd10c800 1 Processor -- start 2024-09-21T09:03:19.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.080+0000 7f77bd10c800 1 -- start start 2024-09-21T09:03:19.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.080+0000 7f77bd10c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff300e5f0 0x556ff318ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.080+0000 7f77bd10c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556ff2fe6330 con 0x556ff300e5f0 2024-09-21T09:03:19.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.080+0000 7f77bac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff300e5f0 0x556ff318ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.080+0000 7f77bac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff300e5f0 0x556ff318ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42876/0 (socket says 172.21.15.178:42876) 2024-09-21T09:03:19.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.080+0000 7f77bac00640 1 -- 172.21.15.178:0/2214730454 learned_addr learned my addr 172.21.15.178:0/2214730454 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.080+0000 7f77bac00640 1 -- 172.21.15.178:0/2214730454 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ff2f33bc0 con 0x556ff300e5f0 2024-09-21T09:03:19.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.080+0000 7f77bac00640 1 --2- 172.21.15.178:0/2214730454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff300e5f0 0x556ff318ba80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f77ac001e10 tx=0x7f77ac00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df645970eccb29f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.081+0000 7f76a8e09640 1 -- 172.21.15.178:0/2214730454 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77ac012020 con 0x556ff300e5f0 2024-09-21T09:03:19.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.081+0000 7f76a8e09640 1 -- 172.21.15.178:0/2214730454 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ac00e5a0 con 0x556ff300e5f0 2024-09-21T09:03:19.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.081+0000 7f76a8e09640 1 -- 172.21.15.178:0/2214730454 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77ac00e8e0 con 0x556ff300e5f0 2024-09-21T09:03:19.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.081+0000 7f77bd10c800 1 -- 172.21.15.178:0/2214730454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff300e5f0 msgr2=0x556ff318ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.081+0000 7f77bd10c800 1 --2- 172.21.15.178:0/2214730454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff300e5f0 0x556ff318ba80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f77ac001e10 tx=0x7f77ac00b780 comp rx=0 tx=0).stop 2024-09-21T09:03:19.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.081+0000 7f77bd10c800 1 -- 172.21.15.178:0/2214730454 shutdown_connections 2024-09-21T09:03:19.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.081+0000 7f77bd10c800 1 --2- 172.21.15.178:0/2214730454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff300e5f0 0x556ff318ba80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.081+0000 7f77bd10c800 1 -- 172.21.15.178:0/2214730454 >> 172.21.15.178:0/2214730454 conn(0x556ff3094de0 msgr2=0x556ff3187440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.081+0000 7f77bd10c800 1 -- 172.21.15.178:0/2214730454 shutdown_connections 2024-09-21T09:03:19.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.081+0000 7f77bd10c800 1 -- 172.21.15.178:0/2214730454 wait complete. 2024-09-21T09:03:19.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.082+0000 7f77bd10c800 1 Processor -- start 2024-09-21T09:03:19.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.082+0000 7f77bd10c800 1 -- start start 2024-09-21T09:03:19.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.082+0000 7f77bd10c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff30a0db0 0x556ff31936a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.082+0000 7f77bd10c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556ff30a3980 con 0x556ff30a0db0 2024-09-21T09:03:19.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.082+0000 7f77bac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff30a0db0 0x556ff31936a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.082+0000 7f77bac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff30a0db0 0x556ff31936a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42878/0 (socket says 172.21.15.178:42878) 2024-09-21T09:03:19.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.082+0000 7f77bac00640 1 -- 172.21.15.178:0/2057640830 learned_addr learned my addr 172.21.15.178:0/2057640830 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.082+0000 7f77bac00640 1 -- 172.21.15.178:0/2057640830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ff2f47fe0 con 0x556ff30a0db0 2024-09-21T09:03:19.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.082+0000 7f77bac00640 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff30a0db0 0x556ff31936a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00b7c0 tx=0x7f77ac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.083+0000 7f76a7606640 1 -- 172.21.15.178:0/2057640830 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77ac012030 con 0x556ff30a0db0 2024-09-21T09:03:19.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.083+0000 7f76a7606640 1 -- 172.21.15.178:0/2057640830 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ac001470 con 0x556ff30a0db0 2024-09-21T09:03:19.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.083+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ff3193be0 con 0x556ff30a0db0 2024-09-21T09:03:19.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.083+0000 7f76a7606640 1 -- 172.21.15.178:0/2057640830 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77ac01a700 con 0x556ff30a0db0 2024-09-21T09:03:19.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.083+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ff3194100 con 0x556ff30a0db0 2024-09-21T09:03:19.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.083+0000 7f76a7606640 1 -- 172.21.15.178:0/2057640830 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f77ac015020 con 0x556ff30a0db0 2024-09-21T09:03:19.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.084+0000 7f76a7606640 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f76a0036b40 0x7f76a0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.084+0000 7f76a7606640 1 -- 172.21.15.178:0/2057640830 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f77ac020030 con 0x556ff30a0db0 2024-09-21T09:03:19.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.084+0000 7f77b3fff640 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f76a0036b40 0x7f76a0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.084+0000 7f77bd10c800 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556ff3198700 0x556ff319aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.084+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff319b030 con 0x556ff3198700 2024-09-21T09:03:19.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.084+0000 7f77bb401640 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556ff3198700 0x556ff319aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.084+0000 7f77b3fff640 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f76a0036b40 0x7f76a0039000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f77a4057000 tx=0x7f77a4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.084+0000 7f77bb401640 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556ff3198700 0x556ff319aaf0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.084+0000 7f77bb401640 1 -- 172.21.15.178:0/2057640830 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77b400a4a0 con 0x556ff3198700 2024-09-21T09:03:19.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.084+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff3197ce0 con 0x556ff3198700 2024-09-21T09:03:19.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.085+0000 7f77bb401640 1 -- 172.21.15.178:0/2057640830 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77b400a4a0 con 0x556ff3198700 2024-09-21T09:03:19.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.085+0000 7f77bd10c800 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556ff319d380 0x556ff319f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.085+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff319fe60 con 0x556ff319d380 2024-09-21T09:03:19.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.085+0000 7f77bac00640 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556ff319d380 0x556ff319f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.085+0000 7f77bac00640 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556ff319d380 0x556ff319f770 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.086+0000 7f77bac00640 1 -- 172.21.15.178:0/2057640830 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff319d380 2024-09-21T09:03:19.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.086+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff319c220 con 0x556ff3198700 2024-09-21T09:03:19.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.086+0000 7f77bb401640 1 -- 172.21.15.178:0/2057640830 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77b400a4a0 con 0x556ff3198700 2024-09-21T09:03:19.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.086+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff319c700 con 0x556ff3198700 2024-09-21T09:03:19.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.086+0000 7f77bb401640 1 -- 172.21.15.178:0/2057640830 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f77b400a4a0 con 0x556ff3198700 2024-09-21T09:03:19.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.086+0000 7f77bd10c800 1 Processor -- start 2024-09-21T09:03:19.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.087+0000 7f77bd10c800 1 -- start start 2024-09-21T09:03:19.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.087+0000 7f77bd10c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31ae820 0x556ff31aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.087+0000 7f77bd10c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556ff2f35580 con 0x556ff31ae820 2024-09-21T09:03:19.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.087+0000 7f77bb401640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31ae820 0x556ff31aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.087+0000 7f77bb401640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31ae820 0x556ff31aec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42890/0 (socket says 172.21.15.178:42890) 2024-09-21T09:03:19.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.087+0000 7f77bb401640 1 -- 172.21.15.178:0/272390279 learned_addr learned my addr 172.21.15.178:0/272390279 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.087+0000 7f77bb401640 1 -- 172.21.15.178:0/272390279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ff31af180 con 0x556ff31ae820 2024-09-21T09:03:19.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.087+0000 7f77bb401640 1 --2- 172.21.15.178:0/272390279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31ae820 0x556ff31aec40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x556ff319b430 tx=0x7f77b4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.087+0000 7f76a4e01640 1 -- 172.21.15.178:0/272390279 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4014450 con 0x556ff31ae820 2024-09-21T09:03:19.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.087+0000 7f76a4e01640 1 -- 172.21.15.178:0/272390279 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b4014610 con 0x556ff31ae820 2024-09-21T09:03:19.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.087+0000 7f77bd10c800 1 -- 172.21.15.178:0/272390279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ff31af410 con 0x556ff31ae820 2024-09-21T09:03:19.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.088+0000 7f76a4e01640 1 -- 172.21.15.178:0/272390279 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4014930 con 0x556ff31ae820 2024-09-21T09:03:19.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.088+0000 7f77bd10c800 1 -- 172.21.15.178:0/272390279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ff31b20f0 con 0x556ff31ae820 2024-09-21T09:03:19.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.088+0000 7f76a4e01640 1 -- 172.21.15.178:0/272390279 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f77b4011040 con 0x556ff31ae820 2024-09-21T09:03:19.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.088+0000 7f76a4e01640 1 --2- 172.21.15.178:0/272390279 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7694036b40 0x7f7694039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.089+0000 7f76a4e01640 1 -- 172.21.15.178:0/272390279 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f77b401e070 con 0x556ff31ae820 2024-09-21T09:03:19.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.089+0000 7f77bac00640 1 --2- 172.21.15.178:0/272390279 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7694036b40 0x7f7694039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.089+0000 7f77bd10c800 1 Processor -- start 2024-09-21T09:03:19.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.089+0000 7f77bac00640 1 --2- 172.21.15.178:0/272390279 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7694036b40 0x7f7694039000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x556ff319b4d0 tx=0x7f77ac018510 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.089+0000 7f77bd10c800 1 -- start start 2024-09-21T09:03:19.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.089+0000 7f77bd10c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31bb480 0x556ff31bb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.089+0000 7f77bd10c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556ff318c230 con 0x556ff31bb480 2024-09-21T09:03:19.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.089+0000 7f77bb401640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31bb480 0x556ff31bb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.089+0000 7f77bb401640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31bb480 0x556ff31bb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42892/0 (socket says 172.21.15.178:42892) 2024-09-21T09:03:19.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.089+0000 7f77bb401640 1 -- 172.21.15.178:0/4231695500 learned_addr learned my addr 172.21.15.178:0/4231695500 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.090+0000 7f77bb401640 1 -- 172.21.15.178:0/4231695500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ff31bbe50 con 0x556ff31bb480 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.090+0000 7f77bb401640 1 --2- 172.21.15.178:0/4231695500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31bb480 0x556ff31bb880 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f77b404cb90 tx=0x7f77b4011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fc5b0709899a6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.090+0000 7f769e7fc640 1 -- 172.21.15.178:0/4231695500 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4044070 con 0x556ff31bb480 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.090+0000 7f769e7fc640 1 -- 172.21.15.178:0/4231695500 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b40167c0 con 0x556ff31bb480 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.090+0000 7f769e7fc640 1 -- 172.21.15.178:0/4231695500 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4013ca0 con 0x556ff31bb480 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.090+0000 7f77bd10c800 1 -- 172.21.15.178:0/4231695500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31bb480 msgr2=0x556ff31bb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.090+0000 7f77bd10c800 1 --2- 172.21.15.178:0/4231695500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31bb480 0x556ff31bb880 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f77b404cb90 tx=0x7f77b4011700 comp rx=0 tx=0).stop 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.090+0000 7f77bd10c800 1 -- 172.21.15.178:0/4231695500 shutdown_connections 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.090+0000 7f77bd10c800 1 --2- 172.21.15.178:0/4231695500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31bb480 0x556ff31bb880 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.090+0000 7f77bd10c800 1 -- 172.21.15.178:0/4231695500 >> 172.21.15.178:0/4231695500 conn(0x556ff31b77e0 msgr2=0x556ff31b58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.090+0000 7f77bd10c800 1 -- 172.21.15.178:0/4231695500 shutdown_connections 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.090+0000 7f77bd10c800 1 -- 172.21.15.178:0/4231695500 wait complete. 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.091+0000 7f77bd10c800 1 Processor -- start 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.091+0000 7f77bd10c800 1 -- start start 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.091+0000 7f77bd10c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31bb480 0x556ff31c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.091+0000 7f77bd10c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556ff31bc3d0 con 0x556ff31bb480 2024-09-21T09:03:19.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.091+0000 7f77bb401640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31bb480 0x556ff31c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.091+0000 7f77bb401640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31bb480 0x556ff31c6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42906/0 (socket says 172.21.15.178:42906) 2024-09-21T09:03:19.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.091+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 learned_addr learned my addr 172.21.15.178:0/3573261728 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.091+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ff31c7170 con 0x556ff31bb480 2024-09-21T09:03:19.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.092+0000 7f77bb401640 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31bb480 0x556ff31c6c30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f77b404bab0 tx=0x7f77b404cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.092+0000 7f769cff9640 1 -- 172.21.15.178:0/3573261728 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4016440 con 0x556ff31bb480 2024-09-21T09:03:19.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.092+0000 7f769cff9640 1 -- 172.21.15.178:0/3573261728 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b404e2e0 con 0x556ff31bb480 2024-09-21T09:03:19.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.092+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ff31c7400 con 0x556ff31bb480 2024-09-21T09:03:19.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.092+0000 7f769cff9640 1 -- 172.21.15.178:0/3573261728 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4022a50 con 0x556ff31bb480 2024-09-21T09:03:19.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.092+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ff31ca0b0 con 0x556ff31bb480 2024-09-21T09:03:19.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.092+0000 7f769cff9640 1 -- 172.21.15.178:0/3573261728 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f77b403e020 con 0x556ff31bb480 2024-09-21T09:03:19.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.093+0000 7f769cff9640 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7684036b90 0x7f7684039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.093+0000 7f769cff9640 1 -- 172.21.15.178:0/3573261728 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f77b403c020 con 0x556ff31bb480 2024-09-21T09:03:19.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.093+0000 7f77bac00640 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7684036b90 0x7f7684039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.093+0000 7f77bac00640 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7684036b90 0x7f7684039050 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f77ac04b060 tx=0x7f77ac031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.093+0000 7f77bd10c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.093+0000 7f77bd10c800 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556ff31d2950 0x556ff31d4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.093+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d5560 con 0x556ff31d2950 2024-09-21T09:03:19.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77b3fff640 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556ff31d2950 0x556ff31d4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77b3fff640 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556ff31d2950 0x556ff31d4e10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77bd10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77bd10c800 20 realm 2024-09-21T09:03:19.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77bd10c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d5990 con 0x556ff31d2950 2024-09-21T09:03:19.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77bd10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77bd10c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77bd10c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d6260 con 0x556ff31d2950 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77bd10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.094+0000 7f77bd10c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.095+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d6600 con 0x556ff31d2950 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.095+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.095+0000 7f77bd10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.095+0000 7f77bd10c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.095+0000 7f77bd10c800 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556ff31d7360 0x556ff31d9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.095+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d7360 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.095+0000 7f77bb401640 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556ff31d7360 0x556ff31d9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.095+0000 7f77bb401640 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556ff31d7360 0x556ff31d9750 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.096+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.096+0000 7f77bd10c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:19.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.096+0000 7f77bd10c800 20 searching for the correct realm 2024-09-21T09:03:19.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.096+0000 7f77bd10c800 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556ff31dbcf0 0x556ff31de1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.096+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31de880 con 0x556ff31dbcf0 2024-09-21T09:03:19.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.096+0000 7f77bac00640 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556ff31dbcf0 0x556ff31de1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.096+0000 7f77bac00640 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556ff31dbcf0 0x556ff31de1b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.096+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.096+0000 7f77bac00640 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f77ac017050 0x7f77ac04c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.096+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31de880 con 0x7f77ac017050 2024-09-21T09:03:19.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.096+0000 7f77b3fff640 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f77ac017050 0x7f77ac04c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.097+0000 7f77b3fff640 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f77ac017050 0x7f77ac04c980 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.097+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a4051070 con 0x7f77ac017050 2024-09-21T09:03:19.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.097+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31de880 con 0x556ff31d7360 2024-09-21T09:03:19.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.097+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.097+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d2950 2024-09-21T09:03:19.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.097+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.098+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d2950 2024-09-21T09:03:19.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.098+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.098+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d7360 2024-09-21T09:03:19.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.098+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.098+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d7360 2024-09-21T09:03:19.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.098+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.098+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x7f77ac017050 2024-09-21T09:03:19.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.099+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a4051070 con 0x7f77ac017050 2024-09-21T09:03:19.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.099+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31dbcf0 2024-09-21T09:03:19.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.099+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.099+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d2950 2024-09-21T09:03:19.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.099+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.099+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d7360 2024-09-21T09:03:19.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.099+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.099+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d2950 2024-09-21T09:03:19.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.100+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.100+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x7f77ac017050 2024-09-21T09:03:19.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.100+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f77a4051070 con 0x7f77ac017050 2024-09-21T09:03:19.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.100+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31dbcf0 2024-09-21T09:03:19.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.100+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.100+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31dbcf0 2024-09-21T09:03:19.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.100+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.100+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d7360 2024-09-21T09:03:19.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.101+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.101+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31dbcf0 2024-09-21T09:03:19.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.101+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.101+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31dbcf0 2024-09-21T09:03:19.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.101+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.101+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d2950 2024-09-21T09:03:19.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.102+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.102+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d2950 2024-09-21T09:03:19.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.102+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.102+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d7360 2024-09-21T09:03:19.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.102+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.102+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31dbcf0 2024-09-21T09:03:19.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.102+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.102+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x7f77ac017050 2024-09-21T09:03:19.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.103+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a4051070 con 0x7f77ac017050 2024-09-21T09:03:19.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.103+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d2950 2024-09-21T09:03:19.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.103+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.103+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d7360 2024-09-21T09:03:19.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.103+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.103+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31dbcf0 2024-09-21T09:03:19.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.104+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.104+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d7360 2024-09-21T09:03:19.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.104+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.104+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x7f77ac017050 2024-09-21T09:03:19.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.104+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a4051070 con 0x7f77ac017050 2024-09-21T09:03:19.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.104+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31dbcf0 2024-09-21T09:03:19.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.104+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.104+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d7360 2024-09-21T09:03:19.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.105+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.105+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x556ff31d2950 2024-09-21T09:03:19.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.105+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.105+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ff31d9d60 con 0x7f77ac017050 2024-09-21T09:03:19.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.105+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a4051070 con 0x7f77ac017050 2024-09-21T09:03:19.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.105+0000 7f77bd10c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:19.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.105+0000 7f77bd10c800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:19.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.105+0000 7f77bd10c800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:19.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.105+0000 7f77bd10c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:19.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.105+0000 7f77bd10c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:19.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.105+0000 7f77bd10c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:19.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.105+0000 7f77bd10c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.105+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff31da100 con 0x556ff31d2950 2024-09-21T09:03:19.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff31da4f0 con 0x556ff31d2950 2024-09-21T09:03:19.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:19.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff31da910 con 0x556ff31d2950 2024-09-21T09:03:19.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 20 zone default found 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 4 Realm: () 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 20 zonegroup default 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff31ded00 con 0x556ff31d7360 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.106+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e0ab0 con 0x556ff31dbcf0 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.107+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.107+0000 7f77bd10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.107+0000 7f77bd10c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.107+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e0f80 con 0x556ff31dbcf0 2024-09-21T09:03:19.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.107+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.107+0000 7f77bd10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.107+0000 7f77bd10c800 20 started sync module instance, tier type = 2024-09-21T09:03:19.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.107+0000 7f77bd10c800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:19.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.107+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31dff20 con 0x7f77ac017050 2024-09-21T09:03:19.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.108+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x7f77ac017050 2024-09-21T09:03:19.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.108+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93939308561440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31dff20 con 0x7f77ac017050 2024-09-21T09:03:19.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.108+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e1a00 con 0x556ff31d2950 2024-09-21T09:03:19.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.109+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93939308561440] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x7f77ac017050 2024-09-21T09:03:19.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.110+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.110+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93939308566320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31dff20 con 0x556ff31d2950 2024-09-21T09:03:19.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.110+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e2450 con 0x556ff31dbcf0 2024-09-21T09:03:19.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.111+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.111+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93939308568416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e2cf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.111+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e3790 con 0x7f77ac017050 2024-09-21T09:03:19.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.111+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93939308566320] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.112+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x7f77ac017050 2024-09-21T09:03:19.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.112+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93939308573280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e3b80 con 0x7f77ac017050 2024-09-21T09:03:19.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.112+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e4580 con 0x556ff31d2950 2024-09-21T09:03:19.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.112+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93939308568416] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.113+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.113+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93939308570688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e4540 con 0x556ff31d2950 2024-09-21T09:03:19.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.113+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e4f90 con 0x556ff31d7360 2024-09-21T09:03:19.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.113+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93939308573280] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x7f77ac017050 2024-09-21T09:03:19.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.114+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93939308570688] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.114+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.114+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93939308579552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e4540 con 0x556ff31d7360 2024-09-21T09:03:19.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.114+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e4f40 con 0x556ff31d7360 2024-09-21T09:03:19.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.115+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.115+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93939308580608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e58b0 con 0x556ff31d7360 2024-09-21T09:03:19.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.115+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e63d0 con 0x556ff31d7360 2024-09-21T09:03:19.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.115+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93939308579552] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.116+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.116+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93939308580608] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.116+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93939308584608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e5330 con 0x556ff31d7360 2024-09-21T09:03:19.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.116+0000 7f77bd10c800 20 add_watcher() i=0 2024-09-21T09:03:19.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.116+0000 7f77bd10c800 20 add_watcher() i=1 2024-09-21T09:03:19.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.116+0000 7f77bd10c800 20 add_watcher() i=2 2024-09-21T09:03:19.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.116+0000 7f77bd10c800 20 add_watcher() i=3 2024-09-21T09:03:19.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.116+0000 7f77bd10c800 20 add_watcher() i=4 2024-09-21T09:03:19.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.116+0000 7f77bd10c800 20 add_watcher() i=5 2024-09-21T09:03:19.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.116+0000 7f77bd10c800 20 add_watcher() i=6 2024-09-21T09:03:19.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.117+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93939308584608] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.117+0000 7f77bd10c800 20 add_watcher() i=7 2024-09-21T09:03:19.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.117+0000 7f77bd10c800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:19.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.117+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e93c0 con 0x556ff31d2950 2024-09-21T09:03:19.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.117+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.117+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93939308576912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e6840 con 0x556ff31d2950 2024-09-21T09:03:19.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.118+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93939308576912] v29'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.118+0000 7f76717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.118+0000 7f77bd10c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.118+0000 7f77bd10c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.118+0000 7f77bd10c800 5 note: GC not initialized 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.118+0000 7f75ebfff640 20 reqs_thread_entry: start 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.118+0000 7f77bd10c800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.118+0000 7f77bd10c800 20 Filter name: none 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.119+0000 7f75e9ffb640 20 reqs_thread_entry: start 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.119+0000 7f77bd10c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.119+0000 7f77bd10c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.119+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff321c6a0 con 0x556ff31d2950 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.119+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.119+0000 7f77bd10c800 20 rados_obj.operate() r=0 bl.length=582 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.119+0000 7f77bd10c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.119+0000 7f77bd10c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:19.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.119+0000 7f77bd10c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:19.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.119+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff3222d90 con 0x556ff31d2950 2024-09-21T09:03:19.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.120+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v29'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.120+0000 7f77bd10c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:19.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.120+0000 7f77bd10c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:19.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.120+0000 7f77bd10c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:19.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.120+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93939308832592 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ff321e6a0 con 0x556ff31d2950 2024-09-21T09:03:19.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.120+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify (1) cookie 93939308570688 notify 124554051593 ret 0) ==== 774+0+0 (crc 0 0 0) 0x556ff2f61e00 con 0x556ff31d2950 2024-09-21T09:03:19.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.120+0000 7f769e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051593 cookie 93939308570688 notifier 4413 bl.length()=732 2024-09-21T09:03:19.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.120+0000 7f769e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:19.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.120+0000 7f769e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:19.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.120+0000 7f769e7fc640 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7680003ea0 con 0x556ff31d2950 2024-09-21T09:03:19.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.120+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(64 notify.4 [notify cookie 93939308832592 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.121+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.121+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== watch-notify(notify_complete (2) cookie 93939308832592 notify 124554051593 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f77a4087950 con 0x556ff31d2950 2024-09-21T09:03:19.130 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-21T09:03:18.693766Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:19.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.121+0000 7f76717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:19.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.121+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93939308576912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff321a430 con 0x556ff31d2950 2024-09-21T09:03:19.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.122+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93939308576912] v29'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.123+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93939308561440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff321a430 con 0x7f77ac017050 2024-09-21T09:03:19.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.123+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93939308561440] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x7f77ac017050 2024-09-21T09:03:19.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.124+0000 7f77bd10c800 20 remove_watcher() i=0 2024-09-21T09:03:19.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.124+0000 7f77bd10c800 2 removed watcher, disabling cache 2024-09-21T09:03:19.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.124+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93939308566320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff321a430 con 0x556ff31d2950 2024-09-21T09:03:19.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.125+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93939308566320] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.125+0000 7f77bd10c800 20 remove_watcher() i=1 2024-09-21T09:03:19.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.125+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93939308568416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff321a430 con 0x556ff31dbcf0 2024-09-21T09:03:19.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.126+0000 7f77bac00640 1 -- 172.21.15.178:0/3573261728 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93939308568416] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac02dcf0 con 0x556ff31dbcf0 2024-09-21T09:03:19.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.126+0000 7f77bd10c800 20 remove_watcher() i=2 2024-09-21T09:03:19.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.126+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93939308573280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e1f60 con 0x7f77ac017050 2024-09-21T09:03:19.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.127+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93939308573280] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x7f77ac017050 2024-09-21T09:03:19.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.127+0000 7f77bd10c800 20 remove_watcher() i=3 2024-09-21T09:03:19.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.127+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93939308570688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e3260 con 0x556ff31d2950 2024-09-21T09:03:19.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.128+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93939308570688] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4051070 con 0x556ff31d2950 2024-09-21T09:03:19.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.128+0000 7f77bd10c800 20 remove_watcher() i=4 2024-09-21T09:03:19.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.128+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93939308579552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e2840 con 0x556ff31d7360 2024-09-21T09:03:19.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.129+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93939308579552] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.129+0000 7f77bd10c800 20 remove_watcher() i=5 2024-09-21T09:03:19.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.129+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93939308580608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e4ae0 con 0x556ff31d7360 2024-09-21T09:03:19.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.130+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93939308580608] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.130+0000 7f77bd10c800 20 remove_watcher() i=6 2024-09-21T09:03:19.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.130+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93939308584608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ff31e3260 con 0x556ff31d7360 2024-09-21T09:03:19.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.131+0000 7f77bb401640 1 -- 172.21.15.178:0/3573261728 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93939308584608] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b402a070 con 0x556ff31d7360 2024-09-21T09:03:19.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.131+0000 7f77bd10c800 20 remove_watcher() i=7 2024-09-21T09:03:19.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.131+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556ff31d7360 msgr2=0x556ff31d9750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.131+0000 7f77bd10c800 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556ff31d7360 0x556ff31d9750 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.131+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556ff31d2950 msgr2=0x556ff31d4e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.131+0000 7f77bd10c800 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556ff31d2950 0x556ff31d4e10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.131+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f77ac017050 msgr2=0x7f77ac04c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.131+0000 7f77bd10c800 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f77ac017050 0x7f77ac04c980 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.131+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556ff31dbcf0 msgr2=0x556ff31de1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.131+0000 7f77bd10c800 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556ff31dbcf0 0x556ff31de1b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7684036b90 msgr2=0x7f7684039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7684036b90 0x7f7684039050 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f77ac04b060 tx=0x7f77ac031000 comp rx=0 tx=0).stop 2024-09-21T09:03:19.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31bb480 msgr2=0x556ff31c6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 --2- 172.21.15.178:0/3573261728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31bb480 0x556ff31c6c30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f77b404bab0 tx=0x7f77b404cb20 comp rx=0 tx=0).stop 2024-09-21T09:03:19.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 reap_dead start 2024-09-21T09:03:19.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77b3fff640 1 -- 172.21.15.178:0/3573261728 reap_dead start 2024-09-21T09:03:19.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 shutdown_connections 2024-09-21T09:03:19.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 >> 172.21.15.178:0/3573261728 conn(0x556ff31b77e0 msgr2=0x556ff31b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 shutdown_connections 2024-09-21T09:03:19.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 -- 172.21.15.178:0/3573261728 wait complete. 2024-09-21T09:03:19.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 -- 172.21.15.178:0/272390279 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7694036b40 msgr2=0x7f7694039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 --2- 172.21.15.178:0/272390279 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7694036b40 0x7f7694039000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x556ff319b4d0 tx=0x7f77ac018510 comp rx=0 tx=0).stop 2024-09-21T09:03:19.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 -- 172.21.15.178:0/272390279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31ae820 msgr2=0x556ff31aec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 --2- 172.21.15.178:0/272390279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31ae820 0x556ff31aec40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x556ff319b430 tx=0x7f77b4018830 comp rx=0 tx=0).stop 2024-09-21T09:03:19.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 -- 172.21.15.178:0/272390279 shutdown_connections 2024-09-21T09:03:19.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 --2- 172.21.15.178:0/272390279 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7694036b40 0x7f7694039000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 --2- 172.21.15.178:0/272390279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff31ae820 0x556ff31aec40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 -- 172.21.15.178:0/272390279 >> 172.21.15.178:0/272390279 conn(0x556ff31a37b0 msgr2=0x556ff31a6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 -- 172.21.15.178:0/272390279 shutdown_connections 2024-09-21T09:03:19.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 -- 172.21.15.178:0/272390279 wait complete. 2024-09-21T09:03:19.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556ff319d380 msgr2=0x556ff319f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.132+0000 7f77bd10c800 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556ff319d380 0x556ff319f770 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.133+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556ff3198700 msgr2=0x556ff319aaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.133+0000 7f77bd10c800 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556ff3198700 0x556ff319aaf0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.133+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f76a0036b40 msgr2=0x7f76a0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.133+0000 7f77bd10c800 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f76a0036b40 0x7f76a0039000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f77a4057000 tx=0x7f77a4052000 comp rx=0 tx=0).stop 2024-09-21T09:03:19.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.133+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff30a0db0 msgr2=0x556ff31936a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.133+0000 7f77bd10c800 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff30a0db0 0x556ff31936a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00b7c0 tx=0x7f77ac000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.133+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 shutdown_connections 2024-09-21T09:03:19.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.133+0000 7f77bd10c800 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556ff319d380 0x556ff319f770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.133+0000 7f77bd10c800 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556ff3198700 0x556ff319aaf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.133+0000 7f77bd10c800 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f76a0036b40 0x7f76a0039000 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.133+0000 7f77bd10c800 1 --2- 172.21.15.178:0/2057640830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ff30a0db0 0x556ff31936a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.133+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 >> 172.21.15.178:0/2057640830 conn(0x556ff3094de0 msgr2=0x556ff3185cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.133+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 shutdown_connections 2024-09-21T09:03:19.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.133+0000 7f77bd10c800 1 -- 172.21.15.178:0/2057640830 wait complete. 2024-09-21T09:03:19.143 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-21T09:03:18.693766Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:19.143 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-21T09:03:19.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-21T09:03:19.143 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-21T09:03:19.190 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:19.191 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:19.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.189+0000 7f79e3811800 1 Processor -- start 2024-09-21T09:03:19.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.190+0000 7f79e3811800 1 -- start start 2024-09-21T09:03:19.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.190+0000 7f79e3811800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5632fe3fedd0 0x5632fe4011c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.190+0000 7f79e3811800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5632fe2b7b30 con 0x5632fe36c610 2024-09-21T09:03:19.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.190+0000 7f79e3811800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5632fe299360 con 0x5632fe3fedd0 2024-09-21T09:03:19.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.190+0000 7f79de83a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5632fe3fedd0 0x5632fe4011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.190+0000 7f79df03b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5632fe36c610 0x5632fe3fd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46704/0 (socket says 172.21.15.178:46704) 2024-09-21T09:03:19.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.190+0000 7f79df03b640 1 -- 172.21.15.178:0/3841723077 learned_addr learned my addr 172.21.15.178:0/3841723077 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:19.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.190+0000 7f79de039640 1 -- 172.21.15.178:0/3841723077 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3707382307 0 0) 0x5632fe2b7b30 con 0x5632fe36c610 2024-09-21T09:03:19.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.190+0000 7f79de039640 1 -- 172.21.15.178:0/3841723077 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79c8001e10 con 0x5632fe36c610 2024-09-21T09:03:19.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.190+0000 7f79de83a640 1 -- 172.21.15.178:0/3841723077 >> v1:172.21.15.44:6789/0 conn(0x5632fe36c610 legacy=0x5632fe3fd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.190+0000 7f79de83a640 1 -- 172.21.15.178:0/3841723077 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632fe2bfe00 con 0x5632fe3fedd0 2024-09-21T09:03:19.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.192+0000 7f79de83a640 1 --2- 172.21.15.178:0/3841723077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe3fedd0 0x5632fe4011c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f79d400a470 tx=0x7f79d4045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f682aa581ef4146e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.192+0000 7f79de039640 1 -- 172.21.15.178:0/3841723077 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d4059070 con 0x5632fe3fedd0 2024-09-21T09:03:19.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.192+0000 7f79de039640 1 -- 172.21.15.178:0/3841723077 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d4054570 con 0x5632fe3fedd0 2024-09-21T09:03:19.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.192+0000 7f79de039640 1 -- 172.21.15.178:0/3841723077 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d4054870 con 0x5632fe3fedd0 2024-09-21T09:03:19.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.193+0000 7f79e3811800 1 -- 172.21.15.178:0/3841723077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe3fedd0 msgr2=0x5632fe4011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.193+0000 7f79e3811800 1 --2- 172.21.15.178:0/3841723077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe3fedd0 0x5632fe4011c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f79d400a470 tx=0x7f79d4045920 comp rx=0 tx=0).stop 2024-09-21T09:03:19.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.193+0000 7f79e3811800 1 -- 172.21.15.178:0/3841723077 shutdown_connections 2024-09-21T09:03:19.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.193+0000 7f79e3811800 1 --2- 172.21.15.178:0/3841723077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe3fedd0 0x5632fe4011c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.193+0000 7f79e3811800 1 -- 172.21.15.178:0/3841723077 >> 172.21.15.178:0/3841723077 conn(0x5632fe3f2e00 msgr2=0x5632fe3f5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.193+0000 7f79e3811800 1 -- 172.21.15.178:0/3841723077 shutdown_connections 2024-09-21T09:03:19.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.193+0000 7f79e3811800 1 -- 172.21.15.178:0/3841723077 wait complete. 2024-09-21T09:03:19.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.207+0000 7f79e3811800 1 Processor -- start 2024-09-21T09:03:19.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.207+0000 7f79e3811800 1 -- start start 2024-09-21T09:03:19.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.207+0000 7f79e3811800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe36c610 0x5632fe4e98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.207+0000 7f79e3811800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5632fe344350 con 0x5632fe36c610 2024-09-21T09:03:19.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.208+0000 7f79df03b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe36c610 0x5632fe4e98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.208+0000 7f79df03b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe36c610 0x5632fe4e98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42922/0 (socket says 172.21.15.178:42922) 2024-09-21T09:03:19.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.208+0000 7f79df03b640 1 -- 172.21.15.178:0/673054840 learned_addr learned my addr 172.21.15.178:0/673054840 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.208+0000 7f79df03b640 1 -- 172.21.15.178:0/673054840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632fe291bc0 con 0x5632fe36c610 2024-09-21T09:03:19.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.208+0000 7f79df03b640 1 --2- 172.21.15.178:0/673054840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe36c610 0x5632fe4e98d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f79d0001e30 tx=0x7f79d000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f0c62ad503c34a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.208+0000 7f78cd60a640 1 -- 172.21.15.178:0/673054840 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d0012020 con 0x5632fe36c610 2024-09-21T09:03:19.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.208+0000 7f78cd60a640 1 -- 172.21.15.178:0/673054840 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d000e5a0 con 0x5632fe36c610 2024-09-21T09:03:19.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.208+0000 7f78cd60a640 1 -- 172.21.15.178:0/673054840 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d000e8e0 con 0x5632fe36c610 2024-09-21T09:03:19.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.209+0000 7f79e3811800 1 -- 172.21.15.178:0/673054840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe36c610 msgr2=0x5632fe4e98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.209+0000 7f79e3811800 1 --2- 172.21.15.178:0/673054840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe36c610 0x5632fe4e98d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f79d0001e30 tx=0x7f79d000b780 comp rx=0 tx=0).stop 2024-09-21T09:03:19.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.209+0000 7f79e3811800 1 -- 172.21.15.178:0/673054840 shutdown_connections 2024-09-21T09:03:19.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.209+0000 7f79e3811800 1 --2- 172.21.15.178:0/673054840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe36c610 0x5632fe4e98d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.209+0000 7f79e3811800 1 -- 172.21.15.178:0/673054840 >> 172.21.15.178:0/673054840 conn(0x5632fe3f2e00 msgr2=0x5632fe4e5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.209+0000 7f79e3811800 1 -- 172.21.15.178:0/673054840 shutdown_connections 2024-09-21T09:03:19.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.209+0000 7f79e3811800 1 -- 172.21.15.178:0/673054840 wait complete. 2024-09-21T09:03:19.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.209+0000 7f79e3811800 1 Processor -- start 2024-09-21T09:03:19.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.209+0000 7f79e3811800 1 -- start start 2024-09-21T09:03:19.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.209+0000 7f79e3811800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe36c610 0x5632fe4f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.209+0000 7f79e3811800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5632fe4019a0 con 0x5632fe36c610 2024-09-21T09:03:19.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.210+0000 7f79df03b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe36c610 0x5632fe4f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.210+0000 7f79df03b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe36c610 0x5632fe4f12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42930/0 (socket says 172.21.15.178:42930) 2024-09-21T09:03:19.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.210+0000 7f79df03b640 1 -- 172.21.15.178:0/1734555800 learned_addr learned my addr 172.21.15.178:0/1734555800 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.210+0000 7f79df03b640 1 -- 172.21.15.178:0/1734555800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632fe2a5fe0 con 0x5632fe36c610 2024-09-21T09:03:19.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.210+0000 7f79df03b640 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe36c610 0x5632fe4f12e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f79d0001e30 tx=0x7f79d0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.210+0000 7f78cbe07640 1 -- 172.21.15.178:0/1734555800 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d0012030 con 0x5632fe36c610 2024-09-21T09:03:19.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.210+0000 7f78cbe07640 1 -- 172.21.15.178:0/1734555800 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d0001490 con 0x5632fe36c610 2024-09-21T09:03:19.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.210+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632fe4f1820 con 0x5632fe36c610 2024-09-21T09:03:19.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.210+0000 7f78cbe07640 1 -- 172.21.15.178:0/1734555800 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d001a8f0 con 0x5632fe36c610 2024-09-21T09:03:19.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.210+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632fe4f1d40 con 0x5632fe36c610 2024-09-21T09:03:19.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.211+0000 7f78cbe07640 1 -- 172.21.15.178:0/1734555800 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f79d0015020 con 0x5632fe36c610 2024-09-21T09:03:19.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.211+0000 7f78cbe07640 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78c4036b90 0x7f78c4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.211+0000 7f78cbe07640 1 -- 172.21.15.178:0/1734555800 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f79d0020030 con 0x5632fe36c610 2024-09-21T09:03:19.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.211+0000 7f79de83a640 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78c4036b90 0x7f78c4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.211+0000 7f79e3811800 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632fe3fedd0 0x5632fe4f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.211+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe4f8890 con 0x5632fe3fedd0 2024-09-21T09:03:19.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.211+0000 7f79df83c640 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632fe3fedd0 0x5632fe4f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.212+0000 7f79de83a640 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78c4036b90 0x7f78c4039050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x5632fe36bd50 tx=0x7f79d4050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.212+0000 7f79df83c640 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632fe3fedd0 0x5632fe4f8350 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.212+0000 7f79df83c640 1 -- 172.21.15.178:0/1734555800 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79d800a4a0 con 0x5632fe3fedd0 2024-09-21T09:03:19.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.212+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe4f5870 con 0x5632fe3fedd0 2024-09-21T09:03:19.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.212+0000 7f79df83c640 1 -- 172.21.15.178:0/1734555800 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f79d800a4a0 con 0x5632fe3fedd0 2024-09-21T09:03:19.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.212+0000 7f79e3811800 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632fe4fa9c0 0x5632fe4fce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.212+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe4fd610 con 0x5632fe4fa9c0 2024-09-21T09:03:19.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.213+0000 7f79df03b640 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632fe4fa9c0 0x5632fe4fce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.213+0000 7f79df03b640 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632fe4fa9c0 0x5632fe4fce80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.213+0000 7f79df03b640 1 -- 172.21.15.178:0/1734555800 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe4fa9c0 2024-09-21T09:03:19.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.213+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe4f9170 con 0x5632fe3fedd0 2024-09-21T09:03:19.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.214+0000 7f79df83c640 1 -- 172.21.15.178:0/1734555800 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f79d800a4a0 con 0x5632fe3fedd0 2024-09-21T09:03:19.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.214+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe4f9590 con 0x5632fe3fedd0 2024-09-21T09:03:19.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.214+0000 7f79df83c640 1 -- 172.21.15.178:0/1734555800 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f79d800a4a0 con 0x5632fe3fedd0 2024-09-21T09:03:19.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.214+0000 7f79e3811800 1 Processor -- start 2024-09-21T09:03:19.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.214+0000 7f79e3811800 1 -- start start 2024-09-21T09:03:19.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.214+0000 7f79e3811800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe50bf60 0x5632fe50c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.214+0000 7f79e3811800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5632fe293580 con 0x5632fe50bf60 2024-09-21T09:03:19.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.214+0000 7f79df83c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe50bf60 0x5632fe50c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.215+0000 7f79df83c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe50bf60 0x5632fe50c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42944/0 (socket says 172.21.15.178:42944) 2024-09-21T09:03:19.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.215+0000 7f79df83c640 1 -- 172.21.15.178:0/3367706183 learned_addr learned my addr 172.21.15.178:0/3367706183 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.215+0000 7f79df83c640 1 -- 172.21.15.178:0/3367706183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632fe50c8c0 con 0x5632fe50bf60 2024-09-21T09:03:19.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.215+0000 7f79df83c640 1 --2- 172.21.15.178:0/3367706183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe50bf60 0x5632fe50c380 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5632fe4f8c90 tx=0x7f79d8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.215+0000 7f78c9602640 1 -- 172.21.15.178:0/3367706183 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d8014450 con 0x5632fe50bf60 2024-09-21T09:03:19.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.215+0000 7f78c9602640 1 -- 172.21.15.178:0/3367706183 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d8014610 con 0x5632fe50bf60 2024-09-21T09:03:19.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.215+0000 7f78c9602640 1 -- 172.21.15.178:0/3367706183 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d8014930 con 0x5632fe50bf60 2024-09-21T09:03:19.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.215+0000 7f79e3811800 1 -- 172.21.15.178:0/3367706183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632fe50cb50 con 0x5632fe50bf60 2024-09-21T09:03:19.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.215+0000 7f79e3811800 1 -- 172.21.15.178:0/3367706183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632fe50f830 con 0x5632fe50bf60 2024-09-21T09:03:19.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.216+0000 7f78c9602640 1 -- 172.21.15.178:0/3367706183 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f79d8011040 con 0x5632fe50bf60 2024-09-21T09:03:19.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.216+0000 7f78c9602640 1 --2- 172.21.15.178:0/3367706183 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78b8036b40 0x7f78b8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.216+0000 7f78c9602640 1 -- 172.21.15.178:0/3367706183 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f79d801e070 con 0x5632fe50bf60 2024-09-21T09:03:19.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.216+0000 7f79df03b640 1 --2- 172.21.15.178:0/3367706183 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78b8036b40 0x7f78b8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.216+0000 7f79e3811800 1 Processor -- start 2024-09-21T09:03:19.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.216+0000 7f79df03b640 1 --2- 172.21.15.178:0/3367706183 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78b8036b40 0x7f78b8039000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f79d001af20 tx=0x7f79d0041040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.216+0000 7f79e3811800 1 -- start start 2024-09-21T09:03:19.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.217+0000 7f79e3811800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe518b80 0x5632fe518f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.217+0000 7f79e3811800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5632fe4ea080 con 0x5632fe518b80 2024-09-21T09:03:19.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.217+0000 7f79df83c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe518b80 0x5632fe518f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.217+0000 7f79df83c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe518b80 0x5632fe518f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42952/0 (socket says 172.21.15.178:42952) 2024-09-21T09:03:19.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.217+0000 7f79df83c640 1 -- 172.21.15.178:0/899963054 learned_addr learned my addr 172.21.15.178:0/899963054 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.217+0000 7f79df83c640 1 -- 172.21.15.178:0/899963054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632fe519550 con 0x5632fe518b80 2024-09-21T09:03:19.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.217+0000 7f79df83c640 1 --2- 172.21.15.178:0/899963054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe518b80 0x5632fe518f80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f79d804cbe0 tx=0x7f79d8011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420f2f21dd830e8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.217+0000 7f78c2ffd640 1 -- 172.21.15.178:0/899963054 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d8028040 con 0x5632fe518b80 2024-09-21T09:03:19.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.218+0000 7f78c2ffd640 1 -- 172.21.15.178:0/899963054 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d8022d90 con 0x5632fe518b80 2024-09-21T09:03:19.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.218+0000 7f78c2ffd640 1 -- 172.21.15.178:0/899963054 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d8016ab0 con 0x5632fe518b80 2024-09-21T09:03:19.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.218+0000 7f79e3811800 1 -- 172.21.15.178:0/899963054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe518b80 msgr2=0x5632fe518f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.218+0000 7f79e3811800 1 --2- 172.21.15.178:0/899963054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe518b80 0x5632fe518f80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f79d804cbe0 tx=0x7f79d8011a80 comp rx=0 tx=0).stop 2024-09-21T09:03:19.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.218+0000 7f79e3811800 1 -- 172.21.15.178:0/899963054 shutdown_connections 2024-09-21T09:03:19.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.218+0000 7f79e3811800 1 --2- 172.21.15.178:0/899963054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe518b80 0x5632fe518f80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.218+0000 7f79e3811800 1 -- 172.21.15.178:0/899963054 >> 172.21.15.178:0/899963054 conn(0x5632fe514f70 msgr2=0x5632fe513070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.218+0000 7f79e3811800 1 -- 172.21.15.178:0/899963054 shutdown_connections 2024-09-21T09:03:19.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.218+0000 7f79e3811800 1 -- 172.21.15.178:0/899963054 wait complete. 2024-09-21T09:03:19.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.218+0000 7f79e3811800 1 Processor -- start 2024-09-21T09:03:19.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.218+0000 7f79e3811800 1 -- start start 2024-09-21T09:03:19.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.218+0000 7f79e3811800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe518b80 0x5632fe520070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.218+0000 7f79e3811800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5632fe519b90 con 0x5632fe518b80 2024-09-21T09:03:19.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.219+0000 7f79df83c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe518b80 0x5632fe520070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.219+0000 7f79df83c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe518b80 0x5632fe520070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42966/0 (socket says 172.21.15.178:42966) 2024-09-21T09:03:19.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.219+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 learned_addr learned my addr 172.21.15.178:0/4015977909 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.219+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632fe5205b0 con 0x5632fe518b80 2024-09-21T09:03:19.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.219+0000 7f79df83c640 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe518b80 0x5632fe520070 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f79d804cbe0 tx=0x7f79d804cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.219+0000 7f78c17fa640 1 -- 172.21.15.178:0/4015977909 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d8028040 con 0x5632fe518b80 2024-09-21T09:03:19.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.219+0000 7f78c17fa640 1 -- 172.21.15.178:0/4015977909 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d804b040 con 0x5632fe518b80 2024-09-21T09:03:19.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.219+0000 7f78c17fa640 1 -- 172.21.15.178:0/4015977909 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d80133b0 con 0x5632fe518b80 2024-09-21T09:03:19.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.219+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632fe520840 con 0x5632fe518b80 2024-09-21T09:03:19.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.220+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632fe5234f0 con 0x5632fe518b80 2024-09-21T09:03:19.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.220+0000 7f78c17fa640 1 -- 172.21.15.178:0/4015977909 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f79d8013550 con 0x5632fe518b80 2024-09-21T09:03:19.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.220+0000 7f78c17fa640 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78a8036b90 0x7f78a8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.220+0000 7f78c17fa640 1 -- 172.21.15.178:0/4015977909 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f79d800e040 con 0x5632fe518b80 2024-09-21T09:03:19.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.221+0000 7f79df03b640 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78a8036b90 0x7f78a8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.221+0000 7f79df03b640 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78a8036b90 0x7f78a8039050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x5632fe4f9d10 tx=0x7f79d0033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.221+0000 7f79e3811800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.221+0000 7f79e3811800 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632fe52bd00 0x5632fe52e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.221+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe52e910 con 0x5632fe52bd00 2024-09-21T09:03:19.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.221+0000 7f79de83a640 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632fe52bd00 0x5632fe52e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79de83a640 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632fe52bd00 0x5632fe52e1c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79e3811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79e3811800 20 realm 2024-09-21T09:03:19.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79e3811800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe52ed40 con 0x5632fe52bd00 2024-09-21T09:03:19.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79e3811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79e3811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:19.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79e3811800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe52f610 con 0x5632fe52bd00 2024-09-21T09:03:19.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79e3811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79e3811800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe52f9b0 con 0x5632fe52bd00 2024-09-21T09:03:19.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.222+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.223+0000 7f79e3811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:19.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.223+0000 7f79e3811800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.223+0000 7f79e3811800 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632fe530710 0x5632fe532b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.223+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe533150 con 0x5632fe530710 2024-09-21T09:03:19.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.223+0000 7f79df83c640 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632fe530710 0x5632fe532b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.223+0000 7f79df83c640 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632fe530710 0x5632fe532b00 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.223+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.223+0000 7f79e3811800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:19.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.223+0000 7f79e3811800 20 searching for the correct realm 2024-09-21T09:03:19.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.223+0000 7f79e3811800 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5632fe535100 0x5632fe5375c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.223+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe535100 2024-09-21T09:03:19.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.223+0000 7f79df03b640 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5632fe535100 0x5632fe5375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.224+0000 7f79df03b640 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5632fe535100 0x5632fe5375c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.224+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe535100 2024-09-21T09:03:19.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.224+0000 7f79df03b640 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f79d003a040 0x7f79d004c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.224+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x7f79d003a040 2024-09-21T09:03:19.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.224+0000 7f79de83a640 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f79d003a040 0x7f79d004c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.224+0000 7f79de83a640 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f79d003a040 0x7f79d004c290 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.225+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.225+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe530710 2024-09-21T09:03:19.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.225+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.225+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe52bd00 2024-09-21T09:03:19.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.225+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.225+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe52bd00 2024-09-21T09:03:19.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.225+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.225+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe530710 2024-09-21T09:03:19.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.226+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.226+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe530710 2024-09-21T09:03:19.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.226+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.226+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x7f79d003a040 2024-09-21T09:03:19.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.226+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.226+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe535100 2024-09-21T09:03:19.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.226+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe535100 2024-09-21T09:03:19.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.226+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe52bd00 2024-09-21T09:03:19.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.227+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.227+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe530710 2024-09-21T09:03:19.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.227+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.227+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe52bd00 2024-09-21T09:03:19.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.227+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.227+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x7f79d003a040 2024-09-21T09:03:19.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.227+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.227+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe535100 2024-09-21T09:03:19.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.227+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe535100 2024-09-21T09:03:19.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.227+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe535100 2024-09-21T09:03:19.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.228+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe535100 2024-09-21T09:03:19.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.228+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe530710 2024-09-21T09:03:19.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.228+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.228+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe535100 2024-09-21T09:03:19.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.228+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe535100 2024-09-21T09:03:19.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.228+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe535100 2024-09-21T09:03:19.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.228+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe535100 2024-09-21T09:03:19.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.228+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe52bd00 2024-09-21T09:03:19.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.229+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.229+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe52bd00 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.229+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.229+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe530710 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.229+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.229+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe535100 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.229+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe535100 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.229+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x7f79d003a040 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.230+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.230+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe52bd00 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.230+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.230+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe530710 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.230+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.230+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe535100 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.230+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe535100 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.230+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe530710 2024-09-21T09:03:19.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.231+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.231+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x7f79d003a040 2024-09-21T09:03:19.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.231+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.231+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe535100 2024-09-21T09:03:19.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.231+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe535100 2024-09-21T09:03:19.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.231+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe530710 2024-09-21T09:03:19.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.231+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.231+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x5632fe52bd00 2024-09-21T09:03:19.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632fe537c90 con 0x7f79d003a040 2024-09-21T09:03:19.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79e3811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:19.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79e3811800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:19.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79e3811800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:19.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79e3811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:19.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79e3811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:19.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79e3811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:19.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79e3811800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe533b10 con 0x5632fe52bd00 2024-09-21T09:03:19.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79e3811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79e3811800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe533750 con 0x5632fe52bd00 2024-09-21T09:03:19.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79e3811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:19.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79e3811800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.232+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe534430 con 0x5632fe52bd00 2024-09-21T09:03:19.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 20 zone default found 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 4 Realm: () 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 20 zonegroup default 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe538110 con 0x5632fe530710 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe539ef0 con 0x5632fe535100 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe535100 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53a380 con 0x5632fe535100 2024-09-21T09:03:19.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe535100 2024-09-21T09:03:19.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 20 started sync module instance, tier type = 2024-09-21T09:03:19.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:19.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.233+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe539330 con 0x7f79d003a040 2024-09-21T09:03:19.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.234+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.235+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94777015244848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe539330 con 0x7f79d003a040 2024-09-21T09:03:19.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.235+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53ae40 con 0x5632fe52bd00 2024-09-21T09:03:19.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.235+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94777015244848] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.236+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.236+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94777015249232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe539330 con 0x5632fe52bd00 2024-09-21T09:03:19.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.236+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53b8d0 con 0x5632fe535100 2024-09-21T09:03:19.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.237+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94777015249232] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.237+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe535100 2024-09-21T09:03:19.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.237+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94777015242368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe5392a0 con 0x5632fe535100 2024-09-21T09:03:19.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.237+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53c790 con 0x7f79d003a040 2024-09-21T09:03:19.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.238+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.238+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94777015256256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53d030 con 0x7f79d003a040 2024-09-21T09:03:19.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.238+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53dae0 con 0x5632fe52bd00 2024-09-21T09:03:19.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.238+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94777015242368] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe535100 2024-09-21T09:03:19.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.239+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.239+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94777015254208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53daa0 con 0x5632fe52bd00 2024-09-21T09:03:19.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.239+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53e4f0 con 0x5632fe530710 2024-09-21T09:03:19.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.239+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94777015256256] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.240+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94777015254208] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.240+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.240+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94777015257936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53daa0 con 0x5632fe530710 2024-09-21T09:03:19.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.240+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53ed90 con 0x5632fe530710 2024-09-21T09:03:19.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.241+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94777015257936] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.241+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.241+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94777015261136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53ed90 con 0x5632fe530710 2024-09-21T09:03:19.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.241+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53f790 con 0x5632fe530710 2024-09-21T09:03:19.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.242+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.242+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94777015268000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53fbb0 con 0x5632fe530710 2024-09-21T09:03:19.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.242+0000 7f79e3811800 20 add_watcher() i=0 2024-09-21T09:03:19.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.242+0000 7f79e3811800 20 add_watcher() i=1 2024-09-21T09:03:19.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.242+0000 7f79e3811800 20 add_watcher() i=2 2024-09-21T09:03:19.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.242+0000 7f79e3811800 20 add_watcher() i=3 2024-09-21T09:03:19.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.242+0000 7f79e3811800 20 add_watcher() i=4 2024-09-21T09:03:19.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.242+0000 7f79e3811800 20 add_watcher() i=5 2024-09-21T09:03:19.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.242+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94777015261136] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.242+0000 7f79e3811800 20 add_watcher() i=6 2024-09-21T09:03:19.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.243+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94777015268000] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.243+0000 7f79e3811800 20 add_watcher() i=7 2024-09-21T09:03:19.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.243+0000 7f79e3811800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:19.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.243+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53e8e0 con 0x5632fe52bd00 2024-09-21T09:03:19.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.243+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.243+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94777015269056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53e8e0 con 0x5632fe52bd00 2024-09-21T09:03:19.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.244+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94777015269056] v29'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.244+0000 7f7895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:19.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.244+0000 7f79e3811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:19.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.244+0000 7f79e3811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:19.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.245+0000 7f79e3811800 5 note: GC not initialized 2024-09-21T09:03:19.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.245+0000 7f7894fe1640 20 reqs_thread_entry: start 2024-09-21T09:03:19.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.245+0000 7f79e3811800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:19.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.245+0000 7f79e3811800 20 Filter name: none 2024-09-21T09:03:19.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.245+0000 7f780e7fc640 20 reqs_thread_entry: start 2024-09-21T09:03:19.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.245+0000 7f79e3811800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:19.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.245+0000 7f79e3811800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.245+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe576100 con 0x5632fe52bd00 2024-09-21T09:03:19.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.246+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.246+0000 7f79e3811800 20 rados_obj.operate() r=0 bl.length=556 2024-09-21T09:03:19.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.246+0000 7f79e3811800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:19.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.246+0000 7f79e3811800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:19.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.246+0000 7f79e3811800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:19.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.246+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe57c810 con 0x5632fe52bd00 2024-09-21T09:03:19.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.247+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v29'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.247+0000 7f79e3811800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:19.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.247+0000 7f79e3811800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:19.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.247+0000 7f79e3811800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:19.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.247+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94777015517712 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe577f10 con 0x5632fe52bd00 2024-09-21T09:03:19.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.247+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify (1) cookie 94777015254208 notify 124554051594 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f79d4075040 con 0x5632fe52bd00 2024-09-21T09:03:19.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.247+0000 7f78c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051594 cookie 94777015254208 notifier 4420 bl.length()=567 2024-09-21T09:03:19.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.247+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(64 notify.4 [notify cookie 94777015517712 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.247+0000 7f78c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:19.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.247+0000 7f78c2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:19.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.247+0000 7f78c2ffd640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f78a4003ea0 con 0x5632fe52bd00 2024-09-21T09:03:19.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.247+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.247+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== watch-notify(notify_complete (2) cookie 94777015517712 notify 124554051594 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f79d4068040 con 0x5632fe52bd00 2024-09-21T09:03:19.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.247+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe57c210 con 0x7f79d003a040 2024-09-21T09:03:19.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.248+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(66 foo:foo2 [delete] v29'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.248+0000 7f79e3811800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-21T09:03:19.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.248+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94777015517712 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632fe577a60 con 0x7f79d003a040 2024-09-21T09:03:19.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.249+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== watch-notify(notify (1) cookie 94777015244848 notify 124554051589 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f79d4068040 con 0x7f79d003a040 2024-09-21T09:03:19.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.249+0000 7f78c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051589 cookie 94777015244848 notifier 4420 bl.length()=159 2024-09-21T09:03:19.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.249+0000 7f78c2ffd640 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f78a4003ea0 con 0x7f79d003a040 2024-09-21T09:03:19.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.249+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(67 notify.0 [notify cookie 94777015517712 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.249+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.249+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== watch-notify(notify_complete (2) cookie 94777015517712 notify 124554051589 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632fe2bfe00 con 0x7f79d003a040 2024-09-21T09:03:19.259 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:19.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.250+0000 7f7895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:19.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.250+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94777015269056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe573e50 con 0x5632fe52bd00 2024-09-21T09:03:19.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.251+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94777015269056] v29'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.251+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94777015244848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe573e50 con 0x7f79d003a040 2024-09-21T09:03:19.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.252+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94777015244848] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.252+0000 7f79e3811800 20 remove_watcher() i=0 2024-09-21T09:03:19.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.252+0000 7f79e3811800 2 removed watcher, disabling cache 2024-09-21T09:03:19.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.252+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94777015249232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe573e50 con 0x5632fe52bd00 2024-09-21T09:03:19.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.253+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94777015249232] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.253+0000 7f79e3811800 20 remove_watcher() i=1 2024-09-21T09:03:19.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.253+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94777015242368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe573e50 con 0x5632fe535100 2024-09-21T09:03:19.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.254+0000 7f79df03b640 1 -- 172.21.15.178:0/4015977909 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94777015242368] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d001ac70 con 0x5632fe535100 2024-09-21T09:03:19.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.254+0000 7f79e3811800 20 remove_watcher() i=2 2024-09-21T09:03:19.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.254+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94777015256256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe539830 con 0x7f79d003a040 2024-09-21T09:03:19.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.255+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94777015256256] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x7f79d003a040 2024-09-21T09:03:19.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.255+0000 7f79e3811800 20 remove_watcher() i=3 2024-09-21T09:03:19.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.255+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94777015254208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53a950 con 0x5632fe52bd00 2024-09-21T09:03:19.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.256+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94777015254208] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d405c040 con 0x5632fe52bd00 2024-09-21T09:03:19.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.256+0000 7f79e3811800 20 remove_watcher() i=4 2024-09-21T09:03:19.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.256+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94777015257936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe538e80 con 0x5632fe530710 2024-09-21T09:03:19.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.257+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94777015257936] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.257+0000 7f79e3811800 20 remove_watcher() i=5 2024-09-21T09:03:19.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.257+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94777015261136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe539830 con 0x5632fe530710 2024-09-21T09:03:19.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.258+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94777015261136] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.258+0000 7f79e3811800 20 remove_watcher() i=6 2024-09-21T09:03:19.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.258+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94777015268000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632fe53a950 con 0x5632fe530710 2024-09-21T09:03:19.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79df83c640 1 -- 172.21.15.178:0/4015977909 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94777015268000] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d803d020 con 0x5632fe530710 2024-09-21T09:03:19.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 20 remove_watcher() i=7 2024-09-21T09:03:19.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632fe530710 msgr2=0x5632fe532b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632fe530710 0x5632fe532b00 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632fe52bd00 msgr2=0x5632fe52e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632fe52bd00 0x5632fe52e1c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f79d003a040 msgr2=0x7f79d004c290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f79d003a040 0x7f79d004c290 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5632fe535100 msgr2=0x5632fe5375c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5632fe535100 0x5632fe5375c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78a8036b90 msgr2=0x7f78a8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78a8036b90 0x7f78a8039050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x5632fe4f9d10 tx=0x7f79d0033000 comp rx=0 tx=0).stop 2024-09-21T09:03:19.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe518b80 msgr2=0x5632fe520070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79de83a640 1 -- 172.21.15.178:0/4015977909 reap_dead start 2024-09-21T09:03:19.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe518b80 0x5632fe520070 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f79d804cbe0 tx=0x7f79d804cb70 comp rx=0 tx=0).stop 2024-09-21T09:03:19.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 shutdown_connections 2024-09-21T09:03:19.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 --2- 172.21.15.178:0/4015977909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe518b80 0x5632fe520070 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 >> 172.21.15.178:0/4015977909 conn(0x5632fe514f70 msgr2=0x5632fe513040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 shutdown_connections 2024-09-21T09:03:19.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.259+0000 7f79e3811800 1 -- 172.21.15.178:0/4015977909 wait complete. 2024-09-21T09:03:19.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 -- 172.21.15.178:0/3367706183 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78b8036b40 msgr2=0x7f78b8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 --2- 172.21.15.178:0/3367706183 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78b8036b40 0x7f78b8039000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f79d001af20 tx=0x7f79d0041040 comp rx=0 tx=0).stop 2024-09-21T09:03:19.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 -- 172.21.15.178:0/3367706183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe50bf60 msgr2=0x5632fe50c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 --2- 172.21.15.178:0/3367706183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe50bf60 0x5632fe50c380 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5632fe4f8c90 tx=0x7f79d8018830 comp rx=0 tx=0).stop 2024-09-21T09:03:19.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 -- 172.21.15.178:0/3367706183 shutdown_connections 2024-09-21T09:03:19.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 --2- 172.21.15.178:0/3367706183 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78b8036b40 0x7f78b8039000 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 --2- 172.21.15.178:0/3367706183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe50bf60 0x5632fe50c380 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 -- 172.21.15.178:0/3367706183 >> 172.21.15.178:0/3367706183 conn(0x5632fe500ef0 msgr2=0x5632fe503a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 -- 172.21.15.178:0/3367706183 shutdown_connections 2024-09-21T09:03:19.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 -- 172.21.15.178:0/3367706183 wait complete. 2024-09-21T09:03:19.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632fe4fa9c0 msgr2=0x5632fe4fce80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632fe4fa9c0 0x5632fe4fce80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632fe3fedd0 msgr2=0x5632fe4f8350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632fe3fedd0 0x5632fe4f8350 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78c4036b90 msgr2=0x7f78c4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78c4036b90 0x7f78c4039050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x5632fe36bd50 tx=0x7f79d4050000 comp rx=0 tx=0).stop 2024-09-21T09:03:19.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe36c610 msgr2=0x5632fe4f12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe36c610 0x5632fe4f12e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f79d0001e30 tx=0x7f79d0000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 shutdown_connections 2024-09-21T09:03:19.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632fe4fa9c0 0x5632fe4fce80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632fe3fedd0 0x5632fe4f8350 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f78c4036b90 0x7f78c4039050 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 --2- 172.21.15.178:0/1734555800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632fe36c610 0x5632fe4f12e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 >> 172.21.15.178:0/1734555800 conn(0x5632fe3f2e00 msgr2=0x5632fe4e3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 shutdown_connections 2024-09-21T09:03:19.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.260+0000 7f79e3811800 1 -- 172.21.15.178:0/1734555800 wait complete. 2024-09-21T09:03:19.271 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:19.271 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-21T09:03:19.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-21T09:03:19.271 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-21T09:03:19.315 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:19.315 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:19.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.314+0000 7f6c11298800 1 Processor -- start 2024-09-21T09:03:19.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.314+0000 7f6c11298800 1 -- start start 2024-09-21T09:03:19.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.314+0000 7f6c11298800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x558181ecc5b0 0x558181f5b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.314+0000 7f6c11298800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558181e17b30 con 0x558181f5b810 2024-09-21T09:03:19.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.314+0000 7f6c11298800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x558181df9360 con 0x558181ecc5b0 2024-09-21T09:03:19.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.315+0000 7f6c0ed8c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x558181ecc5b0 0x558181f5b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.315+0000 7f6c0e58b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x558181f5b810 0x558181f5dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46712/0 (socket says 172.21.15.178:46712) 2024-09-21T09:03:19.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.315+0000 7f6c0e58b640 1 -- 172.21.15.178:0/3397719674 learned_addr learned my addr 172.21.15.178:0/3397719674 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:19.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.315+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/3397719674 >> v1:172.21.15.44:6789/0 conn(0x558181f5b810 legacy=0x558181f5dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.315+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/3397719674 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558181e1fe00 con 0x558181ecc5b0 2024-09-21T09:03:19.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.317+0000 7f6c0ed8c640 1 --2- 172.21.15.178:0/3397719674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x558181f5b2d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6c08005fd0 tx=0x7f6c08045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801bde7dcaead7ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.317+0000 7f6c0dd8a640 1 -- 172.21.15.178:0/3397719674 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c08058530 con 0x558181ecc5b0 2024-09-21T09:03:19.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.317+0000 7f6c0dd8a640 1 -- 172.21.15.178:0/3397719674 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c080586d0 con 0x558181ecc5b0 2024-09-21T09:03:19.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.317+0000 7f6c0dd8a640 1 -- 172.21.15.178:0/3397719674 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c080589d0 con 0x558181ecc5b0 2024-09-21T09:03:19.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.317+0000 7f6c11298800 1 -- 172.21.15.178:0/3397719674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 msgr2=0x558181f5b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.317+0000 7f6c11298800 1 --2- 172.21.15.178:0/3397719674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x558181f5b2d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6c08005fd0 tx=0x7f6c08045c30 comp rx=0 tx=0).stop 2024-09-21T09:03:19.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.317+0000 7f6c11298800 1 -- 172.21.15.178:0/3397719674 shutdown_connections 2024-09-21T09:03:19.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.317+0000 7f6c11298800 1 --2- 172.21.15.178:0/3397719674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x558181f5b2d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.317+0000 7f6c11298800 1 -- 172.21.15.178:0/3397719674 >> 172.21.15.178:0/3397719674 conn(0x558181f52de0 msgr2=0x558181f55200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.318+0000 7f6c11298800 1 -- 172.21.15.178:0/3397719674 shutdown_connections 2024-09-21T09:03:19.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.318+0000 7f6c11298800 1 -- 172.21.15.178:0/3397719674 wait complete. 2024-09-21T09:03:19.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.331+0000 7f6c11298800 1 Processor -- start 2024-09-21T09:03:19.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.331+0000 7f6c11298800 1 -- start start 2024-09-21T09:03:19.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.331+0000 7f6c11298800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x5581820478d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.331+0000 7f6c11298800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558181ea4330 con 0x558181ecc5b0 2024-09-21T09:03:19.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.332+0000 7f6c0ed8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x5581820478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.332+0000 7f6c0ed8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x5581820478d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42988/0 (socket says 172.21.15.178:42988) 2024-09-21T09:03:19.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.332+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/4249337517 learned_addr learned my addr 172.21.15.178:0/4249337517 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.332+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/4249337517 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558181df1bc0 con 0x558181ecc5b0 2024-09-21T09:03:19.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.332+0000 7f6c0ed8c640 1 --2- 172.21.15.178:0/4249337517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x5581820478d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800a3f0 tx=0x7f6c08051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4052a3b861abc3c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.332+0000 7f6afce09640 1 -- 172.21.15.178:0/4249337517 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c080589b0 con 0x558181ecc5b0 2024-09-21T09:03:19.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.332+0000 7f6afce09640 1 -- 172.21.15.178:0/4249337517 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c08068070 con 0x558181ecc5b0 2024-09-21T09:03:19.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.332+0000 7f6afce09640 1 -- 172.21.15.178:0/4249337517 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c08058c80 con 0x558181ecc5b0 2024-09-21T09:03:19.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.333+0000 7f6c11298800 1 -- 172.21.15.178:0/4249337517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 msgr2=0x5581820478d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.333+0000 7f6c11298800 1 --2- 172.21.15.178:0/4249337517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x5581820478d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800a3f0 tx=0x7f6c08051000 comp rx=0 tx=0).stop 2024-09-21T09:03:19.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.333+0000 7f6c11298800 1 -- 172.21.15.178:0/4249337517 shutdown_connections 2024-09-21T09:03:19.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.333+0000 7f6c11298800 1 --2- 172.21.15.178:0/4249337517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x5581820478d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.333+0000 7f6c11298800 1 -- 172.21.15.178:0/4249337517 >> 172.21.15.178:0/4249337517 conn(0x558181f52de0 msgr2=0x558182043290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.333+0000 7f6c11298800 1 -- 172.21.15.178:0/4249337517 shutdown_connections 2024-09-21T09:03:19.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.333+0000 7f6c11298800 1 -- 172.21.15.178:0/4249337517 wait complete. 2024-09-21T09:03:19.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.333+0000 7f6c11298800 1 Processor -- start 2024-09-21T09:03:19.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.334+0000 7f6c11298800 1 -- start start 2024-09-21T09:03:19.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.334+0000 7f6c11298800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x558181f58c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.334+0000 7f6c11298800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558181f5f6b0 con 0x558181ecc5b0 2024-09-21T09:03:19.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.334+0000 7f6c0ed8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x558181f58c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.334+0000 7f6c0ed8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x558181f58c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42998/0 (socket says 172.21.15.178:42998) 2024-09-21T09:03:19.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.334+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/674626951 learned_addr learned my addr 172.21.15.178:0/674626951 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.334+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/674626951 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558181e05fe0 con 0x558181ecc5b0 2024-09-21T09:03:19.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.335+0000 7f6c0ed8c640 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x558181f58c00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6c08065040 tx=0x7f6c08003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.335+0000 7f6afb606640 1 -- 172.21.15.178:0/674626951 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c08063650 con 0x558181ecc5b0 2024-09-21T09:03:19.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.335+0000 7f6afb606640 1 -- 172.21.15.178:0/674626951 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c080637f0 con 0x558181ecc5b0 2024-09-21T09:03:19.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.335+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558181f572f0 con 0x558181ecc5b0 2024-09-21T09:03:19.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.335+0000 7f6afb606640 1 -- 172.21.15.178:0/674626951 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c08063af0 con 0x558181ecc5b0 2024-09-21T09:03:19.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.335+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558181f57810 con 0x558181ecc5b0 2024-09-21T09:03:19.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.336+0000 7f6afb606640 1 -- 172.21.15.178:0/674626951 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6c08074020 con 0x558181ecc5b0 2024-09-21T09:03:19.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.336+0000 7f6afb606640 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6af4036b90 0x7f6af4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.336+0000 7f6afb606640 1 -- 172.21.15.178:0/674626951 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6c080907d0 con 0x558181ecc5b0 2024-09-21T09:03:19.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.336+0000 7f6c0e58b640 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6af4036b90 0x7f6af4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.336+0000 7f6c11298800 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558181f5b810 0x5581820585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.336+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558182058b20 con 0x558181f5b810 2024-09-21T09:03:19.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.336+0000 7f6c0f58d640 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558181f5b810 0x5581820585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.336+0000 7f6c0e58b640 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6af4036b90 0x7f6af4039050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8000f60 tx=0x7f6bf80012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.336+0000 7f6c0f58d640 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558181f5b810 0x5581820585e0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.337+0000 7f6c0f58d640 1 -- 172.21.15.178:0/674626951 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c000083e0 con 0x558181f5b810 2024-09-21T09:03:19.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.337+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558182059370 con 0x558181f5b810 2024-09-21T09:03:19.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.337+0000 7f6c0f58d640 1 -- 172.21.15.178:0/674626951 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c000083e0 con 0x558181f5b810 2024-09-21T09:03:19.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.337+0000 7f6c11298800 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55818205ac80 0x55818205d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.337+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55818205d8d0 con 0x55818205ac80 2024-09-21T09:03:19.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.337+0000 7f6c0ed8c640 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55818205ac80 0x55818205d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.337+0000 7f6c0ed8c640 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55818205ac80 0x55818205d140 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.338+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/674626951 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c0806c450 con 0x55818205ac80 2024-09-21T09:03:19.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.338+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558182059bc0 con 0x558181f5b810 2024-09-21T09:03:19.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.338+0000 7f6c0f58d640 1 -- 172.21.15.178:0/674626951 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c000083e0 con 0x558181f5b810 2024-09-21T09:03:19.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.338+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558182059f60 con 0x558181f5b810 2024-09-21T09:03:19.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.338+0000 7f6c0f58d640 1 -- 172.21.15.178:0/674626951 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6c000083e0 con 0x558181f5b810 2024-09-21T09:03:19.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.339+0000 7f6c11298800 1 Processor -- start 2024-09-21T09:03:19.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.339+0000 7f6c11298800 1 -- start start 2024-09-21T09:03:19.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.339+0000 7f6c11298800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55818206c290 0x55818206c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.339+0000 7f6c11298800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558181f59140 con 0x55818206c290 2024-09-21T09:03:19.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.339+0000 7f6c0f58d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55818206c290 0x55818206c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.339+0000 7f6c0f58d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55818206c290 0x55818206c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43000/0 (socket says 172.21.15.178:43000) 2024-09-21T09:03:19.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.339+0000 7f6c0f58d640 1 -- 172.21.15.178:0/3380874551 learned_addr learned my addr 172.21.15.178:0/3380874551 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.339+0000 7f6c0f58d640 1 -- 172.21.15.178:0/3380874551 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55818206cbf0 con 0x55818206c290 2024-09-21T09:03:19.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.340+0000 7f6c0f58d640 1 --2- 172.21.15.178:0/3380874551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55818206c290 0x55818206c6b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x558181f585f0 tx=0x7f6c0000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.340+0000 7f6af8e01640 1 -- 172.21.15.178:0/3380874551 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c00007d00 con 0x55818206c290 2024-09-21T09:03:19.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.340+0000 7f6af8e01640 1 -- 172.21.15.178:0/3380874551 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0001e020 con 0x55818206c290 2024-09-21T09:03:19.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.340+0000 7f6c11298800 1 -- 172.21.15.178:0/3380874551 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55818206ce80 con 0x55818206c290 2024-09-21T09:03:19.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.340+0000 7f6af8e01640 1 -- 172.21.15.178:0/3380874551 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c00019420 con 0x55818206c290 2024-09-21T09:03:19.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.340+0000 7f6c11298800 1 -- 172.21.15.178:0/3380874551 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55818206fb60 con 0x55818206c290 2024-09-21T09:03:19.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.341+0000 7f6af8e01640 1 -- 172.21.15.178:0/3380874551 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6c00016040 con 0x55818206c290 2024-09-21T09:03:19.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.341+0000 7f6af8e01640 1 --2- 172.21.15.178:0/3380874551 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ae8036b90 0x7f6ae8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.341+0000 7f6af8e01640 1 -- 172.21.15.178:0/3380874551 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6c0001f030 con 0x55818206c290 2024-09-21T09:03:19.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.341+0000 7f6c0ed8c640 1 --2- 172.21.15.178:0/3380874551 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ae8036b90 0x7f6ae8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.341+0000 7f6c11298800 1 Processor -- start 2024-09-21T09:03:19.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.341+0000 7f6c0ed8c640 1 --2- 172.21.15.178:0/3380874551 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ae8036b90 0x7f6ae8039050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x558181f57cc0 tx=0x7f6c0806bef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.341+0000 7f6c11298800 1 -- start start 2024-09-21T09:03:19.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.341+0000 7f6c11298800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558182078ec0 0x5581820792c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.341+0000 7f6c11298800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558181df3580 con 0x558182078ec0 2024-09-21T09:03:19.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.342+0000 7f6c0f58d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558182078ec0 0x5581820792c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.342+0000 7f6c0f58d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558182078ec0 0x5581820792c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43002/0 (socket says 172.21.15.178:43002) 2024-09-21T09:03:19.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.342+0000 7f6c0f58d640 1 -- 172.21.15.178:0/3678507223 learned_addr learned my addr 172.21.15.178:0/3678507223 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.342+0000 7f6c0f58d640 1 -- 172.21.15.178:0/3678507223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558182079890 con 0x558182078ec0 2024-09-21T09:03:19.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.342+0000 7f6c0f58d640 1 --2- 172.21.15.178:0/3678507223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558182078ec0 0x5581820792c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6c0004ce80 tx=0x7f6c00017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ea500c68b34842 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.342+0000 7f6af27fc640 1 -- 172.21.15.178:0/3678507223 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c0001d030 con 0x558182078ec0 2024-09-21T09:03:19.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.342+0000 7f6af27fc640 1 -- 172.21.15.178:0/3678507223 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c00023540 con 0x558182078ec0 2024-09-21T09:03:19.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.342+0000 7f6af27fc640 1 -- 172.21.15.178:0/3678507223 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c0003be60 con 0x558182078ec0 2024-09-21T09:03:19.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.342+0000 7f6c11298800 1 -- 172.21.15.178:0/3678507223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558182078ec0 msgr2=0x5581820792c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.342+0000 7f6c11298800 1 --2- 172.21.15.178:0/3678507223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558182078ec0 0x5581820792c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6c0004ce80 tx=0x7f6c00017fa0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.342+0000 7f6c11298800 1 -- 172.21.15.178:0/3678507223 shutdown_connections 2024-09-21T09:03:19.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.342+0000 7f6c11298800 1 --2- 172.21.15.178:0/3678507223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558182078ec0 0x5581820792c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.342+0000 7f6c11298800 1 -- 172.21.15.178:0/3678507223 >> 172.21.15.178:0/3678507223 conn(0x5581820752b0 msgr2=0x5581820733b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.343+0000 7f6c11298800 1 -- 172.21.15.178:0/3678507223 shutdown_connections 2024-09-21T09:03:19.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.343+0000 7f6c11298800 1 -- 172.21.15.178:0/3678507223 wait complete. 2024-09-21T09:03:19.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.343+0000 7f6c11298800 1 Processor -- start 2024-09-21T09:03:19.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.343+0000 7f6c11298800 1 -- start start 2024-09-21T09:03:19.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.343+0000 7f6c11298800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558182078ec0 0x558182080260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.343+0000 7f6c11298800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558182079d50 con 0x558182078ec0 2024-09-21T09:03:19.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.343+0000 7f6c0f58d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558182078ec0 0x558182080260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.343+0000 7f6c0f58d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558182078ec0 0x558182080260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43008/0 (socket says 172.21.15.178:43008) 2024-09-21T09:03:19.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.343+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 learned_addr learned my addr 172.21.15.178:0/782560395 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.344+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581820807a0 con 0x558182078ec0 2024-09-21T09:03:19.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.344+0000 7f6c0f58d640 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558182078ec0 0x558182080260 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6c00022a30 tx=0x7f6c0004cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.344+0000 7f6af0ff9640 1 -- 172.21.15.178:0/782560395 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c00015770 con 0x558182078ec0 2024-09-21T09:03:19.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.344+0000 7f6af0ff9640 1 -- 172.21.15.178:0/782560395 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c00015910 con 0x558182078ec0 2024-09-21T09:03:19.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.344+0000 7f6af0ff9640 1 -- 172.21.15.178:0/782560395 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c0004e300 con 0x558182078ec0 2024-09-21T09:03:19.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.344+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558182080a30 con 0x558182078ec0 2024-09-21T09:03:19.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.344+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581820836e0 con 0x558182078ec0 2024-09-21T09:03:19.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.345+0000 7f6af0ff9640 1 -- 172.21.15.178:0/782560395 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6c0004e4a0 con 0x558182078ec0 2024-09-21T09:03:19.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.345+0000 7f6af0ff9640 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ad8036b90 0x7f6ad8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.345+0000 7f6af0ff9640 1 -- 172.21.15.178:0/782560395 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6c00038af0 con 0x558182078ec0 2024-09-21T09:03:19.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.345+0000 7f6c0ed8c640 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ad8036b90 0x7f6ad8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.345+0000 7f6c11298800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.345+0000 7f6c11298800 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55818208bc80 0x55818208e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.345+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55818208e890 con 0x55818208bc80 2024-09-21T09:03:19.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.345+0000 7f6c0e58b640 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55818208bc80 0x55818208e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.345+0000 7f6c0ed8c640 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ad8036b90 0x7f6ad8039050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6c0806bf60 tx=0x7f6c08093000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c0e58b640 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55818208bc80 0x55818208e140 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bf8009050 con 0x55818208bc80 2024-09-21T09:03:19.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c11298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c11298800 20 realm 2024-09-21T09:03:19.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c11298800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55818208b0d0 con 0x55818208bc80 2024-09-21T09:03:19.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bf8009050 con 0x55818208bc80 2024-09-21T09:03:19.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c11298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c11298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:19.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c11298800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55818208f370 con 0x55818208bc80 2024-09-21T09:03:19.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bf8009050 con 0x55818208bc80 2024-09-21T09:03:19.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c11298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c11298800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.346+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55818208fc40 con 0x55818208bc80 2024-09-21T09:03:19.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.347+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6bf8009050 con 0x55818208bc80 2024-09-21T09:03:19.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.347+0000 7f6c11298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:19.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.347+0000 7f6c11298800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.347+0000 7f6c11298800 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5581820904f0 0x5581820928e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.347+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558182093020 con 0x5581820904f0 2024-09-21T09:03:19.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.347+0000 7f6c0f58d640 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5581820904f0 0x5581820928e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.347+0000 7f6c0f58d640 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5581820904f0 0x5581820928e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.347+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.347+0000 7f6c11298800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:19.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.347+0000 7f6c11298800 20 searching for the correct realm 2024-09-21T09:03:19.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.348+0000 7f6c11298800 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5581820950d0 0x558182097590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.348+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820950d0 2024-09-21T09:03:19.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.348+0000 7f6c0ed8c640 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5581820950d0 0x558182097590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.348+0000 7f6c0ed8c640 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5581820950d0 0x558182097590 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.348+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0806c450 con 0x5581820950d0 2024-09-21T09:03:19.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.348+0000 7f6c0ed8c640 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6c0807e3a0 0x7f6c08087690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.348+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x7f6c0807e3a0 2024-09-21T09:03:19.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.348+0000 7f6c0e58b640 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6c0807e3a0 0x7f6c08087690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.349+0000 7f6c0e58b640 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6c0807e3a0 0x7f6c08087690 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.349+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf8009050 con 0x7f6c0807e3a0 2024-09-21T09:03:19.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.349+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820904f0 2024-09-21T09:03:19.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.349+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.349+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x55818208bc80 2024-09-21T09:03:19.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.349+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf8009050 con 0x55818208bc80 2024-09-21T09:03:19.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.349+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x55818208bc80 2024-09-21T09:03:19.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.349+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf8029040 con 0x55818208bc80 2024-09-21T09:03:19.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.349+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820904f0 2024-09-21T09:03:19.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.350+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.350+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820904f0 2024-09-21T09:03:19.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.350+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.350+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x7f6c0807e3a0 2024-09-21T09:03:19.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.350+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf8029040 con 0x7f6c0807e3a0 2024-09-21T09:03:19.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.350+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820950d0 2024-09-21T09:03:19.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.350+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0806c450 con 0x5581820950d0 2024-09-21T09:03:19.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.350+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x55818208bc80 2024-09-21T09:03:19.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.351+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf8029040 con 0x55818208bc80 2024-09-21T09:03:19.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.351+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820904f0 2024-09-21T09:03:19.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.351+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.351+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x55818208bc80 2024-09-21T09:03:19.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.351+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf8029040 con 0x55818208bc80 2024-09-21T09:03:19.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.351+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x7f6c0807e3a0 2024-09-21T09:03:19.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.351+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6bf8029040 con 0x7f6c0807e3a0 2024-09-21T09:03:19.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.351+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820950d0 2024-09-21T09:03:19.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.351+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0806c450 con 0x5581820950d0 2024-09-21T09:03:19.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.352+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820950d0 2024-09-21T09:03:19.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.352+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0806c450 con 0x5581820950d0 2024-09-21T09:03:19.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.352+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820904f0 2024-09-21T09:03:19.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.352+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.352+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820950d0 2024-09-21T09:03:19.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.352+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0806c450 con 0x5581820950d0 2024-09-21T09:03:19.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.352+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820950d0 2024-09-21T09:03:19.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.353+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0806c450 con 0x5581820950d0 2024-09-21T09:03:19.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.353+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x55818208bc80 2024-09-21T09:03:19.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.353+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6bf8029040 con 0x55818208bc80 2024-09-21T09:03:19.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.353+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x55818208bc80 2024-09-21T09:03:19.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.353+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6bf8029040 con 0x55818208bc80 2024-09-21T09:03:19.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.353+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820904f0 2024-09-21T09:03:19.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.353+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.353+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820950d0 2024-09-21T09:03:19.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.354+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0806c450 con 0x5581820950d0 2024-09-21T09:03:19.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.354+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x7f6c0807e3a0 2024-09-21T09:03:19.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.354+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf8029040 con 0x7f6c0807e3a0 2024-09-21T09:03:19.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.354+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x55818208bc80 2024-09-21T09:03:19.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.354+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf8029040 con 0x55818208bc80 2024-09-21T09:03:19.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.354+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820904f0 2024-09-21T09:03:19.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.354+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.354+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820950d0 2024-09-21T09:03:19.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.355+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0806c450 con 0x5581820950d0 2024-09-21T09:03:19.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.355+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820904f0 2024-09-21T09:03:19.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.355+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.355+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x7f6c0807e3a0 2024-09-21T09:03:19.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.355+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf8029040 con 0x7f6c0807e3a0 2024-09-21T09:03:19.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.355+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820950d0 2024-09-21T09:03:19.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.355+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0806c450 con 0x5581820950d0 2024-09-21T09:03:19.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.355+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x5581820904f0 2024-09-21T09:03:19.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x55818208bc80 2024-09-21T09:03:19.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6bf8029040 con 0x55818208bc80 2024-09-21T09:03:19.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558182097c60 con 0x7f6c0807e3a0 2024-09-21T09:03:19.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf8029040 con 0x7f6c0807e3a0 2024-09-21T09:03:19.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c11298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:19.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c11298800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:19.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c11298800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:19.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c11298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:19.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c11298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:19.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c11298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:19.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c11298800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558182093ad0 con 0x55818208bc80 2024-09-21T09:03:19.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bf8029040 con 0x55818208bc80 2024-09-21T09:03:19.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c11298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c11298800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558182093f20 con 0x55818208bc80 2024-09-21T09:03:19.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.356+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6bf8029040 con 0x55818208bc80 2024-09-21T09:03:19.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:19.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558182094400 con 0x55818208bc80 2024-09-21T09:03:19.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6bf803d040 con 0x55818208bc80 2024-09-21T09:03:19.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:19.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 20 zone default found 2024-09-21T09:03:19.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 4 Realm: () 2024-09-21T09:03:19.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:19.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:19.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:19.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 20 zonegroup default 2024-09-21T09:03:19.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581820980e0 con 0x5581820904f0 2024-09-21T09:03:19.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55818209a310 con 0x5581820950d0 2024-09-21T09:03:19.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c0806c450 con 0x5581820950d0 2024-09-21T09:03:19.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.357+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55818209a6b0 con 0x5581820950d0 2024-09-21T09:03:19.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.358+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c0806c450 con 0x5581820950d0 2024-09-21T09:03:19.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.358+0000 7f6c11298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.358+0000 7f6c11298800 20 started sync module instance, tier type = 2024-09-21T09:03:19.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.358+0000 7f6c11298800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:19.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.358+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558182099750 con 0x7f6c0807e3a0 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.359+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x7f6c0807e3a0 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.359+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94014720809792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558182099750 con 0x7f6c0807e3a0 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.359+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209af60 con 0x55818208bc80 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.360+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94014720809792] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x7f6c0807e3a0 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.360+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x55818208bc80 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.360+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94014720813648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558182099750 con 0x55818208bc80 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.360+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209b9e0 con 0x5581820950d0 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.361+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94014720813648] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x55818208bc80 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.361+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c0806c450 con 0x5581820950d0 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.361+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94014720807584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581820996c0 con 0x5581820950d0 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.361+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209c8d0 con 0x7f6c0807e3a0 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.362+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94014720807584] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c0806c450 con 0x5581820950d0 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.362+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x7f6c0807e3a0 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.362+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94014720820256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209ccf0 con 0x7f6c0807e3a0 2024-09-21T09:03:19.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.362+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209d6b0 con 0x55818208bc80 2024-09-21T09:03:19.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.363+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x55818208bc80 2024-09-21T09:03:19.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.363+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94014720823808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209dad0 con 0x55818208bc80 2024-09-21T09:03:19.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.363+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209e590 con 0x5581820904f0 2024-09-21T09:03:19.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.363+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94014720820256] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x7f6c0807e3a0 2024-09-21T09:03:19.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.364+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.364+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94014720827584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209e590 con 0x5581820904f0 2024-09-21T09:03:19.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.364+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209efd0 con 0x5581820904f0 2024-09-21T09:03:19.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.364+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94014720823808] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x55818208bc80 2024-09-21T09:03:19.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.365+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.365+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94014720824864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209efd0 con 0x5581820904f0 2024-09-21T09:03:19.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.365+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209fa40 con 0x5581820904f0 2024-09-21T09:03:19.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.365+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94014720827584] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.366+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.366+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94014720824864] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.366+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94014720832784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209fa00 con 0x5581820904f0 2024-09-21T09:03:19.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.366+0000 7f6c11298800 20 add_watcher() i=0 2024-09-21T09:03:19.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.366+0000 7f6c11298800 20 add_watcher() i=1 2024-09-21T09:03:19.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.366+0000 7f6c11298800 20 add_watcher() i=2 2024-09-21T09:03:19.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.366+0000 7f6c11298800 20 add_watcher() i=3 2024-09-21T09:03:19.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.366+0000 7f6c11298800 20 add_watcher() i=4 2024-09-21T09:03:19.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.366+0000 7f6c11298800 20 add_watcher() i=5 2024-09-21T09:03:19.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.366+0000 7f6c11298800 20 add_watcher() i=6 2024-09-21T09:03:19.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.367+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94014720832784] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.367+0000 7f6c11298800 20 add_watcher() i=7 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.367+0000 7f6c11298800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.367+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581820a2a30 con 0x55818208bc80 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.367+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6bf803d040 con 0x55818208bc80 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.368+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94014720821312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209feb0 con 0x55818208bc80 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.368+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94014720821312] v29'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x55818208bc80 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.369+0000 7f6ac57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.369+0000 7f6c11298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.369+0000 7f6c11298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.369+0000 7f6c11298800 5 note: GC not initialized 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.369+0000 7f6a3ffff640 20 reqs_thread_entry: start 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.369+0000 7f6c11298800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.369+0000 7f6c11298800 20 Filter name: none 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.369+0000 7f6a3dffb640 20 reqs_thread_entry: start 2024-09-21T09:03:19.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.369+0000 7f6c11298800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.369+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581820d5860 con 0x55818208bc80 2024-09-21T09:03:19.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.370+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6bf803d040 con 0x55818208bc80 2024-09-21T09:03:19.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.370+0000 7f6c11298800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:19.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.370+0000 7f6c11298800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.370+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581820d6250 con 0x55818208bc80 2024-09-21T09:03:19.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.370+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6bf803d040 con 0x55818208bc80 2024-09-21T09:03:19.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.370+0000 7f6c11298800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:19.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.370+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5581820d7260 con 0x7f6c0807e3a0 2024-09-21T09:03:19.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.370+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x7f6c0807e3a0 2024-09-21T09:03:19.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.371+0000 7f6ac57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:19.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.371+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94014720821312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581820d3610 con 0x55818208bc80 2024-09-21T09:03:19.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.372+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94014720821312] v29'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x55818208bc80 2024-09-21T09:03:19.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.372+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94014720809792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581820d3610 con 0x7f6c0807e3a0 2024-09-21T09:03:19.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.373+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94014720809792] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x7f6c0807e3a0 2024-09-21T09:03:19.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.373+0000 7f6c11298800 20 remove_watcher() i=0 2024-09-21T09:03:19.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.373+0000 7f6c11298800 2 removed watcher, disabling cache 2024-09-21T09:03:19.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.373+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94014720813648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581820d3610 con 0x55818208bc80 2024-09-21T09:03:19.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.374+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94014720813648] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x55818208bc80 2024-09-21T09:03:19.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.374+0000 7f6c11298800 20 remove_watcher() i=1 2024-09-21T09:03:19.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.374+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94014720807584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5581820d3610 con 0x5581820950d0 2024-09-21T09:03:19.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.375+0000 7f6c0ed8c640 1 -- 172.21.15.178:0/782560395 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94014720807584] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c0806c450 con 0x5581820950d0 2024-09-21T09:03:19.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.375+0000 7f6c11298800 20 remove_watcher() i=2 2024-09-21T09:03:19.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.375+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94014720820256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558182099b40 con 0x7f6c0807e3a0 2024-09-21T09:03:19.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.376+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94014720820256] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x7f6c0807e3a0 2024-09-21T09:03:19.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.376+0000 7f6c11298800 20 remove_watcher() i=3 2024-09-21T09:03:19.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.376+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94014720823808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209aa50 con 0x55818208bc80 2024-09-21T09:03:19.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.377+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94014720823808] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf803d040 con 0x55818208bc80 2024-09-21T09:03:19.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.377+0000 7f6c11298800 20 remove_watcher() i=4 2024-09-21T09:03:19.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.377+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94014720827584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558182099b40 con 0x5581820904f0 2024-09-21T09:03:19.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.378+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94014720827584] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.378+0000 7f6c11298800 20 remove_watcher() i=5 2024-09-21T09:03:19.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.378+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94014720824864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209d200 con 0x5581820904f0 2024-09-21T09:03:19.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.379+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94014720824864] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.379+0000 7f6c11298800 20 remove_watcher() i=6 2024-09-21T09:03:19.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.379+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94014720832784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55818209aa50 con 0x5581820904f0 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c0f58d640 1 -- 172.21.15.178:0/782560395 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94014720832784] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c0004e070 con 0x5581820904f0 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 20 remove_watcher() i=7 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5581820904f0 msgr2=0x5581820928e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5581820904f0 0x5581820928e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55818208bc80 msgr2=0x55818208e140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55818208bc80 0x55818208e140 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6c0807e3a0 msgr2=0x7f6c08087690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6c0807e3a0 0x7f6c08087690 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5581820950d0 msgr2=0x558182097590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5581820950d0 0x558182097590 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ad8036b90 msgr2=0x7f6ad8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ad8036b90 0x7f6ad8039050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6c0806bf60 tx=0x7f6c08093000 comp rx=0 tx=0).stop 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558182078ec0 msgr2=0x558182080260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c0e58b640 1 -- 172.21.15.178:0/782560395 reap_dead start 2024-09-21T09:03:19.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558182078ec0 0x558182080260 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6c00022a30 tx=0x7f6c0004cde0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 shutdown_connections 2024-09-21T09:03:19.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 --2- 172.21.15.178:0/782560395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558182078ec0 0x558182080260 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 >> 172.21.15.178:0/782560395 conn(0x5581820752b0 msgr2=0x558182073380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 shutdown_connections 2024-09-21T09:03:19.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.380+0000 7f6c11298800 1 -- 172.21.15.178:0/782560395 wait complete. 2024-09-21T09:03:19.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 -- 172.21.15.178:0/3380874551 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ae8036b90 msgr2=0x7f6ae8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 --2- 172.21.15.178:0/3380874551 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ae8036b90 0x7f6ae8039050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x558181f57cc0 tx=0x7f6c0806bef0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 -- 172.21.15.178:0/3380874551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55818206c290 msgr2=0x55818206c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 --2- 172.21.15.178:0/3380874551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55818206c290 0x55818206c6b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x558181f585f0 tx=0x7f6c0000aec0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 -- 172.21.15.178:0/3380874551 shutdown_connections 2024-09-21T09:03:19.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 --2- 172.21.15.178:0/3380874551 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ae8036b90 0x7f6ae8039050 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 --2- 172.21.15.178:0/3380874551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55818206c290 0x55818206c6b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 -- 172.21.15.178:0/3380874551 >> 172.21.15.178:0/3380874551 conn(0x558182061220 msgr2=0x558182063da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 -- 172.21.15.178:0/3380874551 shutdown_connections 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 -- 172.21.15.178:0/3380874551 wait complete. 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55818205ac80 msgr2=0x55818205d140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55818205ac80 0x55818205d140 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558181f5b810 msgr2=0x5581820585e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558181f5b810 0x5581820585e0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6af4036b90 msgr2=0x7f6af4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6af4036b90 0x7f6af4039050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8000f60 tx=0x7f6bf80012b0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 msgr2=0x558181f58c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x558181f58c00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6c08065040 tx=0x7f6c08003330 comp rx=0 tx=0).stop 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 shutdown_connections 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55818205ac80 0x55818205d140 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558181f5b810 0x5581820585e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6af4036b90 0x7f6af4039050 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 --2- 172.21.15.178:0/674626951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558181ecc5b0 0x558181f58c00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 >> 172.21.15.178:0/674626951 conn(0x558181f52de0 msgr2=0x558182041b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 shutdown_connections 2024-09-21T09:03:19.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.381+0000 7f6c11298800 1 -- 172.21.15.178:0/674626951 wait complete. 2024-09-21T09:03:19.392 INFO:teuthology.orchestra.run.smithi178.stdout:[] 2024-09-21T09:03:19.392 DEBUG:tasks.util.rgw: json result: [] 2024-09-21T09:03:19.392 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-21T09:03:19.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-21T09:03:19.392 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-21T09:03:19.476 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:19.476 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:19.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.475+0000 7fe210030800 1 Processor -- start 2024-09-21T09:03:19.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.475+0000 7fe210030800 1 -- start start 2024-09-21T09:03:19.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.475+0000 7fe210030800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55a46a60a900 0x55a46a60ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.475+0000 7fe210030800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a46a4c6b30 con 0x55a46a6064c0 2024-09-21T09:03:19.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.475+0000 7fe210030800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55a46a4a8360 con 0x55a46a60a900 2024-09-21T09:03:19.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.476+0000 7fe202bd5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55a46a60a900 0x55a46a60ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.476+0000 7fe20b3d6640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55a46a6064c0 0x55a46a6068c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46722/0 (socket says 172.21.15.178:46722) 2024-09-21T09:03:19.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.476+0000 7fe20b3d6640 1 -- 172.21.15.178:0/2128585186 learned_addr learned my addr 172.21.15.178:0/2128585186 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:19.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.476+0000 7fe202bd5640 1 -- 172.21.15.178:0/2128585186 >> v1:172.21.15.44:6789/0 conn(0x55a46a6064c0 legacy=0x55a46a6068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.476+0000 7fe202bd5640 1 -- 172.21.15.178:0/2128585186 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a46a4cee00 con 0x55a46a60a900 2024-09-21T09:03:19.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.478+0000 7fe202bd5640 1 --2- 172.21.15.178:0/2128585186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a60a900 0x55a46a60ccf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400a470 tx=0x7fe1f4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300de2f9ff2a3edb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.478+0000 7fe20abd5640 1 -- 172.21.15.178:0/2128585186 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1f4053570 con 0x55a46a60a900 2024-09-21T09:03:19.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.478+0000 7fe20abd5640 1 -- 172.21.15.178:0/2128585186 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f4058070 con 0x55a46a60a900 2024-09-21T09:03:19.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.478+0000 7fe20abd5640 1 -- 172.21.15.178:0/2128585186 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1f4053880 con 0x55a46a60a900 2024-09-21T09:03:19.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.478+0000 7fe210030800 1 -- 172.21.15.178:0/2128585186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a60a900 msgr2=0x55a46a60ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.478+0000 7fe210030800 1 --2- 172.21.15.178:0/2128585186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a60a900 0x55a46a60ccf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400a470 tx=0x7fe1f4045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:19.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.478+0000 7fe210030800 1 -- 172.21.15.178:0/2128585186 shutdown_connections 2024-09-21T09:03:19.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.478+0000 7fe210030800 1 --2- 172.21.15.178:0/2128585186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a60a900 0x55a46a60ccf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.478+0000 7fe210030800 1 -- 172.21.15.178:0/2128585186 >> 172.21.15.178:0/2128585186 conn(0x55a46a601df0 msgr2=0x55a46a604210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.478+0000 7fe210030800 1 -- 172.21.15.178:0/2128585186 shutdown_connections 2024-09-21T09:03:19.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.478+0000 7fe210030800 1 -- 172.21.15.178:0/2128585186 wait complete. 2024-09-21T09:03:19.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.492+0000 7fe210030800 1 Processor -- start 2024-09-21T09:03:19.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.492+0000 7fe210030800 1 -- start start 2024-09-21T09:03:19.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.492+0000 7fe210030800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a6064c0 0x55a46a57ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.492+0000 7fe210030800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a46a553330 con 0x55a46a6064c0 2024-09-21T09:03:19.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.493+0000 7fe20b3d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a6064c0 0x55a46a57ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.493+0000 7fe20b3d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a6064c0 0x55a46a57ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43024/0 (socket says 172.21.15.178:43024) 2024-09-21T09:03:19.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.493+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3717404821 learned_addr learned my addr 172.21.15.178:0/3717404821 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.493+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3717404821 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a46a4a0bc0 con 0x55a46a6064c0 2024-09-21T09:03:19.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.493+0000 7fe20b3d6640 1 --2- 172.21.15.178:0/3717404821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a6064c0 0x55a46a57ad60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc001e10 tx=0x7fe1fc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb99b0d32013825 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.493+0000 7fe0f960a640 1 -- 172.21.15.178:0/3717404821 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1fc012020 con 0x55a46a6064c0 2024-09-21T09:03:19.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.493+0000 7fe0f960a640 1 -- 172.21.15.178:0/3717404821 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1fc00e5a0 con 0x55a46a6064c0 2024-09-21T09:03:19.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.493+0000 7fe0f960a640 1 -- 172.21.15.178:0/3717404821 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1fc00e8e0 con 0x55a46a6064c0 2024-09-21T09:03:19.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.494+0000 7fe210030800 1 -- 172.21.15.178:0/3717404821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a6064c0 msgr2=0x55a46a57ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.494+0000 7fe210030800 1 --2- 172.21.15.178:0/3717404821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a6064c0 0x55a46a57ad60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc001e10 tx=0x7fe1fc00b780 comp rx=0 tx=0).stop 2024-09-21T09:03:19.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.494+0000 7fe210030800 1 -- 172.21.15.178:0/3717404821 shutdown_connections 2024-09-21T09:03:19.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.494+0000 7fe210030800 1 --2- 172.21.15.178:0/3717404821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a6064c0 0x55a46a57ad60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.494+0000 7fe210030800 1 -- 172.21.15.178:0/3717404821 >> 172.21.15.178:0/3717404821 conn(0x55a46a601df0 msgr2=0x55a46a6f1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.494+0000 7fe210030800 1 -- 172.21.15.178:0/3717404821 shutdown_connections 2024-09-21T09:03:19.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.494+0000 7fe210030800 1 -- 172.21.15.178:0/3717404821 wait complete. 2024-09-21T09:03:19.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.494+0000 7fe210030800 1 Processor -- start 2024-09-21T09:03:19.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.494+0000 7fe210030800 1 -- start start 2024-09-21T09:03:19.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.494+0000 7fe210030800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a6064c0 0x55a46a6fe1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.494+0000 7fe210030800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a46a60d530 con 0x55a46a6064c0 2024-09-21T09:03:19.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.495+0000 7fe20b3d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a6064c0 0x55a46a6fe1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.495+0000 7fe20b3d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a6064c0 0x55a46a6fe1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43036/0 (socket says 172.21.15.178:43036) 2024-09-21T09:03:19.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.495+0000 7fe20b3d6640 1 -- 172.21.15.178:0/1793880855 learned_addr learned my addr 172.21.15.178:0/1793880855 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.495+0000 7fe20b3d6640 1 -- 172.21.15.178:0/1793880855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a46a4b4fe0 con 0x55a46a6064c0 2024-09-21T09:03:19.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.495+0000 7fe20b3d6640 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a6064c0 0x55a46a6fe1f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc004170 tx=0x7fe1fc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.495+0000 7fe0f7e07640 1 -- 172.21.15.178:0/1793880855 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1fc012030 con 0x55a46a6064c0 2024-09-21T09:03:19.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.495+0000 7fe0f7e07640 1 -- 172.21.15.178:0/1793880855 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1fc001470 con 0x55a46a6064c0 2024-09-21T09:03:19.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.495+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a46a6fe730 con 0x55a46a6064c0 2024-09-21T09:03:19.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.495+0000 7fe0f7e07640 1 -- 172.21.15.178:0/1793880855 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1fc01a8d0 con 0x55a46a6064c0 2024-09-21T09:03:19.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.495+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a46a6fec50 con 0x55a46a6064c0 2024-09-21T09:03:19.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.496+0000 7fe0f7e07640 1 -- 172.21.15.178:0/1793880855 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe1fc015020 con 0x55a46a6064c0 2024-09-21T09:03:19.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.496+0000 7fe0f7e07640 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0f0036be0 0x7fe0f00390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.496+0000 7fe0f7e07640 1 -- 172.21.15.178:0/1793880855 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fe1fc020030 con 0x55a46a6064c0 2024-09-21T09:03:19.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.497+0000 7fe202bd5640 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0f0036be0 0x7fe0f00390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.497+0000 7fe210030800 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a46a60a900 0x55a46a705260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.497+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a7057a0 con 0x55a46a60a900 2024-09-21T09:03:19.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.497+0000 7fe20bbd7640 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a46a60a900 0x55a46a705260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.497+0000 7fe202bd5640 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0f0036be0 0x7fe0f00390a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4057000 tx=0x7fe1f4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.497+0000 7fe20bbd7640 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a46a60a900 0x55a46a705260 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.497+0000 7fe20bbd7640 1 -- 172.21.15.178:0/1793880855 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe20400a4a0 con 0x55a46a60a900 2024-09-21T09:03:19.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.497+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a702830 con 0x55a46a60a900 2024-09-21T09:03:19.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.498+0000 7fe20bbd7640 1 -- 172.21.15.178:0/1793880855 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe20400a4a0 con 0x55a46a60a900 2024-09-21T09:03:19.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.498+0000 7fe210030800 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a46a707ab0 0x55a46a709ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.498+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a70a590 con 0x55a46a707ab0 2024-09-21T09:03:19.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.498+0000 7fe20b3d6640 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a46a707ab0 0x55a46a709ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.498+0000 7fe20b3d6640 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a46a707ab0 0x55a46a709ea0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.499+0000 7fe20b3d6640 1 -- 172.21.15.178:0/1793880855 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a707ab0 2024-09-21T09:03:19.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.499+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a706950 con 0x55a46a60a900 2024-09-21T09:03:19.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.499+0000 7fe20bbd7640 1 -- 172.21.15.178:0/1793880855 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe20400a4a0 con 0x55a46a60a900 2024-09-21T09:03:19.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.499+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a706e30 con 0x55a46a60a900 2024-09-21T09:03:19.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.499+0000 7fe20bbd7640 1 -- 172.21.15.178:0/1793880855 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe20400a4a0 con 0x55a46a60a900 2024-09-21T09:03:19.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.500+0000 7fe210030800 1 Processor -- start 2024-09-21T09:03:19.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.500+0000 7fe210030800 1 -- start start 2024-09-21T09:03:19.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.500+0000 7fe210030800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a718f10 0x55a46a719330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.500+0000 7fe210030800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a46a4a2580 con 0x55a46a718f10 2024-09-21T09:03:19.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.500+0000 7fe20bbd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a718f10 0x55a46a719330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.500+0000 7fe20bbd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a718f10 0x55a46a719330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43044/0 (socket says 172.21.15.178:43044) 2024-09-21T09:03:19.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.500+0000 7fe20bbd7640 1 -- 172.21.15.178:0/2383960562 learned_addr learned my addr 172.21.15.178:0/2383960562 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.500+0000 7fe20bbd7640 1 -- 172.21.15.178:0/2383960562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a46a719870 con 0x55a46a718f10 2024-09-21T09:03:19.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.501+0000 7fe20bbd7640 1 --2- 172.21.15.178:0/2383960562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a718f10 0x55a46a719330 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55a46a705b60 tx=0x7fe204018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.501+0000 7fe0f5602640 1 -- 172.21.15.178:0/2383960562 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe204014450 con 0x55a46a718f10 2024-09-21T09:03:19.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.501+0000 7fe0f5602640 1 -- 172.21.15.178:0/2383960562 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe204014610 con 0x55a46a718f10 2024-09-21T09:03:19.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.501+0000 7fe210030800 1 -- 172.21.15.178:0/2383960562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a46a719b00 con 0x55a46a718f10 2024-09-21T09:03:19.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.501+0000 7fe0f5602640 1 -- 172.21.15.178:0/2383960562 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe204014930 con 0x55a46a718f10 2024-09-21T09:03:19.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.501+0000 7fe210030800 1 -- 172.21.15.178:0/2383960562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a46a71c7e0 con 0x55a46a718f10 2024-09-21T09:03:19.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.502+0000 7fe0f5602640 1 -- 172.21.15.178:0/2383960562 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe204011040 con 0x55a46a718f10 2024-09-21T09:03:19.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.502+0000 7fe0f5602640 1 --2- 172.21.15.178:0/2383960562 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0e4036b40 0x7fe0e4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.502+0000 7fe0f5602640 1 -- 172.21.15.178:0/2383960562 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fe20401e070 con 0x55a46a718f10 2024-09-21T09:03:19.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.502+0000 7fe20b3d6640 1 --2- 172.21.15.178:0/2383960562 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0e4036b40 0x7fe0e4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.502+0000 7fe210030800 1 Processor -- start 2024-09-21T09:03:19.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.502+0000 7fe210030800 1 -- start start 2024-09-21T09:03:19.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.502+0000 7fe20b3d6640 1 --2- 172.21.15.178:0/2383960562 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0e4036b40 0x7fe0e4039000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55a46a705c00 tx=0x7fe1fc04af80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.502+0000 7fe210030800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a725b40 0x55a46a725f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.502+0000 7fe210030800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a46a6f9750 con 0x55a46a725b40 2024-09-21T09:03:19.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.502+0000 7fe20bbd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a725b40 0x55a46a725f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.502+0000 7fe20bbd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a725b40 0x55a46a725f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43046/0 (socket says 172.21.15.178:43046) 2024-09-21T09:03:19.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.502+0000 7fe20bbd7640 1 -- 172.21.15.178:0/2086898788 learned_addr learned my addr 172.21.15.178:0/2086898788 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.503+0000 7fe20bbd7640 1 -- 172.21.15.178:0/2086898788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a46a726510 con 0x55a46a725b40 2024-09-21T09:03:19.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.503+0000 7fe20bbd7640 1 --2- 172.21.15.178:0/2086898788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a725b40 0x55a46a725f40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe204013fd0 tx=0x7fe20400df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f2efb7a8e6d88b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.503+0000 7fe0eeffd640 1 -- 172.21.15.178:0/2086898788 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe204043020 con 0x55a46a725b40 2024-09-21T09:03:19.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.503+0000 7fe0eeffd640 1 -- 172.21.15.178:0/2086898788 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe204016570 con 0x55a46a725b40 2024-09-21T09:03:19.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.503+0000 7fe0eeffd640 1 -- 172.21.15.178:0/2086898788 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe20402bd80 con 0x55a46a725b40 2024-09-21T09:03:19.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.503+0000 7fe210030800 1 -- 172.21.15.178:0/2086898788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a725b40 msgr2=0x55a46a725f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.503+0000 7fe210030800 1 --2- 172.21.15.178:0/2086898788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a725b40 0x55a46a725f40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe204013fd0 tx=0x7fe20400df00 comp rx=0 tx=0).stop 2024-09-21T09:03:19.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.503+0000 7fe210030800 1 -- 172.21.15.178:0/2086898788 shutdown_connections 2024-09-21T09:03:19.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.503+0000 7fe210030800 1 --2- 172.21.15.178:0/2086898788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a725b40 0x55a46a725f40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.503+0000 7fe210030800 1 -- 172.21.15.178:0/2086898788 >> 172.21.15.178:0/2086898788 conn(0x55a46a721f40 msgr2=0x55a46a720040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.504+0000 7fe210030800 1 -- 172.21.15.178:0/2086898788 shutdown_connections 2024-09-21T09:03:19.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.504+0000 7fe210030800 1 -- 172.21.15.178:0/2086898788 wait complete. 2024-09-21T09:03:19.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.504+0000 7fe210030800 1 Processor -- start 2024-09-21T09:03:19.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.504+0000 7fe210030800 1 -- start start 2024-09-21T09:03:19.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.504+0000 7fe210030800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a725b40 0x55a46a72f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.504+0000 7fe210030800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a46a726b70 con 0x55a46a725b40 2024-09-21T09:03:19.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.504+0000 7fe20bbd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a725b40 0x55a46a72f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.504+0000 7fe20bbd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a725b40 0x55a46a72f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43048/0 (socket says 172.21.15.178:43048) 2024-09-21T09:03:19.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.504+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 learned_addr learned my addr 172.21.15.178:0/3099382604 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.504+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a46a72f7a0 con 0x55a46a725b40 2024-09-21T09:03:19.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.505+0000 7fe20bbd7640 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a725b40 0x55a46a72f260 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe20404cb30 tx=0x7fe20404cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.505+0000 7fe0ed7fa640 1 -- 172.21.15.178:0/3099382604 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe204043040 con 0x55a46a725b40 2024-09-21T09:03:19.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.505+0000 7fe0ed7fa640 1 -- 172.21.15.178:0/3099382604 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe204014e50 con 0x55a46a725b40 2024-09-21T09:03:19.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.505+0000 7fe0ed7fa640 1 -- 172.21.15.178:0/3099382604 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe20404e2e0 con 0x55a46a725b40 2024-09-21T09:03:19.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.505+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a46a72fa30 con 0x55a46a725b40 2024-09-21T09:03:19.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.505+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a46a7326e0 con 0x55a46a725b40 2024-09-21T09:03:19.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.505+0000 7fe0ed7fa640 1 -- 172.21.15.178:0/3099382604 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe204035030 con 0x55a46a725b40 2024-09-21T09:03:19.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.506+0000 7fe0ed7fa640 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0d4036b90 0x7fe0d4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.506+0000 7fe0ed7fa640 1 -- 172.21.15.178:0/3099382604 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fe20400e040 con 0x55a46a725b40 2024-09-21T09:03:19.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.506+0000 7fe20b3d6640 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0d4036b90 0x7fe0d4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.506+0000 7fe210030800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.506+0000 7fe210030800 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a46a73add0 0x55a46a73d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.506+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a73d9e0 con 0x55a46a73add0 2024-09-21T09:03:19.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.506+0000 7fe202bd5640 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a46a73add0 0x55a46a73d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.506+0000 7fe20b3d6640 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0d4036b90 0x7fe0d4039050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55a46a70a990 tx=0x7fe1fc038000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.506+0000 7fe202bd5640 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a46a73add0 0x55a46a73d290 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe210030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe210030800 20 realm 2024-09-21T09:03:19.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe210030800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a73de10 con 0x55a46a73add0 2024-09-21T09:03:19.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe210030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe210030800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:19.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe210030800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a73e6e0 con 0x55a46a73add0 2024-09-21T09:03:19.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe210030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe210030800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a73ea80 con 0x55a46a73add0 2024-09-21T09:03:19.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe210030800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:19.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.507+0000 7fe210030800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.508+0000 7fe210030800 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a46a73f7e0 0x55a46a741bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.508+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a742110 con 0x55a46a73f7e0 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.508+0000 7fe20bbd7640 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a46a73f7e0 0x55a46a741bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.508+0000 7fe20bbd7640 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a46a73f7e0 0x55a46a741bd0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.508+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.508+0000 7fe210030800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.508+0000 7fe210030800 20 searching for the correct realm 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.508+0000 7fe210030800 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a46a744150 0x55a46a746610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.508+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a744150 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.509+0000 7fe20b3d6640 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a46a744150 0x55a46a746610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.509+0000 7fe20b3d6640 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a46a744150 0x55a46a746610 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.509+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a744150 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.509+0000 7fe20b3d6640 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe1fc04cc20 0x7fe1fc024420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.509+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x7fe1fc04cc20 2024-09-21T09:03:19.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.509+0000 7fe202bd5640 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe1fc04cc20 0x7fe1fc024420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.510+0000 7fe202bd5640 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe1fc04cc20 0x7fe1fc024420 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.510+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f4051070 con 0x7fe1fc04cc20 2024-09-21T09:03:19.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.510+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73f7e0 2024-09-21T09:03:19.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.510+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.510+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73add0 2024-09-21T09:03:19.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.510+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.510+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73add0 2024-09-21T09:03:19.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.511+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.511+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73f7e0 2024-09-21T09:03:19.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.511+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.511+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73f7e0 2024-09-21T09:03:19.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.511+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.511+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x7fe1fc04cc20 2024-09-21T09:03:19.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.511+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f4051070 con 0x7fe1fc04cc20 2024-09-21T09:03:19.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.511+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a744150 2024-09-21T09:03:19.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.511+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a744150 2024-09-21T09:03:19.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.511+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73add0 2024-09-21T09:03:19.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.512+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.512+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73f7e0 2024-09-21T09:03:19.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.512+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.512+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73add0 2024-09-21T09:03:19.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.513+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.513+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x7fe1fc04cc20 2024-09-21T09:03:19.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.513+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe1f4051070 con 0x7fe1fc04cc20 2024-09-21T09:03:19.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.513+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a744150 2024-09-21T09:03:19.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.513+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a744150 2024-09-21T09:03:19.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.513+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a744150 2024-09-21T09:03:19.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.513+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a744150 2024-09-21T09:03:19.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.513+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73f7e0 2024-09-21T09:03:19.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.514+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.514+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a744150 2024-09-21T09:03:19.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.514+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a744150 2024-09-21T09:03:19.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.514+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a744150 2024-09-21T09:03:19.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.514+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a744150 2024-09-21T09:03:19.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.514+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73add0 2024-09-21T09:03:19.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.514+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.514+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73add0 2024-09-21T09:03:19.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.515+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.515+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73f7e0 2024-09-21T09:03:19.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.515+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.515+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a744150 2024-09-21T09:03:19.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.515+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a744150 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.515+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x7fe1fc04cc20 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.515+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f4051070 con 0x7fe1fc04cc20 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.515+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73add0 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.516+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.516+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73f7e0 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.516+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.516+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a744150 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.516+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a744150 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.516+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73f7e0 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.516+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.516+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x7fe1fc04cc20 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.517+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f4051070 con 0x7fe1fc04cc20 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.517+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a744150 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.517+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a744150 2024-09-21T09:03:19.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.517+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73f7e0 2024-09-21T09:03:19.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.517+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.517+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x55a46a73add0 2024-09-21T09:03:19.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.517+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.517+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a46a746ce0 con 0x7fe1fc04cc20 2024-09-21T09:03:19.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f4051070 con 0x7fe1fc04cc20 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe210030800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe210030800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe210030800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe210030800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe210030800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe210030800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe210030800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a742b50 con 0x55a46a73add0 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe210030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe210030800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a742f70 con 0x55a46a73add0 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe210030800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:19.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe210030800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.518+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a743410 con 0x55a46a73add0 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 20 zone default found 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 4 Realm: () 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 20 zonegroup default 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a747160 con 0x55a46a73f7e0 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a749390 con 0x55a46a744150 2024-09-21T09:03:19.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a744150 2024-09-21T09:03:19.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a749730 con 0x55a46a744150 2024-09-21T09:03:19.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a744150 2024-09-21T09:03:19.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 20 started sync module instance, tier type = 2024-09-21T09:03:19.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:19.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.519+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a7487d0 con 0x7fe1fc04cc20 2024-09-21T09:03:19.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.520+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x7fe1fc04cc20 2024-09-21T09:03:19.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.520+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94164649020400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a7487d0 con 0x7fe1fc04cc20 2024-09-21T09:03:19.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.520+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74a0f0 con 0x55a46a73add0 2024-09-21T09:03:19.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.521+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94164649020400] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x7fe1fc04cc20 2024-09-21T09:03:19.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.521+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.522+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94164649018624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74a0f0 con 0x55a46a73add0 2024-09-21T09:03:19.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.522+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74aab0 con 0x55a46a744150 2024-09-21T09:03:19.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.523+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94164649018624] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.523+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a744150 2024-09-21T09:03:19.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.523+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94164649024576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74a060 con 0x55a46a744150 2024-09-21T09:03:19.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.523+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74b970 con 0x7fe1fc04cc20 2024-09-21T09:03:19.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.524+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x7fe1fc04cc20 2024-09-21T09:03:19.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.524+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94164649031328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74c110 con 0x7fe1fc04cc20 2024-09-21T09:03:19.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.524+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74cc30 con 0x55a46a73add0 2024-09-21T09:03:19.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.524+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94164649024576] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a744150 2024-09-21T09:03:19.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.525+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.525+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94164649035520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74cbf0 con 0x55a46a73add0 2024-09-21T09:03:19.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.525+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74d640 con 0x55a46a73f7e0 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.525+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94164649031328] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x7fe1fc04cc20 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.526+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.526+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94164649038224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74d9e0 con 0x55a46a73f7e0 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.526+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74e3e0 con 0x55a46a73f7e0 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.526+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94164649035520] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.527+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94164649038224] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.527+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.527+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94164649032544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74def0 con 0x55a46a73f7e0 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.527+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74e8f0 con 0x55a46a73f7e0 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.528+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94164649032544] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.528+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.528+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94164649029280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74e8b0 con 0x55a46a73f7e0 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.528+0000 7fe210030800 20 add_watcher() i=0 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.528+0000 7fe210030800 20 add_watcher() i=1 2024-09-21T09:03:19.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.528+0000 7fe210030800 20 add_watcher() i=2 2024-09-21T09:03:19.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.528+0000 7fe210030800 20 add_watcher() i=3 2024-09-21T09:03:19.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.528+0000 7fe210030800 20 add_watcher() i=4 2024-09-21T09:03:19.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.528+0000 7fe210030800 20 add_watcher() i=5 2024-09-21T09:03:19.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.528+0000 7fe210030800 20 add_watcher() i=6 2024-09-21T09:03:19.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.529+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94164649029280] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.529+0000 7fe210030800 20 add_watcher() i=7 2024-09-21T09:03:19.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.529+0000 7fe210030800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:19.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.529+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a751d40 con 0x55a46a73add0 2024-09-21T09:03:19.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.529+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.529+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94164649043408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74f260 con 0x55a46a73add0 2024-09-21T09:03:19.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.530+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94164649043408] v29'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.530+0000 7fe0c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:19.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.530+0000 7fe210030800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:19.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.530+0000 7fe210030800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:19.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.530+0000 7fe210030800 5 note: GC not initialized 2024-09-21T09:03:19.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.531+0000 7fe0c0fe1640 20 reqs_thread_entry: start 2024-09-21T09:03:19.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.531+0000 7fe210030800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:19.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.531+0000 7fe210030800 20 Filter name: none 2024-09-21T09:03:19.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.531+0000 7fe03a7fc640 20 reqs_thread_entry: start 2024-09-21T09:03:19.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.531+0000 7fe210030800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.531+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a784c40 con 0x55a46a73add0 2024-09-21T09:03:19.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.531+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.531+0000 7fe210030800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:19.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.531+0000 7fe210030800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.531+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a785630 con 0x55a46a73add0 2024-09-21T09:03:19.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.531+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.531+0000 7fe210030800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:19.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.532+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a46a786640 con 0x7fe1fc04cc20 2024-09-21T09:03:19.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.532+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x7fe1fc04cc20 2024-09-21T09:03:19.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.533+0000 7fe0c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:19.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.533+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94164649043408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a782a70 con 0x55a46a73add0 2024-09-21T09:03:19.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.533+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94164649043408] v29'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.534+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94164649020400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a782a70 con 0x7fe1fc04cc20 2024-09-21T09:03:19.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.534+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94164649020400] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x7fe1fc04cc20 2024-09-21T09:03:19.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.534+0000 7fe210030800 20 remove_watcher() i=0 2024-09-21T09:03:19.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.534+0000 7fe210030800 2 removed watcher, disabling cache 2024-09-21T09:03:19.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.535+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94164649018624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a782a70 con 0x55a46a73add0 2024-09-21T09:03:19.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.535+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94164649018624] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.535+0000 7fe210030800 20 remove_watcher() i=1 2024-09-21T09:03:19.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.535+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94164649024576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a782a70 con 0x55a46a744150 2024-09-21T09:03:19.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.536+0000 7fe20b3d6640 1 -- 172.21.15.178:0/3099382604 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94164649024576] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1fc018950 con 0x55a46a744150 2024-09-21T09:03:19.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.536+0000 7fe210030800 20 remove_watcher() i=2 2024-09-21T09:03:19.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.536+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94164649031328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a749c40 con 0x7fe1fc04cc20 2024-09-21T09:03:19.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.537+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94164649031328] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x7fe1fc04cc20 2024-09-21T09:03:19.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.537+0000 7fe210030800 20 remove_watcher() i=3 2024-09-21T09:03:19.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.537+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94164649035520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a749c40 con 0x55a46a73add0 2024-09-21T09:03:19.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.538+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94164649035520] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f4051070 con 0x55a46a73add0 2024-09-21T09:03:19.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.538+0000 7fe210030800 20 remove_watcher() i=4 2024-09-21T09:03:19.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.538+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94164649038224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74c700 con 0x55a46a73f7e0 2024-09-21T09:03:19.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.539+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94164649038224] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.539+0000 7fe210030800 20 remove_watcher() i=5 2024-09-21T09:03:19.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.539+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94164649032544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a749c40 con 0x55a46a73f7e0 2024-09-21T09:03:19.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.540+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94164649032544] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.540+0000 7fe210030800 20 remove_watcher() i=6 2024-09-21T09:03:19.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.540+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94164649029280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a46a74c700 con 0x55a46a73f7e0 2024-09-21T09:03:19.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.541+0000 7fe20bbd7640 1 -- 172.21.15.178:0/3099382604 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94164649029280] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe204045050 con 0x55a46a73f7e0 2024-09-21T09:03:19.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.541+0000 7fe210030800 20 remove_watcher() i=7 2024-09-21T09:03:19.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.541+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a46a73f7e0 msgr2=0x55a46a741bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.541+0000 7fe210030800 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a46a73f7e0 0x55a46a741bd0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.541+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a46a73add0 msgr2=0x55a46a73d290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.541+0000 7fe210030800 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a46a73add0 0x55a46a73d290 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.541+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe1fc04cc20 msgr2=0x7fe1fc024420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.541+0000 7fe210030800 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe1fc04cc20 0x7fe1fc024420 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.541+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a46a744150 msgr2=0x55a46a746610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.541+0000 7fe210030800 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a46a744150 0x55a46a746610 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0d4036b90 msgr2=0x7fe0d4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0d4036b90 0x7fe0d4039050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55a46a70a990 tx=0x7fe1fc038000 comp rx=0 tx=0).stop 2024-09-21T09:03:19.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a725b40 msgr2=0x55a46a72f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 --2- 172.21.15.178:0/3099382604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a725b40 0x55a46a72f260 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe20404cb30 tx=0x7fe20404cb60 comp rx=0 tx=0).stop 2024-09-21T09:03:19.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 reap_dead start 2024-09-21T09:03:19.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe202bd5640 1 -- 172.21.15.178:0/3099382604 reap_dead start 2024-09-21T09:03:19.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 shutdown_connections 2024-09-21T09:03:19.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 >> 172.21.15.178:0/3099382604 conn(0x55a46a721f40 msgr2=0x55a46a720010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 shutdown_connections 2024-09-21T09:03:19.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 -- 172.21.15.178:0/3099382604 wait complete. 2024-09-21T09:03:19.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 -- 172.21.15.178:0/2383960562 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0e4036b40 msgr2=0x7fe0e4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 --2- 172.21.15.178:0/2383960562 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0e4036b40 0x7fe0e4039000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55a46a705c00 tx=0x7fe1fc04af80 comp rx=0 tx=0).stop 2024-09-21T09:03:19.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 -- 172.21.15.178:0/2383960562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a718f10 msgr2=0x55a46a719330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 --2- 172.21.15.178:0/2383960562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a718f10 0x55a46a719330 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55a46a705b60 tx=0x7fe204018830 comp rx=0 tx=0).stop 2024-09-21T09:03:19.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 -- 172.21.15.178:0/2383960562 shutdown_connections 2024-09-21T09:03:19.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 --2- 172.21.15.178:0/2383960562 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0e4036b40 0x7fe0e4039000 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 --2- 172.21.15.178:0/2383960562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a718f10 0x55a46a719330 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 -- 172.21.15.178:0/2383960562 >> 172.21.15.178:0/2383960562 conn(0x55a46a70dea0 msgr2=0x55a46a710a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 -- 172.21.15.178:0/2383960562 shutdown_connections 2024-09-21T09:03:19.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 -- 172.21.15.178:0/2383960562 wait complete. 2024-09-21T09:03:19.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a46a707ab0 msgr2=0x55a46a709ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a46a707ab0 0x55a46a709ea0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a46a60a900 msgr2=0x55a46a705260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.542+0000 7fe210030800 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a46a60a900 0x55a46a705260 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.543+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0f0036be0 msgr2=0x7fe0f00390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.543+0000 7fe210030800 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0f0036be0 0x7fe0f00390a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4057000 tx=0x7fe1f4052000 comp rx=0 tx=0).stop 2024-09-21T09:03:19.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.543+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a6064c0 msgr2=0x55a46a6fe1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.543+0000 7fe210030800 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a6064c0 0x55a46a6fe1f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc004170 tx=0x7fe1fc000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.543+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 shutdown_connections 2024-09-21T09:03:19.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.543+0000 7fe210030800 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a46a707ab0 0x55a46a709ea0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.543+0000 7fe210030800 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a46a60a900 0x55a46a705260 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.543+0000 7fe210030800 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe0f0036be0 0x7fe0f00390a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.543+0000 7fe210030800 1 --2- 172.21.15.178:0/1793880855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a46a6064c0 0x55a46a6fe1f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.543+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 >> 172.21.15.178:0/1793880855 conn(0x55a46a601df0 msgr2=0x55a46a6efa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.543+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 shutdown_connections 2024-09-21T09:03:19.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.543+0000 7fe210030800 1 -- 172.21.15.178:0/1793880855 wait complete. 2024-09-21T09:03:19.553 INFO:teuthology.orchestra.run.smithi178.stdout:[] 2024-09-21T09:03:19.553 DEBUG:tasks.util.rgw: json result: [] 2024-09-21T09:03:19.567 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:19.567 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-21T09:03:19.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-21T09:03:19.567 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-21T09:03:19.611 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:19.611 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:19.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.610+0000 7f8fd4f42800 1 Processor -- start 2024-09-21T09:03:19.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.610+0000 7f8fd4f42800 1 -- start start 2024-09-21T09:03:19.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.610+0000 7f8fd4f42800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5649f765e5f0 0x5649f76ef690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.611+0000 7f8fd4f42800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5649f75a9b30 con 0x5649f76efbd0 2024-09-21T09:03:19.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.611+0000 7f8fd4f42800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5649f758b360 con 0x5649f765e5f0 2024-09-21T09:03:19.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.611+0000 7f8fd0c97640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5649f765e5f0 0x5649f76ef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.611+0000 7f8fc8496640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5649f76efbd0 0x5649f76f1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46726/0 (socket says 172.21.15.178:46726) 2024-09-21T09:03:19.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.611+0000 7f8fc8496640 1 -- 172.21.15.178:0/3594977616 learned_addr learned my addr 172.21.15.178:0/3594977616 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:19.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.611+0000 7f8fd0c97640 1 -- 172.21.15.178:0/3594977616 >> v1:172.21.15.44:6789/0 conn(0x5649f76efbd0 legacy=0x5649f76f1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.611+0000 7f8fd0c97640 1 -- 172.21.15.178:0/3594977616 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f75b1e00 con 0x5649f765e5f0 2024-09-21T09:03:19.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.613+0000 7f8fd0c97640 1 --2- 172.21.15.178:0/3594977616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f76ef690 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0005fd0 tx=0x7f8fc0045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5177773d2e8e08cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.613+0000 7f8fcbfff640 1 -- 172.21.15.178:0/3594977616 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc0058530 con 0x5649f765e5f0 2024-09-21T09:03:19.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.613+0000 7f8fcbfff640 1 -- 172.21.15.178:0/3594977616 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc00586d0 con 0x5649f765e5f0 2024-09-21T09:03:19.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.613+0000 7f8fcbfff640 1 -- 172.21.15.178:0/3594977616 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc00589d0 con 0x5649f765e5f0 2024-09-21T09:03:19.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.613+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3594977616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 msgr2=0x5649f76ef690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.613+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/3594977616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f76ef690 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0005fd0 tx=0x7f8fc0045c30 comp rx=0 tx=0).stop 2024-09-21T09:03:19.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.614+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3594977616 shutdown_connections 2024-09-21T09:03:19.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.614+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/3594977616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f76ef690 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.614+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3594977616 >> 172.21.15.178:0/3594977616 conn(0x5649f76e4de0 msgr2=0x5649f76e7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.614+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3594977616 shutdown_connections 2024-09-21T09:03:19.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.614+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3594977616 wait complete. 2024-09-21T09:03:19.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.627+0000 7f8fd4f42800 1 Processor -- start 2024-09-21T09:03:19.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.627+0000 7f8fd4f42800 1 -- start start 2024-09-21T09:03:19.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.627+0000 7f8fd4f42800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f77dbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.627+0000 7f8fd4f42800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5649f7636330 con 0x5649f765e5f0 2024-09-21T09:03:19.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.628+0000 7f8fd0c97640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f77dbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.628+0000 7f8fd0c97640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f77dbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43058/0 (socket says 172.21.15.178:43058) 2024-09-21T09:03:19.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.628+0000 7f8fd0c97640 1 -- 172.21.15.178:0/3290750661 learned_addr learned my addr 172.21.15.178:0/3290750661 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.628+0000 7f8fd0c97640 1 -- 172.21.15.178:0/3290750661 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f7583bc0 con 0x5649f765e5f0 2024-09-21T09:03:19.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.628+0000 7f8fd0c97640 1 --2- 172.21.15.178:0/3290750661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f77dbac0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000a3f0 tx=0x7f8fc0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546291b5550f5c1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.629+0000 7f8ebee0d640 1 -- 172.21.15.178:0/3290750661 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc00589b0 con 0x5649f765e5f0 2024-09-21T09:03:19.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.629+0000 7f8ebee0d640 1 -- 172.21.15.178:0/3290750661 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc0068070 con 0x5649f765e5f0 2024-09-21T09:03:19.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.629+0000 7f8ebee0d640 1 -- 172.21.15.178:0/3290750661 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc0058c80 con 0x5649f765e5f0 2024-09-21T09:03:19.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.629+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3290750661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 msgr2=0x5649f77dbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.629+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/3290750661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f77dbac0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000a3f0 tx=0x7f8fc0051000 comp rx=0 tx=0).stop 2024-09-21T09:03:19.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.629+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3290750661 shutdown_connections 2024-09-21T09:03:19.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.629+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/3290750661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f77dbac0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.629+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3290750661 >> 172.21.15.178:0/3290750661 conn(0x5649f76e4de0 msgr2=0x5649f77d7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.629+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3290750661 shutdown_connections 2024-09-21T09:03:19.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.629+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3290750661 wait complete. 2024-09-21T09:03:19.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.630+0000 7f8fd4f42800 1 Processor -- start 2024-09-21T09:03:19.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.630+0000 7f8fd4f42800 1 -- start start 2024-09-21T09:03:19.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.630+0000 7f8fd4f42800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f77e3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.630+0000 7f8fd4f42800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5649f76f3980 con 0x5649f765e5f0 2024-09-21T09:03:19.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.630+0000 7f8fd0c97640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f77e3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.630+0000 7f8fd0c97640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f77e3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43064/0 (socket says 172.21.15.178:43064) 2024-09-21T09:03:19.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.630+0000 7f8fd0c97640 1 -- 172.21.15.178:0/2435984621 learned_addr learned my addr 172.21.15.178:0/2435984621 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.630+0000 7f8fd0c97640 1 -- 172.21.15.178:0/2435984621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f7597fe0 con 0x5649f765e5f0 2024-09-21T09:03:19.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.630+0000 7f8fd0c97640 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f77e3400 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0065040 tx=0x7f8fc0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.631+0000 7f8ebd60a640 1 -- 172.21.15.178:0/2435984621 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc0063650 con 0x5649f765e5f0 2024-09-21T09:03:19.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.631+0000 7f8ebd60a640 1 -- 172.21.15.178:0/2435984621 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc00637f0 con 0x5649f765e5f0 2024-09-21T09:03:19.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.631+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649f77e3940 con 0x5649f765e5f0 2024-09-21T09:03:19.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.631+0000 7f8ebd60a640 1 -- 172.21.15.178:0/2435984621 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc0063af0 con 0x5649f765e5f0 2024-09-21T09:03:19.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.631+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f77e3e60 con 0x5649f765e5f0 2024-09-21T09:03:19.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.631+0000 7f8ebd60a640 1 -- 172.21.15.178:0/2435984621 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8fc0074020 con 0x5649f765e5f0 2024-09-21T09:03:19.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.631+0000 7f8ebd60a640 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8eb8036b40 0x7f8eb8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.632+0000 7f8ebd60a640 1 -- 172.21.15.178:0/2435984621 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8fc0090800 con 0x5649f765e5f0 2024-09-21T09:03:19.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.632+0000 7f8fc8496640 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8eb8036b40 0x7f8eb8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.632+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5649f76efbd0 0x5649f77ea470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.632+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f77ea9b0 con 0x5649f76efbd0 2024-09-21T09:03:19.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.632+0000 7f8fd1498640 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5649f76efbd0 0x5649f77ea470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.632+0000 7f8fc8496640 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8eb8036b40 0x7f8eb8039000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8000f60 tx=0x7f8fb80012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.632+0000 7f8fd1498640 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5649f76efbd0 0x5649f77ea470 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.632+0000 7f8fd1498640 1 -- 172.21.15.178:0/2435984621 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fcc0083e0 con 0x5649f76efbd0 2024-09-21T09:03:19.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.632+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f77e7a20 con 0x5649f76efbd0 2024-09-21T09:03:19.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.633+0000 7f8fd1498640 1 -- 172.21.15.178:0/2435984621 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fcc0083e0 con 0x5649f76efbd0 2024-09-21T09:03:19.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.633+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5649f77ecce0 0x5649f77ef0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.633+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f77ef7c0 con 0x5649f77ecce0 2024-09-21T09:03:19.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.633+0000 7f8fd0c97640 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5649f77ecce0 0x5649f77ef0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.633+0000 7f8fd0c97640 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5649f77ecce0 0x5649f77ef0d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.634+0000 7f8fd0c97640 1 -- 172.21.15.178:0/2435984621 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f77ecce0 2024-09-21T09:03:19.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.634+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f77ebb80 con 0x5649f76efbd0 2024-09-21T09:03:19.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.634+0000 7f8fd1498640 1 -- 172.21.15.178:0/2435984621 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fcc0083e0 con 0x5649f76efbd0 2024-09-21T09:03:19.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.634+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f77ec020 con 0x5649f76efbd0 2024-09-21T09:03:19.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.634+0000 7f8fd1498640 1 -- 172.21.15.178:0/2435984621 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8fcc0083e0 con 0x5649f76efbd0 2024-09-21T09:03:19.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.635+0000 7f8fd4f42800 1 Processor -- start 2024-09-21T09:03:19.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.635+0000 7f8fd4f42800 1 -- start start 2024-09-21T09:03:19.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.635+0000 7f8fd4f42800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f77fe190 0x5649f77fe5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.635+0000 7f8fd4f42800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5649f7585580 con 0x5649f77fe190 2024-09-21T09:03:19.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.635+0000 7f8fd1498640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f77fe190 0x5649f77fe5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.635+0000 7f8fd1498640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f77fe190 0x5649f77fe5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43066/0 (socket says 172.21.15.178:43066) 2024-09-21T09:03:19.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.635+0000 7f8fd1498640 1 -- 172.21.15.178:0/3395231116 learned_addr learned my addr 172.21.15.178:0/3395231116 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.635+0000 7f8fd1498640 1 -- 172.21.15.178:0/3395231116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f77feaf0 con 0x5649f77fe190 2024-09-21T09:03:19.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.635+0000 7f8fd1498640 1 --2- 172.21.15.178:0/3395231116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f77fe190 0x5649f77fe5b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5649f77e44b0 tx=0x7f8fcc00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.636+0000 7f8eb67fc640 1 -- 172.21.15.178:0/3395231116 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc007d00 con 0x5649f77fe190 2024-09-21T09:03:19.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.636+0000 7f8eb67fc640 1 -- 172.21.15.178:0/3395231116 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc01e020 con 0x5649f77fe190 2024-09-21T09:03:19.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.636+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3395231116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649f77fed80 con 0x5649f77fe190 2024-09-21T09:03:19.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.636+0000 7f8eb67fc640 1 -- 172.21.15.178:0/3395231116 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc019420 con 0x5649f77fe190 2024-09-21T09:03:19.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.636+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3395231116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f7801a60 con 0x5649f77fe190 2024-09-21T09:03:19.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.636+0000 7f8eb67fc640 1 -- 172.21.15.178:0/3395231116 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8fcc016040 con 0x5649f77fe190 2024-09-21T09:03:19.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.637+0000 7f8eb67fc640 1 --2- 172.21.15.178:0/3395231116 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ea8036b90 0x7f8ea8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.637+0000 7f8eb67fc640 1 -- 172.21.15.178:0/3395231116 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8fcc01f030 con 0x5649f77fe190 2024-09-21T09:03:19.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.637+0000 7f8fd0c97640 1 --2- 172.21.15.178:0/3395231116 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ea8036b90 0x7f8ea8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.637+0000 7f8fd4f42800 1 Processor -- start 2024-09-21T09:03:19.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.637+0000 7f8fd4f42800 1 -- start start 2024-09-21T09:03:19.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.637+0000 7f8fd0c97640 1 --2- 172.21.15.178:0/3395231116 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ea8036b90 0x7f8ea8039050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5649f77eae50 tx=0x7f8fc006ca10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.637+0000 7f8fd4f42800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f780ad90 0x5649f780b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.637+0000 7f8fd4f42800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5649f77dc1b0 con 0x5649f780ad90 2024-09-21T09:03:19.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.637+0000 7f8fd1498640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f780ad90 0x5649f780b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.637+0000 7f8fd1498640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f780ad90 0x5649f780b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43074/0 (socket says 172.21.15.178:43074) 2024-09-21T09:03:19.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.637+0000 7f8fd1498640 1 -- 172.21.15.178:0/2667383174 learned_addr learned my addr 172.21.15.178:0/2667383174 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.637+0000 7f8fd1498640 1 -- 172.21.15.178:0/2667383174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f780b760 con 0x5649f780ad90 2024-09-21T09:03:19.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.638+0000 7f8fd1498640 1 --2- 172.21.15.178:0/2667383174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f780ad90 0x5649f780b190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc022470 tx=0x7f8fcc017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7fab03af6d4cc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.638+0000 7f8ea7fff640 1 -- 172.21.15.178:0/2667383174 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc01d030 con 0x5649f780ad90 2024-09-21T09:03:19.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.638+0000 7f8ea7fff640 1 -- 172.21.15.178:0/2667383174 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc015d00 con 0x5649f780ad90 2024-09-21T09:03:19.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.638+0000 7f8ea7fff640 1 -- 172.21.15.178:0/2667383174 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc0197a0 con 0x5649f780ad90 2024-09-21T09:03:19.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.638+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2667383174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f780ad90 msgr2=0x5649f780b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.638+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/2667383174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f780ad90 0x5649f780b190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc022470 tx=0x7f8fcc017fa0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.638+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2667383174 shutdown_connections 2024-09-21T09:03:19.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.638+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/2667383174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f780ad90 0x5649f780b190 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.638+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2667383174 >> 172.21.15.178:0/2667383174 conn(0x5649f78070f0 msgr2=0x5649f78051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.638+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2667383174 shutdown_connections 2024-09-21T09:03:19.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.638+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2667383174 wait complete. 2024-09-21T09:03:19.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.639+0000 7f8fd4f42800 1 Processor -- start 2024-09-21T09:03:19.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.639+0000 7f8fd4f42800 1 -- start start 2024-09-21T09:03:19.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.639+0000 7f8fd4f42800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f780ad90 0x5649f7812200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.639+0000 7f8fd4f42800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5649f780bdd0 con 0x5649f780ad90 2024-09-21T09:03:19.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.639+0000 7f8fd1498640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f780ad90 0x5649f7812200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.639+0000 7f8fd1498640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f780ad90 0x5649f7812200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43076/0 (socket says 172.21.15.178:43076) 2024-09-21T09:03:19.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.639+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 learned_addr learned my addr 172.21.15.178:0/111297977 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.639+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f7812740 con 0x5649f780ad90 2024-09-21T09:03:19.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.640+0000 7f8fd1498640 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f780ad90 0x5649f7812200 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc017fe0 tx=0x7f8fcc04ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.640+0000 7f8ea67fc640 1 -- 172.21.15.178:0/111297977 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc019b20 con 0x5649f780ad90 2024-09-21T09:03:19.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.640+0000 7f8ea67fc640 1 -- 172.21.15.178:0/111297977 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0153e0 con 0x5649f780ad90 2024-09-21T09:03:19.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.640+0000 7f8ea67fc640 1 -- 172.21.15.178:0/111297977 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fcc019cc0 con 0x5649f780ad90 2024-09-21T09:03:19.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.640+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649f78129d0 con 0x5649f780ad90 2024-09-21T09:03:19.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.640+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f7815680 con 0x5649f780ad90 2024-09-21T09:03:19.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.640+0000 7f8ea67fc640 1 -- 172.21.15.178:0/111297977 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8fcc02b350 con 0x5649f780ad90 2024-09-21T09:03:19.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.641+0000 7f8ea67fc640 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8e9c036a70 0x7f8e9c038f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.641+0000 7f8ea67fc640 1 -- 172.21.15.178:0/111297977 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8fcc043aa0 con 0x5649f780ad90 2024-09-21T09:03:19.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.641+0000 7f8fd0c97640 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8e9c036a70 0x7f8e9c038f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.641+0000 7f8fd4f42800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.641+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5649f781dc30 0x5649f78200f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.641+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f7820840 con 0x5649f781dc30 2024-09-21T09:03:19.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.641+0000 7f8fd0c97640 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8e9c036a70 0x7f8e9c038f30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0063fa0 tx=0x7f8fc0091000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.641+0000 7f8fc8496640 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5649f781dc30 0x5649f78200f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.641+0000 7f8fc8496640 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5649f781dc30 0x5649f78200f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fb8009050 con 0x5649f781dc30 2024-09-21T09:03:19.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 20 realm 2024-09-21T09:03:19.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f781d080 con 0x5649f781dc30 2024-09-21T09:03:19.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fb8009050 con 0x5649f781dc30 2024-09-21T09:03:19.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:19.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f7821320 con 0x5649f781dc30 2024-09-21T09:03:19.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fb8009050 con 0x5649f781dc30 2024-09-21T09:03:19.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f7821bf0 con 0x5649f781dc30 2024-09-21T09:03:19.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fb8009050 con 0x5649f781dc30 2024-09-21T09:03:19.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:19.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5649f78224a0 0x5649f7824890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.642+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f7824fd0 con 0x5649f78224a0 2024-09-21T09:03:19.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.643+0000 7f8fd1498640 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5649f78224a0 0x5649f7824890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.643+0000 7f8fd1498640 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5649f78224a0 0x5649f7824890 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.643+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.644+0000 7f8fd4f42800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:19.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.644+0000 7f8fd4f42800 20 searching for the correct realm 2024-09-21T09:03:19.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.644+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5649f7827080 0x5649f7829540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.644+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f7827080 2024-09-21T09:03:19.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.644+0000 7f8fd0c97640 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5649f7827080 0x5649f7829540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.644+0000 7f8fd0c97640 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5649f7827080 0x5649f7829540 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.644+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f7827080 2024-09-21T09:03:19.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.644+0000 7f8fd0c97640 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8fc007e3a0 0x7f8fc0086680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.644+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x7f8fc007e3a0 2024-09-21T09:03:19.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.644+0000 7f8fc8496640 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8fc007e3a0 0x7f8fc0086680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.645+0000 7f8fc8496640 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8fc007e3a0 0x7f8fc0086680 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.645+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb8009050 con 0x7f8fc007e3a0 2024-09-21T09:03:19.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.645+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f78224a0 2024-09-21T09:03:19.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.645+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.645+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f781dc30 2024-09-21T09:03:19.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.645+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb8009050 con 0x5649f781dc30 2024-09-21T09:03:19.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.646+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f781dc30 2024-09-21T09:03:19.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.646+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb8029040 con 0x5649f781dc30 2024-09-21T09:03:19.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.646+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f78224a0 2024-09-21T09:03:19.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.646+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.646+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f78224a0 2024-09-21T09:03:19.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.646+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.646+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x7f8fc007e3a0 2024-09-21T09:03:19.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.646+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb8029040 con 0x7f8fc007e3a0 2024-09-21T09:03:19.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.646+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f7827080 2024-09-21T09:03:19.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.647+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f7827080 2024-09-21T09:03:19.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.647+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f781dc30 2024-09-21T09:03:19.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.647+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb8029040 con 0x5649f781dc30 2024-09-21T09:03:19.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.647+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f78224a0 2024-09-21T09:03:19.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.647+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.647+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f781dc30 2024-09-21T09:03:19.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.647+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb8029040 con 0x5649f781dc30 2024-09-21T09:03:19.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.647+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x7f8fc007e3a0 2024-09-21T09:03:19.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.648+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8fb8029040 con 0x7f8fc007e3a0 2024-09-21T09:03:19.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.648+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f7827080 2024-09-21T09:03:19.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.648+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f7827080 2024-09-21T09:03:19.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.648+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f7827080 2024-09-21T09:03:19.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.648+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f7827080 2024-09-21T09:03:19.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.648+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f78224a0 2024-09-21T09:03:19.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.648+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.648+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f7827080 2024-09-21T09:03:19.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.649+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f7827080 2024-09-21T09:03:19.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.649+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f7827080 2024-09-21T09:03:19.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.649+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f7827080 2024-09-21T09:03:19.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.649+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f781dc30 2024-09-21T09:03:19.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.649+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8fb8029040 con 0x5649f781dc30 2024-09-21T09:03:19.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.649+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f781dc30 2024-09-21T09:03:19.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.649+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8fb8029040 con 0x5649f781dc30 2024-09-21T09:03:19.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.649+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f78224a0 2024-09-21T09:03:19.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.650+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.650+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f7827080 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.650+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f7827080 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.650+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x7f8fc007e3a0 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.650+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb8029040 con 0x7f8fc007e3a0 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.650+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f781dc30 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.650+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb8029040 con 0x5649f781dc30 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.650+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f78224a0 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.651+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.651+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f7827080 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.651+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f7827080 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.651+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f78224a0 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.651+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.651+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x7f8fc007e3a0 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.652+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb8029040 con 0x7f8fc007e3a0 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.652+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f7827080 2024-09-21T09:03:19.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.652+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f7827080 2024-09-21T09:03:19.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.652+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f78224a0 2024-09-21T09:03:19.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.652+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.652+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x5649f781dc30 2024-09-21T09:03:19.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.652+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8fb8029040 con 0x5649f781dc30 2024-09-21T09:03:19.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.652+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5649f7829c10 con 0x7f8fc007e3a0 2024-09-21T09:03:19.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb8029040 con 0x7f8fc007e3a0 2024-09-21T09:03:19.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:19.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:19.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:19.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:19.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:19.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:19.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f7825a80 con 0x5649f781dc30 2024-09-21T09:03:19.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fb8029040 con 0x5649f781dc30 2024-09-21T09:03:19.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f7825f00 con 0x5649f781dc30 2024-09-21T09:03:19.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fb8029040 con 0x5649f781dc30 2024-09-21T09:03:19.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:19.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f78263e0 con 0x5649f781dc30 2024-09-21T09:03:19.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8fb803d040 con 0x5649f781dc30 2024-09-21T09:03:19.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:19.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 zone default found 2024-09-21T09:03:19.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 4 Realm: () 2024-09-21T09:03:19.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:19.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:19.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:19.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 zonegroup default 2024-09-21T09:03:19.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.653+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f782a090 con 0x5649f78224a0 2024-09-21T09:03:19.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.654+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.654+0000 7f8fd4f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.654+0000 7f8fd4f42800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.654+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f782c2c0 con 0x5649f7827080 2024-09-21T09:03:19.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.654+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f7827080 2024-09-21T09:03:19.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.654+0000 7f8fd4f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.654+0000 7f8fd4f42800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.654+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f782c660 con 0x5649f7827080 2024-09-21T09:03:19.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.654+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f7827080 2024-09-21T09:03:19.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.654+0000 7f8fd4f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.654+0000 7f8fd4f42800 20 started sync module instance, tier type = 2024-09-21T09:03:19.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.654+0000 7f8fd4f42800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:19.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.654+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782b700 con 0x7f8fc007e3a0 2024-09-21T09:03:19.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.655+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb803d040 con 0x7f8fc007e3a0 2024-09-21T09:03:19.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.655+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94875685141232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782b700 con 0x7f8fc007e3a0 2024-09-21T09:03:19.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.655+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782d020 con 0x5649f781dc30 2024-09-21T09:03:19.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.656+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94875685141232] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb803d040 con 0x7f8fc007e3a0 2024-09-21T09:03:19.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.657+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb803d040 con 0x5649f781dc30 2024-09-21T09:03:19.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.657+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94875685139296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782d020 con 0x5649f781dc30 2024-09-21T09:03:19.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.657+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782d9e0 con 0x5649f7827080 2024-09-21T09:03:19.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.658+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f7827080 2024-09-21T09:03:19.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.658+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94875685147952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782e230 con 0x5649f7827080 2024-09-21T09:03:19.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.658+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782ecd0 con 0x7f8fc007e3a0 2024-09-21T09:03:19.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.658+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94875685139296] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb803d040 con 0x5649f781dc30 2024-09-21T09:03:19.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.659+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb803d040 con 0x7f8fc007e3a0 2024-09-21T09:03:19.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.659+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94875685152672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782f0c0 con 0x7f8fc007e3a0 2024-09-21T09:03:19.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.659+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782fae0 con 0x5649f781dc30 2024-09-21T09:03:19.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.659+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94875685147952] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f7827080 2024-09-21T09:03:19.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.660+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb803d040 con 0x5649f781dc30 2024-09-21T09:03:19.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.660+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94875685156304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782faa0 con 0x5649f781dc30 2024-09-21T09:03:19.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.660+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f78304f0 con 0x5649f78224a0 2024-09-21T09:03:19.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.660+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94875685152672] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb803d040 con 0x7f8fc007e3a0 2024-09-21T09:03:19.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.661+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.661+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94875685156304] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb803d040 con 0x5649f781dc30 2024-09-21T09:03:19.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.661+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94875685145456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f78304f0 con 0x5649f78224a0 2024-09-21T09:03:19.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.661+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782dd80 con 0x5649f78224a0 2024-09-21T09:03:19.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.662+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94875685145456] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.662+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.662+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94875685158976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f7830460 con 0x5649f78224a0 2024-09-21T09:03:19.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.662+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f78313b0 con 0x5649f78224a0 2024-09-21T09:03:19.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.663+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94875685158976] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.663+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.663+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94875685161552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f7831320 con 0x5649f78224a0 2024-09-21T09:03:19.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.663+0000 7f8fd4f42800 20 add_watcher() i=0 2024-09-21T09:03:19.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.663+0000 7f8fd4f42800 20 add_watcher() i=1 2024-09-21T09:03:19.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.663+0000 7f8fd4f42800 20 add_watcher() i=2 2024-09-21T09:03:19.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.663+0000 7f8fd4f42800 20 add_watcher() i=3 2024-09-21T09:03:19.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.663+0000 7f8fd4f42800 20 add_watcher() i=4 2024-09-21T09:03:19.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.663+0000 7f8fd4f42800 20 add_watcher() i=5 2024-09-21T09:03:19.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.663+0000 7f8fd4f42800 20 add_watcher() i=6 2024-09-21T09:03:19.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.664+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94875685161552] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.664+0000 7f8fd4f42800 20 add_watcher() i=7 2024-09-21T09:03:19.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.664+0000 7f8fd4f42800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:19.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.664+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f78347e0 con 0x5649f781dc30 2024-09-21T09:03:19.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.664+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8fb803d040 con 0x5649f781dc30 2024-09-21T09:03:19.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.664+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94875685163072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f7831c90 con 0x5649f781dc30 2024-09-21T09:03:19.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.665+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94875685163072] v29'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fb803d040 con 0x5649f781dc30 2024-09-21T09:03:19.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.665+0000 7f8e877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:19.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.665+0000 7f8fd4f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:19.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.665+0000 7f8fd4f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:19.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.665+0000 7f8fd4f42800 5 note: GC not initialized 2024-09-21T09:03:19.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.665+0000 7f8e867e4640 20 reqs_thread_entry: start 2024-09-21T09:03:19.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.666+0000 7f8fd4f42800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:19.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.666+0000 7f8fd4f42800 20 Filter name: none 2024-09-21T09:03:19.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.666+0000 7f8e7f7fe640 20 reqs_thread_entry: start 2024-09-21T09:03:19.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.666+0000 7f8fd4f42800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.666+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f7867820 con 0x5649f781dc30 2024-09-21T09:03:19.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.666+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8fb803d040 con 0x5649f781dc30 2024-09-21T09:03:19.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.666+0000 7f8fd4f42800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:19.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.666+0000 7f8fd4f42800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.666+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f7868210 con 0x5649f781dc30 2024-09-21T09:03:19.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.666+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8fb803d040 con 0x5649f781dc30 2024-09-21T09:03:19.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.666+0000 7f8fd4f42800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:19.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.667+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5649f7869220 con 0x7f8fc007e3a0 2024-09-21T09:03:19.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.667+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f8fb803d040 con 0x7f8fc007e3a0 2024-09-21T09:03:19.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.668+0000 7f8e877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:19.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.668+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94875685163072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f78655d0 con 0x5649f781dc30 2024-09-21T09:03:19.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.669+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94875685163072] v29'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fb803d040 con 0x5649f781dc30 2024-09-21T09:03:19.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.669+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94875685141232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f78655d0 con 0x7f8fc007e3a0 2024-09-21T09:03:19.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.669+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94875685141232] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb803d040 con 0x7f8fc007e3a0 2024-09-21T09:03:19.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.669+0000 7f8fd4f42800 20 remove_watcher() i=0 2024-09-21T09:03:19.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.669+0000 7f8fd4f42800 2 removed watcher, disabling cache 2024-09-21T09:03:19.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.669+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94875685139296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f78655d0 con 0x5649f781dc30 2024-09-21T09:03:19.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.671+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94875685139296] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb803d040 con 0x5649f781dc30 2024-09-21T09:03:19.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.671+0000 7f8fd4f42800 20 remove_watcher() i=1 2024-09-21T09:03:19.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.671+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94875685147952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f78655d0 con 0x5649f7827080 2024-09-21T09:03:19.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.672+0000 7f8fd0c97640 1 -- 172.21.15.178:0/111297977 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94875685147952] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0063c90 con 0x5649f7827080 2024-09-21T09:03:19.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.672+0000 7f8fd4f42800 20 remove_watcher() i=2 2024-09-21T09:03:19.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.672+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94875685152672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782d530 con 0x7f8fc007e3a0 2024-09-21T09:03:19.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.673+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94875685152672] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb803d040 con 0x7f8fc007e3a0 2024-09-21T09:03:19.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.673+0000 7f8fd4f42800 20 remove_watcher() i=3 2024-09-21T09:03:19.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.673+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94875685156304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782e7a0 con 0x5649f781dc30 2024-09-21T09:03:19.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.674+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94875685156304] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb803d040 con 0x5649f781dc30 2024-09-21T09:03:19.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.674+0000 7f8fd4f42800 20 remove_watcher() i=4 2024-09-21T09:03:19.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.674+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94875685145456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782d530 con 0x5649f78224a0 2024-09-21T09:03:19.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.675+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94875685145456] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.675+0000 7f8fd4f42800 20 remove_watcher() i=5 2024-09-21T09:03:19.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.675+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94875685158976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782cb70 con 0x5649f78224a0 2024-09-21T09:03:19.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.676+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94875685158976] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.676+0000 7f8fd4f42800 20 remove_watcher() i=6 2024-09-21T09:03:19.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.676+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94875685161552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5649f782d530 con 0x5649f78224a0 2024-09-21T09:03:19.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd1498640 1 -- 172.21.15.178:0/111297977 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94875685161552] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fcc056040 con 0x5649f78224a0 2024-09-21T09:03:19.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 20 remove_watcher() i=7 2024-09-21T09:03:19.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5649f78224a0 msgr2=0x5649f7824890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5649f78224a0 0x5649f7824890 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5649f781dc30 msgr2=0x5649f78200f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5649f781dc30 0x5649f78200f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8fc007e3a0 msgr2=0x7f8fc0086680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8fc007e3a0 0x7f8fc0086680 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5649f7827080 msgr2=0x5649f7829540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5649f7827080 0x5649f7829540 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8e9c036a70 msgr2=0x7f8e9c038f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8e9c036a70 0x7f8e9c038f30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0063fa0 tx=0x7f8fc0091000 comp rx=0 tx=0).stop 2024-09-21T09:03:19.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f780ad90 msgr2=0x5649f7812200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fc8496640 1 -- 172.21.15.178:0/111297977 reap_dead start 2024-09-21T09:03:19.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f780ad90 0x5649f7812200 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc017fe0 tx=0x7f8fcc04ce20 comp rx=0 tx=0).stop 2024-09-21T09:03:19.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 shutdown_connections 2024-09-21T09:03:19.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/111297977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f780ad90 0x5649f7812200 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 >> 172.21.15.178:0/111297977 conn(0x5649f78070f0 msgr2=0x5649f78051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 shutdown_connections 2024-09-21T09:03:19.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 -- 172.21.15.178:0/111297977 wait complete. 2024-09-21T09:03:19.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3395231116 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ea8036b90 msgr2=0x7f8ea8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/3395231116 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ea8036b90 0x7f8ea8039050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5649f77eae50 tx=0x7f8fc006ca10 comp rx=0 tx=0).stop 2024-09-21T09:03:19.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3395231116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f77fe190 msgr2=0x5649f77fe5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/3395231116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f77fe190 0x5649f77fe5b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5649f77e44b0 tx=0x7f8fcc00aec0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3395231116 shutdown_connections 2024-09-21T09:03:19.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/3395231116 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ea8036b90 0x7f8ea8039050 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.677+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/3395231116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f77fe190 0x5649f77fe5b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3395231116 >> 172.21.15.178:0/3395231116 conn(0x5649f77f3120 msgr2=0x5649f77f5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3395231116 shutdown_connections 2024-09-21T09:03:19.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 -- 172.21.15.178:0/3395231116 wait complete. 2024-09-21T09:03:19.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5649f77ecce0 msgr2=0x5649f77ef0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5649f77ecce0 0x5649f77ef0d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5649f76efbd0 msgr2=0x5649f77ea470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5649f76efbd0 0x5649f77ea470 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8eb8036b40 msgr2=0x7f8eb8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8eb8036b40 0x7f8eb8039000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8000f60 tx=0x7f8fb80012b0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 msgr2=0x5649f77e3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f77e3400 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0065040 tx=0x7f8fc0003330 comp rx=0 tx=0).stop 2024-09-21T09:03:19.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 shutdown_connections 2024-09-21T09:03:19.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5649f77ecce0 0x5649f77ef0d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5649f76efbd0 0x5649f77ea470 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8eb8036b40 0x7f8eb8039000 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 --2- 172.21.15.178:0/2435984621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649f765e5f0 0x5649f77e3400 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 >> 172.21.15.178:0/2435984621 conn(0x5649f76e4de0 msgr2=0x5649f77d5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 shutdown_connections 2024-09-21T09:03:19.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.678+0000 7f8fd4f42800 1 -- 172.21.15.178:0/2435984621 wait complete. 2024-09-21T09:03:19.691 INFO:teuthology.orchestra.run.smithi178.stdout:["myfoo"] 2024-09-21T09:03:19.692 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-21T09:03:19.694 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:19.695 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-21T09:03:19.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-21T09:03:19.695 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-21T09:03:19.737 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:19.737 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:19.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.736+0000 7fea46939800 1 Processor -- start 2024-09-21T09:03:19.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.736+0000 7fea46939800 1 -- start start 2024-09-21T09:03:19.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.736+0000 7fea46939800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55efcaf9d5a0 0x55efcb02c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.736+0000 7fea46939800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55efcaee8b30 con 0x55efcb02c800 2024-09-21T09:03:19.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.736+0000 7fea46939800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55efcaeca360 con 0x55efcaf9d5a0 2024-09-21T09:03:19.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.737+0000 7fea425f5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55efcaf9d5a0 0x55efcb02c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.737+0000 7fea39df4640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55efcb02c800 0x55efcb02ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46730/0 (socket says 172.21.15.178:46730) 2024-09-21T09:03:19.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.737+0000 7fea39df4640 1 -- 172.21.15.178:0/4214600905 learned_addr learned my addr 172.21.15.178:0/4214600905 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:19.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.737+0000 7fea41df4640 1 -- 172.21.15.178:0/4214600905 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1455356454 0 0) 0x55efcaee8b30 con 0x55efcb02c800 2024-09-21T09:03:19.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.737+0000 7fea41df4640 1 -- 172.21.15.178:0/4214600905 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea30001e10 con 0x55efcb02c800 2024-09-21T09:03:19.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.737+0000 7fea425f5640 1 -- 172.21.15.178:0/4214600905 >> v1:172.21.15.44:6789/0 conn(0x55efcb02c800 legacy=0x55efcb02ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.737+0000 7fea425f5640 1 -- 172.21.15.178:0/4214600905 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcaef0e00 con 0x55efcaf9d5a0 2024-09-21T09:03:19.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.739+0000 7fea425f5640 1 --2- 172.21.15.178:0/4214600905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb02c2c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fea3400a470 tx=0x7fea34045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b411cf972a7d34b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.739+0000 7fea41df4640 1 -- 172.21.15.178:0/4214600905 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea34059070 con 0x55efcaf9d5a0 2024-09-21T09:03:19.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.739+0000 7fea41df4640 1 -- 172.21.15.178:0/4214600905 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea34054570 con 0x55efcaf9d5a0 2024-09-21T09:03:19.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.739+0000 7fea41df4640 1 -- 172.21.15.178:0/4214600905 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea34054850 con 0x55efcaf9d5a0 2024-09-21T09:03:19.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.739+0000 7fea46939800 1 -- 172.21.15.178:0/4214600905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 msgr2=0x55efcb02c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.739+0000 7fea46939800 1 --2- 172.21.15.178:0/4214600905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb02c2c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fea3400a470 tx=0x7fea34045920 comp rx=0 tx=0).stop 2024-09-21T09:03:19.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.739+0000 7fea46939800 1 -- 172.21.15.178:0/4214600905 shutdown_connections 2024-09-21T09:03:19.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.739+0000 7fea46939800 1 --2- 172.21.15.178:0/4214600905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb02c2c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.739+0000 7fea46939800 1 -- 172.21.15.178:0/4214600905 >> 172.21.15.178:0/4214600905 conn(0x55efcb023dd0 msgr2=0x55efcb0261f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.739+0000 7fea46939800 1 -- 172.21.15.178:0/4214600905 shutdown_connections 2024-09-21T09:03:19.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.740+0000 7fea46939800 1 -- 172.21.15.178:0/4214600905 wait complete. 2024-09-21T09:03:19.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.753+0000 7fea46939800 1 Processor -- start 2024-09-21T09:03:19.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.753+0000 7fea46939800 1 -- start start 2024-09-21T09:03:19.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.753+0000 7fea46939800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb118670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.753+0000 7fea46939800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55efcaf75320 con 0x55efcaf9d5a0 2024-09-21T09:03:19.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.754+0000 7fea425f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb118670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.754+0000 7fea425f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb118670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43096/0 (socket says 172.21.15.178:43096) 2024-09-21T09:03:19.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.754+0000 7fea425f5640 1 -- 172.21.15.178:0/3653215539 learned_addr learned my addr 172.21.15.178:0/3653215539 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.754+0000 7fea425f5640 1 -- 172.21.15.178:0/3653215539 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcaec2bc0 con 0x55efcaf9d5a0 2024-09-21T09:03:19.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.754+0000 7fea425f5640 1 --2- 172.21.15.178:0/3653215539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb118670 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fea34025b20 tx=0x7fea3404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967214eb5db0f470 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.754+0000 7fe930608640 1 -- 172.21.15.178:0/3653215539 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea34062070 con 0x55efcaf9d5a0 2024-09-21T09:03:19.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.754+0000 7fe930608640 1 -- 172.21.15.178:0/3653215539 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3400a230 con 0x55efcaf9d5a0 2024-09-21T09:03:19.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.754+0000 7fe930608640 1 -- 172.21.15.178:0/3653215539 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea34059040 con 0x55efcaf9d5a0 2024-09-21T09:03:19.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.755+0000 7fea46939800 1 -- 172.21.15.178:0/3653215539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 msgr2=0x55efcb118670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.755+0000 7fea46939800 1 --2- 172.21.15.178:0/3653215539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb118670 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fea34025b20 tx=0x7fea3404e000 comp rx=0 tx=0).stop 2024-09-21T09:03:19.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.755+0000 7fea46939800 1 -- 172.21.15.178:0/3653215539 shutdown_connections 2024-09-21T09:03:19.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.755+0000 7fea46939800 1 --2- 172.21.15.178:0/3653215539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb118670 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.755+0000 7fea46939800 1 -- 172.21.15.178:0/3653215539 >> 172.21.15.178:0/3653215539 conn(0x55efcb023dd0 msgr2=0x55efcb114030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.755+0000 7fea46939800 1 -- 172.21.15.178:0/3653215539 shutdown_connections 2024-09-21T09:03:19.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.755+0000 7fea46939800 1 -- 172.21.15.178:0/3653215539 wait complete. 2024-09-21T09:03:19.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.756+0000 7fea46939800 1 Processor -- start 2024-09-21T09:03:19.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.756+0000 7fea46939800 1 -- start start 2024-09-21T09:03:19.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.756+0000 7fea46939800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb120030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.756+0000 7fea46939800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55efcb0306a0 con 0x55efcaf9d5a0 2024-09-21T09:03:19.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.756+0000 7fea425f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb120030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.756+0000 7fea425f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb120030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43108/0 (socket says 172.21.15.178:43108) 2024-09-21T09:03:19.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.756+0000 7fea425f5640 1 -- 172.21.15.178:0/224969784 learned_addr learned my addr 172.21.15.178:0/224969784 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.756+0000 7fea425f5640 1 -- 172.21.15.178:0/224969784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcaed6fe0 con 0x55efcaf9d5a0 2024-09-21T09:03:19.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.756+0000 7fea425f5640 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb120030 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fea34045960 tx=0x7fea34002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.757+0000 7fe92ee05640 1 -- 172.21.15.178:0/224969784 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea34062070 con 0x55efcaf9d5a0 2024-09-21T09:03:19.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.757+0000 7fe92ee05640 1 -- 172.21.15.178:0/224969784 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea34054910 con 0x55efcaf9d5a0 2024-09-21T09:03:19.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.757+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efcb120570 con 0x55efcaf9d5a0 2024-09-21T09:03:19.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.757+0000 7fe92ee05640 1 -- 172.21.15.178:0/224969784 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea34059040 con 0x55efcaf9d5a0 2024-09-21T09:03:19.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.757+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efcb120a90 con 0x55efcaf9d5a0 2024-09-21T09:03:19.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.757+0000 7fe92ee05640 1 -- 172.21.15.178:0/224969784 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fea34065040 con 0x55efcaf9d5a0 2024-09-21T09:03:19.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.758+0000 7fe92ee05640 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe928036b90 0x7fe928039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.758+0000 7fe92ee05640 1 -- 172.21.15.178:0/224969784 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fea3408f910 con 0x55efcaf9d5a0 2024-09-21T09:03:19.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.758+0000 7fea39df4640 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe928036b90 0x7fe928039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.758+0000 7fea46939800 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55efcb02c800 0x55efcb1270a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.758+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1275e0 con 0x55efcb02c800 2024-09-21T09:03:19.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.758+0000 7fea42df6640 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55efcb02c800 0x55efcb1270a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.758+0000 7fea39df4640 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe928036b90 0x7fe928039050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea2c000f60 tx=0x7fea2c0010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.758+0000 7fea42df6640 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55efcb02c800 0x55efcb1270a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.758+0000 7fea42df6640 1 -- 172.21.15.178:0/224969784 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea3c00a4a0 con 0x55efcb02c800 2024-09-21T09:03:19.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.758+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb124650 con 0x55efcb02c800 2024-09-21T09:03:19.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.759+0000 7fea42df6640 1 -- 172.21.15.178:0/224969784 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea3c00a4a0 con 0x55efcb02c800 2024-09-21T09:03:19.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.759+0000 7fea46939800 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55efcb1298b0 0x55efcb12bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.759+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb12c340 con 0x55efcb1298b0 2024-09-21T09:03:19.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.759+0000 7fea425f5640 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55efcb1298b0 0x55efcb12bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.759+0000 7fea425f5640 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55efcb1298b0 0x55efcb12bca0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.760+0000 7fea425f5640 1 -- 172.21.15.178:0/224969784 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fea3405c040 con 0x55efcb1298b0 2024-09-21T09:03:19.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.760+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb128750 con 0x55efcb02c800 2024-09-21T09:03:19.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.760+0000 7fea42df6640 1 -- 172.21.15.178:0/224969784 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea3c00a4a0 con 0x55efcb02c800 2024-09-21T09:03:19.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.760+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb128c30 con 0x55efcb02c800 2024-09-21T09:03:19.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.760+0000 7fea42df6640 1 -- 172.21.15.178:0/224969784 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fea3c00a4a0 con 0x55efcb02c800 2024-09-21T09:03:19.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.761+0000 7fea46939800 1 Processor -- start 2024-09-21T09:03:19.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.761+0000 7fea46939800 1 -- start start 2024-09-21T09:03:19.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.761+0000 7fea46939800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb13ad00 0x55efcb13b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.761+0000 7fea46939800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55efcaec4580 con 0x55efcb13ad00 2024-09-21T09:03:19.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.761+0000 7fea42df6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb13ad00 0x55efcb13b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.761+0000 7fea42df6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb13ad00 0x55efcb13b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43120/0 (socket says 172.21.15.178:43120) 2024-09-21T09:03:19.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.761+0000 7fea42df6640 1 -- 172.21.15.178:0/789977009 learned_addr learned my addr 172.21.15.178:0/789977009 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.761+0000 7fea42df6640 1 -- 172.21.15.178:0/789977009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcb13b660 con 0x55efcb13ad00 2024-09-21T09:03:19.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.761+0000 7fea42df6640 1 --2- 172.21.15.178:0/789977009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb13ad00 0x55efcb13b120 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55efcb1210e0 tx=0x7fea3c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.762+0000 7fe927fff640 1 -- 172.21.15.178:0/789977009 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea3c014450 con 0x55efcb13ad00 2024-09-21T09:03:19.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.762+0000 7fe927fff640 1 -- 172.21.15.178:0/789977009 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c0145f0 con 0x55efcb13ad00 2024-09-21T09:03:19.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.762+0000 7fea46939800 1 -- 172.21.15.178:0/789977009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efcb13b8f0 con 0x55efcb13ad00 2024-09-21T09:03:19.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.762+0000 7fe927fff640 1 -- 172.21.15.178:0/789977009 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea3c0148d0 con 0x55efcb13ad00 2024-09-21T09:03:19.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.762+0000 7fea46939800 1 -- 172.21.15.178:0/789977009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efcb13e5d0 con 0x55efcb13ad00 2024-09-21T09:03:19.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.762+0000 7fe927fff640 1 -- 172.21.15.178:0/789977009 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fea3c011040 con 0x55efcb13ad00 2024-09-21T09:03:19.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.763+0000 7fe927fff640 1 --2- 172.21.15.178:0/789977009 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe91c036b90 0x7fe91c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.763+0000 7fe927fff640 1 -- 172.21.15.178:0/789977009 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fea3c01e070 con 0x55efcb13ad00 2024-09-21T09:03:19.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.763+0000 7fea425f5640 1 --2- 172.21.15.178:0/789977009 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe91c036b90 0x7fe91c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.763+0000 7fea46939800 1 Processor -- start 2024-09-21T09:03:19.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.763+0000 7fea425f5640 1 --2- 172.21.15.178:0/789977009 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe91c036b90 0x7fe91c039050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55efcb1279f0 tx=0x7fea3408dd80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.763+0000 7fea46939800 1 -- start start 2024-09-21T09:03:19.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.763+0000 7fea46939800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb029540 0x55efcb029940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.763+0000 7fea46939800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55efcb118d60 con 0x55efcb029540 2024-09-21T09:03:19.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.763+0000 7fea42df6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb029540 0x55efcb029940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.763+0000 7fea42df6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb029540 0x55efcb029940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43136/0 (socket says 172.21.15.178:43136) 2024-09-21T09:03:19.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.763+0000 7fea42df6640 1 -- 172.21.15.178:0/4233655730 learned_addr learned my addr 172.21.15.178:0/4233655730 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.764+0000 7fea42df6640 1 -- 172.21.15.178:0/4233655730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcb029f10 con 0x55efcb029540 2024-09-21T09:03:19.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.764+0000 7fea42df6640 1 --2- 172.21.15.178:0/4233655730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb029540 0x55efcb029940 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fea3c04cb40 tx=0x7fea3c03bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b53e9e43714b71 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.764+0000 7fe925ffb640 1 -- 172.21.15.178:0/4233655730 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea3c013cb0 con 0x55efcb029540 2024-09-21T09:03:19.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.764+0000 7fe925ffb640 1 -- 172.21.15.178:0/4233655730 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c013e50 con 0x55efcb029540 2024-09-21T09:03:19.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.764+0000 7fe925ffb640 1 -- 172.21.15.178:0/4233655730 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea3c04e200 con 0x55efcb029540 2024-09-21T09:03:19.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.764+0000 7fea46939800 1 -- 172.21.15.178:0/4233655730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb029540 msgr2=0x55efcb029940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.764+0000 7fea46939800 1 --2- 172.21.15.178:0/4233655730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb029540 0x55efcb029940 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fea3c04cb40 tx=0x7fea3c03bf20 comp rx=0 tx=0).stop 2024-09-21T09:03:19.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.764+0000 7fea46939800 1 -- 172.21.15.178:0/4233655730 shutdown_connections 2024-09-21T09:03:19.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.764+0000 7fea46939800 1 --2- 172.21.15.178:0/4233655730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb029540 0x55efcb029940 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.764+0000 7fea46939800 1 -- 172.21.15.178:0/4233655730 >> 172.21.15.178:0/4233655730 conn(0x55efcb143d00 msgr2=0x55efcb141e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.764+0000 7fea46939800 1 -- 172.21.15.178:0/4233655730 shutdown_connections 2024-09-21T09:03:19.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.764+0000 7fea46939800 1 -- 172.21.15.178:0/4233655730 wait complete. 2024-09-21T09:03:19.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.765+0000 7fea46939800 1 Processor -- start 2024-09-21T09:03:19.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.765+0000 7fea46939800 1 -- start start 2024-09-21T09:03:19.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.765+0000 7fea46939800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb029540 0x55efcb150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.765+0000 7fea46939800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55efcb028220 con 0x55efcb029540 2024-09-21T09:03:19.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.765+0000 7fea42df6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb029540 0x55efcb150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.765+0000 7fea42df6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb029540 0x55efcb150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43144/0 (socket says 172.21.15.178:43144) 2024-09-21T09:03:19.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.765+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 learned_addr learned my addr 172.21.15.178:0/933708786 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:19.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.765+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcb151490 con 0x55efcb029540 2024-09-21T09:03:19.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.765+0000 7fea42df6640 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb029540 0x55efcb150f50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0117d0 tx=0x7fea3c04cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.766+0000 7fe913fff640 1 -- 172.21.15.178:0/933708786 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea3c02bc70 con 0x55efcb029540 2024-09-21T09:03:19.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.766+0000 7fe913fff640 1 -- 172.21.15.178:0/933708786 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c031070 con 0x55efcb029540 2024-09-21T09:03:19.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.766+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efcb151720 con 0x55efcb029540 2024-09-21T09:03:19.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.766+0000 7fe913fff640 1 -- 172.21.15.178:0/933708786 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea3c022a50 con 0x55efcb029540 2024-09-21T09:03:19.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.766+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efcb1543d0 con 0x55efcb029540 2024-09-21T09:03:19.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.766+0000 7fe913fff640 1 -- 172.21.15.178:0/933708786 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fea3c022bf0 con 0x55efcb029540 2024-09-21T09:03:19.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.767+0000 7fe913fff640 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe90c036b90 0x7fe90c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.767+0000 7fe913fff640 1 -- 172.21.15.178:0/933708786 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fea3c00e040 con 0x55efcb029540 2024-09-21T09:03:19.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.767+0000 7fea425f5640 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe90c036b90 0x7fe90c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.767+0000 7fea46939800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.767+0000 7fea46939800 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55efcb15cc00 0x55efcb15f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.767+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb15f810 con 0x55efcb15cc00 2024-09-21T09:03:19.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.767+0000 7fea39df4640 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55efcb15cc00 0x55efcb15f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.767+0000 7fea425f5640 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe90c036b90 0x7fe90c039050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fea340057c0 tx=0x7fea34087000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.767+0000 7fea39df4640 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55efcb15cc00 0x55efcb15f0c0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea2c009050 con 0x55efcb15cc00 2024-09-21T09:03:19.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 20 realm 2024-09-21T09:03:19.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb15c050 con 0x55efcb15cc00 2024-09-21T09:03:19.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea2c009050 con 0x55efcb15cc00 2024-09-21T09:03:19.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:19.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1602f0 con 0x55efcb15cc00 2024-09-21T09:03:19.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea2c009050 con 0x55efcb15cc00 2024-09-21T09:03:19.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb160bc0 con 0x55efcb15cc00 2024-09-21T09:03:19.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea2c009050 con 0x55efcb15cc00 2024-09-21T09:03:19.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:19.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55efcb161470 0x55efcb163880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb163fe0 con 0x55efcb161470 2024-09-21T09:03:19.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.768+0000 7fea42df6640 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55efcb161470 0x55efcb163880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.769+0000 7fea42df6640 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55efcb161470 0x55efcb163880 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.769+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.769+0000 7fea46939800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:19.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.769+0000 7fea46939800 20 searching for the correct realm 2024-09-21T09:03:19.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.769+0000 7fea46939800 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55efcb1660e0 0x55efcb1685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.769+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb1660e0 2024-09-21T09:03:19.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.769+0000 7fea425f5640 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55efcb1660e0 0x55efcb1685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.769+0000 7fea425f5640 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55efcb1660e0 0x55efcb1685a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.770+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.770+0000 7fea425f5640 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fea3408fbb0 0x7fea3406f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:19.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.770+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x7fea3408fbb0 2024-09-21T09:03:19.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.770+0000 7fea39df4640 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fea3408fbb0 0x7fea3406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:19.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.770+0000 7fea39df4640 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fea3408fbb0 0x7fea3406f400 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:19.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.770+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c009050 con 0x7fea3408fbb0 2024-09-21T09:03:19.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.770+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb161470 2024-09-21T09:03:19.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.771+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.771+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb15cc00 2024-09-21T09:03:19.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.771+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c009050 con 0x55efcb15cc00 2024-09-21T09:03:19.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.771+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb15cc00 2024-09-21T09:03:19.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.771+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c029040 con 0x55efcb15cc00 2024-09-21T09:03:19.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.771+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb161470 2024-09-21T09:03:19.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.771+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.771+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb161470 2024-09-21T09:03:19.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.772+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.772+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x7fea3408fbb0 2024-09-21T09:03:19.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.772+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c029040 con 0x7fea3408fbb0 2024-09-21T09:03:19.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.772+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb1660e0 2024-09-21T09:03:19.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.772+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.772+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb15cc00 2024-09-21T09:03:19.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.772+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c029040 con 0x55efcb15cc00 2024-09-21T09:03:19.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.772+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb161470 2024-09-21T09:03:19.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.773+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.773+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb15cc00 2024-09-21T09:03:19.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.773+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c029040 con 0x55efcb15cc00 2024-09-21T09:03:19.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.773+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x7fea3408fbb0 2024-09-21T09:03:19.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.773+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fea2c029040 con 0x7fea3408fbb0 2024-09-21T09:03:19.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.773+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb1660e0 2024-09-21T09:03:19.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.773+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.773+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb1660e0 2024-09-21T09:03:19.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.774+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.774+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb161470 2024-09-21T09:03:19.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.774+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.774+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb1660e0 2024-09-21T09:03:19.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.774+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.774+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb1660e0 2024-09-21T09:03:19.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.774+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.774+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb15cc00 2024-09-21T09:03:19.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.775+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fea2c029040 con 0x55efcb15cc00 2024-09-21T09:03:19.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.775+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb15cc00 2024-09-21T09:03:19.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.775+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fea2c029040 con 0x55efcb15cc00 2024-09-21T09:03:19.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.775+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb161470 2024-09-21T09:03:19.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.775+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.775+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb1660e0 2024-09-21T09:03:19.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.775+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.775+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x7fea3408fbb0 2024-09-21T09:03:19.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.776+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c029040 con 0x7fea3408fbb0 2024-09-21T09:03:19.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.776+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb15cc00 2024-09-21T09:03:19.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.776+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c029040 con 0x55efcb15cc00 2024-09-21T09:03:19.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.776+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb161470 2024-09-21T09:03:19.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.776+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.776+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb1660e0 2024-09-21T09:03:19.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.776+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.776+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb161470 2024-09-21T09:03:19.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.777+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.777+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x7fea3408fbb0 2024-09-21T09:03:19.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.777+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c029040 con 0x7fea3408fbb0 2024-09-21T09:03:19.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.777+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb1660e0 2024-09-21T09:03:19.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.777+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.777+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb161470 2024-09-21T09:03:19.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x55efcb15cc00 2024-09-21T09:03:19.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fea2c029040 con 0x55efcb15cc00 2024-09-21T09:03:19.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb168c70 con 0x7fea3408fbb0 2024-09-21T09:03:19.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c029040 con 0x7fea3408fbb0 2024-09-21T09:03:19.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea46939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:19.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea46939800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:19.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea46939800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:19.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea46939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:19.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea46939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:19.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea46939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:19.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea46939800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164ae0 con 0x55efcb15cc00 2024-09-21T09:03:19.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea2c029040 con 0x55efcb15cc00 2024-09-21T09:03:19.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea46939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea46939800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.778+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164f30 con 0x55efcb15cc00 2024-09-21T09:03:19.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea2c029040 con 0x55efcb15cc00 2024-09-21T09:03:19.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:19.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1653d0 con 0x55efcb15cc00 2024-09-21T09:03:19.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:19.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 20 zone default found 2024-09-21T09:03:19.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 4 Realm: () 2024-09-21T09:03:19.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:19.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:19.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:19.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 20 zonegroup default 2024-09-21T09:03:19.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb161470 2024-09-21T09:03:19.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16b320 con 0x55efcb1660e0 2024-09-21T09:03:19.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.779+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.780+0000 7fea46939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.780+0000 7fea46939800 20 rados->read ofs=0 len=0 2024-09-21T09:03:19.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.780+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16b6c0 con 0x55efcb1660e0 2024-09-21T09:03:19.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.780+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.780+0000 7fea46939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:19.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.780+0000 7fea46939800 20 started sync module instance, tier type = 2024-09-21T09:03:19.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.780+0000 7fea46939800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:19.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.780+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16a760 con 0x7fea3408fbb0 2024-09-21T09:03:19.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.781+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c03d040 con 0x7fea3408fbb0 2024-09-21T09:03:19.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.781+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94488392805248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16a760 con 0x7fea3408fbb0 2024-09-21T09:03:19.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.781+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16bf70 con 0x55efcb15cc00 2024-09-21T09:03:19.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.782+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.782+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94488392809056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16bf30 con 0x55efcb15cc00 2024-09-21T09:03:19.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.782+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16cf20 con 0x55efcb1660e0 2024-09-21T09:03:19.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.782+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94488392805248] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c03d040 con 0x7fea3408fbb0 2024-09-21T09:03:19.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.783+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.783+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94488392802992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16d2c0 con 0x55efcb1660e0 2024-09-21T09:03:19.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.783+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16dd00 con 0x7fea3408fbb0 2024-09-21T09:03:19.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.783+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94488392809056] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.784+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94488392802992] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.784+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c03d040 con 0x7fea3408fbb0 2024-09-21T09:03:19.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.784+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94488392816592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16c310 con 0x7fea3408fbb0 2024-09-21T09:03:19.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.784+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16e5a0 con 0x55efcb15cc00 2024-09-21T09:03:19.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.785+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.785+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94488392818848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16e4c0 con 0x55efcb15cc00 2024-09-21T09:03:19.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.785+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16f4c0 con 0x55efcb161470 2024-09-21T09:03:19.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.785+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94488392816592] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c03d040 con 0x7fea3408fbb0 2024-09-21T09:03:19.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.786+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94488392818848] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.786+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.786+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94488392821136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16f480 con 0x55efcb161470 2024-09-21T09:03:19.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.786+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16fd90 con 0x55efcb161470 2024-09-21T09:03:19.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.787+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94488392821136] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.787+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.787+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94488392822704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16f480 con 0x55efcb161470 2024-09-21T09:03:19.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.787+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1703e0 con 0x55efcb161470 2024-09-21T09:03:19.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.788+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94488392822704] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.788+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.788+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94488392826544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1703a0 con 0x55efcb161470 2024-09-21T09:03:19.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.788+0000 7fea46939800 20 add_watcher() i=0 2024-09-21T09:03:19.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.788+0000 7fea46939800 20 add_watcher() i=1 2024-09-21T09:03:19.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.788+0000 7fea46939800 20 add_watcher() i=2 2024-09-21T09:03:19.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.788+0000 7fea46939800 20 add_watcher() i=3 2024-09-21T09:03:19.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.788+0000 7fea46939800 20 add_watcher() i=4 2024-09-21T09:03:19.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.788+0000 7fea46939800 20 add_watcher() i=5 2024-09-21T09:03:19.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.788+0000 7fea46939800 20 add_watcher() i=6 2024-09-21T09:03:19.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.789+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94488392826544] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.789+0000 7fea46939800 20 add_watcher() i=7 2024-09-21T09:03:19.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.789+0000 7fea46939800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:19.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.789+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efcb173860 con 0x55efcb15cc00 2024-09-21T09:03:19.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.790+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.790+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94488392824976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb170d50 con 0x55efcb15cc00 2024-09-21T09:03:19.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.791+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94488392824976] v29'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.791+0000 7fe8f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:19.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.791+0000 7fea46939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.791+0000 7fea46939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.791+0000 7fea46939800 5 note: GC not initialized 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.791+0000 7fe8737fe640 20 reqs_thread_entry: start 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.791+0000 7fea46939800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.791+0000 7fea46939800 20 Filter name: none 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.791+0000 7fe8717fa640 20 reqs_thread_entry: start 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.791+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1a62c0 con 0x55efcb1660e0 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.792+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.792+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1a62c0 con 0x55efcb1660e0 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.792+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(63 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.792+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1a62c0 con 0x55efcb15cc00 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.792+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v29'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.792+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164f30 con 0x55efcb15cc00 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.792+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v29'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.792+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164f30 con 0x7fea3408fbb0 2024-09-21T09:03:19.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.793+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c03d040 con 0x7fea3408fbb0 2024-09-21T09:03:19.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.793+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164f30 con 0x55efcb1660e0 2024-09-21T09:03:19.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.793+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.793+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164f30 con 0x55efcb15cc00 2024-09-21T09:03:19.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.793+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.793+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164f30 con 0x55efcb1660e0 2024-09-21T09:03:19.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.793+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.793+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164f30 con 0x7fea3408fbb0 2024-09-21T09:03:19.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.793+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v29'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c03d040 con 0x7fea3408fbb0 2024-09-21T09:03:19.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.793+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164f30 con 0x55efcb1660e0 2024-09-21T09:03:19.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.794+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.794+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164f30 con 0x55efcb15cc00 2024-09-21T09:03:19.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.794+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.794+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164f30 con 0x55efcb161470 2024-09-21T09:03:19.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.794+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.794+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb161470 2024-09-21T09:03:19.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.795+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(74 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.795+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb1660e0 2024-09-21T09:03:19.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.795+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.795+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb161470 2024-09-21T09:03:19.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.795+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(76 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.795+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb161470 2024-09-21T09:03:19.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.795+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(77 [pgnls start_epoch 29 out=127b] v29'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.795+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb161470 2024-09-21T09:03:19.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.795+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(78 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.796+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb1660e0 2024-09-21T09:03:19.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.796+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(79 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.796+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x7fea3408fbb0 2024-09-21T09:03:19.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.796+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(80 [pgnls start_epoch 29 out=70b] v29'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7fea2c03d040 con 0x7fea3408fbb0 2024-09-21T09:03:19.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.796+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb15cc00 2024-09-21T09:03:19.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.796+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(81 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.796+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb15cc00 2024-09-21T09:03:19.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.796+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(82 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.796+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb1660e0 2024-09-21T09:03:19.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.797+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(83 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.797+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x7fea3408fbb0 2024-09-21T09:03:19.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.797+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(84 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c03d040 con 0x7fea3408fbb0 2024-09-21T09:03:19.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.797+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb161470 2024-09-21T09:03:19.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.797+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(85 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.797+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb15cc00 2024-09-21T09:03:19.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.797+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(86 [pgnls start_epoch 29 out=49b] v29'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.797+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb161470 2024-09-21T09:03:19.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.798+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(87 [pgnls start_epoch 29 out=49b] v29'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.798+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb1660e0 2024-09-21T09:03:19.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.798+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(88 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.798+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x7fea3408fbb0 2024-09-21T09:03:19.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.798+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(89 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c03d040 con 0x7fea3408fbb0 2024-09-21T09:03:19.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.798+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb161470 2024-09-21T09:03:19.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.798+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(90 [pgnls start_epoch 29 out=49b] v29'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.798+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb15cc00 2024-09-21T09:03:19.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.799+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(91 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.799+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x55efcb1660e0 2024-09-21T09:03:19.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.799+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(92 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.799+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1690f0 con 0x7fea3408fbb0 2024-09-21T09:03:19.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.799+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(93 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c03d040 con 0x7fea3408fbb0 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.799+0000 7fea46939800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.799+0000 7fea46939800 20 RGWRados::pool_iterate: got myfoo 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.800+0000 7fe8f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.800+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94488392824976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164f30 con 0x55efcb15cc00 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.801+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94488392824976] v29'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.801+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94488392805248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164f30 con 0x7fea3408fbb0 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.802+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94488392805248] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c03d040 con 0x7fea3408fbb0 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.802+0000 7fea46939800 20 remove_watcher() i=0 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.802+0000 7fea46939800 2 removed watcher, disabling cache 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.802+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94488392809056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164f30 con 0x55efcb15cc00 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.803+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94488392809056] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.803+0000 7fea46939800 20 remove_watcher() i=1 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.803+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94488392802992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb164f30 con 0x55efcb1660e0 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.804+0000 7fea425f5640 1 -- 172.21.15.178:0/933708786 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94488392802992] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea34087070 con 0x55efcb1660e0 2024-09-21T09:03:19.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.804+0000 7fea46939800 20 remove_watcher() i=2 2024-09-21T09:03:19.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.804+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94488392816592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1a4580 con 0x7fea3408fbb0 2024-09-21T09:03:19.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.805+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94488392816592] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c03d040 con 0x7fea3408fbb0 2024-09-21T09:03:19.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.805+0000 7fea46939800 20 remove_watcher() i=3 2024-09-21T09:03:19.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.805+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94488392818848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1a4580 con 0x55efcb15cc00 2024-09-21T09:03:19.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.806+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94488392818848] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c03d040 con 0x55efcb15cc00 2024-09-21T09:03:19.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.806+0000 7fea46939800 20 remove_watcher() i=4 2024-09-21T09:03:19.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.806+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94488392821136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb1a4580 con 0x55efcb161470 2024-09-21T09:03:19.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.807+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94488392821136] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c02a070 con 0x55efcb161470 2024-09-21T09:03:19.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.807+0000 7fea46939800 20 remove_watcher() i=5 2024-09-21T09:03:19.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.807+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94488392822704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16ba60 con 0x55efcb161470 2024-09-21T09:03:19.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.808+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94488392822704] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c06b040 con 0x55efcb161470 2024-09-21T09:03:19.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.808+0000 7fea46939800 20 remove_watcher() i=6 2024-09-21T09:03:19.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.808+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94488392826544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efcb16d7d0 con 0x55efcb161470 2024-09-21T09:03:19.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea42df6640 1 -- 172.21.15.178:0/933708786 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94488392826544] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea3c06b040 con 0x55efcb161470 2024-09-21T09:03:19.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 20 remove_watcher() i=7 2024-09-21T09:03:19.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55efcb161470 msgr2=0x55efcb163880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55efcb161470 0x55efcb163880 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55efcb15cc00 msgr2=0x55efcb15f0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55efcb15cc00 0x55efcb15f0c0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fea3408fbb0 msgr2=0x7fea3406f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fea3408fbb0 0x7fea3406f400 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55efcb1660e0 msgr2=0x55efcb1685a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55efcb1660e0 0x55efcb1685a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe90c036b90 msgr2=0x7fe90c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe90c036b90 0x7fe90c039050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fea340057c0 tx=0x7fea34087000 comp rx=0 tx=0).stop 2024-09-21T09:03:19.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb029540 msgr2=0x55efcb150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea39df4640 1 -- 172.21.15.178:0/933708786 reap_dead start 2024-09-21T09:03:19.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb029540 0x55efcb150f50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0117d0 tx=0x7fea3c04cad0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 shutdown_connections 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 --2- 172.21.15.178:0/933708786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb029540 0x55efcb150f50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 >> 172.21.15.178:0/933708786 conn(0x55efcb143d00 msgr2=0x55efcb141dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 shutdown_connections 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.809+0000 7fea46939800 1 -- 172.21.15.178:0/933708786 wait complete. 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 -- 172.21.15.178:0/789977009 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe91c036b90 msgr2=0x7fe91c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 --2- 172.21.15.178:0/789977009 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe91c036b90 0x7fe91c039050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55efcb1279f0 tx=0x7fea3408dd80 comp rx=0 tx=0).stop 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 -- 172.21.15.178:0/789977009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb13ad00 msgr2=0x55efcb13b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 --2- 172.21.15.178:0/789977009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb13ad00 0x55efcb13b120 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55efcb1210e0 tx=0x7fea3c0188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 -- 172.21.15.178:0/789977009 shutdown_connections 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 --2- 172.21.15.178:0/789977009 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe91c036b90 0x7fe91c039050 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 --2- 172.21.15.178:0/789977009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcb13ad00 0x55efcb13b120 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 -- 172.21.15.178:0/789977009 >> 172.21.15.178:0/789977009 conn(0x55efcb12fc90 msgr2=0x55efcb132810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 -- 172.21.15.178:0/789977009 shutdown_connections 2024-09-21T09:03:19.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 -- 172.21.15.178:0/789977009 wait complete. 2024-09-21T09:03:19.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55efcb1298b0 msgr2=0x55efcb12bca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55efcb1298b0 0x55efcb12bca0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55efcb02c800 msgr2=0x55efcb1270a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55efcb02c800 0x55efcb1270a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe928036b90 msgr2=0x7fe928039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe928036b90 0x7fe928039050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea2c000f60 tx=0x7fea2c0010a0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 msgr2=0x55efcb120030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:19.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb120030 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fea34045960 tx=0x7fea34002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 shutdown_connections 2024-09-21T09:03:19.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55efcb1298b0 0x55efcb12bca0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55efcb02c800 0x55efcb1270a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe928036b90 0x7fe928039050 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 --2- 172.21.15.178:0/224969784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55efcaf9d5a0 0x55efcb120030 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:19.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 >> 172.21.15.178:0/224969784 conn(0x55efcb023dd0 msgr2=0x55efcb1128a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:19.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 shutdown_connections 2024-09-21T09:03:19.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:19.810+0000 7fea46939800 1 -- 172.21.15.178:0/224969784 wait complete. 2024-09-21T09:03:19.827 INFO:teuthology.orchestra.run.smithi178.stdout:["myfoo"] 2024-09-21T09:03:19.827 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-21T09:03:19.837 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:19.847 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:19.856 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:19.899 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-21T09:03:19.928 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:19.953 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:19.982 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:19.982 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-21T09:03:19.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-21T09:03:19.982 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-21T09:03:20.026 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:20.027 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:20.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.025+0000 7f1977340800 1 Processor -- start 2024-09-21T09:03:20.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.025+0000 7f1977340800 1 -- start start 2024-09-21T09:03:20.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.025+0000 7f1977340800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x557849d24990 0x557849d24d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.025+0000 7f1977340800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557849be5b30 con 0x557849d252d0 2024-09-21T09:03:20.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.025+0000 7f1977340800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x557849bc7360 con 0x557849d24990 2024-09-21T09:03:20.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.026+0000 7f19730d1640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x557849d24990 0x557849d24d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.026+0000 7f19728d0640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x557849d252d0 0x557849d2baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46744/0 (socket says 172.21.15.178:46744) 2024-09-21T09:03:20.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.026+0000 7f19728d0640 1 -- 172.21.15.178:0/2174819597 learned_addr learned my addr 172.21.15.178:0/2174819597 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:20.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.026+0000 7f19730d1640 1 -- 172.21.15.178:0/2174819597 >> v1:172.21.15.44:6789/0 conn(0x557849d252d0 legacy=0x557849d2baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.026+0000 7f19730d1640 1 -- 172.21.15.178:0/2174819597 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557849bede00 con 0x557849d24990 2024-09-21T09:03:20.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.028+0000 7f19730d1640 1 --2- 172.21.15.178:0/2174819597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849d24d90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1964005fd0 tx=0x7f1964045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d883924fe9f361c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.028+0000 7f19720cf640 1 -- 172.21.15.178:0/2174819597 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1964058530 con 0x557849d24990 2024-09-21T09:03:20.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.028+0000 7f19720cf640 1 -- 172.21.15.178:0/2174819597 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19640586d0 con 0x557849d24990 2024-09-21T09:03:20.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.028+0000 7f19720cf640 1 -- 172.21.15.178:0/2174819597 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19640589d0 con 0x557849d24990 2024-09-21T09:03:20.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.028+0000 7f1977340800 1 -- 172.21.15.178:0/2174819597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 msgr2=0x557849d24d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.028+0000 7f1977340800 1 --2- 172.21.15.178:0/2174819597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849d24d90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1964005fd0 tx=0x7f1964045c30 comp rx=0 tx=0).stop 2024-09-21T09:03:20.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.028+0000 7f1977340800 1 -- 172.21.15.178:0/2174819597 shutdown_connections 2024-09-21T09:03:20.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.028+0000 7f1977340800 1 --2- 172.21.15.178:0/2174819597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849d24d90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.028+0000 7f1977340800 1 -- 172.21.15.178:0/2174819597 >> 172.21.15.178:0/2174819597 conn(0x557849d205c0 msgr2=0x557849d229e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.028+0000 7f1977340800 1 -- 172.21.15.178:0/2174819597 shutdown_connections 2024-09-21T09:03:20.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.029+0000 7f1977340800 1 -- 172.21.15.178:0/2174819597 wait complete. 2024-09-21T09:03:20.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.042+0000 7f1977340800 1 Processor -- start 2024-09-21T09:03:20.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.042+0000 7f1977340800 1 -- start start 2024-09-21T09:03:20.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.042+0000 7f1977340800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849e158d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.043+0000 7f1977340800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557849c72330 con 0x557849d24990 2024-09-21T09:03:20.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.043+0000 7f19730d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849e158d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.043+0000 7f19730d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849e158d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43170/0 (socket says 172.21.15.178:43170) 2024-09-21T09:03:20.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.043+0000 7f19730d1640 1 -- 172.21.15.178:0/2653999484 learned_addr learned my addr 172.21.15.178:0/2653999484 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.043+0000 7f19730d1640 1 -- 172.21.15.178:0/2653999484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557849bbfbc0 con 0x557849d24990 2024-09-21T09:03:20.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.044+0000 7f19730d1640 1 --2- 172.21.15.178:0/2653999484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849e158d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f196400a3f0 tx=0x7f1964051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b946295875e9c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.044+0000 7f186160a640 1 -- 172.21.15.178:0/2653999484 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19640589b0 con 0x557849d24990 2024-09-21T09:03:20.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.044+0000 7f186160a640 1 -- 172.21.15.178:0/2653999484 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1964068070 con 0x557849d24990 2024-09-21T09:03:20.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.044+0000 7f186160a640 1 -- 172.21.15.178:0/2653999484 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1964058c80 con 0x557849d24990 2024-09-21T09:03:20.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.044+0000 7f1977340800 1 -- 172.21.15.178:0/2653999484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 msgr2=0x557849e158d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.044+0000 7f1977340800 1 --2- 172.21.15.178:0/2653999484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849e158d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f196400a3f0 tx=0x7f1964051000 comp rx=0 tx=0).stop 2024-09-21T09:03:20.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.044+0000 7f1977340800 1 -- 172.21.15.178:0/2653999484 shutdown_connections 2024-09-21T09:03:20.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.045+0000 7f1977340800 1 --2- 172.21.15.178:0/2653999484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849e158d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.045+0000 7f1977340800 1 -- 172.21.15.178:0/2653999484 >> 172.21.15.178:0/2653999484 conn(0x557849d205c0 msgr2=0x557849e11290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.045+0000 7f1977340800 1 -- 172.21.15.178:0/2653999484 shutdown_connections 2024-09-21T09:03:20.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.045+0000 7f1977340800 1 -- 172.21.15.178:0/2653999484 wait complete. 2024-09-21T09:03:20.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.045+0000 7f1977340800 1 Processor -- start 2024-09-21T09:03:20.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.045+0000 7f1977340800 1 -- start start 2024-09-21T09:03:20.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.045+0000 7f1977340800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849e1d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.045+0000 7f1977340800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557849d2d650 con 0x557849d24990 2024-09-21T09:03:20.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.045+0000 7f19730d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849e1d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.045+0000 7f19730d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849e1d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43186/0 (socket says 172.21.15.178:43186) 2024-09-21T09:03:20.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.045+0000 7f19730d1640 1 -- 172.21.15.178:0/361699290 learned_addr learned my addr 172.21.15.178:0/361699290 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.046+0000 7f19730d1640 1 -- 172.21.15.178:0/361699290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557849bd3fe0 con 0x557849d24990 2024-09-21T09:03:20.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.046+0000 7f19730d1640 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849e1d110 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1964065040 tx=0x7f1964003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.046+0000 7f185fe07640 1 -- 172.21.15.178:0/361699290 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1964063570 con 0x557849d24990 2024-09-21T09:03:20.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.046+0000 7f185fe07640 1 -- 172.21.15.178:0/361699290 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1964063710 con 0x557849d24990 2024-09-21T09:03:20.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.046+0000 7f185fe07640 1 -- 172.21.15.178:0/361699290 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1964063a10 con 0x557849d24990 2024-09-21T09:03:20.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.046+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557849e1d650 con 0x557849d24990 2024-09-21T09:03:20.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.046+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557849e1db70 con 0x557849d24990 2024-09-21T09:03:20.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.047+0000 7f185fe07640 1 -- 172.21.15.178:0/361699290 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1964075020 con 0x557849d24990 2024-09-21T09:03:20.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.047+0000 7f185fe07640 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1858036b90 0x7f1858039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.047+0000 7f185fe07640 1 -- 172.21.15.178:0/361699290 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1964090d60 con 0x557849d24990 2024-09-21T09:03:20.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.047+0000 7f19728d0640 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1858036b90 0x7f1858039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.047+0000 7f1977340800 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557849d252d0 0x557849e24180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.047+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e246c0 con 0x557849d252d0 2024-09-21T09:03:20.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.047+0000 7f19738d2640 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557849d252d0 0x557849e24180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.047+0000 7f19728d0640 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1858036b90 0x7f1858039050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1968000f60 tx=0x7f19680012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.048+0000 7f19738d2640 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557849d252d0 0x557849e24180 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.048+0000 7f19738d2640 1 -- 172.21.15.178:0/361699290 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f196c0083e0 con 0x557849d252d0 2024-09-21T09:03:20.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.048+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e21730 con 0x557849d252d0 2024-09-21T09:03:20.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.048+0000 7f19738d2640 1 -- 172.21.15.178:0/361699290 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f196c0083e0 con 0x557849d252d0 2024-09-21T09:03:20.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.048+0000 7f1977340800 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557849e26990 0x557849e28d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.048+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e29470 con 0x557849e26990 2024-09-21T09:03:20.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.048+0000 7f19730d1640 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557849e26990 0x557849e28d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.049+0000 7f19730d1640 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557849e26990 0x557849e28d80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.049+0000 7f19730d1640 1 -- 172.21.15.178:0/361699290 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1964080c20 con 0x557849e26990 2024-09-21T09:03:20.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.049+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e25830 con 0x557849d252d0 2024-09-21T09:03:20.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.049+0000 7f19738d2640 1 -- 172.21.15.178:0/361699290 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f196c0083e0 con 0x557849d252d0 2024-09-21T09:03:20.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.049+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e25cd0 con 0x557849d252d0 2024-09-21T09:03:20.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.049+0000 7f19738d2640 1 -- 172.21.15.178:0/361699290 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f196c0083e0 con 0x557849d252d0 2024-09-21T09:03:20.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.050+0000 7f1977340800 1 Processor -- start 2024-09-21T09:03:20.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.050+0000 7f1977340800 1 -- start start 2024-09-21T09:03:20.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.050+0000 7f1977340800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e3e440 0x557849e3e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.050+0000 7f1977340800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557849bc1580 con 0x557849e3e440 2024-09-21T09:03:20.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.050+0000 7f19738d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e3e440 0x557849e3e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.050+0000 7f19738d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e3e440 0x557849e3e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43192/0 (socket says 172.21.15.178:43192) 2024-09-21T09:03:20.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.050+0000 7f19738d2640 1 -- 172.21.15.178:0/3822817571 learned_addr learned my addr 172.21.15.178:0/3822817571 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.050+0000 7f19738d2640 1 -- 172.21.15.178:0/3822817571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557849e3eda0 con 0x557849e3e440 2024-09-21T09:03:20.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.051+0000 7f19738d2640 1 --2- 172.21.15.178:0/3822817571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e3e440 0x557849e3e860 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x557849e1e1c0 tx=0x7f196c00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.051+0000 7f185d602640 1 -- 172.21.15.178:0/3822817571 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f196c007d00 con 0x557849e3e440 2024-09-21T09:03:20.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.051+0000 7f185d602640 1 -- 172.21.15.178:0/3822817571 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196c01e020 con 0x557849e3e440 2024-09-21T09:03:20.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.051+0000 7f1977340800 1 -- 172.21.15.178:0/3822817571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557849e3f030 con 0x557849e3e440 2024-09-21T09:03:20.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.051+0000 7f185d602640 1 -- 172.21.15.178:0/3822817571 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f196c019420 con 0x557849e3e440 2024-09-21T09:03:20.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.051+0000 7f1977340800 1 -- 172.21.15.178:0/3822817571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557849e41d10 con 0x557849e3e440 2024-09-21T09:03:20.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.051+0000 7f185d602640 1 -- 172.21.15.178:0/3822817571 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f196c016040 con 0x557849e3e440 2024-09-21T09:03:20.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.052+0000 7f185d602640 1 --2- 172.21.15.178:0/3822817571 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f184c036b40 0x7f184c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.052+0000 7f185d602640 1 -- 172.21.15.178:0/3822817571 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f196c01f030 con 0x557849e3e440 2024-09-21T09:03:20.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.052+0000 7f19730d1640 1 --2- 172.21.15.178:0/3822817571 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f184c036b40 0x7f184c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.052+0000 7f1977340800 1 Processor -- start 2024-09-21T09:03:20.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.052+0000 7f1977340800 1 -- start start 2024-09-21T09:03:20.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.052+0000 7f19730d1640 1 --2- 172.21.15.178:0/3822817571 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f184c036b40 0x7f184c039000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x557849e24b00 tx=0x7f196408f5a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.052+0000 7f1977340800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e4b0f0 0x557849e4b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.052+0000 7f1977340800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557849e15fc0 con 0x557849e4b0f0 2024-09-21T09:03:20.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.052+0000 7f19738d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e4b0f0 0x557849e4b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.052+0000 7f19738d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e4b0f0 0x557849e4b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43196/0 (socket says 172.21.15.178:43196) 2024-09-21T09:03:20.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.052+0000 7f19738d2640 1 -- 172.21.15.178:0/298612015 learned_addr learned my addr 172.21.15.178:0/298612015 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.053+0000 7f19738d2640 1 -- 172.21.15.178:0/298612015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557849e4bac0 con 0x557849e4b0f0 2024-09-21T09:03:20.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.053+0000 7f19738d2640 1 --2- 172.21.15.178:0/298612015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e4b0f0 0x557849e4b4f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f196c019780 tx=0x7f196c015e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512827c201f51dec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.053+0000 7f1856ffd640 1 -- 172.21.15.178:0/298612015 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f196c01d030 con 0x557849e4b0f0 2024-09-21T09:03:20.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.053+0000 7f1856ffd640 1 -- 172.21.15.178:0/298612015 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196c019b70 con 0x557849e4b0f0 2024-09-21T09:03:20.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.053+0000 7f1856ffd640 1 -- 172.21.15.178:0/298612015 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f196c0173b0 con 0x557849e4b0f0 2024-09-21T09:03:20.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.053+0000 7f1977340800 1 -- 172.21.15.178:0/298612015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e4b0f0 msgr2=0x557849e4b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.053+0000 7f1977340800 1 --2- 172.21.15.178:0/298612015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e4b0f0 0x557849e4b4f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f196c019780 tx=0x7f196c015e40 comp rx=0 tx=0).stop 2024-09-21T09:03:20.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.053+0000 7f1977340800 1 -- 172.21.15.178:0/298612015 shutdown_connections 2024-09-21T09:03:20.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.053+0000 7f1977340800 1 --2- 172.21.15.178:0/298612015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e4b0f0 0x557849e4b4f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.053+0000 7f1977340800 1 -- 172.21.15.178:0/298612015 >> 172.21.15.178:0/298612015 conn(0x557849e47450 msgr2=0x557849e45550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.053+0000 7f1977340800 1 -- 172.21.15.178:0/298612015 shutdown_connections 2024-09-21T09:03:20.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.053+0000 7f1977340800 1 -- 172.21.15.178:0/298612015 wait complete. 2024-09-21T09:03:20.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.054+0000 7f1977340800 1 Processor -- start 2024-09-21T09:03:20.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.054+0000 7f1977340800 1 -- start start 2024-09-21T09:03:20.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.054+0000 7f1977340800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e4b0f0 0x557849e52500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.054+0000 7f1977340800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557849e4c130 con 0x557849e4b0f0 2024-09-21T09:03:20.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.054+0000 7f19738d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e4b0f0 0x557849e52500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.054+0000 7f19738d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e4b0f0 0x557849e52500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43208/0 (socket says 172.21.15.178:43208) 2024-09-21T09:03:20.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.054+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 learned_addr learned my addr 172.21.15.178:0/2628727788 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.054+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557849e52a40 con 0x557849e4b0f0 2024-09-21T09:03:20.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.054+0000 7f19738d2640 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e4b0f0 0x557849e52500 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f196c048010 tx=0x7f196c04ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.054+0000 7f18557fa640 1 -- 172.21.15.178:0/2628727788 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f196c015950 con 0x557849e4b0f0 2024-09-21T09:03:20.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.055+0000 7f18557fa640 1 -- 172.21.15.178:0/2628727788 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196c040150 con 0x557849e4b0f0 2024-09-21T09:03:20.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.055+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557849e52cd0 con 0x557849e4b0f0 2024-09-21T09:03:20.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.055+0000 7f18557fa640 1 -- 172.21.15.178:0/2628727788 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f196c015af0 con 0x557849e4b0f0 2024-09-21T09:03:20.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.055+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557849e55980 con 0x557849e4b0f0 2024-09-21T09:03:20.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.055+0000 7f18557fa640 1 -- 172.21.15.178:0/2628727788 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f196c04eae0 con 0x557849e4b0f0 2024-09-21T09:03:20.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.055+0000 7f18557fa640 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f183c036b90 0x7f183c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.055+0000 7f18557fa640 1 -- 172.21.15.178:0/2628727788 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f196c01dd10 con 0x557849e4b0f0 2024-09-21T09:03:20.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.056+0000 7f19730d1640 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f183c036b90 0x7f183c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.056+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.056+0000 7f1977340800 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557849e5e000 0x557849e604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.056+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e60c10 con 0x557849e5e000 2024-09-21T09:03:20.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.056+0000 7f19728d0640 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557849e5e000 0x557849e604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.056+0000 7f19730d1640 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f183c036b90 0x7f183c039050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1964080eb0 tx=0x7f1964095000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.056+0000 7f19728d0640 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557849e5e000 0x557849e604c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.056+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1968009050 con 0x557849e5e000 2024-09-21T09:03:20.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.056+0000 7f1977340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.056+0000 7f1977340800 20 realm 2024-09-21T09:03:20.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.056+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.056+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e5d450 con 0x557849e5e000 2024-09-21T09:03:20.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1968009050 con 0x557849e5e000 2024-09-21T09:03:20.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f1977340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f1977340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:20.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e616f0 con 0x557849e5e000 2024-09-21T09:03:20.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1968009050 con 0x557849e5e000 2024-09-21T09:03:20.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f1977340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e61fc0 con 0x557849e5e000 2024-09-21T09:03:20.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1968009050 con 0x557849e5e000 2024-09-21T09:03:20.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f1977340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:20.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f1977340800 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557849e62870 0x557849e64c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e653a0 con 0x557849e62870 2024-09-21T09:03:20.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.057+0000 7f19738d2640 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557849e62870 0x557849e64c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.058+0000 7f19738d2640 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557849e62870 0x557849e64c60 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.058+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.058+0000 7f1977340800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:20.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.058+0000 7f1977340800 20 searching for the correct realm 2024-09-21T09:03:20.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.058+0000 7f1977340800 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x557849e67450 0x557849e69910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.058+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e67450 2024-09-21T09:03:20.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.058+0000 7f19730d1640 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x557849e67450 0x557849e69910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.058+0000 7f19730d1640 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x557849e67450 0x557849e69910 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.059+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.059+0000 7f19730d1640 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f19640a7040 0x7f1964058e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.059+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x7f19640a7040 2024-09-21T09:03:20.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.059+0000 7f19728d0640 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f19640a7040 0x7f1964058e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.059+0000 7f19728d0640 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f19640a7040 0x7f1964058e70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.059+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1968009050 con 0x7f19640a7040 2024-09-21T09:03:20.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.059+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e62870 2024-09-21T09:03:20.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.059+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.060+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e5e000 2024-09-21T09:03:20.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.060+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1968009050 con 0x557849e5e000 2024-09-21T09:03:20.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.060+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e5e000 2024-09-21T09:03:20.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.060+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1968029040 con 0x557849e5e000 2024-09-21T09:03:20.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.060+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e62870 2024-09-21T09:03:20.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.060+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.060+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e62870 2024-09-21T09:03:20.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.060+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.060+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x7f19640a7040 2024-09-21T09:03:20.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.061+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1968029040 con 0x7f19640a7040 2024-09-21T09:03:20.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.061+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e67450 2024-09-21T09:03:20.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.061+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.061+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e5e000 2024-09-21T09:03:20.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.061+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1968029040 con 0x557849e5e000 2024-09-21T09:03:20.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.061+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e62870 2024-09-21T09:03:20.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.061+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.061+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e5e000 2024-09-21T09:03:20.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.062+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1968029040 con 0x557849e5e000 2024-09-21T09:03:20.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.062+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x7f19640a7040 2024-09-21T09:03:20.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.062+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1968029040 con 0x7f19640a7040 2024-09-21T09:03:20.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.062+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e67450 2024-09-21T09:03:20.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.062+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.062+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e67450 2024-09-21T09:03:20.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.062+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.062+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e62870 2024-09-21T09:03:20.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.062+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.062+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e67450 2024-09-21T09:03:20.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.063+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.063+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e67450 2024-09-21T09:03:20.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.063+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.063+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e5e000 2024-09-21T09:03:20.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.063+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1968029040 con 0x557849e5e000 2024-09-21T09:03:20.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.063+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e5e000 2024-09-21T09:03:20.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.063+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1968029040 con 0x557849e5e000 2024-09-21T09:03:20.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.063+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e62870 2024-09-21T09:03:20.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.064+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.064+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e67450 2024-09-21T09:03:20.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.064+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.064+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x7f19640a7040 2024-09-21T09:03:20.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.064+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1968029040 con 0x7f19640a7040 2024-09-21T09:03:20.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.064+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e5e000 2024-09-21T09:03:20.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.064+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1968029040 con 0x557849e5e000 2024-09-21T09:03:20.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.064+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e62870 2024-09-21T09:03:20.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.065+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.065+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e67450 2024-09-21T09:03:20.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.065+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.065+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e62870 2024-09-21T09:03:20.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.065+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.065+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x7f19640a7040 2024-09-21T09:03:20.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.066+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1968029040 con 0x7f19640a7040 2024-09-21T09:03:20.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.066+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e67450 2024-09-21T09:03:20.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.066+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.066+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e62870 2024-09-21T09:03:20.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.066+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.066+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x557849e5e000 2024-09-21T09:03:20.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.066+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1968029040 con 0x557849e5e000 2024-09-21T09:03:20.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.066+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557849e69fe0 con 0x7f19640a7040 2024-09-21T09:03:20.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1968029040 con 0x7f19640a7040 2024-09-21T09:03:20.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:20.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:20.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:20.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:20.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:20.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:20.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e65e50 con 0x557849e5e000 2024-09-21T09:03:20.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1968029040 con 0x557849e5e000 2024-09-21T09:03:20.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e662a0 con 0x557849e5e000 2024-09-21T09:03:20.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1968029040 con 0x557849e5e000 2024-09-21T09:03:20.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:20.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e66780 con 0x557849e5e000 2024-09-21T09:03:20.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:20.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 zone default found 2024-09-21T09:03:20.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 4 Realm: () 2024-09-21T09:03:20.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:20.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:20.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:20.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 zonegroup default 2024-09-21T09:03:20.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.067+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e6a460 con 0x557849e62870 2024-09-21T09:03:20.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.068+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.068+0000 7f1977340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.068+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.068+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e6c690 con 0x557849e67450 2024-09-21T09:03:20.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.068+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.068+0000 7f1977340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.068+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.068+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e6ca30 con 0x557849e67450 2024-09-21T09:03:20.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.068+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.068+0000 7f1977340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.068+0000 7f1977340800 20 started sync module instance, tier type = 2024-09-21T09:03:20.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.068+0000 7f1977340800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:20.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.068+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e6bad0 con 0x7f19640a7040 2024-09-21T09:03:20.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.069+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196803d040 con 0x7f19640a7040 2024-09-21T09:03:20.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.069+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93975124295360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e6bad0 con 0x7f19640a7040 2024-09-21T09:03:20.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.069+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e6d300 con 0x557849e5e000 2024-09-21T09:03:20.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.070+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93975124295360] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196803d040 con 0x7f19640a7040 2024-09-21T09:03:20.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.070+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.070+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93975124299216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e6d2c0 con 0x557849e5e000 2024-09-21T09:03:20.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.071+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e6dd60 con 0x557849e67450 2024-09-21T09:03:20.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.072+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.072+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93975124301904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e6e630 con 0x557849e67450 2024-09-21T09:03:20.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.072+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e6f0b0 con 0x7f19640a7040 2024-09-21T09:03:20.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.072+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93975124299216] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.073+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93975124301904] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.073+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196803d040 con 0x7f19640a7040 2024-09-21T09:03:20.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.073+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93975124304256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e6b620 con 0x7f19640a7040 2024-09-21T09:03:20.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.073+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e6f980 con 0x557849e5e000 2024-09-21T09:03:20.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.074+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93975124304256] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196803d040 con 0x7f19640a7040 2024-09-21T09:03:20.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.074+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.074+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93975124306848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e6f930 con 0x557849e5e000 2024-09-21T09:03:20.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.074+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e70390 con 0x557849e62870 2024-09-21T09:03:20.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.075+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.075+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93975124306848] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.075+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93975124309600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e70390 con 0x557849e62870 2024-09-21T09:03:20.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.075+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e70da0 con 0x557849e62870 2024-09-21T09:03:20.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.076+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.076+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93975124314352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e71240 con 0x557849e62870 2024-09-21T09:03:20.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.076+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e71d60 con 0x557849e62870 2024-09-21T09:03:20.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.077+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93975124309600] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.077+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.077+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93975124318256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e71d20 con 0x557849e62870 2024-09-21T09:03:20.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.077+0000 7f1977340800 20 add_watcher() i=0 2024-09-21T09:03:20.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.077+0000 7f1977340800 20 add_watcher() i=1 2024-09-21T09:03:20.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.077+0000 7f1977340800 20 add_watcher() i=2 2024-09-21T09:03:20.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.077+0000 7f1977340800 20 add_watcher() i=3 2024-09-21T09:03:20.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.077+0000 7f1977340800 20 add_watcher() i=4 2024-09-21T09:03:20.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.077+0000 7f1977340800 20 add_watcher() i=5 2024-09-21T09:03:20.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.077+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93975124314352] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.077+0000 7f1977340800 20 add_watcher() i=6 2024-09-21T09:03:20.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.078+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93975124318256] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.078+0000 7f1977340800 20 add_watcher() i=7 2024-09-21T09:03:20.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.078+0000 7f1977340800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:20.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.078+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849e70d10 con 0x557849e5e000 2024-09-21T09:03:20.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.078+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.078+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93975124311776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849e70d10 con 0x557849e5e000 2024-09-21T09:03:20.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.079+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93975124311776] v29'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.080+0000 7f1829fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:20.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.080+0000 7f1977340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:20.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.080+0000 7f1977340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:20.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.080+0000 7f1977340800 5 note: GC not initialized 2024-09-21T09:03:20.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.080+0000 7f1828fe1640 20 reqs_thread_entry: start 2024-09-21T09:03:20.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.080+0000 7f1977340800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:20.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.080+0000 7f1977340800 20 Filter name: none 2024-09-21T09:03:20.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.080+0000 7f17a27fc640 20 reqs_thread_entry: start 2024-09-21T09:03:20.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.080+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.080+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849ea8020 con 0x7f19640a7040 2024-09-21T09:03:20.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.081+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f196803d040 con 0x7f19640a7040 2024-09-21T09:03:20.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.081+0000 7f1977340800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:20.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.081+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.081+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849ea8990 con 0x557849e62870 2024-09-21T09:03:20.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.081+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.081+0000 7f1977340800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:20.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.081+0000 7f1977340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T09:03:20.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.081+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.081+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849ea8940 con 0x7f19640a7040 2024-09-21T09:03:20.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f196803d040 con 0x7f19640a7040 2024-09-21T09:03:20.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:20.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:65 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849ea8940 con 0x557849e62870 2024-09-21T09:03:20.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(65 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:20.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T09:03:20.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 4.3 4:c0ba99c0:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849eab590 con 0x557849e5e000 2024-09-21T09:03:20.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 4.3a 4:5c12a2f4:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849eadf00 con 0x557849e67450 2024-09-21T09:03:20.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 4.2b 4:d7ea17ea:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849eb0b20 con 0x557849e5e000 2024-09-21T09:03:20.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 4.2f 4:f6e88df9:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849eb36b0 con 0x557849e5e000 2024-09-21T09:03:20.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 4.38 4:1f78f3cb:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849eb6190 con 0x557849e5e000 2024-09-21T09:03:20.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 4.13 4:c8101c22:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849eb8bc0 con 0x7f19640a7040 2024-09-21T09:03:20.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 4.3f 4:fe592d9e:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849ebb4b0 con 0x7f19640a7040 2024-09-21T09:03:20.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 4.3a 4:5c7f5cbc:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849ebdd20 con 0x557849e67450 2024-09-21T09:03:20.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(67 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 4.13 4:ca88a996:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849eab9f0 con 0x7f19640a7040 2024-09-21T09:03:20.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 4.c 4:303bfd52:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849ead7a0 con 0x557849e5e000 2024-09-21T09:03:20.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.083+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(66 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.083+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(68 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.083+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(69 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.083+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(70 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.083+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(71 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f196803d040 con 0x7f19640a7040 2024-09-21T09:03:20.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.082+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:76 4.30 4:0ce2a88a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557849ec3d10 con 0x557849e67450 2024-09-21T09:03:20.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.083+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f196803d040 con 0x7f19640a7040 2024-09-21T09:03:20.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.083+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(73 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.083+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f196803d040 con 0x7f19640a7040 2024-09-21T09:03:20.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.083+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(75 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.083+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(76 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.084+0000 7f1829fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:20.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.084+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93975124311776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849ea5a00 con 0x557849e5e000 2024-09-21T09:03:20.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.085+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93975124311776] v29'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.085+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93975124295360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849ea5a00 con 0x7f19640a7040 2024-09-21T09:03:20.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.086+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93975124295360] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196803d040 con 0x7f19640a7040 2024-09-21T09:03:20.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.086+0000 7f1977340800 20 remove_watcher() i=0 2024-09-21T09:03:20.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.086+0000 7f1977340800 2 removed watcher, disabling cache 2024-09-21T09:03:20.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.086+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93975124299216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849ea5a00 con 0x557849e5e000 2024-09-21T09:03:20.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.087+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93975124299216] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.087+0000 7f1977340800 20 remove_watcher() i=1 2024-09-21T09:03:20.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.087+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93975124301904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849ea5a00 con 0x557849e67450 2024-09-21T09:03:20.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.088+0000 7f19730d1640 1 -- 172.21.15.178:0/2628727788 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93975124301904] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19640a4040 con 0x557849e67450 2024-09-21T09:03:20.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.088+0000 7f1977340800 20 remove_watcher() i=2 2024-09-21T09:03:20.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.088+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93975124304256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849ea5a00 con 0x7f19640a7040 2024-09-21T09:03:20.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.089+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93975124304256] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196803d040 con 0x7f19640a7040 2024-09-21T09:03:20.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.089+0000 7f1977340800 20 remove_watcher() i=3 2024-09-21T09:03:20.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.089+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93975124306848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849ea5a00 con 0x557849e5e000 2024-09-21T09:03:20.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.090+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93975124306848] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196803d040 con 0x557849e5e000 2024-09-21T09:03:20.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.090+0000 7f1977340800 20 remove_watcher() i=4 2024-09-21T09:03:20.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.090+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93975124309600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849ea5a00 con 0x557849e62870 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.091+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93975124309600] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.091+0000 7f1977340800 20 remove_watcher() i=5 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.091+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93975124314352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849ea5a00 con 0x557849e62870 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.092+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93975124314352] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.092+0000 7f1977340800 20 remove_watcher() i=6 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.092+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93975124318256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557849ea5a00 con 0x557849e62870 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f19738d2640 1 -- 172.21.15.178:0/2628727788 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93975124318256] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196c02a070 con 0x557849e62870 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 20 remove_watcher() i=7 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557849e62870 msgr2=0x557849e64c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557849e62870 0x557849e64c60 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557849e5e000 msgr2=0x557849e604c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557849e5e000 0x557849e604c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f19640a7040 msgr2=0x7f1964058e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f19640a7040 0x7f1964058e70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x557849e67450 msgr2=0x557849e69910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x557849e67450 0x557849e69910 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f183c036b90 msgr2=0x7f183c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f183c036b90 0x7f183c039050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1964080eb0 tx=0x7f1964095000 comp rx=0 tx=0).stop 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e4b0f0 msgr2=0x557849e52500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 --2- 172.21.15.178:0/2628727788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e4b0f0 0x557849e52500 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f196c048010 tx=0x7f196c04ce30 comp rx=0 tx=0).stop 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f19728d0640 1 -- 172.21.15.178:0/2628727788 reap_dead start 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 shutdown_connections 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 >> 172.21.15.178:0/2628727788 conn(0x557849e47450 msgr2=0x557849e45520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 shutdown_connections 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.093+0000 7f1977340800 1 -- 172.21.15.178:0/2628727788 wait complete. 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 -- 172.21.15.178:0/3822817571 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f184c036b40 msgr2=0x7f184c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 --2- 172.21.15.178:0/3822817571 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f184c036b40 0x7f184c039000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x557849e24b00 tx=0x7f196408f5a0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 -- 172.21.15.178:0/3822817571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e3e440 msgr2=0x557849e3e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 --2- 172.21.15.178:0/3822817571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e3e440 0x557849e3e860 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x557849e1e1c0 tx=0x7f196c00aec0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 -- 172.21.15.178:0/3822817571 shutdown_connections 2024-09-21T09:03:20.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 --2- 172.21.15.178:0/3822817571 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f184c036b40 0x7f184c039000 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 --2- 172.21.15.178:0/3822817571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849e3e440 0x557849e3e860 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 -- 172.21.15.178:0/3822817571 >> 172.21.15.178:0/3822817571 conn(0x557849d25b60 msgr2=0x557849d25f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 -- 172.21.15.178:0/3822817571 shutdown_connections 2024-09-21T09:03:20.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 -- 172.21.15.178:0/3822817571 wait complete. 2024-09-21T09:03:20.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557849e26990 msgr2=0x557849e28d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557849e26990 0x557849e28d80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557849d252d0 msgr2=0x557849e24180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557849d252d0 0x557849e24180 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1858036b90 msgr2=0x7f1858039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1858036b90 0x7f1858039050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1968000f60 tx=0x7f19680012b0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 msgr2=0x557849e1d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849e1d110 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1964065040 tx=0x7f1964003330 comp rx=0 tx=0).stop 2024-09-21T09:03:20.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 shutdown_connections 2024-09-21T09:03:20.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557849e26990 0x557849e28d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557849d252d0 0x557849e24180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1858036b90 0x7f1858039050 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 --2- 172.21.15.178:0/361699290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557849d24990 0x557849e1d110 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 >> 172.21.15.178:0/361699290 conn(0x557849d205c0 msgr2=0x557849e0fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 shutdown_connections 2024-09-21T09:03:20.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.094+0000 7f1977340800 1 -- 172.21.15.178:0/361699290 wait complete. 2024-09-21T09:03:20.111 INFO:teuthology.orchestra.run.smithi178.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"68ad48f1-b3da-4499-bba2-41066e92d255","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1","marker":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-21T09:03:19.561268Z","creation_time":"2024-09-21T09:03:19.558161Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-21T09:03:20.111 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68ad48f1-b3da-4499-bba2-41066e92d255', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1', 'marker': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T09:03:19.561268Z', 'creation_time': '2024-09-21T09:03:19.558161Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-21T09:03:20.111 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-21T09:03:20.111 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-21T09:03:20.111 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-21T09:03:20.155 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:20.155 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:20.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.154+0000 7fb37eb06800 1 Processor -- start 2024-09-21T09:03:20.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.154+0000 7fb37eb06800 1 -- start start 2024-09-21T09:03:20.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.154+0000 7fb37eb06800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55acb38fbdf0 0x55acb398d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.154+0000 7fb37eb06800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55acb3847b30 con 0x55acb398db20 2024-09-21T09:03:20.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.154+0000 7fb37eb06800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55acb3829360 con 0x55acb38fbdf0 2024-09-21T09:03:20.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.155+0000 7fb37c5fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55acb38fbdf0 0x55acb398d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.155+0000 7fb37bdf9640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55acb398db20 0x55acb398ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46746/0 (socket says 172.21.15.178:46746) 2024-09-21T09:03:20.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.155+0000 7fb37bdf9640 1 -- 172.21.15.178:0/773819662 learned_addr learned my addr 172.21.15.178:0/773819662 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:20.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.155+0000 7fb37c5fa640 1 -- 172.21.15.178:0/773819662 >> v1:172.21.15.44:6789/0 conn(0x55acb398db20 legacy=0x55acb398ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.155+0000 7fb37c5fa640 1 -- 172.21.15.178:0/773819662 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acb384fe00 con 0x55acb38fbdf0 2024-09-21T09:03:20.158 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.157+0000 7fb37c5fa640 1 --2- 172.21.15.178:0/773819662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb398d5e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb374005fd0 tx=0x7fb374045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d748c36e7969e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.157+0000 7fb37b5f8640 1 -- 172.21.15.178:0/773819662 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb374058530 con 0x55acb38fbdf0 2024-09-21T09:03:20.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.157+0000 7fb37b5f8640 1 -- 172.21.15.178:0/773819662 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3740586d0 con 0x55acb38fbdf0 2024-09-21T09:03:20.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.157+0000 7fb37b5f8640 1 -- 172.21.15.178:0/773819662 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3740589d0 con 0x55acb38fbdf0 2024-09-21T09:03:20.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.157+0000 7fb37eb06800 1 -- 172.21.15.178:0/773819662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 msgr2=0x55acb398d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.157+0000 7fb37eb06800 1 --2- 172.21.15.178:0/773819662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb398d5e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb374005fd0 tx=0x7fb374045c30 comp rx=0 tx=0).stop 2024-09-21T09:03:20.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.157+0000 7fb37eb06800 1 -- 172.21.15.178:0/773819662 shutdown_connections 2024-09-21T09:03:20.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.157+0000 7fb37eb06800 1 --2- 172.21.15.178:0/773819662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb398d5e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.157+0000 7fb37eb06800 1 -- 172.21.15.178:0/773819662 >> 172.21.15.178:0/773819662 conn(0x55acb3982df0 msgr2=0x55acb3985210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.157+0000 7fb37eb06800 1 -- 172.21.15.178:0/773819662 shutdown_connections 2024-09-21T09:03:20.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.158+0000 7fb37eb06800 1 -- 172.21.15.178:0/773819662 wait complete. 2024-09-21T09:03:20.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.171+0000 7fb37eb06800 1 Processor -- start 2024-09-21T09:03:20.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.171+0000 7fb37eb06800 1 -- start start 2024-09-21T09:03:20.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.171+0000 7fb37eb06800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb3a79aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.171+0000 7fb37eb06800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55acb38d4330 con 0x55acb38fbdf0 2024-09-21T09:03:20.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.172+0000 7fb37c5fa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb3a79aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.172+0000 7fb37c5fa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb3a79aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43238/0 (socket says 172.21.15.178:43238) 2024-09-21T09:03:20.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.172+0000 7fb37c5fa640 1 -- 172.21.15.178:0/2680779221 learned_addr learned my addr 172.21.15.178:0/2680779221 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.172+0000 7fb37c5fa640 1 -- 172.21.15.178:0/2680779221 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acb3821bc0 con 0x55acb38fbdf0 2024-09-21T09:03:20.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.172+0000 7fb37c5fa640 1 --2- 172.21.15.178:0/2680779221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb3a79aa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb37400a3f0 tx=0x7fb374051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca92afa39e4ad00a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.172+0000 7fb26a60c640 1 -- 172.21.15.178:0/2680779221 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3740589b0 con 0x55acb38fbdf0 2024-09-21T09:03:20.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.173+0000 7fb26a60c640 1 -- 172.21.15.178:0/2680779221 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb374068070 con 0x55acb38fbdf0 2024-09-21T09:03:20.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.173+0000 7fb26a60c640 1 -- 172.21.15.178:0/2680779221 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb374058c80 con 0x55acb38fbdf0 2024-09-21T09:03:20.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.173+0000 7fb37eb06800 1 -- 172.21.15.178:0/2680779221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 msgr2=0x55acb3a79aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.173+0000 7fb37eb06800 1 --2- 172.21.15.178:0/2680779221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb3a79aa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb37400a3f0 tx=0x7fb374051000 comp rx=0 tx=0).stop 2024-09-21T09:03:20.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.173+0000 7fb37eb06800 1 -- 172.21.15.178:0/2680779221 shutdown_connections 2024-09-21T09:03:20.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.174+0000 7fb37eb06800 1 --2- 172.21.15.178:0/2680779221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb3a79aa0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.174+0000 7fb37eb06800 1 -- 172.21.15.178:0/2680779221 >> 172.21.15.178:0/2680779221 conn(0x55acb3982df0 msgr2=0x55acb3a75460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.174+0000 7fb37eb06800 1 -- 172.21.15.178:0/2680779221 shutdown_connections 2024-09-21T09:03:20.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.174+0000 7fb37eb06800 1 -- 172.21.15.178:0/2680779221 wait complete. 2024-09-21T09:03:20.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.174+0000 7fb37eb06800 1 Processor -- start 2024-09-21T09:03:20.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.174+0000 7fb37eb06800 1 -- start start 2024-09-21T09:03:20.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.174+0000 7fb37eb06800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb3a813d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.174+0000 7fb37eb06800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55acb3991900 con 0x55acb38fbdf0 2024-09-21T09:03:20.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.174+0000 7fb37c5fa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb3a813d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.174+0000 7fb37c5fa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb3a813d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43248/0 (socket says 172.21.15.178:43248) 2024-09-21T09:03:20.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.174+0000 7fb37c5fa640 1 -- 172.21.15.178:0/990853184 learned_addr learned my addr 172.21.15.178:0/990853184 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.174+0000 7fb37c5fa640 1 -- 172.21.15.178:0/990853184 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acb3835fe0 con 0x55acb38fbdf0 2024-09-21T09:03:20.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.175+0000 7fb37c5fa640 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb3a813d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb374065040 tx=0x7fb374003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.175+0000 7fb268e09640 1 -- 172.21.15.178:0/990853184 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb374063650 con 0x55acb38fbdf0 2024-09-21T09:03:20.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.175+0000 7fb268e09640 1 -- 172.21.15.178:0/990853184 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3740637f0 con 0x55acb38fbdf0 2024-09-21T09:03:20.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.175+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acb3a81910 con 0x55acb38fbdf0 2024-09-21T09:03:20.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.175+0000 7fb268e09640 1 -- 172.21.15.178:0/990853184 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb374063af0 con 0x55acb38fbdf0 2024-09-21T09:03:20.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.175+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acb3a81e30 con 0x55acb38fbdf0 2024-09-21T09:03:20.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.176+0000 7fb268e09640 1 -- 172.21.15.178:0/990853184 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb374074020 con 0x55acb38fbdf0 2024-09-21T09:03:20.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.176+0000 7fb268e09640 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb264036b90 0x7fb264039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.176+0000 7fb268e09640 1 -- 172.21.15.178:0/990853184 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb3740907d0 con 0x55acb38fbdf0 2024-09-21T09:03:20.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.176+0000 7fb37bdf9640 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb264036b90 0x7fb264039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.176+0000 7fb37eb06800 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acb398db20 0x55acb3a88440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.176+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3a88980 con 0x55acb398db20 2024-09-21T09:03:20.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.176+0000 7fb37cdfb640 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acb398db20 0x55acb3a88440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.177+0000 7fb37bdf9640 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb264036b90 0x7fb264039050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb364000f60 tx=0x7fb3640012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.177+0000 7fb37cdfb640 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acb398db20 0x55acb3a88440 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.177+0000 7fb37cdfb640 1 -- 172.21.15.178:0/990853184 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb36c0083e0 con 0x55acb398db20 2024-09-21T09:03:20.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.177+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3a859d0 con 0x55acb398db20 2024-09-21T09:03:20.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.177+0000 7fb37cdfb640 1 -- 172.21.15.178:0/990853184 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb36c0083e0 con 0x55acb398db20 2024-09-21T09:03:20.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.177+0000 7fb37eb06800 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acb3a8ac70 0x55acb3a8d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.177+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3a8d730 con 0x55acb3a8ac70 2024-09-21T09:03:20.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.177+0000 7fb37c5fa640 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acb3a8ac70 0x55acb3a8d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.178+0000 7fb37c5fa640 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acb3a8ac70 0x55acb3a8d060 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.178+0000 7fb37c5fa640 1 -- 172.21.15.178:0/990853184 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3a8ac70 2024-09-21T09:03:20.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.178+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3a89b10 con 0x55acb398db20 2024-09-21T09:03:20.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.178+0000 7fb37cdfb640 1 -- 172.21.15.178:0/990853184 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb36c0083e0 con 0x55acb398db20 2024-09-21T09:03:20.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.178+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3a89fb0 con 0x55acb398db20 2024-09-21T09:03:20.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.179+0000 7fb37cdfb640 1 -- 172.21.15.178:0/990853184 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb36c0083e0 con 0x55acb398db20 2024-09-21T09:03:20.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.179+0000 7fb37eb06800 1 Processor -- start 2024-09-21T09:03:20.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.179+0000 7fb37eb06800 1 -- start start 2024-09-21T09:03:20.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.179+0000 7fb37eb06800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3a9c100 0x55acb3a9c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.179+0000 7fb37eb06800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55acb3823580 con 0x55acb3a9c100 2024-09-21T09:03:20.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.179+0000 7fb37cdfb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3a9c100 0x55acb3a9c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.179+0000 7fb37cdfb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3a9c100 0x55acb3a9c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43252/0 (socket says 172.21.15.178:43252) 2024-09-21T09:03:20.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.179+0000 7fb37cdfb640 1 -- 172.21.15.178:0/3792069656 learned_addr learned my addr 172.21.15.178:0/3792069656 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.180+0000 7fb37cdfb640 1 -- 172.21.15.178:0/3792069656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acb3a9ca60 con 0x55acb3a9c100 2024-09-21T09:03:20.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.180+0000 7fb37cdfb640 1 --2- 172.21.15.178:0/3792069656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3a9c100 0x55acb3a9c520 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55acb3a82480 tx=0x7fb36c00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.180+0000 7fb261ffb640 1 -- 172.21.15.178:0/3792069656 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb36c007d00 con 0x55acb3a9c100 2024-09-21T09:03:20.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.180+0000 7fb261ffb640 1 -- 172.21.15.178:0/3792069656 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36c01e020 con 0x55acb3a9c100 2024-09-21T09:03:20.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.180+0000 7fb37eb06800 1 -- 172.21.15.178:0/3792069656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acb3a9ccf0 con 0x55acb3a9c100 2024-09-21T09:03:20.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.180+0000 7fb261ffb640 1 -- 172.21.15.178:0/3792069656 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb36c019420 con 0x55acb3a9c100 2024-09-21T09:03:20.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.180+0000 7fb37eb06800 1 -- 172.21.15.178:0/3792069656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acb3a9f9d0 con 0x55acb3a9c100 2024-09-21T09:03:20.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.181+0000 7fb261ffb640 1 -- 172.21.15.178:0/3792069656 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb36c016040 con 0x55acb3a9c100 2024-09-21T09:03:20.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.181+0000 7fb261ffb640 1 --2- 172.21.15.178:0/3792069656 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb254036b40 0x7fb254039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.181+0000 7fb261ffb640 1 -- 172.21.15.178:0/3792069656 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb36c01f030 con 0x55acb3a9c100 2024-09-21T09:03:20.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.181+0000 7fb37c5fa640 1 --2- 172.21.15.178:0/3792069656 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb254036b40 0x7fb254039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.181+0000 7fb37eb06800 1 Processor -- start 2024-09-21T09:03:20.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.181+0000 7fb37eb06800 1 -- start start 2024-09-21T09:03:20.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.181+0000 7fb37c5fa640 1 --2- 172.21.15.178:0/3792069656 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb254036b40 0x7fb254039000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55acb3a88da0 tx=0x7fb37406bef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.181+0000 7fb37eb06800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3aa8d50 0x55acb3aa9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.181+0000 7fb37eb06800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55acb3a7a190 con 0x55acb3aa8d50 2024-09-21T09:03:20.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.182+0000 7fb37cdfb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3aa8d50 0x55acb3aa9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.182+0000 7fb37cdfb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3aa8d50 0x55acb3aa9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43260/0 (socket says 172.21.15.178:43260) 2024-09-21T09:03:20.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.182+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1746832431 learned_addr learned my addr 172.21.15.178:0/1746832431 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.182+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1746832431 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acb3aa9720 con 0x55acb3aa8d50 2024-09-21T09:03:20.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.182+0000 7fb37cdfb640 1 --2- 172.21.15.178:0/1746832431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3aa8d50 0x55acb3aa9150 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb36c04cf20 tx=0x7fb36c017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a35d895219de2f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.182+0000 7fb25b7fe640 1 -- 172.21.15.178:0/1746832431 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb36c01d030 con 0x55acb3aa8d50 2024-09-21T09:03:20.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.182+0000 7fb25b7fe640 1 -- 172.21.15.178:0/1746832431 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36c015d00 con 0x55acb3aa8d50 2024-09-21T09:03:20.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.182+0000 7fb25b7fe640 1 -- 172.21.15.178:0/1746832431 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb36c0197f0 con 0x55acb3aa8d50 2024-09-21T09:03:20.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.183+0000 7fb37eb06800 1 -- 172.21.15.178:0/1746832431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3aa8d50 msgr2=0x55acb3aa9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.183+0000 7fb37eb06800 1 --2- 172.21.15.178:0/1746832431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3aa8d50 0x55acb3aa9150 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb36c04cf20 tx=0x7fb36c017fa0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.183+0000 7fb37eb06800 1 -- 172.21.15.178:0/1746832431 shutdown_connections 2024-09-21T09:03:20.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.183+0000 7fb37eb06800 1 --2- 172.21.15.178:0/1746832431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3aa8d50 0x55acb3aa9150 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.183+0000 7fb37eb06800 1 -- 172.21.15.178:0/1746832431 >> 172.21.15.178:0/1746832431 conn(0x55acb3aa50b0 msgr2=0x55acb3aa31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.183+0000 7fb37eb06800 1 -- 172.21.15.178:0/1746832431 shutdown_connections 2024-09-21T09:03:20.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.183+0000 7fb37eb06800 1 -- 172.21.15.178:0/1746832431 wait complete. 2024-09-21T09:03:20.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.183+0000 7fb37eb06800 1 Processor -- start 2024-09-21T09:03:20.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.183+0000 7fb37eb06800 1 -- start start 2024-09-21T09:03:20.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.183+0000 7fb37eb06800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3aa8d50 0x55acb3ab01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.183+0000 7fb37eb06800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55acb3aa9ca0 con 0x55acb3aa8d50 2024-09-21T09:03:20.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.183+0000 7fb37cdfb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3aa8d50 0x55acb3ab01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.183+0000 7fb37cdfb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3aa8d50 0x55acb3ab01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43266/0 (socket says 172.21.15.178:43266) 2024-09-21T09:03:20.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.183+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 learned_addr learned my addr 172.21.15.178:0/1196687187 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.184+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acb3ab06e0 con 0x55acb3aa8d50 2024-09-21T09:03:20.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.184+0000 7fb37cdfb640 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3aa8d50 0x55acb3ab01a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb36c03d040 tx=0x7fb36c04ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.184+0000 7fb259ffb640 1 -- 172.21.15.178:0/1196687187 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb36c03b070 con 0x55acb3aa8d50 2024-09-21T09:03:20.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.184+0000 7fb259ffb640 1 -- 172.21.15.178:0/1196687187 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36c019b70 con 0x55acb3aa8d50 2024-09-21T09:03:20.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.184+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acb3ab0970 con 0x55acb3aa8d50 2024-09-21T09:03:20.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.184+0000 7fb259ffb640 1 -- 172.21.15.178:0/1196687187 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb36c0179a0 con 0x55acb3aa8d50 2024-09-21T09:03:20.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.184+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acb3ab3620 con 0x55acb3aa8d50 2024-09-21T09:03:20.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.185+0000 7fb259ffb640 1 -- 172.21.15.178:0/1196687187 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb36c0153e0 con 0x55acb3aa8d50 2024-09-21T09:03:20.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.185+0000 7fb259ffb640 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb24c036b40 0x7fb24c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.185+0000 7fb259ffb640 1 -- 172.21.15.178:0/1196687187 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb36c037aa0 con 0x55acb3aa8d50 2024-09-21T09:03:20.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.185+0000 7fb37c5fa640 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb24c036b40 0x7fb24c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.185+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.185+0000 7fb37eb06800 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acb3abbb50 0x55acb3abe010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.185+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3abe760 con 0x55acb3abbb50 2024-09-21T09:03:20.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.185+0000 7fb37bdf9640 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acb3abbb50 0x55acb3abe010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.185+0000 7fb37c5fa640 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb24c036b40 0x7fb24c039000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb37406bf60 tx=0x7fb374093000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37bdf9640 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acb3abbb50 0x55acb3abe010 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb364009050 con 0x55acb3abbb50 2024-09-21T09:03:20.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37eb06800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37eb06800 20 realm 2024-09-21T09:03:20.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3abafa0 con 0x55acb3abbb50 2024-09-21T09:03:20.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb364009050 con 0x55acb3abbb50 2024-09-21T09:03:20.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37eb06800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37eb06800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:20.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3abf240 con 0x55acb3abbb50 2024-09-21T09:03:20.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb364009050 con 0x55acb3abbb50 2024-09-21T09:03:20.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37eb06800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.186+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3abfb10 con 0x55acb3abbb50 2024-09-21T09:03:20.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.187+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb364009050 con 0x55acb3abbb50 2024-09-21T09:03:20.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.187+0000 7fb37eb06800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:20.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.187+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.187+0000 7fb37eb06800 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acb3ac03c0 0x55acb3ac27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.187+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac2ef0 con 0x55acb3ac03c0 2024-09-21T09:03:20.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.187+0000 7fb37cdfb640 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acb3ac03c0 0x55acb3ac27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.187+0000 7fb37cdfb640 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acb3ac03c0 0x55acb3ac27b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.187+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.188+0000 7fb37eb06800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:20.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.188+0000 7fb37eb06800 20 searching for the correct realm 2024-09-21T09:03:20.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.188+0000 7fb37eb06800 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55acb3ac4fa0 0x55acb3ac7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.188+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac4fa0 2024-09-21T09:03:20.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.188+0000 7fb37c5fa640 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55acb3ac4fa0 0x55acb3ac7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.188+0000 7fb37c5fa640 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55acb3ac4fa0 0x55acb3ac7460 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.188+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.188+0000 7fb37c5fa640 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb37407e3a0 0x7fb374087690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.188+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x7fb37407e3a0 2024-09-21T09:03:20.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.188+0000 7fb37bdf9640 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb37407e3a0 0x7fb374087690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.189+0000 7fb37bdf9640 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb37407e3a0 0x7fb374087690 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.189+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb364009050 con 0x7fb37407e3a0 2024-09-21T09:03:20.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.189+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac03c0 2024-09-21T09:03:20.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.189+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.189+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3abbb50 2024-09-21T09:03:20.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.189+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb364009050 con 0x55acb3abbb50 2024-09-21T09:03:20.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.189+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3abbb50 2024-09-21T09:03:20.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.189+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb364029040 con 0x55acb3abbb50 2024-09-21T09:03:20.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.190+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac03c0 2024-09-21T09:03:20.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.190+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.190+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac03c0 2024-09-21T09:03:20.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.190+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.190+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x7fb37407e3a0 2024-09-21T09:03:20.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.190+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb364029040 con 0x7fb37407e3a0 2024-09-21T09:03:20.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.190+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac4fa0 2024-09-21T09:03:20.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.190+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.191+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3abbb50 2024-09-21T09:03:20.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.191+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb364029040 con 0x55acb3abbb50 2024-09-21T09:03:20.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.191+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac03c0 2024-09-21T09:03:20.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.191+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.191+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3abbb50 2024-09-21T09:03:20.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.191+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb364029040 con 0x55acb3abbb50 2024-09-21T09:03:20.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.191+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x7fb37407e3a0 2024-09-21T09:03:20.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.191+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb364029040 con 0x7fb37407e3a0 2024-09-21T09:03:20.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.191+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac4fa0 2024-09-21T09:03:20.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.192+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.192+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac4fa0 2024-09-21T09:03:20.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.192+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.192+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac03c0 2024-09-21T09:03:20.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.192+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.192+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac4fa0 2024-09-21T09:03:20.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.193+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.193+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac4fa0 2024-09-21T09:03:20.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.193+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.193+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3abbb50 2024-09-21T09:03:20.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.193+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb364029040 con 0x55acb3abbb50 2024-09-21T09:03:20.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.193+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3abbb50 2024-09-21T09:03:20.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.193+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb364029040 con 0x55acb3abbb50 2024-09-21T09:03:20.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.193+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac03c0 2024-09-21T09:03:20.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.194+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.194+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac4fa0 2024-09-21T09:03:20.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.194+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.194+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x7fb37407e3a0 2024-09-21T09:03:20.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.194+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb364029040 con 0x7fb37407e3a0 2024-09-21T09:03:20.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.194+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3abbb50 2024-09-21T09:03:20.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.194+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb364029040 con 0x55acb3abbb50 2024-09-21T09:03:20.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.194+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac03c0 2024-09-21T09:03:20.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.195+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.195+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac4fa0 2024-09-21T09:03:20.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.195+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.195+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac03c0 2024-09-21T09:03:20.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.195+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.195+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x7fb37407e3a0 2024-09-21T09:03:20.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.195+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb364029040 con 0x7fb37407e3a0 2024-09-21T09:03:20.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.195+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac4fa0 2024-09-21T09:03:20.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3ac03c0 2024-09-21T09:03:20.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x55acb3abbb50 2024-09-21T09:03:20.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb364029040 con 0x55acb3abbb50 2024-09-21T09:03:20.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7b30 con 0x7fb37407e3a0 2024-09-21T09:03:20.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb364029040 con 0x7fb37407e3a0 2024-09-21T09:03:20.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37eb06800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:20.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37eb06800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:20.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37eb06800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:20.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37eb06800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:20.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37eb06800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:20.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37eb06800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:20.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.196+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac39a0 con 0x55acb3abbb50 2024-09-21T09:03:20.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb364029040 con 0x55acb3abbb50 2024-09-21T09:03:20.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac3e20 con 0x55acb3abbb50 2024-09-21T09:03:20.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb364029040 con 0x55acb3abbb50 2024-09-21T09:03:20.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:20.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac4300 con 0x55acb3abbb50 2024-09-21T09:03:20.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:20.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 20 zone default found 2024-09-21T09:03:20.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 4 Realm: () 2024-09-21T09:03:20.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:20.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:20.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:20.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 20 zonegroup default 2024-09-21T09:03:20.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac7fb0 con 0x55acb3ac03c0 2024-09-21T09:03:20.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.197+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3aca1e0 con 0x55acb3ac4fa0 2024-09-21T09:03:20.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.198+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.198+0000 7fb37eb06800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.198+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.198+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3aca580 con 0x55acb3ac4fa0 2024-09-21T09:03:20.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.198+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.198+0000 7fb37eb06800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.198+0000 7fb37eb06800 20 started sync module instance, tier type = 2024-09-21T09:03:20.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.198+0000 7fb37eb06800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:20.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.198+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac9620 con 0x7fb37407e3a0 2024-09-21T09:03:20.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.199+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36403d040 con 0x7fb37407e3a0 2024-09-21T09:03:20.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.199+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94200237169168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ac9620 con 0x7fb37407e3a0 2024-09-21T09:03:20.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.199+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3acaf40 con 0x55acb3abbb50 2024-09-21T09:03:20.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.200+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94200237169168] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36403d040 con 0x7fb37407e3a0 2024-09-21T09:03:20.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.200+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.200+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94200237167232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3acaf40 con 0x55acb3abbb50 2024-09-21T09:03:20.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.200+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3acb900 con 0x55acb3ac4fa0 2024-09-21T09:03:20.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.201+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94200237167232] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.201+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.201+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94200237173392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3acaeb0 con 0x55acb3ac4fa0 2024-09-21T09:03:20.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.201+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3acc640 con 0x7fb37407e3a0 2024-09-21T09:03:20.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.202+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94200237173392] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.203+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36403d040 con 0x7fb37407e3a0 2024-09-21T09:03:20.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.203+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94200237178016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3acca60 con 0x7fb37407e3a0 2024-09-21T09:03:20.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.203+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3acd420 con 0x55acb3abbb50 2024-09-21T09:03:20.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.204+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.204+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94200237182832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3acd390 con 0x55acb3abbb50 2024-09-21T09:03:20.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.204+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ace3d0 con 0x55acb3ac03c0 2024-09-21T09:03:20.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.204+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94200237178016] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36403d040 con 0x7fb37407e3a0 2024-09-21T09:03:20.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.205+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94200237182832] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.205+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.205+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94200237185040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ace3d0 con 0x55acb3ac03c0 2024-09-21T09:03:20.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.205+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3acec70 con 0x55acb3ac03c0 2024-09-21T09:03:20.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.206+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94200237185040] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.206+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.206+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94200237179072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3ace3d0 con 0x55acb3ac03c0 2024-09-21T09:03:20.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.206+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3acf370 con 0x55acb3ac03c0 2024-09-21T09:03:20.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.207+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.207+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94200237179072] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.207+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94200237190720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3acf7e0 con 0x55acb3ac03c0 2024-09-21T09:03:20.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.207+0000 7fb37eb06800 20 add_watcher() i=0 2024-09-21T09:03:20.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.207+0000 7fb37eb06800 20 add_watcher() i=1 2024-09-21T09:03:20.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.207+0000 7fb37eb06800 20 add_watcher() i=2 2024-09-21T09:03:20.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.207+0000 7fb37eb06800 20 add_watcher() i=3 2024-09-21T09:03:20.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.207+0000 7fb37eb06800 20 add_watcher() i=4 2024-09-21T09:03:20.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.207+0000 7fb37eb06800 20 add_watcher() i=5 2024-09-21T09:03:20.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.207+0000 7fb37eb06800 20 add_watcher() i=6 2024-09-21T09:03:20.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.208+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94200237190720] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.208+0000 7fb37eb06800 20 add_watcher() i=7 2024-09-21T09:03:20.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.208+0000 7fb37eb06800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:20.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.208+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3acf7e0 con 0x55acb3abbb50 2024-09-21T09:03:20.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.208+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.208+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94200237191984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3acf7c0 con 0x55acb3abbb50 2024-09-21T09:03:20.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.209+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94200237191984] v29'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.209+0000 7fb2327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:20.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.209+0000 7fb37eb06800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:20.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.209+0000 7fb37eb06800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:20.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.209+0000 7fb37eb06800 5 note: GC not initialized 2024-09-21T09:03:20.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.210+0000 7fb2317e2640 20 reqs_thread_entry: start 2024-09-21T09:03:20.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.210+0000 7fb37eb06800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:20.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.210+0000 7fb37eb06800 20 Filter name: none 2024-09-21T09:03:20.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.210+0000 7fb1a2ffd640 20 reqs_thread_entry: start 2024-09-21T09:03:20.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.210+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.210+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b057a0 con 0x55acb3abbb50 2024-09-21T09:03:20.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.210+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.210+0000 7fb37eb06800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:20.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.210+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.210+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b06190 con 0x55acb3abbb50 2024-09-21T09:03:20.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.211+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.211+0000 7fb37eb06800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:20.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.211+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b071a0 con 0x7fb37407e3a0 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.211+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb36403d040 con 0x7fb37407e3a0 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.211+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.211+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b048f0 con 0x7fb37407e3a0 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.211+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb36403d040 con 0x7fb37407e3a0 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.211+0000 7fb37eb06800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.211+0000 7fb37eb06800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.211+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:66 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b06ed0 con 0x55acb3ac03c0 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.212+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(66 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.212+0000 7fb37eb06800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.212+0000 7fb37eb06800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.212+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 4.3 4:c0ba99c0:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b08a30 con 0x55acb3abbb50 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.212+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 4.3a 4:5c12a2f4:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b0b420 con 0x55acb3ac4fa0 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.212+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 4.2b 4:d7ea17ea:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b0dfe0 con 0x55acb3abbb50 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.212+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 4.2f 4:f6e88df9:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b10bb0 con 0x55acb3abbb50 2024-09-21T09:03:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.212+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 4.38 4:1f78f3cb:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b135a0 con 0x55acb3abbb50 2024-09-21T09:03:20.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.212+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 4.13 4:c8101c22:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b16070 con 0x7fb37407e3a0 2024-09-21T09:03:20.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.212+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:73 4.3f 4:fe592d9e:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b189b0 con 0x7fb37407e3a0 2024-09-21T09:03:20.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.212+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:74 4.3a 4:5c7f5cbc:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b1b330 con 0x55acb3ac4fa0 2024-09-21T09:03:20.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.212+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:75 4.13 4:ca88a996:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b1ddd0 con 0x7fb37407e3a0 2024-09-21T09:03:20.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.212+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 4.c 4:303bfd52:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b20c90 con 0x55acb3abbb50 2024-09-21T09:03:20.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.212+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 4.30 4:0ce2a88a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b23b30 con 0x55acb3ac4fa0 2024-09-21T09:03:20.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.213+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(70 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.213+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(68 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.213+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(67 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.213+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(69 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.213+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(71 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.213+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(72 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb36403d040 con 0x7fb37407e3a0 2024-09-21T09:03:20.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.213+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(73 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb36403d040 con 0x7fb37407e3a0 2024-09-21T09:03:20.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.213+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(74 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.213+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(75 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb36403d040 con 0x7fb37407e3a0 2024-09-21T09:03:20.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.213+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(77 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.213+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(76 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.214+0000 7fb2327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:20.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.214+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94200237191984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b23b30 con 0x55acb3abbb50 2024-09-21T09:03:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.215+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94200237191984] v29'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.215+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94200237169168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b23b30 con 0x7fb37407e3a0 2024-09-21T09:03:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.216+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94200237169168] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36403d040 con 0x7fb37407e3a0 2024-09-21T09:03:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.216+0000 7fb37eb06800 20 remove_watcher() i=0 2024-09-21T09:03:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.216+0000 7fb37eb06800 2 removed watcher, disabling cache 2024-09-21T09:03:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.216+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94200237167232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b23b30 con 0x55acb3abbb50 2024-09-21T09:03:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.217+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94200237167232] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.217+0000 7fb37eb06800 20 remove_watcher() i=1 2024-09-21T09:03:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.217+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94200237173392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b23b30 con 0x55acb3ac4fa0 2024-09-21T09:03:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.218+0000 7fb37c5fa640 1 -- 172.21.15.178:0/1196687187 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94200237173392] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb37406c450 con 0x55acb3ac4fa0 2024-09-21T09:03:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.218+0000 7fb37eb06800 20 remove_watcher() i=2 2024-09-21T09:03:20.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.218+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94200237178016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b23b30 con 0x7fb37407e3a0 2024-09-21T09:03:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.219+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94200237178016] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36403d040 con 0x7fb37407e3a0 2024-09-21T09:03:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.219+0000 7fb37eb06800 20 remove_watcher() i=3 2024-09-21T09:03:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.219+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94200237182832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b23b30 con 0x55acb3abbb50 2024-09-21T09:03:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.220+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94200237182832] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36403d040 con 0x55acb3abbb50 2024-09-21T09:03:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.220+0000 7fb37eb06800 20 remove_watcher() i=4 2024-09-21T09:03:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.220+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94200237185040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b23b30 con 0x55acb3ac03c0 2024-09-21T09:03:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.221+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94200237185040] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.221+0000 7fb37eb06800 20 remove_watcher() i=5 2024-09-21T09:03:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.221+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94200237179072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b23b30 con 0x55acb3ac03c0 2024-09-21T09:03:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.222+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94200237179072] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.222+0000 7fb37eb06800 20 remove_watcher() i=6 2024-09-21T09:03:20.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.222+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94200237190720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55acb3b23b30 con 0x55acb3ac03c0 2024-09-21T09:03:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37cdfb640 1 -- 172.21.15.178:0/1196687187 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94200237190720] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c02a070 con 0x55acb3ac03c0 2024-09-21T09:03:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 20 remove_watcher() i=7 2024-09-21T09:03:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acb3ac03c0 msgr2=0x55acb3ac27b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acb3ac03c0 0x55acb3ac27b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acb3abbb50 msgr2=0x55acb3abe010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acb3abbb50 0x55acb3abe010 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb37407e3a0 msgr2=0x7fb374087690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb37407e3a0 0x7fb374087690 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55acb3ac4fa0 msgr2=0x55acb3ac7460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55acb3ac4fa0 0x55acb3ac7460 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb24c036b40 msgr2=0x7fb24c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb24c036b40 0x7fb24c039000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb37406bf60 tx=0x7fb374093000 comp rx=0 tx=0).stop 2024-09-21T09:03:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3aa8d50 msgr2=0x55acb3ab01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37bdf9640 1 -- 172.21.15.178:0/1196687187 reap_dead start 2024-09-21T09:03:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3aa8d50 0x55acb3ab01a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb36c03d040 tx=0x7fb36c04ce80 comp rx=0 tx=0).stop 2024-09-21T09:03:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 shutdown_connections 2024-09-21T09:03:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 --2- 172.21.15.178:0/1196687187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3aa8d50 0x55acb3ab01a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 >> 172.21.15.178:0/1196687187 conn(0x55acb3aa50b0 msgr2=0x55acb3aa3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 shutdown_connections 2024-09-21T09:03:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 -- 172.21.15.178:0/1196687187 wait complete. 2024-09-21T09:03:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 -- 172.21.15.178:0/3792069656 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb254036b40 msgr2=0x7fb254039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 --2- 172.21.15.178:0/3792069656 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb254036b40 0x7fb254039000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55acb3a88da0 tx=0x7fb37406bef0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 -- 172.21.15.178:0/3792069656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3a9c100 msgr2=0x55acb3a9c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.223+0000 7fb37eb06800 1 --2- 172.21.15.178:0/3792069656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3a9c100 0x55acb3a9c520 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55acb3a82480 tx=0x7fb36c00aec0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 -- 172.21.15.178:0/3792069656 shutdown_connections 2024-09-21T09:03:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 --2- 172.21.15.178:0/3792069656 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb254036b40 0x7fb254039000 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 --2- 172.21.15.178:0/3792069656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb3a9c100 0x55acb3a9c520 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 -- 172.21.15.178:0/3792069656 >> 172.21.15.178:0/3792069656 conn(0x55acb3a91090 msgr2=0x55acb3a93c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 -- 172.21.15.178:0/3792069656 shutdown_connections 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 -- 172.21.15.178:0/3792069656 wait complete. 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acb3a8ac70 msgr2=0x55acb3a8d060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acb3a8ac70 0x55acb3a8d060 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acb398db20 msgr2=0x55acb3a88440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acb398db20 0x55acb3a88440 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb264036b90 msgr2=0x7fb264039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb264036b90 0x7fb264039050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb364000f60 tx=0x7fb3640012b0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 msgr2=0x55acb3a813d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb3a813d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb374065040 tx=0x7fb374003330 comp rx=0 tx=0).stop 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 shutdown_connections 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acb3a8ac70 0x55acb3a8d060 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acb398db20 0x55acb3a88440 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb264036b90 0x7fb264039050 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 --2- 172.21.15.178:0/990853184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acb38fbdf0 0x55acb3a813d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 >> 172.21.15.178:0/990853184 conn(0x55acb3982df0 msgr2=0x55acb3a73d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 shutdown_connections 2024-09-21T09:03:20.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.224+0000 7fb37eb06800 1 -- 172.21.15.178:0/990853184 wait complete. 2024-09-21T09:03:20.239 INFO:teuthology.orchestra.run.smithi178.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"68ad48f1-b3da-4499-bba2-41066e92d255","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1","marker":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-21T09:03:19.561268Z","creation_time":"2024-09-21T09:03:19.558161Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-09-21T09:03:20.239 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68ad48f1-b3da-4499-bba2-41066e92d255', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1', 'marker': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T09:03:19.561268Z', 'creation_time': '2024-09-21T09:03:19.558161Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-21T09:03:20.245 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-21T09:03:20.245 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-21T09:03:20.245 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-21T09:03:20.245 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-21T09:03:20.289 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:20.289 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:20.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.288+0000 7ff552010800 1 Processor -- start 2024-09-21T09:03:20.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.288+0000 7ff552010800 1 -- start start 2024-09-21T09:03:20.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.288+0000 7ff552010800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x558caa2735f0 0x558caa304690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.288+0000 7ff552010800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558caa1beb30 con 0x558caa304bd0 2024-09-21T09:03:20.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.288+0000 7ff552010800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x558caa1a0360 con 0x558caa2735f0 2024-09-21T09:03:20.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.288+0000 7ff54d6f7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x558caa2735f0 0x558caa304690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.288+0000 7ff54cef6640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x558caa304bd0 0x558caa306fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46760/0 (socket says 172.21.15.178:46760) 2024-09-21T09:03:20.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.288+0000 7ff54cef6640 1 -- 172.21.15.178:0/2178239664 learned_addr learned my addr 172.21.15.178:0/2178239664 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:20.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.289+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2178239664 >> v1:172.21.15.44:6789/0 conn(0x558caa304bd0 legacy=0x558caa306fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.289+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2178239664 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558caa1c6e00 con 0x558caa2735f0 2024-09-21T09:03:20.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.290+0000 7ff54d6f7640 1 --2- 172.21.15.178:0/2178239664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa304690 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff54000a470 tx=0x7ff540045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8424c8c785627342 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.291+0000 7ff53ffff640 1 -- 172.21.15.178:0/2178239664 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff540053570 con 0x558caa2735f0 2024-09-21T09:03:20.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.291+0000 7ff53ffff640 1 -- 172.21.15.178:0/2178239664 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff540058070 con 0x558caa2735f0 2024-09-21T09:03:20.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.291+0000 7ff53ffff640 1 -- 172.21.15.178:0/2178239664 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff540053880 con 0x558caa2735f0 2024-09-21T09:03:20.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.291+0000 7ff552010800 1 -- 172.21.15.178:0/2178239664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 msgr2=0x558caa304690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.291+0000 7ff552010800 1 --2- 172.21.15.178:0/2178239664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa304690 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff54000a470 tx=0x7ff540045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:20.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.291+0000 7ff552010800 1 -- 172.21.15.178:0/2178239664 shutdown_connections 2024-09-21T09:03:20.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.291+0000 7ff552010800 1 --2- 172.21.15.178:0/2178239664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa304690 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.291+0000 7ff552010800 1 -- 172.21.15.178:0/2178239664 >> 172.21.15.178:0/2178239664 conn(0x558caa2f9de0 msgr2=0x558caa2fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.291+0000 7ff552010800 1 -- 172.21.15.178:0/2178239664 shutdown_connections 2024-09-21T09:03:20.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.291+0000 7ff552010800 1 -- 172.21.15.178:0/2178239664 wait complete. 2024-09-21T09:03:20.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.305+0000 7ff552010800 1 Processor -- start 2024-09-21T09:03:20.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.305+0000 7ff552010800 1 -- start start 2024-09-21T09:03:20.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.305+0000 7ff552010800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa3f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.305+0000 7ff552010800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558caa24b330 con 0x558caa2735f0 2024-09-21T09:03:20.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.305+0000 7ff54d6f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa3f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.305+0000 7ff54d6f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa3f0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43284/0 (socket says 172.21.15.178:43284) 2024-09-21T09:03:20.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.305+0000 7ff54d6f7640 1 -- 172.21.15.178:0/1194530076 learned_addr learned my addr 172.21.15.178:0/1194530076 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.306+0000 7ff54d6f7640 1 -- 172.21.15.178:0/1194530076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558caa198bc0 con 0x558caa2735f0 2024-09-21T09:03:20.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.306+0000 7ff54d6f7640 1 --2- 172.21.15.178:0/1194530076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa3f0a70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff540025c20 tx=0x7ff540051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156adc1a5f8586c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.306+0000 7ff43b606640 1 -- 172.21.15.178:0/1194530076 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff54005c580 con 0x558caa2735f0 2024-09-21T09:03:20.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.306+0000 7ff43b606640 1 -- 172.21.15.178:0/1194530076 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff540063030 con 0x558caa2735f0 2024-09-21T09:03:20.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.306+0000 7ff43b606640 1 -- 172.21.15.178:0/1194530076 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff54005c850 con 0x558caa2735f0 2024-09-21T09:03:20.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.307+0000 7ff552010800 1 -- 172.21.15.178:0/1194530076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 msgr2=0x558caa3f0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.307+0000 7ff552010800 1 --2- 172.21.15.178:0/1194530076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa3f0a70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff540025c20 tx=0x7ff540051000 comp rx=0 tx=0).stop 2024-09-21T09:03:20.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.307+0000 7ff552010800 1 -- 172.21.15.178:0/1194530076 shutdown_connections 2024-09-21T09:03:20.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.307+0000 7ff552010800 1 --2- 172.21.15.178:0/1194530076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa3f0a70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.307+0000 7ff552010800 1 -- 172.21.15.178:0/1194530076 >> 172.21.15.178:0/1194530076 conn(0x558caa2f9de0 msgr2=0x558caa3ec430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.307+0000 7ff552010800 1 -- 172.21.15.178:0/1194530076 shutdown_connections 2024-09-21T09:03:20.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.307+0000 7ff552010800 1 -- 172.21.15.178:0/1194530076 wait complete. 2024-09-21T09:03:20.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.307+0000 7ff552010800 1 Processor -- start 2024-09-21T09:03:20.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.307+0000 7ff552010800 1 -- start start 2024-09-21T09:03:20.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.307+0000 7ff552010800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa3f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.307+0000 7ff552010800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558caa308980 con 0x558caa2735f0 2024-09-21T09:03:20.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.307+0000 7ff54d6f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa3f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.308+0000 7ff54d6f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa3f83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43298/0 (socket says 172.21.15.178:43298) 2024-09-21T09:03:20.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.308+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2988404544 learned_addr learned my addr 172.21.15.178:0/2988404544 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.308+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2988404544 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558caa1acfe0 con 0x558caa2735f0 2024-09-21T09:03:20.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.308+0000 7ff54d6f7640 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa3f83e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x558caa3f18d0 tx=0x7ff540002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.308+0000 7ff439e03640 1 -- 172.21.15.178:0/2988404544 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff540054ad0 con 0x558caa2735f0 2024-09-21T09:03:20.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.308+0000 7ff439e03640 1 -- 172.21.15.178:0/2988404544 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff540054c70 con 0x558caa2735f0 2024-09-21T09:03:20.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.308+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558caa3f8920 con 0x558caa2735f0 2024-09-21T09:03:20.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.308+0000 7ff439e03640 1 -- 172.21.15.178:0/2988404544 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff540068420 con 0x558caa2735f0 2024-09-21T09:03:20.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.308+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558caa3f8e40 con 0x558caa2735f0 2024-09-21T09:03:20.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.309+0000 7ff439e03640 1 -- 172.21.15.178:0/2988404544 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff5400685c0 con 0x558caa2735f0 2024-09-21T09:03:20.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.309+0000 7ff439e03640 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff434036b90 0x7ff434039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.309+0000 7ff439e03640 1 -- 172.21.15.178:0/2988404544 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff540070030 con 0x558caa2735f0 2024-09-21T09:03:20.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.309+0000 7ff54cef6640 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff434036b90 0x7ff434039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.309+0000 7ff552010800 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558caa304bd0 0x558caa3ff450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.309+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa3ff990 con 0x558caa304bd0 2024-09-21T09:03:20.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.310+0000 7ff54def8640 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558caa304bd0 0x558caa3ff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.310+0000 7ff54cef6640 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff434036b90 0x7ff434039050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff544000f60 tx=0x7ff5440012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.310+0000 7ff54def8640 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558caa304bd0 0x558caa3ff450 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.310+0000 7ff54def8640 1 -- 172.21.15.178:0/2988404544 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff54800a4a0 con 0x558caa304bd0 2024-09-21T09:03:20.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.310+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa3fca20 con 0x558caa304bd0 2024-09-21T09:03:20.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.310+0000 7ff54def8640 1 -- 172.21.15.178:0/2988404544 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff54800a4a0 con 0x558caa304bd0 2024-09-21T09:03:20.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.310+0000 7ff552010800 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558caa401d30 0x558caa404120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.310+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa404810 con 0x558caa401d30 2024-09-21T09:03:20.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.311+0000 7ff54d6f7640 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558caa401d30 0x558caa404120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.311+0000 7ff54d6f7640 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558caa401d30 0x558caa404120 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.311+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2988404544 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff540051070 con 0x558caa401d30 2024-09-21T09:03:20.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.311+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa400bd0 con 0x558caa304bd0 2024-09-21T09:03:20.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.312+0000 7ff54def8640 1 -- 172.21.15.178:0/2988404544 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff54800a4a0 con 0x558caa304bd0 2024-09-21T09:03:20.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.312+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa401070 con 0x558caa304bd0 2024-09-21T09:03:20.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.312+0000 7ff54def8640 1 -- 172.21.15.178:0/2988404544 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff54800a4a0 con 0x558caa304bd0 2024-09-21T09:03:20.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.312+0000 7ff552010800 1 Processor -- start 2024-09-21T09:03:20.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.312+0000 7ff552010800 1 -- start start 2024-09-21T09:03:20.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.312+0000 7ff552010800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa413190 0x558caa4135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.312+0000 7ff552010800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558caa19a580 con 0x558caa413190 2024-09-21T09:03:20.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.313+0000 7ff54def8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa413190 0x558caa4135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.313+0000 7ff54def8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa413190 0x558caa4135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43302/0 (socket says 172.21.15.178:43302) 2024-09-21T09:03:20.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.313+0000 7ff54def8640 1 -- 172.21.15.178:0/2782709452 learned_addr learned my addr 172.21.15.178:0/2782709452 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.313+0000 7ff54def8640 1 -- 172.21.15.178:0/2782709452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558caa413af0 con 0x558caa413190 2024-09-21T09:03:20.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.313+0000 7ff54def8640 1 --2- 172.21.15.178:0/2782709452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa413190 0x558caa4135b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x558caa3ffd90 tx=0x7ff548018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.313+0000 7ff432ffd640 1 -- 172.21.15.178:0/2782709452 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff548014450 con 0x558caa413190 2024-09-21T09:03:20.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.313+0000 7ff432ffd640 1 -- 172.21.15.178:0/2782709452 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff548014610 con 0x558caa413190 2024-09-21T09:03:20.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.313+0000 7ff552010800 1 -- 172.21.15.178:0/2782709452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558caa413d80 con 0x558caa413190 2024-09-21T09:03:20.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.313+0000 7ff432ffd640 1 -- 172.21.15.178:0/2782709452 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff548014930 con 0x558caa413190 2024-09-21T09:03:20.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.313+0000 7ff552010800 1 -- 172.21.15.178:0/2782709452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558caa416a60 con 0x558caa413190 2024-09-21T09:03:20.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.314+0000 7ff432ffd640 1 -- 172.21.15.178:0/2782709452 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff548011040 con 0x558caa413190 2024-09-21T09:03:20.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.314+0000 7ff432ffd640 1 --2- 172.21.15.178:0/2782709452 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff424036b40 0x7ff424039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.314+0000 7ff432ffd640 1 -- 172.21.15.178:0/2782709452 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff54801e070 con 0x558caa413190 2024-09-21T09:03:20.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.314+0000 7ff54d6f7640 1 --2- 172.21.15.178:0/2782709452 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff424036b40 0x7ff424039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.314+0000 7ff552010800 1 Processor -- start 2024-09-21T09:03:20.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.315+0000 7ff54d6f7640 1 --2- 172.21.15.178:0/2782709452 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff424036b40 0x7ff424039000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x558caa3ffe80 tx=0x7ff540045e60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.315+0000 7ff552010800 1 -- start start 2024-09-21T09:03:20.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.315+0000 7ff552010800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa41fe10 0x558caa420210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.315+0000 7ff552010800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558caa3f11c0 con 0x558caa41fe10 2024-09-21T09:03:20.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.315+0000 7ff54def8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa41fe10 0x558caa420210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.315+0000 7ff54def8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa41fe10 0x558caa420210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43310/0 (socket says 172.21.15.178:43310) 2024-09-21T09:03:20.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.315+0000 7ff54def8640 1 -- 172.21.15.178:0/3216009515 learned_addr learned my addr 172.21.15.178:0/3216009515 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.315+0000 7ff54def8640 1 -- 172.21.15.178:0/3216009515 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558caa4207e0 con 0x558caa41fe10 2024-09-21T09:03:20.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.315+0000 7ff54def8640 1 --2- 172.21.15.178:0/3216009515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa41fe10 0x558caa420210 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff54804cba0 tx=0x7ff54803bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cd60d891ef8db4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.316+0000 7ff430ff9640 1 -- 172.21.15.178:0/3216009515 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5480167c0 con 0x558caa41fe10 2024-09-21T09:03:20.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.316+0000 7ff430ff9640 1 -- 172.21.15.178:0/3216009515 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff548013cb0 con 0x558caa41fe10 2024-09-21T09:03:20.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.316+0000 7ff430ff9640 1 -- 172.21.15.178:0/3216009515 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff548016960 con 0x558caa41fe10 2024-09-21T09:03:20.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.316+0000 7ff552010800 1 -- 172.21.15.178:0/3216009515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa41fe10 msgr2=0x558caa420210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.316+0000 7ff552010800 1 --2- 172.21.15.178:0/3216009515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa41fe10 0x558caa420210 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff54804cba0 tx=0x7ff54803bf50 comp rx=0 tx=0).stop 2024-09-21T09:03:20.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.316+0000 7ff552010800 1 -- 172.21.15.178:0/3216009515 shutdown_connections 2024-09-21T09:03:20.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.316+0000 7ff552010800 1 --2- 172.21.15.178:0/3216009515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa41fe10 0x558caa420210 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.316+0000 7ff552010800 1 -- 172.21.15.178:0/3216009515 >> 172.21.15.178:0/3216009515 conn(0x558caa41c170 msgr2=0x558caa41a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.316+0000 7ff552010800 1 -- 172.21.15.178:0/3216009515 shutdown_connections 2024-09-21T09:03:20.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.316+0000 7ff552010800 1 -- 172.21.15.178:0/3216009515 wait complete. 2024-09-21T09:03:20.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.316+0000 7ff552010800 1 Processor -- start 2024-09-21T09:03:20.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.316+0000 7ff552010800 1 -- start start 2024-09-21T09:03:20.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.317+0000 7ff552010800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa41fe10 0x558caa4272a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.317+0000 7ff552010800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558caa420e90 con 0x558caa41fe10 2024-09-21T09:03:20.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.317+0000 7ff54def8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa41fe10 0x558caa4272a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.317+0000 7ff54def8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa41fe10 0x558caa4272a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43326/0 (socket says 172.21.15.178:43326) 2024-09-21T09:03:20.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.317+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 learned_addr learned my addr 172.21.15.178:0/2593761512 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.317+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558caa4277e0 con 0x558caa41fe10 2024-09-21T09:03:20.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.317+0000 7ff54def8640 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa41fe10 0x558caa4272a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff54804ba90 tx=0x7ff54804cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.317+0000 7ff422ffd640 1 -- 172.21.15.178:0/2593761512 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff548013e60 con 0x558caa41fe10 2024-09-21T09:03:20.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.317+0000 7ff422ffd640 1 -- 172.21.15.178:0/2593761512 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54804cd70 con 0x558caa41fe10 2024-09-21T09:03:20.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.317+0000 7ff422ffd640 1 -- 172.21.15.178:0/2593761512 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff54802bda0 con 0x558caa41fe10 2024-09-21T09:03:20.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.317+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558caa427a70 con 0x558caa41fe10 2024-09-21T09:03:20.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.317+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558caa42a720 con 0x558caa41fe10 2024-09-21T09:03:20.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.318+0000 7ff422ffd640 1 -- 172.21.15.178:0/2593761512 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff548022a80 con 0x558caa41fe10 2024-09-21T09:03:20.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.318+0000 7ff422ffd640 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff418036b90 0x7ff418039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.318+0000 7ff422ffd640 1 -- 172.21.15.178:0/2593761512 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff54800e040 con 0x558caa41fe10 2024-09-21T09:03:20.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.318+0000 7ff54d6f7640 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff418036b90 0x7ff418039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.318+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff552010800 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558caa432f30 0x558caa4353f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa435b40 con 0x558caa432f30 2024-09-21T09:03:20.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff54d6f7640 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff418036b90 0x7ff418039050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff54008f3c0 tx=0x7ff540088000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff54cef6640 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558caa432f30 0x558caa4353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff54cef6640 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558caa432f30 0x558caa4353f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff544009050 con 0x558caa432f30 2024-09-21T09:03:20.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff552010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff552010800 20 realm 2024-09-21T09:03:20.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa432380 con 0x558caa432f30 2024-09-21T09:03:20.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff544009050 con 0x558caa432f30 2024-09-21T09:03:20.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff552010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff552010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:20.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.319+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa436620 con 0x558caa432f30 2024-09-21T09:03:20.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.320+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff544009050 con 0x558caa432f30 2024-09-21T09:03:20.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.320+0000 7ff552010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.320+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.320+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa436ef0 con 0x558caa432f30 2024-09-21T09:03:20.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.320+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff544009050 con 0x558caa432f30 2024-09-21T09:03:20.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.320+0000 7ff552010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:20.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.320+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.320+0000 7ff552010800 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558caa4377a0 0x558caa439b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.320+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa43a2d0 con 0x558caa4377a0 2024-09-21T09:03:20.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.320+0000 7ff54def8640 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558caa4377a0 0x558caa439b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.320+0000 7ff54def8640 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558caa4377a0 0x558caa439b90 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.321+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.321+0000 7ff552010800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:20.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.321+0000 7ff552010800 20 searching for the correct realm 2024-09-21T09:03:20.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.321+0000 7ff552010800 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558caa43c380 0x558caa43e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.321+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa43c380 2024-09-21T09:03:20.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.321+0000 7ff54d6f7640 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558caa43c380 0x558caa43e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.321+0000 7ff54d6f7640 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558caa43c380 0x558caa43e840 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.321+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.321+0000 7ff54d6f7640 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff54008c040 0x7ff54007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.321+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x7ff54008c040 2024-09-21T09:03:20.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.321+0000 7ff54cef6640 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff54008c040 0x7ff54007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.322+0000 7ff54cef6640 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff54008c040 0x7ff54007d3f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.322+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff544009050 con 0x7ff54008c040 2024-09-21T09:03:20.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.322+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa4377a0 2024-09-21T09:03:20.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.322+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.322+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa432f30 2024-09-21T09:03:20.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.322+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff544009050 con 0x558caa432f30 2024-09-21T09:03:20.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.322+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa432f30 2024-09-21T09:03:20.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.323+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff544029040 con 0x558caa432f30 2024-09-21T09:03:20.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.323+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa4377a0 2024-09-21T09:03:20.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.323+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.323+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa4377a0 2024-09-21T09:03:20.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.323+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.323+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x7ff54008c040 2024-09-21T09:03:20.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.323+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff544029040 con 0x7ff54008c040 2024-09-21T09:03:20.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.323+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa43c380 2024-09-21T09:03:20.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.324+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.324+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa432f30 2024-09-21T09:03:20.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.324+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff544029040 con 0x558caa432f30 2024-09-21T09:03:20.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.324+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa4377a0 2024-09-21T09:03:20.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.324+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.324+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa432f30 2024-09-21T09:03:20.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.324+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff544029040 con 0x558caa432f30 2024-09-21T09:03:20.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.324+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x7ff54008c040 2024-09-21T09:03:20.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.325+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff544029040 con 0x7ff54008c040 2024-09-21T09:03:20.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.325+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa43c380 2024-09-21T09:03:20.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.325+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.325+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa43c380 2024-09-21T09:03:20.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.325+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.325+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa4377a0 2024-09-21T09:03:20.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.325+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.325+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa43c380 2024-09-21T09:03:20.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.326+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.326+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa43c380 2024-09-21T09:03:20.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.326+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.326+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa432f30 2024-09-21T09:03:20.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.326+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff544029040 con 0x558caa432f30 2024-09-21T09:03:20.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.326+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa432f30 2024-09-21T09:03:20.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.326+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff544029040 con 0x558caa432f30 2024-09-21T09:03:20.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.326+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa4377a0 2024-09-21T09:03:20.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.326+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.327+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa43c380 2024-09-21T09:03:20.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.327+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.327+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x7ff54008c040 2024-09-21T09:03:20.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.327+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff544029040 con 0x7ff54008c040 2024-09-21T09:03:20.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.327+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa432f30 2024-09-21T09:03:20.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.327+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff544029040 con 0x558caa432f30 2024-09-21T09:03:20.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.327+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa4377a0 2024-09-21T09:03:20.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.327+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.328+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa43c380 2024-09-21T09:03:20.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.328+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.328+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa4377a0 2024-09-21T09:03:20.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.328+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.328+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x7ff54008c040 2024-09-21T09:03:20.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.328+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff544029040 con 0x7ff54008c040 2024-09-21T09:03:20.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.328+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa43c380 2024-09-21T09:03:20.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.328+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.328+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa4377a0 2024-09-21T09:03:20.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x558caa432f30 2024-09-21T09:03:20.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff544029040 con 0x558caa432f30 2024-09-21T09:03:20.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ef10 con 0x7ff54008c040 2024-09-21T09:03:20.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff544029040 con 0x7ff54008c040 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff552010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff552010800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff552010800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff552010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff552010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff552010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa43ad80 con 0x558caa432f30 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff544029040 con 0x558caa432f30 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff552010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.329+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa43b200 con 0x558caa432f30 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff544029040 con 0x558caa432f30 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:20.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa43b6e0 con 0x558caa432f30 2024-09-21T09:03:20.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:20.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 20 zone default found 2024-09-21T09:03:20.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 4 Realm: () 2024-09-21T09:03:20.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:20.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:20.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:20.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 20 zonegroup default 2024-09-21T09:03:20.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa43f390 con 0x558caa4377a0 2024-09-21T09:03:20.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.330+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa4415c0 con 0x558caa43c380 2024-09-21T09:03:20.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.331+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.331+0000 7ff552010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.331+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.331+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa441960 con 0x558caa43c380 2024-09-21T09:03:20.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.331+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.331+0000 7ff552010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.331+0000 7ff552010800 20 started sync module instance, tier type = 2024-09-21T09:03:20.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.331+0000 7ff552010800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:20.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.331+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa440a00 con 0x7ff54008c040 2024-09-21T09:03:20.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.332+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54403d040 con 0x7ff54008c040 2024-09-21T09:03:20.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.332+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94062640369136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa440a00 con 0x7ff54008c040 2024-09-21T09:03:20.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.332+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa442320 con 0x558caa432f30 2024-09-21T09:03:20.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.333+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94062640369136] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54403d040 con 0x7ff54008c040 2024-09-21T09:03:20.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.333+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.333+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94062640367200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa442320 con 0x558caa432f30 2024-09-21T09:03:20.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.333+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa442ce0 con 0x558caa43c380 2024-09-21T09:03:20.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.334+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94062640367200] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.334+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.334+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94062640373360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa442290 con 0x558caa43c380 2024-09-21T09:03:20.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.334+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa443a00 con 0x7ff54008c040 2024-09-21T09:03:20.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.335+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54403d040 con 0x7ff54008c040 2024-09-21T09:03:20.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.335+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94062640379184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa4442a0 con 0x7ff54008c040 2024-09-21T09:03:20.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.335+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94062640373360] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.335+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa444d60 con 0x558caa432f30 2024-09-21T09:03:20.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.336+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.336+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94062640384048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa444d20 con 0x558caa432f30 2024-09-21T09:03:20.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.336+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa445770 con 0x558caa4377a0 2024-09-21T09:03:20.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.337+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94062640379184] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54403d040 con 0x7ff54008c040 2024-09-21T09:03:20.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.338+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.338+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94062640386752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa445b60 con 0x558caa4377a0 2024-09-21T09:03:20.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.338+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa446560 con 0x558caa4377a0 2024-09-21T09:03:20.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.338+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94062640384048] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.338+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94062640386752] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.339+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.339+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94062640377984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa446070 con 0x558caa4377a0 2024-09-21T09:03:20.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.339+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa446a30 con 0x558caa4377a0 2024-09-21T09:03:20.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.340+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.340+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94062640377984] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.340+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94062640391552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa4469a0 con 0x558caa4377a0 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.340+0000 7ff552010800 20 add_watcher() i=0 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.340+0000 7ff552010800 20 add_watcher() i=1 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.340+0000 7ff552010800 20 add_watcher() i=2 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.340+0000 7ff552010800 20 add_watcher() i=3 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.340+0000 7ff552010800 20 add_watcher() i=4 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.340+0000 7ff552010800 20 add_watcher() i=5 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.340+0000 7ff552010800 20 add_watcher() i=6 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.341+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94062640391552] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.341+0000 7ff552010800 20 add_watcher() i=7 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.341+0000 7ff552010800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.341+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa449ec0 con 0x558caa432f30 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.341+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.341+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94062640381312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa4473e0 con 0x558caa432f30 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.342+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94062640381312] v29'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.342+0000 7ff4037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.342+0000 7ff552010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.342+0000 7ff552010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.342+0000 7ff552010800 5 note: GC not initialized 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.342+0000 7ff4027e4640 20 reqs_thread_entry: start 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.342+0000 7ff552010800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.342+0000 7ff552010800 20 Filter name: none 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.342+0000 7ff373fff640 20 reqs_thread_entry: start 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.343+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.343+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa47d270 con 0x7ff54008c040 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.343+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff54403d040 con 0x7ff54008c040 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.343+0000 7ff552010800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.343+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.343+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa47dbe0 con 0x558caa4377a0 2024-09-21T09:03:20.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.343+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.343+0000 7ff552010800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:20.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.343+0000 7ff552010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T09:03:20.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.343+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.343+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa47db90 con 0x7ff54008c040 2024-09-21T09:03:20.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.344+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff54403d040 con 0x7ff54008c040 2024-09-21T09:03:20.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.344+0000 7ff552010800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:20.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.344+0000 7ff552010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.344+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:65 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa47db90 con 0x558caa4377a0 2024-09-21T09:03:20.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.344+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(65 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.344+0000 7ff552010800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:20.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.344+0000 7ff552010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T09:03:20.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.344+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 4.3 4:c0ba99c0:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa4807e0 con 0x558caa432f30 2024-09-21T09:03:20.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.344+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 4.3a 4:5c12a2f4:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa4830f0 con 0x558caa43c380 2024-09-21T09:03:20.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.344+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 4.2b 4:d7ea17ea:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa485d30 con 0x558caa432f30 2024-09-21T09:03:20.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.344+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 4.2f 4:f6e88df9:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa488620 con 0x558caa432f30 2024-09-21T09:03:20.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 4.38 4:1f78f3cb:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa48b2e0 con 0x558caa432f30 2024-09-21T09:03:20.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 4.13 4:c8101c22:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa48e1a0 con 0x7ff54008c040 2024-09-21T09:03:20.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 4.3f 4:fe592d9e:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa491010 con 0x7ff54008c040 2024-09-21T09:03:20.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 4.3a 4:5c7f5cbc:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa493e90 con 0x558caa43c380 2024-09-21T09:03:20.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 4.13 4:ca88a996:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa496ca0 con 0x7ff54008c040 2024-09-21T09:03:20.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 4.c 4:303bfd52:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa499960 con 0x558caa432f30 2024-09-21T09:03:20.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:76 4.30 4:0ce2a88a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558caa49c590 con 0x558caa43c380 2024-09-21T09:03:20.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(66 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(67 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(68 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(69 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(70 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(76 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(71 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.5 [call out=124b] v0'0 uv4 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ff54403d040 con 0x7ff54008c040 2024-09-21T09:03:20.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(73 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff54403d040 con 0x7ff54008c040 2024-09-21T09:03:20.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(75 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.345+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff54403d040 con 0x7ff54008c040 2024-09-21T09:03:20.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.346+0000 7ff4037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:20.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.346+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94062640381312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa485d30 con 0x558caa432f30 2024-09-21T09:03:20.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.347+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94062640381312] v29'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.347+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94062640369136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa47acd0 con 0x7ff54008c040 2024-09-21T09:03:20.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.348+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94062640369136] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54403d040 con 0x7ff54008c040 2024-09-21T09:03:20.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.348+0000 7ff552010800 20 remove_watcher() i=0 2024-09-21T09:03:20.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.348+0000 7ff552010800 2 removed watcher, disabling cache 2024-09-21T09:03:20.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.348+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94062640367200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa47acd0 con 0x558caa432f30 2024-09-21T09:03:20.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.349+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94062640367200] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.349+0000 7ff552010800 20 remove_watcher() i=1 2024-09-21T09:03:20.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.349+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94062640373360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa47acd0 con 0x558caa43c380 2024-09-21T09:03:20.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.350+0000 7ff54d6f7640 1 -- 172.21.15.178:0/2593761512 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94062640373360] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff540051070 con 0x558caa43c380 2024-09-21T09:03:20.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.350+0000 7ff552010800 20 remove_watcher() i=2 2024-09-21T09:03:20.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.350+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94062640379184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa47acd0 con 0x7ff54008c040 2024-09-21T09:03:20.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.351+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94062640379184] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54403d040 con 0x7ff54008c040 2024-09-21T09:03:20.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.351+0000 7ff552010800 20 remove_watcher() i=3 2024-09-21T09:03:20.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.351+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94062640384048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa47acd0 con 0x558caa432f30 2024-09-21T09:03:20.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.353+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94062640384048] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54403d040 con 0x558caa432f30 2024-09-21T09:03:20.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.353+0000 7ff552010800 20 remove_watcher() i=4 2024-09-21T09:03:20.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.353+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94062640386752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa47acd0 con 0x558caa4377a0 2024-09-21T09:03:20.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.354+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94062640386752] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.354+0000 7ff552010800 20 remove_watcher() i=5 2024-09-21T09:03:20.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.354+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94062640377984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa47acd0 con 0x558caa4377a0 2024-09-21T09:03:20.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.355+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94062640377984] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.355+0000 7ff552010800 20 remove_watcher() i=6 2024-09-21T09:03:20.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.355+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94062640391552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558caa47acd0 con 0x558caa4377a0 2024-09-21T09:03:20.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff54def8640 1 -- 172.21.15.178:0/2593761512 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94062640391552] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff548056040 con 0x558caa4377a0 2024-09-21T09:03:20.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 20 remove_watcher() i=7 2024-09-21T09:03:20.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558caa4377a0 msgr2=0x558caa439b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558caa4377a0 0x558caa439b90 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558caa432f30 msgr2=0x558caa4353f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558caa432f30 0x558caa4353f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff54008c040 msgr2=0x7ff54007d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff54008c040 0x7ff54007d3f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558caa43c380 msgr2=0x558caa43e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558caa43c380 0x558caa43e840 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff418036b90 msgr2=0x7ff418039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff418036b90 0x7ff418039050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff54008f3c0 tx=0x7ff540088000 comp rx=0 tx=0).stop 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa41fe10 msgr2=0x558caa4272a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 1 --2- 172.21.15.178:0/2593761512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa41fe10 0x558caa4272a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff54804ba90 tx=0x7ff54804cb00 comp rx=0 tx=0).stop 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 reap_dead start 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff54cef6640 1 -- 172.21.15.178:0/2593761512 reap_dead start 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 shutdown_connections 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.356+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 >> 172.21.15.178:0/2593761512 conn(0x558caa41c170 msgr2=0x558caa41a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 shutdown_connections 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 -- 172.21.15.178:0/2593761512 wait complete. 2024-09-21T09:03:20.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 -- 172.21.15.178:0/2782709452 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff424036b40 msgr2=0x7ff424039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 --2- 172.21.15.178:0/2782709452 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff424036b40 0x7ff424039000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x558caa3ffe80 tx=0x7ff540045e60 comp rx=0 tx=0).stop 2024-09-21T09:03:20.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 -- 172.21.15.178:0/2782709452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa413190 msgr2=0x558caa4135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 --2- 172.21.15.178:0/2782709452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa413190 0x558caa4135b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x558caa3ffd90 tx=0x7ff548018830 comp rx=0 tx=0).stop 2024-09-21T09:03:20.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 -- 172.21.15.178:0/2782709452 shutdown_connections 2024-09-21T09:03:20.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 --2- 172.21.15.178:0/2782709452 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff424036b40 0x7ff424039000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 --2- 172.21.15.178:0/2782709452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa413190 0x558caa4135b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 -- 172.21.15.178:0/2782709452 >> 172.21.15.178:0/2782709452 conn(0x558caa408120 msgr2=0x558caa40aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 -- 172.21.15.178:0/2782709452 shutdown_connections 2024-09-21T09:03:20.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 -- 172.21.15.178:0/2782709452 wait complete. 2024-09-21T09:03:20.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558caa401d30 msgr2=0x558caa404120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558caa401d30 0x558caa404120 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558caa304bd0 msgr2=0x558caa3ff450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558caa304bd0 0x558caa3ff450 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff434036b90 msgr2=0x7ff434039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff434036b90 0x7ff434039050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff544000f60 tx=0x7ff5440012b0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 msgr2=0x558caa3f83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa3f83e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x558caa3f18d0 tx=0x7ff540002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 shutdown_connections 2024-09-21T09:03:20.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558caa401d30 0x558caa404120 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558caa304bd0 0x558caa3ff450 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff434036b90 0x7ff434039050 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 --2- 172.21.15.178:0/2988404544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558caa2735f0 0x558caa3f83e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.357+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 >> 172.21.15.178:0/2988404544 conn(0x558caa2f9de0 msgr2=0x558caa3eaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.358+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 shutdown_connections 2024-09-21T09:03:20.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.358+0000 7ff552010800 1 -- 172.21.15.178:0/2988404544 wait complete. 2024-09-21T09:03:20.378 INFO:teuthology.orchestra.run.smithi178.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"68ad48f1-b3da-4499-bba2-41066e92d255","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1","marker":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-21T09:03:19.561268Z","creation_time":"2024-09-21T09:03:19.558161Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-21T09:03:20.378 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68ad48f1-b3da-4499-bba2-41066e92d255', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1', 'marker': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T09:03:19.561268Z', 'creation_time': '2024-09-21T09:03:19.558161Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-21T09:03:20.379 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-21T09:03:20.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-21T09:03:20.379 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-21T09:03:20.424 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:20.424 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:20.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.423+0000 7fa74d322800 1 Processor -- start 2024-09-21T09:03:20.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.423+0000 7fa74d322800 1 -- start start 2024-09-21T09:03:20.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.423+0000 7fa74d322800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55a63c6a3630 0x55a63c732200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.423+0000 7fa74d322800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a63c5eeb30 con 0x55a63c732740 2024-09-21T09:03:20.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.423+0000 7fa74d322800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55a63c5d0360 con 0x55a63c6a3630 2024-09-21T09:03:20.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.424+0000 7fa748fb8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55a63c6a3630 0x55a63c732200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.424+0000 7fa748fb8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55a63c6a3630 0x55a63c732200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43340/0 (socket says 172.21.15.178:43340) 2024-09-21T09:03:20.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.424+0000 7fa7487b7640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55a63c732740 0x55a63c734b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46776/0 (socket says 172.21.15.178:46776) 2024-09-21T09:03:20.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.424+0000 7fa748fb8640 1 -- 172.21.15.178:0/136730603 learned_addr learned my addr 172.21.15.178:0/136730603 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.424+0000 7fa748fb8640 1 -- 172.21.15.178:0/136730603 >> v1:172.21.15.44:6789/0 conn(0x55a63c732740 legacy=0x55a63c734b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.424+0000 7fa748fb8640 1 -- 172.21.15.178:0/136730603 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63c5f6e00 con 0x55a63c6a3630 2024-09-21T09:03:20.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.426+0000 7fa748fb8640 1 --2- 172.21.15.178:0/136730603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c732200 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa73800a520 tx=0x7fa738045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6744519d4f84a08d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.426+0000 7fa747fb6640 1 -- 172.21.15.178:0/136730603 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738055070 con 0x55a63c6a3630 2024-09-21T09:03:20.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.426+0000 7fa747fb6640 1 -- 172.21.15.178:0/136730603 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7380515b0 con 0x55a63c6a3630 2024-09-21T09:03:20.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.426+0000 7fa747fb6640 1 -- 172.21.15.178:0/136730603 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7380518d0 con 0x55a63c6a3630 2024-09-21T09:03:20.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.426+0000 7fa74d322800 1 -- 172.21.15.178:0/136730603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 msgr2=0x55a63c732200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.426+0000 7fa74d322800 1 --2- 172.21.15.178:0/136730603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c732200 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa73800a520 tx=0x7fa738045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.426+0000 7fa74d322800 1 -- 172.21.15.178:0/136730603 shutdown_connections 2024-09-21T09:03:20.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.426+0000 7fa74d322800 1 --2- 172.21.15.178:0/136730603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c732200 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.426+0000 7fa74d322800 1 -- 172.21.15.178:0/136730603 >> 172.21.15.178:0/136730603 conn(0x55a63c729db0 msgr2=0x55a63c72c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.426+0000 7fa74d322800 1 -- 172.21.15.178:0/136730603 shutdown_connections 2024-09-21T09:03:20.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.426+0000 7fa74d322800 1 -- 172.21.15.178:0/136730603 wait complete. 2024-09-21T09:03:20.442 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.440+0000 7fa74d322800 1 Processor -- start 2024-09-21T09:03:20.442 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.440+0000 7fa74d322800 1 -- start start 2024-09-21T09:03:20.442 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.440+0000 7fa74d322800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c81e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.442 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.440+0000 7fa74d322800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a63c67b360 con 0x55a63c6a3630 2024-09-21T09:03:20.443 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.441+0000 7fa748fb8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c81e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.443 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.441+0000 7fa748fb8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c81e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43344/0 (socket says 172.21.15.178:43344) 2024-09-21T09:03:20.443 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.441+0000 7fa748fb8640 1 -- 172.21.15.178:0/1766360133 learned_addr learned my addr 172.21.15.178:0/1766360133 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.441+0000 7fa748fb8640 1 -- 172.21.15.178:0/1766360133 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63c5c8bc0 con 0x55a63c6a3630 2024-09-21T09:03:20.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.441+0000 7fa748fb8640 1 --2- 172.21.15.178:0/1766360133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c81e830 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa738025da0 tx=0x7fa738051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6fc6dce1156056 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.441+0000 7fa636e0d640 1 -- 172.21.15.178:0/1766360133 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738051890 con 0x55a63c6a3630 2024-09-21T09:03:20.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.441+0000 7fa636e0d640 1 -- 172.21.15.178:0/1766360133 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa738051ac0 con 0x55a63c6a3630 2024-09-21T09:03:20.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.441+0000 7fa636e0d640 1 -- 172.21.15.178:0/1766360133 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738051da0 con 0x55a63c6a3630 2024-09-21T09:03:20.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.442+0000 7fa74d322800 1 -- 172.21.15.178:0/1766360133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 msgr2=0x55a63c81e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.442+0000 7fa74d322800 1 --2- 172.21.15.178:0/1766360133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c81e830 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa738025da0 tx=0x7fa738051000 comp rx=0 tx=0).stop 2024-09-21T09:03:20.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.442+0000 7fa74d322800 1 -- 172.21.15.178:0/1766360133 shutdown_connections 2024-09-21T09:03:20.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.442+0000 7fa74d322800 1 --2- 172.21.15.178:0/1766360133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c81e830 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.442+0000 7fa74d322800 1 -- 172.21.15.178:0/1766360133 >> 172.21.15.178:0/1766360133 conn(0x55a63c729db0 msgr2=0x55a63c81a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.442+0000 7fa74d322800 1 -- 172.21.15.178:0/1766360133 shutdown_connections 2024-09-21T09:03:20.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.442+0000 7fa74d322800 1 -- 172.21.15.178:0/1766360133 wait complete. 2024-09-21T09:03:20.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.442+0000 7fa74d322800 1 Processor -- start 2024-09-21T09:03:20.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.443+0000 7fa74d322800 1 -- start start 2024-09-21T09:03:20.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.443+0000 7fa74d322800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c826060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.443+0000 7fa74d322800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a63c736610 con 0x55a63c6a3630 2024-09-21T09:03:20.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.443+0000 7fa748fb8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c826060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.443+0000 7fa748fb8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c826060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43348/0 (socket says 172.21.15.178:43348) 2024-09-21T09:03:20.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.443+0000 7fa748fb8640 1 -- 172.21.15.178:0/303033090 learned_addr learned my addr 172.21.15.178:0/303033090 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.443+0000 7fa748fb8640 1 -- 172.21.15.178:0/303033090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63c5dcfe0 con 0x55a63c6a3630 2024-09-21T09:03:20.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.443+0000 7fa748fb8640 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c826060 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa738000c00 tx=0x7fa738002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.444+0000 7fa63560a640 1 -- 172.21.15.178:0/303033090 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738073070 con 0x55a63c6a3630 2024-09-21T09:03:20.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.444+0000 7fa63560a640 1 -- 172.21.15.178:0/303033090 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73805a450 con 0x55a63c6a3630 2024-09-21T09:03:20.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.444+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a63c8265a0 con 0x55a63c6a3630 2024-09-21T09:03:20.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.444+0000 7fa63560a640 1 -- 172.21.15.178:0/303033090 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73805a730 con 0x55a63c6a3630 2024-09-21T09:03:20.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.444+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a63c826b20 con 0x55a63c6a3630 2024-09-21T09:03:20.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.444+0000 7fa63560a640 1 -- 172.21.15.178:0/303033090 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa738076070 con 0x55a63c6a3630 2024-09-21T09:03:20.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.445+0000 7fa63560a640 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa630036b40 0x7fa630039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.445+0000 7fa63560a640 1 -- 172.21.15.178:0/303033090 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fa738062070 con 0x55a63c6a3630 2024-09-21T09:03:20.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.445+0000 7fa7487b7640 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa630036b40 0x7fa630039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.445+0000 7fa74d322800 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a63c732740 0x55a63c82d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.445+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c82d6a0 con 0x55a63c732740 2024-09-21T09:03:20.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.445+0000 7fa7497b9640 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a63c732740 0x55a63c82d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.445+0000 7fa7487b7640 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa630036b40 0x7fa630039000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa73c001e40 tx=0x7fa73c0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.445+0000 7fa7497b9640 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a63c732740 0x55a63c82d0d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.445+0000 7fa7497b9640 1 -- 172.21.15.178:0/303033090 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74000a4a0 con 0x55a63c732740 2024-09-21T09:03:20.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.445+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c82dfd0 con 0x55a63c732740 2024-09-21T09:03:20.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.446+0000 7fa7497b9640 1 -- 172.21.15.178:0/303033090 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa74000a4a0 con 0x55a63c732740 2024-09-21T09:03:20.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.446+0000 7fa74d322800 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a63c82f920 0x55a63c831db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.446+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c832540 con 0x55a63c82f920 2024-09-21T09:03:20.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.446+0000 7fa748fb8640 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a63c82f920 0x55a63c831db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.446+0000 7fa748fb8640 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a63c82f920 0x55a63c831db0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.447+0000 7fa748fb8640 1 -- 172.21.15.178:0/303033090 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c82f920 2024-09-21T09:03:20.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.447+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c82e820 con 0x55a63c732740 2024-09-21T09:03:20.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.447+0000 7fa7497b9640 1 -- 172.21.15.178:0/303033090 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa74000a4a0 con 0x55a63c732740 2024-09-21T09:03:20.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.447+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c82ec00 con 0x55a63c732740 2024-09-21T09:03:20.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.447+0000 7fa7497b9640 1 -- 172.21.15.178:0/303033090 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa74000a4a0 con 0x55a63c732740 2024-09-21T09:03:20.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.447+0000 7fa74d322800 1 Processor -- start 2024-09-21T09:03:20.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.448+0000 7fa74d322800 1 -- start start 2024-09-21T09:03:20.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.448+0000 7fa74d322800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c72fb90 0x55a63c72e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.448+0000 7fa74d322800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a63c5ca580 con 0x55a63c72fb90 2024-09-21T09:03:20.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.448+0000 7fa7497b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c72fb90 0x55a63c72e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.448+0000 7fa7497b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c72fb90 0x55a63c72e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43358/0 (socket says 172.21.15.178:43358) 2024-09-21T09:03:20.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.448+0000 7fa7497b9640 1 -- 172.21.15.178:0/1776355299 learned_addr learned my addr 172.21.15.178:0/1776355299 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.448+0000 7fa7497b9640 1 -- 172.21.15.178:0/1776355299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63c72ffb0 con 0x55a63c72fb90 2024-09-21T09:03:20.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.448+0000 7fa7497b9640 1 --2- 172.21.15.178:0/1776355299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c72fb90 0x55a63c72e1e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55a63c82daa0 tx=0x7fa740018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.449+0000 7fa62e7fc640 1 -- 172.21.15.178:0/1776355299 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa740014450 con 0x55a63c72fb90 2024-09-21T09:03:20.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.449+0000 7fa62e7fc640 1 -- 172.21.15.178:0/1776355299 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa740014610 con 0x55a63c72fb90 2024-09-21T09:03:20.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.449+0000 7fa74d322800 1 -- 172.21.15.178:0/1776355299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a63c72e780 con 0x55a63c72fb90 2024-09-21T09:03:20.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.449+0000 7fa62e7fc640 1 -- 172.21.15.178:0/1776355299 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa740014930 con 0x55a63c72fb90 2024-09-21T09:03:20.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.449+0000 7fa74d322800 1 -- 172.21.15.178:0/1776355299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a63c72ec80 con 0x55a63c72fb90 2024-09-21T09:03:20.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.449+0000 7fa62e7fc640 1 -- 172.21.15.178:0/1776355299 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa740011040 con 0x55a63c72fb90 2024-09-21T09:03:20.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.449+0000 7fa62e7fc640 1 --2- 172.21.15.178:0/1776355299 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa620036b90 0x7fa620039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.449+0000 7fa62e7fc640 1 -- 172.21.15.178:0/1776355299 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fa74001e070 con 0x55a63c72fb90 2024-09-21T09:03:20.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.450+0000 7fa748fb8640 1 --2- 172.21.15.178:0/1776355299 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa620036b90 0x7fa620039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.450+0000 7fa74d322800 1 Processor -- start 2024-09-21T09:03:20.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.450+0000 7fa748fb8640 1 --2- 172.21.15.178:0/1776355299 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa620036b90 0x7fa620039050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa738050c70 tx=0x7fa73806f420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.450+0000 7fa74d322800 1 -- start start 2024-09-21T09:03:20.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.450+0000 7fa74d322800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c84fcf0 0x55a63c8500f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.450+0000 7fa74d322800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a63c81ef20 con 0x55a63c84fcf0 2024-09-21T09:03:20.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.450+0000 7fa7497b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c84fcf0 0x55a63c8500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.450+0000 7fa7497b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c84fcf0 0x55a63c8500f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43368/0 (socket says 172.21.15.178:43368) 2024-09-21T09:03:20.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.450+0000 7fa7497b9640 1 -- 172.21.15.178:0/3698162364 learned_addr learned my addr 172.21.15.178:0/3698162364 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.450+0000 7fa7497b9640 1 -- 172.21.15.178:0/3698162364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63c8506c0 con 0x55a63c84fcf0 2024-09-21T09:03:20.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.451+0000 7fa7497b9640 1 --2- 172.21.15.178:0/3698162364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c84fcf0 0x55a63c8500f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa74004ccb0 tx=0x7fa740011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e445116d5651e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.451+0000 7fa61ffff640 1 -- 172.21.15.178:0/3698162364 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa740016940 con 0x55a63c84fcf0 2024-09-21T09:03:20.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.451+0000 7fa61ffff640 1 -- 172.21.15.178:0/3698162364 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa740014ad0 con 0x55a63c84fcf0 2024-09-21T09:03:20.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.451+0000 7fa61ffff640 1 -- 172.21.15.178:0/3698162364 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa740046aa0 con 0x55a63c84fcf0 2024-09-21T09:03:20.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.451+0000 7fa74d322800 1 -- 172.21.15.178:0/3698162364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c84fcf0 msgr2=0x55a63c8500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.451+0000 7fa74d322800 1 --2- 172.21.15.178:0/3698162364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c84fcf0 0x55a63c8500f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa74004ccb0 tx=0x7fa740011970 comp rx=0 tx=0).stop 2024-09-21T09:03:20.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.451+0000 7fa74d322800 1 -- 172.21.15.178:0/3698162364 shutdown_connections 2024-09-21T09:03:20.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.451+0000 7fa74d322800 1 --2- 172.21.15.178:0/3698162364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c84fcf0 0x55a63c8500f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.451+0000 7fa74d322800 1 -- 172.21.15.178:0/3698162364 >> 172.21.15.178:0/3698162364 conn(0x55a63c84c050 msgr2=0x55a63c84a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.451+0000 7fa74d322800 1 -- 172.21.15.178:0/3698162364 shutdown_connections 2024-09-21T09:03:20.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.451+0000 7fa74d322800 1 -- 172.21.15.178:0/3698162364 wait complete. 2024-09-21T09:03:20.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.452+0000 7fa74d322800 1 Processor -- start 2024-09-21T09:03:20.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.452+0000 7fa74d322800 1 -- start start 2024-09-21T09:03:20.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.452+0000 7fa74d322800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c84fcf0 0x55a63c857150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.452+0000 7fa74d322800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a63c850d30 con 0x55a63c84fcf0 2024-09-21T09:03:20.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.452+0000 7fa7497b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c84fcf0 0x55a63c857150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.452+0000 7fa7497b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c84fcf0 0x55a63c857150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43370/0 (socket says 172.21.15.178:43370) 2024-09-21T09:03:20.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.452+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 learned_addr learned my addr 172.21.15.178:0/1052440070 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.452+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63c857690 con 0x55a63c84fcf0 2024-09-21T09:03:20.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.453+0000 7fa7497b9640 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c84fcf0 0x55a63c857150 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa74004bbd0 tx=0x7fa74004cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.453+0000 7fa61e7fc640 1 -- 172.21.15.178:0/1052440070 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa740016940 con 0x55a63c84fcf0 2024-09-21T09:03:20.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.453+0000 7fa61e7fc640 1 -- 172.21.15.178:0/1052440070 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa740014c80 con 0x55a63c84fcf0 2024-09-21T09:03:20.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.453+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a63c857920 con 0x55a63c84fcf0 2024-09-21T09:03:20.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.453+0000 7fa61e7fc640 1 -- 172.21.15.178:0/1052440070 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa74004e4a0 con 0x55a63c84fcf0 2024-09-21T09:03:20.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.453+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a63c85a5d0 con 0x55a63c84fcf0 2024-09-21T09:03:20.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.453+0000 7fa61e7fc640 1 -- 172.21.15.178:0/1052440070 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa7400133b0 con 0x55a63c84fcf0 2024-09-21T09:03:20.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.454+0000 7fa61e7fc640 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa614036af0 0x7fa614038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.454+0000 7fa61e7fc640 1 -- 172.21.15.178:0/1052440070 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fa740034070 con 0x55a63c84fcf0 2024-09-21T09:03:20.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.454+0000 7fa748fb8640 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa614036af0 0x7fa614038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.454+0000 7fa74d322800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.454+0000 7fa74d322800 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a63c862db0 0x55a63c865270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.454+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8659c0 con 0x55a63c862db0 2024-09-21T09:03:20.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.454+0000 7fa7487b7640 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a63c862db0 0x55a63c865270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.454+0000 7fa748fb8640 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa614036af0 0x7fa614038fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa738051780 tx=0x7fa738089000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.454+0000 7fa7487b7640 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a63c862db0 0x55a63c865270 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa73c00f670 con 0x55a63c862db0 2024-09-21T09:03:20.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 20 realm 2024-09-21T09:03:20.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c862200 con 0x55a63c862db0 2024-09-21T09:03:20.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa73c00f670 con 0x55a63c862db0 2024-09-21T09:03:20.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:20.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8664a0 con 0x55a63c862db0 2024-09-21T09:03:20.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa73c00f670 con 0x55a63c862db0 2024-09-21T09:03:20.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c866d70 con 0x55a63c862db0 2024-09-21T09:03:20.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa73c00f670 con 0x55a63c862db0 2024-09-21T09:03:20.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:20.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a63c867620 0x55a63c869a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.455+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86a150 con 0x55a63c867620 2024-09-21T09:03:20.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.456+0000 7fa7497b9640 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a63c867620 0x55a63c869a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.456+0000 7fa7497b9640 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a63c867620 0x55a63c869a10 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.456+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.456+0000 7fa74d322800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:20.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.456+0000 7fa74d322800 20 searching for the correct realm 2024-09-21T09:03:20.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.456+0000 7fa74d322800 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a63c86c1f0 0x55a63c86e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.456+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c86c1f0 2024-09-21T09:03:20.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.456+0000 7fa748fb8640 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a63c86c1f0 0x55a63c86e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.457+0000 7fa748fb8640 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a63c86c1f0 0x55a63c86e6b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.457+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.457+0000 7fa748fb8640 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fa738078070 0x7fa7380670d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.457+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x7fa738078070 2024-09-21T09:03:20.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.457+0000 7fa7487b7640 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fa738078070 0x7fa7380670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.457+0000 7fa7487b7640 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fa738078070 0x7fa7380670d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.457+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c00f670 con 0x7fa738078070 2024-09-21T09:03:20.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.457+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c867620 2024-09-21T09:03:20.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.458+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.458+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c862db0 2024-09-21T09:03:20.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.458+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c00f670 con 0x55a63c862db0 2024-09-21T09:03:20.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.458+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c862db0 2024-09-21T09:03:20.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.458+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.458+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c867620 2024-09-21T09:03:20.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.458+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.458+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c867620 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.459+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.459+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x7fa738078070 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.459+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.459+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c86c1f0 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.459+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.459+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c862db0 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.459+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.459+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c867620 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.460+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.460+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c862db0 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.460+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.460+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x7fa738078070 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.460+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.460+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c86c1f0 2024-09-21T09:03:20.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.460+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.460+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c86c1f0 2024-09-21T09:03:20.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.461+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.461+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c867620 2024-09-21T09:03:20.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.461+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.461+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c86c1f0 2024-09-21T09:03:20.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.461+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.461+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c86c1f0 2024-09-21T09:03:20.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.461+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.461+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c862db0 2024-09-21T09:03:20.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.461+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.461+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c862db0 2024-09-21T09:03:20.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.462+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.462+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c867620 2024-09-21T09:03:20.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.462+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.462+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c86c1f0 2024-09-21T09:03:20.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.462+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.462+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x7fa738078070 2024-09-21T09:03:20.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.462+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.462+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c862db0 2024-09-21T09:03:20.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.463+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.463+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c867620 2024-09-21T09:03:20.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.463+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.463+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c86c1f0 2024-09-21T09:03:20.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.463+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.463+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c867620 2024-09-21T09:03:20.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.463+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.463+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x7fa738078070 2024-09-21T09:03:20.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.464+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.464+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c86c1f0 2024-09-21T09:03:20.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.464+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.464+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c867620 2024-09-21T09:03:20.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.464+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.464+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x55a63c862db0 2024-09-21T09:03:20.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.464+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.464+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86ed80 con 0x7fa738078070 2024-09-21T09:03:20.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:20.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:20.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:20.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:20.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:20.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:20.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86abf0 con 0x55a63c862db0 2024-09-21T09:03:20.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86a7d0 con 0x55a63c862db0 2024-09-21T09:03:20.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:20.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86b4d0 con 0x55a63c862db0 2024-09-21T09:03:20.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:20.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 zone default found 2024-09-21T09:03:20.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 4 Realm: () 2024-09-21T09:03:20.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:20.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:20.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:20.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 zonegroup default 2024-09-21T09:03:20.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.465+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c86f200 con 0x55a63c867620 2024-09-21T09:03:20.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.466+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.466+0000 7fa74d322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.466+0000 7fa74d322800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.466+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c871430 con 0x55a63c86c1f0 2024-09-21T09:03:20.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.466+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.466+0000 7fa74d322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.466+0000 7fa74d322800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.466+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8717d0 con 0x55a63c86c1f0 2024-09-21T09:03:20.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.466+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.466+0000 7fa74d322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.466+0000 7fa74d322800 20 started sync module instance, tier type = 2024-09-21T09:03:20.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.466+0000 7fa74d322800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:20.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.466+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c870870 con 0x7fa738078070 2024-09-21T09:03:20.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.467+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.467+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94172468415584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c870870 con 0x7fa738078070 2024-09-21T09:03:20.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.467+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c872190 con 0x55a63c862db0 2024-09-21T09:03:20.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.468+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94172468415584] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.469+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.469+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94172468413856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c872190 con 0x55a63c862db0 2024-09-21T09:03:20.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.469+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c872b90 con 0x55a63c86c1f0 2024-09-21T09:03:20.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.470+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.470+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94172468422304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c873430 con 0x55a63c86c1f0 2024-09-21T09:03:20.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.470+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c873eb0 con 0x7fa738078070 2024-09-21T09:03:20.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.470+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94172468413856] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.471+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94172468422304] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.471+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.471+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94172468424576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c871ce0 con 0x7fa738078070 2024-09-21T09:03:20.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.471+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c874750 con 0x55a63c862db0 2024-09-21T09:03:20.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.472+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.472+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94172468429392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c874670 con 0x55a63c862db0 2024-09-21T09:03:20.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.472+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c875650 con 0x55a63c867620 2024-09-21T09:03:20.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.472+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94172468424576] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.473+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.473+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94172468427168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c875610 con 0x55a63c867620 2024-09-21T09:03:20.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.473+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8760d0 con 0x55a63c867620 2024-09-21T09:03:20.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.473+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94172468429392] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.474+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94172468427168] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.475+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.475+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94172468431680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c875be0 con 0x55a63c867620 2024-09-21T09:03:20.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.475+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8765a0 con 0x55a63c867620 2024-09-21T09:03:20.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.476+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94172468431680] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.476+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.476+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94172468433248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8765a0 con 0x55a63c867620 2024-09-21T09:03:20.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.476+0000 7fa74d322800 20 add_watcher() i=0 2024-09-21T09:03:20.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.476+0000 7fa74d322800 20 add_watcher() i=1 2024-09-21T09:03:20.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.476+0000 7fa74d322800 20 add_watcher() i=2 2024-09-21T09:03:20.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.476+0000 7fa74d322800 20 add_watcher() i=3 2024-09-21T09:03:20.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.476+0000 7fa74d322800 20 add_watcher() i=4 2024-09-21T09:03:20.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.476+0000 7fa74d322800 20 add_watcher() i=5 2024-09-21T09:03:20.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.476+0000 7fa74d322800 20 add_watcher() i=6 2024-09-21T09:03:20.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.477+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94172468433248] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.477+0000 7fa74d322800 20 add_watcher() i=7 2024-09-21T09:03:20.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.477+0000 7fa74d322800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:20.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.477+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8799a0 con 0x55a63c862db0 2024-09-21T09:03:20.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.477+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.477+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94172468437696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c876ec0 con 0x55a63c862db0 2024-09-21T09:03:20.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.478+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94172468437696] v29'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.478+0000 7fa5fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:20.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.478+0000 7fa74d322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:20.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.478+0000 7fa74d322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:20.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.478+0000 7fa74d322800 5 note: GC not initialized 2024-09-21T09:03:20.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.478+0000 7fa5fdfe3640 20 reqs_thread_entry: start 2024-09-21T09:03:20.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.478+0000 7fa74d322800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:20.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.479+0000 7fa74d322800 20 Filter name: none 2024-09-21T09:03:20.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.479+0000 7fa56f7fe640 20 reqs_thread_entry: start 2024-09-21T09:03:20.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.479+0000 7fa74d322800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.479+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8ac9d0 con 0x55a63c862db0 2024-09-21T09:03:20.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.479+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.479+0000 7fa74d322800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:20.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.479+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8adf20 con 0x7fa738078070 2024-09-21T09:03:20.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.479+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.479+0000 7fa74d322800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.479+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8adf20 con 0x55a63c867620 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.480+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(64 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.480+0000 7fa74d322800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.480+0000 7fa74d322800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.480+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 4.3 4:c0ba99c0:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8af5f0 con 0x55a63c862db0 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.480+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 4.3a 4:5c12a2f4:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b22a0 con 0x55a63c86c1f0 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.480+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 4.2b 4:d7ea17ea:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b4fa0 con 0x55a63c862db0 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.480+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 4.2f 4:f6e88df9:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b7c50 con 0x55a63c862db0 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.480+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 4.38 4:1f78f3cb:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8ba940 con 0x55a63c862db0 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.480+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 4.13 4:c8101c22:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8bd560 con 0x7fa738078070 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.480+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 4.3f 4:fe592d9e:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b4fa0 con 0x7fa738078070 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.480+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:72 4.3a 4:5c7f5cbc:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8c22a0 con 0x55a63c86c1f0 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.480+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:73 4.13 4:ca88a996:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b4fa0 con 0x7fa738078070 2024-09-21T09:03:20.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.480+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:74 4.c 4:303bfd52:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8c6fe0 con 0x55a63c862db0 2024-09-21T09:03:20.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.480+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:75 4.30 4:0ce2a88a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8c9610 con 0x55a63c86c1f0 2024-09-21T09:03:20.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.481+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(66 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.481+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.481+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(72 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.481+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(67 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.481+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(68 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.481+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(69 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.481+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(74 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.481+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(70 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.5 [call out=124b] v0'0 uv4 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.481+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(71 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.481+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(73 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.481+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(75 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.481+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8af040 con 0x7fa738078070 2024-09-21T09:03:20.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.482+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(76 foo.buckets [call] v29'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.483+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8af040 con 0x7fa738078070 2024-09-21T09:03:20.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.483+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(77 foo.buckets [call] v29'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.483+0000 7fa74d322800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.483+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b75c0 con 0x55a63c862db0 2024-09-21T09:03:20.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.484+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.484+0000 7fa74d322800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:20.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.484+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b75c0 con 0x7fa738078070 2024-09-21T09:03:20.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.484+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.485+0000 7fa5fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:20.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.485+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94172468437696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b75c0 con 0x55a63c862db0 2024-09-21T09:03:20.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.486+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94172468437696] v29'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.486+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94172468415584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b75c0 con 0x7fa738078070 2024-09-21T09:03:20.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.487+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94172468415584] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.487+0000 7fa74d322800 20 remove_watcher() i=0 2024-09-21T09:03:20.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.487+0000 7fa74d322800 2 removed watcher, disabling cache 2024-09-21T09:03:20.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.487+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94172468413856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b75c0 con 0x55a63c862db0 2024-09-21T09:03:20.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.488+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94172468413856] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.488+0000 7fa74d322800 20 remove_watcher() i=1 2024-09-21T09:03:20.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.488+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94172468422304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b75c0 con 0x55a63c86c1f0 2024-09-21T09:03:20.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.489+0000 7fa748fb8640 1 -- 172.21.15.178:0/1052440070 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94172468422304] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73807f070 con 0x55a63c86c1f0 2024-09-21T09:03:20.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.489+0000 7fa74d322800 20 remove_watcher() i=2 2024-09-21T09:03:20.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.489+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94172468424576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b75c0 con 0x7fa738078070 2024-09-21T09:03:20.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.490+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94172468424576] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x7fa738078070 2024-09-21T09:03:20.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.490+0000 7fa74d322800 20 remove_watcher() i=3 2024-09-21T09:03:20.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.490+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94172468429392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b75c0 con 0x55a63c862db0 2024-09-21T09:03:20.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.491+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94172468429392] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c02b040 con 0x55a63c862db0 2024-09-21T09:03:20.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.491+0000 7fa74d322800 20 remove_watcher() i=4 2024-09-21T09:03:20.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.491+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94172468427168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b75c0 con 0x55a63c867620 2024-09-21T09:03:20.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.492+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94172468427168] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.492+0000 7fa74d322800 20 remove_watcher() i=5 2024-09-21T09:03:20.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.492+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94172468431680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b75c0 con 0x55a63c867620 2024-09-21T09:03:20.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.493+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94172468431680] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.493+0000 7fa74d322800 20 remove_watcher() i=6 2024-09-21T09:03:20.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.493+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94172468433248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a63c8b75c0 con 0x55a63c867620 2024-09-21T09:03:20.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa7497b9640 1 -- 172.21.15.178:0/1052440070 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94172468433248] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74002a070 con 0x55a63c867620 2024-09-21T09:03:20.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 20 remove_watcher() i=7 2024-09-21T09:03:20.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a63c867620 msgr2=0x55a63c869a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a63c867620 0x55a63c869a10 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a63c862db0 msgr2=0x55a63c865270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a63c862db0 0x55a63c865270 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fa738078070 msgr2=0x7fa7380670d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fa738078070 0x7fa7380670d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a63c86c1f0 msgr2=0x55a63c86e6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55a63c86c1f0 0x55a63c86e6b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa614036af0 msgr2=0x7fa614038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa614036af0 0x7fa614038fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa738051780 tx=0x7fa738089000 comp rx=0 tx=0).stop 2024-09-21T09:03:20.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c84fcf0 msgr2=0x55a63c857150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa7487b7640 1 -- 172.21.15.178:0/1052440070 reap_dead start 2024-09-21T09:03:20.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c84fcf0 0x55a63c857150 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa74004bbd0 tx=0x7fa74004cc40 comp rx=0 tx=0).stop 2024-09-21T09:03:20.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 shutdown_connections 2024-09-21T09:03:20.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 --2- 172.21.15.178:0/1052440070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c84fcf0 0x55a63c857150 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 >> 172.21.15.178:0/1052440070 conn(0x55a63c84c050 msgr2=0x55a63c84a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 shutdown_connections 2024-09-21T09:03:20.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.494+0000 7fa74d322800 1 -- 172.21.15.178:0/1052440070 wait complete. 2024-09-21T09:03:20.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 -- 172.21.15.178:0/1776355299 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa620036b90 msgr2=0x7fa620039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 --2- 172.21.15.178:0/1776355299 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa620036b90 0x7fa620039050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa738050c70 tx=0x7fa73806f420 comp rx=0 tx=0).stop 2024-09-21T09:03:20.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 -- 172.21.15.178:0/1776355299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c72fb90 msgr2=0x55a63c72e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 --2- 172.21.15.178:0/1776355299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c72fb90 0x55a63c72e1e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55a63c82daa0 tx=0x7fa740018830 comp rx=0 tx=0).stop 2024-09-21T09:03:20.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 -- 172.21.15.178:0/1776355299 shutdown_connections 2024-09-21T09:03:20.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 --2- 172.21.15.178:0/1776355299 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa620036b90 0x7fa620039050 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 --2- 172.21.15.178:0/1776355299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c72fb90 0x55a63c72e1e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 -- 172.21.15.178:0/1776355299 >> 172.21.15.178:0/1776355299 conn(0x55a63c835e50 msgr2=0x55a63c8389d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 -- 172.21.15.178:0/1776355299 shutdown_connections 2024-09-21T09:03:20.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 -- 172.21.15.178:0/1776355299 wait complete. 2024-09-21T09:03:20.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a63c82f920 msgr2=0x55a63c831db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a63c82f920 0x55a63c831db0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a63c732740 msgr2=0x55a63c82d0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a63c732740 0x55a63c82d0d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa630036b40 msgr2=0x7fa630039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa630036b40 0x7fa630039000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa73c001e40 tx=0x7fa73c0013a0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 msgr2=0x55a63c826060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c826060 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa738000c00 tx=0x7fa738002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 shutdown_connections 2024-09-21T09:03:20.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55a63c82f920 0x55a63c831db0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55a63c732740 0x55a63c82d0d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa630036b40 0x7fa630039000 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 --2- 172.21.15.178:0/303033090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a63c6a3630 0x55a63c826060 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 >> 172.21.15.178:0/303033090 conn(0x55a63c729db0 msgr2=0x55a63c818aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 shutdown_connections 2024-09-21T09:03:20.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.495+0000 7fa74d322800 1 -- 172.21.15.178:0/303033090 wait complete. 2024-09-21T09:03:20.505 INFO:teuthology.orchestra.run.smithi178.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-21T09:03:20.483826Z","last_stats_update":"2024-09-21T09:03:20.482470Z"} 2024-09-21T09:03:20.506 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-21T09:03:20.483826Z', 'last_stats_update': '2024-09-21T09:03:20.482470Z'} 2024-09-21T09:03:20.511 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:20.511 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-21T09:03:20.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-21T09:03:20.511 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-21T09:03:20.557 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:20.557 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:20.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.556+0000 7f902c542800 1 Processor -- start 2024-09-21T09:03:20.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.556+0000 7f902c542800 1 -- start start 2024-09-21T09:03:20.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.556+0000 7f902c542800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5632577d6d40 0x5632577d9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.556+0000 7f902c542800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56325768fb30 con 0x563257743df0 2024-09-21T09:03:20.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.556+0000 7f902c542800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x563257671360 con 0x5632577d6d40 2024-09-21T09:03:20.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.557+0000 7f901ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5632577d6d40 0x5632577d9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.557+0000 7f9028290640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x563257743df0 0x5632577d5620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46780/0 (socket says 172.21.15.178:46780) 2024-09-21T09:03:20.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.557+0000 7f901ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5632577d6d40 0x5632577d9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43386/0 (socket says 172.21.15.178:43386) 2024-09-21T09:03:20.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.557+0000 7f9028290640 1 -- 172.21.15.178:0/621753362 learned_addr learned my addr 172.21.15.178:0/621753362 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:20.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.557+0000 7f901ffff640 1 -- 172.21.15.178:0/621753362 >> v1:172.21.15.44:6789/0 conn(0x563257743df0 legacy=0x5632577d5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.557+0000 7f901ffff640 1 -- 172.21.15.178:0/621753362 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563257697e00 con 0x5632577d6d40 2024-09-21T09:03:20.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.559+0000 7f901ffff640 1 --2- 172.21.15.178:0/621753362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632577d6d40 0x5632577d9130 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f901000a470 tx=0x7f9010045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282a309d331310e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.559+0000 7f9027a8f640 1 -- 172.21.15.178:0/621753362 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9010053570 con 0x5632577d6d40 2024-09-21T09:03:20.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.559+0000 7f9027a8f640 1 -- 172.21.15.178:0/621753362 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9010058070 con 0x5632577d6d40 2024-09-21T09:03:20.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.559+0000 7f9027a8f640 1 -- 172.21.15.178:0/621753362 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9010053880 con 0x5632577d6d40 2024-09-21T09:03:20.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.559+0000 7f902c542800 1 -- 172.21.15.178:0/621753362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632577d6d40 msgr2=0x5632577d9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.559+0000 7f902c542800 1 --2- 172.21.15.178:0/621753362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632577d6d40 0x5632577d9130 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f901000a470 tx=0x7f9010045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:20.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.559+0000 7f902c542800 1 -- 172.21.15.178:0/621753362 shutdown_connections 2024-09-21T09:03:20.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.559+0000 7f902c542800 1 --2- 172.21.15.178:0/621753362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632577d6d40 0x5632577d9130 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.559+0000 7f902c542800 1 -- 172.21.15.178:0/621753362 >> 172.21.15.178:0/621753362 conn(0x5632577cadd0 msgr2=0x5632577cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.559+0000 7f902c542800 1 -- 172.21.15.178:0/621753362 shutdown_connections 2024-09-21T09:03:20.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.559+0000 7f902c542800 1 -- 172.21.15.178:0/621753362 wait complete. 2024-09-21T09:03:20.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.573+0000 7f902c542800 1 Processor -- start 2024-09-21T09:03:20.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.573+0000 7f902c542800 1 -- start start 2024-09-21T09:03:20.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.573+0000 7f902c542800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563257743df0 0x5632578c1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.573+0000 7f902c542800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56325771c360 con 0x563257743df0 2024-09-21T09:03:20.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.574+0000 7f9028290640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563257743df0 0x5632578c1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.574+0000 7f9028290640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563257743df0 0x5632578c1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43390/0 (socket says 172.21.15.178:43390) 2024-09-21T09:03:20.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.574+0000 7f9028290640 1 -- 172.21.15.178:0/1330166901 learned_addr learned my addr 172.21.15.178:0/1330166901 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.574+0000 7f9028290640 1 -- 172.21.15.178:0/1330166901 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563257669bc0 con 0x563257743df0 2024-09-21T09:03:20.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.574+0000 7f9028290640 1 --2- 172.21.15.178:0/1330166901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563257743df0 0x5632578c1a90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9018001d80 tx=0x7f9018001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76ec90e16eb00fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.574+0000 7f8f1660c640 1 -- 172.21.15.178:0/1330166901 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9018013030 con 0x563257743df0 2024-09-21T09:03:20.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.574+0000 7f8f1660c640 1 -- 172.21.15.178:0/1330166901 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f901800e470 con 0x563257743df0 2024-09-21T09:03:20.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.575+0000 7f8f1660c640 1 -- 172.21.15.178:0/1330166901 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f901800e810 con 0x563257743df0 2024-09-21T09:03:20.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.575+0000 7f902c542800 1 -- 172.21.15.178:0/1330166901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563257743df0 msgr2=0x5632578c1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.575+0000 7f902c542800 1 --2- 172.21.15.178:0/1330166901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563257743df0 0x5632578c1a90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9018001d80 tx=0x7f9018001e70 comp rx=0 tx=0).stop 2024-09-21T09:03:20.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.575+0000 7f902c542800 1 -- 172.21.15.178:0/1330166901 shutdown_connections 2024-09-21T09:03:20.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.575+0000 7f902c542800 1 --2- 172.21.15.178:0/1330166901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563257743df0 0x5632578c1a90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.575+0000 7f902c542800 1 -- 172.21.15.178:0/1330166901 >> 172.21.15.178:0/1330166901 conn(0x5632577cadd0 msgr2=0x5632578bd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.575+0000 7f902c542800 1 -- 172.21.15.178:0/1330166901 shutdown_connections 2024-09-21T09:03:20.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.575+0000 7f902c542800 1 -- 172.21.15.178:0/1330166901 wait complete. 2024-09-21T09:03:20.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.576+0000 7f902c542800 1 Processor -- start 2024-09-21T09:03:20.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.576+0000 7f902c542800 1 -- start start 2024-09-21T09:03:20.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.576+0000 7f902c542800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563257743df0 0x5632578c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.576+0000 7f902c542800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5632577d9910 con 0x563257743df0 2024-09-21T09:03:20.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.576+0000 7f9028290640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563257743df0 0x5632578c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.576+0000 7f9028290640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563257743df0 0x5632578c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43406/0 (socket says 172.21.15.178:43406) 2024-09-21T09:03:20.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.576+0000 7f9028290640 1 -- 172.21.15.178:0/2726535302 learned_addr learned my addr 172.21.15.178:0/2726535302 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.576+0000 7f9028290640 1 -- 172.21.15.178:0/2726535302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56325767dfe0 con 0x563257743df0 2024-09-21T09:03:20.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.576+0000 7f9028290640 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563257743df0 0x5632578c94a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9018004000 tx=0x7f9018000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.577+0000 7f8f14e09640 1 -- 172.21.15.178:0/2726535302 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9018027070 con 0x563257743df0 2024-09-21T09:03:20.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.577+0000 7f8f14e09640 1 -- 172.21.15.178:0/2726535302 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9018019900 con 0x563257743df0 2024-09-21T09:03:20.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.577+0000 7f8f14e09640 1 -- 172.21.15.178:0/2726535302 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9018019c60 con 0x563257743df0 2024-09-21T09:03:20.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.577+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632578c99e0 con 0x563257743df0 2024-09-21T09:03:20.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.577+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632578c9f00 con 0x563257743df0 2024-09-21T09:03:20.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.577+0000 7f8f14e09640 1 -- 172.21.15.178:0/2726535302 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f901802a070 con 0x563257743df0 2024-09-21T09:03:20.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.578+0000 7f8f14e09640 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8f10036b40 0x7f8f10039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.578+0000 7f8f14e09640 1 -- 172.21.15.178:0/2726535302 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f901801f070 con 0x563257743df0 2024-09-21T09:03:20.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.578+0000 7f901ffff640 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8f10036b40 0x7f8f10039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.578+0000 7f902c542800 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632577d6d40 0x5632578d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.578+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632578d0ae0 con 0x5632577d6d40 2024-09-21T09:03:20.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.578+0000 7f9028a91640 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632577d6d40 0x5632578d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.578+0000 7f901ffff640 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8f10036b40 0x7f8f10039000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9010057000 tx=0x7f9010052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.578+0000 7f9028a91640 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632577d6d40 0x5632578d0510 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.579+0000 7f9028a91640 1 -- 172.21.15.178:0/2726535302 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f902000a4a0 con 0x5632577d6d40 2024-09-21T09:03:20.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.579+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632578cdae0 con 0x5632577d6d40 2024-09-21T09:03:20.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.579+0000 7f9028a91640 1 -- 172.21.15.178:0/2726535302 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f902000a4a0 con 0x5632577d6d40 2024-09-21T09:03:20.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.579+0000 7f902c542800 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632578d2df0 0x5632578d51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.579+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632578d5880 con 0x5632578d2df0 2024-09-21T09:03:20.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.579+0000 7f9028290640 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632578d2df0 0x5632578d51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.580+0000 7f9028290640 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632578d2df0 0x5632578d51e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.580+0000 7f9028290640 1 -- 172.21.15.178:0/2726535302 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9018029030 con 0x5632578d2df0 2024-09-21T09:03:20.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.580+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632578d1c90 con 0x5632577d6d40 2024-09-21T09:03:20.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.580+0000 7f9028a91640 1 -- 172.21.15.178:0/2726535302 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f902000a4a0 con 0x5632577d6d40 2024-09-21T09:03:20.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.580+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632578d2170 con 0x5632577d6d40 2024-09-21T09:03:20.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.581+0000 7f9028a91640 1 -- 172.21.15.178:0/2726535302 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f902000a4a0 con 0x5632577d6d40 2024-09-21T09:03:20.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.581+0000 7f902c542800 1 Processor -- start 2024-09-21T09:03:20.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.581+0000 7f902c542800 1 -- start start 2024-09-21T09:03:20.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.581+0000 7f902c542800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578e4240 0x5632578e4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.581+0000 7f902c542800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56325766b580 con 0x5632578e4240 2024-09-21T09:03:20.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.581+0000 7f9028a91640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578e4240 0x5632578e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.581+0000 7f9028a91640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578e4240 0x5632578e4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43416/0 (socket says 172.21.15.178:43416) 2024-09-21T09:03:20.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.581+0000 7f9028a91640 1 -- 172.21.15.178:0/20964579 learned_addr learned my addr 172.21.15.178:0/20964579 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.581+0000 7f9028a91640 1 -- 172.21.15.178:0/20964579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632578e4ba0 con 0x5632578e4240 2024-09-21T09:03:20.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.582+0000 7f9028a91640 1 --2- 172.21.15.178:0/20964579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578e4240 0x5632578e4660 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x5632578ca550 tx=0x7f90200188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.582+0000 7f8f0dffb640 1 -- 172.21.15.178:0/20964579 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9020014450 con 0x5632578e4240 2024-09-21T09:03:20.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.582+0000 7f8f0dffb640 1 -- 172.21.15.178:0/20964579 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90200145f0 con 0x5632578e4240 2024-09-21T09:03:20.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.582+0000 7f902c542800 1 -- 172.21.15.178:0/20964579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632578e4e30 con 0x5632578e4240 2024-09-21T09:03:20.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.582+0000 7f8f0dffb640 1 -- 172.21.15.178:0/20964579 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90200148d0 con 0x5632578e4240 2024-09-21T09:03:20.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.582+0000 7f902c542800 1 -- 172.21.15.178:0/20964579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632578e7b10 con 0x5632578e4240 2024-09-21T09:03:20.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.583+0000 7f8f0dffb640 1 -- 172.21.15.178:0/20964579 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9020011040 con 0x5632578e4240 2024-09-21T09:03:20.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.583+0000 7f8f0dffb640 1 --2- 172.21.15.178:0/20964579 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8f00036b40 0x7f8f00039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.583+0000 7f8f0dffb640 1 -- 172.21.15.178:0/20964579 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f902001e070 con 0x5632578e4240 2024-09-21T09:03:20.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.583+0000 7f9028290640 1 --2- 172.21.15.178:0/20964579 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8f00036b40 0x7f8f00039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.583+0000 7f902c542800 1 Processor -- start 2024-09-21T09:03:20.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.583+0000 7f9028290640 1 --2- 172.21.15.178:0/20964579 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8f00036b40 0x7f8f00039000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x5632578d0f10 tx=0x7f901802ae80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.583+0000 7f902c542800 1 -- start start 2024-09-21T09:03:20.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.583+0000 7f902c542800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578f0ee0 0x5632578f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.583+0000 7f902c542800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5632578c2240 con 0x5632578f0ee0 2024-09-21T09:03:20.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.584+0000 7f9028a91640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578f0ee0 0x5632578f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.584+0000 7f9028a91640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578f0ee0 0x5632578f12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43428/0 (socket says 172.21.15.178:43428) 2024-09-21T09:03:20.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.584+0000 7f9028a91640 1 -- 172.21.15.178:0/3523453213 learned_addr learned my addr 172.21.15.178:0/3523453213 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.584+0000 7f9028a91640 1 -- 172.21.15.178:0/3523453213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632578f18b0 con 0x5632578f0ee0 2024-09-21T09:03:20.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.584+0000 7f9028a91640 1 --2- 172.21.15.178:0/3523453213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578f0ee0 0x5632578f12e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f902004cb90 tx=0x7f9020011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e5d90a7081c9c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.584+0000 7f8f077fe640 1 -- 172.21.15.178:0/3523453213 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9020044070 con 0x5632578f0ee0 2024-09-21T09:03:20.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.584+0000 7f8f077fe640 1 -- 172.21.15.178:0/3523453213 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902004e0d0 con 0x5632578f0ee0 2024-09-21T09:03:20.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.584+0000 7f8f077fe640 1 -- 172.21.15.178:0/3523453213 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f902004e3d0 con 0x5632578f0ee0 2024-09-21T09:03:20.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.584+0000 7f902c542800 1 -- 172.21.15.178:0/3523453213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578f0ee0 msgr2=0x5632578f12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.584+0000 7f902c542800 1 --2- 172.21.15.178:0/3523453213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578f0ee0 0x5632578f12e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f902004cb90 tx=0x7f9020011700 comp rx=0 tx=0).stop 2024-09-21T09:03:20.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.584+0000 7f902c542800 1 -- 172.21.15.178:0/3523453213 shutdown_connections 2024-09-21T09:03:20.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.584+0000 7f902c542800 1 --2- 172.21.15.178:0/3523453213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578f0ee0 0x5632578f12e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.584+0000 7f902c542800 1 -- 172.21.15.178:0/3523453213 >> 172.21.15.178:0/3523453213 conn(0x5632578ed290 msgr2=0x5632578eb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.585+0000 7f902c542800 1 -- 172.21.15.178:0/3523453213 shutdown_connections 2024-09-21T09:03:20.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.585+0000 7f902c542800 1 -- 172.21.15.178:0/3523453213 wait complete. 2024-09-21T09:03:20.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.585+0000 7f902c542800 1 Processor -- start 2024-09-21T09:03:20.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.585+0000 7f902c542800 1 -- start start 2024-09-21T09:03:20.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.585+0000 7f902c542800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578f0ee0 0x5632578f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.585+0000 7f902c542800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5632578f1e80 con 0x5632578f0ee0 2024-09-21T09:03:20.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.585+0000 7f9028a91640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578f0ee0 0x5632578f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.585+0000 7f9028a91640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578f0ee0 0x5632578f8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43436/0 (socket says 172.21.15.178:43436) 2024-09-21T09:03:20.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.585+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 learned_addr learned my addr 172.21.15.178:0/4110090876 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.585+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632578f88b0 con 0x5632578f0ee0 2024-09-21T09:03:20.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.586+0000 7f9028a91640 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578f0ee0 0x5632578f8370 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9020011740 tx=0x7f902004cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.586+0000 7f8f05ffb640 1 -- 172.21.15.178:0/4110090876 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f902002b350 con 0x5632578f0ee0 2024-09-21T09:03:20.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.586+0000 7f8f05ffb640 1 -- 172.21.15.178:0/4110090876 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902002b4f0 con 0x5632578f0ee0 2024-09-21T09:03:20.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.586+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632578f8b40 con 0x5632578f0ee0 2024-09-21T09:03:20.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.586+0000 7f8f05ffb640 1 -- 172.21.15.178:0/4110090876 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f902002b810 con 0x5632578f0ee0 2024-09-21T09:03:20.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.586+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632578fb7f0 con 0x5632578f0ee0 2024-09-21T09:03:20.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.586+0000 7f8f05ffb640 1 -- 172.21.15.178:0/4110090876 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f902003e020 con 0x5632578f0ee0 2024-09-21T09:03:20.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.587+0000 7f8f05ffb640 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ef8036b40 0x7f8ef8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.587+0000 7f8f05ffb640 1 -- 172.21.15.178:0/4110090876 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f902003c020 con 0x5632578f0ee0 2024-09-21T09:03:20.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.587+0000 7f9028290640 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ef8036b40 0x7f8ef8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.587+0000 7f9028290640 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ef8036b40 0x7f8ef8039000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9018016fd0 tx=0x7f9018036000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.588+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.588+0000 7f902c542800 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563257904020 0x5632579064e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.588+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563257906c30 con 0x563257904020 2024-09-21T09:03:20.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.588+0000 7f901ffff640 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563257904020 0x5632579064e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.588+0000 7f901ffff640 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563257904020 0x5632579064e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.588+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.588+0000 7f902c542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.588+0000 7f902c542800 20 realm 2024-09-21T09:03:20.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.588+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.588+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563257907060 con 0x563257904020 2024-09-21T09:03:20.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f902c542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f902c542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:20.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563257907930 con 0x563257904020 2024-09-21T09:03:20.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f902c542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563257907cd0 con 0x563257904020 2024-09-21T09:03:20.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f902c542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:20.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f902c542800 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563257908a30 0x56325790ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56325790b470 con 0x563257908a30 2024-09-21T09:03:20.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.589+0000 7f9028a91640 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563257908a30 0x56325790ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.590+0000 7f9028a91640 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563257908a30 0x56325790ae20 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.590+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.590+0000 7f902c542800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:20.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.590+0000 7f902c542800 20 searching for the correct realm 2024-09-21T09:03:20.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.590+0000 7f902c542800 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56325790d420 0x56325790f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.590+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56325790ffb0 con 0x56325790d420 2024-09-21T09:03:20.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.590+0000 7f9028290640 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56325790d420 0x56325790f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.590+0000 7f9028290640 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56325790d420 0x56325790f8e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.591+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9018029030 con 0x56325790d420 2024-09-21T09:03:20.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.591+0000 7f9028290640 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f901802c060 0x7f901802a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.591+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56325790ffb0 con 0x7f901802c060 2024-09-21T09:03:20.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.591+0000 7f901ffff640 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f901802c060 0x7f901802a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.591+0000 7f901ffff640 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f901802c060 0x7f901802a580 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.591+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.591+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56325790ffb0 con 0x563257908a30 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.591+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.592+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56325790b470 con 0x563257904020 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.592+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.592+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56325790b470 con 0x563257904020 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.592+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.592+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56325790b470 con 0x563257908a30 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.592+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.592+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56325790b470 con 0x563257908a30 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.593+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.593+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56325790b470 con 0x7f901802c060 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.593+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.593+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56325790b470 con 0x56325790d420 2024-09-21T09:03:20.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.593+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9018029030 con 0x56325790d420 2024-09-21T09:03:20.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.593+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x563257904020 2024-09-21T09:03:20.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.593+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.593+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x563257908a30 2024-09-21T09:03:20.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.594+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.594+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x563257904020 2024-09-21T09:03:20.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.594+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.594+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x7f901802c060 2024-09-21T09:03:20.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.594+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.594+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x56325790d420 2024-09-21T09:03:20.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.594+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9018029030 con 0x56325790d420 2024-09-21T09:03:20.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.594+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x56325790d420 2024-09-21T09:03:20.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.594+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9018029030 con 0x56325790d420 2024-09-21T09:03:20.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.594+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x563257908a30 2024-09-21T09:03:20.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.595+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.595+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x56325790d420 2024-09-21T09:03:20.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.595+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9018029030 con 0x56325790d420 2024-09-21T09:03:20.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.595+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x56325790d420 2024-09-21T09:03:20.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.595+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9018029030 con 0x56325790d420 2024-09-21T09:03:20.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.595+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x563257904020 2024-09-21T09:03:20.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.595+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.595+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x563257904020 2024-09-21T09:03:20.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.596+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.596+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x563257908a30 2024-09-21T09:03:20.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.596+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.596+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x56325790d420 2024-09-21T09:03:20.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.596+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9018029030 con 0x56325790d420 2024-09-21T09:03:20.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.596+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x7f901802c060 2024-09-21T09:03:20.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.596+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.597+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x563257904020 2024-09-21T09:03:20.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.597+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.597+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x563257908a30 2024-09-21T09:03:20.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.597+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.597+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x56325790d420 2024-09-21T09:03:20.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.597+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9018029030 con 0x56325790d420 2024-09-21T09:03:20.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.597+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x563257908a30 2024-09-21T09:03:20.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.598+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.598+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x7f901802c060 2024-09-21T09:03:20.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.598+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.598+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x56325790d420 2024-09-21T09:03:20.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.598+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9018029030 con 0x56325790d420 2024-09-21T09:03:20.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.598+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x563257908a30 2024-09-21T09:03:20.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.598+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.598+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x563257904020 2024-09-21T09:03:20.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9018059040 con 0x7f901802c060 2024-09-21T09:03:20.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f902c542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:20.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f902c542800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:20.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f902c542800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:20.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f902c542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:20.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f902c542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:20.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f902c542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:20.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56325790bd30 con 0x563257904020 2024-09-21T09:03:20.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f902c542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56325790c120 con 0x563257904020 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f902c542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.599+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56325790c540 con 0x563257904020 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 20 zone default found 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 4 Realm: () 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:20.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 20 zonegroup default 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563257910430 con 0x563257908a30 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632579121e0 con 0x56325790d420 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9018029030 con 0x56325790d420 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563257912670 con 0x56325790d420 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.600+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9018029030 con 0x56325790d420 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.601+0000 7f902c542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.601+0000 7f902c542800 20 started sync module instance, tier type = 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.601+0000 7f902c542800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:20.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.601+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257911650 con 0x7f901802c060 2024-09-21T09:03:20.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.602+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.602+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94774217481040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257911650 con 0x7f901802c060 2024-09-21T09:03:20.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.602+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257913170 con 0x563257904020 2024-09-21T09:03:20.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.603+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94774217481040] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.603+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.603+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94774217485392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257911650 con 0x563257904020 2024-09-21T09:03:20.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.603+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257913be0 con 0x56325790d420 2024-09-21T09:03:20.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.604+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9018029030 con 0x56325790d420 2024-09-21T09:03:20.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.604+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94774217488080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257914480 con 0x56325790d420 2024-09-21T09:03:20.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.604+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257914f40 con 0x7f901802c060 2024-09-21T09:03:20.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.604+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94774217485392] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.605+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94774217488080] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9018029030 con 0x56325790d420 2024-09-21T09:03:20.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.605+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.605+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94774217490384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632579111a0 con 0x7f901802c060 2024-09-21T09:03:20.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.605+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632579157e0 con 0x563257904020 2024-09-21T09:03:20.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.606+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94774217490384] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.606+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.606+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94774217493008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257915740 con 0x563257904020 2024-09-21T09:03:20.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.606+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632579161f0 con 0x563257908a30 2024-09-21T09:03:20.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.607+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.607+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94774217497920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257916650 con 0x563257908a30 2024-09-21T09:03:20.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.607+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94774217493008] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.607+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257917150 con 0x563257908a30 2024-09-21T09:03:20.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.608+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94774217497920] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.609+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.609+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94774217501760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257916160 con 0x563257908a30 2024-09-21T09:03:20.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.609+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257917730 con 0x563257908a30 2024-09-21T09:03:20.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.610+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.610+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94774217503360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257917b50 con 0x563257908a30 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.610+0000 7f902c542800 20 add_watcher() i=0 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.610+0000 7f902c542800 20 add_watcher() i=1 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.610+0000 7f902c542800 20 add_watcher() i=2 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.610+0000 7f902c542800 20 add_watcher() i=3 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.610+0000 7f902c542800 20 add_watcher() i=4 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.610+0000 7f902c542800 20 add_watcher() i=5 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.610+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94774217501760] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.610+0000 7f902c542800 20 add_watcher() i=6 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.610+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94774217503360] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.610+0000 7f902c542800 20 add_watcher() i=7 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.610+0000 7f902c542800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.610+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563257917b50 con 0x563257904020 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.611+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.611+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94774217504416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257917ac0 con 0x563257904020 2024-09-21T09:03:20.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.612+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94774217504416] v29'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.612+0000 7f8ede7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.612+0000 7f902c542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.612+0000 7f902c542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.612+0000 7f902c542800 5 note: GC not initialized 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.612+0000 7f8edd7e2640 20 reqs_thread_entry: start 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.612+0000 7f902c542800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.612+0000 7f902c542800 20 Filter name: none 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.612+0000 7f8e4effd640 20 reqs_thread_entry: start 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.612+0000 7f902c542800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.612+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.612+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56325794dea0 con 0x563257904020 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f902c542800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f902c542800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:20.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f902c542800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:20.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f902c542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:20.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f902c542800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T09:03:20.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56325794ff80 con 0x7f901802c060 2024-09-21T09:03:20.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f902c542800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:20.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f902c542800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T09:03:20.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f902c542800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:20.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f902c542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 : miss 2024-09-21T09:03:20.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.613+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563257951780 con 0x563257908a30 2024-09-21T09:03:20.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.614+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(64 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.614+0000 7f902c542800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:20.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.614+0000 7f902c542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:20.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.614+0000 7f902c542800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:20.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.614+0000 7f902c542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:20.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.614+0000 7f902c542800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:20.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.614+0000 7f902c542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 2024-09-21T09:03:20.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.614+0000 7f902c542800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-21T09:03:20.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.614+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257952aa0 con 0x7f901802c060 2024-09-21T09:03:20.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.615+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(65 foo.buckets [call] v29'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.615+0000 7f902c542800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-21T09:03:20.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.615+0000 7f902c542800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.615+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632579525f0 con 0x7f901802c060 2024-09-21T09:03:20.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.615+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.615+0000 7f902c542800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:20.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.615+0000 7f902c542800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-21T09:03:20.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.615+0000 7f902c542800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:20.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.615+0000 7f902c542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:20.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.615+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563257958ad0 con 0x7f901802c060 2024-09-21T09:03:20.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.617+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v29'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.617+0000 7f902c542800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-21T09:03:20.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.617+0000 7f902c542800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:20.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.617+0000 7f902c542800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T09:03:20.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.617+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94774217754080 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563257956020 con 0x563257908a30 2024-09-21T09:03:20.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.617+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== watch-notify(notify (1) cookie 94774217501760 notify 124554051586 ret 0) ==== 380+0+0 (crc 0 0 0) 0x563257950ca0 con 0x563257908a30 2024-09-21T09:03:20.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.617+0000 7f8f077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051586 cookie 94774217501760 notifier 4483 bl.length()=338 2024-09-21T09:03:20.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.617+0000 7f8f077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-21T09:03:20.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.617+0000 7f8f077fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:20.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.617+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(68 notify.6 [notify cookie 94774217754080 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.617+0000 7f8f077fe640 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8eec003ea0 con 0x563257908a30 2024-09-21T09:03:20.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.617+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.618+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== watch-notify(notify_complete (2) cookie 94774217754080 notify 124554051586 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632578f8b40 con 0x563257908a30 2024-09-21T09:03:20.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.618+0000 7f8ede7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:20.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.618+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94774217504416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56325794bbf0 con 0x563257904020 2024-09-21T09:03:20.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.619+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94774217504416] v29'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.619+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94774217481040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56325794bbf0 con 0x7f901802c060 2024-09-21T09:03:20.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.620+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94774217481040] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.620+0000 7f902c542800 20 remove_watcher() i=0 2024-09-21T09:03:20.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.620+0000 7f902c542800 2 removed watcher, disabling cache 2024-09-21T09:03:20.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.620+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94774217485392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56325794bbf0 con 0x563257904020 2024-09-21T09:03:20.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.621+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94774217485392] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.621+0000 7f902c542800 20 remove_watcher() i=1 2024-09-21T09:03:20.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.621+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94774217488080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56325794bbf0 con 0x56325790d420 2024-09-21T09:03:20.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.622+0000 7f9028290640 1 -- 172.21.15.178:0/4110090876 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94774217488080] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9018029030 con 0x56325790d420 2024-09-21T09:03:20.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.622+0000 7f902c542800 20 remove_watcher() i=2 2024-09-21T09:03:20.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.622+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94774217490384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56325794bbf0 con 0x7f901802c060 2024-09-21T09:03:20.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.623+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94774217490384] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010051070 con 0x7f901802c060 2024-09-21T09:03:20.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.623+0000 7f902c542800 20 remove_watcher() i=3 2024-09-21T09:03:20.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.623+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94774217493008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56325794bbf0 con 0x563257904020 2024-09-21T09:03:20.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.624+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94774217493008] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010051070 con 0x563257904020 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.624+0000 7f902c542800 20 remove_watcher() i=4 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.624+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94774217497920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56325794bbf0 con 0x563257908a30 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.625+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94774217497920] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.625+0000 7f902c542800 20 remove_watcher() i=5 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.625+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94774217501760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56325794bbf0 con 0x563257908a30 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.626+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94774217501760] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.626+0000 7f902c542800 20 remove_watcher() i=6 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.626+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94774217503360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56325794bbf0 con 0x563257908a30 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f9028a91640 1 -- 172.21.15.178:0/4110090876 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94774217503360] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902002a070 con 0x563257908a30 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f902c542800 20 remove_watcher() i=7 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563257908a30 msgr2=0x56325790ae20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f902c542800 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563257908a30 0x56325790ae20 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563257904020 msgr2=0x5632579064e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f902c542800 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563257904020 0x5632579064e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f901802c060 msgr2=0x7f901802a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f902c542800 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f901802c060 0x7f901802a580 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56325790d420 msgr2=0x56325790f8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f902c542800 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56325790d420 0x56325790f8e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ef8036b40 msgr2=0x7f8ef8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f902c542800 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8ef8036b40 0x7f8ef8039000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9018016fd0 tx=0x7f9018036000 comp rx=0 tx=0).stop 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578f0ee0 msgr2=0x5632578f8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f902c542800 1 --2- 172.21.15.178:0/4110090876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578f0ee0 0x5632578f8370 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9020011740 tx=0x7f902004cb20 comp rx=0 tx=0).stop 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 reap_dead start 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.627+0000 7f901ffff640 1 -- 172.21.15.178:0/4110090876 reap_dead start 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 shutdown_connections 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 >> 172.21.15.178:0/4110090876 conn(0x5632578ed290 msgr2=0x5632578f25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 shutdown_connections 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/4110090876 wait complete. 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/20964579 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8f00036b40 msgr2=0x7f8f00039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 --2- 172.21.15.178:0/20964579 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8f00036b40 0x7f8f00039000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x5632578d0f10 tx=0x7f901802ae80 comp rx=0 tx=0).stop 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/20964579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578e4240 msgr2=0x5632578e4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 --2- 172.21.15.178:0/20964579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578e4240 0x5632578e4660 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x5632578ca550 tx=0x7f90200188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/20964579 shutdown_connections 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 --2- 172.21.15.178:0/20964579 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8f00036b40 0x7f8f00039000 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 --2- 172.21.15.178:0/20964579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5632578e4240 0x5632578e4660 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/20964579 >> 172.21.15.178:0/20964579 conn(0x5632578d91d0 msgr2=0x5632578dbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/20964579 shutdown_connections 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/20964579 wait complete. 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632578d2df0 msgr2=0x5632578d51e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632578d2df0 0x5632578d51e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632577d6d40 msgr2=0x5632578d0510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632577d6d40 0x5632578d0510 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8f10036b40 msgr2=0x7f8f10039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8f10036b40 0x7f8f10039000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9010057000 tx=0x7f9010052000 comp rx=0 tx=0).stop 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563257743df0 msgr2=0x5632578c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563257743df0 0x5632578c94a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9018004000 tx=0x7f9018000bc0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 shutdown_connections 2024-09-21T09:03:20.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5632578d2df0 0x5632578d51e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5632577d6d40 0x5632578d0510 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8f10036b40 0x7f8f10039000 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 --2- 172.21.15.178:0/2726535302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563257743df0 0x5632578c94a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.628+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 >> 172.21.15.178:0/2726535302 conn(0x5632577cadd0 msgr2=0x5632578bbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.629+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 shutdown_connections 2024-09-21T09:03:20.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.629+0000 7f902c542800 1 -- 172.21.15.178:0/2726535302 wait complete. 2024-09-21T09:03:20.639 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-21T09:03:20.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-21T09:03:20.639 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-21T09:03:20.692 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:20.692 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:20.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.691+0000 7ff10a830800 1 Processor -- start 2024-09-21T09:03:20.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.691+0000 7ff10a830800 1 -- start start 2024-09-21T09:03:20.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.691+0000 7ff10a830800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5593779addd0 0x5593779b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.691+0000 7ff10a830800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559377866b30 con 0x55937791b650 2024-09-21T09:03:20.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.691+0000 7ff10a830800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x559377848360 con 0x5593779addd0 2024-09-21T09:03:20.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.692+0000 7ff0fd272640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5593779addd0 0x5593779b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.692+0000 7ff105a73640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55937791b650 0x5593779ac6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46792/0 (socket says 172.21.15.178:46792) 2024-09-21T09:03:20.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.692+0000 7ff105a73640 1 -- 172.21.15.178:0/2831377669 learned_addr learned my addr 172.21.15.178:0/2831377669 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:20.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.692+0000 7ff0fd272640 1 -- 172.21.15.178:0/2831377669 >> v1:172.21.15.44:6789/0 conn(0x55937791b650 legacy=0x5593779ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.692+0000 7ff0fd272640 1 -- 172.21.15.178:0/2831377669 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55937786ee00 con 0x5593779addd0 2024-09-21T09:03:20.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.694+0000 7ff0fd272640 1 --2- 172.21.15.178:0/2831377669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5593779addd0 0x5593779b01c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000a470 tx=0x7ff0f0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69d721dbaebd3b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.694+0000 7ff105272640 1 -- 172.21.15.178:0/2831377669 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f0053570 con 0x5593779addd0 2024-09-21T09:03:20.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.694+0000 7ff105272640 1 -- 172.21.15.178:0/2831377669 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f0058070 con 0x5593779addd0 2024-09-21T09:03:20.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.694+0000 7ff105272640 1 -- 172.21.15.178:0/2831377669 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f0053880 con 0x5593779addd0 2024-09-21T09:03:20.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.694+0000 7ff10a830800 1 -- 172.21.15.178:0/2831377669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5593779addd0 msgr2=0x5593779b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.694+0000 7ff10a830800 1 --2- 172.21.15.178:0/2831377669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5593779addd0 0x5593779b01c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000a470 tx=0x7ff0f0045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:20.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.694+0000 7ff10a830800 1 -- 172.21.15.178:0/2831377669 shutdown_connections 2024-09-21T09:03:20.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.694+0000 7ff10a830800 1 --2- 172.21.15.178:0/2831377669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5593779addd0 0x5593779b01c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.694+0000 7ff10a830800 1 -- 172.21.15.178:0/2831377669 >> 172.21.15.178:0/2831377669 conn(0x5593779a1e20 msgr2=0x5593779a4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.694+0000 7ff10a830800 1 -- 172.21.15.178:0/2831377669 shutdown_connections 2024-09-21T09:03:20.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.694+0000 7ff10a830800 1 -- 172.21.15.178:0/2831377669 wait complete. 2024-09-21T09:03:20.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.708+0000 7ff10a830800 1 Processor -- start 2024-09-21T09:03:20.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.708+0000 7ff10a830800 1 -- start start 2024-09-21T09:03:20.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.708+0000 7ff10a830800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55937791b650 0x559377a98b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.708+0000 7ff10a830800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5593778f3370 con 0x55937791b650 2024-09-21T09:03:20.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.708+0000 7ff105a73640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55937791b650 0x559377a98b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.708+0000 7ff105a73640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55937791b650 0x559377a98b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43456/0 (socket says 172.21.15.178:43456) 2024-09-21T09:03:20.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.708+0000 7ff105a73640 1 -- 172.21.15.178:0/3689597689 learned_addr learned my addr 172.21.15.178:0/3689597689 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.709+0000 7ff105a73640 1 -- 172.21.15.178:0/3689597689 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559377840bc0 con 0x55937791b650 2024-09-21T09:03:20.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.709+0000 7ff105a73640 1 --2- 172.21.15.178:0/3689597689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55937791b650 0x559377a98b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8001e10 tx=0x7ff0f800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce78518740830a4c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.709+0000 7feff3e07640 1 -- 172.21.15.178:0/3689597689 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f8012020 con 0x55937791b650 2024-09-21T09:03:20.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.709+0000 7feff3e07640 1 -- 172.21.15.178:0/3689597689 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f800e5a0 con 0x55937791b650 2024-09-21T09:03:20.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.709+0000 7feff3e07640 1 -- 172.21.15.178:0/3689597689 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f800e8e0 con 0x55937791b650 2024-09-21T09:03:20.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.710+0000 7ff10a830800 1 -- 172.21.15.178:0/3689597689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55937791b650 msgr2=0x559377a98b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.710+0000 7ff10a830800 1 --2- 172.21.15.178:0/3689597689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55937791b650 0x559377a98b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8001e10 tx=0x7ff0f800b780 comp rx=0 tx=0).stop 2024-09-21T09:03:20.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.710+0000 7ff10a830800 1 -- 172.21.15.178:0/3689597689 shutdown_connections 2024-09-21T09:03:20.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.710+0000 7ff10a830800 1 --2- 172.21.15.178:0/3689597689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55937791b650 0x559377a98b90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.710+0000 7ff10a830800 1 -- 172.21.15.178:0/3689597689 >> 172.21.15.178:0/3689597689 conn(0x5593779a1e20 msgr2=0x559377a94550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.710+0000 7ff10a830800 1 -- 172.21.15.178:0/3689597689 shutdown_connections 2024-09-21T09:03:20.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.710+0000 7ff10a830800 1 -- 172.21.15.178:0/3689597689 wait complete. 2024-09-21T09:03:20.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.710+0000 7ff10a830800 1 Processor -- start 2024-09-21T09:03:20.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.710+0000 7ff10a830800 1 -- start start 2024-09-21T09:03:20.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.710+0000 7ff10a830800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55937791b650 0x559377aa05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.710+0000 7ff10a830800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5593779b09d0 con 0x55937791b650 2024-09-21T09:03:20.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.710+0000 7ff105a73640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55937791b650 0x559377aa05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.710+0000 7ff105a73640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55937791b650 0x559377aa05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43464/0 (socket says 172.21.15.178:43464) 2024-09-21T09:03:20.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.710+0000 7ff105a73640 1 -- 172.21.15.178:0/548116126 learned_addr learned my addr 172.21.15.178:0/548116126 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.711+0000 7ff105a73640 1 -- 172.21.15.178:0/548116126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559377854fe0 con 0x55937791b650 2024-09-21T09:03:20.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.711+0000 7ff105a73640 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55937791b650 0x559377aa05a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800b7c0 tx=0x7ff0f8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.711+0000 7feff2604640 1 -- 172.21.15.178:0/548116126 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f8012030 con 0x55937791b650 2024-09-21T09:03:20.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.711+0000 7feff2604640 1 -- 172.21.15.178:0/548116126 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f8001470 con 0x55937791b650 2024-09-21T09:03:20.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.711+0000 7feff2604640 1 -- 172.21.15.178:0/548116126 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f801a8d0 con 0x55937791b650 2024-09-21T09:03:20.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.711+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559377aa0ae0 con 0x55937791b650 2024-09-21T09:03:20.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.711+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559377aa1000 con 0x55937791b650 2024-09-21T09:03:20.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.712+0000 7feff2604640 1 -- 172.21.15.178:0/548116126 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff0f8015020 con 0x55937791b650 2024-09-21T09:03:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.712+0000 7feff2604640 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefec036b90 0x7fefec039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.712+0000 7feff2604640 1 -- 172.21.15.178:0/548116126 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff0f8020030 con 0x55937791b650 2024-09-21T09:03:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.712+0000 7ff0fd272640 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefec036b90 0x7fefec039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.712+0000 7ff10a830800 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5593779addd0 0x559377aa7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.712+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377aa7b50 con 0x5593779addd0 2024-09-21T09:03:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.712+0000 7ff106274640 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5593779addd0 0x559377aa7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.713+0000 7ff0fd272640 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefec036b90 0x7fefec039050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0057000 tx=0x7ff0f0052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.713+0000 7ff106274640 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5593779addd0 0x559377aa7610 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.713+0000 7ff106274640 1 -- 172.21.15.178:0/548116126 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff10000a4a0 con 0x5593779addd0 2024-09-21T09:03:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.713+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377aa4be0 con 0x5593779addd0 2024-09-21T09:03:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.713+0000 7ff106274640 1 -- 172.21.15.178:0/548116126 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff10000a4a0 con 0x5593779addd0 2024-09-21T09:03:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.713+0000 7ff10a830800 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559377aa9ea0 0x559377aac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.713+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377aac980 con 0x559377aa9ea0 2024-09-21T09:03:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.713+0000 7ff105a73640 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559377aa9ea0 0x559377aac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.714+0000 7ff105a73640 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559377aa9ea0 0x559377aac290 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.714+0000 7ff105a73640 1 -- 172.21.15.178:0/548116126 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0f8018950 con 0x559377aa9ea0 2024-09-21T09:03:20.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.714+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377aa8d40 con 0x5593779addd0 2024-09-21T09:03:20.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.715+0000 7ff106274640 1 -- 172.21.15.178:0/548116126 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff10000a4a0 con 0x5593779addd0 2024-09-21T09:03:20.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.715+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377aa9220 con 0x5593779addd0 2024-09-21T09:03:20.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.715+0000 7ff106274640 1 -- 172.21.15.178:0/548116126 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff10000a4a0 con 0x5593779addd0 2024-09-21T09:03:20.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.715+0000 7ff10a830800 1 Processor -- start 2024-09-21T09:03:20.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.715+0000 7ff10a830800 1 -- start start 2024-09-21T09:03:20.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.715+0000 7ff10a830800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377abb300 0x559377abb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.715+0000 7ff10a830800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559377842580 con 0x559377abb300 2024-09-21T09:03:20.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.716+0000 7ff106274640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377abb300 0x559377abb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.716+0000 7ff106274640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377abb300 0x559377abb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43470/0 (socket says 172.21.15.178:43470) 2024-09-21T09:03:20.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.716+0000 7ff106274640 1 -- 172.21.15.178:0/972577087 learned_addr learned my addr 172.21.15.178:0/972577087 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.716+0000 7ff106274640 1 -- 172.21.15.178:0/972577087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559377abbc60 con 0x559377abb300 2024-09-21T09:03:20.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.716+0000 7ff106274640 1 --2- 172.21.15.178:0/972577087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377abb300 0x559377abb720 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x559377aa7f50 tx=0x7ff100018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.716+0000 7fefeb7fe640 1 -- 172.21.15.178:0/972577087 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff100014450 con 0x559377abb300 2024-09-21T09:03:20.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.716+0000 7fefeb7fe640 1 -- 172.21.15.178:0/972577087 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff100014610 con 0x559377abb300 2024-09-21T09:03:20.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.716+0000 7ff10a830800 1 -- 172.21.15.178:0/972577087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559377abbef0 con 0x559377abb300 2024-09-21T09:03:20.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.716+0000 7fefeb7fe640 1 -- 172.21.15.178:0/972577087 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff100014930 con 0x559377abb300 2024-09-21T09:03:20.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.716+0000 7ff10a830800 1 -- 172.21.15.178:0/972577087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559377abebd0 con 0x559377abb300 2024-09-21T09:03:20.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.717+0000 7fefeb7fe640 1 -- 172.21.15.178:0/972577087 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff100011040 con 0x559377abb300 2024-09-21T09:03:20.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.717+0000 7fefeb7fe640 1 --2- 172.21.15.178:0/972577087 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefe0036b90 0x7fefe0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.717+0000 7fefeb7fe640 1 -- 172.21.15.178:0/972577087 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff10001e070 con 0x559377abb300 2024-09-21T09:03:20.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.717+0000 7ff105a73640 1 --2- 172.21.15.178:0/972577087 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefe0036b90 0x7fefe0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.718+0000 7ff10a830800 1 Processor -- start 2024-09-21T09:03:20.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.718+0000 7ff10a830800 1 -- start start 2024-09-21T09:03:20.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.718+0000 7ff105a73640 1 --2- 172.21.15.178:0/972577087 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefe0036b90 0x7fefe0039050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x559377aa7ff0 tx=0x7ff0f8024ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.718+0000 7ff10a830800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377ac7f60 0x559377ac8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.718+0000 7ff10a830800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559377a99340 con 0x559377ac7f60 2024-09-21T09:03:20.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.718+0000 7ff106274640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377ac7f60 0x559377ac8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.718+0000 7ff106274640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377ac7f60 0x559377ac8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43482/0 (socket says 172.21.15.178:43482) 2024-09-21T09:03:20.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.718+0000 7ff106274640 1 -- 172.21.15.178:0/1392664481 learned_addr learned my addr 172.21.15.178:0/1392664481 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.718+0000 7ff106274640 1 -- 172.21.15.178:0/1392664481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559377ac8930 con 0x559377ac7f60 2024-09-21T09:03:20.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.718+0000 7ff106274640 1 --2- 172.21.15.178:0/1392664481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377ac7f60 0x559377ac8360 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff10004cbc0 tx=0x7ff100011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219da7776444f32d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.719+0000 7fefe97fa640 1 -- 172.21.15.178:0/1392664481 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff100040150 con 0x559377ac7f60 2024-09-21T09:03:20.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.719+0000 7fefe97fa640 1 -- 172.21.15.178:0/1392664481 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1000167e0 con 0x559377ac7f60 2024-09-21T09:03:20.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.719+0000 7fefe97fa640 1 -- 172.21.15.178:0/1392664481 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff100014ad0 con 0x559377ac7f60 2024-09-21T09:03:20.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.719+0000 7ff10a830800 1 -- 172.21.15.178:0/1392664481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377ac7f60 msgr2=0x559377ac8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.719+0000 7ff10a830800 1 --2- 172.21.15.178:0/1392664481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377ac7f60 0x559377ac8360 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff10004cbc0 tx=0x7ff100011b10 comp rx=0 tx=0).stop 2024-09-21T09:03:20.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.719+0000 7ff10a830800 1 -- 172.21.15.178:0/1392664481 shutdown_connections 2024-09-21T09:03:20.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.719+0000 7ff10a830800 1 --2- 172.21.15.178:0/1392664481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377ac7f60 0x559377ac8360 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.719+0000 7ff10a830800 1 -- 172.21.15.178:0/1392664481 >> 172.21.15.178:0/1392664481 conn(0x559377ac42c0 msgr2=0x559377ac23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.719+0000 7ff10a830800 1 -- 172.21.15.178:0/1392664481 shutdown_connections 2024-09-21T09:03:20.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.719+0000 7ff10a830800 1 -- 172.21.15.178:0/1392664481 wait complete. 2024-09-21T09:03:20.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.719+0000 7ff10a830800 1 Processor -- start 2024-09-21T09:03:20.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.719+0000 7ff10a830800 1 -- start start 2024-09-21T09:03:20.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.719+0000 7ff10a830800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377ac7f60 0x559377acf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.719+0000 7ff10a830800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559377ac8fa0 con 0x559377ac7f60 2024-09-21T09:03:20.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.720+0000 7ff106274640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377ac7f60 0x559377acf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.720+0000 7ff106274640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377ac7f60 0x559377acf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43498/0 (socket says 172.21.15.178:43498) 2024-09-21T09:03:20.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.720+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 learned_addr learned my addr 172.21.15.178:0/2785520848 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.720+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559377acf960 con 0x559377ac7f60 2024-09-21T09:03:20.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.720+0000 7ff106274640 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377ac7f60 0x559377acf420 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff10004bae0 tx=0x7ff10004cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.720+0000 7fefd77fe640 1 -- 172.21.15.178:0/2785520848 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff100011510 con 0x559377ac7f60 2024-09-21T09:03:20.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.720+0000 7fefd77fe640 1 -- 172.21.15.178:0/2785520848 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1000116b0 con 0x559377ac7f60 2024-09-21T09:03:20.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.720+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559377acfbf0 con 0x559377ac7f60 2024-09-21T09:03:20.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.720+0000 7fefd77fe640 1 -- 172.21.15.178:0/2785520848 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff10004e0d0 con 0x559377ac7f60 2024-09-21T09:03:20.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.720+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559377ad28a0 con 0x559377ac7f60 2024-09-21T09:03:20.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.721+0000 7fefd77fe640 1 -- 172.21.15.178:0/2785520848 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff10004e270 con 0x559377ac7f60 2024-09-21T09:03:20.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.721+0000 7fefd77fe640 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefd0036b90 0x7fefd0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.721+0000 7fefd77fe640 1 -- 172.21.15.178:0/2785520848 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff100046040 con 0x559377ac7f60 2024-09-21T09:03:20.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.721+0000 7ff105a73640 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefd0036b90 0x7fefd0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.722+0000 7ff105a73640 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefd0036b90 0x7fefd0039050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800bcd0 tx=0x7ff0f8038000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.722+0000 7ff10a830800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.722+0000 7ff10a830800 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559377adb100 0x559377add5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.722+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377addd10 con 0x559377adb100 2024-09-21T09:03:20.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.722+0000 7ff0fd272640 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559377adb100 0x559377add5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.722+0000 7ff0fd272640 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559377adb100 0x559377add5c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.722+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.722+0000 7ff10a830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.722+0000 7ff10a830800 20 realm 2024-09-21T09:03:20.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff10a830800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377ade140 con 0x559377adb100 2024-09-21T09:03:20.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff10a830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff10a830800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:20.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff10a830800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377adea10 con 0x559377adb100 2024-09-21T09:03:20.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff10a830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff10a830800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377adedb0 con 0x559377adb100 2024-09-21T09:03:20.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff10a830800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:20.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff10a830800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff10a830800 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559377adfb10 0x559377ae1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377ae2510 con 0x559377adfb10 2024-09-21T09:03:20.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.723+0000 7ff106274640 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559377adfb10 0x559377ae1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.724+0000 7ff106274640 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559377adfb10 0x559377ae1f00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.724+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.724+0000 7ff10a830800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:20.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.724+0000 7ff10a830800 20 searching for the correct realm 2024-09-21T09:03:20.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.724+0000 7ff10a830800 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559377ae44a0 0x559377ae6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.724+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377ae44a0 2024-09-21T09:03:20.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.725+0000 7ff105a73640 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559377ae44a0 0x559377ae6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.725+0000 7ff105a73640 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559377ae44a0 0x559377ae6960 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.725+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.725+0000 7ff105a73640 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff0f8059040 0x7ff0f8024420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.725+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x7ff0f8059040 2024-09-21T09:03:20.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.725+0000 7ff0fd272640 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff0f8059040 0x7ff0f8024420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.726+0000 7ff0fd272640 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff0f8059040 0x7ff0f8024420 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.726+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0051070 con 0x7ff0f8059040 2024-09-21T09:03:20.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.726+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adfb10 2024-09-21T09:03:20.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.726+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.726+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adb100 2024-09-21T09:03:20.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.726+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.726+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adb100 2024-09-21T09:03:20.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.727+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.727+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adfb10 2024-09-21T09:03:20.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.727+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.727+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adfb10 2024-09-21T09:03:20.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.727+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.727+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x7ff0f8059040 2024-09-21T09:03:20.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.727+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0051070 con 0x7ff0f8059040 2024-09-21T09:03:20.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.727+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377ae44a0 2024-09-21T09:03:20.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.728+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.728+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adb100 2024-09-21T09:03:20.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.728+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.728+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adfb10 2024-09-21T09:03:20.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.728+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.728+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adb100 2024-09-21T09:03:20.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.728+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.728+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x7ff0f8059040 2024-09-21T09:03:20.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.729+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff0f0051070 con 0x7ff0f8059040 2024-09-21T09:03:20.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.729+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377ae44a0 2024-09-21T09:03:20.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.729+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.729+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377ae44a0 2024-09-21T09:03:20.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.729+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.729+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adfb10 2024-09-21T09:03:20.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.729+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.729+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377ae44a0 2024-09-21T09:03:20.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.730+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.730+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377ae44a0 2024-09-21T09:03:20.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.730+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.730+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adb100 2024-09-21T09:03:20.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.730+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.730+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adb100 2024-09-21T09:03:20.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.730+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.730+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adfb10 2024-09-21T09:03:20.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.731+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.731+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377ae44a0 2024-09-21T09:03:20.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.731+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.731+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x7ff0f8059040 2024-09-21T09:03:20.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.731+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0051070 con 0x7ff0f8059040 2024-09-21T09:03:20.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.731+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adb100 2024-09-21T09:03:20.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.731+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.731+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adfb10 2024-09-21T09:03:20.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.732+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.732+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377ae44a0 2024-09-21T09:03:20.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.732+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.732+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adfb10 2024-09-21T09:03:20.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.732+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.732+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x7ff0f8059040 2024-09-21T09:03:20.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.732+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0051070 con 0x7ff0f8059040 2024-09-21T09:03:20.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.732+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377ae44a0 2024-09-21T09:03:20.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adfb10 2024-09-21T09:03:20.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x559377adb100 2024-09-21T09:03:20.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7030 con 0x7ff0f8059040 2024-09-21T09:03:20.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0051070 con 0x7ff0f8059040 2024-09-21T09:03:20.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff10a830800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:20.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff10a830800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:20.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff10a830800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:20.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff10a830800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff10a830800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff10a830800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff10a830800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.733+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377ae39f0 con 0x559377adb100 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377ae29a0 con 0x559377adb100 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377ae33a0 con 0x559377adb100 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:20.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 20 zone default found 2024-09-21T09:03:20.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 4 Realm: () 2024-09-21T09:03:20.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:20.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:20.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:20.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 20 zonegroup default 2024-09-21T09:03:20.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.734+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377ae7960 con 0x559377adfb10 2024-09-21T09:03:20.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.735+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.735+0000 7ff10a830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.735+0000 7ff10a830800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.735+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377ae9c00 con 0x559377ae44a0 2024-09-21T09:03:20.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.735+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.735+0000 7ff10a830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.735+0000 7ff10a830800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.735+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377ae9fa0 con 0x559377ae44a0 2024-09-21T09:03:20.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.735+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.735+0000 7ff10a830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.735+0000 7ff10a830800 20 started sync module instance, tier type = 2024-09-21T09:03:20.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.735+0000 7ff10a830800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:20.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.735+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377ae9090 con 0x7ff0f8059040 2024-09-21T09:03:20.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.736+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x7ff0f8059040 2024-09-21T09:03:20.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.736+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94091856483760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377ae9090 con 0x7ff0f8059040 2024-09-21T09:03:20.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.736+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377aea9b0 con 0x559377adb100 2024-09-21T09:03:20.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.737+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94091856483760] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x7ff0f8059040 2024-09-21T09:03:20.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.737+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.737+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94091856488160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377ae9090 con 0x559377adb100 2024-09-21T09:03:20.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.737+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377aeb400 con 0x559377ae44a0 2024-09-21T09:03:20.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.738+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.739+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94091856490256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377aebca0 con 0x559377ae44a0 2024-09-21T09:03:20.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.739+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377aec740 con 0x7ff0f8059040 2024-09-21T09:03:20.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.739+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94091856488160] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.740+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x7ff0f8059040 2024-09-21T09:03:20.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.740+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94091856490256] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.740+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94091856495120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377ae8be0 con 0x7ff0f8059040 2024-09-21T09:03:20.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.740+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377aecfe0 con 0x559377adb100 2024-09-21T09:03:20.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.741+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.741+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94091856497376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377aecf00 con 0x559377adb100 2024-09-21T09:03:20.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.741+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377aedee0 con 0x559377adfb10 2024-09-21T09:03:20.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.741+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94091856495120] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x7ff0f8059040 2024-09-21T09:03:20.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.742+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.742+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94091856492528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377aee2d0 con 0x559377adfb10 2024-09-21T09:03:20.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.742+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377aeecd0 con 0x559377adfb10 2024-09-21T09:03:20.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.742+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94091856497376] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.743+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94091856492528] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.743+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.743+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94091856501232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377aee7e0 con 0x559377adfb10 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.743+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377aef1a0 con 0x559377adfb10 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.745+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.745+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94091856506096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377aef5c0 con 0x559377adfb10 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.745+0000 7ff10a830800 20 add_watcher() i=0 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.745+0000 7ff10a830800 20 add_watcher() i=1 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.745+0000 7ff10a830800 20 add_watcher() i=2 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.745+0000 7ff10a830800 20 add_watcher() i=3 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.745+0000 7ff10a830800 20 add_watcher() i=4 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.745+0000 7ff10a830800 20 add_watcher() i=5 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.745+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94091856501232] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.745+0000 7ff10a830800 20 add_watcher() i=6 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.746+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94091856506096] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.746+0000 7ff10a830800 20 add_watcher() i=7 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.746+0000 7ff10a830800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:20.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.746+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377aed3d0 con 0x559377adb100 2024-09-21T09:03:20.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.747+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.747+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94091856507152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377aed380 con 0x559377adb100 2024-09-21T09:03:20.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.747+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94091856507152] v29'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.748+0000 7fefb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:20.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.748+0000 7ff10a830800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:20.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.748+0000 7ff10a830800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:20.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.748+0000 7ff10a830800 5 note: GC not initialized 2024-09-21T09:03:20.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.748+0000 7fefb67fc640 20 reqs_thread_entry: start 2024-09-21T09:03:20.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.748+0000 7ff10a830800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:20.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.748+0000 7ff10a830800 20 Filter name: none 2024-09-21T09:03:20.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.748+0000 7fef27fff640 20 reqs_thread_entry: start 2024-09-21T09:03:20.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.748+0000 7ff10a830800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T09:03:20.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.748+0000 7ff10a830800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.748+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377b25a80 con 0x559377adfb10 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.749+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.749+0000 7ff10a830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.749+0000 7ff10a830800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.749+0000 7ff10a830800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.749+0000 7ff10a830800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.749+0000 7ff10a830800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.749+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377b240c0 con 0x559377adfb10 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.749+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.749+0000 7ff10a830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.749+0000 7ff10a830800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.749+0000 7ff10a830800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.749+0000 7ff10a830800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.749+0000 7ff10a830800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.749+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377b249b0 con 0x559377adfb10 2024-09-21T09:03:20.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.750+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v29'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.750+0000 7ff10a830800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.750+0000 7ff10a830800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.750+0000 7ff10a830800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.750+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94091856725248 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377b29070 con 0x559377adfb10 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.751+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== watch-notify(notify (1) cookie 94091856492528 notify 124554051587 ret 0) ==== 598+0+0 (crc 0 0 0) 0x559377b254d0 con 0x559377adfb10 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.751+0000 7fefe97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051587 cookie 94091856492528 notifier 4490 bl.length()=556 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.751+0000 7fefe97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.751+0000 7fefe97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.751+0000 7fefe97fa640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fefc8003ea0 con 0x559377adfb10 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.751+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(65 notify.5 [notify cookie 94091856725248 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.751+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.751+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== watch-notify(notify_complete (2) cookie 94091856725248 notify 124554051587 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559377acfbf0 con 0x559377adfb10 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.751+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377b24960 con 0x559377adfb10 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.752+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v29'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.752+0000 7ff10a830800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T09:03:20.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.752+0000 7ff10a830800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T09:03:20.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.752+0000 7ff10a830800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T09:03:20.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.752+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94091856725168 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559377b24950 con 0x559377ae44a0 2024-09-21T09:03:20.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.753+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== watch-notify(notify (1) cookie 94091856490256 notify 124554051586 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7ff0f8061040 con 0x559377ae44a0 2024-09-21T09:03:20.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.753+0000 7fefe8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051586 cookie 94091856490256 notifier 4490 bl.length()=177 2024-09-21T09:03:20.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.753+0000 7fefe8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T09:03:20.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.753+0000 7fefe8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T09:03:20.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.753+0000 7fefe8ff9640 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fef30003400 con 0x559377ae44a0 2024-09-21T09:03:20.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.753+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(68 notify.2 [notify cookie 94091856725168 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.753+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== watch-notify(notify_complete (2) cookie 94091856725168 notify 124554051586 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559377aa1000 con 0x559377ae44a0 2024-09-21T09:03:20.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.753+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.761 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-21T09:03:20.750481Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:20.750467Z","tags":[],"group_ids":[]} 2024-09-21T09:03:20.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.754+0000 7fefb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:20.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.754+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94091856507152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377b23740 con 0x559377adb100 2024-09-21T09:03:20.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.755+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94091856507152] v29'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.755+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94091856483760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377b23740 con 0x7ff0f8059040 2024-09-21T09:03:20.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.756+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94091856483760] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x7ff0f8059040 2024-09-21T09:03:20.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.756+0000 7ff10a830800 20 remove_watcher() i=0 2024-09-21T09:03:20.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.756+0000 7ff10a830800 2 removed watcher, disabling cache 2024-09-21T09:03:20.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.756+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94091856488160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377b23740 con 0x559377adb100 2024-09-21T09:03:20.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.757+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94091856488160] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.757+0000 7ff10a830800 20 remove_watcher() i=1 2024-09-21T09:03:20.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.757+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94091856490256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377b23740 con 0x559377ae44a0 2024-09-21T09:03:20.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.758+0000 7ff105a73640 1 -- 172.21.15.178:0/2785520848 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94091856490256] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f8018950 con 0x559377ae44a0 2024-09-21T09:03:20.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.758+0000 7ff10a830800 20 remove_watcher() i=2 2024-09-21T09:03:20.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.758+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94091856495120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377b23740 con 0x7ff0f8059040 2024-09-21T09:03:20.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.759+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94091856495120] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x7ff0f8059040 2024-09-21T09:03:20.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.759+0000 7ff10a830800 20 remove_watcher() i=3 2024-09-21T09:03:20.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.759+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94091856497376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377b23740 con 0x559377adb100 2024-09-21T09:03:20.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.760+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94091856497376] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0051070 con 0x559377adb100 2024-09-21T09:03:20.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.760+0000 7ff10a830800 20 remove_watcher() i=4 2024-09-21T09:03:20.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.760+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94091856492528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377b23740 con 0x559377adfb10 2024-09-21T09:03:20.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.761+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94091856492528] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.761+0000 7ff10a830800 20 remove_watcher() i=5 2024-09-21T09:03:20.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.761+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94091856501232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377b23740 con 0x559377adfb10 2024-09-21T09:03:20.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.762+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94091856501232] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.762+0000 7ff10a830800 20 remove_watcher() i=6 2024-09-21T09:03:20.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.762+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94091856506096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559377b23740 con 0x559377adfb10 2024-09-21T09:03:20.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff106274640 1 -- 172.21.15.178:0/2785520848 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94091856506096] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002a070 con 0x559377adfb10 2024-09-21T09:03:20.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 20 remove_watcher() i=7 2024-09-21T09:03:20.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559377adfb10 msgr2=0x559377ae1f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559377adfb10 0x559377ae1f00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559377adb100 msgr2=0x559377add5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559377adb100 0x559377add5c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff0f8059040 msgr2=0x7ff0f8024420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff0f8059040 0x7ff0f8024420 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559377ae44a0 msgr2=0x559377ae6960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559377ae44a0 0x559377ae6960 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefd0036b90 msgr2=0x7fefd0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefd0036b90 0x7fefd0039050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800bcd0 tx=0x7ff0f8038000 comp rx=0 tx=0).stop 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377ac7f60 msgr2=0x559377acf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff0fd272640 1 -- 172.21.15.178:0/2785520848 reap_dead start 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377ac7f60 0x559377acf420 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff10004bae0 tx=0x7ff10004cb50 comp rx=0 tx=0).stop 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 shutdown_connections 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 --2- 172.21.15.178:0/2785520848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377ac7f60 0x559377acf420 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 >> 172.21.15.178:0/2785520848 conn(0x559377ac42c0 msgr2=0x559377ac2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 shutdown_connections 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.763+0000 7ff10a830800 1 -- 172.21.15.178:0/2785520848 wait complete. 2024-09-21T09:03:20.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 -- 172.21.15.178:0/972577087 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefe0036b90 msgr2=0x7fefe0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 --2- 172.21.15.178:0/972577087 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefe0036b90 0x7fefe0039050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x559377aa7ff0 tx=0x7ff0f8024ec0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 -- 172.21.15.178:0/972577087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377abb300 msgr2=0x559377abb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 --2- 172.21.15.178:0/972577087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377abb300 0x559377abb720 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x559377aa7f50 tx=0x7ff100018830 comp rx=0 tx=0).stop 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 -- 172.21.15.178:0/972577087 shutdown_connections 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 --2- 172.21.15.178:0/972577087 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefe0036b90 0x7fefe0039050 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 --2- 172.21.15.178:0/972577087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559377abb300 0x559377abb720 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 -- 172.21.15.178:0/972577087 >> 172.21.15.178:0/972577087 conn(0x559377ab0290 msgr2=0x559377ab2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 -- 172.21.15.178:0/972577087 shutdown_connections 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 -- 172.21.15.178:0/972577087 wait complete. 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559377aa9ea0 msgr2=0x559377aac290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559377aa9ea0 0x559377aac290 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5593779addd0 msgr2=0x559377aa7610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5593779addd0 0x559377aa7610 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefec036b90 msgr2=0x7fefec039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefec036b90 0x7fefec039050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0057000 tx=0x7ff0f0052000 comp rx=0 tx=0).stop 2024-09-21T09:03:20.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55937791b650 msgr2=0x559377aa05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55937791b650 0x559377aa05a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800b7c0 tx=0x7ff0f8000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 shutdown_connections 2024-09-21T09:03:20.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559377aa9ea0 0x559377aac290 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5593779addd0 0x559377aa7610 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fefec036b90 0x7fefec039050 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 --2- 172.21.15.178:0/548116126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55937791b650 0x559377aa05a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 >> 172.21.15.178:0/548116126 conn(0x5593779a1e20 msgr2=0x559377a92dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 shutdown_connections 2024-09-21T09:03:20.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.764+0000 7ff10a830800 1 -- 172.21.15.178:0/548116126 wait complete. 2024-09-21T09:03:20.775 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-21T09:03:20.750481Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:20.750467Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:20.779 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-21T09:03:20.783 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:20.783 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-21T09:03:20.783 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-21T09:03:20.783 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-21T09:03:20.826 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:20.826 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:20.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.825+0000 7f3870d51800 1 Processor -- start 2024-09-21T09:03:20.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.825+0000 7f3870d51800 1 -- start start 2024-09-21T09:03:20.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.825+0000 7f3870d51800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x559035a43900 0x559035a45cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.825+0000 7f3870d51800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5590358ffb30 con 0x559035a3f4c0 2024-09-21T09:03:20.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.825+0000 7f3870d51800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5590358e1360 con 0x559035a43900 2024-09-21T09:03:20.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.825+0000 7f386e044640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x559035a43900 0x559035a45cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.825+0000 7f386e845640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x559035a3f4c0 0x559035a3f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46806/0 (socket says 172.21.15.178:46806) 2024-09-21T09:03:20.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.825+0000 7f386e845640 1 -- 172.21.15.178:0/2928216372 learned_addr learned my addr 172.21.15.178:0/2928216372 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:20.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.826+0000 7f386e044640 1 -- 172.21.15.178:0/2928216372 >> v1:172.21.15.44:6789/0 conn(0x559035a3f4c0 legacy=0x559035a3f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.826+0000 7f386d843640 1 -- 172.21.15.178:0/2928216372 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958319370 0 0) 0x5590358ffb30 con 0x559035a3f4c0 2024-09-21T09:03:20.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.826+0000 7f386e044640 1 -- 172.21.15.178:0/2928216372 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559035907e00 con 0x559035a43900 2024-09-21T09:03:20.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.828+0000 7f386e044640 1 --2- 172.21.15.178:0/2928216372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a43900 0x559035a45cf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f386400a470 tx=0x7f3864045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9ba3903fb2b4d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.828+0000 7f386d843640 1 -- 172.21.15.178:0/2928216372 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3864053570 con 0x559035a43900 2024-09-21T09:03:20.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.828+0000 7f386d843640 1 -- 172.21.15.178:0/2928216372 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3864058070 con 0x559035a43900 2024-09-21T09:03:20.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.828+0000 7f386d843640 1 -- 172.21.15.178:0/2928216372 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3864053880 con 0x559035a43900 2024-09-21T09:03:20.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.828+0000 7f3870d51800 1 -- 172.21.15.178:0/2928216372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a43900 msgr2=0x559035a45cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.828+0000 7f3870d51800 1 --2- 172.21.15.178:0/2928216372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a43900 0x559035a45cf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f386400a470 tx=0x7f3864045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:20.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.828+0000 7f3870d51800 1 -- 172.21.15.178:0/2928216372 shutdown_connections 2024-09-21T09:03:20.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.828+0000 7f3870d51800 1 --2- 172.21.15.178:0/2928216372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a43900 0x559035a45cf0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.828+0000 7f3870d51800 1 -- 172.21.15.178:0/2928216372 >> 172.21.15.178:0/2928216372 conn(0x559035a3adf0 msgr2=0x559035a3d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.828+0000 7f3870d51800 1 -- 172.21.15.178:0/2928216372 shutdown_connections 2024-09-21T09:03:20.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.828+0000 7f3870d51800 1 -- 172.21.15.178:0/2928216372 wait complete. 2024-09-21T09:03:20.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.842+0000 7f3870d51800 1 Processor -- start 2024-09-21T09:03:20.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.842+0000 7f3870d51800 1 -- start start 2024-09-21T09:03:20.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.842+0000 7f3870d51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a3f4c0 0x559035b2b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.842+0000 7f3870d51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55903598c330 con 0x559035a3f4c0 2024-09-21T09:03:20.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.842+0000 7f386e845640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a3f4c0 0x559035b2b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.842+0000 7f386e845640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a3f4c0 0x559035b2b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43514/0 (socket says 172.21.15.178:43514) 2024-09-21T09:03:20.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.842+0000 7f386e845640 1 -- 172.21.15.178:0/981879164 learned_addr learned my addr 172.21.15.178:0/981879164 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.843+0000 7f386e845640 1 -- 172.21.15.178:0/981879164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590358d9bc0 con 0x559035a3f4c0 2024-09-21T09:03:20.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.843+0000 7f386e845640 1 --2- 172.21.15.178:0/981879164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a3f4c0 0x559035b2b470 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f386000b240 tx=0x7f386000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654d8a32f623bbe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.843+0000 7f375ce09640 1 -- 172.21.15.178:0/981879164 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3860008070 con 0x559035a3f4c0 2024-09-21T09:03:20.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.843+0000 7f375ce09640 1 -- 172.21.15.178:0/981879164 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386000d500 con 0x559035a3f4c0 2024-09-21T09:03:20.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.843+0000 7f375ce09640 1 -- 172.21.15.178:0/981879164 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386000d860 con 0x559035a3f4c0 2024-09-21T09:03:20.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.844+0000 7f3870d51800 1 -- 172.21.15.178:0/981879164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a3f4c0 msgr2=0x559035b2b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.844+0000 7f3870d51800 1 --2- 172.21.15.178:0/981879164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a3f4c0 0x559035b2b470 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f386000b240 tx=0x7f386000b700 comp rx=0 tx=0).stop 2024-09-21T09:03:20.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.844+0000 7f3870d51800 1 -- 172.21.15.178:0/981879164 shutdown_connections 2024-09-21T09:03:20.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.844+0000 7f3870d51800 1 --2- 172.21.15.178:0/981879164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a3f4c0 0x559035b2b470 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.844+0000 7f3870d51800 1 -- 172.21.15.178:0/981879164 >> 172.21.15.178:0/981879164 conn(0x559035a3adf0 msgr2=0x559035b2db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.844+0000 7f3870d51800 1 -- 172.21.15.178:0/981879164 shutdown_connections 2024-09-21T09:03:20.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.844+0000 7f3870d51800 1 -- 172.21.15.178:0/981879164 wait complete. 2024-09-21T09:03:20.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.844+0000 7f3870d51800 1 Processor -- start 2024-09-21T09:03:20.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.844+0000 7f3870d51800 1 -- start start 2024-09-21T09:03:20.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.844+0000 7f3870d51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a3f4c0 0x559035b39250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.844+0000 7f3870d51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559035a46530 con 0x559035a3f4c0 2024-09-21T09:03:20.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.845+0000 7f386e845640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a3f4c0 0x559035b39250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.845+0000 7f386e845640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a3f4c0 0x559035b39250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43526/0 (socket says 172.21.15.178:43526) 2024-09-21T09:03:20.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.845+0000 7f386e845640 1 -- 172.21.15.178:0/580597911 learned_addr learned my addr 172.21.15.178:0/580597911 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.845+0000 7f386e845640 1 -- 172.21.15.178:0/580597911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590358edfe0 con 0x559035a3f4c0 2024-09-21T09:03:20.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.845+0000 7f386e845640 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a3f4c0 0x559035b39250 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x559035b2ab70 tx=0x7f3860000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.845+0000 7f375b606640 1 -- 172.21.15.178:0/580597911 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3860019870 con 0x559035a3f4c0 2024-09-21T09:03:20.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.845+0000 7f375b606640 1 -- 172.21.15.178:0/580597911 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3860019a10 con 0x559035a3f4c0 2024-09-21T09:03:20.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.845+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559035b397f0 con 0x559035a3f4c0 2024-09-21T09:03:20.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.845+0000 7f375b606640 1 -- 172.21.15.178:0/580597911 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3860019d30 con 0x559035a3f4c0 2024-09-21T09:03:20.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.845+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559035b39d70 con 0x559035a3f4c0 2024-09-21T09:03:20.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.846+0000 7f375b606640 1 -- 172.21.15.178:0/580597911 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3860017040 con 0x559035a3f4c0 2024-09-21T09:03:20.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.846+0000 7f375b606640 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3754036b90 0x7f3754039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.846+0000 7f375b606640 1 -- 172.21.15.178:0/580597911 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3860015020 con 0x559035a3f4c0 2024-09-21T09:03:20.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.846+0000 7f386e044640 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3754036b90 0x7f3754039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.846+0000 7f3870d51800 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559035a43900 0x559035b402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.846+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b40800 con 0x559035a43900 2024-09-21T09:03:20.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.847+0000 7f386f046640 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559035a43900 0x559035b402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.847+0000 7f386e044640 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3754036b90 0x7f3754039050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3864057000 tx=0x7f3864052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.847+0000 7f386f046640 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559035a43900 0x559035b402c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.847+0000 7f386f046640 1 -- 172.21.15.178:0/580597911 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f386800a4a0 con 0x559035a43900 2024-09-21T09:03:20.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.847+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b3d890 con 0x559035a43900 2024-09-21T09:03:20.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.848+0000 7f386f046640 1 -- 172.21.15.178:0/580597911 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f386800a4a0 con 0x559035a43900 2024-09-21T09:03:20.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.848+0000 7f3870d51800 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559035b42b10 0x559035b44f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.848+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b455f0 con 0x559035b42b10 2024-09-21T09:03:20.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.848+0000 7f386e845640 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559035b42b10 0x559035b44f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.848+0000 7f386e845640 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559035b42b10 0x559035b44f00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.848+0000 7f386e845640 1 -- 172.21.15.178:0/580597911 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f386002d070 con 0x559035b42b10 2024-09-21T09:03:20.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.848+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b419b0 con 0x559035a43900 2024-09-21T09:03:20.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.849+0000 7f386f046640 1 -- 172.21.15.178:0/580597911 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f386800a4a0 con 0x559035a43900 2024-09-21T09:03:20.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.849+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b41e90 con 0x559035a43900 2024-09-21T09:03:20.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.849+0000 7f386f046640 1 -- 172.21.15.178:0/580597911 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f386800a4a0 con 0x559035a43900 2024-09-21T09:03:20.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.849+0000 7f3870d51800 1 Processor -- start 2024-09-21T09:03:20.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.849+0000 7f3870d51800 1 -- start start 2024-09-21T09:03:20.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.849+0000 7f3870d51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b53f70 0x559035b54390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.849+0000 7f3870d51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5590358db580 con 0x559035b53f70 2024-09-21T09:03:20.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.850+0000 7f386f046640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b53f70 0x559035b54390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.850+0000 7f386f046640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b53f70 0x559035b54390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43538/0 (socket says 172.21.15.178:43538) 2024-09-21T09:03:20.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.850+0000 7f386f046640 1 -- 172.21.15.178:0/1828180554 learned_addr learned my addr 172.21.15.178:0/1828180554 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.850+0000 7f386f046640 1 -- 172.21.15.178:0/1828180554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559035b548d0 con 0x559035b53f70 2024-09-21T09:03:20.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.850+0000 7f386f046640 1 --2- 172.21.15.178:0/1828180554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b53f70 0x559035b54390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x559035b40bc0 tx=0x7f3868018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.850+0000 7f3758e01640 1 -- 172.21.15.178:0/1828180554 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3868014450 con 0x559035b53f70 2024-09-21T09:03:20.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.850+0000 7f3758e01640 1 -- 172.21.15.178:0/1828180554 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3868014610 con 0x559035b53f70 2024-09-21T09:03:20.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.850+0000 7f3870d51800 1 -- 172.21.15.178:0/1828180554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559035b54b60 con 0x559035b53f70 2024-09-21T09:03:20.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.850+0000 7f3758e01640 1 -- 172.21.15.178:0/1828180554 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3868014930 con 0x559035b53f70 2024-09-21T09:03:20.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.850+0000 7f3870d51800 1 -- 172.21.15.178:0/1828180554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559035b57840 con 0x559035b53f70 2024-09-21T09:03:20.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.851+0000 7f3758e01640 1 -- 172.21.15.178:0/1828180554 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3868011040 con 0x559035b53f70 2024-09-21T09:03:20.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.851+0000 7f3758e01640 1 --2- 172.21.15.178:0/1828180554 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3748036b90 0x7f3748039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.851+0000 7f3758e01640 1 -- 172.21.15.178:0/1828180554 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f386801e070 con 0x559035b53f70 2024-09-21T09:03:20.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.851+0000 7f386e845640 1 --2- 172.21.15.178:0/1828180554 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3748036b90 0x7f3748039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.852+0000 7f3870d51800 1 Processor -- start 2024-09-21T09:03:20.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.852+0000 7f386e845640 1 --2- 172.21.15.178:0/1828180554 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3748036b90 0x7f3748039050 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x559035b40c60 tx=0x7f3860019ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.852+0000 7f3870d51800 1 -- start start 2024-09-21T09:03:20.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.852+0000 7f3870d51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b60bd0 0x559035b60fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.852+0000 7f3870d51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559035b29b70 con 0x559035b60bd0 2024-09-21T09:03:20.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.852+0000 7f386f046640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b60bd0 0x559035b60fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.852+0000 7f386f046640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b60bd0 0x559035b60fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43552/0 (socket says 172.21.15.178:43552) 2024-09-21T09:03:20.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.852+0000 7f386f046640 1 -- 172.21.15.178:0/2055979019 learned_addr learned my addr 172.21.15.178:0/2055979019 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.852+0000 7f386f046640 1 -- 172.21.15.178:0/2055979019 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559035b615a0 con 0x559035b60bd0 2024-09-21T09:03:20.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.852+0000 7f386f046640 1 --2- 172.21.15.178:0/2055979019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b60bd0 0x559035b60fd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f386804cb80 tx=0x7f386803bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebbfaf8b3c675c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.852+0000 7f37527fc640 1 -- 172.21.15.178:0/2055979019 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38680168f0 con 0x559035b60bd0 2024-09-21T09:03:20.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.852+0000 7f37527fc640 1 -- 172.21.15.178:0/2055979019 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3868014ad0 con 0x559035b60bd0 2024-09-21T09:03:20.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.852+0000 7f37527fc640 1 -- 172.21.15.178:0/2055979019 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386804e0d0 con 0x559035b60bd0 2024-09-21T09:03:20.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.853+0000 7f3870d51800 1 -- 172.21.15.178:0/2055979019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b60bd0 msgr2=0x559035b60fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.853+0000 7f3870d51800 1 --2- 172.21.15.178:0/2055979019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b60bd0 0x559035b60fd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f386804cb80 tx=0x7f386803bf60 comp rx=0 tx=0).stop 2024-09-21T09:03:20.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.853+0000 7f3870d51800 1 -- 172.21.15.178:0/2055979019 shutdown_connections 2024-09-21T09:03:20.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.853+0000 7f3870d51800 1 --2- 172.21.15.178:0/2055979019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b60bd0 0x559035b60fd0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.853+0000 7f3870d51800 1 -- 172.21.15.178:0/2055979019 >> 172.21.15.178:0/2055979019 conn(0x559035b5cee0 msgr2=0x559035b5b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.853+0000 7f3870d51800 1 -- 172.21.15.178:0/2055979019 shutdown_connections 2024-09-21T09:03:20.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.853+0000 7f3870d51800 1 -- 172.21.15.178:0/2055979019 wait complete. 2024-09-21T09:03:20.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.853+0000 7f3870d51800 1 Processor -- start 2024-09-21T09:03:20.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.853+0000 7f3870d51800 1 -- start start 2024-09-21T09:03:20.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.853+0000 7f3870d51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b60bd0 0x559035b68070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.853+0000 7f3870d51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559035b61b50 con 0x559035b60bd0 2024-09-21T09:03:20.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.854+0000 7f386f046640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b60bd0 0x559035b68070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.854+0000 7f386f046640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b60bd0 0x559035b68070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43556/0 (socket says 172.21.15.178:43556) 2024-09-21T09:03:20.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.854+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 learned_addr learned my addr 172.21.15.178:0/3219612352 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:20.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.854+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559035b685b0 con 0x559035b60bd0 2024-09-21T09:03:20.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.854+0000 7f386f046640 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b60bd0 0x559035b68070 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f386804cb80 tx=0x7f386804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.854+0000 7f3750ff9640 1 -- 172.21.15.178:0/3219612352 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3868044030 con 0x559035b60bd0 2024-09-21T09:03:20.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.854+0000 7f3750ff9640 1 -- 172.21.15.178:0/3219612352 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3868014c80 con 0x559035b60bd0 2024-09-21T09:03:20.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.854+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559035b68840 con 0x559035b60bd0 2024-09-21T09:03:20.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.854+0000 7f3750ff9640 1 -- 172.21.15.178:0/3219612352 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386804b270 con 0x559035b60bd0 2024-09-21T09:03:20.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.854+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559035b6b4f0 con 0x559035b60bd0 2024-09-21T09:03:20.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.855+0000 7f3750ff9640 1 -- 172.21.15.178:0/3219612352 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f386804b410 con 0x559035b60bd0 2024-09-21T09:03:20.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.855+0000 7f3750ff9640 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3738036b40 0x7f3738039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.855+0000 7f3750ff9640 1 -- 172.21.15.178:0/3219612352 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3868045070 con 0x559035b60bd0 2024-09-21T09:03:20.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.855+0000 7f386e845640 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3738036b40 0x7f3738039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.855+0000 7f3870d51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.855+0000 7f3870d51800 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559035b73d00 0x559035b761c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.855+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b76910 con 0x559035b73d00 2024-09-21T09:03:20.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.856+0000 7f386e845640 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3738036b40 0x7f3738039000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f386000bc50 tx=0x7f3860032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.856+0000 7f386e044640 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559035b73d00 0x559035b761c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.856+0000 7f386e044640 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559035b73d00 0x559035b761c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.856+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.856+0000 7f3870d51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.856+0000 7f3870d51800 20 realm 2024-09-21T09:03:20.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.856+0000 7f3870d51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.856+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b76d40 con 0x559035b73d00 2024-09-21T09:03:20.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.856+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.856+0000 7f3870d51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.856+0000 7f3870d51800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:20.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.856+0000 7f3870d51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.856+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b77610 con 0x559035b73d00 2024-09-21T09:03:20.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.856+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.857+0000 7f3870d51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.857+0000 7f3870d51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.857+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b779b0 con 0x559035b73d00 2024-09-21T09:03:20.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.857+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.857+0000 7f3870d51800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:20.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.857+0000 7f3870d51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.857+0000 7f3870d51800 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559035b78710 0x559035b7ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.857+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b7b040 con 0x559035b78710 2024-09-21T09:03:20.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.857+0000 7f386f046640 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559035b78710 0x559035b7ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.857+0000 7f386f046640 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559035b78710 0x559035b7ab00 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.858+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.858+0000 7f3870d51800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:20.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.858+0000 7f3870d51800 20 searching for the correct realm 2024-09-21T09:03:20.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.858+0000 7f3870d51800 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559035b7d080 0x559035b7f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.858+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b7d080 2024-09-21T09:03:20.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.858+0000 7f386e845640 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559035b7d080 0x559035b7f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.858+0000 7f386e845640 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559035b7d080 0x559035b7f540 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.858+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x559035b7d080 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.858+0000 7f386e845640 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3860044d10 0x7f386001c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.858+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x7f3860044d10 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.858+0000 7f386e044640 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3860044d10 0x7f386001c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.859+0000 7f386e044640 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3860044d10 0x7f386001c610 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.859+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3864051070 con 0x7f3860044d10 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.859+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b78710 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.859+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.859+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b73d00 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.859+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.859+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b73d00 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.860+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.860+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b78710 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.860+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.860+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b78710 2024-09-21T09:03:20.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.860+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.860+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x7f3860044d10 2024-09-21T09:03:20.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.860+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3864051070 con 0x7f3860044d10 2024-09-21T09:03:20.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.860+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b7d080 2024-09-21T09:03:20.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.861+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x559035b7d080 2024-09-21T09:03:20.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.861+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b73d00 2024-09-21T09:03:20.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.861+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.861+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b78710 2024-09-21T09:03:20.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.861+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.861+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b73d00 2024-09-21T09:03:20.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.861+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.861+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x7f3860044d10 2024-09-21T09:03:20.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.862+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3864051070 con 0x7f3860044d10 2024-09-21T09:03:20.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.862+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b7d080 2024-09-21T09:03:20.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.862+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x559035b7d080 2024-09-21T09:03:20.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.862+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b7d080 2024-09-21T09:03:20.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.862+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x559035b7d080 2024-09-21T09:03:20.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.862+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b78710 2024-09-21T09:03:20.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.862+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.862+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b7d080 2024-09-21T09:03:20.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.863+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x559035b7d080 2024-09-21T09:03:20.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.863+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559035b7fc10 con 0x559035b7d080 2024-09-21T09:03:20.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.863+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x559035b7d080 2024-09-21T09:03:20.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.863+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3860060040 con 0x559035b73d00 2024-09-21T09:03:20.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.863+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.863+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3860060040 con 0x559035b73d00 2024-09-21T09:03:20.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.863+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.863+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3860060040 con 0x559035b78710 2024-09-21T09:03:20.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.864+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.864+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3860060040 con 0x559035b7d080 2024-09-21T09:03:20.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.864+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x559035b7d080 2024-09-21T09:03:20.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.864+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3860060040 con 0x7f3860044d10 2024-09-21T09:03:20.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.864+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3864051070 con 0x7f3860044d10 2024-09-21T09:03:20.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.864+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3860060040 con 0x559035b73d00 2024-09-21T09:03:20.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.864+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.864+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3860060040 con 0x559035b78710 2024-09-21T09:03:20.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.865+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.865+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3860060040 con 0x559035b7d080 2024-09-21T09:03:20.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.865+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x559035b7d080 2024-09-21T09:03:20.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.865+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3860060040 con 0x559035b78710 2024-09-21T09:03:20.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.865+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.865+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3860060040 con 0x7f3860044d10 2024-09-21T09:03:20.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.865+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3864051070 con 0x7f3860044d10 2024-09-21T09:03:20.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.865+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3860060040 con 0x559035b7d080 2024-09-21T09:03:20.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x559035b7d080 2024-09-21T09:03:20.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3860060040 con 0x559035b78710 2024-09-21T09:03:20.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3860060040 con 0x559035b73d00 2024-09-21T09:03:20.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3860060040 con 0x7f3860044d10 2024-09-21T09:03:20.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3864051070 con 0x7f3860044d10 2024-09-21T09:03:20.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f3870d51800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:20.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f3870d51800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:20.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f3870d51800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:20.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f3870d51800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:20.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f3870d51800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:20.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f3870d51800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:20.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f3870d51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.866+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b7bab0 con 0x559035b73d00 2024-09-21T09:03:20.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b7bf30 con 0x559035b73d00 2024-09-21T09:03:20.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:20.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b7c410 con 0x559035b73d00 2024-09-21T09:03:20.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:20.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 20 zone default found 2024-09-21T09:03:20.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 4 Realm: () 2024-09-21T09:03:20.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:20.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:20.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:20.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 20 zonegroup default 2024-09-21T09:03:20.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b80090 con 0x559035b78710 2024-09-21T09:03:20.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.867+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b822c0 con 0x559035b7d080 2024-09-21T09:03:20.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.868+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f386002d070 con 0x559035b7d080 2024-09-21T09:03:20.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.868+0000 7f3870d51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.868+0000 7f3870d51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.868+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b82660 con 0x559035b7d080 2024-09-21T09:03:20.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.868+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f386002d070 con 0x559035b7d080 2024-09-21T09:03:20.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.868+0000 7f3870d51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:20.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.868+0000 7f3870d51800 20 started sync module instance, tier type = 2024-09-21T09:03:20.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.868+0000 7f3870d51800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:20.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.868+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b81700 con 0x7f3860044d10 2024-09-21T09:03:20.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.869+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3864051070 con 0x7f3860044d10 2024-09-21T09:03:20.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.869+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94077864909824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b81700 con 0x7f3860044d10 2024-09-21T09:03:20.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.869+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b83020 con 0x559035b73d00 2024-09-21T09:03:20.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.870+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94077864909824] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3864051070 con 0x7f3860044d10 2024-09-21T09:03:20.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.870+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.870+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94077864914048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b81700 con 0x559035b73d00 2024-09-21T09:03:20.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.870+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b83a30 con 0x559035b7d080 2024-09-21T09:03:20.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.871+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94077864914048] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.871+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386002d070 con 0x559035b7d080 2024-09-21T09:03:20.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.871+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94077864907344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b81670 con 0x559035b7d080 2024-09-21T09:03:20.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.871+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b848a0 con 0x7f3860044d10 2024-09-21T09:03:20.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.872+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94077864907344] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386002d070 con 0x559035b7d080 2024-09-21T09:03:20.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.873+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3864051070 con 0x7f3860044d10 2024-09-21T09:03:20.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.873+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94077864920048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b84cc0 con 0x7f3860044d10 2024-09-21T09:03:20.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.873+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b85680 con 0x559035b73d00 2024-09-21T09:03:20.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.874+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94077864920048] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3864051070 con 0x7f3860044d10 2024-09-21T09:03:20.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.874+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.874+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94077864921584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b85680 con 0x559035b73d00 2024-09-21T09:03:20.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.874+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b86040 con 0x559035b78710 2024-09-21T09:03:20.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.875+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94077864921584] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.875+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.875+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94077864923600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b855f0 con 0x559035b78710 2024-09-21T09:03:20.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.875+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b86eb0 con 0x559035b78710 2024-09-21T09:03:20.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.876+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94077864923600] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.876+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.876+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94077864928224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b86eb0 con 0x559035b78710 2024-09-21T09:03:20.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.876+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b87870 con 0x559035b78710 2024-09-21T09:03:20.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.877+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.877+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94077864932288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b87c90 con 0x559035b78710 2024-09-21T09:03:20.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.877+0000 7f3870d51800 20 add_watcher() i=0 2024-09-21T09:03:20.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.877+0000 7f3870d51800 20 add_watcher() i=1 2024-09-21T09:03:20.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.877+0000 7f3870d51800 20 add_watcher() i=2 2024-09-21T09:03:20.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.877+0000 7f3870d51800 20 add_watcher() i=3 2024-09-21T09:03:20.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.877+0000 7f3870d51800 20 add_watcher() i=4 2024-09-21T09:03:20.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.877+0000 7f3870d51800 20 add_watcher() i=5 2024-09-21T09:03:20.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.877+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94077864928224] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.877+0000 7f3870d51800 20 add_watcher() i=6 2024-09-21T09:03:20.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.878+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94077864932288] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.878+0000 7f3870d51800 20 add_watcher() i=7 2024-09-21T09:03:20.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.878+0000 7f3870d51800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:20.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.878+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035b87c90 con 0x559035b73d00 2024-09-21T09:03:20.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.878+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.878+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94077864933344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b87c00 con 0x559035b73d00 2024-09-21T09:03:20.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.879+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94077864933344] v29'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.879+0000 7f37257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:20.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.879+0000 7f3870d51800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:20.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.879+0000 7f3870d51800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:20.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.879+0000 7f3870d51800 5 note: GC not initialized 2024-09-21T09:03:20.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.879+0000 7f369ffff640 20 reqs_thread_entry: start 2024-09-21T09:03:20.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.879+0000 7f3870d51800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:20.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.879+0000 7f3870d51800 20 Filter name: none 2024-09-21T09:03:20.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.880+0000 7f369dffb640 20 reqs_thread_entry: start 2024-09-21T09:03:20.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.880+0000 7f3870d51800 20 rados->read ofs=0 len=0 2024-09-21T09:03:20.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.880+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559035bbdbe0 con 0x7f3860044d10 2024-09-21T09:03:20.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.880+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f3864051070 con 0x7f3860044d10 2024-09-21T09:03:20.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.880+0000 7f3870d51800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:20.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.881+0000 7f37257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:20.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.881+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94077864933344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035bbba20 con 0x559035b73d00 2024-09-21T09:03:20.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.882+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94077864933344] v29'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.882+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94077864909824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035bbba20 con 0x7f3860044d10 2024-09-21T09:03:20.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.883+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94077864909824] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3864051070 con 0x7f3860044d10 2024-09-21T09:03:20.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.883+0000 7f3870d51800 20 remove_watcher() i=0 2024-09-21T09:03:20.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.883+0000 7f3870d51800 2 removed watcher, disabling cache 2024-09-21T09:03:20.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.883+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94077864914048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035bbba20 con 0x559035b73d00 2024-09-21T09:03:20.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.884+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94077864914048] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.884+0000 7f3870d51800 20 remove_watcher() i=1 2024-09-21T09:03:20.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.884+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94077864907344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035bbba20 con 0x559035b7d080 2024-09-21T09:03:20.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.885+0000 7f386e845640 1 -- 172.21.15.178:0/3219612352 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94077864907344] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386002d070 con 0x559035b7d080 2024-09-21T09:03:20.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.885+0000 7f3870d51800 20 remove_watcher() i=2 2024-09-21T09:03:20.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.885+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94077864920048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b81250 con 0x7f3860044d10 2024-09-21T09:03:20.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.886+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94077864920048] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3864051070 con 0x7f3860044d10 2024-09-21T09:03:20.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.886+0000 7f3870d51800 20 remove_watcher() i=3 2024-09-21T09:03:20.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.886+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94077864921584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b843f0 con 0x559035b73d00 2024-09-21T09:03:20.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.887+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94077864921584] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3864051070 con 0x559035b73d00 2024-09-21T09:03:20.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.887+0000 7f3870d51800 20 remove_watcher() i=4 2024-09-21T09:03:20.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.887+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94077864923600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b81250 con 0x559035b78710 2024-09-21T09:03:20.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.888+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94077864923600] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.888+0000 7f3870d51800 20 remove_watcher() i=5 2024-09-21T09:03:20.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.888+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94077864928224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b849f0 con 0x559035b78710 2024-09-21T09:03:20.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.889+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94077864928224] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.889+0000 7f3870d51800 20 remove_watcher() i=6 2024-09-21T09:03:20.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.889+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94077864932288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559035b843f0 con 0x559035b78710 2024-09-21T09:03:20.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f386f046640 1 -- 172.21.15.178:0/3219612352 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94077864932288] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386802a070 con 0x559035b78710 2024-09-21T09:03:20.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 20 remove_watcher() i=7 2024-09-21T09:03:20.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559035b78710 msgr2=0x559035b7ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559035b78710 0x559035b7ab00 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559035b73d00 msgr2=0x559035b761c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559035b73d00 0x559035b761c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3860044d10 msgr2=0x7f386001c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3860044d10 0x7f386001c610 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559035b7d080 msgr2=0x559035b7f540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559035b7d080 0x559035b7f540 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3738036b40 msgr2=0x7f3738039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3738036b40 0x7f3738039000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f386000bc50 tx=0x7f3860032000 comp rx=0 tx=0).stop 2024-09-21T09:03:20.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b60bd0 msgr2=0x559035b68070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 --2- 172.21.15.178:0/3219612352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b60bd0 0x559035b68070 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f386804cb80 tx=0x7f386804cb10 comp rx=0 tx=0).stop 2024-09-21T09:03:20.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f386e044640 1 -- 172.21.15.178:0/3219612352 reap_dead start 2024-09-21T09:03:20.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 shutdown_connections 2024-09-21T09:03:20.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 >> 172.21.15.178:0/3219612352 conn(0x559035b5cee0 msgr2=0x559035b5afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 shutdown_connections 2024-09-21T09:03:20.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 -- 172.21.15.178:0/3219612352 wait complete. 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 -- 172.21.15.178:0/1828180554 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3748036b90 msgr2=0x7f3748039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 --2- 172.21.15.178:0/1828180554 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3748036b90 0x7f3748039050 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x559035b40c60 tx=0x7f3860019ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 -- 172.21.15.178:0/1828180554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b53f70 msgr2=0x559035b54390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.890+0000 7f3870d51800 1 --2- 172.21.15.178:0/1828180554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b53f70 0x559035b54390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x559035b40bc0 tx=0x7f3868018830 comp rx=0 tx=0).stop 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 -- 172.21.15.178:0/1828180554 shutdown_connections 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 --2- 172.21.15.178:0/1828180554 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3748036b90 0x7f3748039050 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 --2- 172.21.15.178:0/1828180554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035b53f70 0x559035b54390 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 -- 172.21.15.178:0/1828180554 >> 172.21.15.178:0/1828180554 conn(0x559035b48f00 msgr2=0x559035b4ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 -- 172.21.15.178:0/1828180554 shutdown_connections 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 -- 172.21.15.178:0/1828180554 wait complete. 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559035b42b10 msgr2=0x559035b44f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559035b42b10 0x559035b44f00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559035a43900 msgr2=0x559035b402c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559035a43900 0x559035b402c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3754036b90 msgr2=0x7f3754039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3754036b90 0x7f3754039050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3864057000 tx=0x7f3864052000 comp rx=0 tx=0).stop 2024-09-21T09:03:20.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a3f4c0 msgr2=0x559035b39250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a3f4c0 0x559035b39250 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x559035b2ab70 tx=0x7f3860000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 shutdown_connections 2024-09-21T09:03:20.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559035b42b10 0x559035b44f00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559035a43900 0x559035b402c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3754036b90 0x7f3754039050 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 --2- 172.21.15.178:0/580597911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559035a3f4c0 0x559035b39250 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 >> 172.21.15.178:0/580597911 conn(0x559035a3adf0 msgr2=0x559035b288a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 shutdown_connections 2024-09-21T09:03:20.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.891+0000 7f3870d51800 1 -- 172.21.15.178:0/580597911 wait complete. 2024-09-21T09:03:20.901 INFO:teuthology.orchestra.run.smithi178.stdout:{"key":"bucket:myfoo","ver":{"tag":"_fZhGhJudpptiLH3eXdoCbBH","ver":2},"mtime":"2024-09-21T09:03:20.616782Z","data":{"bucket":{"name":"myfoo","marker":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1","bucket_id":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-21T09:03:19.558161Z","linked":false,"has_bucket_info":false}} 2024-09-21T09:03:20.901 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_fZhGhJudpptiLH3eXdoCbBH', 'ver': 2}, 'mtime': '2024-09-21T09:03:20.616782Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1', 'bucket_id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-21T09:03:19.558161Z', 'linked': False, 'has_bucket_info': False}} 2024-09-21T09:03:20.902 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1'] 2024-09-21T09:03:20.902 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1'] 2024-09-21T09:03:20.902 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 2024-09-21T09:03:20.989 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:20.989 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:20.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.988+0000 7f488731f800 1 Processor -- start 2024-09-21T09:03:20.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.989+0000 7f488731f800 1 -- start start 2024-09-21T09:03:20.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.989+0000 7f488731f800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56278c7f79b0 0x56278c7f9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:20.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.989+0000 7f488731f800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56278c6b3b30 con 0x56278c7f3570 2024-09-21T09:03:20.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.989+0000 7f488731f800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x56278c695360 con 0x56278c7f79b0 2024-09-21T09:03:20.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.989+0000 7f487a794640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56278c7f79b0 0x56278c7f9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:20.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.989+0000 7f4882f95640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x56278c7f3570 0x56278c7f3970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46810/0 (socket says 172.21.15.178:46810) 2024-09-21T09:03:20.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.989+0000 7f4882f95640 1 -- 172.21.15.178:0/1190081687 learned_addr learned my addr 172.21.15.178:0/1190081687 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:20.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.989+0000 7f4882794640 1 -- 172.21.15.178:0/1190081687 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3340401637 0 0) 0x56278c6b3b30 con 0x56278c7f3570 2024-09-21T09:03:20.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.989+0000 7f4882794640 1 -- 172.21.15.178:0/1190081687 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4870001e10 con 0x56278c7f3570 2024-09-21T09:03:20.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.989+0000 7f487a794640 1 -- 172.21.15.178:0/1190081687 >> v1:172.21.15.44:6789/0 conn(0x56278c7f3570 legacy=0x56278c7f3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.989+0000 7f487a794640 1 -- 172.21.15.178:0/1190081687 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56278c6bbe00 con 0x56278c7f79b0 2024-09-21T09:03:20.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.991+0000 7f487a794640 1 --2- 172.21.15.178:0/1190081687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f79b0 0x56278c7f9da0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f486c00a470 tx=0x7f486c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4c0112a8861aae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:20.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.991+0000 7f4882794640 1 -- 172.21.15.178:0/1190081687 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f486c059070 con 0x56278c7f79b0 2024-09-21T09:03:20.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.991+0000 7f4882794640 1 -- 172.21.15.178:0/1190081687 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486c054570 con 0x56278c7f79b0 2024-09-21T09:03:20.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.991+0000 7f4882794640 1 -- 172.21.15.178:0/1190081687 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f486c054870 con 0x56278c7f79b0 2024-09-21T09:03:20.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.992+0000 7f488731f800 1 -- 172.21.15.178:0/1190081687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f79b0 msgr2=0x56278c7f9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:20.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.992+0000 7f488731f800 1 --2- 172.21.15.178:0/1190081687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f79b0 0x56278c7f9da0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f486c00a470 tx=0x7f486c045920 comp rx=0 tx=0).stop 2024-09-21T09:03:20.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.992+0000 7f488731f800 1 -- 172.21.15.178:0/1190081687 shutdown_connections 2024-09-21T09:03:20.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.992+0000 7f488731f800 1 --2- 172.21.15.178:0/1190081687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f79b0 0x56278c7f9da0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:20.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.992+0000 7f488731f800 1 -- 172.21.15.178:0/1190081687 >> 172.21.15.178:0/1190081687 conn(0x56278c7eee00 msgr2=0x56278c7f1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:20.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.992+0000 7f488731f800 1 -- 172.21.15.178:0/1190081687 shutdown_connections 2024-09-21T09:03:20.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:20.992+0000 7f488731f800 1 -- 172.21.15.178:0/1190081687 wait complete. 2024-09-21T09:03:21.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.006+0000 7f488731f800 1 Processor -- start 2024-09-21T09:03:21.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.006+0000 7f488731f800 1 -- start start 2024-09-21T09:03:21.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.006+0000 7f488731f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f3570 0x56278c8e26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.006+0000 7f488731f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56278c740350 con 0x56278c7f3570 2024-09-21T09:03:21.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.006+0000 7f4882f95640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f3570 0x56278c8e26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.006+0000 7f4882f95640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f3570 0x56278c8e26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43580/0 (socket says 172.21.15.178:43580) 2024-09-21T09:03:21.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.006+0000 7f4882f95640 1 -- 172.21.15.178:0/499043306 learned_addr learned my addr 172.21.15.178:0/499043306 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.007+0000 7f4882f95640 1 -- 172.21.15.178:0/499043306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56278c68dbc0 con 0x56278c7f3570 2024-09-21T09:03:21.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.007+0000 7f4882f95640 1 --2- 172.21.15.178:0/499043306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f3570 0x56278c8e26a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4874001e30 tx=0x7f487400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec063a616c9ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.007+0000 7f4770e09640 1 -- 172.21.15.178:0/499043306 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4874012020 con 0x56278c7f3570 2024-09-21T09:03:21.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.007+0000 7f4770e09640 1 -- 172.21.15.178:0/499043306 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487400e5a0 con 0x56278c7f3570 2024-09-21T09:03:21.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.007+0000 7f4770e09640 1 -- 172.21.15.178:0/499043306 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f487400e8e0 con 0x56278c7f3570 2024-09-21T09:03:21.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.008+0000 7f488731f800 1 -- 172.21.15.178:0/499043306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f3570 msgr2=0x56278c8e26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.008+0000 7f488731f800 1 --2- 172.21.15.178:0/499043306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f3570 0x56278c8e26a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4874001e30 tx=0x7f487400b780 comp rx=0 tx=0).stop 2024-09-21T09:03:21.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.008+0000 7f488731f800 1 -- 172.21.15.178:0/499043306 shutdown_connections 2024-09-21T09:03:21.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.008+0000 7f488731f800 1 --2- 172.21.15.178:0/499043306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f3570 0x56278c8e26a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.008+0000 7f488731f800 1 -- 172.21.15.178:0/499043306 >> 172.21.15.178:0/499043306 conn(0x56278c7eee00 msgr2=0x56278c8de060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.008+0000 7f488731f800 1 -- 172.21.15.178:0/499043306 shutdown_connections 2024-09-21T09:03:21.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.008+0000 7f488731f800 1 -- 172.21.15.178:0/499043306 wait complete. 2024-09-21T09:03:21.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.008+0000 7f488731f800 1 Processor -- start 2024-09-21T09:03:21.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.008+0000 7f488731f800 1 -- start start 2024-09-21T09:03:21.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.008+0000 7f488731f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f3570 0x56278c8edd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.008+0000 7f488731f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56278c7fa5e0 con 0x56278c7f3570 2024-09-21T09:03:21.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.009+0000 7f4882f95640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f3570 0x56278c8edd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.009+0000 7f4882f95640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f3570 0x56278c8edd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43596/0 (socket says 172.21.15.178:43596) 2024-09-21T09:03:21.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.009+0000 7f4882f95640 1 -- 172.21.15.178:0/2207429561 learned_addr learned my addr 172.21.15.178:0/2207429561 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.009+0000 7f4882f95640 1 -- 172.21.15.178:0/2207429561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56278c6a1fe0 con 0x56278c7f3570 2024-09-21T09:03:21.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.009+0000 7f4882f95640 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f3570 0x56278c8edd50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4874001e30 tx=0x7f4874000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.009+0000 7f476f606640 1 -- 172.21.15.178:0/2207429561 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4874012030 con 0x56278c7f3570 2024-09-21T09:03:21.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.009+0000 7f476f606640 1 -- 172.21.15.178:0/2207429561 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4874001490 con 0x56278c7f3570 2024-09-21T09:03:21.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.010+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56278c7686a0 con 0x56278c7f3570 2024-09-21T09:03:21.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.010+0000 7f476f606640 1 -- 172.21.15.178:0/2207429561 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f487401a8f0 con 0x56278c7f3570 2024-09-21T09:03:21.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.010+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56278c8ee310 con 0x56278c7f3570 2024-09-21T09:03:21.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.010+0000 7f476f606640 1 -- 172.21.15.178:0/2207429561 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4874015020 con 0x56278c7f3570 2024-09-21T09:03:21.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.010+0000 7f476f606640 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4768036b40 0x7f4768039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.011+0000 7f476f606640 1 -- 172.21.15.178:0/2207429561 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f4874020030 con 0x56278c7f3570 2024-09-21T09:03:21.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.011+0000 7f487a794640 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4768036b40 0x7f4768039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.011+0000 7f488731f800 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56278c7f79b0 0x56278c8f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.011+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c8f27c0 con 0x56278c7f79b0 2024-09-21T09:03:21.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.011+0000 7f4883796640 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56278c7f79b0 0x56278c8f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.011+0000 7f487a794640 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4768036b40 0x7f4768039000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x56278c7f4370 tx=0x7f486c050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.011+0000 7f4883796640 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56278c7f79b0 0x56278c8f21f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.011+0000 7f4883796640 1 -- 172.21.15.178:0/2207429561 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f487c00a4a0 con 0x56278c7f79b0 2024-09-21T09:03:21.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.011+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c8ef710 con 0x56278c7f79b0 2024-09-21T09:03:21.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.012+0000 7f4883796640 1 -- 172.21.15.178:0/2207429561 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f487c00a4a0 con 0x56278c7f79b0 2024-09-21T09:03:21.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.012+0000 7f488731f800 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56278c8f48c0 0x56278c8f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.012+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c8f7510 con 0x56278c8f48c0 2024-09-21T09:03:21.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.012+0000 7f4882f95640 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56278c8f48c0 0x56278c8f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.012+0000 7f4882f95640 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56278c8f48c0 0x56278c8f6d80 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.013+0000 7f4882f95640 1 -- 172.21.15.178:0/2207429561 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4874018430 con 0x56278c8f48c0 2024-09-21T09:03:21.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.013+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c8f30d0 con 0x56278c7f79b0 2024-09-21T09:03:21.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.013+0000 7f4883796640 1 -- 172.21.15.178:0/2207429561 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f487c00a4a0 con 0x56278c7f79b0 2024-09-21T09:03:21.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.013+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c8f34f0 con 0x56278c7f79b0 2024-09-21T09:03:21.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.013+0000 7f4883796640 1 -- 172.21.15.178:0/2207429561 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f487c00a4a0 con 0x56278c7f79b0 2024-09-21T09:03:21.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.013+0000 7f488731f800 1 Processor -- start 2024-09-21T09:03:21.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.013+0000 7f488731f800 1 -- start start 2024-09-21T09:03:21.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.014+0000 7f488731f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c8eb720 0x56278c8e9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.014+0000 7f488731f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56278c68f580 con 0x56278c8eb720 2024-09-21T09:03:21.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.014+0000 7f4883796640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c8eb720 0x56278c8e9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.014+0000 7f4883796640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c8eb720 0x56278c8e9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43612/0 (socket says 172.21.15.178:43612) 2024-09-21T09:03:21.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.014+0000 7f4883796640 1 -- 172.21.15.178:0/276196081 learned_addr learned my addr 172.21.15.178:0/276196081 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.014+0000 7f4883796640 1 -- 172.21.15.178:0/276196081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56278c8ebb40 con 0x56278c8eb720 2024-09-21T09:03:21.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.014+0000 7f4883796640 1 --2- 172.21.15.178:0/276196081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c8eb720 0x56278c8e9d70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x56278c8f2ba0 tx=0x7f487c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.014+0000 7f476ce01640 1 -- 172.21.15.178:0/276196081 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f487c014450 con 0x56278c8eb720 2024-09-21T09:03:21.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.014+0000 7f476ce01640 1 -- 172.21.15.178:0/276196081 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487c0145f0 con 0x56278c8eb720 2024-09-21T09:03:21.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.014+0000 7f476ce01640 1 -- 172.21.15.178:0/276196081 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f487c0148d0 con 0x56278c8eb720 2024-09-21T09:03:21.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.014+0000 7f488731f800 1 -- 172.21.15.178:0/276196081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56278c8ea370 con 0x56278c8eb720 2024-09-21T09:03:21.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.015+0000 7f488731f800 1 -- 172.21.15.178:0/276196081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56278c8ea870 con 0x56278c8eb720 2024-09-21T09:03:21.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.015+0000 7f476ce01640 1 -- 172.21.15.178:0/276196081 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f487c011040 con 0x56278c8eb720 2024-09-21T09:03:21.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.015+0000 7f476ce01640 1 --2- 172.21.15.178:0/276196081 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f475c036b90 0x7f475c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.015+0000 7f476ce01640 1 -- 172.21.15.178:0/276196081 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f487c01e070 con 0x56278c8eb720 2024-09-21T09:03:21.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.015+0000 7f4882f95640 1 --2- 172.21.15.178:0/276196081 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f475c036b90 0x7f475c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.016+0000 7f488731f800 1 Processor -- start 2024-09-21T09:03:21.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.016+0000 7f4882f95640 1 --2- 172.21.15.178:0/276196081 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f475c036b90 0x7f475c039050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x56278c8f3c30 tx=0x7f4874016f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.016+0000 7f488731f800 1 -- start start 2024-09-21T09:03:21.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.016+0000 7f488731f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c914d30 0x56278c915130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.016+0000 7f488731f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56278c8e2e50 con 0x56278c914d30 2024-09-21T09:03:21.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.016+0000 7f4883796640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c914d30 0x56278c915130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.016+0000 7f4883796640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c914d30 0x56278c915130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43614/0 (socket says 172.21.15.178:43614) 2024-09-21T09:03:21.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.016+0000 7f4883796640 1 -- 172.21.15.178:0/514061560 learned_addr learned my addr 172.21.15.178:0/514061560 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.017+0000 7f4883796640 1 -- 172.21.15.178:0/514061560 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56278c915700 con 0x56278c914d30 2024-09-21T09:03:21.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.017+0000 7f4883796640 1 --2- 172.21.15.178:0/514061560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c914d30 0x56278c915130 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f487c018430 tx=0x7f487c0404b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddef2f9b8c840b3c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.017+0000 7f47667fc640 1 -- 172.21.15.178:0/514061560 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f487c013dc0 con 0x56278c914d30 2024-09-21T09:03:21.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.017+0000 7f47667fc640 1 -- 172.21.15.178:0/514061560 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487c046ad0 con 0x56278c914d30 2024-09-21T09:03:21.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.017+0000 7f47667fc640 1 -- 172.21.15.178:0/514061560 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f487c046df0 con 0x56278c914d30 2024-09-21T09:03:21.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.017+0000 7f488731f800 1 -- 172.21.15.178:0/514061560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c914d30 msgr2=0x56278c915130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.017+0000 7f488731f800 1 --2- 172.21.15.178:0/514061560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c914d30 0x56278c915130 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f487c018430 tx=0x7f487c0404b0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.017+0000 7f488731f800 1 -- 172.21.15.178:0/514061560 shutdown_connections 2024-09-21T09:03:21.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.017+0000 7f488731f800 1 --2- 172.21.15.178:0/514061560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c914d30 0x56278c915130 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.017+0000 7f488731f800 1 -- 172.21.15.178:0/514061560 >> 172.21.15.178:0/514061560 conn(0x56278c911090 msgr2=0x56278c90f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.017+0000 7f488731f800 1 -- 172.21.15.178:0/514061560 shutdown_connections 2024-09-21T09:03:21.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.017+0000 7f488731f800 1 -- 172.21.15.178:0/514061560 wait complete. 2024-09-21T09:03:21.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.018+0000 7f488731f800 1 Processor -- start 2024-09-21T09:03:21.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.018+0000 7f488731f800 1 -- start start 2024-09-21T09:03:21.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.018+0000 7f488731f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c914d30 0x56278c91c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.018+0000 7f488731f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56278c915d70 con 0x56278c914d30 2024-09-21T09:03:21.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.018+0000 7f4883796640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c914d30 0x56278c91c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.018+0000 7f4883796640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c914d30 0x56278c91c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43630/0 (socket says 172.21.15.178:43630) 2024-09-21T09:03:21.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.018+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 learned_addr learned my addr 172.21.15.178:0/547642662 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.018+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56278c91c740 con 0x56278c914d30 2024-09-21T09:03:21.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.018+0000 7f4883796640 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c914d30 0x56278c91c200 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f487c018430 tx=0x7f487c04cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.019+0000 7f4764ff9640 1 -- 172.21.15.178:0/547642662 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f487c03b070 con 0x56278c914d30 2024-09-21T09:03:21.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.019+0000 7f4764ff9640 1 -- 172.21.15.178:0/547642662 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487c02ba60 con 0x56278c914d30 2024-09-21T09:03:21.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.019+0000 7f4764ff9640 1 -- 172.21.15.178:0/547642662 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f487c016440 con 0x56278c914d30 2024-09-21T09:03:21.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.019+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56278c91c9d0 con 0x56278c914d30 2024-09-21T09:03:21.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.019+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56278c91f680 con 0x56278c914d30 2024-09-21T09:03:21.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.019+0000 7f4764ff9640 1 -- 172.21.15.178:0/547642662 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f487c022a80 con 0x56278c914d30 2024-09-21T09:03:21.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.019+0000 7f4764ff9640 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f474c036b90 0x7f474c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.020+0000 7f4764ff9640 1 -- 172.21.15.178:0/547642662 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f487c033070 con 0x56278c914d30 2024-09-21T09:03:21.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.020+0000 7f4882f95640 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f474c036b90 0x7f474c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.020+0000 7f4882f95640 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f474c036b90 0x7f474c039050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f487404af70 tx=0x7f4874035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.020+0000 7f488731f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.020+0000 7f488731f800 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56278c927e00 0x56278c92a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.020+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c92aa10 con 0x56278c927e00 2024-09-21T09:03:21.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.020+0000 7f487a794640 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56278c927e00 0x56278c92a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f487a794640 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56278c927e00 0x56278c92a2c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f488731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f488731f800 20 realm 2024-09-21T09:03:21.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f488731f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c92ae40 con 0x56278c927e00 2024-09-21T09:03:21.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f488731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f488731f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:21.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f488731f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c92b710 con 0x56278c927e00 2024-09-21T09:03:21.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f488731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f488731f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.021+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c92bab0 con 0x56278c927e00 2024-09-21T09:03:21.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.022+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.022+0000 7f488731f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:21.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.022+0000 7f488731f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.022+0000 7f488731f800 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56278c92c810 0x56278c92ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.022+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c92f250 con 0x56278c92c810 2024-09-21T09:03:21.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.022+0000 7f4883796640 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56278c92c810 0x56278c92ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.022+0000 7f4883796640 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56278c92c810 0x56278c92ec00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.023+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.023+0000 7f488731f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:21.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.023+0000 7f488731f800 20 searching for the correct realm 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.023+0000 7f488731f800 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56278c931200 0x56278c9336c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.023+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c931200 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.023+0000 7f4882f95640 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56278c931200 0x56278c9336c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.023+0000 7f4882f95640 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56278c931200 0x56278c9336c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.023+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4874018430 con 0x56278c931200 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.023+0000 7f4882f95640 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f4874017050 0x7f487402d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.023+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x7f4874017050 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.024+0000 7f487a794640 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f4874017050 0x7f487402d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.024+0000 7f487a794640 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f4874017050 0x7f487402d3f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.024+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.024+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c92c810 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.024+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.024+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c927e00 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.025+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.025+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c927e00 2024-09-21T09:03:21.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.025+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.025+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c92c810 2024-09-21T09:03:21.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.025+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.025+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c92c810 2024-09-21T09:03:21.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.026+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.026+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x7f4874017050 2024-09-21T09:03:21.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.026+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.026+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c931200 2024-09-21T09:03:21.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.026+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4874018430 con 0x56278c931200 2024-09-21T09:03:21.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.026+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c927e00 2024-09-21T09:03:21.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.026+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.026+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c92c810 2024-09-21T09:03:21.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.027+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.027+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c927e00 2024-09-21T09:03:21.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.027+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.027+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x7f4874017050 2024-09-21T09:03:21.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.027+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.027+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c931200 2024-09-21T09:03:21.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.027+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4874018430 con 0x56278c931200 2024-09-21T09:03:21.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.027+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c931200 2024-09-21T09:03:21.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.028+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4874018430 con 0x56278c931200 2024-09-21T09:03:21.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.028+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c92c810 2024-09-21T09:03:21.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.028+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.028+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c931200 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.028+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4874018430 con 0x56278c931200 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.028+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c931200 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.028+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4874018430 con 0x56278c931200 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.028+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c927e00 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.029+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.029+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c927e00 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.029+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.029+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c92c810 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.029+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.029+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c931200 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.029+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4874018430 con 0x56278c931200 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.029+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x7f4874017050 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.029+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.029+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c927e00 2024-09-21T09:03:21.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.030+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.030+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c92c810 2024-09-21T09:03:21.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.030+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.030+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c931200 2024-09-21T09:03:21.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.030+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4874018430 con 0x56278c931200 2024-09-21T09:03:21.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.030+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c92c810 2024-09-21T09:03:21.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.030+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.031+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x7f4874017050 2024-09-21T09:03:21.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.031+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.031+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c931200 2024-09-21T09:03:21.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.031+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4874018430 con 0x56278c931200 2024-09-21T09:03:21.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.031+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c92c810 2024-09-21T09:03:21.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.031+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.031+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x56278c927e00 2024-09-21T09:03:21.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.031+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.031+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56278c933d90 con 0x7f4874017050 2024-09-21T09:03:21.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:21.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:21.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:21.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:21.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:21.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:21.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c92fc70 con 0x56278c927e00 2024-09-21T09:03:21.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c92f880 con 0x56278c927e00 2024-09-21T09:03:21.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:21.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c92f890 con 0x56278c927e00 2024-09-21T09:03:21.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:21.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 zone default found 2024-09-21T09:03:21.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 4 Realm: () 2024-09-21T09:03:21.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:21.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:21.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:21.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 zonegroup default 2024-09-21T09:03:21.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.032+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c934210 con 0x56278c92c810 2024-09-21T09:03:21.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.033+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.033+0000 7f488731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.033+0000 7f488731f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.033+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c935f90 con 0x56278c931200 2024-09-21T09:03:21.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.033+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4874018430 con 0x56278c931200 2024-09-21T09:03:21.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.033+0000 7f488731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.033+0000 7f488731f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.033+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c936410 con 0x56278c931200 2024-09-21T09:03:21.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.033+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4874018430 con 0x56278c931200 2024-09-21T09:03:21.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.033+0000 7f488731f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.033+0000 7f488731f800 20 started sync module instance, tier type = 2024-09-21T09:03:21.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.033+0000 7f488731f800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:21.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.033+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c935430 con 0x7f4874017050 2024-09-21T09:03:21.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.034+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.034+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94727862180176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c935430 con 0x7f4874017050 2024-09-21T09:03:21.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.034+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c936ef0 con 0x56278c927e00 2024-09-21T09:03:21.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.035+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94727862180176] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.035+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.035+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94727862184416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c935430 con 0x56278c927e00 2024-09-21T09:03:21.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.036+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c9379a0 con 0x56278c931200 2024-09-21T09:03:21.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.037+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4874018430 con 0x56278c931200 2024-09-21T09:03:21.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.037+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94727862187136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c938240 con 0x56278c931200 2024-09-21T09:03:21.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.037+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c938ce0 con 0x7f4874017050 2024-09-21T09:03:21.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.037+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94727862184416] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.038+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.038+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94727862192048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c9390d0 con 0x7f4874017050 2024-09-21T09:03:21.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.038+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94727862187136] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4874018430 con 0x56278c931200 2024-09-21T09:03:21.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.038+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c939920 con 0x56278c927e00 2024-09-21T09:03:21.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.039+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94727862192048] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.039+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.039+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94727862177664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c939510 con 0x56278c927e00 2024-09-21T09:03:21.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.039+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c939f50 con 0x56278c92c810 2024-09-21T09:03:21.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.040+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.040+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94727862196768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c939f10 con 0x56278c92c810 2024-09-21T09:03:21.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.040+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c93af10 con 0x56278c92c810 2024-09-21T09:03:21.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.040+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94727862177664] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.041+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94727862196768] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.041+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.041+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94727862199104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c939060 con 0x56278c92c810 2024-09-21T09:03:21.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.041+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c93b400 con 0x56278c92c810 2024-09-21T09:03:21.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.042+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.042+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94727862202128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c93b7e0 con 0x56278c92c810 2024-09-21T09:03:21.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.042+0000 7f488731f800 20 add_watcher() i=0 2024-09-21T09:03:21.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.042+0000 7f488731f800 20 add_watcher() i=1 2024-09-21T09:03:21.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.042+0000 7f488731f800 20 add_watcher() i=2 2024-09-21T09:03:21.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.042+0000 7f488731f800 20 add_watcher() i=3 2024-09-21T09:03:21.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.042+0000 7f488731f800 20 add_watcher() i=4 2024-09-21T09:03:21.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.042+0000 7f488731f800 20 add_watcher() i=5 2024-09-21T09:03:21.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.042+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94727862199104] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.042+0000 7f488731f800 20 add_watcher() i=6 2024-09-21T09:03:21.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.043+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94727862202128] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.043+0000 7f488731f800 20 add_watcher() i=7 2024-09-21T09:03:21.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.043+0000 7f488731f800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:21.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.043+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c93aa40 con 0x56278c927e00 2024-09-21T09:03:21.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.043+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.043+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94727862203184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c93aa40 con 0x56278c927e00 2024-09-21T09:03:21.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.044+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94727862203184] v29'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.044+0000 7f47397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:21.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.044+0000 7f488731f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:21.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.044+0000 7f488731f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:21.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.045+0000 7f488731f800 5 note: GC not initialized 2024-09-21T09:03:21.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.045+0000 7f46b3fff640 20 reqs_thread_entry: start 2024-09-21T09:03:21.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.045+0000 7f488731f800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:21.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.045+0000 7f488731f800 20 Filter name: none 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.045+0000 7f46b1ffb640 20 reqs_thread_entry: start 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.045+0000 7f488731f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.045+0000 7f488731f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.045+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c971cd0 con 0x56278c92c810 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f488731f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f488731f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f488731f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f488731f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f488731f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f488731f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c973db0 con 0x7f4874017050 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f488731f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:21.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f488731f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T09:03:21.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f488731f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:21.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f488731f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 : miss 2024-09-21T09:03:21.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f488731f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.046+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c975770 con 0x56278c92c810 2024-09-21T09:03:21.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.047+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(64 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.047+0000 7f488731f800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:21.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.047+0000 7f488731f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:21.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.047+0000 7f488731f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:21.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.047+0000 7f488731f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:21.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.047+0000 7f488731f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:21.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.047+0000 7f488731f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 2024-09-21T09:03:21.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.047+0000 7f488731f800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-21T09:03:21.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.047+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c9799e0 con 0x7f4874017050 2024-09-21T09:03:21.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.048+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(65 foo.buckets [call] v29'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.048+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:66 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c97f900 con 0x56278c92c810 2024-09-21T09:03:21.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.049+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(66 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v29'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.049+0000 7f488731f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:21.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.049+0000 7f488731f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:21.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.049+0000 7f488731f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:21.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.049+0000 7f488731f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1, ofs0, ns] 2024-09-21T09:03:21.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.049+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94727862441696 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c979e10 con 0x56278c92c810 2024-09-21T09:03:21.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.049+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== watch-notify(notify (1) cookie 94727862196768 notify 124554051588 ret 0) ==== 794+0+0 (crc 0 0 0) 0x56278c974cb0 con 0x56278c92c810 2024-09-21T09:03:21.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.049+0000 7f47667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051588 cookie 94727862196768 notifier 4504 bl.length()=752 2024-09-21T09:03:21.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.049+0000 7f47667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:21.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.049+0000 7f47667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:21.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.049+0000 7f47667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:21.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.049+0000 7f47667fc640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f4748003ea0 con 0x56278c92c810 2024-09-21T09:03:21.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.049+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(67 notify.5 [notify cookie 94727862441696 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.050+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.050+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== watch-notify(notify_complete (2) cookie 94727862441696 notify 124554051588 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56278c91c9d0 con 0x56278c92c810 2024-09-21T09:03:21.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.050+0000 7f488731f800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): orig_sources= new_sources= 2024-09-21T09:03:21.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.050+0000 7f488731f800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): potential sources added=[] removed=[] 2024-09-21T09:03:21.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.050+0000 7f488731f800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): orig_dests= new_dests= 2024-09-21T09:03:21.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.050+0000 7f488731f800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): potential dests added=[] removed=[] 2024-09-21T09:03:21.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.050+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c97e100 con 0x56278c92c810 2024-09-21T09:03:21.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.051+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(69 fud.buckets [call] v29'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.051+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c975690 con 0x7f4874017050 2024-09-21T09:03:21.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.052+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v29'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.052+0000 7f488731f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-21T09:03:21.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.052+0000 7f488731f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:21.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.052+0000 7f488731f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T09:03:21.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.052+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94727862429936 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56278c975690 con 0x56278c92c810 2024-09-21T09:03:21.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.052+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== watch-notify(notify (1) cookie 94727862199104 notify 124554051589 ret 0) ==== 356+0+0 (crc 0 0 0) 0x56278c91c740 con 0x56278c92c810 2024-09-21T09:03:21.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.052+0000 7f4765ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051589 cookie 94727862199104 notifier 4504 bl.length()=314 2024-09-21T09:03:21.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.052+0000 7f4765ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.052+0000 7f4765ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.052+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(71 notify.6 [notify cookie 94727862429936 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.052+0000 7f4765ffb640 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f46b8003400 con 0x56278c92c810 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.053+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== watch-notify(notify_complete (2) cookie 94727862429936 notify 124554051589 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56278c915700 con 0x56278c92c810 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.053+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.053+0000 7f47397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.053+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94727862203184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c96fa40 con 0x56278c927e00 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.054+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94727862203184] v29'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.054+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94727862180176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c96fa40 con 0x7f4874017050 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.055+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94727862180176] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.055+0000 7f488731f800 20 remove_watcher() i=0 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.055+0000 7f488731f800 2 removed watcher, disabling cache 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.055+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94727862184416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c96fa40 con 0x56278c927e00 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.056+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94727862184416] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.057+0000 7f488731f800 20 remove_watcher() i=1 2024-09-21T09:03:21.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.057+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94727862187136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c96fa40 con 0x56278c931200 2024-09-21T09:03:21.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.058+0000 7f4882f95640 1 -- 172.21.15.178:0/547642662 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94727862187136] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4874018430 con 0x56278c931200 2024-09-21T09:03:21.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.058+0000 7f488731f800 20 remove_watcher() i=2 2024-09-21T09:03:21.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.058+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94727862192048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c975630 con 0x7f4874017050 2024-09-21T09:03:21.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.059+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94727862192048] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x7f4874017050 2024-09-21T09:03:21.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.059+0000 7f488731f800 20 remove_watcher() i=3 2024-09-21T09:03:21.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.059+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94727862177664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c975630 con 0x56278c927e00 2024-09-21T09:03:21.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.060+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94727862177664] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f486c05c040 con 0x56278c927e00 2024-09-21T09:03:21.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.060+0000 7f488731f800 20 remove_watcher() i=4 2024-09-21T09:03:21.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.060+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94727862196768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c975630 con 0x56278c92c810 2024-09-21T09:03:21.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.061+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94727862196768] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.061+0000 7f488731f800 20 remove_watcher() i=5 2024-09-21T09:03:21.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.061+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94727862199104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c975630 con 0x56278c92c810 2024-09-21T09:03:21.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.062+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 31 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94727862199104] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.062+0000 7f488731f800 20 remove_watcher() i=6 2024-09-21T09:03:21.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.062+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94727862202128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56278c975630 con 0x56278c92c810 2024-09-21T09:03:21.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.062+0000 7f4883796640 1 -- 172.21.15.178:0/547642662 <== osd.0 v2:172.21.15.44:6800/2732047064 32 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94727862202128] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f487c02a070 con 0x56278c92c810 2024-09-21T09:03:21.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 20 remove_watcher() i=7 2024-09-21T09:03:21.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56278c92c810 msgr2=0x56278c92ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56278c92c810 0x56278c92ec00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56278c927e00 msgr2=0x56278c92a2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56278c927e00 0x56278c92a2c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f4874017050 msgr2=0x7f487402d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f4874017050 0x7f487402d3f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56278c931200 msgr2=0x56278c9336c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56278c931200 0x56278c9336c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f474c036b90 msgr2=0x7f474c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f474c036b90 0x7f474c039050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f487404af70 tx=0x7f4874035000 comp rx=0 tx=0).stop 2024-09-21T09:03:21.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c914d30 msgr2=0x56278c91c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 --2- 172.21.15.178:0/547642662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c914d30 0x56278c91c200 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f487c018430 tx=0x7f487c04cc70 comp rx=0 tx=0).stop 2024-09-21T09:03:21.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 reap_dead start 2024-09-21T09:03:21.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f487a794640 1 -- 172.21.15.178:0/547642662 reap_dead start 2024-09-21T09:03:21.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 shutdown_connections 2024-09-21T09:03:21.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 >> 172.21.15.178:0/547642662 conn(0x56278c911090 msgr2=0x56278c90f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 shutdown_connections 2024-09-21T09:03:21.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/547642662 wait complete. 2024-09-21T09:03:21.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/276196081 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f475c036b90 msgr2=0x7f475c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 --2- 172.21.15.178:0/276196081 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f475c036b90 0x7f475c039050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x56278c8f3c30 tx=0x7f4874016f10 comp rx=0 tx=0).stop 2024-09-21T09:03:21.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/276196081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c8eb720 msgr2=0x56278c8e9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 --2- 172.21.15.178:0/276196081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c8eb720 0x56278c8e9d70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x56278c8f2ba0 tx=0x7f487c018830 comp rx=0 tx=0).stop 2024-09-21T09:03:21.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/276196081 shutdown_connections 2024-09-21T09:03:21.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 --2- 172.21.15.178:0/276196081 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f475c036b90 0x7f475c039050 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 --2- 172.21.15.178:0/276196081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c8eb720 0x56278c8e9d70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/276196081 >> 172.21.15.178:0/276196081 conn(0x56278c8fae60 msgr2=0x56278c8fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/276196081 shutdown_connections 2024-09-21T09:03:21.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.063+0000 7f488731f800 1 -- 172.21.15.178:0/276196081 wait complete. 2024-09-21T09:03:21.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56278c8f48c0 msgr2=0x56278c8f6d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56278c8f48c0 0x56278c8f6d80 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56278c7f79b0 msgr2=0x56278c8f21f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56278c7f79b0 0x56278c8f21f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4768036b40 msgr2=0x7f4768039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4768036b40 0x7f4768039000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x56278c7f4370 tx=0x7f486c050000 comp rx=0 tx=0).stop 2024-09-21T09:03:21.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f3570 msgr2=0x56278c8edd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f3570 0x56278c8edd50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4874001e30 tx=0x7f4874000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 shutdown_connections 2024-09-21T09:03:21.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56278c8f48c0 0x56278c8f6d80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56278c7f79b0 0x56278c8f21f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4768036b40 0x7f4768039000 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 --2- 172.21.15.178:0/2207429561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56278c7f3570 0x56278c8edd50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 >> 172.21.15.178:0/2207429561 conn(0x56278c7eee00 msgr2=0x56278c8dc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 shutdown_connections 2024-09-21T09:03:21.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.064+0000 7f488731f800 1 -- 172.21.15.178:0/2207429561 wait complete. 2024-09-21T09:03:21.074 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-21T09:03:21.074 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-21T09:03:21.075 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-21T09:03:21.119 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:21.119 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:21.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.118+0000 7fc6e8a0f800 1 Processor -- start 2024-09-21T09:03:21.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.118+0000 7fc6e8a0f800 1 -- start start 2024-09-21T09:03:21.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.118+0000 7fc6e8a0f800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x562769f98900 0x562769f9acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.118+0000 7fc6e8a0f800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562769e54b30 con 0x562769f944c0 2024-09-21T09:03:21.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.118+0000 7fc6e8a0f800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x562769e36360 con 0x562769f98900 2024-09-21T09:03:21.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.119+0000 7fc6db92b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x562769f98900 0x562769f9acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.119+0000 7fc6e412c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x562769f944c0 0x562769f948c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46822/0 (socket says 172.21.15.178:46822) 2024-09-21T09:03:21.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.119+0000 7fc6e412c640 1 -- 172.21.15.178:0/851595862 learned_addr learned my addr 172.21.15.178:0/851595862 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:21.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.119+0000 7fc6db92b640 1 -- 172.21.15.178:0/851595862 >> v1:172.21.15.44:6789/0 conn(0x562769f944c0 legacy=0x562769f948c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.119+0000 7fc6e392b640 1 -- 172.21.15.178:0/851595862 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 835469042 0 0) 0x562769e54b30 con 0x562769f944c0 2024-09-21T09:03:21.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.119+0000 7fc6db92b640 1 -- 172.21.15.178:0/851595862 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562769e5ce00 con 0x562769f98900 2024-09-21T09:03:21.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.121+0000 7fc6db92b640 1 --2- 172.21.15.178:0/851595862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f98900 0x562769f9acf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00a470 tx=0x7fc6cc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ec52b07aa1963a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.121+0000 7fc6e392b640 1 -- 172.21.15.178:0/851595862 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6cc053570 con 0x562769f98900 2024-09-21T09:03:21.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.121+0000 7fc6e392b640 1 -- 172.21.15.178:0/851595862 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6cc058070 con 0x562769f98900 2024-09-21T09:03:21.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.121+0000 7fc6e392b640 1 -- 172.21.15.178:0/851595862 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6cc053880 con 0x562769f98900 2024-09-21T09:03:21.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.121+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/851595862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f98900 msgr2=0x562769f9acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.121+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/851595862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f98900 0x562769f9acf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00a470 tx=0x7fc6cc045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:21.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.121+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/851595862 shutdown_connections 2024-09-21T09:03:21.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.121+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/851595862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f98900 0x562769f9acf0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.121+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/851595862 >> 172.21.15.178:0/851595862 conn(0x562769f8fdf0 msgr2=0x562769f92210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.121+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/851595862 shutdown_connections 2024-09-21T09:03:21.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.121+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/851595862 wait complete. 2024-09-21T09:03:21.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.135+0000 7fc6e8a0f800 1 Processor -- start 2024-09-21T09:03:21.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.135+0000 7fc6e8a0f800 1 -- start start 2024-09-21T09:03:21.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.135+0000 7fc6e8a0f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f944c0 0x562769f08d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.135+0000 7fc6e8a0f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562769ee1330 con 0x562769f944c0 2024-09-21T09:03:21.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.136+0000 7fc6e412c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f944c0 0x562769f08d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.136+0000 7fc6e412c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f944c0 0x562769f08d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43662/0 (socket says 172.21.15.178:43662) 2024-09-21T09:03:21.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.136+0000 7fc6e412c640 1 -- 172.21.15.178:0/2427545231 learned_addr learned my addr 172.21.15.178:0/2427545231 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.136+0000 7fc6e412c640 1 -- 172.21.15.178:0/2427545231 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562769e2ebc0 con 0x562769f944c0 2024-09-21T09:03:21.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.136+0000 7fc6e412c640 1 --2- 172.21.15.178:0/2427545231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f944c0 0x562769f08d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400b240 tx=0x7fc6d400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9ca4822d7923e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.136+0000 7fc5d260c640 1 -- 172.21.15.178:0/2427545231 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4008070 con 0x562769f944c0 2024-09-21T09:03:21.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.136+0000 7fc5d260c640 1 -- 172.21.15.178:0/2427545231 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d400d500 con 0x562769f944c0 2024-09-21T09:03:21.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.136+0000 7fc5d260c640 1 -- 172.21.15.178:0/2427545231 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d400d860 con 0x562769f944c0 2024-09-21T09:03:21.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.137+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/2427545231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f944c0 msgr2=0x562769f08d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.137+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/2427545231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f944c0 0x562769f08d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400b240 tx=0x7fc6d400b700 comp rx=0 tx=0).stop 2024-09-21T09:03:21.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.137+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/2427545231 shutdown_connections 2024-09-21T09:03:21.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.137+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/2427545231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f944c0 0x562769f08d80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.137+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/2427545231 >> 172.21.15.178:0/2427545231 conn(0x562769f8fdf0 msgr2=0x56276a07ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.137+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/2427545231 shutdown_connections 2024-09-21T09:03:21.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.137+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/2427545231 wait complete. 2024-09-21T09:03:21.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.137+0000 7fc6e8a0f800 1 Processor -- start 2024-09-21T09:03:21.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.137+0000 7fc6e8a0f800 1 -- start start 2024-09-21T09:03:21.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.137+0000 7fc6e8a0f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f944c0 0x56276a08c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.137+0000 7fc6e8a0f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562769f9b530 con 0x562769f944c0 2024-09-21T09:03:21.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.138+0000 7fc6e412c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f944c0 0x56276a08c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.138+0000 7fc6e412c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f944c0 0x56276a08c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43676/0 (socket says 172.21.15.178:43676) 2024-09-21T09:03:21.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.138+0000 7fc6e412c640 1 -- 172.21.15.178:0/3939122496 learned_addr learned my addr 172.21.15.178:0/3939122496 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.138+0000 7fc6e412c640 1 -- 172.21.15.178:0/3939122496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562769e42fe0 con 0x562769f944c0 2024-09-21T09:03:21.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.138+0000 7fc6e412c640 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f944c0 0x56276a08c080 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x562769f08480 tx=0x7fc6d4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.138+0000 7fc5d0e09640 1 -- 172.21.15.178:0/3939122496 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4019870 con 0x562769f944c0 2024-09-21T09:03:21.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.138+0000 7fc5d0e09640 1 -- 172.21.15.178:0/3939122496 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d4019a10 con 0x562769f944c0 2024-09-21T09:03:21.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.138+0000 7fc5d0e09640 1 -- 172.21.15.178:0/3939122496 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4019d30 con 0x562769f944c0 2024-09-21T09:03:21.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.138+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56276a08c5c0 con 0x562769f944c0 2024-09-21T09:03:21.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.138+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56276a08cae0 con 0x562769f944c0 2024-09-21T09:03:21.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.139+0000 7fc5d0e09640 1 -- 172.21.15.178:0/3939122496 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc6d4017040 con 0x562769f944c0 2024-09-21T09:03:21.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.139+0000 7fc5d0e09640 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5cc036b40 0x7fc5cc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.139+0000 7fc5d0e09640 1 -- 172.21.15.178:0/3939122496 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc6d4015020 con 0x562769f944c0 2024-09-21T09:03:21.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.139+0000 7fc6db92b640 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5cc036b40 0x7fc5cc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.139+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562769f98900 0x56276a0930f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.139+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a093630 con 0x562769f98900 2024-09-21T09:03:21.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.140+0000 7fc6e492d640 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562769f98900 0x56276a0930f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.140+0000 7fc6db92b640 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5cc036b40 0x7fc5cc039000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc057000 tx=0x7fc6cc052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.140+0000 7fc6e492d640 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562769f98900 0x56276a0930f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.140+0000 7fc6e492d640 1 -- 172.21.15.178:0/3939122496 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6dc00a4a0 con 0x562769f98900 2024-09-21T09:03:21.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.140+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0906c0 con 0x562769f98900 2024-09-21T09:03:21.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.140+0000 7fc6e492d640 1 -- 172.21.15.178:0/3939122496 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc6dc00a4a0 con 0x562769f98900 2024-09-21T09:03:21.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.140+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56276a095940 0x56276a097d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.140+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0983d0 con 0x56276a095940 2024-09-21T09:03:21.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.141+0000 7fc6e412c640 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56276a095940 0x56276a097d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.141+0000 7fc6e412c640 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56276a095940 0x56276a097d30 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.142+0000 7fc6e412c640 1 -- 172.21.15.178:0/3939122496 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc6d402d070 con 0x56276a095940 2024-09-21T09:03:21.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.142+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0947e0 con 0x562769f98900 2024-09-21T09:03:21.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.142+0000 7fc6e492d640 1 -- 172.21.15.178:0/3939122496 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc6dc00a4a0 con 0x562769f98900 2024-09-21T09:03:21.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.142+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a094cc0 con 0x562769f98900 2024-09-21T09:03:21.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.142+0000 7fc6e492d640 1 -- 172.21.15.178:0/3939122496 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc6dc00a4a0 con 0x562769f98900 2024-09-21T09:03:21.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.142+0000 7fc6e8a0f800 1 Processor -- start 2024-09-21T09:03:21.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.142+0000 7fc6e8a0f800 1 -- start start 2024-09-21T09:03:21.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.143+0000 7fc6e8a0f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0a6d90 0x56276a0a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.143+0000 7fc6e8a0f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562769e30580 con 0x56276a0a6d90 2024-09-21T09:03:21.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.143+0000 7fc6e492d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0a6d90 0x56276a0a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.143+0000 7fc6e492d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0a6d90 0x56276a0a71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43692/0 (socket says 172.21.15.178:43692) 2024-09-21T09:03:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.143+0000 7fc6e492d640 1 -- 172.21.15.178:0/3197533406 learned_addr learned my addr 172.21.15.178:0/3197533406 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.143+0000 7fc6e492d640 1 -- 172.21.15.178:0/3197533406 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56276a0a76f0 con 0x56276a0a6d90 2024-09-21T09:03:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.143+0000 7fc6e492d640 1 --2- 172.21.15.178:0/3197533406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0a6d90 0x56276a0a71b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x56276a08d130 tx=0x7fc6dc0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.143+0000 7fc5c9ffb640 1 -- 172.21.15.178:0/3197533406 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc014450 con 0x56276a0a6d90 2024-09-21T09:03:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.143+0000 7fc5c9ffb640 1 -- 172.21.15.178:0/3197533406 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6dc0145f0 con 0x56276a0a6d90 2024-09-21T09:03:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.143+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3197533406 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56276a0a7980 con 0x56276a0a6d90 2024-09-21T09:03:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.143+0000 7fc5c9ffb640 1 -- 172.21.15.178:0/3197533406 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc0148d0 con 0x56276a0a6d90 2024-09-21T09:03:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.143+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3197533406 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56276a0aa660 con 0x56276a0a6d90 2024-09-21T09:03:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.144+0000 7fc5c9ffb640 1 -- 172.21.15.178:0/3197533406 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc6dc011040 con 0x56276a0a6d90 2024-09-21T09:03:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.144+0000 7fc5c9ffb640 1 --2- 172.21.15.178:0/3197533406 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5bc036b90 0x7fc5bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.144+0000 7fc5c9ffb640 1 -- 172.21.15.178:0/3197533406 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc6dc01e070 con 0x56276a0a6d90 2024-09-21T09:03:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.144+0000 7fc6e412c640 1 --2- 172.21.15.178:0/3197533406 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5bc036b90 0x7fc5bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.145+0000 7fc6e8a0f800 1 Processor -- start 2024-09-21T09:03:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.145+0000 7fc6e412c640 1 --2- 172.21.15.178:0/3197533406 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5bc036b90 0x7fc5bc039050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x56276a093a60 tx=0x7fc6d401b540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.145+0000 7fc6e8a0f800 1 -- start start 2024-09-21T09:03:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.145+0000 7fc6e8a0f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0b39c0 0x56276a0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.145+0000 7fc6e8a0f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56276a087540 con 0x56276a0b39c0 2024-09-21T09:03:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.145+0000 7fc6e492d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0b39c0 0x56276a0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.145+0000 7fc6e492d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0b39c0 0x56276a0b3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43702/0 (socket says 172.21.15.178:43702) 2024-09-21T09:03:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.145+0000 7fc6e492d640 1 -- 172.21.15.178:0/1962711526 learned_addr learned my addr 172.21.15.178:0/1962711526 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.145+0000 7fc6e492d640 1 -- 172.21.15.178:0/1962711526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56276a0b4300 con 0x56276a0b39c0 2024-09-21T09:03:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.146+0000 7fc6e492d640 1 --2- 172.21.15.178:0/1962711526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0b39c0 0x56276a0b3dc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc04cb40 tx=0x7fc6dc03bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995254b57327c5c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.146+0000 7fc5c37fe640 1 -- 172.21.15.178:0/1962711526 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc0168f0 con 0x56276a0b39c0 2024-09-21T09:03:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.146+0000 7fc5c37fe640 1 -- 172.21.15.178:0/1962711526 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6dc013cb0 con 0x56276a0b39c0 2024-09-21T09:03:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.146+0000 7fc5c37fe640 1 -- 172.21.15.178:0/1962711526 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc04e0d0 con 0x56276a0b39c0 2024-09-21T09:03:21.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.146+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1962711526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0b39c0 msgr2=0x56276a0b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.146+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/1962711526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0b39c0 0x56276a0b3dc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc04cb40 tx=0x7fc6dc03bf20 comp rx=0 tx=0).stop 2024-09-21T09:03:21.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.146+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1962711526 shutdown_connections 2024-09-21T09:03:21.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.146+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/1962711526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0b39c0 0x56276a0b3dc0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.146+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1962711526 >> 172.21.15.178:0/1962711526 conn(0x56276a0afd70 msgr2=0x56276a0ade70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.146+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1962711526 shutdown_connections 2024-09-21T09:03:21.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.146+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1962711526 wait complete. 2024-09-21T09:03:21.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.146+0000 7fc6e8a0f800 1 Processor -- start 2024-09-21T09:03:21.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.147+0000 7fc6e8a0f800 1 -- start start 2024-09-21T09:03:21.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.147+0000 7fc6e8a0f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0b39c0 0x56276a0bae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.147+0000 7fc6e8a0f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56276a0b49a0 con 0x56276a0b39c0 2024-09-21T09:03:21.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.147+0000 7fc6e492d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0b39c0 0x56276a0bae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.147+0000 7fc6e492d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0b39c0 0x56276a0bae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43718/0 (socket says 172.21.15.178:43718) 2024-09-21T09:03:21.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.147+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 learned_addr learned my addr 172.21.15.178:0/1385246155 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.147+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56276a0bb3c0 con 0x56276a0b39c0 2024-09-21T09:03:21.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.147+0000 7fc6e492d640 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0b39c0 0x56276a0bae80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc04ba60 tx=0x7fc6dc04cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.147+0000 7fc5c1ffb640 1 -- 172.21.15.178:0/1385246155 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc013e60 con 0x56276a0b39c0 2024-09-21T09:03:21.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.147+0000 7fc5c1ffb640 1 -- 172.21.15.178:0/1385246155 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6dc02ba60 con 0x56276a0b39c0 2024-09-21T09:03:21.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.147+0000 7fc5c1ffb640 1 -- 172.21.15.178:0/1385246155 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6dc02bd40 con 0x56276a0b39c0 2024-09-21T09:03:21.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.147+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56276a0bb650 con 0x56276a0b39c0 2024-09-21T09:03:21.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.148+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56276a0be300 con 0x56276a0b39c0 2024-09-21T09:03:21.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.148+0000 7fc5c1ffb640 1 -- 172.21.15.178:0/1385246155 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc6dc022a50 con 0x56276a0b39c0 2024-09-21T09:03:21.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.148+0000 7fc5c1ffb640 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5b4036b90 0x7fc5b4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.148+0000 7fc5c1ffb640 1 -- 172.21.15.178:0/1385246155 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc6dc00e040 con 0x56276a0b39c0 2024-09-21T09:03:21.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.149+0000 7fc6e412c640 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5b4036b90 0x7fc5b4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.149+0000 7fc6e412c640 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5b4036b90 0x7fc5b4039050 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400e960 tx=0x7fc6d4035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.149+0000 7fc6e8a0f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.149+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56276a0c6b70 0x56276a0c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.149+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0c9780 con 0x56276a0c6b70 2024-09-21T09:03:21.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.149+0000 7fc6db92b640 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56276a0c6b70 0x56276a0c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6db92b640 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56276a0c6b70 0x56276a0c9030 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6e8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6e8a0f800 20 realm 2024-09-21T09:03:21.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6e8a0f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0c9bb0 con 0x56276a0c6b70 2024-09-21T09:03:21.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6e8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6e8a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:21.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6e8a0f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0ca480 con 0x56276a0c6b70 2024-09-21T09:03:21.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6e8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6e8a0f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.150+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0ca820 con 0x56276a0c6b70 2024-09-21T09:03:21.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.151+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.151+0000 7fc6e8a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:21.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.151+0000 7fc6e8a0f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.151+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56276a0cb580 0x56276a0cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.151+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0cdf80 con 0x56276a0cb580 2024-09-21T09:03:21.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.151+0000 7fc6e492d640 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56276a0cb580 0x56276a0cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.151+0000 7fc6e492d640 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56276a0cb580 0x56276a0cd970 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.151+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.151+0000 7fc6e8a0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:21.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.151+0000 7fc6e8a0f800 20 searching for the correct realm 2024-09-21T09:03:21.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.151+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56276a0cff10 0x56276a0d23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.151+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d2aa0 con 0x56276a0cff10 2024-09-21T09:03:21.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.152+0000 7fc6e412c640 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56276a0cff10 0x56276a0d23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.152+0000 7fc6e412c640 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56276a0cff10 0x56276a0d23d0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.152+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.152+0000 7fc6e412c640 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc6d403d070 0x7fc6d401c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.152+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d2aa0 con 0x7fc6d403d070 2024-09-21T09:03:21.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.152+0000 7fc6db92b640 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc6d403d070 0x7fc6d401c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.152+0000 7fc6db92b640 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc6d403d070 0x7fc6d401c610 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.153+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.153+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d2aa0 con 0x56276a0cb580 2024-09-21T09:03:21.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.153+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.153+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d2aa0 con 0x56276a0c6b70 2024-09-21T09:03:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.153+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.153+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d2aa0 con 0x56276a0c6b70 2024-09-21T09:03:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.153+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.153+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d2aa0 con 0x56276a0cb580 2024-09-21T09:03:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.154+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.154+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d2aa0 con 0x56276a0cb580 2024-09-21T09:03:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.154+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.154+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d2aa0 con 0x7fc6d403d070 2024-09-21T09:03:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.154+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.154+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d2aa0 con 0x56276a0cff10 2024-09-21T09:03:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.154+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.154+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d2aa0 con 0x56276a0c6b70 2024-09-21T09:03:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.155+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.155+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d2aa0 con 0x56276a0cb580 2024-09-21T09:03:21.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.155+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.155+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d2aa0 con 0x56276a0c6b70 2024-09-21T09:03:21.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.155+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.155+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d2aa0 con 0x7fc6d403d070 2024-09-21T09:03:21.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.155+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.155+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d2aa0 con 0x56276a0cff10 2024-09-21T09:03:21.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.156+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.156+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0cff10 2024-09-21T09:03:21.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.156+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.156+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0cb580 2024-09-21T09:03:21.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.156+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.156+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0cff10 2024-09-21T09:03:21.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.157+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.157+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0cff10 2024-09-21T09:03:21.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.157+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.157+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0c6b70 2024-09-21T09:03:21.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.157+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.157+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0c6b70 2024-09-21T09:03:21.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.157+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.157+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0cb580 2024-09-21T09:03:21.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.157+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.157+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0cff10 2024-09-21T09:03:21.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.158+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.158+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x7fc6d403d070 2024-09-21T09:03:21.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.158+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.158+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0c6b70 2024-09-21T09:03:21.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.158+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.158+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0cb580 2024-09-21T09:03:21.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.158+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.158+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0cff10 2024-09-21T09:03:21.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.159+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.159+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0cb580 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.159+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.159+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x7fc6d403d070 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.159+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.159+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0cff10 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.159+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.159+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0cb580 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x56276a0c6b70 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc6d405c040 con 0x7fc6d403d070 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6e8a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6e8a0f800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6e8a0f800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:21.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6e8a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:21.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6e8a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:21.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6e8a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:21.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6e8a0f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0cf460 con 0x56276a0c6b70 2024-09-21T09:03:21.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6e8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6e8a0f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.160+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0cecd0 con 0x56276a0c6b70 2024-09-21T09:03:21.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:21.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0ce410 con 0x56276a0c6b70 2024-09-21T09:03:21.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.176 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 20 zone default found 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 4 Realm: () 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 20 zonegroup default 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d33d0 con 0x56276a0cb580 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d5600 con 0x56276a0cff10 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.161+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d59a0 con 0x56276a0cff10 2024-09-21T09:03:21.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.162+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.162+0000 7fc6e8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.162+0000 7fc6e8a0f800 20 started sync module instance, tier type = 2024-09-21T09:03:21.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.162+0000 7fc6e8a0f800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:21.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.162+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d4a90 con 0x7fc6d403d070 2024-09-21T09:03:21.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.163+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.163+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94727282970560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d4a90 con 0x7fc6d403d070 2024-09-21T09:03:21.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.163+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d6410 con 0x56276a0c6b70 2024-09-21T09:03:21.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.164+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94727282970560] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.164+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.164+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94727282974464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d4a90 con 0x56276a0c6b70 2024-09-21T09:03:21.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.164+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d6e90 con 0x56276a0cff10 2024-09-21T09:03:21.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.165+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94727282974464] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.165+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.165+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94727282968032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d4a00 con 0x56276a0cff10 2024-09-21T09:03:21.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.165+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d7d80 con 0x7fc6d403d070 2024-09-21T09:03:21.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.166+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94727282968032] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.166+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.167+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94727282981072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d81a0 con 0x7fc6d403d070 2024-09-21T09:03:21.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.167+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d8b60 con 0x56276a0c6b70 2024-09-21T09:03:21.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.168+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94727282981072] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.168+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.168+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94727282982608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d8b60 con 0x56276a0c6b70 2024-09-21T09:03:21.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.168+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d9520 con 0x56276a0cb580 2024-09-21T09:03:21.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.169+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94727282982608] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.169+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.169+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94727282984624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d8ad0 con 0x56276a0cb580 2024-09-21T09:03:21.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.169+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0da290 con 0x56276a0cb580 2024-09-21T09:03:21.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.170+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94727282984624] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.170+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.170+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94727282989248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0da290 con 0x56276a0cb580 2024-09-21T09:03:21.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.170+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0dace0 con 0x56276a0cb580 2024-09-21T09:03:21.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.171+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.171+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94727282993136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0db100 con 0x56276a0cb580 2024-09-21T09:03:21.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.171+0000 7fc6e8a0f800 20 add_watcher() i=0 2024-09-21T09:03:21.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.171+0000 7fc6e8a0f800 20 add_watcher() i=1 2024-09-21T09:03:21.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.171+0000 7fc6e8a0f800 20 add_watcher() i=2 2024-09-21T09:03:21.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.171+0000 7fc6e8a0f800 20 add_watcher() i=3 2024-09-21T09:03:21.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.171+0000 7fc6e8a0f800 20 add_watcher() i=4 2024-09-21T09:03:21.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.171+0000 7fc6e8a0f800 20 add_watcher() i=5 2024-09-21T09:03:21.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.171+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94727282989248] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.171+0000 7fc6e8a0f800 20 add_watcher() i=6 2024-09-21T09:03:21.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.172+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94727282993136] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.172+0000 7fc6e8a0f800 20 add_watcher() i=7 2024-09-21T09:03:21.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.172+0000 7fc6e8a0f800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:21.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.172+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d9ce0 con 0x56276a0c6b70 2024-09-21T09:03:21.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.172+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.172+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94727282994192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d9ce0 con 0x56276a0c6b70 2024-09-21T09:03:21.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.173+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94727282994192] v29'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.173+0000 7fc59a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:21.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.174+0000 7fc6e8a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:21.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.174+0000 7fc6e8a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:21.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.174+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e6c30 con 0x56276a0c6b70 2024-09-21T09:03:21.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.175+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.175+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e7300 con 0x56276a0cb580 2024-09-21T09:03:21.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.176+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.176+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e7300 con 0x56276a0cff10 2024-09-21T09:03:21.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.177+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.177+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e7da0 con 0x56276a0c6b70 2024-09-21T09:03:21.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.177+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'113 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.178+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e2930 con 0x7fc6d403d070 2024-09-21T09:03:21.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.179+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.179+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e2900 con 0x56276a0cff10 2024-09-21T09:03:21.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.179+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.180+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8730 con 0x56276a0c6b70 2024-09-21T09:03:21.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.181+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.181+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8730 con 0x56276a0cb580 2024-09-21T09:03:21.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.182+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.182+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e86f0 con 0x7fc6d403d070 2024-09-21T09:03:21.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.183+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.183+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cff10 2024-09-21T09:03:21.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.184+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.184+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x7fc6d403d070 2024-09-21T09:03:21.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.185+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.185+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cb580 2024-09-21T09:03:21.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.186+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.186+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x7fc6d403d070 2024-09-21T09:03:21.189 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.187+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.189 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.187+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cb580 2024-09-21T09:03:21.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.188+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.188+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0c6b70 2024-09-21T09:03:21.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.189+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'114 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.189+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cff10 2024-09-21T09:03:21.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.190+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.190+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x7fc6d403d070 2024-09-21T09:03:21.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.191+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.191+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cff10 2024-09-21T09:03:21.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.192+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.192+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0c6b70 2024-09-21T09:03:21.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.193+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.193+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0c6b70 2024-09-21T09:03:21.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.194+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'115 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.194+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cff10 2024-09-21T09:03:21.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.195+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.195+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x7fc6d403d070 2024-09-21T09:03:21.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.196+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.196+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cff10 2024-09-21T09:03:21.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.197+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.197+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cff10 2024-09-21T09:03:21.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.198+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.198+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cff10 2024-09-21T09:03:21.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.199+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.199+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cff10 2024-09-21T09:03:21.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.200+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.200+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cb580 2024-09-21T09:03:21.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.201+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.201+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cff10 2024-09-21T09:03:21.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.202+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.202+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cb580 2024-09-21T09:03:21.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.203+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.203+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cff10 2024-09-21T09:03:21.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.204+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.204+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x56276a0cb580 2024-09-21T09:03:21.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.206+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.206+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e8ba0 con 0x7fc6d403d070 2024-09-21T09:03:21.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.207+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.207+0000 7fc5997e2640 20 reqs_thread_entry: start 2024-09-21T09:03:21.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.207+0000 7fc6e8a0f800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:21.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.207+0000 7fc6e8a0f800 20 Filter name: none 2024-09-21T09:03:21.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.207+0000 7fc512ffd640 20 reqs_thread_entry: start 2024-09-21T09:03:21.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.207+0000 7fc6e8a0f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T09:03:21.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.207+0000 7fc6e8a0f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.207+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a113aa0 con 0x56276a0cb580 2024-09-21T09:03:21.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.208+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.208+0000 7fc6e8a0f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T09:03:21.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.208+0000 7fc6e8a0f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-21T09:03:21.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.208+0000 7fc6e8a0f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T09:03:21.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.208+0000 7fc6e8a0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:21.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.208+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56276a116470 con 0x56276a0cb580 2024-09-21T09:03:21.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.208+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.211 INFO:teuthology.orchestra.run.smithi178.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-21T09:03:21.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.209+0000 7fc59a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:21.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.209+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94727282994192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0e38a0 con 0x56276a0c6b70 2024-09-21T09:03:21.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.210+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94727282994192] v29'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.210+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94727282970560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0dac10 con 0x7fc6d403d070 2024-09-21T09:03:21.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.211+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94727282970560] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.211+0000 7fc6e8a0f800 20 remove_watcher() i=0 2024-09-21T09:03:21.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.211+0000 7fc6e8a0f800 2 removed watcher, disabling cache 2024-09-21T09:03:21.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.211+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94727282974464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0dac10 con 0x56276a0c6b70 2024-09-21T09:03:21.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.212+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94727282974464] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.212+0000 7fc6e8a0f800 20 remove_watcher() i=1 2024-09-21T09:03:21.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.212+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94727282968032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d5f00 con 0x56276a0cff10 2024-09-21T09:03:21.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.213+0000 7fc6e412c640 1 -- 172.21.15.178:0/1385246155 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94727282968032] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d4044d70 con 0x56276a0cff10 2024-09-21T09:03:21.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.213+0000 7fc6e8a0f800 20 remove_watcher() i=2 2024-09-21T09:03:21.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.213+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94727282981072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0dac10 con 0x7fc6d403d070 2024-09-21T09:03:21.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.214+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94727282981072] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x7fc6d403d070 2024-09-21T09:03:21.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.214+0000 7fc6e8a0f800 20 remove_watcher() i=3 2024-09-21T09:03:21.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.214+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94727282982608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d45e0 con 0x56276a0c6b70 2024-09-21T09:03:21.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.215+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94727282982608] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc051070 con 0x56276a0c6b70 2024-09-21T09:03:21.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.215+0000 7fc6e8a0f800 20 remove_watcher() i=4 2024-09-21T09:03:21.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.215+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94727282984624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d5f00 con 0x56276a0cb580 2024-09-21T09:03:21.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.217+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94727282984624] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.217+0000 7fc6e8a0f800 20 remove_watcher() i=5 2024-09-21T09:03:21.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.217+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94727282989248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0d78d0 con 0x56276a0cb580 2024-09-21T09:03:21.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.218+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94727282989248] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.218+0000 7fc6e8a0f800 20 remove_watcher() i=6 2024-09-21T09:03:21.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.218+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94727282993136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56276a0dac10 con 0x56276a0cb580 2024-09-21T09:03:21.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e492d640 1 -- 172.21.15.178:0/1385246155 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94727282993136] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6dc02a070 con 0x56276a0cb580 2024-09-21T09:03:21.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 20 remove_watcher() i=7 2024-09-21T09:03:21.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56276a0cb580 msgr2=0x56276a0cd970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56276a0cb580 0x56276a0cd970 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56276a0c6b70 msgr2=0x56276a0c9030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56276a0c6b70 0x56276a0c9030 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc6d403d070 msgr2=0x7fc6d401c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc6d403d070 0x7fc6d401c610 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56276a0cff10 msgr2=0x56276a0d23d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56276a0cff10 0x56276a0d23d0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5b4036b90 msgr2=0x7fc5b4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5b4036b90 0x7fc5b4039050 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400e960 tx=0x7fc6d4035000 comp rx=0 tx=0).stop 2024-09-21T09:03:21.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0b39c0 msgr2=0x56276a0bae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6db92b640 1 -- 172.21.15.178:0/1385246155 reap_dead start 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0b39c0 0x56276a0bae80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc04ba60 tx=0x7fc6dc04cad0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 shutdown_connections 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/1385246155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0b39c0 0x56276a0bae80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 >> 172.21.15.178:0/1385246155 conn(0x56276a0afd70 msgr2=0x56276a0ade40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 shutdown_connections 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/1385246155 wait complete. 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3197533406 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5bc036b90 msgr2=0x7fc5bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/3197533406 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5bc036b90 0x7fc5bc039050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x56276a093a60 tx=0x7fc6d401b540 comp rx=0 tx=0).stop 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3197533406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0a6d90 msgr2=0x56276a0a71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/3197533406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0a6d90 0x56276a0a71b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x56276a08d130 tx=0x7fc6dc0188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3197533406 shutdown_connections 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.219+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/3197533406 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5bc036b90 0x7fc5bc039050 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/3197533406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56276a0a6d90 0x56276a0a71b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3197533406 >> 172.21.15.178:0/3197533406 conn(0x56276a09bd20 msgr2=0x56276a09e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3197533406 shutdown_connections 2024-09-21T09:03:21.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3197533406 wait complete. 2024-09-21T09:03:21.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56276a095940 msgr2=0x56276a097d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56276a095940 0x56276a097d30 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562769f98900 msgr2=0x56276a0930f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562769f98900 0x56276a0930f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5cc036b40 msgr2=0x7fc5cc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5cc036b40 0x7fc5cc039000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc057000 tx=0x7fc6cc052000 comp rx=0 tx=0).stop 2024-09-21T09:03:21.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f944c0 msgr2=0x56276a08c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f944c0 0x56276a08c080 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x562769f08480 tx=0x7fc6d4000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 shutdown_connections 2024-09-21T09:03:21.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56276a095940 0x56276a097d30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562769f98900 0x56276a0930f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc5cc036b40 0x7fc5cc039000 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 --2- 172.21.15.178:0/3939122496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562769f944c0 0x56276a08c080 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 >> 172.21.15.178:0/3939122496 conn(0x562769f8fdf0 msgr2=0x56276a07d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 shutdown_connections 2024-09-21T09:03:21.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.220+0000 7fc6e8a0f800 1 -- 172.21.15.178:0/3939122496 wait complete. 2024-09-21T09:03:21.230 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-21T09:03:21.230 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-21T09:03:21.230 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-21T09:03:21.231 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-21T09:03:21.277 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:21.277 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:21.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.276+0000 7f629d898800 1 Processor -- start 2024-09-21T09:03:21.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.276+0000 7f629d898800 1 -- start start 2024-09-21T09:03:21.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.276+0000 7f629d898800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55cf745adb00 0x55cf745afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.276+0000 7f629d898800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cf74468b30 con 0x55cf745a7a60 2024-09-21T09:03:21.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.276+0000 7f629d898800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55cf7444a360 con 0x55cf745adb00 2024-09-21T09:03:21.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.277+0000 7f629ab8b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55cf745adb00 0x55cf745afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.277+0000 7f629b38c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55cf745a7a60 0x55cf745a7e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46826/0 (socket says 172.21.15.178:46826) 2024-09-21T09:03:21.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.277+0000 7f629ab8b640 1 --2- 172.21.15.178:0/2044267376 >> v2:172.21.15.44:3300/0 conn(0x55cf745adb00 0x55cf745afef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43734/0 (socket says 172.21.15.178:43734) 2024-09-21T09:03:21.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.277+0000 7f629b38c640 1 -- 172.21.15.178:0/2044267376 learned_addr learned my addr 172.21.15.178:0/2044267376 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:21.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.277+0000 7f629ab8b640 1 -- 172.21.15.178:0/2044267376 >> v1:172.21.15.44:6789/0 conn(0x55cf745a7a60 legacy=0x55cf745a7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.277+0000 7f629ab8b640 1 -- 172.21.15.178:0/2044267376 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf74470e00 con 0x55cf745adb00 2024-09-21T09:03:21.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.279+0000 7f629ab8b640 1 --2- 172.21.15.178:0/2044267376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745adb00 0x55cf745afef0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f629000a470 tx=0x7f6290045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff56a72126d3549 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.279+0000 7f629a38a640 1 -- 172.21.15.178:0/2044267376 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6290053570 con 0x55cf745adb00 2024-09-21T09:03:21.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.279+0000 7f629a38a640 1 -- 172.21.15.178:0/2044267376 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6290058070 con 0x55cf745adb00 2024-09-21T09:03:21.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.279+0000 7f629a38a640 1 -- 172.21.15.178:0/2044267376 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6290053880 con 0x55cf745adb00 2024-09-21T09:03:21.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.279+0000 7f629d898800 1 -- 172.21.15.178:0/2044267376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745adb00 msgr2=0x55cf745afef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.279+0000 7f629d898800 1 --2- 172.21.15.178:0/2044267376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745adb00 0x55cf745afef0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f629000a470 tx=0x7f6290045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:21.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.279+0000 7f629d898800 1 -- 172.21.15.178:0/2044267376 shutdown_connections 2024-09-21T09:03:21.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.279+0000 7f629d898800 1 --2- 172.21.15.178:0/2044267376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745adb00 0x55cf745afef0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.279+0000 7f629d898800 1 -- 172.21.15.178:0/2044267376 >> 172.21.15.178:0/2044267376 conn(0x55cf745a3550 msgr2=0x55cf745a5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.279+0000 7f629d898800 1 -- 172.21.15.178:0/2044267376 shutdown_connections 2024-09-21T09:03:21.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.279+0000 7f629d898800 1 -- 172.21.15.178:0/2044267376 wait complete. 2024-09-21T09:03:21.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.293+0000 7f629d898800 1 Processor -- start 2024-09-21T09:03:21.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.293+0000 7f629d898800 1 -- start start 2024-09-21T09:03:21.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.293+0000 7f629d898800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745a7a60 0x55cf745aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.293+0000 7f629d898800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cf744f5360 con 0x55cf745a7a60 2024-09-21T09:03:21.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.294+0000 7f629b38c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745a7a60 0x55cf745aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.294+0000 7f629b38c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745a7a60 0x55cf745aa420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43748/0 (socket says 172.21.15.178:43748) 2024-09-21T09:03:21.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.294+0000 7f629b38c640 1 -- 172.21.15.178:0/1635616324 learned_addr learned my addr 172.21.15.178:0/1635616324 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.294+0000 7f629b38c640 1 -- 172.21.15.178:0/1635616324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf74442bc0 con 0x55cf745a7a60 2024-09-21T09:03:21.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.294+0000 7f629b38c640 1 --2- 172.21.15.178:0/1635616324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745a7a60 0x55cf745aa420 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f628c001d80 tx=0x7f628c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64acd8240c9295eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.294+0000 7f618960a640 1 -- 172.21.15.178:0/1635616324 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f628c013030 con 0x55cf745a7a60 2024-09-21T09:03:21.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.294+0000 7f618960a640 1 -- 172.21.15.178:0/1635616324 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f628c00e470 con 0x55cf745a7a60 2024-09-21T09:03:21.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.294+0000 7f618960a640 1 -- 172.21.15.178:0/1635616324 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f628c00e810 con 0x55cf745a7a60 2024-09-21T09:03:21.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.295+0000 7f629d898800 1 -- 172.21.15.178:0/1635616324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745a7a60 msgr2=0x55cf745aa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.295+0000 7f629d898800 1 --2- 172.21.15.178:0/1635616324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745a7a60 0x55cf745aa420 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f628c001d80 tx=0x7f628c001e70 comp rx=0 tx=0).stop 2024-09-21T09:03:21.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.295+0000 7f629d898800 1 -- 172.21.15.178:0/1635616324 shutdown_connections 2024-09-21T09:03:21.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.295+0000 7f629d898800 1 --2- 172.21.15.178:0/1635616324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745a7a60 0x55cf745aa420 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.295+0000 7f629d898800 1 -- 172.21.15.178:0/1635616324 >> 172.21.15.178:0/1635616324 conn(0x55cf745a3550 msgr2=0x55cf746941e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.295+0000 7f629d898800 1 -- 172.21.15.178:0/1635616324 shutdown_connections 2024-09-21T09:03:21.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.295+0000 7f629d898800 1 -- 172.21.15.178:0/1635616324 wait complete. 2024-09-21T09:03:21.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.296+0000 7f629d898800 1 Processor -- start 2024-09-21T09:03:21.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.296+0000 7f629d898800 1 -- start start 2024-09-21T09:03:21.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.296+0000 7f629d898800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745a7a60 0x55cf746a2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.296+0000 7f629d898800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cf745b0730 con 0x55cf745a7a60 2024-09-21T09:03:21.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.296+0000 7f629b38c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745a7a60 0x55cf746a2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.296+0000 7f629b38c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745a7a60 0x55cf746a2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43752/0 (socket says 172.21.15.178:43752) 2024-09-21T09:03:21.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.296+0000 7f629b38c640 1 -- 172.21.15.178:0/2087923657 learned_addr learned my addr 172.21.15.178:0/2087923657 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.296+0000 7f629b38c640 1 -- 172.21.15.178:0/2087923657 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf74456fe0 con 0x55cf745a7a60 2024-09-21T09:03:21.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.296+0000 7f629b38c640 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745a7a60 0x55cf746a2440 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f628c004000 tx=0x7f628c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.297+0000 7f6187e07640 1 -- 172.21.15.178:0/2087923657 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f628c027070 con 0x55cf745a7a60 2024-09-21T09:03:21.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.297+0000 7f6187e07640 1 -- 172.21.15.178:0/2087923657 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f628c001400 con 0x55cf745a7a60 2024-09-21T09:03:21.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.297+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf746a2980 con 0x55cf745a7a60 2024-09-21T09:03:21.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.297+0000 7f6187e07640 1 -- 172.21.15.178:0/2087923657 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f628c019a70 con 0x55cf745a7a60 2024-09-21T09:03:21.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.297+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf746a2ea0 con 0x55cf745a7a60 2024-09-21T09:03:21.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.297+0000 7f6187e07640 1 -- 172.21.15.178:0/2087923657 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f628c02a070 con 0x55cf745a7a60 2024-09-21T09:03:21.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.298+0000 7f6187e07640 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6180036be0 0x7f61800390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.298+0000 7f6187e07640 1 -- 172.21.15.178:0/2087923657 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f628c01f070 con 0x55cf745a7a60 2024-09-21T09:03:21.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.298+0000 7f629ab8b640 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6180036be0 0x7f61800390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.298+0000 7f629d898800 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cf745adb00 0x55cf746a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.298+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746a9a30 con 0x55cf745adb00 2024-09-21T09:03:21.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.298+0000 7f629bb8d640 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cf745adb00 0x55cf746a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.298+0000 7f629ab8b640 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6180036be0 0x7f61800390a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6290057000 tx=0x7f6290052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.298+0000 7f629bb8d640 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cf745adb00 0x55cf746a94b0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.298+0000 7f629bb8d640 1 -- 172.21.15.178:0/2087923657 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x55cf745adb00 2024-09-21T09:03:21.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.298+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746a6a80 con 0x55cf745adb00 2024-09-21T09:03:21.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.299+0000 7f629bb8d640 1 -- 172.21.15.178:0/2087923657 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f629400a4a0 con 0x55cf745adb00 2024-09-21T09:03:21.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.299+0000 7f629d898800 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cf746abd30 0x55cf746ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.299+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ae810 con 0x55cf746abd30 2024-09-21T09:03:21.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.299+0000 7f629b38c640 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cf746abd30 0x55cf746ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.299+0000 7f629b38c640 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cf746abd30 0x55cf746ae120 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.300+0000 7f629b38c640 1 -- 172.21.15.178:0/2087923657 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f628c029030 con 0x55cf746abd30 2024-09-21T09:03:21.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.300+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746aabd0 con 0x55cf745adb00 2024-09-21T09:03:21.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.300+0000 7f629bb8d640 1 -- 172.21.15.178:0/2087923657 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f629400a4a0 con 0x55cf745adb00 2024-09-21T09:03:21.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.300+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ab0b0 con 0x55cf745adb00 2024-09-21T09:03:21.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.300+0000 7f629bb8d640 1 -- 172.21.15.178:0/2087923657 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f629400a4a0 con 0x55cf745adb00 2024-09-21T09:03:21.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.301+0000 7f629d898800 1 Processor -- start 2024-09-21T09:03:21.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.301+0000 7f629d898800 1 -- start start 2024-09-21T09:03:21.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.301+0000 7f629d898800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746bd190 0x55cf746bd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.301+0000 7f629d898800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cf74444580 con 0x55cf746bd190 2024-09-21T09:03:21.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.301+0000 7f629bb8d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746bd190 0x55cf746bd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.305 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.301+0000 7f629bb8d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746bd190 0x55cf746bd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43766/0 (socket says 172.21.15.178:43766) 2024-09-21T09:03:21.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.301+0000 7f629bb8d640 1 -- 172.21.15.178:0/21611905 learned_addr learned my addr 172.21.15.178:0/21611905 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.301+0000 7f629bb8d640 1 -- 172.21.15.178:0/21611905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf746bdaf0 con 0x55cf746bd190 2024-09-21T09:03:21.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.302+0000 7f629bb8d640 1 --2- 172.21.15.178:0/21611905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746bd190 0x55cf746bd5b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x55cf746a34f0 tx=0x7f6294018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.302+0000 7f6185602640 1 -- 172.21.15.178:0/21611905 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6294014450 con 0x55cf746bd190 2024-09-21T09:03:21.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.302+0000 7f6185602640 1 -- 172.21.15.178:0/21611905 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6294014610 con 0x55cf746bd190 2024-09-21T09:03:21.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.302+0000 7f629d898800 1 -- 172.21.15.178:0/21611905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf746bdd80 con 0x55cf746bd190 2024-09-21T09:03:21.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.302+0000 7f6185602640 1 -- 172.21.15.178:0/21611905 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6294014930 con 0x55cf746bd190 2024-09-21T09:03:21.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.302+0000 7f629d898800 1 -- 172.21.15.178:0/21611905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf746c0a60 con 0x55cf746bd190 2024-09-21T09:03:21.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.302+0000 7f6185602640 1 -- 172.21.15.178:0/21611905 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6294011040 con 0x55cf746bd190 2024-09-21T09:03:21.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.303+0000 7f6185602640 1 --2- 172.21.15.178:0/21611905 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6174036b90 0x7f6174039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.303+0000 7f6185602640 1 -- 172.21.15.178:0/21611905 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f629401e070 con 0x55cf746bd190 2024-09-21T09:03:21.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.303+0000 7f629b38c640 1 --2- 172.21.15.178:0/21611905 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6174036b90 0x7f6174039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.303+0000 7f629d898800 1 Processor -- start 2024-09-21T09:03:21.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.303+0000 7f629b38c640 1 --2- 172.21.15.178:0/21611905 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6174036b90 0x7f6174039050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55cf746a9e80 tx=0x7f628c04aca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.303+0000 7f629d898800 1 -- start start 2024-09-21T09:03:21.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.303+0000 7f629d898800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746c9dc0 0x55cf746ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.303+0000 7f629d898800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cf745a8af0 con 0x55cf746c9dc0 2024-09-21T09:03:21.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.303+0000 7f629bb8d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746c9dc0 0x55cf746ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.303+0000 7f629bb8d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746c9dc0 0x55cf746ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43772/0 (socket says 172.21.15.178:43772) 2024-09-21T09:03:21.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.303+0000 7f629bb8d640 1 -- 172.21.15.178:0/3999256523 learned_addr learned my addr 172.21.15.178:0/3999256523 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.304+0000 7f629bb8d640 1 -- 172.21.15.178:0/3999256523 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf746ca790 con 0x55cf746c9dc0 2024-09-21T09:03:21.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.304+0000 7f629bb8d640 1 --2- 172.21.15.178:0/3999256523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746c9dc0 0x55cf746ca1c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f629404cb90 tx=0x7f6294011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7f2f4cfdfa5c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.304+0000 7f617effd640 1 -- 172.21.15.178:0/3999256523 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6294044070 con 0x55cf746c9dc0 2024-09-21T09:03:21.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.304+0000 7f617effd640 1 -- 172.21.15.178:0/3999256523 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62940167c0 con 0x55cf746c9dc0 2024-09-21T09:03:21.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.304+0000 7f617effd640 1 -- 172.21.15.178:0/3999256523 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6294013ca0 con 0x55cf746c9dc0 2024-09-21T09:03:21.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.304+0000 7f629d898800 1 -- 172.21.15.178:0/3999256523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746c9dc0 msgr2=0x55cf746ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.304+0000 7f629d898800 1 --2- 172.21.15.178:0/3999256523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746c9dc0 0x55cf746ca1c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f629404cb90 tx=0x7f6294011700 comp rx=0 tx=0).stop 2024-09-21T09:03:21.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.304+0000 7f629d898800 1 -- 172.21.15.178:0/3999256523 shutdown_connections 2024-09-21T09:03:21.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.304+0000 7f629d898800 1 --2- 172.21.15.178:0/3999256523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746c9dc0 0x55cf746ca1c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.304+0000 7f629d898800 1 -- 172.21.15.178:0/3999256523 >> 172.21.15.178:0/3999256523 conn(0x55cf746c6170 msgr2=0x55cf746c4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.304+0000 7f629d898800 1 -- 172.21.15.178:0/3999256523 shutdown_connections 2024-09-21T09:03:21.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.304+0000 7f629d898800 1 -- 172.21.15.178:0/3999256523 wait complete. 2024-09-21T09:03:21.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.305+0000 7f629d898800 1 Processor -- start 2024-09-21T09:03:21.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.305+0000 7f629d898800 1 -- start start 2024-09-21T09:03:21.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.305+0000 7f629d898800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746c9dc0 0x55cf746d1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.305+0000 7f629d898800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cf746cad60 con 0x55cf746c9dc0 2024-09-21T09:03:21.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.305+0000 7f629bb8d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746c9dc0 0x55cf746d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.305+0000 7f629bb8d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746c9dc0 0x55cf746d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43782/0 (socket says 172.21.15.178:43782) 2024-09-21T09:03:21.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.305+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 learned_addr learned my addr 172.21.15.178:0/146826428 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.305+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf746d1740 con 0x55cf746c9dc0 2024-09-21T09:03:21.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.306+0000 7f629bb8d640 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746c9dc0 0x55cf746d1200 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f629404bab0 tx=0x7f629404cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.306+0000 7f617d7fa640 1 -- 172.21.15.178:0/146826428 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6294016440 con 0x55cf746c9dc0 2024-09-21T09:03:21.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.306+0000 7f617d7fa640 1 -- 172.21.15.178:0/146826428 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629404e2e0 con 0x55cf746c9dc0 2024-09-21T09:03:21.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.306+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf746d19d0 con 0x55cf746c9dc0 2024-09-21T09:03:21.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.306+0000 7f617d7fa640 1 -- 172.21.15.178:0/146826428 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6294022a50 con 0x55cf746c9dc0 2024-09-21T09:03:21.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.306+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf746d4680 con 0x55cf746c9dc0 2024-09-21T09:03:21.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.306+0000 7f617d7fa640 1 -- 172.21.15.178:0/146826428 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f629403e020 con 0x55cf746c9dc0 2024-09-21T09:03:21.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.307+0000 7f617d7fa640 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6164036b90 0x7f6164039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.307+0000 7f617d7fa640 1 -- 172.21.15.178:0/146826428 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f629403c020 con 0x55cf746c9dc0 2024-09-21T09:03:21.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.307+0000 7f629b38c640 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6164036b90 0x7f6164039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.307+0000 7f629b38c640 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6164036b90 0x7f6164039050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f628c02c030 tx=0x7f628c035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.307+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.307+0000 7f629d898800 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cf746dcf20 0x55cf746df3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.307+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746dfb30 con 0x55cf746dcf20 2024-09-21T09:03:21.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.307+0000 7f629ab8b640 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cf746dcf20 0x55cf746df3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.308+0000 7f629ab8b640 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cf746dcf20 0x55cf746df3e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.308+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.308+0000 7f629d898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.308+0000 7f629d898800 20 realm 2024-09-21T09:03:21.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.308+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.308+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746dff60 con 0x55cf746dcf20 2024-09-21T09:03:21.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.308+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.308+0000 7f629d898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.308+0000 7f629d898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:21.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.308+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.308+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e0830 con 0x55cf746dcf20 2024-09-21T09:03:21.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.308+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.308+0000 7f629d898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.308+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.309+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e0bd0 con 0x55cf746dcf20 2024-09-21T09:03:21.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.309+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.309+0000 7f629d898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:21.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.309+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.309+0000 7f629d898800 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cf746e1930 0x55cf746e3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.309+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e1930 2024-09-21T09:03:21.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.309+0000 7f629bb8d640 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cf746e1930 0x55cf746e3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.309+0000 7f629bb8d640 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cf746e1930 0x55cf746e3d20 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.310+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.310+0000 7f629d898800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:21.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.310+0000 7f629d898800 20 searching for the correct realm 2024-09-21T09:03:21.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.310+0000 7f629d898800 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cf746e6300 0x55cf746e87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.310+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e8e90 con 0x55cf746e6300 2024-09-21T09:03:21.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.310+0000 7f629b38c640 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cf746e6300 0x55cf746e87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.310+0000 7f629b38c640 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cf746e6300 0x55cf746e87c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.310+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628c029030 con 0x55cf746e6300 2024-09-21T09:03:21.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.310+0000 7f629b38c640 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f628c02c060 0x7f628c02b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.310+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e8e90 con 0x7f628c02c060 2024-09-21T09:03:21.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.310+0000 7f629ab8b640 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f628c02c060 0x7f628c02b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.311+0000 7f629ab8b640 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f628c02c060 0x7f628c02b3b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.311+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.311+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e8e90 con 0x55cf746e1930 2024-09-21T09:03:21.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.311+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.311+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746dcf20 2024-09-21T09:03:21.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.312+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.312+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746dcf20 2024-09-21T09:03:21.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.312+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.312+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e1930 2024-09-21T09:03:21.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.312+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.312+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e1930 2024-09-21T09:03:21.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.312+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.312+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x7f628c02c060 2024-09-21T09:03:21.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.313+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.313+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e6300 2024-09-21T09:03:21.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.313+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628c029030 con 0x55cf746e6300 2024-09-21T09:03:21.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.313+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746dcf20 2024-09-21T09:03:21.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.313+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.313+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e1930 2024-09-21T09:03:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.313+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.313+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746dcf20 2024-09-21T09:03:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.314+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.314+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x7f628c02c060 2024-09-21T09:03:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.314+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.314+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e6300 2024-09-21T09:03:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.314+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628c029030 con 0x55cf746e6300 2024-09-21T09:03:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.314+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e6300 2024-09-21T09:03:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.314+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628c029030 con 0x55cf746e6300 2024-09-21T09:03:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.314+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e1930 2024-09-21T09:03:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.315+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.315+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e6300 2024-09-21T09:03:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.315+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628c029030 con 0x55cf746e6300 2024-09-21T09:03:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.315+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e6300 2024-09-21T09:03:21.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.315+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628c029030 con 0x55cf746e6300 2024-09-21T09:03:21.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.315+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746dcf20 2024-09-21T09:03:21.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.315+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.315+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746dcf20 2024-09-21T09:03:21.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.315+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.315+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e1930 2024-09-21T09:03:21.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.316+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.316+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e6300 2024-09-21T09:03:21.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.316+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628c029030 con 0x55cf746e6300 2024-09-21T09:03:21.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.316+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x7f628c02c060 2024-09-21T09:03:21.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.316+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.316+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746dcf20 2024-09-21T09:03:21.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.316+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.316+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e1930 2024-09-21T09:03:21.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.317+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.317+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e6300 2024-09-21T09:03:21.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.317+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628c029030 con 0x55cf746e6300 2024-09-21T09:03:21.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.317+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e1930 2024-09-21T09:03:21.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.318+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.318+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x7f628c02c060 2024-09-21T09:03:21.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.318+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.318+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e6300 2024-09-21T09:03:21.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.318+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f628c029030 con 0x55cf746e6300 2024-09-21T09:03:21.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.318+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746e1930 2024-09-21T09:03:21.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.318+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.318+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x55cf746dcf20 2024-09-21T09:03:21.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4330 con 0x7f628c02c060 2024-09-21T09:03:21.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629d898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:21.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629d898800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:21.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629d898800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:21.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629d898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:21.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629d898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:21.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629d898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:21.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4bf0 con 0x55cf746dcf20 2024-09-21T09:03:21.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629d898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e4fe0 con 0x55cf746dcf20 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629d898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.319+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e5400 con 0x55cf746dcf20 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 20 zone default found 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 4 Realm: () 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 20 zonegroup default 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746e9310 con 0x55cf746e1930 2024-09-21T09:03:21.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746eb090 con 0x55cf746e6300 2024-09-21T09:03:21.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f628c029030 con 0x55cf746e6300 2024-09-21T09:03:21.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746eb4f0 con 0x55cf746e6300 2024-09-21T09:03:21.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f628c029030 con 0x55cf746e6300 2024-09-21T09:03:21.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 20 started sync module instance, tier type = 2024-09-21T09:03:21.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:21.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.320+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ea530 con 0x7f628c02c060 2024-09-21T09:03:21.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.321+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.321+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94349500000816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ea530 con 0x7f628c02c060 2024-09-21T09:03:21.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.321+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ebff0 con 0x55cf746dcf20 2024-09-21T09:03:21.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.322+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94349500000816] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.323+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.323+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94349500005056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ea530 con 0x55cf746dcf20 2024-09-21T09:03:21.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.323+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746eca80 con 0x55cf746e6300 2024-09-21T09:03:21.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.324+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94349500005056] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.324+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f628c029030 con 0x55cf746e6300 2024-09-21T09:03:21.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.324+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94349499998336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ea4a0 con 0x55cf746e6300 2024-09-21T09:03:21.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.324+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ed940 con 0x7f628c02c060 2024-09-21T09:03:21.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.325+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94349499998336] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f628c029030 con 0x55cf746e6300 2024-09-21T09:03:21.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.325+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.325+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94349500011664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ed8b0 con 0x7f628c02c060 2024-09-21T09:03:21.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.325+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ee700 con 0x55cf746dcf20 2024-09-21T09:03:21.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.326+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94349500011664] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.326+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.326+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94349500013728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ee700 con 0x55cf746dcf20 2024-09-21T09:03:21.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.326+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ef110 con 0x55cf746e1930 2024-09-21T09:03:21.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.327+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.327+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94349500017760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ef080 con 0x55cf746e1930 2024-09-21T09:03:21.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.327+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746f00c0 con 0x55cf746e1930 2024-09-21T09:03:21.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.327+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94349500013728] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.328+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94349500017760] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.328+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.328+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94349500014784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746efbd0 con 0x55cf746e1930 2024-09-21T09:03:21.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.328+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746f0960 con 0x55cf746e1930 2024-09-21T09:03:21.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.329+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.329+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94349500023984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746efbd0 con 0x55cf746e1930 2024-09-21T09:03:21.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.329+0000 7f629d898800 20 add_watcher() i=0 2024-09-21T09:03:21.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.329+0000 7f629d898800 20 add_watcher() i=1 2024-09-21T09:03:21.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.329+0000 7f629d898800 20 add_watcher() i=2 2024-09-21T09:03:21.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.329+0000 7f629d898800 20 add_watcher() i=3 2024-09-21T09:03:21.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.329+0000 7f629d898800 20 add_watcher() i=4 2024-09-21T09:03:21.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.329+0000 7f629d898800 20 add_watcher() i=5 2024-09-21T09:03:21.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.329+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94349500014784] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.329+0000 7f629d898800 20 add_watcher() i=6 2024-09-21T09:03:21.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.330+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94349500023984] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.330+0000 7f629d898800 20 add_watcher() i=7 2024-09-21T09:03:21.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.330+0000 7f629d898800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:21.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.330+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ef490 con 0x55cf746dcf20 2024-09-21T09:03:21.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.330+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.330+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94349500025040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf746ef490 con 0x55cf746dcf20 2024-09-21T09:03:21.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.331+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94349500025040] v29'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.331+0000 7f6151fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:21.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.332+0000 7f629d898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:21.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.332+0000 7f629d898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:21.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.332+0000 7f629d898800 5 note: GC not initialized 2024-09-21T09:03:21.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.332+0000 7f6150fe1640 20 reqs_thread_entry: start 2024-09-21T09:03:21.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.332+0000 7f629d898800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:21.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.332+0000 7f629d898800 20 Filter name: none 2024-09-21T09:03:21.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.332+0000 7f60ca7fc640 20 reqs_thread_entry: start 2024-09-21T09:03:21.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.332+0000 7f629d898800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T09:03:21.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.332+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.332+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf74726d90 con 0x55cf746e1930 2024-09-21T09:03:21.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629d898800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T09:03:21.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629d898800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-21T09:03:21.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629d898800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T09:03:21.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629d898800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:21.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629d898800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T09:03:21.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf74728e70 con 0x7f628c02c060 2024-09-21T09:03:21.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629d898800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:21.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629d898800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T09:03:21.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629d898800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:21.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629d898800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 : miss 2024-09-21T09:03:21.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.333+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf7472a8b0 con 0x55cf746e1930 2024-09-21T09:03:21.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.334+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(64 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.334+0000 7f629d898800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:21.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.334+0000 7f629d898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:21.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.334+0000 7f629d898800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:21.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.334+0000 7f629d898800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:21.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.334+0000 7f629d898800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:21.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.334+0000 7f629d898800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 2024-09-21T09:03:21.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.334+0000 7f629d898800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-21T09:03:21.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.334+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf7472da60 con 0x55cf746e1930 2024-09-21T09:03:21.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.335+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(65 fud.buckets [call] v29'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.335+0000 7f629d898800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-21T09:03:21.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.335+0000 7f629d898800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.335+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf7472cbd0 con 0x7f628c02c060 2024-09-21T09:03:21.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.335+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.335+0000 7f629d898800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:21.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.335+0000 7f629d898800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-21T09:03:21.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.335+0000 7f629d898800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:21.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.335+0000 7f629d898800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:21.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.335+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf7472da00 con 0x7f628c02c060 2024-09-21T09:03:21.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.336+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v29'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.336+0000 7f629d898800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-21T09:03:21.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.336+0000 7f629d898800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:21.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.336+0000 7f629d898800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T09:03:21.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.336+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94349500273872 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cf7472f300 con 0x55cf746e1930 2024-09-21T09:03:21.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.337+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== watch-notify(notify (1) cookie 94349500014784 notify 124554051590 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55cf74729df0 con 0x55cf746e1930 2024-09-21T09:03:21.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.337+0000 7f617effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051590 cookie 94349500014784 notifier 4518 bl.length()=338 2024-09-21T09:03:21.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.337+0000 7f617effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-21T09:03:21.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.337+0000 7f617effd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:21.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.337+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(68 notify.6 [notify cookie 94349500273872 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.337+0000 7f617effd640 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6160003ea0 con 0x55cf746e1930 2024-09-21T09:03:21.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.337+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.337+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== watch-notify(notify_complete (2) cookie 94349500273872 notify 124554051590 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cf746d19d0 con 0x55cf746e1930 2024-09-21T09:03:21.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.338+0000 7f6151fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:21.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.338+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94349500025040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf74724ae0 con 0x55cf746dcf20 2024-09-21T09:03:21.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.339+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94349500025040] v29'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.339+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94349500000816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf74724ae0 con 0x7f628c02c060 2024-09-21T09:03:21.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.340+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94349500000816] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.340+0000 7f629d898800 20 remove_watcher() i=0 2024-09-21T09:03:21.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.340+0000 7f629d898800 2 removed watcher, disabling cache 2024-09-21T09:03:21.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.340+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94349500005056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf74724ae0 con 0x55cf746dcf20 2024-09-21T09:03:21.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.341+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94349500005056] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.341+0000 7f629d898800 20 remove_watcher() i=1 2024-09-21T09:03:21.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.341+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94349499998336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf74724ae0 con 0x55cf746e6300 2024-09-21T09:03:21.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.342+0000 7f629b38c640 1 -- 172.21.15.178:0/146826428 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94349499998336] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f628c029030 con 0x55cf746e6300 2024-09-21T09:03:21.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.342+0000 7f629d898800 20 remove_watcher() i=2 2024-09-21T09:03:21.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.342+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94349500011664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf74724ae0 con 0x7f628c02c060 2024-09-21T09:03:21.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.343+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94349500011664] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6290051070 con 0x7f628c02c060 2024-09-21T09:03:21.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.343+0000 7f629d898800 20 remove_watcher() i=3 2024-09-21T09:03:21.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.343+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94349500013728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf74724ae0 con 0x55cf746dcf20 2024-09-21T09:03:21.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.344+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94349500013728] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6290051070 con 0x55cf746dcf20 2024-09-21T09:03:21.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.344+0000 7f629d898800 20 remove_watcher() i=4 2024-09-21T09:03:21.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.344+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94349500017760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf74724ae0 con 0x55cf746e1930 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.345+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94349500017760] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.345+0000 7f629d898800 20 remove_watcher() i=5 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.345+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94349500014784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf74724ae0 con 0x55cf746e1930 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.346+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94349500014784] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.346+0000 7f629d898800 20 remove_watcher() i=6 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.346+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94349500023984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cf74724ae0 con 0x55cf746e1930 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629bb8d640 1 -- 172.21.15.178:0/146826428 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94349500023984] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f629402a070 con 0x55cf746e1930 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629d898800 20 remove_watcher() i=7 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cf746e1930 msgr2=0x55cf746e3d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629d898800 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cf746e1930 0x55cf746e3d20 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cf746dcf20 msgr2=0x55cf746df3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629d898800 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cf746dcf20 0x55cf746df3e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f628c02c060 msgr2=0x7f628c02b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629d898800 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f628c02c060 0x7f628c02b3b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cf746e6300 msgr2=0x55cf746e87c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629d898800 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cf746e6300 0x55cf746e87c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6164036b90 msgr2=0x7f6164039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629d898800 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6164036b90 0x7f6164039050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f628c02c030 tx=0x7f628c035000 comp rx=0 tx=0).stop 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746c9dc0 msgr2=0x55cf746d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629ab8b640 1 -- 172.21.15.178:0/146826428 reap_dead start 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.347+0000 7f629d898800 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746c9dc0 0x55cf746d1200 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f629404bab0 tx=0x7f629404cb20 comp rx=0 tx=0).stop 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 shutdown_connections 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 --2- 172.21.15.178:0/146826428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746c9dc0 0x55cf746d1200 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 >> 172.21.15.178:0/146826428 conn(0x55cf746c6170 msgr2=0x55cf746c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 shutdown_connections 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/146826428 wait complete. 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/21611905 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6174036b90 msgr2=0x7f6174039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 --2- 172.21.15.178:0/21611905 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6174036b90 0x7f6174039050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55cf746a9e80 tx=0x7f628c04aca0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/21611905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746bd190 msgr2=0x55cf746bd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 --2- 172.21.15.178:0/21611905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746bd190 0x55cf746bd5b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x55cf746a34f0 tx=0x7f6294018830 comp rx=0 tx=0).stop 2024-09-21T09:03:21.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/21611905 shutdown_connections 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 --2- 172.21.15.178:0/21611905 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6174036b90 0x7f6174039050 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 --2- 172.21.15.178:0/21611905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf746bd190 0x55cf746bd5b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/21611905 >> 172.21.15.178:0/21611905 conn(0x55cf746b2120 msgr2=0x55cf746b4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/21611905 shutdown_connections 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/21611905 wait complete. 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cf746abd30 msgr2=0x55cf746ae120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cf746abd30 0x55cf746ae120 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cf745adb00 msgr2=0x55cf746a94b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cf745adb00 0x55cf746a94b0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6180036be0 msgr2=0x7f61800390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6180036be0 0x7f61800390a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6290057000 tx=0x7f6290052000 comp rx=0 tx=0).stop 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745a7a60 msgr2=0x55cf746a2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745a7a60 0x55cf746a2440 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f628c004000 tx=0x7f628c000bc0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 shutdown_connections 2024-09-21T09:03:21.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cf746abd30 0x55cf746ae120 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cf745adb00 0x55cf746a94b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6180036be0 0x7f61800390a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 --2- 172.21.15.178:0/2087923657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf745a7a60 0x55cf746a2440 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.348+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 >> 172.21.15.178:0/2087923657 conn(0x55cf745a3550 msgr2=0x55cf74693db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.349+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 shutdown_connections 2024-09-21T09:03:21.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.349+0000 7f629d898800 1 -- 172.21.15.178:0/2087923657 wait complete. 2024-09-21T09:03:21.359 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1'] 2024-09-21T09:03:21.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1'] 2024-09-21T09:03:21.359 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 2024-09-21T09:03:21.407 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:21.407 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:21.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.406+0000 7f5ff1d26800 1 Processor -- start 2024-09-21T09:03:21.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.406+0000 7f5ff1d26800 1 -- start start 2024-09-21T09:03:21.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.406+0000 7f5ff1d26800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55cde11f2610 0x55cde12836b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.406+0000 7f5ff1d26800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cde113db30 con 0x55cde1283bf0 2024-09-21T09:03:21.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.406+0000 7f5ff1d26800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55cde111f360 con 0x55cde11f2610 2024-09-21T09:03:21.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.407+0000 7f5fed9bf640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55cde11f2610 0x55cde12836b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.407+0000 7f5fe51be640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55cde1283bf0 0x55cde1285fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46836/0 (socket says 172.21.15.178:46836) 2024-09-21T09:03:21.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.407+0000 7f5fe51be640 1 -- 172.21.15.178:0/1710967434 learned_addr learned my addr 172.21.15.178:0/1710967434 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:21.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.407+0000 7f5fed9bf640 1 --2- 172.21.15.178:0/1710967434 >> v2:172.21.15.44:3300/0 conn(0x55cde11f2610 0x55cde12836b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43786/0 (socket says 172.21.15.178:43786) 2024-09-21T09:03:21.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.407+0000 7f5fed9bf640 1 -- 172.21.15.178:0/1710967434 >> v1:172.21.15.44:6789/0 conn(0x55cde1283bf0 legacy=0x55cde1285fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.407+0000 7f5fed9bf640 1 -- 172.21.15.178:0/1710967434 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cde1145e00 con 0x55cde11f2610 2024-09-21T09:03:21.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.407+0000 7f5fed1be640 1 -- 172.21.15.178:0/1710967434 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371652852 0 0) 0x55cde113db30 con 0x55cde1283bf0 2024-09-21T09:03:21.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.409+0000 7f5fed9bf640 1 --2- 172.21.15.178:0/1710967434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde12836b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000a470 tx=0x7f5fe0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23961f571b6f3bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.409+0000 7f5fed1be640 1 -- 172.21.15.178:0/1710967434 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe0053570 con 0x55cde11f2610 2024-09-21T09:03:21.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.409+0000 7f5fed1be640 1 -- 172.21.15.178:0/1710967434 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe0058070 con 0x55cde11f2610 2024-09-21T09:03:21.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.409+0000 7f5fed1be640 1 -- 172.21.15.178:0/1710967434 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe0053880 con 0x55cde11f2610 2024-09-21T09:03:21.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.409+0000 7f5ff1d26800 1 -- 172.21.15.178:0/1710967434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 msgr2=0x55cde12836b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.409+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/1710967434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde12836b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000a470 tx=0x7f5fe0045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:21.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.409+0000 7f5ff1d26800 1 -- 172.21.15.178:0/1710967434 shutdown_connections 2024-09-21T09:03:21.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.409+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/1710967434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde12836b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.409+0000 7f5ff1d26800 1 -- 172.21.15.178:0/1710967434 >> 172.21.15.178:0/1710967434 conn(0x55cde1278e00 msgr2=0x55cde127b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.409+0000 7f5ff1d26800 1 -- 172.21.15.178:0/1710967434 shutdown_connections 2024-09-21T09:03:21.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.409+0000 7f5ff1d26800 1 -- 172.21.15.178:0/1710967434 wait complete. 2024-09-21T09:03:21.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.423+0000 7f5ff1d26800 1 Processor -- start 2024-09-21T09:03:21.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.423+0000 7f5ff1d26800 1 -- start start 2024-09-21T09:03:21.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.423+0000 7f5ff1d26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde136f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.423+0000 7f5ff1d26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cde11ca350 con 0x55cde11f2610 2024-09-21T09:03:21.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.424+0000 7f5fed9bf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde136f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.424+0000 7f5fed9bf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde136f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43800/0 (socket says 172.21.15.178:43800) 2024-09-21T09:03:21.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.424+0000 7f5fed9bf640 1 -- 172.21.15.178:0/3255727515 learned_addr learned my addr 172.21.15.178:0/3255727515 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.424+0000 7f5fed9bf640 1 -- 172.21.15.178:0/3255727515 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cde1117bc0 con 0x55cde11f2610 2024-09-21T09:03:21.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.424+0000 7f5fed9bf640 1 --2- 172.21.15.178:0/3255727515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde136f920 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0045f50 tx=0x7f5fe0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a47f8250cc9585d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.424+0000 7f5edbe07640 1 -- 172.21.15.178:0/3255727515 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe0053c20 con 0x55cde11f2610 2024-09-21T09:03:21.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.424+0000 7f5edbe07640 1 -- 172.21.15.178:0/3255727515 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe0063030 con 0x55cde11f2610 2024-09-21T09:03:21.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.424+0000 7f5edbe07640 1 -- 172.21.15.178:0/3255727515 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe0053440 con 0x55cde11f2610 2024-09-21T09:03:21.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.425+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3255727515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 msgr2=0x55cde136f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.425+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/3255727515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde136f920 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0045f50 tx=0x7f5fe0051000 comp rx=0 tx=0).stop 2024-09-21T09:03:21.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.425+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3255727515 shutdown_connections 2024-09-21T09:03:21.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.425+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/3255727515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde136f920 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.425+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3255727515 >> 172.21.15.178:0/3255727515 conn(0x55cde1278e00 msgr2=0x55cde136b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.425+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3255727515 shutdown_connections 2024-09-21T09:03:21.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.425+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3255727515 wait complete. 2024-09-21T09:03:21.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.425+0000 7f5ff1d26800 1 Processor -- start 2024-09-21T09:03:21.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.425+0000 7f5ff1d26800 1 -- start start 2024-09-21T09:03:21.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.425+0000 7f5ff1d26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde13772b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.425+0000 7f5ff1d26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cde12879a0 con 0x55cde11f2610 2024-09-21T09:03:21.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.426+0000 7f5fed9bf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde13772b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.426+0000 7f5fed9bf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde13772b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43814/0 (socket says 172.21.15.178:43814) 2024-09-21T09:03:21.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.426+0000 7f5fed9bf640 1 -- 172.21.15.178:0/3471901333 learned_addr learned my addr 172.21.15.178:0/3471901333 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.426+0000 7f5fed9bf640 1 -- 172.21.15.178:0/3471901333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cde112bfe0 con 0x55cde11f2610 2024-09-21T09:03:21.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.426+0000 7f5fed9bf640 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde13772b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0045f20 tx=0x7f5fe0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.426+0000 7f5eda604640 1 -- 172.21.15.178:0/3471901333 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe0053570 con 0x55cde11f2610 2024-09-21T09:03:21.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.426+0000 7f5eda604640 1 -- 172.21.15.178:0/3471901333 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe0053710 con 0x55cde11f2610 2024-09-21T09:03:21.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.426+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cde13777f0 con 0x55cde11f2610 2024-09-21T09:03:21.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.426+0000 7f5eda604640 1 -- 172.21.15.178:0/3471901333 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe0068420 con 0x55cde11f2610 2024-09-21T09:03:21.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.426+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cde1377c90 con 0x55cde11f2610 2024-09-21T09:03:21.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.427+0000 7f5eda604640 1 -- 172.21.15.178:0/3471901333 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5fe00685c0 con 0x55cde11f2610 2024-09-21T09:03:21.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.427+0000 7f5eda604640 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5ed4036b90 0x7f5ed4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.427+0000 7f5eda604640 1 -- 172.21.15.178:0/3471901333 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f5fe0070070 con 0x55cde11f2610 2024-09-21T09:03:21.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.427+0000 7f5fe51be640 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5ed4036b90 0x7f5ed4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.427+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cde1283bf0 0x55cde137e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.427+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde137e860 con 0x55cde1283bf0 2024-09-21T09:03:21.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.428+0000 7f5fee1c0640 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cde1283bf0 0x55cde137e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.428+0000 7f5fe51be640 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5ed4036b90 0x7f5ed4039050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8000c00 tx=0x7f5fd80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.428+0000 7f5fee1c0640 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cde1283bf0 0x55cde137e320 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.428+0000 7f5fee1c0640 1 -- 172.21.15.178:0/3471901333 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe800a4a0 con 0x55cde1283bf0 2024-09-21T09:03:21.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.428+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde137b8b0 con 0x55cde1283bf0 2024-09-21T09:03:21.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.428+0000 7f5fee1c0640 1 -- 172.21.15.178:0/3471901333 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fe800a4a0 con 0x55cde1283bf0 2024-09-21T09:03:21.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.428+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cde1380b30 0x55cde1382f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.428+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13835f0 con 0x55cde1380b30 2024-09-21T09:03:21.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.429+0000 7f5fed9bf640 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cde1380b30 0x55cde1382f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.429+0000 7f5fed9bf640 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cde1380b30 0x55cde1382f20 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.429+0000 7f5fed9bf640 1 -- 172.21.15.178:0/3471901333 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde1380b30 2024-09-21T09:03:21.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.429+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde137f910 con 0x55cde1283bf0 2024-09-21T09:03:21.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.430+0000 7f5fee1c0640 1 -- 172.21.15.178:0/3471901333 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fe800a4a0 con 0x55cde1283bf0 2024-09-21T09:03:21.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.430+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde137fdf0 con 0x55cde1283bf0 2024-09-21T09:03:21.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.430+0000 7f5fee1c0640 1 -- 172.21.15.178:0/3471901333 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5fe800a4a0 con 0x55cde1283bf0 2024-09-21T09:03:21.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.430+0000 7f5ff1d26800 1 Processor -- start 2024-09-21T09:03:21.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.430+0000 7f5ff1d26800 1 -- start start 2024-09-21T09:03:21.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.430+0000 7f5ff1d26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde1391ed0 0x55cde13922f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.430+0000 7f5ff1d26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cde1119580 con 0x55cde1391ed0 2024-09-21T09:03:21.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.431+0000 7f5fee1c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde1391ed0 0x55cde13922f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.431+0000 7f5fee1c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde1391ed0 0x55cde13922f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43818/0 (socket says 172.21.15.178:43818) 2024-09-21T09:03:21.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.431+0000 7f5fee1c0640 1 -- 172.21.15.178:0/657103741 learned_addr learned my addr 172.21.15.178:0/657103741 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.431+0000 7f5fee1c0640 1 -- 172.21.15.178:0/657103741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cde1392830 con 0x55cde1391ed0 2024-09-21T09:03:21.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.431+0000 7f5fee1c0640 1 --2- 172.21.15.178:0/657103741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde1391ed0 0x55cde13922f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x55cde137ec00 tx=0x7f5fe8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.431+0000 7f5ed37fe640 1 -- 172.21.15.178:0/657103741 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe8014450 con 0x55cde1391ed0 2024-09-21T09:03:21.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.431+0000 7f5ed37fe640 1 -- 172.21.15.178:0/657103741 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe8014610 con 0x55cde1391ed0 2024-09-21T09:03:21.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.431+0000 7f5ed37fe640 1 -- 172.21.15.178:0/657103741 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe8014930 con 0x55cde1391ed0 2024-09-21T09:03:21.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.431+0000 7f5ff1d26800 1 -- 172.21.15.178:0/657103741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cde1392ac0 con 0x55cde1391ed0 2024-09-21T09:03:21.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.431+0000 7f5ff1d26800 1 -- 172.21.15.178:0/657103741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cde13957a0 con 0x55cde1391ed0 2024-09-21T09:03:21.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.432+0000 7f5ed37fe640 1 -- 172.21.15.178:0/657103741 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5fe8011040 con 0x55cde1391ed0 2024-09-21T09:03:21.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.432+0000 7f5ed37fe640 1 --2- 172.21.15.178:0/657103741 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5ec8036c00 0x7f5ec80390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.432+0000 7f5ed37fe640 1 -- 172.21.15.178:0/657103741 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f5fe801e070 con 0x55cde1391ed0 2024-09-21T09:03:21.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.432+0000 7f5fed9bf640 1 --2- 172.21.15.178:0/657103741 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5ec8036c00 0x7f5ec80390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.432+0000 7f5ff1d26800 1 Processor -- start 2024-09-21T09:03:21.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.432+0000 7f5ff1d26800 1 -- start start 2024-09-21T09:03:21.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.433+0000 7f5fed9bf640 1 --2- 172.21.15.178:0/657103741 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5ec8036c00 0x7f5ec80390c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55cde137ec60 tx=0x7f5fe008f070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.433+0000 7f5ff1d26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde139eae0 0x55cde139eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.433+0000 7f5ff1d26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cde1370070 con 0x55cde139eae0 2024-09-21T09:03:21.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.433+0000 7f5fee1c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde139eae0 0x55cde139eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.433+0000 7f5fee1c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde139eae0 0x55cde139eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43822/0 (socket says 172.21.15.178:43822) 2024-09-21T09:03:21.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.433+0000 7f5fee1c0640 1 -- 172.21.15.178:0/4275353090 learned_addr learned my addr 172.21.15.178:0/4275353090 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.433+0000 7f5fee1c0640 1 -- 172.21.15.178:0/4275353090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cde139f420 con 0x55cde139eae0 2024-09-21T09:03:21.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.433+0000 7f5fee1c0640 1 --2- 172.21.15.178:0/4275353090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde139eae0 0x55cde139eee0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5fe804cbc0 tx=0x7f5fe8011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2836d39d2e232eee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.433+0000 7f5ed17fa640 1 -- 172.21.15.178:0/4275353090 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe8040150 con 0x55cde139eae0 2024-09-21T09:03:21.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.433+0000 7f5ed17fa640 1 -- 172.21.15.178:0/4275353090 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe80167e0 con 0x55cde139eae0 2024-09-21T09:03:21.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.433+0000 7f5ed17fa640 1 -- 172.21.15.178:0/4275353090 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe8014ad0 con 0x55cde139eae0 2024-09-21T09:03:21.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.434+0000 7f5ff1d26800 1 -- 172.21.15.178:0/4275353090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde139eae0 msgr2=0x55cde139eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.434+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/4275353090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde139eae0 0x55cde139eee0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5fe804cbc0 tx=0x7f5fe8011b10 comp rx=0 tx=0).stop 2024-09-21T09:03:21.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.434+0000 7f5ff1d26800 1 -- 172.21.15.178:0/4275353090 shutdown_connections 2024-09-21T09:03:21.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.434+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/4275353090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde139eae0 0x55cde139eee0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.434+0000 7f5ff1d26800 1 -- 172.21.15.178:0/4275353090 >> 172.21.15.178:0/4275353090 conn(0x55cde139ae90 msgr2=0x55cde1398f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.434+0000 7f5ff1d26800 1 -- 172.21.15.178:0/4275353090 shutdown_connections 2024-09-21T09:03:21.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.434+0000 7f5ff1d26800 1 -- 172.21.15.178:0/4275353090 wait complete. 2024-09-21T09:03:21.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.434+0000 7f5ff1d26800 1 Processor -- start 2024-09-21T09:03:21.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.434+0000 7f5ff1d26800 1 -- start start 2024-09-21T09:03:21.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.434+0000 7f5ff1d26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde139eae0 0x55cde13a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.434+0000 7f5ff1d26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cde139fac0 con 0x55cde139eae0 2024-09-21T09:03:21.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.435+0000 7f5fee1c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde139eae0 0x55cde13a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.435+0000 7f5fee1c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde139eae0 0x55cde13a5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43830/0 (socket says 172.21.15.178:43830) 2024-09-21T09:03:21.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.435+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 learned_addr learned my addr 172.21.15.178:0/2098726617 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.435+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cde13a6500 con 0x55cde139eae0 2024-09-21T09:03:21.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.435+0000 7f5fee1c0640 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde139eae0 0x55cde13a5fc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8011fd0 tx=0x7f5fe804cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.435+0000 7f5ebf7fe640 1 -- 172.21.15.178:0/2098726617 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe8011510 con 0x55cde139eae0 2024-09-21T09:03:21.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.435+0000 7f5ebf7fe640 1 -- 172.21.15.178:0/2098726617 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe80116b0 con 0x55cde139eae0 2024-09-21T09:03:21.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.435+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cde13a6790 con 0x55cde139eae0 2024-09-21T09:03:21.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.435+0000 7f5ebf7fe640 1 -- 172.21.15.178:0/2098726617 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe804e0d0 con 0x55cde139eae0 2024-09-21T09:03:21.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.435+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cde13a9440 con 0x55cde139eae0 2024-09-21T09:03:21.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.436+0000 7f5ebf7fe640 1 -- 172.21.15.178:0/2098726617 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5fe804e270 con 0x55cde139eae0 2024-09-21T09:03:21.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.436+0000 7f5ebf7fe640 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5eb8036b90 0x7f5eb8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.436+0000 7f5ebf7fe640 1 -- 172.21.15.178:0/2098726617 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f5fe8046040 con 0x55cde139eae0 2024-09-21T09:03:21.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.437+0000 7f5fed9bf640 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5eb8036b90 0x7f5eb8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.437+0000 7f5fed9bf640 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5eb8036b90 0x7f5eb8039050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000a330 tx=0x7f5fe0068ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.437+0000 7f5ff1d26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.437+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cde13b1c10 0x55cde13b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.437+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13b4820 con 0x55cde13b1c10 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.437+0000 7f5fe51be640 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cde13b1c10 0x55cde13b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5fe51be640 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cde13b1c10 0x55cde13b40d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fd800f5f0 con 0x55cde13b1c10 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5ff1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5ff1d26800 20 realm 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5ff1d26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13b1060 con 0x55cde13b1c10 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fd800f5f0 con 0x55cde13b1c10 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5ff1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5ff1d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5ff1d26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13b5310 con 0x55cde13b1c10 2024-09-21T09:03:21.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fd800f5f0 con 0x55cde13b1c10 2024-09-21T09:03:21.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5ff1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5ff1d26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13b5be0 con 0x55cde13b1c10 2024-09-21T09:03:21.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fd800f5f0 con 0x55cde13b1c10 2024-09-21T09:03:21.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.438+0000 7f5ff1d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:21.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.439+0000 7f5ff1d26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.439+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cde13b6600 0x55cde13b89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.439+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13b9160 con 0x55cde13b6600 2024-09-21T09:03:21.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.439+0000 7f5fee1c0640 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cde13b6600 0x55cde13b89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.439+0000 7f5fee1c0640 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cde13b6600 0x55cde13b89f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.439+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.439+0000 7f5ff1d26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:21.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.439+0000 7f5ff1d26800 20 searching for the correct realm 2024-09-21T09:03:21.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.439+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cde13bb110 0x55cde13bd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.439+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13bb110 2024-09-21T09:03:21.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.440+0000 7f5fed9bf640 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cde13bb110 0x55cde13bd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.440+0000 7f5fed9bf640 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cde13bb110 0x55cde13bd5d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.440+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde13bb110 2024-09-21T09:03:21.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.440+0000 7f5fed9bf640 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5fe00a8040 0x7f5fe0090930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.440+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x7f5fe00a8040 2024-09-21T09:03:21.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.440+0000 7f5fe51be640 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5fe00a8040 0x7f5fe0090930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.441+0000 7f5fe51be640 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5fe00a8040 0x7f5fe0090930 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.441+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd800f5f0 con 0x7f5fe00a8040 2024-09-21T09:03:21.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.441+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b6600 2024-09-21T09:03:21.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.441+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.441+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b1c10 2024-09-21T09:03:21.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.441+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd800f5f0 con 0x55cde13b1c10 2024-09-21T09:03:21.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.441+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b1c10 2024-09-21T09:03:21.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.442+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.442+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b6600 2024-09-21T09:03:21.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.442+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.442+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b6600 2024-09-21T09:03:21.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.442+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.442+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x7f5fe00a8040 2024-09-21T09:03:21.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.442+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd802b040 con 0x7f5fe00a8040 2024-09-21T09:03:21.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.442+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13bb110 2024-09-21T09:03:21.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.442+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde13bb110 2024-09-21T09:03:21.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.442+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b1c10 2024-09-21T09:03:21.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.443+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.443+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b6600 2024-09-21T09:03:21.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.443+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.443+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b1c10 2024-09-21T09:03:21.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.443+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.443+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x7f5fe00a8040 2024-09-21T09:03:21.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.443+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5fd802b040 con 0x7f5fe00a8040 2024-09-21T09:03:21.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.443+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13bb110 2024-09-21T09:03:21.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.444+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde13bb110 2024-09-21T09:03:21.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.444+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13bb110 2024-09-21T09:03:21.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.444+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde13bb110 2024-09-21T09:03:21.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.444+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b6600 2024-09-21T09:03:21.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.444+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.444+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13bb110 2024-09-21T09:03:21.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.444+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde13bb110 2024-09-21T09:03:21.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.444+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13bb110 2024-09-21T09:03:21.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.445+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde13bb110 2024-09-21T09:03:21.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.445+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b1c10 2024-09-21T09:03:21.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.445+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.445+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b1c10 2024-09-21T09:03:21.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.445+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.445+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b6600 2024-09-21T09:03:21.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.445+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.445+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13bb110 2024-09-21T09:03:21.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.446+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde13bb110 2024-09-21T09:03:21.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.446+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x7f5fe00a8040 2024-09-21T09:03:21.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.446+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd802b040 con 0x7f5fe00a8040 2024-09-21T09:03:21.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.446+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b1c10 2024-09-21T09:03:21.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.446+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.446+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b6600 2024-09-21T09:03:21.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.446+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.446+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13bb110 2024-09-21T09:03:21.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.447+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde13bb110 2024-09-21T09:03:21.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.447+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b6600 2024-09-21T09:03:21.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.447+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.447+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x7f5fe00a8040 2024-09-21T09:03:21.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.447+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd802b040 con 0x7f5fe00a8040 2024-09-21T09:03:21.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.447+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13bb110 2024-09-21T09:03:21.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.447+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde13bb110 2024-09-21T09:03:21.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.447+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b6600 2024-09-21T09:03:21.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x55cde13b1c10 2024-09-21T09:03:21.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bdca0 con 0x7f5fe00a8040 2024-09-21T09:03:21.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd802b040 con 0x7f5fe00a8040 2024-09-21T09:03:21.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5ff1d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:21.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5ff1d26800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:21.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5ff1d26800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:21.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5ff1d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:21.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5ff1d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:21.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5ff1d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:21.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5ff1d26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13b9b20 con 0x55cde13b1c10 2024-09-21T09:03:21.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5ff1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5ff1d26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.448+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13b9730 con 0x55cde13b1c10 2024-09-21T09:03:21.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:21.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13ba450 con 0x55cde13b1c10 2024-09-21T09:03:21.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:21.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 20 zone default found 2024-09-21T09:03:21.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 4 Realm: () 2024-09-21T09:03:21.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:21.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 20 zonegroup default 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13be120 con 0x55cde13b6600 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c03d0 con 0x55cde13bb110 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde13bb110 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.449+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c0770 con 0x55cde13bb110 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.450+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde13bb110 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.450+0000 7f5ff1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.450+0000 7f5ff1d26800 20 started sync module instance, tier type = 2024-09-21T09:03:21.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.450+0000 7f5ff1d26800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:21.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.450+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bf810 con 0x7f5fe00a8040 2024-09-21T09:03:21.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.451+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x7f5fe00a8040 2024-09-21T09:03:21.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.451+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94342735461648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bf810 con 0x7f5fe00a8040 2024-09-21T09:03:21.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.451+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c1130 con 0x55cde13b1c10 2024-09-21T09:03:21.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.452+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94342735461648] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x7f5fe00a8040 2024-09-21T09:03:21.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.452+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.452+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94342735466080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bf810 con 0x55cde13b1c10 2024-09-21T09:03:21.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.452+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c1bd0 con 0x55cde13bb110 2024-09-21T09:03:21.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.453+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94342735466080] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.453+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde13bb110 2024-09-21T09:03:21.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.453+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94342735459168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13bf780 con 0x55cde13bb110 2024-09-21T09:03:21.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.453+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c2a90 con 0x7f5fe00a8040 2024-09-21T09:03:21.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.454+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94342735459168] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde13bb110 2024-09-21T09:03:21.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.454+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x7f5fe00a8040 2024-09-21T09:03:21.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.454+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94342735472096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c2a00 con 0x7f5fe00a8040 2024-09-21T09:03:21.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.454+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c3950 con 0x55cde13b1c10 2024-09-21T09:03:21.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.455+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.455+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94342735475872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c3d70 con 0x55cde13b1c10 2024-09-21T09:03:21.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.455+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c47b0 con 0x55cde13b6600 2024-09-21T09:03:21.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.455+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94342735472096] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x7f5fe00a8040 2024-09-21T09:03:21.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.456+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.456+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94342735475872] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.456+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94342735479424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c4ba0 con 0x55cde13b6600 2024-09-21T09:03:21.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.456+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c38c0 con 0x55cde13b6600 2024-09-21T09:03:21.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.457+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94342735479424] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.457+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.457+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94342735476928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c50b0 con 0x55cde13b6600 2024-09-21T09:03:21.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.457+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c5ab0 con 0x55cde13b6600 2024-09-21T09:03:21.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.458+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.458+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94342735484352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c5ed0 con 0x55cde13b6600 2024-09-21T09:03:21.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.458+0000 7f5ff1d26800 20 add_watcher() i=0 2024-09-21T09:03:21.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.458+0000 7f5ff1d26800 20 add_watcher() i=1 2024-09-21T09:03:21.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.458+0000 7f5ff1d26800 20 add_watcher() i=2 2024-09-21T09:03:21.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.458+0000 7f5ff1d26800 20 add_watcher() i=3 2024-09-21T09:03:21.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.458+0000 7f5ff1d26800 20 add_watcher() i=4 2024-09-21T09:03:21.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.458+0000 7f5ff1d26800 20 add_watcher() i=5 2024-09-21T09:03:21.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.458+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94342735476928] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.458+0000 7f5ff1d26800 20 add_watcher() i=6 2024-09-21T09:03:21.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.459+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94342735484352] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.459+0000 7f5ff1d26800 20 add_watcher() i=7 2024-09-21T09:03:21.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.459+0000 7f5ff1d26800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:21.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.459+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c2e80 con 0x55cde13b1c10 2024-09-21T09:03:21.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.460+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.460+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94342735485408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13c2e80 con 0x55cde13b1c10 2024-09-21T09:03:21.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.460+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94342735485408] v29'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.461+0000 7f5e9f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:21.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.461+0000 7f5ff1d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.461+0000 7f5ff1d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.461+0000 7f5ff1d26800 5 note: GC not initialized 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.461+0000 7f5e9e7fc640 20 reqs_thread_entry: start 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.461+0000 7f5ff1d26800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.461+0000 7f5ff1d26800 20 Filter name: none 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.461+0000 7f5e0ffff640 20 reqs_thread_entry: start 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.461+0000 7f5ff1d26800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.461+0000 7f5ff1d26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.461+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13fc4e0 con 0x55cde13b1c10 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:21.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde13fc030 con 0x7f5fe00a8040 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5fd802b040 con 0x7f5fe00a8040 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 : miss 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde1400130 con 0x55cde13b6600 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(64 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:21.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:21.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 2024-09-21T09:03:21.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-21T09:03:21.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.462+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde14044e0 con 0x55cde13b6600 2024-09-21T09:03:21.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.463+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(65 fud.buckets [call] v29'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.463+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:66 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde140a400 con 0x55cde13b6600 2024-09-21T09:03:21.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.465+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(66 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v29'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.465+0000 7f5ff1d26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:21.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.465+0000 7f5ff1d26800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:21.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.465+0000 7f5ff1d26800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:21.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.465+0000 7f5ff1d26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1, ofs0, ns] 2024-09-21T09:03:21.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.465+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94342735723008 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde1404910 con 0x55cde13b6600 2024-09-21T09:03:21.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.465+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== watch-notify(notify (1) cookie 94342735479424 notify 124554051591 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55cde13ff670 con 0x55cde13b6600 2024-09-21T09:03:21.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.465+0000 7f5ed17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051591 cookie 94342735479424 notifier 4525 bl.length()=752 2024-09-21T09:03:21.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.465+0000 7f5ed17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:21.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.465+0000 7f5ed17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:21.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.465+0000 7f5ed17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:21.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.465+0000 7f5ed17fa640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f5eb0003ea0 con 0x55cde13b6600 2024-09-21T09:03:21.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.465+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(67 notify.5 [notify cookie 94342735723008 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.465+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.466+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== watch-notify(notify_complete (2) cookie 94342735723008 notify 124554051591 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cde13a6790 con 0x55cde13b6600 2024-09-21T09:03:21.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.466+0000 7f5ff1d26800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): orig_sources= new_sources= 2024-09-21T09:03:21.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.466+0000 7f5ff1d26800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): potential sources added=[] removed=[] 2024-09-21T09:03:21.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.466+0000 7f5ff1d26800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): orig_dests= new_dests= 2024-09-21T09:03:21.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.466+0000 7f5ff1d26800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): potential dests added=[] removed=[] 2024-09-21T09:03:21.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.466+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13ffa00 con 0x7f5fe00a8040 2024-09-21T09:03:21.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.467+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(69 foo.buckets [call] v29'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x7f5fe00a8040 2024-09-21T09:03:21.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.467+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13ffa00 con 0x7f5fe00a8040 2024-09-21T09:03:21.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.468+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v29'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x7f5fe00a8040 2024-09-21T09:03:21.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.468+0000 7f5ff1d26800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-21T09:03:21.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.468+0000 7f5ff1d26800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:21.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.468+0000 7f5ff1d26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T09:03:21.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.468+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94342735723008 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cde14090b0 con 0x55cde13b6600 2024-09-21T09:03:21.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.468+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== watch-notify(notify (1) cookie 94342735476928 notify 124554051592 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55cde13a6500 con 0x55cde13b6600 2024-09-21T09:03:21.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.468+0000 7f5ed0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051592 cookie 94342735476928 notifier 4525 bl.length()=314 2024-09-21T09:03:21.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.468+0000 7f5ed0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-21T09:03:21.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.468+0000 7f5ed0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:21.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.468+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(71 notify.6 [notify cookie 94342735723008 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.468+0000 7f5ed0ff9640 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f5e18003400 con 0x55cde13b6600 2024-09-21T09:03:21.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.468+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.468+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== watch-notify(notify_complete (2) cookie 94342735723008 notify 124554051592 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cde139f420 con 0x55cde13b6600 2024-09-21T09:03:21.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.469+0000 7f5e9f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:21.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.469+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94342735485408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13fa230 con 0x55cde13b1c10 2024-09-21T09:03:21.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.470+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94342735485408] v29'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.470+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94342735461648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13fa230 con 0x7f5fe00a8040 2024-09-21T09:03:21.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.471+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94342735461648] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x7f5fe00a8040 2024-09-21T09:03:21.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.471+0000 7f5ff1d26800 20 remove_watcher() i=0 2024-09-21T09:03:21.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.471+0000 7f5ff1d26800 2 removed watcher, disabling cache 2024-09-21T09:03:21.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.471+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94342735466080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13fa230 con 0x55cde13b1c10 2024-09-21T09:03:21.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.472+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94342735466080] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.472+0000 7f5ff1d26800 20 remove_watcher() i=1 2024-09-21T09:03:21.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.472+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94342735459168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13fa230 con 0x55cde13bb110 2024-09-21T09:03:21.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.473+0000 7f5fed9bf640 1 -- 172.21.15.178:0/2098726617 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94342735459168] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x55cde13bb110 2024-09-21T09:03:21.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.473+0000 7f5ff1d26800 20 remove_watcher() i=2 2024-09-21T09:03:21.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.473+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94342735472096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13fa230 con 0x7f5fe00a8040 2024-09-21T09:03:21.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.474+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94342735472096] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x7f5fe00a8040 2024-09-21T09:03:21.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.474+0000 7f5ff1d26800 20 remove_watcher() i=3 2024-09-21T09:03:21.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.474+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94342735475872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13fa230 con 0x55cde13b1c10 2024-09-21T09:03:21.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.475+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94342735475872] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd802b040 con 0x55cde13b1c10 2024-09-21T09:03:21.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.475+0000 7f5ff1d26800 20 remove_watcher() i=4 2024-09-21T09:03:21.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.475+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94342735479424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13fa230 con 0x55cde13b6600 2024-09-21T09:03:21.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.476+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94342735479424] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.476+0000 7f5ff1d26800 20 remove_watcher() i=5 2024-09-21T09:03:21.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.476+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94342735476928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13fa230 con 0x55cde13b6600 2024-09-21T09:03:21.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.477+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94342735476928] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.477+0000 7f5ff1d26800 20 remove_watcher() i=6 2024-09-21T09:03:21.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.477+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94342735484352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cde13fa230 con 0x55cde13b6600 2024-09-21T09:03:21.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5fee1c0640 1 -- 172.21.15.178:0/2098726617 <== osd.0 v2:172.21.15.44:6800/2732047064 31 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94342735484352] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe802a070 con 0x55cde13b6600 2024-09-21T09:03:21.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5ff1d26800 20 remove_watcher() i=7 2024-09-21T09:03:21.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cde13b6600 msgr2=0x55cde13b89f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cde13b6600 0x55cde13b89f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cde13b1c10 msgr2=0x55cde13b40d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cde13b1c10 0x55cde13b40d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5fe00a8040 msgr2=0x7f5fe0090930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5fe00a8040 0x7f5fe0090930 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cde13bb110 msgr2=0x55cde13bd5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cde13bb110 0x55cde13bd5d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5eb8036b90 msgr2=0x7f5eb8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5eb8036b90 0x7f5eb8039050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000a330 tx=0x7f5fe0068ad0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde139eae0 msgr2=0x55cde13a5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5fe51be640 1 -- 172.21.15.178:0/2098726617 reap_dead start 2024-09-21T09:03:21.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.478+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde139eae0 0x55cde13a5fc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8011fd0 tx=0x7f5fe804cb50 comp rx=0 tx=0).stop 2024-09-21T09:03:21.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 shutdown_connections 2024-09-21T09:03:21.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/2098726617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde139eae0 0x55cde13a5fc0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 >> 172.21.15.178:0/2098726617 conn(0x55cde139ae90 msgr2=0x55cde1398f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 shutdown_connections 2024-09-21T09:03:21.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/2098726617 wait complete. 2024-09-21T09:03:21.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/657103741 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5ec8036c00 msgr2=0x7f5ec80390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/657103741 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5ec8036c00 0x7f5ec80390c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55cde137ec60 tx=0x7f5fe008f070 comp rx=0 tx=0).stop 2024-09-21T09:03:21.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/657103741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde1391ed0 msgr2=0x55cde13922f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/657103741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde1391ed0 0x55cde13922f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x55cde137ec00 tx=0x7f5fe8018830 comp rx=0 tx=0).stop 2024-09-21T09:03:21.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/657103741 shutdown_connections 2024-09-21T09:03:21.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/657103741 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5ec8036c00 0x7f5ec80390c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/657103741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde1391ed0 0x55cde13922f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/657103741 >> 172.21.15.178:0/657103741 conn(0x55cde1386e60 msgr2=0x55cde13899e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/657103741 shutdown_connections 2024-09-21T09:03:21.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/657103741 wait complete. 2024-09-21T09:03:21.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cde1380b30 msgr2=0x55cde1382f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cde1380b30 0x55cde1382f20 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cde1283bf0 msgr2=0x55cde137e320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cde1283bf0 0x55cde137e320 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5ed4036b90 msgr2=0x7f5ed4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5ed4036b90 0x7f5ed4039050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8000c00 tx=0x7f5fd80013b0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 msgr2=0x55cde13772b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde13772b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0045f20 tx=0x7f5fe0002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 shutdown_connections 2024-09-21T09:03:21.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cde1380b30 0x55cde1382f20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cde1283bf0 0x55cde137e320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5ed4036b90 0x7f5ed4039050 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 --2- 172.21.15.178:0/3471901333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cde11f2610 0x55cde13772b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.479+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 >> 172.21.15.178:0/3471901333 conn(0x55cde1278e00 msgr2=0x55cde1369b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.480+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 shutdown_connections 2024-09-21T09:03:21.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.480+0000 7f5ff1d26800 1 -- 172.21.15.178:0/3471901333 wait complete. 2024-09-21T09:03:21.490 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-21T09:03:21.490 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-21T09:03:21.490 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-21T09:03:21.534 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:21.534 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:21.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.533+0000 7f7143cb9800 1 Processor -- start 2024-09-21T09:03:21.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.533+0000 7f7143cb9800 1 -- start start 2024-09-21T09:03:21.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.533+0000 7f7143cb9800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55fb38ee3d90 0x55fb38ee6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.533+0000 7f7143cb9800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fb38d9cb30 con 0x55fb38e51610 2024-09-21T09:03:21.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.533+0000 7f7143cb9800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55fb38d7e360 con 0x55fb38ee3d90 2024-09-21T09:03:21.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.534+0000 7f7138fac640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55fb38ee3d90 0x55fb38ee6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.534+0000 7f7138fac640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55fb38ee3d90 0x55fb38ee6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43840/0 (socket says 172.21.15.178:43840) 2024-09-21T09:03:21.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.534+0000 7f71417ad640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55fb38e51610 0x55fb38ee2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46838/0 (socket says 172.21.15.178:46838) 2024-09-21T09:03:21.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.534+0000 7f7138fac640 1 -- 172.21.15.178:0/1362391091 learned_addr learned my addr 172.21.15.178:0/1362391091 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.534+0000 7f7138fac640 1 -- 172.21.15.178:0/1362391091 >> v1:172.21.15.44:6789/0 conn(0x55fb38e51610 legacy=0x55fb38ee2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.534+0000 7f7138fac640 1 -- 172.21.15.178:0/1362391091 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb38da4e00 con 0x55fb38ee3d90 2024-09-21T09:03:21.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.536+0000 7f7138fac640 1 --2- 172.21.15.178:0/1362391091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ee3d90 0x55fb38ee6180 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f712c00a520 tx=0x7f712c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6b016b64abdc1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.536+0000 7f7140fac640 1 -- 172.21.15.178:0/1362391091 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f712c055070 con 0x55fb38ee3d90 2024-09-21T09:03:21.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.536+0000 7f7140fac640 1 -- 172.21.15.178:0/1362391091 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f712c0515b0 con 0x55fb38ee3d90 2024-09-21T09:03:21.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.536+0000 7f7140fac640 1 -- 172.21.15.178:0/1362391091 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f712c0518d0 con 0x55fb38ee3d90 2024-09-21T09:03:21.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.536+0000 7f7143cb9800 1 -- 172.21.15.178:0/1362391091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ee3d90 msgr2=0x55fb38ee6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.536+0000 7f7143cb9800 1 --2- 172.21.15.178:0/1362391091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ee3d90 0x55fb38ee6180 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f712c00a520 tx=0x7f712c045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.536+0000 7f7143cb9800 1 -- 172.21.15.178:0/1362391091 shutdown_connections 2024-09-21T09:03:21.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.536+0000 7f7143cb9800 1 --2- 172.21.15.178:0/1362391091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ee3d90 0x55fb38ee6180 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.536+0000 7f7143cb9800 1 -- 172.21.15.178:0/1362391091 >> 172.21.15.178:0/1362391091 conn(0x55fb38ed7de0 msgr2=0x55fb38eda200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.537+0000 7f7143cb9800 1 -- 172.21.15.178:0/1362391091 shutdown_connections 2024-09-21T09:03:21.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.537+0000 7f7143cb9800 1 -- 172.21.15.178:0/1362391091 wait complete. 2024-09-21T09:03:21.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.550+0000 7f7143cb9800 1 Processor -- start 2024-09-21T09:03:21.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.550+0000 7f7143cb9800 1 -- start start 2024-09-21T09:03:21.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.550+0000 7f7143cb9800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38e51610 0x55fb38fcea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.550+0000 7f7143cb9800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fb38e29330 con 0x55fb38e51610 2024-09-21T09:03:21.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.551+0000 7f71417ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38e51610 0x55fb38fcea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.551+0000 7f71417ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38e51610 0x55fb38fcea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43848/0 (socket says 172.21.15.178:43848) 2024-09-21T09:03:21.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.551+0000 7f71417ad640 1 -- 172.21.15.178:0/2011371850 learned_addr learned my addr 172.21.15.178:0/2011371850 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.551+0000 7f71417ad640 1 -- 172.21.15.178:0/2011371850 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb38d76bc0 con 0x55fb38e51610 2024-09-21T09:03:21.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.551+0000 7f71417ad640 1 --2- 172.21.15.178:0/2011371850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38e51610 0x55fb38fcea90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7134001e40 tx=0x7f7134001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12944ad1415c80b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.551+0000 7f702f606640 1 -- 172.21.15.178:0/2011371850 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713400e5c0 con 0x55fb38e51610 2024-09-21T09:03:21.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.551+0000 7f702f606640 1 -- 172.21.15.178:0/2011371850 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7134006070 con 0x55fb38e51610 2024-09-21T09:03:21.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.551+0000 7f702f606640 1 -- 172.21.15.178:0/2011371850 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713400e910 con 0x55fb38e51610 2024-09-21T09:03:21.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.552+0000 7f7143cb9800 1 -- 172.21.15.178:0/2011371850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38e51610 msgr2=0x55fb38fcea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.552+0000 7f7143cb9800 1 --2- 172.21.15.178:0/2011371850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38e51610 0x55fb38fcea90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7134001e40 tx=0x7f7134001e70 comp rx=0 tx=0).stop 2024-09-21T09:03:21.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.552+0000 7f7143cb9800 1 -- 172.21.15.178:0/2011371850 shutdown_connections 2024-09-21T09:03:21.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.552+0000 7f7143cb9800 1 --2- 172.21.15.178:0/2011371850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38e51610 0x55fb38fcea90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.552+0000 7f7143cb9800 1 -- 172.21.15.178:0/2011371850 >> 172.21.15.178:0/2011371850 conn(0x55fb38ed7de0 msgr2=0x55fb38fca450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.552+0000 7f7143cb9800 1 -- 172.21.15.178:0/2011371850 shutdown_connections 2024-09-21T09:03:21.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.552+0000 7f7143cb9800 1 -- 172.21.15.178:0/2011371850 wait complete. 2024-09-21T09:03:21.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.552+0000 7f7143cb9800 1 Processor -- start 2024-09-21T09:03:21.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.552+0000 7f7143cb9800 1 -- start start 2024-09-21T09:03:21.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.552+0000 7f7143cb9800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38e51610 0x55fb38fd64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.552+0000 7f7143cb9800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fb38ee6990 con 0x55fb38e51610 2024-09-21T09:03:21.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.553+0000 7f71417ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38e51610 0x55fb38fd64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.553+0000 7f71417ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38e51610 0x55fb38fd64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43850/0 (socket says 172.21.15.178:43850) 2024-09-21T09:03:21.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.553+0000 7f71417ad640 1 -- 172.21.15.178:0/3138786798 learned_addr learned my addr 172.21.15.178:0/3138786798 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.553+0000 7f71417ad640 1 -- 172.21.15.178:0/3138786798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb38d8afe0 con 0x55fb38e51610 2024-09-21T09:03:21.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.553+0000 7f71417ad640 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38e51610 0x55fb38fd64c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7134000f60 tx=0x7f7134000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.553+0000 7f702de03640 1 -- 172.21.15.178:0/3138786798 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713400f8d0 con 0x55fb38e51610 2024-09-21T09:03:21.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.553+0000 7f702de03640 1 -- 172.21.15.178:0/3138786798 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713400fa70 con 0x55fb38e51610 2024-09-21T09:03:21.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.553+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb38fd6a00 con 0x55fb38e51610 2024-09-21T09:03:21.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.553+0000 7f702de03640 1 -- 172.21.15.178:0/3138786798 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713400fd90 con 0x55fb38e51610 2024-09-21T09:03:21.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.553+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb38fd6f20 con 0x55fb38e51610 2024-09-21T09:03:21.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.554+0000 7f702de03640 1 -- 172.21.15.178:0/3138786798 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7134017070 con 0x55fb38e51610 2024-09-21T09:03:21.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.554+0000 7f702de03640 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7028036af0 0x7f7028038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.554+0000 7f702de03640 1 -- 172.21.15.178:0/3138786798 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f7134015020 con 0x55fb38e51610 2024-09-21T09:03:21.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.554+0000 7f7138fac640 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7028036af0 0x7f7028038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.555+0000 7f7143cb9800 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fb38ee3d90 0x55fb38fdd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.555+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb38fddb00 con 0x55fb38ee3d90 2024-09-21T09:03:21.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.555+0000 7f7141fae640 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fb38ee3d90 0x55fb38fdd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.555+0000 7f7138fac640 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7028036af0 0x7f7028038fb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f712c057000 tx=0x7f712c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.555+0000 7f7141fae640 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fb38ee3d90 0x55fb38fdd530 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.555+0000 7f7141fae640 1 -- 172.21.15.178:0/3138786798 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f713c00a4a0 con 0x55fb38ee3d90 2024-09-21T09:03:21.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.555+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb38fdaae0 con 0x55fb38ee3d90 2024-09-21T09:03:21.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.556+0000 7f7141fae640 1 -- 172.21.15.178:0/3138786798 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f713c00a4a0 con 0x55fb38ee3d90 2024-09-21T09:03:21.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.556+0000 7f7143cb9800 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fb38fdfe10 0x55fb38fe2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.556+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb38fe28a0 con 0x55fb38fdfe10 2024-09-21T09:03:21.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.556+0000 7f71417ad640 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fb38fdfe10 0x55fb38fe2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.556+0000 7f71417ad640 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fb38fdfe10 0x55fb38fe2200 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.557+0000 7f71417ad640 1 -- 172.21.15.178:0/3138786798 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f713402e070 con 0x55fb38fdfe10 2024-09-21T09:03:21.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.557+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb38fdecb0 con 0x55fb38ee3d90 2024-09-21T09:03:21.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.557+0000 7f7141fae640 1 -- 172.21.15.178:0/3138786798 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f713c00a4a0 con 0x55fb38ee3d90 2024-09-21T09:03:21.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.557+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb38fdf190 con 0x55fb38ee3d90 2024-09-21T09:03:21.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.557+0000 7f7141fae640 1 -- 172.21.15.178:0/3138786798 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f713c00a4a0 con 0x55fb38ee3d90 2024-09-21T09:03:21.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.558+0000 7f7143cb9800 1 Processor -- start 2024-09-21T09:03:21.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.558+0000 7f7143cb9800 1 -- start start 2024-09-21T09:03:21.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.558+0000 7f7143cb9800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ff1260 0x55fb38ff1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.558+0000 7f7143cb9800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fb38d78580 con 0x55fb38ff1260 2024-09-21T09:03:21.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.558+0000 7f7141fae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ff1260 0x55fb38ff1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.558+0000 7f7141fae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ff1260 0x55fb38ff1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43852/0 (socket says 172.21.15.178:43852) 2024-09-21T09:03:21.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.558+0000 7f7141fae640 1 -- 172.21.15.178:0/581269587 learned_addr learned my addr 172.21.15.178:0/581269587 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.558+0000 7f7141fae640 1 -- 172.21.15.178:0/581269587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb38ff1bc0 con 0x55fb38ff1260 2024-09-21T09:03:21.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.558+0000 7f7141fae640 1 --2- 172.21.15.178:0/581269587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ff1260 0x55fb38ff1680 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x55fb38fddee0 tx=0x7f713c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.559+0000 7f7026ffd640 1 -- 172.21.15.178:0/581269587 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713c014450 con 0x55fb38ff1260 2024-09-21T09:03:21.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.559+0000 7f7026ffd640 1 -- 172.21.15.178:0/581269587 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713c014610 con 0x55fb38ff1260 2024-09-21T09:03:21.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.559+0000 7f7143cb9800 1 -- 172.21.15.178:0/581269587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb38ff1e50 con 0x55fb38ff1260 2024-09-21T09:03:21.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.559+0000 7f7026ffd640 1 -- 172.21.15.178:0/581269587 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713c014930 con 0x55fb38ff1260 2024-09-21T09:03:21.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.559+0000 7f7143cb9800 1 -- 172.21.15.178:0/581269587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb38ff4b30 con 0x55fb38ff1260 2024-09-21T09:03:21.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.559+0000 7f7026ffd640 1 -- 172.21.15.178:0/581269587 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f713c011040 con 0x55fb38ff1260 2024-09-21T09:03:21.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.560+0000 7f7026ffd640 1 --2- 172.21.15.178:0/581269587 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7018036b90 0x7f7018039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.560+0000 7f7026ffd640 1 -- 172.21.15.178:0/581269587 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f713c01e070 con 0x55fb38ff1260 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.560+0000 7f71417ad640 1 --2- 172.21.15.178:0/581269587 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7018036b90 0x7f7018039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.560+0000 7f7143cb9800 1 Processor -- start 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.560+0000 7f71417ad640 1 --2- 172.21.15.178:0/581269587 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7018036b90 0x7f7018039050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55fb38fddf50 tx=0x7f713404b760 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.560+0000 7f7143cb9800 1 -- start start 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.560+0000 7f7143cb9800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ffdec0 0x55fb38ffe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.560+0000 7f7143cb9800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fb38fcf240 con 0x55fb38ffdec0 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.560+0000 7f7141fae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ffdec0 0x55fb38ffe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.560+0000 7f7141fae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ffdec0 0x55fb38ffe2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43854/0 (socket says 172.21.15.178:43854) 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.560+0000 7f7141fae640 1 -- 172.21.15.178:0/2910484927 learned_addr learned my addr 172.21.15.178:0/2910484927 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.561+0000 7f7141fae640 1 -- 172.21.15.178:0/2910484927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb38ffe890 con 0x55fb38ffdec0 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.561+0000 7f7141fae640 1 --2- 172.21.15.178:0/2910484927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ffdec0 0x55fb38ffe2c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f713c04cb90 tx=0x7f713c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4da379ff18dbaf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.561+0000 7f7024ff9640 1 -- 172.21.15.178:0/2910484927 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713c044070 con 0x55fb38ffdec0 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.561+0000 7f7024ff9640 1 -- 172.21.15.178:0/2910484927 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713c013c90 con 0x55fb38ffdec0 2024-09-21T09:03:21.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.561+0000 7f7024ff9640 1 -- 172.21.15.178:0/2910484927 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713c014ad0 con 0x55fb38ffdec0 2024-09-21T09:03:21.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.561+0000 7f7143cb9800 1 -- 172.21.15.178:0/2910484927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ffdec0 msgr2=0x55fb38ffe2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.561+0000 7f7143cb9800 1 --2- 172.21.15.178:0/2910484927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ffdec0 0x55fb38ffe2c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f713c04cb90 tx=0x7f713c011700 comp rx=0 tx=0).stop 2024-09-21T09:03:21.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.561+0000 7f7143cb9800 1 -- 172.21.15.178:0/2910484927 shutdown_connections 2024-09-21T09:03:21.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.561+0000 7f7143cb9800 1 --2- 172.21.15.178:0/2910484927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ffdec0 0x55fb38ffe2c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.561+0000 7f7143cb9800 1 -- 172.21.15.178:0/2910484927 >> 172.21.15.178:0/2910484927 conn(0x55fb38ffa220 msgr2=0x55fb38ff8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.561+0000 7f7143cb9800 1 -- 172.21.15.178:0/2910484927 shutdown_connections 2024-09-21T09:03:21.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.561+0000 7f7143cb9800 1 -- 172.21.15.178:0/2910484927 wait complete. 2024-09-21T09:03:21.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.562+0000 7f7143cb9800 1 Processor -- start 2024-09-21T09:03:21.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.562+0000 7f7143cb9800 1 -- start start 2024-09-21T09:03:21.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.562+0000 7f7143cb9800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ffdec0 0x55fb39005300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.562+0000 7f7143cb9800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fb38ffee50 con 0x55fb38ffdec0 2024-09-21T09:03:21.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.562+0000 7f7141fae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ffdec0 0x55fb39005300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.562+0000 7f7141fae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ffdec0 0x55fb39005300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43864/0 (socket says 172.21.15.178:43864) 2024-09-21T09:03:21.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.562+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 learned_addr learned my addr 172.21.15.178:0/2119999035 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.562+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb39005840 con 0x55fb38ffdec0 2024-09-21T09:03:21.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.562+0000 7f7141fae640 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ffdec0 0x55fb39005300 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f713c0117d0 tx=0x7f713c04cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.563+0000 7f7016ffd640 1 -- 172.21.15.178:0/2119999035 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713c016440 con 0x55fb38ffdec0 2024-09-21T09:03:21.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.563+0000 7f7016ffd640 1 -- 172.21.15.178:0/2119999035 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713c013e40 con 0x55fb38ffdec0 2024-09-21T09:03:21.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.563+0000 7f7016ffd640 1 -- 172.21.15.178:0/2119999035 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713c02b480 con 0x55fb38ffdec0 2024-09-21T09:03:21.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.563+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb39005ad0 con 0x55fb38ffdec0 2024-09-21T09:03:21.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.563+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb39008780 con 0x55fb38ffdec0 2024-09-21T09:03:21.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.563+0000 7f7016ffd640 1 -- 172.21.15.178:0/2119999035 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f713c03e020 con 0x55fb38ffdec0 2024-09-21T09:03:21.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.564+0000 7f7016ffd640 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f700c036b90 0x7f700c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.564+0000 7f7016ffd640 1 -- 172.21.15.178:0/2119999035 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f713c03c020 con 0x55fb38ffdec0 2024-09-21T09:03:21.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.564+0000 7f71417ad640 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f700c036b90 0x7f700c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.564+0000 7f71417ad640 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f700c036b90 0x7f700c039050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7134024410 tx=0x7f713404d000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.564+0000 7f7143cb9800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.564+0000 7f7143cb9800 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fb39011020 0x55fb390134e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.564+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb39013c30 con 0x55fb39011020 2024-09-21T09:03:21.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.564+0000 7f7138fac640 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fb39011020 0x55fb390134e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7138fac640 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fb39011020 0x55fb390134e0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7143cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7143cb9800 20 realm 2024-09-21T09:03:21.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7143cb9800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb39014000 con 0x55fb39011020 2024-09-21T09:03:21.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7143cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7143cb9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:21.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7143cb9800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb390148a0 con 0x55fb39011020 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7143cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7143cb9800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.565+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb39014c40 con 0x55fb39011020 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.566+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.566+0000 7f7143cb9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.566+0000 7f7143cb9800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.566+0000 7f7143cb9800 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fb390159a0 0x55fb39017d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.566+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb390159a0 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.566+0000 7f7141fae640 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fb390159a0 0x55fb39017d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.566+0000 7f7141fae640 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fb390159a0 0x55fb39017d90 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.566+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.566+0000 7f7143cb9800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.566+0000 7f7143cb9800 20 searching for the correct realm 2024-09-21T09:03:21.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.566+0000 7f7143cb9800 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fb3901a360 0x55fb3901c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.566+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb3901cef0 con 0x55fb3901a360 2024-09-21T09:03:21.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.567+0000 7f71417ad640 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fb3901a360 0x55fb3901c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.567+0000 7f71417ad640 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fb3901a360 0x55fb3901c820 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.567+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.567+0000 7f71417ad640 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f713400f070 0x7f713401d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.567+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb3901cef0 con 0x7f713400f070 2024-09-21T09:03:21.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.567+0000 7f7138fac640 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f713400f070 0x7f713401d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.567+0000 7f7138fac640 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f713400f070 0x7f713401d5f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.568+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.568+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb3901cef0 con 0x55fb390159a0 2024-09-21T09:03:21.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.568+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.568+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb39011020 2024-09-21T09:03:21.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.568+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.568+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb39011020 2024-09-21T09:03:21.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.568+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.568+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb390159a0 2024-09-21T09:03:21.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.569+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.569+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb390159a0 2024-09-21T09:03:21.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.569+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.569+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x7f713400f070 2024-09-21T09:03:21.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.569+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.569+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb3901a360 2024-09-21T09:03:21.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.570+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.570+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb39011020 2024-09-21T09:03:21.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.570+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.570+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb390159a0 2024-09-21T09:03:21.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.570+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.570+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb39011020 2024-09-21T09:03:21.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.570+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.570+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x7f713400f070 2024-09-21T09:03:21.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.571+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.571+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb3901a360 2024-09-21T09:03:21.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.571+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.571+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb3901a360 2024-09-21T09:03:21.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.571+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.571+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb390159a0 2024-09-21T09:03:21.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.571+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.571+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb3901a360 2024-09-21T09:03:21.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.572+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.572+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb3901a360 2024-09-21T09:03:21.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.572+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.572+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb39011020 2024-09-21T09:03:21.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.572+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.572+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb39011020 2024-09-21T09:03:21.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.572+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.572+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb390159a0 2024-09-21T09:03:21.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.573+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.573+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb3901a360 2024-09-21T09:03:21.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.573+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.573+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x7f713400f070 2024-09-21T09:03:21.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.573+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.573+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb39011020 2024-09-21T09:03:21.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.573+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.573+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb390159a0 2024-09-21T09:03:21.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.574+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.574+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb3901a360 2024-09-21T09:03:21.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.574+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.574+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb390159a0 2024-09-21T09:03:21.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.574+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.574+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x7f713400f070 2024-09-21T09:03:21.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.574+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.574+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb3901a360 2024-09-21T09:03:21.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.575+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.575+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb390159a0 2024-09-21T09:03:21.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.575+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.575+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x55fb39011020 2024-09-21T09:03:21.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.575+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.575+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018360 con 0x7f713400f070 2024-09-21T09:03:21.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.575+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.575+0000 7f7143cb9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:21.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.575+0000 7f7143cb9800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:21.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.575+0000 7f7143cb9800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:21.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.575+0000 7f7143cb9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:21.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.575+0000 7f7143cb9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:21.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.575+0000 7f7143cb9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:21.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018770 con 0x55fb39011020 2024-09-21T09:03:21.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018b60 con 0x55fb39011020 2024-09-21T09:03:21.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:21.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb39018f80 con 0x55fb39011020 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 20 zone default found 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 4 Realm: () 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 20 zonegroup default 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.576+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb390193b0 con 0x55fb390159a0 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.577+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.577+0000 7f7143cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.577+0000 7f7143cb9800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.577+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb3901f280 con 0x55fb3901a360 2024-09-21T09:03:21.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.577+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.577+0000 7f7143cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.577+0000 7f7143cb9800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.577+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb3901f620 con 0x55fb3901a360 2024-09-21T09:03:21.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.577+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.577+0000 7f7143cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.577+0000 7f7143cb9800 20 started sync module instance, tier type = 2024-09-21T09:03:21.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.577+0000 7f7143cb9800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:21.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.577+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb3901e6c0 con 0x7f713400f070 2024-09-21T09:03:21.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.578+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.578+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94537481579456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb3901e6c0 con 0x7f713400f070 2024-09-21T09:03:21.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.578+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39020020 con 0x55fb39011020 2024-09-21T09:03:21.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.579+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94537481579456] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.579+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.579+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94537481576976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb3901ffe0 con 0x55fb39011020 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.579+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39020ac0 con 0x55fb3901a360 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.581+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94537481576976] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.581+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.581+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94537481583408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb3901ff50 con 0x55fb3901a360 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.581+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb390219b0 con 0x7f713400f070 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.582+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94537481583408] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.582+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.582+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94537481590016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39021dd0 con 0x7f713400f070 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.582+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb390226a0 con 0x55fb39011020 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.583+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.583+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94537481590016] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.583+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94537481592272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb390221f0 con 0x55fb39011020 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.583+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39021920 con 0x55fb390159a0 2024-09-21T09:03:21.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.584+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.584+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94537481597200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39021920 con 0x55fb390159a0 2024-09-21T09:03:21.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.584+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94537481592272] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.584+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb390240c0 con 0x55fb390159a0 2024-09-21T09:03:21.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.585+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94537481597200] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.585+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.585+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94537481595536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39023530 con 0x55fb390159a0 2024-09-21T09:03:21.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.585+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb390246a0 con 0x55fb390159a0 2024-09-21T09:03:21.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.586+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.586+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94537481595536] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.586+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94537481601520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39024ac0 con 0x55fb390159a0 2024-09-21T09:03:21.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.586+0000 7f7143cb9800 20 add_watcher() i=0 2024-09-21T09:03:21.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.586+0000 7f7143cb9800 20 add_watcher() i=1 2024-09-21T09:03:21.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.586+0000 7f7143cb9800 20 add_watcher() i=2 2024-09-21T09:03:21.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.586+0000 7f7143cb9800 20 add_watcher() i=3 2024-09-21T09:03:21.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.586+0000 7f7143cb9800 20 add_watcher() i=4 2024-09-21T09:03:21.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.586+0000 7f7143cb9800 20 add_watcher() i=5 2024-09-21T09:03:21.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.586+0000 7f7143cb9800 20 add_watcher() i=6 2024-09-21T09:03:21.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.587+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94537481601520] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.587+0000 7f7143cb9800 20 add_watcher() i=7 2024-09-21T09:03:21.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.587+0000 7f7143cb9800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:21.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.587+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb39027af0 con 0x55fb39011020 2024-09-21T09:03:21.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.587+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.587+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94537481602576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39024f10 con 0x55fb39011020 2024-09-21T09:03:21.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.588+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94537481602576] v29'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.588+0000 7f6ff77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:21.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.588+0000 7f7143cb9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:21.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.588+0000 7f7143cb9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:21.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.588+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb390304a0 con 0x55fb39011020 2024-09-21T09:03:21.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.590+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.590+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39030af0 con 0x55fb390159a0 2024-09-21T09:03:21.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.590+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.591+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39030af0 con 0x55fb3901a360 2024-09-21T09:03:21.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.591+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.591+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb390315d0 con 0x55fb39011020 2024-09-21T09:03:21.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.592+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'122 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.592+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb3902c170 con 0x7f713400f070 2024-09-21T09:03:21.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.593+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.593+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb3902c170 con 0x55fb3901a360 2024-09-21T09:03:21.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.594+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.594+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032410 con 0x55fb39011020 2024-09-21T09:03:21.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.595+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.595+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032410 con 0x55fb390159a0 2024-09-21T09:03:21.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.597+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.597+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032410 con 0x7f713400f070 2024-09-21T09:03:21.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.598+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.598+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032410 con 0x55fb3901a360 2024-09-21T09:03:21.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.599+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.599+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032480 con 0x7f713400f070 2024-09-21T09:03:21.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.600+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.600+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032480 con 0x55fb390159a0 2024-09-21T09:03:21.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.601+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.601+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x7f713400f070 2024-09-21T09:03:21.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.601+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.601+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb390159a0 2024-09-21T09:03:21.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.602+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.602+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb39011020 2024-09-21T09:03:21.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.603+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'123 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.603+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb3901a360 2024-09-21T09:03:21.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.605+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.605+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x7f713400f070 2024-09-21T09:03:21.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.606+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.606+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb3901a360 2024-09-21T09:03:21.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.607+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.607+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb39011020 2024-09-21T09:03:21.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.608+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.608+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb39011020 2024-09-21T09:03:21.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.609+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'124 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.609+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb3901a360 2024-09-21T09:03:21.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.610+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.610+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x7f713400f070 2024-09-21T09:03:21.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.611+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.611+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb3901a360 2024-09-21T09:03:21.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.612+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.612+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb3901a360 2024-09-21T09:03:21.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.613+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.613+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb3901a360 2024-09-21T09:03:21.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.613+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.614+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb3901a360 2024-09-21T09:03:21.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.614+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.614+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb390159a0 2024-09-21T09:03:21.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.615+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.615+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb3901a360 2024-09-21T09:03:21.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.617+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.617+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb390159a0 2024-09-21T09:03:21.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.618+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.618+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb3901a360 2024-09-21T09:03:21.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.619+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.619+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x55fb390159a0 2024-09-21T09:03:21.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.620+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.620+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39032550 con 0x7f713400f070 2024-09-21T09:03:21.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.621+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.621+0000 7f6ff67e4640 20 reqs_thread_entry: start 2024-09-21T09:03:21.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.621+0000 7f7143cb9800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:21.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.621+0000 7f7143cb9800 20 Filter name: none 2024-09-21T09:03:21.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.622+0000 7f6f67fff640 20 reqs_thread_entry: start 2024-09-21T09:03:21.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.622+0000 7f7143cb9800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T09:03:21.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.622+0000 7f7143cb9800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.622+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb3905d710 con 0x55fb390159a0 2024-09-21T09:03:21.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.622+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.622+0000 7f7143cb9800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T09:03:21.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.622+0000 7f7143cb9800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-21T09:03:21.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.622+0000 7f7143cb9800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T09:03:21.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.622+0000 7f7143cb9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:21.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.622+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb39060020 con 0x55fb390159a0 2024-09-21T09:03:21.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.623+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.623+0000 7f7143cb9800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-21T09:03:21.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.623+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb3905e000 con 0x55fb390159a0 2024-09-21T09:03:21.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.624+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v29'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.624+0000 7f7143cb9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T09:03:21.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.624+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94537481841424 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb390606b0 con 0x55fb3901a360 2024-09-21T09:03:21.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.624+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== watch-notify(notify (1) cookie 94537481583408 notify 124554051587 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55fb3902bcc0 con 0x55fb3901a360 2024-09-21T09:03:21.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.624+0000 7f7024ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051587 cookie 94537481583408 notifier 4532 bl.length()=170 2024-09-21T09:03:21.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.624+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 27 ==== osd_op_reply(97 notify.2 [notify cookie 94537481841424 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.624+0000 7f7024ff9640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7004003d60 con 0x55fb3901a360 2024-09-21T09:03:21.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.625+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.625+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 29 ==== watch-notify(notify_complete (2) cookie 94537481841424 notify 124554051587 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fb39008780 con 0x55fb3901a360 2024-09-21T09:03:21.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.625+0000 7f7143cb9800 10 removing email index: 2024-09-21T09:03:21.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.625+0000 7f7143cb9800 10 removing user buckets index 2024-09-21T09:03:21.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.625+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39060630 con 0x55fb390159a0 2024-09-21T09:03:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.626+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(99 fud.buckets [delete] v29'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.626+0000 7f7143cb9800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-21T09:03:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.626+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94537481848368 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb3905fb20 con 0x55fb390159a0 2024-09-21T09:03:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.626+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== watch-notify(notify (1) cookie 94537481595536 notify 124554051593 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55fb39032ad0 con 0x55fb390159a0 2024-09-21T09:03:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.626+0000 7f7024ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051593 cookie 94537481595536 notifier 4532 bl.length()=160 2024-09-21T09:03:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.626+0000 7f7024ff9640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7004003d60 con 0x55fb390159a0 2024-09-21T09:03:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.626+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== osd_op_reply(100 notify.6 [notify cookie 94537481848368 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.627+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 31 ==== watch-notify(notify_complete (2) cookie 94537481848368 notify 124554051593 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fb39005ad0 con 0x55fb390159a0 2024-09-21T09:03:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.627+0000 7f7143cb9800 10 removing user index: fud 2024-09-21T09:03:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.627+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 32 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.627+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb3905fb20 con 0x55fb390159a0 2024-09-21T09:03:21.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.628+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 33 ==== osd_op_reply(102 fud [call,call,delete] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.628+0000 7f7143cb9800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-21T09:03:21.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.628+0000 7f7143cb9800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-21T09:03:21.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.628+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94537481847008 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb3905efc0 con 0x55fb390159a0 2024-09-21T09:03:21.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.628+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 34 ==== watch-notify(notify (1) cookie 94537481597200 notify 124554051594 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55fb39005ad0 con 0x55fb390159a0 2024-09-21T09:03:21.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.628+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 35 ==== osd_op_reply(103 notify.5 [notify cookie 94537481847008 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.628+0000 7f7017fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051594 cookie 94537481597200 notifier 4532 bl.length()=152 2024-09-21T09:03:21.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.628+0000 7f7017fff640 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6f740032c0 con 0x55fb390159a0 2024-09-21T09:03:21.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.628+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 36 ==== watch-notify(notify_complete (2) cookie 94537481847008 notify 124554051594 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fb39005840 con 0x55fb390159a0 2024-09-21T09:03:21.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.628+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 37 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.629+0000 7f6ff77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:21.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.629+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94537481602576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb3902ad90 con 0x55fb39011020 2024-09-21T09:03:21.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.630+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94537481602576] v29'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.630+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94537481579456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39024610 con 0x7f713400f070 2024-09-21T09:03:21.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.631+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94537481579456] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.631+0000 7f7143cb9800 20 remove_watcher() i=0 2024-09-21T09:03:21.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.631+0000 7f7143cb9800 2 removed watcher, disabling cache 2024-09-21T09:03:21.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.631+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94537481576976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39024610 con 0x55fb39011020 2024-09-21T09:03:21.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.632+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94537481576976] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.632+0000 7f7143cb9800 20 remove_watcher() i=1 2024-09-21T09:03:21.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.632+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94537481583408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb3901e210 con 0x55fb3901a360 2024-09-21T09:03:21.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.633+0000 7f71417ad640 1 -- 172.21.15.178:0/2119999035 <== osd.3 v2:172.21.15.178:6808/24558189 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94537481583408] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713402e070 con 0x55fb3901a360 2024-09-21T09:03:21.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.633+0000 7f7143cb9800 20 remove_watcher() i=2 2024-09-21T09:03:21.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.633+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94537481590016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39024610 con 0x7f713400f070 2024-09-21T09:03:21.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.634+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94537481590016] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c057030 con 0x7f713400f070 2024-09-21T09:03:21.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.634+0000 7f7143cb9800 20 remove_watcher() i=3 2024-09-21T09:03:21.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.634+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94537481592272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb3901fb30 con 0x55fb39011020 2024-09-21T09:03:21.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.635+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94537481592272] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c057030 con 0x55fb39011020 2024-09-21T09:03:21.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.635+0000 7f7143cb9800 20 remove_watcher() i=4 2024-09-21T09:03:21.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.635+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94537481597200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb3901e210 con 0x55fb390159a0 2024-09-21T09:03:21.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.636+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94537481597200] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.636+0000 7f7143cb9800 20 remove_watcher() i=5 2024-09-21T09:03:21.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.636+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94537481595536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39021500 con 0x55fb390159a0 2024-09-21T09:03:21.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.638+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94537481595536] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.638+0000 7f7143cb9800 20 remove_watcher() i=6 2024-09-21T09:03:21.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.638+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94537481601520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb39024610 con 0x55fb390159a0 2024-09-21T09:03:21.643 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7141fae640 1 -- 172.21.15.178:0/2119999035 <== osd.0 v2:172.21.15.44:6800/2732047064 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94537481601520] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c02a070 con 0x55fb390159a0 2024-09-21T09:03:21.643 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 20 remove_watcher() i=7 2024-09-21T09:03:21.643 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fb390159a0 msgr2=0x55fb39017d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.643 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fb390159a0 0x55fb39017d90 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.643 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fb39011020 msgr2=0x55fb390134e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.643 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fb39011020 0x55fb390134e0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.643 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f713400f070 msgr2=0x7f713401d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.643 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f713400f070 0x7f713401d5f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.643 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fb3901a360 msgr2=0x55fb3901c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fb3901a360 0x55fb3901c820 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f700c036b90 msgr2=0x7f700c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f700c036b90 0x7f700c039050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7134024410 tx=0x7f713404d000 comp rx=0 tx=0).stop 2024-09-21T09:03:21.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ffdec0 msgr2=0x55fb39005300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7138fac640 1 -- 172.21.15.178:0/2119999035 reap_dead start 2024-09-21T09:03:21.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ffdec0 0x55fb39005300 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f713c0117d0 tx=0x7f713c04cb20 comp rx=0 tx=0).stop 2024-09-21T09:03:21.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 shutdown_connections 2024-09-21T09:03:21.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 --2- 172.21.15.178:0/2119999035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ffdec0 0x55fb39005300 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 >> 172.21.15.178:0/2119999035 conn(0x55fb38ffa220 msgr2=0x55fb38ff82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 shutdown_connections 2024-09-21T09:03:21.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.639+0000 7f7143cb9800 1 -- 172.21.15.178:0/2119999035 wait complete. 2024-09-21T09:03:21.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 -- 172.21.15.178:0/581269587 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7018036b90 msgr2=0x7f7018039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 --2- 172.21.15.178:0/581269587 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7018036b90 0x7f7018039050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55fb38fddf50 tx=0x7f713404b760 comp rx=0 tx=0).stop 2024-09-21T09:03:21.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 -- 172.21.15.178:0/581269587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ff1260 msgr2=0x55fb38ff1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 --2- 172.21.15.178:0/581269587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ff1260 0x55fb38ff1680 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x55fb38fddee0 tx=0x7f713c018830 comp rx=0 tx=0).stop 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 -- 172.21.15.178:0/581269587 shutdown_connections 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 --2- 172.21.15.178:0/581269587 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7018036b90 0x7f7018039050 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 --2- 172.21.15.178:0/581269587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38ff1260 0x55fb38ff1680 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 -- 172.21.15.178:0/581269587 >> 172.21.15.178:0/581269587 conn(0x55fb38fe61f0 msgr2=0x55fb38fe8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 -- 172.21.15.178:0/581269587 shutdown_connections 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 -- 172.21.15.178:0/581269587 wait complete. 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fb38fdfe10 msgr2=0x55fb38fe2200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fb38fdfe10 0x55fb38fe2200 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fb38ee3d90 msgr2=0x55fb38fdd530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fb38ee3d90 0x55fb38fdd530 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7028036af0 msgr2=0x7f7028038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7028036af0 0x7f7028038fb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f712c057000 tx=0x7f712c052000 comp rx=0 tx=0).stop 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38e51610 msgr2=0x55fb38fd64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38e51610 0x55fb38fd64c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7134000f60 tx=0x7f7134000bc0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 shutdown_connections 2024-09-21T09:03:21.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fb38fdfe10 0x55fb38fe2200 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fb38ee3d90 0x55fb38fdd530 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f7028036af0 0x7f7028038fb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 --2- 172.21.15.178:0/3138786798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb38e51610 0x55fb38fd64c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 >> 172.21.15.178:0/3138786798 conn(0x55fb38ed7de0 msgr2=0x55fb38fc8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 shutdown_connections 2024-09-21T09:03:21.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.640+0000 7f7143cb9800 1 -- 172.21.15.178:0/3138786798 wait complete. 2024-09-21T09:03:21.650 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-21T09:03:21.650 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-21T09:03:21.651 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-21T09:03:21.704 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:21.704 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:21.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.704+0000 7f9639330800 1 Processor -- start 2024-09-21T09:03:21.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.704+0000 7f9639330800 1 -- start start 2024-09-21T09:03:21.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.704+0000 7f9639330800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55e6d2dfbd70 0x55e6d2dfe160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.704+0000 7f9639330800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e6d2cb4b30 con 0x55e6d2d69640 2024-09-21T09:03:21.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.704+0000 7f9639330800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55e6d2c96360 con 0x55e6d2dfbd70 2024-09-21T09:03:21.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.704+0000 7f9634862640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55e6d2dfbd70 0x55e6d2dfe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.704+0000 7f9635063640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55e6d2d69640 0x55e6d2dfa650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46850/0 (socket says 172.21.15.178:46850) 2024-09-21T09:03:21.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.704+0000 7f9635063640 1 -- 172.21.15.178:0/1048488144 learned_addr learned my addr 172.21.15.178:0/1048488144 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:21.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.704+0000 7f9634862640 1 -- 172.21.15.178:0/1048488144 >> v1:172.21.15.44:6789/0 conn(0x55e6d2d69640 legacy=0x55e6d2dfa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.704+0000 7f9634862640 1 -- 172.21.15.178:0/1048488144 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d2cbce00 con 0x55e6d2dfbd70 2024-09-21T09:03:21.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.704+0000 7f9627fff640 1 -- 172.21.15.178:0/1048488144 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301738470 0 0) 0x55e6d2cb4b30 con 0x55e6d2d69640 2024-09-21T09:03:21.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.706+0000 7f9634862640 1 --2- 172.21.15.178:0/1048488144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2dfbd70 0x55e6d2dfe160 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f962c00a470 tx=0x7f962c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af6ba554cac5cff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.706+0000 7f9627fff640 1 -- 172.21.15.178:0/1048488144 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f962c053570 con 0x55e6d2dfbd70 2024-09-21T09:03:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.706+0000 7f9627fff640 1 -- 172.21.15.178:0/1048488144 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f962c058070 con 0x55e6d2dfbd70 2024-09-21T09:03:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.706+0000 7f9627fff640 1 -- 172.21.15.178:0/1048488144 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f962c053880 con 0x55e6d2dfbd70 2024-09-21T09:03:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.707+0000 7f9639330800 1 -- 172.21.15.178:0/1048488144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2dfbd70 msgr2=0x55e6d2dfe160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.707+0000 7f9639330800 1 --2- 172.21.15.178:0/1048488144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2dfbd70 0x55e6d2dfe160 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f962c00a470 tx=0x7f962c045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.707+0000 7f9639330800 1 -- 172.21.15.178:0/1048488144 shutdown_connections 2024-09-21T09:03:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.707+0000 7f9639330800 1 --2- 172.21.15.178:0/1048488144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2dfbd70 0x55e6d2dfe160 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.707+0000 7f9639330800 1 -- 172.21.15.178:0/1048488144 >> 172.21.15.178:0/1048488144 conn(0x55e6d2defde0 msgr2=0x55e6d2df2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.707+0000 7f9639330800 1 -- 172.21.15.178:0/1048488144 shutdown_connections 2024-09-21T09:03:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.707+0000 7f9639330800 1 -- 172.21.15.178:0/1048488144 wait complete. 2024-09-21T09:03:21.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.720+0000 7f9639330800 1 Processor -- start 2024-09-21T09:03:21.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.720+0000 7f9639330800 1 -- start start 2024-09-21T09:03:21.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.721+0000 7f9639330800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2d69640 0x55e6d2ee6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.721+0000 7f9639330800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e6d2d41450 con 0x55e6d2d69640 2024-09-21T09:03:21.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.721+0000 7f9635063640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2d69640 0x55e6d2ee6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.721+0000 7f9635063640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2d69640 0x55e6d2ee6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43882/0 (socket says 172.21.15.178:43882) 2024-09-21T09:03:21.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.721+0000 7f9635063640 1 -- 172.21.15.178:0/3335329549 learned_addr learned my addr 172.21.15.178:0/3335329549 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.721+0000 7f9635063640 1 -- 172.21.15.178:0/3335329549 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d2c8ebc0 con 0x55e6d2d69640 2024-09-21T09:03:21.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.721+0000 7f9635063640 1 --2- 172.21.15.178:0/3335329549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2d69640 0x55e6d2ee6900 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f962800b240 tx=0x7f962800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25bc36e638b821e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.722+0000 7f9523606640 1 -- 172.21.15.178:0/3335329549 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9628008070 con 0x55e6d2d69640 2024-09-21T09:03:21.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.722+0000 7f9523606640 1 -- 172.21.15.178:0/3335329549 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f962800d500 con 0x55e6d2d69640 2024-09-21T09:03:21.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.722+0000 7f9523606640 1 -- 172.21.15.178:0/3335329549 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f962800d860 con 0x55e6d2d69640 2024-09-21T09:03:21.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.722+0000 7f9639330800 1 -- 172.21.15.178:0/3335329549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2d69640 msgr2=0x55e6d2ee6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.722+0000 7f9639330800 1 --2- 172.21.15.178:0/3335329549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2d69640 0x55e6d2ee6900 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f962800b240 tx=0x7f962800b700 comp rx=0 tx=0).stop 2024-09-21T09:03:21.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.722+0000 7f9639330800 1 -- 172.21.15.178:0/3335329549 shutdown_connections 2024-09-21T09:03:21.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.722+0000 7f9639330800 1 --2- 172.21.15.178:0/3335329549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2d69640 0x55e6d2ee6900 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.722+0000 7f9639330800 1 -- 172.21.15.178:0/3335329549 >> 172.21.15.178:0/3335329549 conn(0x55e6d2defde0 msgr2=0x55e6d2ee22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.722+0000 7f9639330800 1 -- 172.21.15.178:0/3335329549 shutdown_connections 2024-09-21T09:03:21.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.722+0000 7f9639330800 1 -- 172.21.15.178:0/3335329549 wait complete. 2024-09-21T09:03:21.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.723+0000 7f9639330800 1 Processor -- start 2024-09-21T09:03:21.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.723+0000 7f9639330800 1 -- start start 2024-09-21T09:03:21.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.723+0000 7f9639330800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2d69640 0x55e6d2eee380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.723+0000 7f9639330800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e6d2dfe940 con 0x55e6d2d69640 2024-09-21T09:03:21.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.723+0000 7f9635063640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2d69640 0x55e6d2eee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.723+0000 7f9635063640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2d69640 0x55e6d2eee380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43890/0 (socket says 172.21.15.178:43890) 2024-09-21T09:03:21.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.723+0000 7f9635063640 1 -- 172.21.15.178:0/1022929306 learned_addr learned my addr 172.21.15.178:0/1022929306 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.723+0000 7f9635063640 1 -- 172.21.15.178:0/1022929306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d2ca2fe0 con 0x55e6d2d69640 2024-09-21T09:03:21.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.724+0000 7f9635063640 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2d69640 0x55e6d2eee380 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x55e6d2ee7760 tx=0x7f9628000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.724+0000 7f9521e03640 1 -- 172.21.15.178:0/1022929306 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9628019870 con 0x55e6d2d69640 2024-09-21T09:03:21.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.724+0000 7f9521e03640 1 -- 172.21.15.178:0/1022929306 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9628019a10 con 0x55e6d2d69640 2024-09-21T09:03:21.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.724+0000 7f9521e03640 1 -- 172.21.15.178:0/1022929306 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9628019d30 con 0x55e6d2d69640 2024-09-21T09:03:21.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.724+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6d2eee8c0 con 0x55e6d2d69640 2024-09-21T09:03:21.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.724+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6d2eeede0 con 0x55e6d2d69640 2024-09-21T09:03:21.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.725+0000 7f9521e03640 1 -- 172.21.15.178:0/1022929306 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9628017040 con 0x55e6d2d69640 2024-09-21T09:03:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.725+0000 7f9521e03640 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f951c036b90 0x7f951c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.725+0000 7f9521e03640 1 -- 172.21.15.178:0/1022929306 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9628015020 con 0x55e6d2d69640 2024-09-21T09:03:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.725+0000 7f9634862640 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f951c036b90 0x7f951c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.725+0000 7f9639330800 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e6d2dfbd70 0x55e6d2ef53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.725+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2ef5970 con 0x55e6d2dfbd70 2024-09-21T09:03:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.725+0000 7f9635864640 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e6d2dfbd70 0x55e6d2ef53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.725+0000 7f9634862640 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f951c036b90 0x7f951c039050 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f962c057000 tx=0x7f962c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.725+0000 7f9635864640 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e6d2dfbd70 0x55e6d2ef53f0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.726+0000 7f9635864640 1 -- 172.21.15.178:0/1022929306 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f963000a4a0 con 0x55e6d2dfbd70 2024-09-21T09:03:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.726+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2ef29c0 con 0x55e6d2dfbd70 2024-09-21T09:03:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.726+0000 7f9635864640 1 -- 172.21.15.178:0/1022929306 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f963000a4a0 con 0x55e6d2dfbd70 2024-09-21T09:03:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.726+0000 7f9639330800 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e6d2ef7ca0 0x55e6d2efa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.726+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2efa780 con 0x55e6d2ef7ca0 2024-09-21T09:03:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.726+0000 7f9635063640 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e6d2ef7ca0 0x55e6d2efa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.726+0000 7f9635063640 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e6d2ef7ca0 0x55e6d2efa090 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.727+0000 7f9635063640 1 -- 172.21.15.178:0/1022929306 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2ef7ca0 2024-09-21T09:03:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.727+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2ef6b40 con 0x55e6d2dfbd70 2024-09-21T09:03:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.727+0000 7f9635864640 1 -- 172.21.15.178:0/1022929306 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f963000a4a0 con 0x55e6d2dfbd70 2024-09-21T09:03:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.727+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2ef7020 con 0x55e6d2dfbd70 2024-09-21T09:03:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.727+0000 7f9635864640 1 -- 172.21.15.178:0/1022929306 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f963000a4a0 con 0x55e6d2dfbd70 2024-09-21T09:03:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.728+0000 7f9639330800 1 Processor -- start 2024-09-21T09:03:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.728+0000 7f9639330800 1 -- start start 2024-09-21T09:03:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.728+0000 7f9639330800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f09100 0x55e6d2f09520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.728+0000 7f9639330800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e6d2c90580 con 0x55e6d2f09100 2024-09-21T09:03:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.728+0000 7f9635864640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f09100 0x55e6d2f09520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.728+0000 7f9635864640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f09100 0x55e6d2f09520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43904/0 (socket says 172.21.15.178:43904) 2024-09-21T09:03:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.728+0000 7f9635864640 1 -- 172.21.15.178:0/2811571072 learned_addr learned my addr 172.21.15.178:0/2811571072 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.728+0000 7f9635864640 1 -- 172.21.15.178:0/2811571072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d2f09a60 con 0x55e6d2f09100 2024-09-21T09:03:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.729+0000 7f9635864640 1 --2- 172.21.15.178:0/2811571072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f09100 0x55e6d2f09520 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55e6d2ef5d50 tx=0x7f9630018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.729+0000 7f951affd640 1 -- 172.21.15.178:0/2811571072 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9630014450 con 0x55e6d2f09100 2024-09-21T09:03:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.729+0000 7f951affd640 1 -- 172.21.15.178:0/2811571072 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9630014610 con 0x55e6d2f09100 2024-09-21T09:03:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.729+0000 7f951affd640 1 -- 172.21.15.178:0/2811571072 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9630014930 con 0x55e6d2f09100 2024-09-21T09:03:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.729+0000 7f9639330800 1 -- 172.21.15.178:0/2811571072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6d2f09cf0 con 0x55e6d2f09100 2024-09-21T09:03:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.729+0000 7f9639330800 1 -- 172.21.15.178:0/2811571072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6d2f0c9d0 con 0x55e6d2f09100 2024-09-21T09:03:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.729+0000 7f951affd640 1 -- 172.21.15.178:0/2811571072 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9630011040 con 0x55e6d2f09100 2024-09-21T09:03:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.730+0000 7f951affd640 1 --2- 172.21.15.178:0/2811571072 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9510036b40 0x7f9510039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.730+0000 7f951affd640 1 -- 172.21.15.178:0/2811571072 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f963001e070 con 0x55e6d2f09100 2024-09-21T09:03:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.730+0000 7f9635063640 1 --2- 172.21.15.178:0/2811571072 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9510036b40 0x7f9510039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.730+0000 7f9639330800 1 Processor -- start 2024-09-21T09:03:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.730+0000 7f9635063640 1 --2- 172.21.15.178:0/2811571072 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9510036b40 0x7f9510039000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55e6d2ef5df0 tx=0x7f962801b520 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.730+0000 7f9639330800 1 -- start start 2024-09-21T09:03:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.730+0000 7f9639330800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f15db0 0x55e6d2f161b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.730+0000 7f9639330800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e6d2ee70b0 con 0x55e6d2f15db0 2024-09-21T09:03:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.730+0000 7f9635864640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f15db0 0x55e6d2f161b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.730+0000 7f9635864640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f15db0 0x55e6d2f161b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43906/0 (socket says 172.21.15.178:43906) 2024-09-21T09:03:21.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.730+0000 7f9635864640 1 -- 172.21.15.178:0/2575183008 learned_addr learned my addr 172.21.15.178:0/2575183008 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.731+0000 7f9635864640 1 -- 172.21.15.178:0/2575183008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d2f16780 con 0x55e6d2f15db0 2024-09-21T09:03:21.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.731+0000 7f9635864640 1 --2- 172.21.15.178:0/2575183008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f15db0 0x55e6d2f161b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f963004cba0 tx=0x7f963002b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618e32e377268aed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.731+0000 7f9518ff9640 1 -- 172.21.15.178:0/2575183008 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9630028040 con 0x55e6d2f15db0 2024-09-21T09:03:21.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.731+0000 7f9518ff9640 1 -- 172.21.15.178:0/2575183008 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96300400c0 con 0x55e6d2f15db0 2024-09-21T09:03:21.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.731+0000 7f9518ff9640 1 -- 172.21.15.178:0/2575183008 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9630016980 con 0x55e6d2f15db0 2024-09-21T09:03:21.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.731+0000 7f9639330800 1 -- 172.21.15.178:0/2575183008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f15db0 msgr2=0x55e6d2f161b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.731+0000 7f9639330800 1 --2- 172.21.15.178:0/2575183008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f15db0 0x55e6d2f161b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f963004cba0 tx=0x7f963002b410 comp rx=0 tx=0).stop 2024-09-21T09:03:21.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.731+0000 7f9639330800 1 -- 172.21.15.178:0/2575183008 shutdown_connections 2024-09-21T09:03:21.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.731+0000 7f9639330800 1 --2- 172.21.15.178:0/2575183008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f15db0 0x55e6d2f161b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.731+0000 7f9639330800 1 -- 172.21.15.178:0/2575183008 >> 172.21.15.178:0/2575183008 conn(0x55e6d2f12110 msgr2=0x55e6d2f10210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.732+0000 7f9639330800 1 -- 172.21.15.178:0/2575183008 shutdown_connections 2024-09-21T09:03:21.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.732+0000 7f9639330800 1 -- 172.21.15.178:0/2575183008 wait complete. 2024-09-21T09:03:21.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.732+0000 7f9639330800 1 Processor -- start 2024-09-21T09:03:21.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.732+0000 7f9639330800 1 -- start start 2024-09-21T09:03:21.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.732+0000 7f9639330800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f15db0 0x55e6d2f1d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.732+0000 7f9639330800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e6d2f16df0 con 0x55e6d2f15db0 2024-09-21T09:03:21.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.732+0000 7f9635864640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f15db0 0x55e6d2f1d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.732+0000 7f9635864640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f15db0 0x55e6d2f1d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43922/0 (socket says 172.21.15.178:43922) 2024-09-21T09:03:21.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.732+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 learned_addr learned my addr 172.21.15.178:0/4112348751 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.732+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d2f1d800 con 0x55e6d2f15db0 2024-09-21T09:03:21.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.733+0000 7f9635864640 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f15db0 0x55e6d2f1d2c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9630011b50 tx=0x7f963004cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.733+0000 7f9506ffd640 1 -- 172.21.15.178:0/4112348751 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9630028050 con 0x55e6d2f15db0 2024-09-21T09:03:21.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.733+0000 7f9506ffd640 1 -- 172.21.15.178:0/4112348751 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9630016980 con 0x55e6d2f15db0 2024-09-21T09:03:21.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.733+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6d2f1da90 con 0x55e6d2f15db0 2024-09-21T09:03:21.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.733+0000 7f9506ffd640 1 -- 172.21.15.178:0/4112348751 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f963004e070 con 0x55e6d2f15db0 2024-09-21T09:03:21.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.733+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6d2f20740 con 0x55e6d2f15db0 2024-09-21T09:03:21.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.734+0000 7f9506ffd640 1 -- 172.21.15.178:0/4112348751 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f963004e210 con 0x55e6d2f15db0 2024-09-21T09:03:21.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.734+0000 7f9506ffd640 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9500036b90 0x7f9500039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.734+0000 7f9506ffd640 1 -- 172.21.15.178:0/4112348751 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f963000e040 con 0x55e6d2f15db0 2024-09-21T09:03:21.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.734+0000 7f9635063640 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9500036b90 0x7f9500039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.734+0000 7f9635063640 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9500036b90 0x7f9500039050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f962804b770 tx=0x7f9628032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.735+0000 7f9639330800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.735+0000 7f9639330800 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e6d2f28cd0 0x55e6d2f2b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.735+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f2b8e0 con 0x55e6d2f28cd0 2024-09-21T09:03:21.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.735+0000 7f9634862640 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e6d2f28cd0 0x55e6d2f2b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.735+0000 7f9634862640 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e6d2f28cd0 0x55e6d2f2b190 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.735+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.735+0000 7f9639330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.735+0000 7f9639330800 20 realm 2024-09-21T09:03:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.735+0000 7f9639330800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.735+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f2bd10 con 0x55e6d2f28cd0 2024-09-21T09:03:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9639330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9639330800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9639330800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f2c5e0 con 0x55e6d2f28cd0 2024-09-21T09:03:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9639330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9639330800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f2c980 con 0x55e6d2f28cd0 2024-09-21T09:03:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9639330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9639330800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9639330800 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e6d2f2d6e0 0x55e6d2f2fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f300e0 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.736+0000 7f9635864640 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e6d2f2d6e0 0x55e6d2f2fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.737+0000 7f9635864640 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e6d2f2d6e0 0x55e6d2f2fad0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.737+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.737+0000 7f9639330800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.737+0000 7f9639330800 20 searching for the correct realm 2024-09-21T09:03:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.737+0000 7f9639330800 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e6d2f32070 0x55e6d2f34530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.737+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f32070 2024-09-21T09:03:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.737+0000 7f9635063640 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e6d2f32070 0x55e6d2f34530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.737+0000 7f9635063640 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e6d2f32070 0x55e6d2f34530 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.738+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.738+0000 7f9635063640 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9628050040 0x7f962801c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.738+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x7f9628050040 2024-09-21T09:03:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.738+0000 7f9634862640 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9628050040 0x7f962801c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.738+0000 7f9634862640 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9628050040 0x7f962801c610 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.738+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962c051070 con 0x7f9628050040 2024-09-21T09:03:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.738+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.739+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.739+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f28cd0 2024-09-21T09:03:21.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.739+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.739+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f28cd0 2024-09-21T09:03:21.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.739+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.739+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.739+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.739+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.740+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.740+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x7f9628050040 2024-09-21T09:03:21.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.740+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962c051070 con 0x7f9628050040 2024-09-21T09:03:21.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.740+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f32070 2024-09-21T09:03:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.740+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.740+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f28cd0 2024-09-21T09:03:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.740+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.740+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.741+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.741+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f28cd0 2024-09-21T09:03:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.741+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.741+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x7f9628050040 2024-09-21T09:03:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.741+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f962c051070 con 0x7f9628050040 2024-09-21T09:03:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.741+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f32070 2024-09-21T09:03:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.741+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.741+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f32070 2024-09-21T09:03:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.741+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.741+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.742+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.742+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f32070 2024-09-21T09:03:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.742+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.742+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f32070 2024-09-21T09:03:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.742+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.742+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f28cd0 2024-09-21T09:03:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.742+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.742+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f28cd0 2024-09-21T09:03:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.743+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.743+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.743+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.743+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f32070 2024-09-21T09:03:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.743+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.743+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x7f9628050040 2024-09-21T09:03:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.743+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962c051070 con 0x7f9628050040 2024-09-21T09:03:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.743+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f28cd0 2024-09-21T09:03:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.743+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.744+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.744+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.744+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f32070 2024-09-21T09:03:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.744+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.744+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.744+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.744+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x7f9628050040 2024-09-21T09:03:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.744+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962c051070 con 0x7f9628050040 2024-09-21T09:03:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.745+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f32070 2024-09-21T09:03:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.745+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.745+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.745+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.745+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x55e6d2f28cd0 2024-09-21T09:03:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.745+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.745+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f34c00 con 0x7f9628050040 2024-09-21T09:03:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.745+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962c051070 con 0x7f9628050040 2024-09-21T09:03:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.745+0000 7f9639330800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.745+0000 7f9639330800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f315c0 con 0x55e6d2f28cd0 2024-09-21T09:03:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f30570 con 0x55e6d2f28cd0 2024-09-21T09:03:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f30f30 con 0x55e6d2f28cd0 2024-09-21T09:03:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:21.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 20 zone default found 2024-09-21T09:03:21.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 4 Realm: () 2024-09-21T09:03:21.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:21.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:21.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:21.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 20 zonegroup default 2024-09-21T09:03:21.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f350a0 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.746+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.747+0000 7f9639330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.747+0000 7f9639330800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.747+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f37370 con 0x55e6d2f32070 2024-09-21T09:03:21.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.747+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.747+0000 7f9639330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.747+0000 7f9639330800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.747+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f37710 con 0x55e6d2f32070 2024-09-21T09:03:21.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.747+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.747+0000 7f9639330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.747+0000 7f9639330800 20 started sync module instance, tier type = 2024-09-21T09:03:21.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.747+0000 7f9639330800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:21.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.747+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f367b0 con 0x7f9628050040 2024-09-21T09:03:21.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.748+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962c051070 con 0x7f9628050040 2024-09-21T09:03:21.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.748+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94449870007472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f367b0 con 0x7f9628050040 2024-09-21T09:03:21.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.748+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f38160 con 0x55e6d2f28cd0 2024-09-21T09:03:21.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.749+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94449870007472] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962c051070 con 0x7f9628050040 2024-09-21T09:03:21.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.749+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.749+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94449870011472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f367b0 con 0x55e6d2f28cd0 2024-09-21T09:03:21.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.749+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f38c10 con 0x55e6d2f32070 2024-09-21T09:03:21.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.750+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94449870011472] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.750+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.750+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94449870004992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f36720 con 0x55e6d2f32070 2024-09-21T09:03:21.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.750+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f39ad0 con 0x7f9628050040 2024-09-21T09:03:21.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.751+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962c051070 con 0x7f9628050040 2024-09-21T09:03:21.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.751+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94449870018560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f3a290 con 0x7f9628050040 2024-09-21T09:03:21.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.752+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94449870004992] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.752+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f3adb0 con 0x55e6d2f28cd0 2024-09-21T09:03:21.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.753+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94449870018560] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962c051070 con 0x7f9628050040 2024-09-21T09:03:21.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.753+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.753+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94449870022784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f3ad70 con 0x55e6d2f28cd0 2024-09-21T09:03:21.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.753+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f3b650 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.754+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.754+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94449870025120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f3ad70 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.754+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f3c520 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.754+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94449870022784] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.755+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94449870025120] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.755+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.755+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94449870027248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f39000 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.755+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f3cb00 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.756+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.756+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94449870030416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f3cf20 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.756+0000 7f9639330800 20 add_watcher() i=0 2024-09-21T09:03:21.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.756+0000 7f9639330800 20 add_watcher() i=1 2024-09-21T09:03:21.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.756+0000 7f9639330800 20 add_watcher() i=2 2024-09-21T09:03:21.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.756+0000 7f9639330800 20 add_watcher() i=3 2024-09-21T09:03:21.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.756+0000 7f9639330800 20 add_watcher() i=4 2024-09-21T09:03:21.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.756+0000 7f9639330800 20 add_watcher() i=5 2024-09-21T09:03:21.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.756+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94449870027248] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.756+0000 7f9639330800 20 add_watcher() i=6 2024-09-21T09:03:21.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.756+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94449870030416] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.756+0000 7f9639330800 20 add_watcher() i=7 2024-09-21T09:03:21.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.756+0000 7f9639330800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:21.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.757+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f3cf20 con 0x55e6d2f28cd0 2024-09-21T09:03:21.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.757+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.757+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94449870031472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f3ce90 con 0x55e6d2f28cd0 2024-09-21T09:03:21.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.758+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94449870031472] v29'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.758+0000 7f94eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:21.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.758+0000 7f9639330800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:21.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.758+0000 7f9639330800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:21.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.758+0000 7f9639330800 5 note: GC not initialized 2024-09-21T09:03:21.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.758+0000 7f94ea7e4640 20 reqs_thread_entry: start 2024-09-21T09:03:21.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.758+0000 7f9639330800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:21.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.758+0000 7f9639330800 20 Filter name: none 2024-09-21T09:03:21.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f945bfff640 20 reqs_thread_entry: start 2024-09-21T09:03:21.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9639330800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-21T09:03:21.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9639330800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f734b0 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9639330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9639330800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-21T09:03:21.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9639330800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-21T09:03:21.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9639330800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-21T09:03:21.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9639330800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f71a40 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9639330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9639330800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-21T09:03:21.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9639330800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T09:03:21.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9639330800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-21T09:03:21.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.759+0000 7f9639330800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-21T09:03:21.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.760+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f76190 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.761+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v29'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.761+0000 7f9639330800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-21T09:03:21.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.761+0000 7f9639330800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-21T09:03:21.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.761+0000 7f9639330800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-21T09:03:21.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.761+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94449870265168 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f76c60 con 0x7f9628050040 2024-09-21T09:03:21.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.761+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== watch-notify(notify (1) cookie 94449870018560 notify 124554051602 ret 0) ==== 652+0+0 (crc 0 0 0) 0x55e6d2cbce00 con 0x7f9628050040 2024-09-21T09:03:21.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.761+0000 7f9518ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051602 cookie 94449870018560 notifier 4539 bl.length()=610 2024-09-21T09:03:21.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.761+0000 7f9518ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-21T09:03:21.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.761+0000 7f9518ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-21T09:03:21.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.761+0000 7f9518ff9640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f94f8003ea0 con 0x7f9628050040 2024-09-21T09:03:21.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.761+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(65 notify.3 [notify cookie 94449870265168 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f962c051070 con 0x7f9628050040 2024-09-21T09:03:21.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.761+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962c051070 con 0x7f9628050040 2024-09-21T09:03:21.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.761+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== watch-notify(notify_complete (2) cookie 94449870265168 notify 124554051602 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f962c082b40 con 0x7f9628050040 2024-09-21T09:03:21.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.761+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f76190 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.762+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v29'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.762+0000 7f9639330800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T09:03:21.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.762+0000 7f9639330800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T09:03:21.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.762+0000 7f9639330800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T09:03:21.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.762+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94449870260704 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f76190 con 0x55e6d2f32070 2024-09-21T09:03:21.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.763+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== watch-notify(notify (1) cookie 94449870004992 notify 124554051588 ret 0) ==== 234+0+0 (crc 0 0 0) 0x7f962805b040 con 0x55e6d2f32070 2024-09-21T09:03:21.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.763+0000 7f9507fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051588 cookie 94449870004992 notifier 4539 bl.length()=192 2024-09-21T09:03:21.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.763+0000 7f9507fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T09:03:21.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.763+0000 7f9507fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T09:03:21.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.763+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(68 notify.2 [notify cookie 94449870260704 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.763+0000 7f9507fff640 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9468003400 con 0x55e6d2f32070 2024-09-21T09:03:21.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.763+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.763+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== watch-notify(notify_complete (2) cookie 94449870260704 notify 124554051588 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e6d2eeede0 con 0x55e6d2f32070 2024-09-21T09:03:21.775 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-21T09:03:21.760811Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:21.760802Z","tags":[],"group_ids":[]} 2024-09-21T09:03:21.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.764+0000 7f94eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:21.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.764+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94449870031472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f70fd0 con 0x55e6d2f28cd0 2024-09-21T09:03:21.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.765+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94449870031472] v29'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.765+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94449870007472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f70fd0 con 0x7f9628050040 2024-09-21T09:03:21.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.766+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94449870007472] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962c051070 con 0x7f9628050040 2024-09-21T09:03:21.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.766+0000 7f9639330800 20 remove_watcher() i=0 2024-09-21T09:03:21.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.766+0000 7f9639330800 2 removed watcher, disabling cache 2024-09-21T09:03:21.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.766+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94449870011472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f70fd0 con 0x55e6d2f28cd0 2024-09-21T09:03:21.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.767+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94449870011472] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.767+0000 7f9639330800 20 remove_watcher() i=1 2024-09-21T09:03:21.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.767+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94449870004992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f70fd0 con 0x55e6d2f32070 2024-09-21T09:03:21.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.768+0000 7f9635063640 1 -- 172.21.15.178:0/4112348751 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94449870004992] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962802d070 con 0x55e6d2f32070 2024-09-21T09:03:21.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.768+0000 7f9639330800 20 remove_watcher() i=2 2024-09-21T09:03:21.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.768+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94449870018560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f70fd0 con 0x7f9628050040 2024-09-21T09:03:21.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.769+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94449870018560] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962c051070 con 0x7f9628050040 2024-09-21T09:03:21.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.769+0000 7f9639330800 20 remove_watcher() i=3 2024-09-21T09:03:21.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.769+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94449870022784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f70fd0 con 0x55e6d2f28cd0 2024-09-21T09:03:21.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.770+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94449870022784] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f962c051070 con 0x55e6d2f28cd0 2024-09-21T09:03:21.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.770+0000 7f9639330800 20 remove_watcher() i=4 2024-09-21T09:03:21.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.770+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94449870025120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f70fd0 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.771+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94449870025120] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.771+0000 7f9639330800 20 remove_watcher() i=5 2024-09-21T09:03:21.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.771+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94449870027248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f70fd0 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.772+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94449870027248] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.772+0000 7f9639330800 20 remove_watcher() i=6 2024-09-21T09:03:21.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.772+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94449870030416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e6d2f70fd0 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.773+0000 7f9635864640 1 -- 172.21.15.178:0/4112348751 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94449870030416] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f963002a070 con 0x55e6d2f2d6e0 2024-09-21T09:03:21.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.773+0000 7f9639330800 20 remove_watcher() i=7 2024-09-21T09:03:21.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.773+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e6d2f2d6e0 msgr2=0x55e6d2f2fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.773+0000 7f9639330800 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e6d2f2d6e0 0x55e6d2f2fad0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.773+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e6d2f28cd0 msgr2=0x55e6d2f2b190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.773+0000 7f9639330800 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e6d2f28cd0 0x55e6d2f2b190 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.773+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9628050040 msgr2=0x7f962801c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.773+0000 7f9639330800 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9628050040 0x7f962801c610 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.773+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e6d2f32070 msgr2=0x55e6d2f34530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.773+0000 7f9639330800 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e6d2f32070 0x55e6d2f34530 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9500036b90 msgr2=0x7f9500039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9500036b90 0x7f9500039050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f962804b770 tx=0x7f9628032000 comp rx=0 tx=0).stop 2024-09-21T09:03:21.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f15db0 msgr2=0x55e6d2f1d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9634862640 1 -- 172.21.15.178:0/4112348751 reap_dead start 2024-09-21T09:03:21.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f15db0 0x55e6d2f1d2c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9630011b50 tx=0x7f963004cb30 comp rx=0 tx=0).stop 2024-09-21T09:03:21.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 shutdown_connections 2024-09-21T09:03:21.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 --2- 172.21.15.178:0/4112348751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f15db0 0x55e6d2f1d2c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 >> 172.21.15.178:0/4112348751 conn(0x55e6d2f12110 msgr2=0x55e6d2f101e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 shutdown_connections 2024-09-21T09:03:21.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/4112348751 wait complete. 2024-09-21T09:03:21.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/2811571072 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9510036b40 msgr2=0x7f9510039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 --2- 172.21.15.178:0/2811571072 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9510036b40 0x7f9510039000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55e6d2ef5df0 tx=0x7f962801b520 comp rx=0 tx=0).stop 2024-09-21T09:03:21.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/2811571072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f09100 msgr2=0x55e6d2f09520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 --2- 172.21.15.178:0/2811571072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f09100 0x55e6d2f09520 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55e6d2ef5d50 tx=0x7f9630018830 comp rx=0 tx=0).stop 2024-09-21T09:03:21.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/2811571072 shutdown_connections 2024-09-21T09:03:21.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 --2- 172.21.15.178:0/2811571072 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9510036b40 0x7f9510039000 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 --2- 172.21.15.178:0/2811571072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2f09100 0x55e6d2f09520 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/2811571072 >> 172.21.15.178:0/2811571072 conn(0x55e6d2efe090 msgr2=0x55e6d2f00c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/2811571072 shutdown_connections 2024-09-21T09:03:21.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/2811571072 wait complete. 2024-09-21T09:03:21.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e6d2ef7ca0 msgr2=0x55e6d2efa090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e6d2ef7ca0 0x55e6d2efa090 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e6d2dfbd70 msgr2=0x55e6d2ef53f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e6d2dfbd70 0x55e6d2ef53f0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f951c036b90 msgr2=0x7f951c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f951c036b90 0x7f951c039050 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f962c057000 tx=0x7f962c052000 comp rx=0 tx=0).stop 2024-09-21T09:03:21.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2d69640 msgr2=0x55e6d2eee380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.774+0000 7f9639330800 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2d69640 0x55e6d2eee380 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x55e6d2ee7760 tx=0x7f9628000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.775+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 shutdown_connections 2024-09-21T09:03:21.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.775+0000 7f9639330800 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e6d2ef7ca0 0x55e6d2efa090 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.775+0000 7f9639330800 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e6d2dfbd70 0x55e6d2ef53f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.775+0000 7f9639330800 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f951c036b90 0x7f951c039050 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.775+0000 7f9639330800 1 --2- 172.21.15.178:0/1022929306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6d2d69640 0x55e6d2eee380 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.775+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 >> 172.21.15.178:0/1022929306 conn(0x55e6d2defde0 msgr2=0x55e6d2ee0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.775+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 shutdown_connections 2024-09-21T09:03:21.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.775+0000 7f9639330800 1 -- 172.21.15.178:0/1022929306 wait complete. 2024-09-21T09:03:21.785 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-21T09:03:21.760811Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:21.760802Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:21.786 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-21T09:03:21.786 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-21T09:03:21.786 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-21T09:03:21.833 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:21.833 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:21.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.832+0000 7fdf80b26800 1 Processor -- start 2024-09-21T09:03:21.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.832+0000 7fdf80b26800 1 -- start start 2024-09-21T09:03:21.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.833+0000 7fdf80b26800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x559440f48880 0x559440f4ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.833+0000 7fdf80b26800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559440e03b30 con 0x559440eb7eb0 2024-09-21T09:03:21.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.833+0000 7fdf80b26800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x559440de5360 con 0x559440f48880 2024-09-21T09:03:21.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.833+0000 7fdf73fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x559440f48880 0x559440f4ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.833+0000 7fdf7c713640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x559440eb7eb0 0x559440f47160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46856/0 (socket says 172.21.15.178:46856) 2024-09-21T09:03:21.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.833+0000 7fdf7c713640 1 -- 172.21.15.178:0/1112038376 learned_addr learned my addr 172.21.15.178:0/1112038376 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:21.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.833+0000 7fdf73fff640 1 -- 172.21.15.178:0/1112038376 >> v1:172.21.15.44:6789/0 conn(0x559440eb7eb0 legacy=0x559440f47160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.833+0000 7fdf7bf12640 1 -- 172.21.15.178:0/1112038376 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3688330107 0 0) 0x559440e03b30 con 0x559440eb7eb0 2024-09-21T09:03:21.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.833+0000 7fdf73fff640 1 -- 172.21.15.178:0/1112038376 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559440e0be00 con 0x559440f48880 2024-09-21T09:03:21.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.835+0000 7fdf73fff640 1 --2- 172.21.15.178:0/1112038376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440f48880 0x559440f4ac90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400a470 tx=0x7fdf64045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aece267085456e84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.835+0000 7fdf7bf12640 1 -- 172.21.15.178:0/1112038376 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf64053570 con 0x559440f48880 2024-09-21T09:03:21.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.835+0000 7fdf7bf12640 1 -- 172.21.15.178:0/1112038376 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf64058070 con 0x559440f48880 2024-09-21T09:03:21.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.835+0000 7fdf7bf12640 1 -- 172.21.15.178:0/1112038376 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf64053880 con 0x559440f48880 2024-09-21T09:03:21.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.836+0000 7fdf80b26800 1 -- 172.21.15.178:0/1112038376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440f48880 msgr2=0x559440f4ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.836+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1112038376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440f48880 0x559440f4ac90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400a470 tx=0x7fdf64045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:21.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.836+0000 7fdf80b26800 1 -- 172.21.15.178:0/1112038376 shutdown_connections 2024-09-21T09:03:21.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.836+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1112038376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440f48880 0x559440f4ac90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.836+0000 7fdf80b26800 1 -- 172.21.15.178:0/1112038376 >> 172.21.15.178:0/1112038376 conn(0x559440f3ee10 msgr2=0x559440f41230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.836+0000 7fdf80b26800 1 -- 172.21.15.178:0/1112038376 shutdown_connections 2024-09-21T09:03:21.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.836+0000 7fdf80b26800 1 -- 172.21.15.178:0/1112038376 wait complete. 2024-09-21T09:03:21.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.849+0000 7fdf80b26800 1 Processor -- start 2024-09-21T09:03:21.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.849+0000 7fdf80b26800 1 -- start start 2024-09-21T09:03:21.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.849+0000 7fdf80b26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440eb7eb0 0x559440f44a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.849+0000 7fdf80b26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559440e90350 con 0x559440eb7eb0 2024-09-21T09:03:21.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.850+0000 7fdf7c713640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440eb7eb0 0x559440f44a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.850+0000 7fdf7c713640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440eb7eb0 0x559440f44a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43938/0 (socket says 172.21.15.178:43938) 2024-09-21T09:03:21.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.850+0000 7fdf7c713640 1 -- 172.21.15.178:0/1792436503 learned_addr learned my addr 172.21.15.178:0/1792436503 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.850+0000 7fdf7c713640 1 -- 172.21.15.178:0/1792436503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559440dddbc0 con 0x559440eb7eb0 2024-09-21T09:03:21.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.850+0000 7fdf7c713640 1 --2- 172.21.15.178:0/1792436503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440eb7eb0 0x559440f44a90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00b240 tx=0x7fdf6c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f12b630eea61b77 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.850+0000 7fde6a60c640 1 -- 172.21.15.178:0/1792436503 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c008070 con 0x559440eb7eb0 2024-09-21T09:03:21.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.850+0000 7fde6a60c640 1 -- 172.21.15.178:0/1792436503 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf6c00d500 con 0x559440eb7eb0 2024-09-21T09:03:21.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.850+0000 7fde6a60c640 1 -- 172.21.15.178:0/1792436503 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c00d860 con 0x559440eb7eb0 2024-09-21T09:03:21.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.851+0000 7fdf80b26800 1 -- 172.21.15.178:0/1792436503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440eb7eb0 msgr2=0x559440f44a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.851+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1792436503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440eb7eb0 0x559440f44a90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00b240 tx=0x7fdf6c00b700 comp rx=0 tx=0).stop 2024-09-21T09:03:21.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.851+0000 7fdf80b26800 1 -- 172.21.15.178:0/1792436503 shutdown_connections 2024-09-21T09:03:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.851+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1792436503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440eb7eb0 0x559440f44a90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.851+0000 7fdf80b26800 1 -- 172.21.15.178:0/1792436503 >> 172.21.15.178:0/1792436503 conn(0x559440f3ee10 msgr2=0x55944102f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.851+0000 7fdf80b26800 1 -- 172.21.15.178:0/1792436503 shutdown_connections 2024-09-21T09:03:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.851+0000 7fdf80b26800 1 -- 172.21.15.178:0/1792436503 wait complete. 2024-09-21T09:03:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.851+0000 7fdf80b26800 1 Processor -- start 2024-09-21T09:03:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.851+0000 7fdf80b26800 1 -- start start 2024-09-21T09:03:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.851+0000 7fdf80b26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440eb7eb0 0x55944103d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.851+0000 7fdf80b26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559440f4b610 con 0x559440eb7eb0 2024-09-21T09:03:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.852+0000 7fdf7c713640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440eb7eb0 0x55944103d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.852+0000 7fdf7c713640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440eb7eb0 0x55944103d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43950/0 (socket says 172.21.15.178:43950) 2024-09-21T09:03:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.852+0000 7fdf7c713640 1 -- 172.21.15.178:0/3181063336 learned_addr learned my addr 172.21.15.178:0/3181063336 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.852+0000 7fdf7c713640 1 -- 172.21.15.178:0/3181063336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559440df1fe0 con 0x559440eb7eb0 2024-09-21T09:03:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.852+0000 7fdf7c713640 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440eb7eb0 0x55944103d2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c000f60 tx=0x7fdf6c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.852+0000 7fde68e09640 1 -- 172.21.15.178:0/3181063336 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c019870 con 0x559440eb7eb0 2024-09-21T09:03:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.852+0000 7fde68e09640 1 -- 172.21.15.178:0/3181063336 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf6c019a10 con 0x559440eb7eb0 2024-09-21T09:03:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.852+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55944103d830 con 0x559440eb7eb0 2024-09-21T09:03:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.852+0000 7fde68e09640 1 -- 172.21.15.178:0/3181063336 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c019d10 con 0x559440eb7eb0 2024-09-21T09:03:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.852+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55944103dd50 con 0x559440eb7eb0 2024-09-21T09:03:21.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.853+0000 7fde68e09640 1 -- 172.21.15.178:0/3181063336 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdf6c017040 con 0x559440eb7eb0 2024-09-21T09:03:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.853+0000 7fde68e09640 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde64036be0 0x7fde640390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.853+0000 7fde68e09640 1 -- 172.21.15.178:0/3181063336 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fdf6c015020 con 0x559440eb7eb0 2024-09-21T09:03:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.853+0000 7fdf73fff640 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde64036be0 0x7fde640390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.853+0000 7fdf80b26800 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559440f48880 0x559441044360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.853+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5594410448a0 con 0x559440f48880 2024-09-21T09:03:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.853+0000 7fdf7cf14640 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559440f48880 0x559441044360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.854+0000 7fdf73fff640 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde64036be0 0x7fde640390a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdf64057000 tx=0x7fdf64052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.854+0000 7fdf7cf14640 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559440f48880 0x559441044360 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.854+0000 7fdf7cf14640 1 -- 172.21.15.178:0/3181063336 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x559440f48880 2024-09-21T09:03:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.854+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559441041930 con 0x559440f48880 2024-09-21T09:03:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.854+0000 7fdf7cf14640 1 -- 172.21.15.178:0/3181063336 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdf7400a4a0 con 0x559440f48880 2024-09-21T09:03:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.854+0000 7fdf80b26800 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559441046b90 0x559441048f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.854+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559441049620 con 0x559441046b90 2024-09-21T09:03:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.855+0000 7fdf7c713640 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559441046b90 0x559441048f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.855+0000 7fdf7c713640 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559441046b90 0x559441048f80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.855+0000 7fdf7c713640 1 -- 172.21.15.178:0/3181063336 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdf6c02d070 con 0x559441046b90 2024-09-21T09:03:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.855+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559441045a30 con 0x559440f48880 2024-09-21T09:03:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.856+0000 7fdf7cf14640 1 -- 172.21.15.178:0/3181063336 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdf7400a4a0 con 0x559440f48880 2024-09-21T09:03:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.856+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559441045f10 con 0x559440f48880 2024-09-21T09:03:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.856+0000 7fdf7cf14640 1 -- 172.21.15.178:0/3181063336 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdf7400a4a0 con 0x559440f48880 2024-09-21T09:03:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.856+0000 7fdf80b26800 1 Processor -- start 2024-09-21T09:03:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.856+0000 7fdf80b26800 1 -- start start 2024-09-21T09:03:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.857+0000 7fdf80b26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441057fe0 0x559441058400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.857+0000 7fdf80b26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559440ddf580 con 0x559441057fe0 2024-09-21T09:03:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.857+0000 7fdf7cf14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441057fe0 0x559441058400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.857+0000 7fdf7cf14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441057fe0 0x559441058400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43954/0 (socket says 172.21.15.178:43954) 2024-09-21T09:03:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.857+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1308738160 learned_addr learned my addr 172.21.15.178:0/1308738160 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.857+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1308738160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559441058940 con 0x559441057fe0 2024-09-21T09:03:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.857+0000 7fdf7cf14640 1 --2- 172.21.15.178:0/1308738160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441057fe0 0x559441058400 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x55944103e3a0 tx=0x7fdf740188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.857+0000 7fde61ffb640 1 -- 172.21.15.178:0/1308738160 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf74014450 con 0x559441057fe0 2024-09-21T09:03:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.857+0000 7fde61ffb640 1 -- 172.21.15.178:0/1308738160 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf740145f0 con 0x559441057fe0 2024-09-21T09:03:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.857+0000 7fde61ffb640 1 -- 172.21.15.178:0/1308738160 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf740148d0 con 0x559441057fe0 2024-09-21T09:03:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.857+0000 7fdf80b26800 1 -- 172.21.15.178:0/1308738160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559441058bd0 con 0x559441057fe0 2024-09-21T09:03:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.858+0000 7fdf80b26800 1 -- 172.21.15.178:0/1308738160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55944105b8b0 con 0x559441057fe0 2024-09-21T09:03:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.858+0000 7fde61ffb640 1 -- 172.21.15.178:0/1308738160 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdf74011040 con 0x559441057fe0 2024-09-21T09:03:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.858+0000 7fde61ffb640 1 --2- 172.21.15.178:0/1308738160 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde54036b90 0x7fde54039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.858+0000 7fde61ffb640 1 -- 172.21.15.178:0/1308738160 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fdf7401e070 con 0x559441057fe0 2024-09-21T09:03:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.858+0000 7fdf7c713640 1 --2- 172.21.15.178:0/1308738160 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde54036b90 0x7fde54039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.859+0000 7fdf80b26800 1 Processor -- start 2024-09-21T09:03:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.859+0000 7fdf80b26800 1 -- start start 2024-09-21T09:03:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.859+0000 7fdf7c713640 1 --2- 172.21.15.178:0/1308738160 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde54036b90 0x7fde54039050 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x559441044cb0 tx=0x7fdf6c04b670 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.859+0000 7fdf80b26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441064c30 0x559441065030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.859+0000 7fdf80b26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559440f43160 con 0x559441064c30 2024-09-21T09:03:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.859+0000 7fdf7cf14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441064c30 0x559441065030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.859+0000 7fdf7cf14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441064c30 0x559441065030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43956/0 (socket says 172.21.15.178:43956) 2024-09-21T09:03:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.859+0000 7fdf7cf14640 1 -- 172.21.15.178:0/2792007110 learned_addr learned my addr 172.21.15.178:0/2792007110 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.859+0000 7fdf7cf14640 1 -- 172.21.15.178:0/2792007110 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559441065600 con 0x559441064c30 2024-09-21T09:03:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.859+0000 7fdf7cf14640 1 --2- 172.21.15.178:0/2792007110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441064c30 0x559441065030 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdf7404cbb0 tx=0x7fdf74011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d231202365a8dcdb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.860+0000 7fde537fe640 1 -- 172.21.15.178:0/2792007110 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf74013dc0 con 0x559441064c30 2024-09-21T09:03:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.860+0000 7fde537fe640 1 -- 172.21.15.178:0/2792007110 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7404e0d0 con 0x559441064c30 2024-09-21T09:03:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.860+0000 7fde537fe640 1 -- 172.21.15.178:0/2792007110 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf7404e3b0 con 0x559441064c30 2024-09-21T09:03:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.860+0000 7fdf80b26800 1 -- 172.21.15.178:0/2792007110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441064c30 msgr2=0x559441065030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.860+0000 7fdf80b26800 1 --2- 172.21.15.178:0/2792007110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441064c30 0x559441065030 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdf7404cbb0 tx=0x7fdf74011970 comp rx=0 tx=0).stop 2024-09-21T09:03:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.860+0000 7fdf80b26800 1 -- 172.21.15.178:0/2792007110 shutdown_connections 2024-09-21T09:03:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.860+0000 7fdf80b26800 1 --2- 172.21.15.178:0/2792007110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441064c30 0x559441065030 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.860+0000 7fdf80b26800 1 -- 172.21.15.178:0/2792007110 >> 172.21.15.178:0/2792007110 conn(0x559441060fe0 msgr2=0x55944105f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.860+0000 7fdf80b26800 1 -- 172.21.15.178:0/2792007110 shutdown_connections 2024-09-21T09:03:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.860+0000 7fdf80b26800 1 -- 172.21.15.178:0/2792007110 wait complete. 2024-09-21T09:03:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.860+0000 7fdf80b26800 1 Processor -- start 2024-09-21T09:03:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.860+0000 7fdf80b26800 1 -- start start 2024-09-21T09:03:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.861+0000 7fdf80b26800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441064c30 0x55944106c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.861+0000 7fdf80b26800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559441065bd0 con 0x559441064c30 2024-09-21T09:03:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.861+0000 7fdf7cf14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441064c30 0x55944106c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.861+0000 7fdf7cf14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441064c30 0x55944106c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43970/0 (socket says 172.21.15.178:43970) 2024-09-21T09:03:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.861+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 learned_addr learned my addr 172.21.15.178:0/1641321731 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.861+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944106c690 con 0x559441064c30 2024-09-21T09:03:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.861+0000 7fdf7cf14640 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441064c30 0x55944106c150 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdf74011be0 tx=0x7fdf7404cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.861+0000 7fde51ffb640 1 -- 172.21.15.178:0/1641321731 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf74044030 con 0x559441064c30 2024-09-21T09:03:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.861+0000 7fde51ffb640 1 -- 172.21.15.178:0/1641321731 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7402ba60 con 0x559441064c30 2024-09-21T09:03:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.861+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55944106c920 con 0x559441064c30 2024-09-21T09:03:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.861+0000 7fde51ffb640 1 -- 172.21.15.178:0/1641321731 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf7402bd40 con 0x559441064c30 2024-09-21T09:03:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.861+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55944106f5d0 con 0x559441064c30 2024-09-21T09:03:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.862+0000 7fde51ffb640 1 -- 172.21.15.178:0/1641321731 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdf74022a80 con 0x559441064c30 2024-09-21T09:03:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.862+0000 7fde51ffb640 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde44036b90 0x7fde44039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.862+0000 7fde51ffb640 1 -- 172.21.15.178:0/1641321731 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fdf74045070 con 0x559441064c30 2024-09-21T09:03:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.862+0000 7fdf7c713640 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde44036b90 0x7fde44039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.863+0000 7fdf7c713640 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde44036b90 0x7fde44039050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c000fb0 tx=0x7fdf6c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.863+0000 7fdf80b26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.863+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559441077e20 0x55944107a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.863+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55944107aa30 con 0x559441077e20 2024-09-21T09:03:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.863+0000 7fdf73fff640 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559441077e20 0x55944107a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.863+0000 7fdf73fff640 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559441077e20 0x55944107a2e0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.863+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.863+0000 7fdf80b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.863+0000 7fdf80b26800 20 realm 2024-09-21T09:03:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.863+0000 7fdf80b26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55944107ae60 con 0x559441077e20 2024-09-21T09:03:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf80b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf80b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf80b26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55944107b730 con 0x559441077e20 2024-09-21T09:03:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf80b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf80b26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55944107bad0 con 0x559441077e20 2024-09-21T09:03:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf80b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:21.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf80b26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55944107c830 0x55944107ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55944107f230 con 0x55944107c830 2024-09-21T09:03:21.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.864+0000 7fdf7cf14640 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55944107c830 0x55944107ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.865+0000 7fdf7cf14640 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55944107c830 0x55944107ec20 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.865+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.865+0000 7fdf80b26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:21.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.865+0000 7fdf80b26800 20 searching for the correct realm 2024-09-21T09:03:21.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.865+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5594410811c0 0x559441083680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.865+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x5594410811c0 2024-09-21T09:03:21.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.865+0000 7fdf7c713640 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5594410811c0 0x559441083680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.865+0000 7fdf7c713640 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5594410811c0 0x559441083680 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.866+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.866+0000 7fdf7c713640 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fdf6c03d070 0x7fdf6c04b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.866+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x7fdf6c03d070 2024-09-21T09:03:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.866+0000 7fdf73fff640 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fdf6c03d070 0x7fdf6c04b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.866+0000 7fdf73fff640 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fdf6c03d070 0x7fdf6c04b820 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.866+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.866+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x55944107c830 2024-09-21T09:03:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.867+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.867+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x559441077e20 2024-09-21T09:03:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.867+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.867+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x559441077e20 2024-09-21T09:03:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.867+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.867+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x55944107c830 2024-09-21T09:03:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.867+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.867+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x55944107c830 2024-09-21T09:03:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.867+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.868+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x7fdf6c03d070 2024-09-21T09:03:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.868+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.868+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x5594410811c0 2024-09-21T09:03:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.868+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.868+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x559441077e20 2024-09-21T09:03:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.868+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.868+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x55944107c830 2024-09-21T09:03:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.869+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.869+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x559441077e20 2024-09-21T09:03:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.869+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.869+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x7fdf6c03d070 2024-09-21T09:03:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.869+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.869+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x5594410811c0 2024-09-21T09:03:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.869+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.869+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x5594410811c0 2024-09-21T09:03:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.869+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.869+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x55944107c830 2024-09-21T09:03:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.870+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.870+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x5594410811c0 2024-09-21T09:03:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.870+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.870+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x5594410811c0 2024-09-21T09:03:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.870+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.870+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x559441077e20 2024-09-21T09:03:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.870+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.870+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x559441077e20 2024-09-21T09:03:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.871+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.871+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x55944107c830 2024-09-21T09:03:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.871+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.871+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x5594410811c0 2024-09-21T09:03:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.871+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.871+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x7fdf6c03d070 2024-09-21T09:03:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.871+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.871+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x559441077e20 2024-09-21T09:03:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.872+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.872+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x55944107c830 2024-09-21T09:03:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.872+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.872+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x5594410811c0 2024-09-21T09:03:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.872+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.872+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x55944107c830 2024-09-21T09:03:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.873+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.873+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x7fdf6c03d070 2024-09-21T09:03:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.873+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.873+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x5594410811c0 2024-09-21T09:03:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.873+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.873+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x55944107c830 2024-09-21T09:03:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.873+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.873+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x559441077e20 2024-09-21T09:03:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559441083d50 con 0x7fdf6c03d070 2024-09-21T09:03:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf80b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf80b26800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf80b26800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf80b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:21.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf80b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:21.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf80b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:21.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf80b26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559441080710 con 0x559441077e20 2024-09-21T09:03:21.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf80b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf80b26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55944107f6c0 con 0x559441077e20 2024-09-21T09:03:21.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf80b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:21.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf80b26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.874+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559441080080 con 0x559441077e20 2024-09-21T09:03:21.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:21.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 20 zone default found 2024-09-21T09:03:21.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 4 Realm: () 2024-09-21T09:03:21.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:21.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:21.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:21.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 20 zonegroup default 2024-09-21T09:03:21.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559441084680 con 0x55944107c830 2024-09-21T09:03:21.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5594410868b0 con 0x5594410811c0 2024-09-21T09:03:21.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.875+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559441086c50 con 0x5594410811c0 2024-09-21T09:03:21.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.876+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.876+0000 7fdf80b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:21.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.876+0000 7fdf80b26800 20 started sync module instance, tier type = 2024-09-21T09:03:21.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.876+0000 7fdf80b26800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:21.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.876+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559441085d40 con 0x7fdf6c03d070 2024-09-21T09:03:21.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.877+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.877+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94095234589296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559441085d40 con 0x7fdf6c03d070 2024-09-21T09:03:21.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.877+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559441087610 con 0x559441077e20 2024-09-21T09:03:21.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.878+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94095234589296] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.878+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.878+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94095234593600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559441085d40 con 0x559441077e20 2024-09-21T09:03:21.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.878+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559441088090 con 0x5594410811c0 2024-09-21T09:03:21.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.879+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94095234593600] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.879+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.879+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94095234586768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559441085cb0 con 0x5594410811c0 2024-09-21T09:03:21.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.879+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559441088f00 con 0x7fdf6c03d070 2024-09-21T09:03:21.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.880+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94095234586768] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.880+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.880+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94095234599504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559441089320 con 0x7fdf6c03d070 2024-09-21T09:03:21.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.880+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559441089ce0 con 0x559441077e20 2024-09-21T09:03:21.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.882+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94095234599504] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.882+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.882+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94095234601040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559441089ce0 con 0x559441077e20 2024-09-21T09:03:21.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.882+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55944108a6a0 con 0x55944107c830 2024-09-21T09:03:21.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.883+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94095234601040] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.883+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.883+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94095234603056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559441089c50 con 0x55944107c830 2024-09-21T09:03:21.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.883+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55944108b420 con 0x55944107c830 2024-09-21T09:03:21.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.884+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94095234603056] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.884+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.884+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94095234607680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55944108b3e0 con 0x55944107c830 2024-09-21T09:03:21.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.884+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55944108be80 con 0x55944107c830 2024-09-21T09:03:21.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.885+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.885+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94095234611536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55944108c2f0 con 0x55944107c830 2024-09-21T09:03:21.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.885+0000 7fdf80b26800 20 add_watcher() i=0 2024-09-21T09:03:21.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.885+0000 7fdf80b26800 20 add_watcher() i=1 2024-09-21T09:03:21.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.885+0000 7fdf80b26800 20 add_watcher() i=2 2024-09-21T09:03:21.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.885+0000 7fdf80b26800 20 add_watcher() i=3 2024-09-21T09:03:21.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.885+0000 7fdf80b26800 20 add_watcher() i=4 2024-09-21T09:03:21.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.885+0000 7fdf80b26800 20 add_watcher() i=5 2024-09-21T09:03:21.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.885+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94095234607680] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.885+0000 7fdf80b26800 20 add_watcher() i=6 2024-09-21T09:03:21.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.886+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94095234611536] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.886+0000 7fdf80b26800 20 add_watcher() i=7 2024-09-21T09:03:21.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.886+0000 7fdf80b26800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:21.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.886+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55944108c2f0 con 0x559441077e20 2024-09-21T09:03:21.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.886+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.886+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94095234612800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55944108c260 con 0x559441077e20 2024-09-21T09:03:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.887+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94095234612800] v29'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.887+0000 7fde327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.887+0000 7fdf80b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.887+0000 7fdf80b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.887+0000 7fdf80b26800 5 note: GC not initialized 2024-09-21T09:03:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.888+0000 7fde317e2640 20 reqs_thread_entry: start 2024-09-21T09:03:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.888+0000 7fdf80b26800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.888+0000 7fdf80b26800 20 Filter name: none 2024-09-21T09:03:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.888+0000 7fdda2ffd640 20 reqs_thread_entry: start 2024-09-21T09:03:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.888+0000 7fdf80b26800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-21T09:03:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.888+0000 7fdf80b26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.888+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5594410c2960 con 0x55944107c830 2024-09-21T09:03:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf80b26800 20 rados_obj.operate() r=0 bl.length=419 2024-09-21T09:03:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf80b26800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-21T09:03:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf80b26800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-21T09:03:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf80b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf80b26800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T09:03:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf80b26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5594410c23b0 con 0x7fdf6c03d070 2024-09-21T09:03:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf80b26800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf80b26800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T09:03:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf80b26800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf80b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 : miss 2024-09-21T09:03:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf80b26800 20 rados->read ofs=0 len=0 2024-09-21T09:03:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.889+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5594410c6080 con 0x55944107c830 2024-09-21T09:03:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.890+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(64 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.890+0000 7fdf80b26800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.890+0000 7fdf80b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.890+0000 7fdf80b26800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.890+0000 7fdf80b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.890+0000 7fdf80b26800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.890+0000 7fdf80b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 2024-09-21T09:03:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.890+0000 7fdf80b26800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-21T09:03:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.890+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410ca440 con 0x7fdf6c03d070 2024-09-21T09:03:21.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.891+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(65 foo.buckets [call] v29'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.891+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 8.16 8:6a2d24de:root::.bucket.meta.testx%3amyfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410cdd30 con 0x5594410811c0 2024-09-21T09:03:21.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.892+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [create,call,writefull 0~412,setxattr (203)] v29'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.892+0000 7fdf80b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x7 2024-09-21T09:03:21.915 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.892+0000 7fdf80b26800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:21.915 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.892+0000 7fdf80b26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-21T09:03:21.915 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.892+0000 7fdf80b26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1, ofs0, ns] 2024-09-21T09:03:21.915 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.892+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94095234874208 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5594410cd880 con 0x559441077e20 2024-09-21T09:03:21.915 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.892+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== watch-notify(notify (1) cookie 94095234601040 notify 124554051595 ret 0) ==== 889+0+0 (crc 0 0 0) 0x559440e0be00 con 0x559441077e20 2024-09-21T09:03:21.915 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.892+0000 7fde537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051595 cookie 94095234601040 notifier 4546 bl.length()=847 2024-09-21T09:03:21.915 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.892+0000 7fde537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x7 2024-09-21T09:03:21.915 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.892+0000 7fde537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:21.915 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.892+0000 7fde537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-21T09:03:21.915 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.892+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(67 notify.4 [notify cookie 94095234874208 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.915 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.892+0000 7fde537fe640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fde40003ea0 con 0x559441077e20 2024-09-21T09:03:21.915 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.893+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.915 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.893+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== watch-notify(notify_complete (2) cookie 94095234874208 notify 124554051595 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdf64087510 con 0x559441077e20 2024-09-21T09:03:21.915 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.893+0000 7fdf80b26800 20 handle_bi_update(): bucket=testx:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): orig_sources= new_sources= 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.893+0000 7fdf80b26800 20 handle_bi_update(): bucket=testx:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): potential sources added=[] removed=[] 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.893+0000 7fdf80b26800 20 handle_bi_update(): bucket=testx:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): orig_dests= new_dests= 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.893+0000 7fdf80b26800 20 handle_bi_update(): bucket=testx:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): potential dests added=[] removed=[] 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.893+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410cd960 con 0x559441077e20 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.894+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v29'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.894+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410cd960 con 0x559441077e20 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.895+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v29'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.895+0000 7fdf80b26800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.895+0000 7fdf80b26800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.895+0000 7fdf80b26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.895+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94095234880688 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5594410cd8d0 con 0x559441077e20 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.895+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== watch-notify(notify (1) cookie 94095234601040 notify 124554051596 ret 0) ==== 390+0+0 (crc 0 0 0) 0x5594410ce3e0 con 0x559441077e20 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.895+0000 7fde52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051596 cookie 94095234601040 notifier 4546 bl.length()=348 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.895+0000 7fde52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-21T09:03:21.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.895+0000 7fde52ffd640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-21T09:03:21.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.895+0000 7fde52ffd640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fddb0003400 con 0x559441077e20 2024-09-21T09:03:21.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.895+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(71 notify.4 [notify cookie 94095234880688 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.895+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.895+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== watch-notify(notify_complete (2) cookie 94095234880688 notify 124554051596 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5594410ccb70 con 0x559441077e20 2024-09-21T09:03:21.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.896+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410cd960 con 0x7fdf6c03d070 2024-09-21T09:03:21.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.897+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(73 myfoo [call,delete] v29'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.897+0000 7fdf80b26800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-21T09:03:21.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.897+0000 7fdf80b26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T09:03:21.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.897+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94095234880688 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5594410cd8d0 con 0x55944107c830 2024-09-21T09:03:21.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.897+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== watch-notify(notify (1) cookie 94095234607680 notify 124554051595 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5594410c5700 con 0x55944107c830 2024-09-21T09:03:21.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.897+0000 7fde537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051595 cookie 94095234607680 notifier 4546 bl.length()=149 2024-09-21T09:03:21.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.897+0000 7fde537fe640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fde40003ea0 con 0x55944107c830 2024-09-21T09:03:21.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.897+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(74 notify.6 [notify cookie 94095234880688 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.897+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.897+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== watch-notify(notify_complete (2) cookie 94095234880688 notify 124554051595 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55944106c920 con 0x55944107c830 2024-09-21T09:03:21.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.897+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410cd960 con 0x55944107c830 2024-09-21T09:03:21.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.899+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(76 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call,delete] v29'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.899+0000 7fdf80b26800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 from cache 2024-09-21T09:03:21.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.899+0000 7fdf80b26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1, ofs0, ns] 2024-09-21T09:03:21.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.899+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 94095234849104 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5594410cd960 con 0x55944107c830 2024-09-21T09:03:21.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.899+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== watch-notify(notify (1) cookie 94095234603056 notify 124554051596 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55944106c920 con 0x55944107c830 2024-09-21T09:03:21.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.899+0000 7fde52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051596 cookie 94095234603056 notifier 4546 bl.length()=206 2024-09-21T09:03:21.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.899+0000 7fde52ffd640 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fddb0003400 con 0x55944107c830 2024-09-21T09:03:21.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.899+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(77 notify.5 [notify cookie 94095234849104 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.899+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.899+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== watch-notify(notify_complete (2) cookie 94095234849104 notify 124554051596 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55944106c690 con 0x55944107c830 2024-09-21T09:03:21.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.900+0000 7fde327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:21.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.900+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94095234612800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410c0510 con 0x559441077e20 2024-09-21T09:03:21.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.901+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94095234612800] v29'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.901+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94095234589296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410c0510 con 0x7fdf6c03d070 2024-09-21T09:03:21.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.902+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94095234589296] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.902+0000 7fdf80b26800 20 remove_watcher() i=0 2024-09-21T09:03:21.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.902+0000 7fdf80b26800 2 removed watcher, disabling cache 2024-09-21T09:03:21.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.902+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94095234593600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410c0510 con 0x559441077e20 2024-09-21T09:03:21.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.903+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94095234593600] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.903+0000 7fdf80b26800 20 remove_watcher() i=1 2024-09-21T09:03:21.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.903+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94095234586768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410c0510 con 0x5594410811c0 2024-09-21T09:03:21.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.904+0000 7fdf7c713640 1 -- 172.21.15.178:0/1641321731 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94095234586768] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf6c044d70 con 0x5594410811c0 2024-09-21T09:03:21.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.904+0000 7fdf80b26800 20 remove_watcher() i=2 2024-09-21T09:03:21.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.904+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94095234599504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410ab180 con 0x7fdf6c03d070 2024-09-21T09:03:21.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.905+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94095234599504] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x7fdf6c03d070 2024-09-21T09:03:21.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.905+0000 7fdf80b26800 20 remove_watcher() i=3 2024-09-21T09:03:21.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.905+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94095234601040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410ab180 con 0x559441077e20 2024-09-21T09:03:21.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.907+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94095234601040] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf64051070 con 0x559441077e20 2024-09-21T09:03:21.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.907+0000 7fdf80b26800 20 remove_watcher() i=4 2024-09-21T09:03:21.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.907+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94095234603056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410ab180 con 0x55944107c830 2024-09-21T09:03:21.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.908+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94095234603056] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.908+0000 7fdf80b26800 20 remove_watcher() i=5 2024-09-21T09:03:21.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.908+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94095234607680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410ab180 con 0x55944107c830 2024-09-21T09:03:21.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.909+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94095234607680] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.909+0000 7fdf80b26800 20 remove_watcher() i=6 2024-09-21T09:03:21.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.909+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94095234611536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5594410ab180 con 0x55944107c830 2024-09-21T09:03:21.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf7cf14640 1 -- 172.21.15.178:0/1641321731 <== osd.0 v2:172.21.15.44:6800/2732047064 31 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94095234611536] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7402a070 con 0x55944107c830 2024-09-21T09:03:21.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 20 remove_watcher() i=7 2024-09-21T09:03:21.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55944107c830 msgr2=0x55944107ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55944107c830 0x55944107ec20 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559441077e20 msgr2=0x55944107a2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559441077e20 0x55944107a2e0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fdf6c03d070 msgr2=0x7fdf6c04b820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fdf6c03d070 0x7fdf6c04b820 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5594410811c0 msgr2=0x559441083680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5594410811c0 0x559441083680 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde44036b90 msgr2=0x7fde44039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde44036b90 0x7fde44039050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c000fb0 tx=0x7fdf6c032000 comp rx=0 tx=0).stop 2024-09-21T09:03:21.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441064c30 msgr2=0x55944106c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1641321731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441064c30 0x55944106c150 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdf74011be0 tx=0x7fdf7404cb10 comp rx=0 tx=0).stop 2024-09-21T09:03:21.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf73fff640 1 -- 172.21.15.178:0/1641321731 reap_dead start 2024-09-21T09:03:21.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 shutdown_connections 2024-09-21T09:03:21.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 >> 172.21.15.178:0/1641321731 conn(0x559441060fe0 msgr2=0x559441066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 shutdown_connections 2024-09-21T09:03:21.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.910+0000 7fdf80b26800 1 -- 172.21.15.178:0/1641321731 wait complete. 2024-09-21T09:03:21.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 -- 172.21.15.178:0/1308738160 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde54036b90 msgr2=0x7fde54039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1308738160 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde54036b90 0x7fde54039050 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x559441044cb0 tx=0x7fdf6c04b670 comp rx=0 tx=0).stop 2024-09-21T09:03:21.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 -- 172.21.15.178:0/1308738160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441057fe0 msgr2=0x559441058400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1308738160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441057fe0 0x559441058400 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x55944103e3a0 tx=0x7fdf740188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 -- 172.21.15.178:0/1308738160 shutdown_connections 2024-09-21T09:03:21.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1308738160 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde54036b90 0x7fde54039050 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 --2- 172.21.15.178:0/1308738160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559441057fe0 0x559441058400 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 -- 172.21.15.178:0/1308738160 >> 172.21.15.178:0/1308738160 conn(0x55944104cf70 msgr2=0x55944104faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 -- 172.21.15.178:0/1308738160 shutdown_connections 2024-09-21T09:03:21.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 -- 172.21.15.178:0/1308738160 wait complete. 2024-09-21T09:03:21.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559441046b90 msgr2=0x559441048f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559441046b90 0x559441048f80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559440f48880 msgr2=0x559441044360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559440f48880 0x559441044360 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde64036be0 msgr2=0x7fde640390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde64036be0 0x7fde640390a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdf64057000 tx=0x7fdf64052000 comp rx=0 tx=0).stop 2024-09-21T09:03:21.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440eb7eb0 msgr2=0x55944103d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440eb7eb0 0x55944103d2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c000f60 tx=0x7fdf6c000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 shutdown_connections 2024-09-21T09:03:21.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559441046b90 0x559441048f80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559440f48880 0x559441044360 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fde64036be0 0x7fde640390a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 --2- 172.21.15.178:0/3181063336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559440eb7eb0 0x55944103d2f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.926 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 >> 172.21.15.178:0/3181063336 conn(0x559440f3ee10 msgr2=0x55944102ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.926 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 shutdown_connections 2024-09-21T09:03:21.926 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.911+0000 7fdf80b26800 1 -- 172.21.15.178:0/3181063336 wait complete. 2024-09-21T09:03:21.927 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-21T09:03:21.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-21T09:03:21.927 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-21T09:03:21.970 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:21.970 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:21.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.969+0000 7f40d2011800 1 Processor -- start 2024-09-21T09:03:21.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.969+0000 7f40d2011800 1 -- start start 2024-09-21T09:03:21.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.969+0000 7f40d2011800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55fec02cd9f0 0x55fec02cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.969+0000 7f40d2011800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fec0188b30 con 0x55fec023d5b0 2024-09-21T09:03:21.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.969+0000 7f40d2011800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55fec016a360 con 0x55fec02cd9f0 2024-09-21T09:03:21.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.969+0000 7f40ccf9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55fec02cd9f0 0x55fec02cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.969+0000 7f40ccf9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55fec02cd9f0 0x55fec02cfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43986/0 (socket says 172.21.15.178:43986) 2024-09-21T09:03:21.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.969+0000 7f40cd79c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55fec023d5b0 0x55fec02cc2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46858/0 (socket says 172.21.15.178:46858) 2024-09-21T09:03:21.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.969+0000 7f40ccf9b640 1 -- 172.21.15.178:0/2397216839 learned_addr learned my addr 172.21.15.178:0/2397216839 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.970+0000 7f40ccf9b640 1 -- 172.21.15.178:0/2397216839 >> v1:172.21.15.44:6789/0 conn(0x55fec023d5b0 legacy=0x55fec02cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.970+0000 7f40ccf9b640 1 -- 172.21.15.178:0/2397216839 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fec0190e00 con 0x55fec02cd9f0 2024-09-21T09:03:21.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.971+0000 7f40ccf9b640 1 --2- 172.21.15.178:0/2397216839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec02cd9f0 0x55fec02cfde0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f40c400a520 tx=0x7f40c4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a734e4066605f66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.972+0000 7f40bffff640 1 -- 172.21.15.178:0/2397216839 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c4055070 con 0x55fec02cd9f0 2024-09-21T09:03:21.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.972+0000 7f40bffff640 1 -- 172.21.15.178:0/2397216839 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c40515b0 con 0x55fec02cd9f0 2024-09-21T09:03:21.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.972+0000 7f40bffff640 1 -- 172.21.15.178:0/2397216839 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c40518d0 con 0x55fec02cd9f0 2024-09-21T09:03:21.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.972+0000 7f40d2011800 1 -- 172.21.15.178:0/2397216839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec02cd9f0 msgr2=0x55fec02cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.972+0000 7f40d2011800 1 --2- 172.21.15.178:0/2397216839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec02cd9f0 0x55fec02cfde0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f40c400a520 tx=0x7f40c4045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.972+0000 7f40d2011800 1 -- 172.21.15.178:0/2397216839 shutdown_connections 2024-09-21T09:03:21.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.972+0000 7f40d2011800 1 --2- 172.21.15.178:0/2397216839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec02cd9f0 0x55fec02cfde0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.972+0000 7f40d2011800 1 -- 172.21.15.178:0/2397216839 >> 172.21.15.178:0/2397216839 conn(0x55fec02c3de0 msgr2=0x55fec02c6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.972+0000 7f40d2011800 1 -- 172.21.15.178:0/2397216839 shutdown_connections 2024-09-21T09:03:21.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.972+0000 7f40d2011800 1 -- 172.21.15.178:0/2397216839 wait complete. 2024-09-21T09:03:21.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.986+0000 7f40d2011800 1 Processor -- start 2024-09-21T09:03:21.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.986+0000 7f40d2011800 1 -- start start 2024-09-21T09:03:21.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.986+0000 7f40d2011800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec023d5b0 0x55fec03b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.986+0000 7f40d2011800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fec0215330 con 0x55fec023d5b0 2024-09-21T09:03:21.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.986+0000 7f40cd79c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec023d5b0 0x55fec03b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.986+0000 7f40cd79c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec023d5b0 0x55fec03b88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:43998/0 (socket says 172.21.15.178:43998) 2024-09-21T09:03:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.986+0000 7f40cd79c640 1 -- 172.21.15.178:0/1438544023 learned_addr learned my addr 172.21.15.178:0/1438544023 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.987+0000 7f40cd79c640 1 -- 172.21.15.178:0/1438544023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fec0162bc0 con 0x55fec023d5b0 2024-09-21T09:03:21.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.987+0000 7f40cd79c640 1 --2- 172.21.15.178:0/1438544023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec023d5b0 0x55fec03b88f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f40c000b230 tx=0x7f40c000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8aab3a31b471051 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.987+0000 7f3fbb606640 1 -- 172.21.15.178:0/1438544023 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c000e5c0 con 0x55fec023d5b0 2024-09-21T09:03:21.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.987+0000 7f3fbb606640 1 -- 172.21.15.178:0/1438544023 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c0006070 con 0x55fec023d5b0 2024-09-21T09:03:21.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.987+0000 7f3fbb606640 1 -- 172.21.15.178:0/1438544023 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c000e890 con 0x55fec023d5b0 2024-09-21T09:03:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.988+0000 7f40d2011800 1 -- 172.21.15.178:0/1438544023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec023d5b0 msgr2=0x55fec03b88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.988+0000 7f40d2011800 1 --2- 172.21.15.178:0/1438544023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec023d5b0 0x55fec03b88f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f40c000b230 tx=0x7f40c000b6f0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.988+0000 7f40d2011800 1 -- 172.21.15.178:0/1438544023 shutdown_connections 2024-09-21T09:03:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.988+0000 7f40d2011800 1 --2- 172.21.15.178:0/1438544023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec023d5b0 0x55fec03b88f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.988+0000 7f40d2011800 1 -- 172.21.15.178:0/1438544023 >> 172.21.15.178:0/1438544023 conn(0x55fec02c3de0 msgr2=0x55fec03b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.988+0000 7f40d2011800 1 -- 172.21.15.178:0/1438544023 shutdown_connections 2024-09-21T09:03:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.988+0000 7f40d2011800 1 -- 172.21.15.178:0/1438544023 wait complete. 2024-09-21T09:03:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.988+0000 7f40d2011800 1 Processor -- start 2024-09-21T09:03:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.988+0000 7f40d2011800 1 -- start start 2024-09-21T09:03:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.988+0000 7f40d2011800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec023d5b0 0x55fec03c0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.988+0000 7f40d2011800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fec02d06b0 con 0x55fec023d5b0 2024-09-21T09:03:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.989+0000 7f40cd79c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec023d5b0 0x55fec03c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.989+0000 7f40cd79c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec023d5b0 0x55fec03c0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44004/0 (socket says 172.21.15.178:44004) 2024-09-21T09:03:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.989+0000 7f40cd79c640 1 -- 172.21.15.178:0/2652247464 learned_addr learned my addr 172.21.15.178:0/2652247464 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.989+0000 7f40cd79c640 1 -- 172.21.15.178:0/2652247464 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fec0176fe0 con 0x55fec023d5b0 2024-09-21T09:03:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.989+0000 7f40cd79c640 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec023d5b0 0x55fec03c0320 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f40c0000fd0 tx=0x7f40c0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.989+0000 7f3fb9e03640 1 -- 172.21.15.178:0/2652247464 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c000f8d0 con 0x55fec023d5b0 2024-09-21T09:03:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.989+0000 7f3fb9e03640 1 -- 172.21.15.178:0/2652247464 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c000fa90 con 0x55fec023d5b0 2024-09-21T09:03:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.989+0000 7f3fb9e03640 1 -- 172.21.15.178:0/2652247464 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c000fdb0 con 0x55fec023d5b0 2024-09-21T09:03:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.989+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fec03c0860 con 0x55fec023d5b0 2024-09-21T09:03:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.989+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fec03c0d80 con 0x55fec023d5b0 2024-09-21T09:03:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.990+0000 7f3fb9e03640 1 -- 172.21.15.178:0/2652247464 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f40c0017070 con 0x55fec023d5b0 2024-09-21T09:03:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.990+0000 7f3fb9e03640 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3fb4036b40 0x7f3fb4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.990+0000 7f3fb9e03640 1 -- 172.21.15.178:0/2652247464 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f40c0015020 con 0x55fec023d5b0 2024-09-21T09:03:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.990+0000 7f40ccf9b640 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3fb4036b40 0x7f3fb4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.990+0000 7f40d2011800 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fec02cd9f0 0x55fec03c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:21.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.990+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec03c7910 con 0x55fec02cd9f0 2024-09-21T09:03:21.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.991+0000 7f40cdf9d640 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fec02cd9f0 0x55fec03c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:21.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.991+0000 7f40ccf9b640 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3fb4036b40 0x7f3fb4039000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f40c4057000 tx=0x7f40c4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:21.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.991+0000 7f40cdf9d640 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fec02cd9f0 0x55fec03c7390 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.991+0000 7f40cdf9d640 1 -- 172.21.15.178:0/2652247464 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c800a4a0 con 0x55fec02cd9f0 2024-09-21T09:03:22.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.991+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec03c4960 con 0x55fec02cd9f0 2024-09-21T09:03:22.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.991+0000 7f40cdf9d640 1 -- 172.21.15.178:0/2652247464 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40c800a4a0 con 0x55fec02cd9f0 2024-09-21T09:03:22.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.991+0000 7f40d2011800 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fec03c9c40 0x55fec03cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.991+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec03cc720 con 0x55fec03c9c40 2024-09-21T09:03:22.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.992+0000 7f40cd79c640 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fec03c9c40 0x55fec03cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.992+0000 7f40cd79c640 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fec03c9c40 0x55fec03cc030 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.992+0000 7f40cd79c640 1 -- 172.21.15.178:0/2652247464 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f40c002e070 con 0x55fec03c9c40 2024-09-21T09:03:22.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.992+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec03c8ae0 con 0x55fec02cd9f0 2024-09-21T09:03:22.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.993+0000 7f40cdf9d640 1 -- 172.21.15.178:0/2652247464 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40c800a4a0 con 0x55fec02cd9f0 2024-09-21T09:03:22.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.993+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec03c8fc0 con 0x55fec02cd9f0 2024-09-21T09:03:22.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.993+0000 7f40cdf9d640 1 -- 172.21.15.178:0/2652247464 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40c800a4a0 con 0x55fec02cd9f0 2024-09-21T09:03:22.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.993+0000 7f40d2011800 1 Processor -- start 2024-09-21T09:03:22.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.993+0000 7f40d2011800 1 -- start start 2024-09-21T09:03:22.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.993+0000 7f40d2011800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03db0a0 0x55fec03db4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.993+0000 7f40d2011800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fec0164580 con 0x55fec03db0a0 2024-09-21T09:03:22.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.994+0000 7f40cdf9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03db0a0 0x55fec03db4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.994+0000 7f40cdf9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03db0a0 0x55fec03db4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44020/0 (socket says 172.21.15.178:44020) 2024-09-21T09:03:22.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.994+0000 7f40cdf9d640 1 -- 172.21.15.178:0/2571918310 learned_addr learned my addr 172.21.15.178:0/2571918310 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.994+0000 7f40cdf9d640 1 -- 172.21.15.178:0/2571918310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fec03dba00 con 0x55fec03db0a0 2024-09-21T09:03:22.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.994+0000 7f40cdf9d640 1 --2- 172.21.15.178:0/2571918310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03db0a0 0x55fec03db4c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x55fec03c7cf0 tx=0x7f40c8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.994+0000 7f3fb2ffd640 1 -- 172.21.15.178:0/2571918310 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c8014450 con 0x55fec03db0a0 2024-09-21T09:03:22.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.994+0000 7f3fb2ffd640 1 -- 172.21.15.178:0/2571918310 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c8014610 con 0x55fec03db0a0 2024-09-21T09:03:22.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.994+0000 7f40d2011800 1 -- 172.21.15.178:0/2571918310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fec03dbc90 con 0x55fec03db0a0 2024-09-21T09:03:22.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.994+0000 7f3fb2ffd640 1 -- 172.21.15.178:0/2571918310 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c8014930 con 0x55fec03db0a0 2024-09-21T09:03:22.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.994+0000 7f40d2011800 1 -- 172.21.15.178:0/2571918310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fec03de970 con 0x55fec03db0a0 2024-09-21T09:03:22.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.995+0000 7f3fb2ffd640 1 -- 172.21.15.178:0/2571918310 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f40c8011040 con 0x55fec03db0a0 2024-09-21T09:03:22.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.995+0000 7f3fb2ffd640 1 --2- 172.21.15.178:0/2571918310 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3fa8036b90 0x7f3fa8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.995+0000 7f3fb2ffd640 1 -- 172.21.15.178:0/2571918310 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f40c801e070 con 0x55fec03db0a0 2024-09-21T09:03:22.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.995+0000 7f40cd79c640 1 --2- 172.21.15.178:0/2571918310 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3fa8036b90 0x7f3fa8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.995+0000 7f40d2011800 1 Processor -- start 2024-09-21T09:03:22.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.995+0000 7f40d2011800 1 -- start start 2024-09-21T09:03:22.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.995+0000 7f40cd79c640 1 --2- 172.21.15.178:0/2571918310 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3fa8036b90 0x7f3fa8039050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55fec03c7d90 tx=0x7f40c004b690 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.996+0000 7f40d2011800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03e7d00 0x55fec03e8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.996+0000 7f40d2011800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fec03b90a0 con 0x55fec03e7d00 2024-09-21T09:03:22.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.996+0000 7f40cdf9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03e7d00 0x55fec03e8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.996+0000 7f40cdf9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03e7d00 0x55fec03e8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44032/0 (socket says 172.21.15.178:44032) 2024-09-21T09:03:22.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.996+0000 7f40cdf9d640 1 -- 172.21.15.178:0/4289852202 learned_addr learned my addr 172.21.15.178:0/4289852202 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.996+0000 7f40cdf9d640 1 -- 172.21.15.178:0/4289852202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fec03e86d0 con 0x55fec03e7d00 2024-09-21T09:03:22.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.996+0000 7f40cdf9d640 1 --2- 172.21.15.178:0/4289852202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03e7d00 0x55fec03e8100 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f40c804cbc0 tx=0x7f40c8011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baad81afbf87598d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.996+0000 7f3fb0ff9640 1 -- 172.21.15.178:0/4289852202 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c8040150 con 0x55fec03e7d00 2024-09-21T09:03:22.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.996+0000 7f3fb0ff9640 1 -- 172.21.15.178:0/4289852202 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c80167e0 con 0x55fec03e7d00 2024-09-21T09:03:22.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.996+0000 7f3fb0ff9640 1 -- 172.21.15.178:0/4289852202 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c8014ad0 con 0x55fec03e7d00 2024-09-21T09:03:22.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.997+0000 7f40d2011800 1 -- 172.21.15.178:0/4289852202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03e7d00 msgr2=0x55fec03e8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.997+0000 7f40d2011800 1 --2- 172.21.15.178:0/4289852202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03e7d00 0x55fec03e8100 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f40c804cbc0 tx=0x7f40c8011b10 comp rx=0 tx=0).stop 2024-09-21T09:03:22.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.997+0000 7f40d2011800 1 -- 172.21.15.178:0/4289852202 shutdown_connections 2024-09-21T09:03:22.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.997+0000 7f40d2011800 1 --2- 172.21.15.178:0/4289852202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03e7d00 0x55fec03e8100 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.997+0000 7f40d2011800 1 -- 172.21.15.178:0/4289852202 >> 172.21.15.178:0/4289852202 conn(0x55fec03e4060 msgr2=0x55fec03e2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.997+0000 7f40d2011800 1 -- 172.21.15.178:0/4289852202 shutdown_connections 2024-09-21T09:03:22.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.997+0000 7f40d2011800 1 -- 172.21.15.178:0/4289852202 wait complete. 2024-09-21T09:03:22.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.997+0000 7f40d2011800 1 Processor -- start 2024-09-21T09:03:22.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.997+0000 7f40d2011800 1 -- start start 2024-09-21T09:03:22.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.997+0000 7f40d2011800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03e7d00 0x55fec03ef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.997+0000 7f40d2011800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fec03e8d40 con 0x55fec03e7d00 2024-09-21T09:03:22.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.997+0000 7f40cdf9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03e7d00 0x55fec03ef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.997+0000 7f40cdf9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03e7d00 0x55fec03ef1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44034/0 (socket says 172.21.15.178:44034) 2024-09-21T09:03:22.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.997+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 learned_addr learned my addr 172.21.15.178:0/1991153140 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.998+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fec03ef6f0 con 0x55fec03e7d00 2024-09-21T09:03:22.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.998+0000 7f40cdf9d640 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03e7d00 0x55fec03ef1b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f40c8011fd0 tx=0x7f40c804cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.998+0000 7f3f9effd640 1 -- 172.21.15.178:0/1991153140 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c8011510 con 0x55fec03e7d00 2024-09-21T09:03:22.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.998+0000 7f3f9effd640 1 -- 172.21.15.178:0/1991153140 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c80116b0 con 0x55fec03e7d00 2024-09-21T09:03:22.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.998+0000 7f3f9effd640 1 -- 172.21.15.178:0/1991153140 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c804e0d0 con 0x55fec03e7d00 2024-09-21T09:03:22.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.998+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fec03ef980 con 0x55fec03e7d00 2024-09-21T09:03:22.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.998+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fec03f2630 con 0x55fec03e7d00 2024-09-21T09:03:22.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.999+0000 7f3f9effd640 1 -- 172.21.15.178:0/1991153140 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f40c804e270 con 0x55fec03e7d00 2024-09-21T09:03:22.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.999+0000 7f3f9effd640 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3f98036b90 0x7f3f98039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.999+0000 7f3f9effd640 1 -- 172.21.15.178:0/1991153140 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f40c8033030 con 0x55fec03e7d00 2024-09-21T09:03:22.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.999+0000 7f40cd79c640 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3f98036b90 0x7f3f98039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.999+0000 7f40d2011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.999+0000 7f40d2011800 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fec03fad70 0x55fec03fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.999+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec03fd980 con 0x55fec03fad70 2024-09-21T09:03:22.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:21.999+0000 7f40ccf9b640 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fec03fad70 0x55fec03fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.000+0000 7f40cd79c640 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3f98036b90 0x7f3f98039050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f40c000efb0 tx=0x7f40c0035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.000+0000 7f40ccf9b640 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fec03fad70 0x55fec03fd230 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.000+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.000+0000 7f40d2011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.000+0000 7f40d2011800 20 realm 2024-09-21T09:03:22.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.000+0000 7f40d2011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.000+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec03fddb0 con 0x55fec03fad70 2024-09-21T09:03:22.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.000+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.000+0000 7f40d2011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.000+0000 7f40d2011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.000+0000 7f40d2011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.000+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec03fe680 con 0x55fec03fad70 2024-09-21T09:03:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.001+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.001+0000 7f40d2011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.001+0000 7f40d2011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.001+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec03fea20 con 0x55fec03fad70 2024-09-21T09:03:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.001+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.001+0000 7f40d2011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.001+0000 7f40d2011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.001+0000 7f40d2011800 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fec03ff780 0x55fec0401b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.001+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec04020b0 con 0x55fec03ff780 2024-09-21T09:03:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.001+0000 7f40cdf9d640 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fec03ff780 0x55fec0401b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.001+0000 7f40cdf9d640 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fec03ff780 0x55fec0401b70 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.002+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.002+0000 7f40d2011800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.002+0000 7f40d2011800 20 searching for the correct realm 2024-09-21T09:03:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.002+0000 7f40d2011800 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fec04040f0 0x55fec04065b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.002+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec04040f0 2024-09-21T09:03:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.002+0000 7f40cd79c640 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fec04040f0 0x55fec04065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.002+0000 7f40cd79c640 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fec04040f0 0x55fec04065b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.002+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c002e070 con 0x55fec04040f0 2024-09-21T09:03:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.002+0000 7f40cd79c640 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f40c000f070 0x7f40c001c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.002+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x7f40c000f070 2024-09-21T09:03:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.003+0000 7f40ccf9b640 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f40c000f070 0x7f40c001c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.003+0000 7f40ccf9b640 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f40c000f070 0x7f40c001c620 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.003+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4057030 con 0x7f40c000f070 2024-09-21T09:03:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.003+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03ff780 2024-09-21T09:03:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.004+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.004+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03fad70 2024-09-21T09:03:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.004+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.004+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03fad70 2024-09-21T09:03:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.004+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.004+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03ff780 2024-09-21T09:03:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.004+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.004+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03ff780 2024-09-21T09:03:22.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.005+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.005+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x7f40c000f070 2024-09-21T09:03:22.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.005+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4057030 con 0x7f40c000f070 2024-09-21T09:03:22.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.005+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec04040f0 2024-09-21T09:03:22.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.005+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c002e070 con 0x55fec04040f0 2024-09-21T09:03:22.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.005+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03fad70 2024-09-21T09:03:22.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.005+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.005+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03ff780 2024-09-21T09:03:22.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.006+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.006+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03fad70 2024-09-21T09:03:22.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.006+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.006+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x7f40c000f070 2024-09-21T09:03:22.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.006+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f40c4057030 con 0x7f40c000f070 2024-09-21T09:03:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.006+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec04040f0 2024-09-21T09:03:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.006+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c002e070 con 0x55fec04040f0 2024-09-21T09:03:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.006+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec04040f0 2024-09-21T09:03:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.007+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c002e070 con 0x55fec04040f0 2024-09-21T09:03:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.007+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03ff780 2024-09-21T09:03:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.007+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.007+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec04040f0 2024-09-21T09:03:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.007+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c002e070 con 0x55fec04040f0 2024-09-21T09:03:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.007+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec04040f0 2024-09-21T09:03:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.007+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c002e070 con 0x55fec04040f0 2024-09-21T09:03:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.007+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03fad70 2024-09-21T09:03:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.008+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.008+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03fad70 2024-09-21T09:03:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.008+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.008+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03ff780 2024-09-21T09:03:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.008+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.008+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec04040f0 2024-09-21T09:03:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.008+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c002e070 con 0x55fec04040f0 2024-09-21T09:03:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.008+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x7f40c000f070 2024-09-21T09:03:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.008+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4057030 con 0x7f40c000f070 2024-09-21T09:03:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.008+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03fad70 2024-09-21T09:03:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.009+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.009+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03ff780 2024-09-21T09:03:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.009+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.009+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec04040f0 2024-09-21T09:03:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.009+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c002e070 con 0x55fec04040f0 2024-09-21T09:03:22.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.009+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03ff780 2024-09-21T09:03:22.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.010+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.010+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x7f40c000f070 2024-09-21T09:03:22.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.010+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4057030 con 0x7f40c000f070 2024-09-21T09:03:22.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.010+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec04040f0 2024-09-21T09:03:22.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.010+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c002e070 con 0x55fec04040f0 2024-09-21T09:03:22.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.010+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03ff780 2024-09-21T09:03:22.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.010+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.010+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x55fec03fad70 2024-09-21T09:03:22.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fec0406c80 con 0x7f40c000f070 2024-09-21T09:03:22.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4057030 con 0x7f40c000f070 2024-09-21T09:03:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec0402af0 con 0x55fec03fad70 2024-09-21T09:03:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec0402f70 con 0x55fec03fad70 2024-09-21T09:03:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec0403450 con 0x55fec03fad70 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 zone default found 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 4 Realm: () 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 zonegroup default 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.011+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec0407100 con 0x55fec03ff780 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.012+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.012+0000 7f40d2011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.012+0000 7f40d2011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.012+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec0409330 con 0x55fec04040f0 2024-09-21T09:03:22.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.012+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40c002e070 con 0x55fec04040f0 2024-09-21T09:03:22.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.012+0000 7f40d2011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.012+0000 7f40d2011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.012+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec04096d0 con 0x55fec04040f0 2024-09-21T09:03:22.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.012+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40c002e070 con 0x55fec04040f0 2024-09-21T09:03:22.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.012+0000 7f40d2011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.012+0000 7f40d2011800 20 started sync module instance, tier type = 2024-09-21T09:03:22.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.012+0000 7f40d2011800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:22.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.012+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec0408770 con 0x7f40c000f070 2024-09-21T09:03:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.013+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x7f40c000f070 2024-09-21T09:03:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.013+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94552635509600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec0408770 con 0x7f40c000f070 2024-09-21T09:03:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.013+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040a090 con 0x55fec03fad70 2024-09-21T09:03:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.014+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94552635509600] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x7f40c000f070 2024-09-21T09:03:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.014+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.014+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94552635507872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040a090 con 0x55fec03fad70 2024-09-21T09:03:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.014+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040aa90 con 0x55fec04040f0 2024-09-21T09:03:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.016+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94552635507872] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.016+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c002e070 con 0x55fec04040f0 2024-09-21T09:03:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.016+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94552635513824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040a000 con 0x55fec04040f0 2024-09-21T09:03:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.016+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040b950 con 0x7f40c000f070 2024-09-21T09:03:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.017+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x7f40c000f070 2024-09-21T09:03:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.017+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94552635520640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040c110 con 0x7f40c000f070 2024-09-21T09:03:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.017+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040cc10 con 0x55fec03fad70 2024-09-21T09:03:22.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.017+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94552635513824] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c002e070 con 0x55fec04040f0 2024-09-21T09:03:22.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.018+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94552635520640] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x7f40c000f070 2024-09-21T09:03:22.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.018+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.018+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94552635524864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040cbd0 con 0x55fec03fad70 2024-09-21T09:03:22.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.018+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040d4e0 con 0x55fec03ff780 2024-09-21T09:03:22.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.019+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.019+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94552635527216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040cbd0 con 0x55fec03ff780 2024-09-21T09:03:22.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.019+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040e3c0 con 0x55fec03ff780 2024-09-21T09:03:22.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.019+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94552635524864] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.020+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94552635527216] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.020+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.020+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94552635529344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040ae80 con 0x55fec03ff780 2024-09-21T09:03:22.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.020+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040e9e0 con 0x55fec03ff780 2024-09-21T09:03:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.021+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.021+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94552635532592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040ee00 con 0x55fec03ff780 2024-09-21T09:03:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.021+0000 7f40d2011800 20 add_watcher() i=0 2024-09-21T09:03:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.021+0000 7f40d2011800 20 add_watcher() i=1 2024-09-21T09:03:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.021+0000 7f40d2011800 20 add_watcher() i=2 2024-09-21T09:03:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.021+0000 7f40d2011800 20 add_watcher() i=3 2024-09-21T09:03:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.021+0000 7f40d2011800 20 add_watcher() i=4 2024-09-21T09:03:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.021+0000 7f40d2011800 20 add_watcher() i=5 2024-09-21T09:03:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.021+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94552635529344] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.021+0000 7f40d2011800 20 add_watcher() i=6 2024-09-21T09:03:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.022+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94552635532592] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.022+0000 7f40d2011800 20 add_watcher() i=7 2024-09-21T09:03:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.022+0000 7f40d2011800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.022+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec040ee00 con 0x55fec03fad70 2024-09-21T09:03:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.022+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.022+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94552635533648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040ed70 con 0x55fec03fad70 2024-09-21T09:03:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.023+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94552635533648] v29'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.023+0000 7f3f837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.023+0000 7f40d2011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.023+0000 7f40d2011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.024+0000 7f40d2011800 5 note: GC not initialized 2024-09-21T09:03:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.024+0000 7f3f827e4640 20 reqs_thread_entry: start 2024-09-21T09:03:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.024+0000 7f40d2011800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.024+0000 7f40d2011800 20 Filter name: none 2024-09-21T09:03:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.024+0000 7f3ef3fff640 20 reqs_thread_entry: start 2024-09-21T09:03:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.024+0000 7f40d2011800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.024+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fec0444bb0 con 0x55fec03fad70 2024-09-21T09:03:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.024+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.024+0000 7f40d2011800 20 rados_obj.operate() r=0 bl.length=193 2024-09-21T09:03:22.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.025+0000 7f3f837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:22.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.025+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94552635533648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec0442a10 con 0x55fec03fad70 2024-09-21T09:03:22.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.026+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94552635533648] v29'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.026+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94552635509600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec0442a10 con 0x7f40c000f070 2024-09-21T09:03:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.027+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94552635509600] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x7f40c000f070 2024-09-21T09:03:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.027+0000 7f40d2011800 20 remove_watcher() i=0 2024-09-21T09:03:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.027+0000 7f40d2011800 2 removed watcher, disabling cache 2024-09-21T09:03:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.027+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94552635507872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec0442a10 con 0x55fec03fad70 2024-09-21T09:03:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.028+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94552635507872] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.028+0000 7f40d2011800 20 remove_watcher() i=1 2024-09-21T09:03:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.028+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94552635513824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec0442a10 con 0x55fec04040f0 2024-09-21T09:03:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.029+0000 7f40cd79c640 1 -- 172.21.15.178:0/1991153140 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94552635513824] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c002e070 con 0x55fec04040f0 2024-09-21T09:03:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.029+0000 7f40d2011800 20 remove_watcher() i=2 2024-09-21T09:03:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.029+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94552635520640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec0408b60 con 0x7f40c000f070 2024-09-21T09:03:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.030+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94552635520640] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x7f40c000f070 2024-09-21T09:03:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.030+0000 7f40d2011800 20 remove_watcher() i=3 2024-09-21T09:03:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.030+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94552635524864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec0409be0 con 0x55fec03fad70 2024-09-21T09:03:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.031+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94552635524864] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4057030 con 0x55fec03fad70 2024-09-21T09:03:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.031+0000 7f40d2011800 20 remove_watcher() i=4 2024-09-21T09:03:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.031+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94552635527216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040b680 con 0x55fec03ff780 2024-09-21T09:03:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.032+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94552635527216] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.032+0000 7f40d2011800 20 remove_watcher() i=5 2024-09-21T09:03:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.032+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94552635529344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec0409be0 con 0x55fec03ff780 2024-09-21T09:03:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.033+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94552635529344] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.033+0000 7f40d2011800 20 remove_watcher() i=6 2024-09-21T09:03:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.033+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94552635532592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fec040b680 con 0x55fec03ff780 2024-09-21T09:03:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.034+0000 7f40cdf9d640 1 -- 172.21.15.178:0/1991153140 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94552635532592] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c802a070 con 0x55fec03ff780 2024-09-21T09:03:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.034+0000 7f40d2011800 20 remove_watcher() i=7 2024-09-21T09:03:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.034+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fec03ff780 msgr2=0x55fec0401b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.034+0000 7f40d2011800 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fec03ff780 0x55fec0401b70 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.034+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fec03fad70 msgr2=0x55fec03fd230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.034+0000 7f40d2011800 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fec03fad70 0x55fec03fd230 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.034+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f40c000f070 msgr2=0x7f40c001c620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.034+0000 7f40d2011800 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f40c000f070 0x7f40c001c620 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.034+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fec04040f0 msgr2=0x55fec04065b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.034+0000 7f40d2011800 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fec04040f0 0x55fec04065b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3f98036b90 msgr2=0x7f3f98039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3f98036b90 0x7f3f98039050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f40c000efb0 tx=0x7f40c0035000 comp rx=0 tx=0).stop 2024-09-21T09:03:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03e7d00 msgr2=0x55fec03ef1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 --2- 172.21.15.178:0/1991153140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03e7d00 0x55fec03ef1b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f40c8011fd0 tx=0x7f40c804cb50 comp rx=0 tx=0).stop 2024-09-21T09:03:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 reap_dead start 2024-09-21T09:03:22.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40ccf9b640 1 -- 172.21.15.178:0/1991153140 reap_dead start 2024-09-21T09:03:22.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 shutdown_connections 2024-09-21T09:03:22.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 >> 172.21.15.178:0/1991153140 conn(0x55fec03e4060 msgr2=0x55fec03e2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 shutdown_connections 2024-09-21T09:03:22.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/1991153140 wait complete. 2024-09-21T09:03:22.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/2571918310 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3fa8036b90 msgr2=0x7f3fa8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 --2- 172.21.15.178:0/2571918310 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3fa8036b90 0x7f3fa8039050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55fec03c7d90 tx=0x7f40c004b690 comp rx=0 tx=0).stop 2024-09-21T09:03:22.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/2571918310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03db0a0 msgr2=0x55fec03db4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 --2- 172.21.15.178:0/2571918310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03db0a0 0x55fec03db4c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x55fec03c7cf0 tx=0x7f40c8018830 comp rx=0 tx=0).stop 2024-09-21T09:03:22.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/2571918310 shutdown_connections 2024-09-21T09:03:22.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 --2- 172.21.15.178:0/2571918310 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3fa8036b90 0x7f3fa8039050 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 --2- 172.21.15.178:0/2571918310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec03db0a0 0x55fec03db4c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/2571918310 >> 172.21.15.178:0/2571918310 conn(0x55fec03d0030 msgr2=0x55fec03d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/2571918310 shutdown_connections 2024-09-21T09:03:22.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/2571918310 wait complete. 2024-09-21T09:03:22.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fec03c9c40 msgr2=0x55fec03cc030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fec03c9c40 0x55fec03cc030 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fec02cd9f0 msgr2=0x55fec03c7390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fec02cd9f0 0x55fec03c7390 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3fb4036b40 msgr2=0x7f3fb4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.035+0000 7f40d2011800 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3fb4036b40 0x7f3fb4039000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f40c4057000 tx=0x7f40c4052000 comp rx=0 tx=0).stop 2024-09-21T09:03:22.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.036+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec023d5b0 msgr2=0x55fec03c0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.036+0000 7f40d2011800 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec023d5b0 0x55fec03c0320 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f40c0000fd0 tx=0x7f40c0000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.036+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 shutdown_connections 2024-09-21T09:03:22.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.036+0000 7f40d2011800 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fec03c9c40 0x55fec03cc030 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.036+0000 7f40d2011800 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fec02cd9f0 0x55fec03c7390 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.036+0000 7f40d2011800 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3fb4036b40 0x7f3fb4039000 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.036+0000 7f40d2011800 1 --2- 172.21.15.178:0/2652247464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fec023d5b0 0x55fec03c0320 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.036+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 >> 172.21.15.178:0/2652247464 conn(0x55fec02c3de0 msgr2=0x55fec03b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.036+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 shutdown_connections 2024-09-21T09:03:22.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.036+0000 7f40d2011800 1 -- 172.21.15.178:0/2652247464 wait complete. 2024-09-21T09:03:22.051 INFO:teuthology.orchestra.run.smithi178.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"l1LehsP26n7Tqdsxe/xBU2np","ver":2},"mtime":"2024-09-21T09:03:21.895008Z","data":{"bucket":{"name":"myfoo","marker":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1","bucket_id":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-21T09:03:19.558161Z","linked":true,"has_bucket_info":false}} 2024-09-21T09:03:22.051 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'l1LehsP26n7Tqdsxe/xBU2np', 'ver': 2}, 'mtime': '2024-09-21T09:03:21.895008Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1', 'bucket_id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-21T09:03:19.558161Z', 'linked': True, 'has_bucket_info': False}} 2024-09-21T09:03:22.051 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-21T09:03:22.051 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-21T09:03:22.052 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-21T09:03:22.138 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:22.138 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:22.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.137+0000 7f9c4273e800 1 Processor -- start 2024-09-21T09:03:22.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.137+0000 7f9c4273e800 1 -- start start 2024-09-21T09:03:22.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.137+0000 7f9c4273e800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55733815ca10 0x55733815ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.137+0000 7f9c4273e800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557338017b30 con 0x557338158710 2024-09-21T09:03:22.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.137+0000 7f9c4273e800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x557337ff9360 con 0x55733815ca10 2024-09-21T09:03:22.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.137+0000 7f9c37fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55733815ca10 0x55733815ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.137+0000 7f9c3e434640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x557338158710 0x557338158b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46862/0 (socket says 172.21.15.178:46862) 2024-09-21T09:03:22.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.138+0000 7f9c3e434640 1 -- 172.21.15.178:0/978349554 learned_addr learned my addr 172.21.15.178:0/978349554 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:22.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.138+0000 7f9c37fff640 1 -- 172.21.15.178:0/978349554 >> v1:172.21.15.44:6789/0 conn(0x557338158710 legacy=0x557338158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.138+0000 7f9c37fff640 1 -- 172.21.15.178:0/978349554 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55733801fe00 con 0x55733815ca10 2024-09-21T09:03:22.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.140+0000 7f9c37fff640 1 --2- 172.21.15.178:0/978349554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733815ca10 0x55733815ee00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800a470 tx=0x7f9c28045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31a026074bec5e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.140+0000 7f9c3dc33640 1 -- 172.21.15.178:0/978349554 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c28053570 con 0x55733815ca10 2024-09-21T09:03:22.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.140+0000 7f9c3dc33640 1 -- 172.21.15.178:0/978349554 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c28058070 con 0x55733815ca10 2024-09-21T09:03:22.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.140+0000 7f9c3dc33640 1 -- 172.21.15.178:0/978349554 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c28053880 con 0x55733815ca10 2024-09-21T09:03:22.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.140+0000 7f9c4273e800 1 -- 172.21.15.178:0/978349554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733815ca10 msgr2=0x55733815ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.142 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.140+0000 7f9c4273e800 1 --2- 172.21.15.178:0/978349554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733815ca10 0x55733815ee00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800a470 tx=0x7f9c28045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:22.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.140+0000 7f9c4273e800 1 -- 172.21.15.178:0/978349554 shutdown_connections 2024-09-21T09:03:22.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.140+0000 7f9c4273e800 1 --2- 172.21.15.178:0/978349554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733815ca10 0x55733815ee00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.140+0000 7f9c4273e800 1 -- 172.21.15.178:0/978349554 >> 172.21.15.178:0/978349554 conn(0x557338153fe0 msgr2=0x557338156400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.140+0000 7f9c4273e800 1 -- 172.21.15.178:0/978349554 shutdown_connections 2024-09-21T09:03:22.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.140+0000 7f9c4273e800 1 -- 172.21.15.178:0/978349554 wait complete. 2024-09-21T09:03:22.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.154+0000 7f9c4273e800 1 Processor -- start 2024-09-21T09:03:22.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.154+0000 7f9c4273e800 1 -- start start 2024-09-21T09:03:22.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.154+0000 7f9c4273e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338158710 0x557338247870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.154+0000 7f9c4273e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5573380a4360 con 0x557338158710 2024-09-21T09:03:22.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.154+0000 7f9c3e434640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338158710 0x557338247870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.155+0000 7f9c3e434640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338158710 0x557338247870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44046/0 (socket says 172.21.15.178:44046) 2024-09-21T09:03:22.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.155+0000 7f9c3e434640 1 -- 172.21.15.178:0/1412783358 learned_addr learned my addr 172.21.15.178:0/1412783358 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.155+0000 7f9c3e434640 1 -- 172.21.15.178:0/1412783358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557337ff1bc0 con 0x557338158710 2024-09-21T09:03:22.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.155+0000 7f9c3e434640 1 --2- 172.21.15.178:0/1412783358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338158710 0x557338247870 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9c30001e10 tx=0x7f9c3000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb243817813000a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.155+0000 7f9b2c608640 1 -- 172.21.15.178:0/1412783358 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c30012020 con 0x557338158710 2024-09-21T09:03:22.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.155+0000 7f9b2c608640 1 -- 172.21.15.178:0/1412783358 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3000e5a0 con 0x557338158710 2024-09-21T09:03:22.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.155+0000 7f9b2c608640 1 -- 172.21.15.178:0/1412783358 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c3000e8e0 con 0x557338158710 2024-09-21T09:03:22.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.156+0000 7f9c4273e800 1 -- 172.21.15.178:0/1412783358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338158710 msgr2=0x557338247870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.156+0000 7f9c4273e800 1 --2- 172.21.15.178:0/1412783358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338158710 0x557338247870 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9c30001e10 tx=0x7f9c3000b780 comp rx=0 tx=0).stop 2024-09-21T09:03:22.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.156+0000 7f9c4273e800 1 -- 172.21.15.178:0/1412783358 shutdown_connections 2024-09-21T09:03:22.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.156+0000 7f9c4273e800 1 --2- 172.21.15.178:0/1412783358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338158710 0x557338247870 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.156+0000 7f9c4273e800 1 -- 172.21.15.178:0/1412783358 >> 172.21.15.178:0/1412783358 conn(0x557338153fe0 msgr2=0x557338243230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.156+0000 7f9c4273e800 1 -- 172.21.15.178:0/1412783358 shutdown_connections 2024-09-21T09:03:22.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.156+0000 7f9c4273e800 1 -- 172.21.15.178:0/1412783358 wait complete. 2024-09-21T09:03:22.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.156+0000 7f9c4273e800 1 Processor -- start 2024-09-21T09:03:22.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.156+0000 7f9c4273e800 1 -- start start 2024-09-21T09:03:22.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.156+0000 7f9c4273e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338158710 0x55733824f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.156+0000 7f9c4273e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55733815f640 con 0x557338158710 2024-09-21T09:03:22.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.157+0000 7f9c3e434640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338158710 0x55733824f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.157+0000 7f9c3e434640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338158710 0x55733824f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44054/0 (socket says 172.21.15.178:44054) 2024-09-21T09:03:22.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.157+0000 7f9c3e434640 1 -- 172.21.15.178:0/1889225217 learned_addr learned my addr 172.21.15.178:0/1889225217 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.157+0000 7f9c3e434640 1 -- 172.21.15.178:0/1889225217 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557338005fe0 con 0x557338158710 2024-09-21T09:03:22.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.157+0000 7f9c3e434640 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338158710 0x55733824f250 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000b7c0 tx=0x7f9c30000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.157+0000 7f9b2ae05640 1 -- 172.21.15.178:0/1889225217 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c30012030 con 0x557338158710 2024-09-21T09:03:22.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.157+0000 7f9b2ae05640 1 -- 172.21.15.178:0/1889225217 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c30001470 con 0x557338158710 2024-09-21T09:03:22.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.157+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55733824f790 con 0x557338158710 2024-09-21T09:03:22.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.157+0000 7f9b2ae05640 1 -- 172.21.15.178:0/1889225217 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c3001a8d0 con 0x557338158710 2024-09-21T09:03:22.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.157+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55733824fcb0 con 0x557338158710 2024-09-21T09:03:22.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.158+0000 7f9b2ae05640 1 -- 172.21.15.178:0/1889225217 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9c30015020 con 0x557338158710 2024-09-21T09:03:22.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.158+0000 7f9b2ae05640 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b24036b90 0x7f9b24039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.158+0000 7f9b2ae05640 1 -- 172.21.15.178:0/1889225217 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9c30020030 con 0x557338158710 2024-09-21T09:03:22.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.158+0000 7f9c37fff640 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b24036b90 0x7f9b24039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.158+0000 7f9c4273e800 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55733815ca10 0x5573382562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.158+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557338256890 con 0x55733815ca10 2024-09-21T09:03:22.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.159+0000 7f9c3ec35640 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55733815ca10 0x5573382562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.159+0000 7f9c37fff640 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b24036b90 0x7f9b24039050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9c28057000 tx=0x7f9c28052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.159+0000 7f9c3ec35640 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55733815ca10 0x5573382562c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.159+0000 7f9c3ec35640 1 -- 172.21.15.178:0/1889225217 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c3800a4a0 con 0x55733815ca10 2024-09-21T09:03:22.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.159+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557338253870 con 0x55733815ca10 2024-09-21T09:03:22.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.159+0000 7f9c3ec35640 1 -- 172.21.15.178:0/1889225217 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c3800a4a0 con 0x55733815ca10 2024-09-21T09:03:22.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.159+0000 7f9c4273e800 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557338258ba0 0x55733825af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.159+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55733825b630 con 0x557338258ba0 2024-09-21T09:03:22.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.160+0000 7f9c3e434640 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557338258ba0 0x55733825af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.160+0000 7f9c3e434640 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557338258ba0 0x55733825af90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.161+0000 7f9c3e434640 1 -- 172.21.15.178:0/1889225217 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9c3002dcf0 con 0x557338258ba0 2024-09-21T09:03:22.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.161+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557338257a40 con 0x55733815ca10 2024-09-21T09:03:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.161+0000 7f9c3ec35640 1 -- 172.21.15.178:0/1889225217 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c3800a4a0 con 0x55733815ca10 2024-09-21T09:03:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.161+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557338257f20 con 0x55733815ca10 2024-09-21T09:03:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.161+0000 7f9c3ec35640 1 -- 172.21.15.178:0/1889225217 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9c3800a4a0 con 0x55733815ca10 2024-09-21T09:03:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.161+0000 7f9c4273e800 1 Processor -- start 2024-09-21T09:03:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.162+0000 7f9c4273e800 1 -- start start 2024-09-21T09:03:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.162+0000 7f9c4273e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338269ff0 0x55733826a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.162+0000 7f9c4273e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557337ff3580 con 0x557338269ff0 2024-09-21T09:03:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.162+0000 7f9c3ec35640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338269ff0 0x55733826a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.162+0000 7f9c3ec35640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338269ff0 0x55733826a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44058/0 (socket says 172.21.15.178:44058) 2024-09-21T09:03:22.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.162+0000 7f9c3ec35640 1 -- 172.21.15.178:0/454819987 learned_addr learned my addr 172.21.15.178:0/454819987 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.162+0000 7f9c3ec35640 1 -- 172.21.15.178:0/454819987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55733826a950 con 0x557338269ff0 2024-09-21T09:03:22.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.162+0000 7f9c3ec35640 1 --2- 172.21.15.178:0/454819987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338269ff0 0x55733826a410 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x557338250300 tx=0x7f9c380188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.162+0000 7f9b23fff640 1 -- 172.21.15.178:0/454819987 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c38014450 con 0x557338269ff0 2024-09-21T09:03:22.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.163+0000 7f9b23fff640 1 -- 172.21.15.178:0/454819987 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c380145f0 con 0x557338269ff0 2024-09-21T09:03:22.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.163+0000 7f9c4273e800 1 -- 172.21.15.178:0/454819987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55733826abe0 con 0x557338269ff0 2024-09-21T09:03:22.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.163+0000 7f9b23fff640 1 -- 172.21.15.178:0/454819987 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c380148d0 con 0x557338269ff0 2024-09-21T09:03:22.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.163+0000 7f9c4273e800 1 -- 172.21.15.178:0/454819987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55733826d8c0 con 0x557338269ff0 2024-09-21T09:03:22.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.163+0000 7f9b23fff640 1 -- 172.21.15.178:0/454819987 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9c38011040 con 0x557338269ff0 2024-09-21T09:03:22.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.163+0000 7f9b23fff640 1 --2- 172.21.15.178:0/454819987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b18036b90 0x7f9b18039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.164+0000 7f9b23fff640 1 -- 172.21.15.178:0/454819987 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9c3801e070 con 0x557338269ff0 2024-09-21T09:03:22.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.164+0000 7f9c3e434640 1 --2- 172.21.15.178:0/454819987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b18036b90 0x7f9b18039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.164+0000 7f9c4273e800 1 Processor -- start 2024-09-21T09:03:22.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.164+0000 7f9c3e434640 1 --2- 172.21.15.178:0/454819987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b18036b90 0x7f9b18039050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x557338256ce0 tx=0x7f9c30041040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.164+0000 7f9c4273e800 1 -- start start 2024-09-21T09:03:22.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.164+0000 7f9c4273e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338276c20 0x557338277020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.164+0000 7f9c4273e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557338248020 con 0x557338276c20 2024-09-21T09:03:22.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.164+0000 7f9c3ec35640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338276c20 0x557338277020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.164+0000 7f9c3ec35640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338276c20 0x557338277020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44072/0 (socket says 172.21.15.178:44072) 2024-09-21T09:03:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.164+0000 7f9c3ec35640 1 -- 172.21.15.178:0/514110407 learned_addr learned my addr 172.21.15.178:0/514110407 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.165+0000 7f9c3ec35640 1 -- 172.21.15.178:0/514110407 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573382775f0 con 0x557338276c20 2024-09-21T09:03:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.165+0000 7f9c3ec35640 1 --2- 172.21.15.178:0/514110407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338276c20 0x557338277020 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9c3804cb40 tx=0x7f9c3803bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d5a869ccf45c93 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.165+0000 7f9b21ffb640 1 -- 172.21.15.178:0/514110407 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c38013cb0 con 0x557338276c20 2024-09-21T09:03:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.165+0000 7f9b21ffb640 1 -- 172.21.15.178:0/514110407 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c38013e50 con 0x557338276c20 2024-09-21T09:03:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.165+0000 7f9b21ffb640 1 -- 172.21.15.178:0/514110407 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c3804e200 con 0x557338276c20 2024-09-21T09:03:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.165+0000 7f9c4273e800 1 -- 172.21.15.178:0/514110407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338276c20 msgr2=0x557338277020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.165+0000 7f9c4273e800 1 --2- 172.21.15.178:0/514110407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338276c20 0x557338277020 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9c3804cb40 tx=0x7f9c3803bf20 comp rx=0 tx=0).stop 2024-09-21T09:03:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.165+0000 7f9c4273e800 1 -- 172.21.15.178:0/514110407 shutdown_connections 2024-09-21T09:03:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.165+0000 7f9c4273e800 1 --2- 172.21.15.178:0/514110407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338276c20 0x557338277020 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.165+0000 7f9c4273e800 1 -- 172.21.15.178:0/514110407 >> 172.21.15.178:0/514110407 conn(0x557338272f80 msgr2=0x5573382710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.165+0000 7f9c4273e800 1 -- 172.21.15.178:0/514110407 shutdown_connections 2024-09-21T09:03:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.165+0000 7f9c4273e800 1 -- 172.21.15.178:0/514110407 wait complete. 2024-09-21T09:03:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.166+0000 7f9c4273e800 1 Processor -- start 2024-09-21T09:03:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.166+0000 7f9c4273e800 1 -- start start 2024-09-21T09:03:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.166+0000 7f9c4273e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338276c20 0x55733827e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.166+0000 7f9c4273e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557338277bc0 con 0x557338276c20 2024-09-21T09:03:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.166+0000 7f9c3ec35640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338276c20 0x55733827e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.166+0000 7f9c3ec35640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338276c20 0x55733827e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44074/0 (socket says 172.21.15.178:44074) 2024-09-21T09:03:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.166+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 learned_addr learned my addr 172.21.15.178:0/2606710197 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.166+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55733827e610 con 0x557338276c20 2024-09-21T09:03:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.166+0000 7f9c3ec35640 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338276c20 0x55733827e0d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9c380117d0 tx=0x7f9c3804cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.166+0000 7f9b0ffff640 1 -- 172.21.15.178:0/2606710197 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c3802bc70 con 0x557338276c20 2024-09-21T09:03:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.167+0000 7f9b0ffff640 1 -- 172.21.15.178:0/2606710197 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c38031030 con 0x557338276c20 2024-09-21T09:03:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.167+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55733827e8a0 con 0x557338276c20 2024-09-21T09:03:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.167+0000 7f9b0ffff640 1 -- 172.21.15.178:0/2606710197 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c38022a50 con 0x557338276c20 2024-09-21T09:03:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.167+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557338281550 con 0x557338276c20 2024-09-21T09:03:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.167+0000 7f9b0ffff640 1 -- 172.21.15.178:0/2606710197 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9c38022bf0 con 0x557338276c20 2024-09-21T09:03:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.167+0000 7f9b0ffff640 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b08036b90 0x7f9b08039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.168+0000 7f9b0ffff640 1 -- 172.21.15.178:0/2606710197 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9c3800e040 con 0x557338276c20 2024-09-21T09:03:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.168+0000 7f9c3e434640 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b08036b90 0x7f9b08039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.168+0000 7f9c3e434640 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b08036b90 0x7f9b08039050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c30000fd0 tx=0x7f9c30034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.168+0000 7f9c4273e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.168+0000 7f9c4273e800 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557338289e30 0x55733828c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.168+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55733828ca40 con 0x557338289e30 2024-09-21T09:03:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.168+0000 7f9c37fff640 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557338289e30 0x55733828c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c37fff640 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557338289e30 0x55733828c2f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c4273e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c4273e800 20 realm 2024-09-21T09:03:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c4273e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55733828ce70 con 0x557338289e30 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c4273e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c4273e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c4273e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55733828d740 con 0x557338289e30 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c4273e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c4273e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55733828dae0 con 0x557338289e30 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.169+0000 7f9c4273e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.170+0000 7f9c4273e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.170+0000 7f9c4273e800 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55733828e840 0x557338290c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.170+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557338291240 con 0x55733828e840 2024-09-21T09:03:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.170+0000 7f9c3ec35640 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55733828e840 0x557338290c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.170+0000 7f9c3ec35640 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55733828e840 0x557338290c30 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.170+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.170+0000 7f9c4273e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.170+0000 7f9c4273e800 20 searching for the correct realm 2024-09-21T09:03:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.170+0000 7f9c4273e800 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5573382931d0 0x557338295690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.170+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x5573382931d0 2024-09-21T09:03:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.171+0000 7f9c3e434640 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5573382931d0 0x557338295690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.171+0000 7f9c3e434640 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5573382931d0 0x557338295690 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.171+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.171+0000 7f9c3e434640 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9c30059040 0x7f9c3004c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.171+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x7f9c30059040 2024-09-21T09:03:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.171+0000 7f9c37fff640 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9c30059040 0x7f9c3004c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.172+0000 7f9c37fff640 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9c30059040 0x7f9c3004c2a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.172+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28051070 con 0x7f9c30059040 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.172+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x55733828e840 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.172+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.172+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x557338289e30 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.172+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.172+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x557338289e30 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.173+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.173+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x55733828e840 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.173+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.173+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x55733828e840 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.173+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.173+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x7f9c30059040 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.173+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28051070 con 0x7f9c30059040 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.173+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x5573382931d0 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.174+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.174+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x557338289e30 2024-09-21T09:03:22.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.174+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.174+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x55733828e840 2024-09-21T09:03:22.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.174+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.174+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x557338289e30 2024-09-21T09:03:22.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.174+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.174+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x7f9c30059040 2024-09-21T09:03:22.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.175+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9c28051070 con 0x7f9c30059040 2024-09-21T09:03:22.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.175+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x5573382931d0 2024-09-21T09:03:22.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.175+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.175+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x5573382931d0 2024-09-21T09:03:22.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.175+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.175+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x55733828e840 2024-09-21T09:03:22.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.175+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.175+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x5573382931d0 2024-09-21T09:03:22.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.176+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.176+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x5573382931d0 2024-09-21T09:03:22.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.176+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.176+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x557338289e30 2024-09-21T09:03:22.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.176+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.176+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x557338289e30 2024-09-21T09:03:22.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.176+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.176+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x55733828e840 2024-09-21T09:03:22.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.177+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.177+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x5573382931d0 2024-09-21T09:03:22.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.177+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.177+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x7f9c30059040 2024-09-21T09:03:22.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.177+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28051070 con 0x7f9c30059040 2024-09-21T09:03:22.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.177+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x557338289e30 2024-09-21T09:03:22.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.177+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.177+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x55733828e840 2024-09-21T09:03:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.178+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.178+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x5573382931d0 2024-09-21T09:03:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.178+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.178+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x55733828e840 2024-09-21T09:03:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.178+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.178+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x7f9c30059040 2024-09-21T09:03:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.178+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28051070 con 0x7f9c30059040 2024-09-21T09:03:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.178+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x5573382931d0 2024-09-21T09:03:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.179+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.179+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x55733828e840 2024-09-21T09:03:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.179+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.179+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x557338289e30 2024-09-21T09:03:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.179+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.179+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557338295d60 con 0x7f9c30059040 2024-09-21T09:03:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.179+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28051070 con 0x7f9c30059040 2024-09-21T09:03:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.179+0000 7f9c4273e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.179+0000 7f9c4273e800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.179+0000 7f9c4273e800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.179+0000 7f9c4273e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.179+0000 7f9c4273e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.179+0000 7f9c4273e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.179+0000 7f9c4273e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557338292720 con 0x557338289e30 2024-09-21T09:03:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557338291f90 con 0x557338289e30 2024-09-21T09:03:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5573382916d0 con 0x557338289e30 2024-09-21T09:03:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 20 zone default found 2024-09-21T09:03:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 4 Realm: () 2024-09-21T09:03:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 20 zonegroup default 2024-09-21T09:03:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.180+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557338296690 con 0x55733828e840 2024-09-21T09:03:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.181+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.181+0000 7f9c4273e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.181+0000 7f9c4273e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.181+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5573382988c0 con 0x5573382931d0 2024-09-21T09:03:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.181+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.181+0000 7f9c4273e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.181+0000 7f9c4273e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.181+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557338298c60 con 0x5573382931d0 2024-09-21T09:03:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.181+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.181+0000 7f9c4273e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.181+0000 7f9c4273e800 20 started sync module instance, tier type = 2024-09-21T09:03:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.181+0000 7f9c4273e800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.181+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557338297d50 con 0x7f9c30059040 2024-09-21T09:03:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.182+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x7f9c30059040 2024-09-21T09:03:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.182+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93953351844512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557338297d50 con 0x7f9c30059040 2024-09-21T09:03:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.182+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557338299660 con 0x557338289e30 2024-09-21T09:03:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.183+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93953351844512] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x7f9c30059040 2024-09-21T09:03:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.183+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.184+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93953351848304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557338297d50 con 0x557338289e30 2024-09-21T09:03:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.184+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55733829a0f0 con 0x5573382931d0 2024-09-21T09:03:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.185+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.185+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93953351848304] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.185+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93953351850944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55733829a990 con 0x5573382931d0 2024-09-21T09:03:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.185+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382978e0 con 0x7f9c30059040 2024-09-21T09:03:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.186+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93953351850944] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.186+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x7f9c30059040 2024-09-21T09:03:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.186+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93953351853280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55733829b400 con 0x7f9c30059040 2024-09-21T09:03:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.186+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55733829bdc0 con 0x557338289e30 2024-09-21T09:03:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.187+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.187+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93953351853280] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x7f9c30059040 2024-09-21T09:03:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.187+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93953351858448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55733829c1e0 con 0x557338289e30 2024-09-21T09:03:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.187+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55733829c750 con 0x55733828e840 2024-09-21T09:03:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.188+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.188+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93953351855952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55733829cff0 con 0x55733828e840 2024-09-21T09:03:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.188+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93953351858448] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.188+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55733829bd50 con 0x55733828e840 2024-09-21T09:03:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.189+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.189+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93953351865648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55733829bd50 con 0x55733828e840 2024-09-21T09:03:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.189+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55733829e440 con 0x55733828e840 2024-09-21T09:03:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.189+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93953351855952] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.190+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93953351865648] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.190+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.190+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93953351866704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55733829cb40 con 0x55733828e840 2024-09-21T09:03:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.190+0000 7f9c4273e800 20 add_watcher() i=0 2024-09-21T09:03:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.190+0000 7f9c4273e800 20 add_watcher() i=1 2024-09-21T09:03:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.190+0000 7f9c4273e800 20 add_watcher() i=2 2024-09-21T09:03:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.190+0000 7f9c4273e800 20 add_watcher() i=3 2024-09-21T09:03:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.190+0000 7f9c4273e800 20 add_watcher() i=4 2024-09-21T09:03:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.190+0000 7f9c4273e800 20 add_watcher() i=5 2024-09-21T09:03:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.190+0000 7f9c4273e800 20 add_watcher() i=6 2024-09-21T09:03:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.191+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93953351866704] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.191+0000 7f9c4273e800 20 add_watcher() i=7 2024-09-21T09:03:22.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.191+0000 7f9c4273e800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:22.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.191+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5573382a1470 con 0x557338289e30 2024-09-21T09:03:22.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.191+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.191+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93953351868272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55733829e8f0 con 0x557338289e30 2024-09-21T09:03:22.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.192+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93953351868272] v29'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.192+0000 7f9af4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:22.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.192+0000 7f9c4273e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:22.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.192+0000 7f9c4273e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:22.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.192+0000 7f9c4273e800 5 note: GC not initialized 2024-09-21T09:03:22.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.192+0000 7f9a6f7fe640 20 reqs_thread_entry: start 2024-09-21T09:03:22.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.192+0000 7f9c4273e800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:22.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 20 Filter name: none 2024-09-21T09:03:22.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9a6d7fa640 20 reqs_thread_entry: start 2024-09-21T09:03:22.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:22.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5573382d4720 con 0x557338289e30 2024-09-21T09:03:22.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:22.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:22.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:22.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:22.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-21T09:03:22.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5573382d6800 con 0x557338289e30 2024-09-21T09:03:22.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-21T09:03:22.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-21T09:03:22.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-21T09:03:22.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 : miss 2024-09-21T09:03:22.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.193+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 8.16 8:6a2d24de:root::.bucket.meta.testx%3amyfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5573382d8090 con 0x5573382931d0 2024-09-21T09:03:22.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.194+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.194+0000 7f9c4273e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-21T09:03:22.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.194+0000 7f9c4273e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:22.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.194+0000 7f9c4273e800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:22.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.194+0000 7f9c4273e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:22.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.194+0000 7f9c4273e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-21T09:03:22.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.194+0000 7f9c4273e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 2024-09-21T09:03:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.194+0000 7f9c4273e800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-21T09:03:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.194+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382dc9d0 con 0x557338289e30 2024-09-21T09:03:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.195+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v29'4 uv4 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.195+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:66 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382e02e0 con 0x55733828e840 2024-09-21T09:03:22.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.196+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(66 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [create,call,writefull 0~379,setxattr (123)] v29'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.196+0000 7f9c4273e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x7 2024-09-21T09:03:22.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.196+0000 7f9c4273e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:22.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.196+0000 7f9c4273e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:22.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.196+0000 7f9c4273e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1, ofs0, ns] 2024-09-21T09:03:22.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.196+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 93953352130064 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5573382dfa90 con 0x55733828e840 2024-09-21T09:03:22.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.197+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== watch-notify(notify (1) cookie 93953351855952 notify 124554051597 ret 0) ==== 770+0+0 (crc 0 0 0) 0x5573382dc400 con 0x55733828e840 2024-09-21T09:03:22.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.197+0000 7f9b21ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051597 cookie 93953351855952 notifier 4560 bl.length()=728 2024-09-21T09:03:22.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.197+0000 7f9b21ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x7 2024-09-21T09:03:22.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.197+0000 7f9b21ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:22.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.197+0000 7f9b21ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.197+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(67 notify.5 [notify cookie 93953352130064 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.197+0000 7f9b21ffb640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9b04003ea0 con 0x55733828e840 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.197+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.197+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== watch-notify(notify_complete (2) cookie 93953352130064 notify 124554051597 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55733827e8a0 con 0x55733828e840 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.197+0000 7f9c4273e800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): orig_sources= new_sources= 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.197+0000 7f9c4273e800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): potential sources added=[] removed=[] 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.197+0000 7f9c4273e800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): orig_dests= new_dests= 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.197+0000 7f9c4273e800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): potential dests added=[] removed=[] 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.197+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382e04b0 con 0x7f9c30059040 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.198+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(69 foo.buckets [call] v29'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x7f9c30059040 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.198+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382db5c0 con 0x7f9c30059040 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.199+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v29'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x7f9c30059040 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.199+0000 7f9c4273e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.199+0000 7f9c4273e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.199+0000 7f9c4273e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T09:03:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.199+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93953352120720 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5573382dbdb0 con 0x55733828e840 2024-09-21T09:03:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.199+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== watch-notify(notify (1) cookie 93953351865648 notify 124554051598 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55733827e610 con 0x55733828e840 2024-09-21T09:03:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.199+0000 7f9b21ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051598 cookie 93953351865648 notifier 4560 bl.length()=314 2024-09-21T09:03:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.199+0000 7f9b21ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-21T09:03:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.199+0000 7f9b21ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.199+0000 7f9b21ffb640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9b04003ea0 con 0x55733828e840 2024-09-21T09:03:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.199+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(71 notify.6 [notify cookie 93953352120720 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.200+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.200+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== watch-notify(notify_complete (2) cookie 93953352120720 notify 124554051598 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5573382775f0 con 0x55733828e840 2024-09-21T09:03:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.200+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382dbe40 con 0x557338289e30 2024-09-21T09:03:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.201+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(73 testx/myfoo [call,delete] v29'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.201+0000 7f9c4273e800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-21T09:03:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.201+0000 7f9c4273e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.201+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 93953352120720 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5573382dcd60 con 0x557338289e30 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.201+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== watch-notify(notify (1) cookie 93953351858448 notify 124554051597 ret 0) ==== 197+0+0 (crc 0 0 0) 0x5573382e0680 con 0x557338289e30 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.201+0000 7f9b217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051597 cookie 93953351858448 notifier 4560 bl.length()=155 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.201+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(74 notify.4 [notify cookie 93953352120720 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.201+0000 7f9b217fa640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9a740032c0 con 0x557338289e30 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.201+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.201+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== watch-notify(notify_complete (2) cookie 93953352120720 notify 124554051597 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5573382e04b0 con 0x557338289e30 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.201+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:76 8.16 8:6a2d24de:root::.bucket.meta.testx%3amyfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382dbe40 con 0x5573382931d0 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.202+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call,delete] v29'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.202+0000 7f9c4273e800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 from cache 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.202+0000 7f9c4273e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1, ofs0, ns] 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.202+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 93953352120720 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5573382d6350 con 0x557338289e30 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.203+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== watch-notify(notify (1) cookie 93953351858448 notify 124554051598 ret 0) ==== 254+0+0 (crc 0 0 0) 0x5573382e04b0 con 0x557338289e30 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.203+0000 7f9b217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051598 cookie 93953351858448 notifier 4560 bl.length()=212 2024-09-21T09:03:22.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.203+0000 7f9b217fa640 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9a74003330 con 0x557338289e30 2024-09-21T09:03:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.203+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(77 notify.4 [notify cookie 93953352120720 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.203+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.203+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== watch-notify(notify_complete (2) cookie 93953352120720 notify 124554051598 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55733801fe00 con 0x557338289e30 2024-09-21T09:03:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.204+0000 7f9af4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.204+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93953351868272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382d2470 con 0x557338289e30 2024-09-21T09:03:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.205+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93953351868272] v29'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.205+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93953351844512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382d2470 con 0x7f9c30059040 2024-09-21T09:03:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.206+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93953351844512] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x7f9c30059040 2024-09-21T09:03:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.206+0000 7f9c4273e800 20 remove_watcher() i=0 2024-09-21T09:03:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.206+0000 7f9c4273e800 2 removed watcher, disabling cache 2024-09-21T09:03:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.206+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93953351848304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382d2470 con 0x557338289e30 2024-09-21T09:03:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.207+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 35 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93953351848304] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.207+0000 7f9c4273e800 20 remove_watcher() i=1 2024-09-21T09:03:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.207+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93953351850944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382d2470 con 0x5573382931d0 2024-09-21T09:03:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.208+0000 7f9c3e434640 1 -- 172.21.15.178:0/2606710197 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93953351850944] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3002dcf0 con 0x5573382931d0 2024-09-21T09:03:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.208+0000 7f9c4273e800 20 remove_watcher() i=2 2024-09-21T09:03:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.208+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93953351853280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382d2470 con 0x7f9c30059040 2024-09-21T09:03:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.209+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93953351853280] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x7f9c30059040 2024-09-21T09:03:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.209+0000 7f9c4273e800 20 remove_watcher() i=3 2024-09-21T09:03:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.209+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93953351858448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382d2470 con 0x557338289e30 2024-09-21T09:03:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.210+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 <== osd.1 v2:172.21.15.178:6800/627496675 36 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93953351858448] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28051070 con 0x557338289e30 2024-09-21T09:03:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.210+0000 7f9c4273e800 20 remove_watcher() i=4 2024-09-21T09:03:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.210+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93953351855952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382d2470 con 0x55733828e840 2024-09-21T09:03:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.211+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93953351855952] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.211+0000 7f9c4273e800 20 remove_watcher() i=5 2024-09-21T09:03:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.211+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93953351865648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382d2470 con 0x55733828e840 2024-09-21T09:03:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.212+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93953351865648] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.212+0000 7f9c4273e800 20 remove_watcher() i=6 2024-09-21T09:03:22.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.212+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93953351866704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5573382d2470 con 0x55733828e840 2024-09-21T09:03:22.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c3ec35640 1 -- 172.21.15.178:0/2606710197 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93953351866704] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3802a070 con 0x55733828e840 2024-09-21T09:03:22.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c4273e800 20 remove_watcher() i=7 2024-09-21T09:03:22.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55733828e840 msgr2=0x557338290c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c4273e800 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55733828e840 0x557338290c30 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557338289e30 msgr2=0x55733828c2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c4273e800 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x557338289e30 0x55733828c2f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9c30059040 msgr2=0x7f9c3004c2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c4273e800 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9c30059040 0x7f9c3004c2a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5573382931d0 msgr2=0x557338295690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c4273e800 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5573382931d0 0x557338295690 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b08036b90 msgr2=0x7f9b08039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c4273e800 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b08036b90 0x7f9b08039050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c30000fd0 tx=0x7f9c30034000 comp rx=0 tx=0).stop 2024-09-21T09:03:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338276c20 msgr2=0x55733827e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c37fff640 1 -- 172.21.15.178:0/2606710197 reap_dead start 2024-09-21T09:03:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.213+0000 7f9c4273e800 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338276c20 0x55733827e0d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9c380117d0 tx=0x7f9c3804cad0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 shutdown_connections 2024-09-21T09:03:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 --2- 172.21.15.178:0/2606710197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338276c20 0x55733827e0d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 >> 172.21.15.178:0/2606710197 conn(0x557338272f80 msgr2=0x557338271040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 shutdown_connections 2024-09-21T09:03:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 -- 172.21.15.178:0/2606710197 wait complete. 2024-09-21T09:03:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 -- 172.21.15.178:0/454819987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b18036b90 msgr2=0x7f9b18039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 --2- 172.21.15.178:0/454819987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b18036b90 0x7f9b18039050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x557338256ce0 tx=0x7f9c30041040 comp rx=0 tx=0).stop 2024-09-21T09:03:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 -- 172.21.15.178:0/454819987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338269ff0 msgr2=0x55733826a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 --2- 172.21.15.178:0/454819987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338269ff0 0x55733826a410 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x557338250300 tx=0x7f9c380188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 -- 172.21.15.178:0/454819987 shutdown_connections 2024-09-21T09:03:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 --2- 172.21.15.178:0/454819987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b18036b90 0x7f9b18039050 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 --2- 172.21.15.178:0/454819987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338269ff0 0x55733826a410 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 -- 172.21.15.178:0/454819987 >> 172.21.15.178:0/454819987 conn(0x55733825ef80 msgr2=0x557338261b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 -- 172.21.15.178:0/454819987 shutdown_connections 2024-09-21T09:03:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 -- 172.21.15.178:0/454819987 wait complete. 2024-09-21T09:03:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557338258ba0 msgr2=0x55733825af90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557338258ba0 0x55733825af90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55733815ca10 msgr2=0x5573382562c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55733815ca10 0x5573382562c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b24036b90 msgr2=0x7f9b24039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b24036b90 0x7f9b24039050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9c28057000 tx=0x7f9c28052000 comp rx=0 tx=0).stop 2024-09-21T09:03:22.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338158710 msgr2=0x55733824f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.214+0000 7f9c4273e800 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338158710 0x55733824f250 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000b7c0 tx=0x7f9c30000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.215+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 shutdown_connections 2024-09-21T09:03:22.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.215+0000 7f9c4273e800 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x557338258ba0 0x55733825af90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.215+0000 7f9c4273e800 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55733815ca10 0x5573382562c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.215+0000 7f9c4273e800 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b24036b90 0x7f9b24039050 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.215+0000 7f9c4273e800 1 --2- 172.21.15.178:0/1889225217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557338158710 0x55733824f250 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.215+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 >> 172.21.15.178:0/1889225217 conn(0x557338153fe0 msgr2=0x557338241ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.215+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 shutdown_connections 2024-09-21T09:03:22.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.215+0000 7f9c4273e800 1 -- 172.21.15.178:0/1889225217 wait complete. 2024-09-21T09:03:22.226 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-21T09:03:22.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-21T09:03:22.226 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-21T09:03:22.273 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:22.273 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:22.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.272+0000 7fa9bfd2c800 1 Processor -- start 2024-09-21T09:03:22.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.272+0000 7fa9bfd2c800 1 -- start start 2024-09-21T09:03:22.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.272+0000 7fa9bfd2c800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56336c4d5710 0x56336c4d5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.272+0000 7fa9bfd2c800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56336c394b30 con 0x56336c4d6050 2024-09-21T09:03:22.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.272+0000 7fa9bfd2c800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x56336c376360 con 0x56336c4d5710 2024-09-21T09:03:22.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.272+0000 7fa9bba59640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56336c4d5710 0x56336c4d5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.272+0000 7fa9bba59640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56336c4d5710 0x56336c4d5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44080/0 (socket says 172.21.15.178:44080) 2024-09-21T09:03:22.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.272+0000 7fa9bba59640 1 -- 172.21.15.178:0/2828342423 learned_addr learned my addr 172.21.15.178:0/2828342423 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.272+0000 7fa9bb258640 1 --1- 172.21.15.178:0/2828342423 >> v1:172.21.15.44:6789/0 conn(0x56336c4d6050 0x56336c4daa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46878/0 (socket says 172.21.15.178:46878) 2024-09-21T09:03:22.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.273+0000 7fa9bba59640 1 -- 172.21.15.178:0/2828342423 >> v1:172.21.15.44:6789/0 conn(0x56336c4d6050 legacy=0x56336c4daa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.273+0000 7fa9baa57640 1 -- 172.21.15.178:0/2828342423 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3864688234 0 0) 0x56336c394b30 con 0x56336c4d6050 2024-09-21T09:03:22.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.273+0000 7fa9bba59640 1 -- 172.21.15.178:0/2828342423 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56336c39ce00 con 0x56336c4d5710 2024-09-21T09:03:22.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.275+0000 7fa9bba59640 1 --2- 172.21.15.178:0/2828342423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c4d5b10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00a520 tx=0x7fa9ac045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c51547aeddc0e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.275+0000 7fa9baa57640 1 -- 172.21.15.178:0/2828342423 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ac055070 con 0x56336c4d5710 2024-09-21T09:03:22.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.275+0000 7fa9baa57640 1 -- 172.21.15.178:0/2828342423 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ac0515b0 con 0x56336c4d5710 2024-09-21T09:03:22.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.275+0000 7fa9baa57640 1 -- 172.21.15.178:0/2828342423 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ac0518d0 con 0x56336c4d5710 2024-09-21T09:03:22.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.275+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/2828342423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 msgr2=0x56336c4d5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.275+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/2828342423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c4d5b10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00a520 tx=0x7fa9ac045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.275+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/2828342423 shutdown_connections 2024-09-21T09:03:22.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.275+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/2828342423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c4d5b10 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.275+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/2828342423 >> 172.21.15.178:0/2828342423 conn(0x56336c4d0fe0 msgr2=0x56336c4d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.275+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/2828342423 shutdown_connections 2024-09-21T09:03:22.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.276+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/2828342423 wait complete. 2024-09-21T09:03:22.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.289+0000 7fa9bfd2c800 1 Processor -- start 2024-09-21T09:03:22.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.289+0000 7fa9bfd2c800 1 -- start start 2024-09-21T09:03:22.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.289+0000 7fa9bfd2c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c5c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.289+0000 7fa9bfd2c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56336c421360 con 0x56336c4d5710 2024-09-21T09:03:22.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.290+0000 7fa9bba59640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c5c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.290+0000 7fa9bba59640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c5c46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44084/0 (socket says 172.21.15.178:44084) 2024-09-21T09:03:22.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.290+0000 7fa9bba59640 1 -- 172.21.15.178:0/542760895 learned_addr learned my addr 172.21.15.178:0/542760895 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.290+0000 7fa9bba59640 1 -- 172.21.15.178:0/542760895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56336c36ebc0 con 0x56336c4d5710 2024-09-21T09:03:22.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.290+0000 7fa9bba59640 1 --2- 172.21.15.178:0/542760895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c5c46b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac000c00 tx=0x7fa9ac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d9fbb314d0a4e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.290+0000 7fa8a9e0b640 1 -- 172.21.15.178:0/542760895 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ac0519d0 con 0x56336c4d5710 2024-09-21T09:03:22.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.290+0000 7fa8a9e0b640 1 -- 172.21.15.178:0/542760895 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ac051b70 con 0x56336c4d5710 2024-09-21T09:03:22.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.290+0000 7fa8a9e0b640 1 -- 172.21.15.178:0/542760895 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ac051e50 con 0x56336c4d5710 2024-09-21T09:03:22.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.291+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/542760895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 msgr2=0x56336c5c46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.291+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/542760895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c5c46b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac000c00 tx=0x7fa9ac051000 comp rx=0 tx=0).stop 2024-09-21T09:03:22.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.291+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/542760895 shutdown_connections 2024-09-21T09:03:22.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.291+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/542760895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c5c46b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.291+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/542760895 >> 172.21.15.178:0/542760895 conn(0x56336c4d0fe0 msgr2=0x56336c5c0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.291+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/542760895 shutdown_connections 2024-09-21T09:03:22.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.291+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/542760895 wait complete. 2024-09-21T09:03:22.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.291+0000 7fa9bfd2c800 1 Processor -- start 2024-09-21T09:03:22.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.292+0000 7fa9bfd2c800 1 -- start start 2024-09-21T09:03:22.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.292+0000 7fa9bfd2c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c5cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.292+0000 7fa9bfd2c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56336c4dc5f0 con 0x56336c4d5710 2024-09-21T09:03:22.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.292+0000 7fa9bba59640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c5cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.292+0000 7fa9bba59640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c5cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44094/0 (socket says 172.21.15.178:44094) 2024-09-21T09:03:22.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.292+0000 7fa9bba59640 1 -- 172.21.15.178:0/3023029194 learned_addr learned my addr 172.21.15.178:0/3023029194 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.292+0000 7fa9bba59640 1 -- 172.21.15.178:0/3023029194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56336c382fe0 con 0x56336c4d5710 2024-09-21T09:03:22.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.292+0000 7fa9bba59640 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c5cbeb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00a520 tx=0x7fa9ac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.292+0000 7fa8a3fff640 1 -- 172.21.15.178:0/3023029194 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ac073070 con 0x56336c4d5710 2024-09-21T09:03:22.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.292+0000 7fa8a3fff640 1 -- 172.21.15.178:0/3023029194 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ac05a580 con 0x56336c4d5710 2024-09-21T09:03:22.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.292+0000 7fa8a3fff640 1 -- 172.21.15.178:0/3023029194 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ac05a8a0 con 0x56336c4d5710 2024-09-21T09:03:22.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.292+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56336c5cc3f0 con 0x56336c4d5710 2024-09-21T09:03:22.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.293+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56336c5cc970 con 0x56336c4d5710 2024-09-21T09:03:22.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.293+0000 7fa8a3fff640 1 -- 172.21.15.178:0/3023029194 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa9ac076070 con 0x56336c4d5710 2024-09-21T09:03:22.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.293+0000 7fa8a3fff640 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa8a4036b90 0x7fa8a4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.293+0000 7fa8a3fff640 1 -- 172.21.15.178:0/3023029194 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fa9ac062070 con 0x56336c4d5710 2024-09-21T09:03:22.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.293+0000 7fa9bb258640 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa8a4036b90 0x7fa8a4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.294+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56336c4d6050 0x56336c5d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.294+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c5d34f0 con 0x56336c4d6050 2024-09-21T09:03:22.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.294+0000 7fa9bc25a640 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56336c4d6050 0x56336c5d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.294+0000 7fa9bb258640 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa8a4036b90 0x7fa8a4039050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0000c00 tx=0x7fa9b00013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.294+0000 7fa9bc25a640 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56336c4d6050 0x56336c5d2f20 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.294+0000 7fa9bc25a640 1 -- 172.21.15.178:0/3023029194 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9b400a4a0 con 0x56336c4d6050 2024-09-21T09:03:22.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.294+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c5d04d0 con 0x56336c4d6050 2024-09-21T09:03:22.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.295+0000 7fa9bc25a640 1 -- 172.21.15.178:0/3023029194 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9b400a4a0 con 0x56336c4d6050 2024-09-21T09:03:22.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.295+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56336c5d5800 0x56336c5d7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.295+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c5d8290 con 0x56336c5d5800 2024-09-21T09:03:22.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.295+0000 7fa9bba59640 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56336c5d5800 0x56336c5d7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.295+0000 7fa9bba59640 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56336c5d5800 0x56336c5d7bf0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.296+0000 7fa9bba59640 1 -- 172.21.15.178:0/3023029194 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c5d5800 2024-09-21T09:03:22.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.296+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c5d46a0 con 0x56336c4d6050 2024-09-21T09:03:22.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.296+0000 7fa9bc25a640 1 -- 172.21.15.178:0/3023029194 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9b400a4a0 con 0x56336c4d6050 2024-09-21T09:03:22.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.296+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c5d4b40 con 0x56336c4d6050 2024-09-21T09:03:22.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.296+0000 7fa9bc25a640 1 -- 172.21.15.178:0/3023029194 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9b400a4a0 con 0x56336c4d6050 2024-09-21T09:03:22.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.296+0000 7fa9bfd2c800 1 Processor -- start 2024-09-21T09:03:22.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.296+0000 7fa9bfd2c800 1 -- start start 2024-09-21T09:03:22.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.297+0000 7fa9bfd2c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5e6c10 0x56336c5e7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.297+0000 7fa9bfd2c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56336c370580 con 0x56336c5e6c10 2024-09-21T09:03:22.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.297+0000 7fa9bc25a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5e6c10 0x56336c5e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.297+0000 7fa9bc25a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5e6c10 0x56336c5e7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44100/0 (socket says 172.21.15.178:44100) 2024-09-21T09:03:22.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.297+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1344648964 learned_addr learned my addr 172.21.15.178:0/1344648964 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.297+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1344648964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56336c5e7570 con 0x56336c5e6c10 2024-09-21T09:03:22.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.298+0000 7fa9bc25a640 1 --2- 172.21.15.178:0/1344648964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5e6c10 0x56336c5e7030 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x56336c5d38d0 tx=0x7fa9b4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.298+0000 7fa8a17fa640 1 -- 172.21.15.178:0/1344648964 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9b4014450 con 0x56336c5e6c10 2024-09-21T09:03:22.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.298+0000 7fa8a17fa640 1 -- 172.21.15.178:0/1344648964 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b40145f0 con 0x56336c5e6c10 2024-09-21T09:03:22.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.298+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1344648964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56336c5e7800 con 0x56336c5e6c10 2024-09-21T09:03:22.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.298+0000 7fa8a17fa640 1 -- 172.21.15.178:0/1344648964 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9b4014910 con 0x56336c5e6c10 2024-09-21T09:03:22.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.298+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1344648964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56336c5ea4e0 con 0x56336c5e6c10 2024-09-21T09:03:22.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.298+0000 7fa8a17fa640 1 -- 172.21.15.178:0/1344648964 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa9b4011040 con 0x56336c5e6c10 2024-09-21T09:03:22.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.299+0000 7fa8a17fa640 1 --2- 172.21.15.178:0/1344648964 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa894036b40 0x7fa894039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.299+0000 7fa8a17fa640 1 -- 172.21.15.178:0/1344648964 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fa9b401e070 con 0x56336c5e6c10 2024-09-21T09:03:22.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.299+0000 7fa9bba59640 1 --2- 172.21.15.178:0/1344648964 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa894036b40 0x7fa894039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.299+0000 7fa9bfd2c800 1 Processor -- start 2024-09-21T09:03:22.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.299+0000 7fa9bfd2c800 1 -- start start 2024-09-21T09:03:22.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.299+0000 7fa9bba59640 1 --2- 172.21.15.178:0/1344648964 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa894036b40 0x7fa894039000 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x56336c5d3940 tx=0x7fa9ac050f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.299+0000 7fa9bfd2c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5f38e0 0x56336c5f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.299+0000 7fa9bfd2c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56336c5c4da0 con 0x56336c5f38e0 2024-09-21T09:03:22.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.299+0000 7fa9bc25a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5f38e0 0x56336c5f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.300+0000 7fa9bc25a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5f38e0 0x56336c5f3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44102/0 (socket says 172.21.15.178:44102) 2024-09-21T09:03:22.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.300+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1098959746 learned_addr learned my addr 172.21.15.178:0/1098959746 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.300+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1098959746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56336c5f42b0 con 0x56336c5f38e0 2024-09-21T09:03:22.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.300+0000 7fa9bc25a640 1 --2- 172.21.15.178:0/1098959746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5f38e0 0x56336c5f3ce0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa9b404cd40 tx=0x7fa9b402b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4d7b801e9ae18b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.300+0000 7fa89affd640 1 -- 172.21.15.178:0/1098959746 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9b4028040 con 0x56336c5f38e0 2024-09-21T09:03:22.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.300+0000 7fa89affd640 1 -- 172.21.15.178:0/1098959746 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b4011c40 con 0x56336c5f38e0 2024-09-21T09:03:22.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.300+0000 7fa89affd640 1 -- 172.21.15.178:0/1098959746 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9b4046b30 con 0x56336c5f38e0 2024-09-21T09:03:22.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.301+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1098959746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5f38e0 msgr2=0x56336c5f3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.301+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1098959746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5f38e0 0x56336c5f3ce0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa9b404cd40 tx=0x7fa9b402b720 comp rx=0 tx=0).stop 2024-09-21T09:03:22.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.301+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1098959746 shutdown_connections 2024-09-21T09:03:22.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.301+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1098959746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5f38e0 0x56336c5f3ce0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.301+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1098959746 >> 172.21.15.178:0/1098959746 conn(0x56336c5efc40 msgr2=0x56336c5edd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.301+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1098959746 shutdown_connections 2024-09-21T09:03:22.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.301+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1098959746 wait complete. 2024-09-21T09:03:22.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.301+0000 7fa9bfd2c800 1 Processor -- start 2024-09-21T09:03:22.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.301+0000 7fa9bfd2c800 1 -- start start 2024-09-21T09:03:22.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.301+0000 7fa9bfd2c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5f38e0 0x56336c44b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.301+0000 7fa9bfd2c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56336c5f4960 con 0x56336c5f38e0 2024-09-21T09:03:22.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.301+0000 7fa9bc25a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5f38e0 0x56336c44b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.301+0000 7fa9bc25a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5f38e0 0x56336c44b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44118/0 (socket says 172.21.15.178:44118) 2024-09-21T09:03:22.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.301+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 learned_addr learned my addr 172.21.15.178:0/1799730264 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.302+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56336c449dd0 con 0x56336c5f38e0 2024-09-21T09:03:22.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.302+0000 7fa9bc25a640 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5f38e0 0x56336c44b6e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa9b404bc10 tx=0x7fa9b404ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.302+0000 7fa8997fa640 1 -- 172.21.15.178:0/1799730264 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9b4028030 con 0x56336c5f38e0 2024-09-21T09:03:22.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.302+0000 7fa8997fa640 1 -- 172.21.15.178:0/1799730264 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b4022b80 con 0x56336c5f38e0 2024-09-21T09:03:22.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.302+0000 7fa8997fa640 1 -- 172.21.15.178:0/1799730264 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9b4022e60 con 0x56336c5f38e0 2024-09-21T09:03:22.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.302+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56336c44a060 con 0x56336c5f38e0 2024-09-21T09:03:22.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.302+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56336c44a560 con 0x56336c5f38e0 2024-09-21T09:03:22.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.303+0000 7fa8997fa640 1 -- 172.21.15.178:0/1799730264 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa9b404e3e0 con 0x56336c5f38e0 2024-09-21T09:03:22.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.303+0000 7fa8997fa640 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa884036b90 0x7fa884039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.303+0000 7fa8997fa640 1 -- 172.21.15.178:0/1799730264 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fa9b400e040 con 0x56336c5f38e0 2024-09-21T09:03:22.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.303+0000 7fa9bba59640 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa884036b90 0x7fa884039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.303+0000 7fa9bba59640 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa884036b90 0x7fa884039050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac067040 tx=0x7fa9ac089000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.303+0000 7fa9bfd2c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.304+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56336c608c10 0x56336c60b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.304+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c60b820 con 0x56336c608c10 2024-09-21T09:03:22.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.304+0000 7fa9bb258640 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56336c608c10 0x56336c60b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.304+0000 7fa9bb258640 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56336c608c10 0x56336c60b0d0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.304+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9b000f5f0 con 0x56336c608c10 2024-09-21T09:03:22.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.304+0000 7fa9bfd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.304+0000 7fa9bfd2c800 20 realm 2024-09-21T09:03:22.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.304+0000 7fa9bfd2c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.304+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c608060 con 0x56336c608c10 2024-09-21T09:03:22.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.304+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9b000f5f0 con 0x56336c608c10 2024-09-21T09:03:22.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.304+0000 7fa9bfd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.304+0000 7fa9bfd2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:22.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.304+0000 7fa9bfd2c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.304+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c60c310 con 0x56336c608c10 2024-09-21T09:03:22.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.305+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9b000f5f0 con 0x56336c608c10 2024-09-21T09:03:22.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.305+0000 7fa9bfd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.305+0000 7fa9bfd2c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.305+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c60cbe0 con 0x56336c608c10 2024-09-21T09:03:22.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.305+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9b000f5f0 con 0x56336c608c10 2024-09-21T09:03:22.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.305+0000 7fa9bfd2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:22.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.305+0000 7fa9bfd2c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.305+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56336c60d600 0x56336c60f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.305+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c610160 con 0x56336c60d600 2024-09-21T09:03:22.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.305+0000 7fa9bc25a640 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56336c60d600 0x56336c60f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.306+0000 7fa9bc25a640 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56336c60d600 0x56336c60f9f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.306+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.306+0000 7fa9bfd2c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:22.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.306+0000 7fa9bfd2c800 20 searching for the correct realm 2024-09-21T09:03:22.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.306+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56336c612110 0x56336c6145d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.306+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c612110 2024-09-21T09:03:22.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.306+0000 7fa9bba59640 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56336c612110 0x56336c6145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.306+0000 7fa9bba59640 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56336c612110 0x56336c6145d0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.307+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.307+0000 7fa9bba59640 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fa9ac078070 0x7fa9ac068120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.307+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x7fa9ac078070 2024-09-21T09:03:22.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.307+0000 7fa9bb258640 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fa9ac078070 0x7fa9ac068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.307+0000 7fa9bb258640 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fa9ac078070 0x7fa9ac068120 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.307+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b000f5f0 con 0x7fa9ac078070 2024-09-21T09:03:22.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.307+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c60d600 2024-09-21T09:03:22.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.307+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.307+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c608c10 2024-09-21T09:03:22.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.308+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b000f5f0 con 0x56336c608c10 2024-09-21T09:03:22.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.308+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c608c10 2024-09-21T09:03:22.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.308+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.308+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c60d600 2024-09-21T09:03:22.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.308+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.308+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c60d600 2024-09-21T09:03:22.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.309+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.309+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x7fa9ac078070 2024-09-21T09:03:22.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.309+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.309+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c612110 2024-09-21T09:03:22.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.309+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.309+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c608c10 2024-09-21T09:03:22.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.309+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.309+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c60d600 2024-09-21T09:03:22.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.310+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.310+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c608c10 2024-09-21T09:03:22.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.310+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.310+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x7fa9ac078070 2024-09-21T09:03:22.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.310+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.310+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c612110 2024-09-21T09:03:22.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.310+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.310+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c612110 2024-09-21T09:03:22.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.310+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.310+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c60d600 2024-09-21T09:03:22.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.311+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.311+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c612110 2024-09-21T09:03:22.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.311+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.311+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c612110 2024-09-21T09:03:22.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.311+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.311+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c608c10 2024-09-21T09:03:22.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.311+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.311+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c608c10 2024-09-21T09:03:22.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.312+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.312+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c60d600 2024-09-21T09:03:22.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.312+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.312+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c612110 2024-09-21T09:03:22.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.312+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.312+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x7fa9ac078070 2024-09-21T09:03:22.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.312+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.312+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c608c10 2024-09-21T09:03:22.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.312+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.313+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c60d600 2024-09-21T09:03:22.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.313+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.313+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c612110 2024-09-21T09:03:22.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.313+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.313+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c60d600 2024-09-21T09:03:22.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.313+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.313+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x7fa9ac078070 2024-09-21T09:03:22.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.314+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.314+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c612110 2024-09-21T09:03:22.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.314+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.314+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c60d600 2024-09-21T09:03:22.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.314+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.314+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x56336c608c10 2024-09-21T09:03:22.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.314+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.314+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56336c614ca0 con 0x7fa9ac078070 2024-09-21T09:03:22.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.314+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:22.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:22.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:22.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:22.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:22.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:22.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c610b20 con 0x56336c608c10 2024-09-21T09:03:22.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c610760 con 0x56336c608c10 2024-09-21T09:03:22.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:22.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c611500 con 0x56336c608c10 2024-09-21T09:03:22.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:22.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 zone default found 2024-09-21T09:03:22.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 4 Realm: () 2024-09-21T09:03:22.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:22.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:22.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:22.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 zonegroup default 2024-09-21T09:03:22.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.315+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c615160 con 0x56336c60d600 2024-09-21T09:03:22.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.316+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.316+0000 7fa9bfd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.316+0000 7fa9bfd2c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.316+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c617430 con 0x56336c612110 2024-09-21T09:03:22.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.316+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.316+0000 7fa9bfd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.316+0000 7fa9bfd2c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.316+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c6177d0 con 0x56336c612110 2024-09-21T09:03:22.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.316+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.316+0000 7fa9bfd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.316+0000 7fa9bfd2c800 20 started sync module instance, tier type = 2024-09-21T09:03:22.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.316+0000 7fa9bfd2c800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:22.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.316+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c6168c0 con 0x7fa9ac078070 2024-09-21T09:03:22.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.317+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.317+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94778861645328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c6168c0 con 0x7fa9ac078070 2024-09-21T09:03:22.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.317+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c6181e0 con 0x56336c608c10 2024-09-21T09:03:22.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.318+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94778861645328] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.318+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.318+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94778861643248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c6181e0 con 0x56336c608c10 2024-09-21T09:03:22.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.318+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c618c00 con 0x56336c612110 2024-09-21T09:03:22.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.320+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.320+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94778861643248] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.320+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94778861651696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c6194a0 con 0x56336c612110 2024-09-21T09:03:22.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.320+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c617d50 con 0x7fa9ac078070 2024-09-21T09:03:22.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.321+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.321+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94778861656624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61a300 con 0x7fa9ac078070 2024-09-21T09:03:22.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.321+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94778861651696] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.321+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61ad40 con 0x56336c608c10 2024-09-21T09:03:22.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.322+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.322+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94778861654080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61ad00 con 0x56336c608c10 2024-09-21T09:03:22.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.322+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61b720 con 0x56336c60d600 2024-09-21T09:03:22.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.322+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94778861656624] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.323+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.323+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94778861662736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61bb10 con 0x56336c60d600 2024-09-21T09:03:22.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.323+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61c4d0 con 0x56336c60d600 2024-09-21T09:03:22.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.323+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94778861654080] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.324+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94778861662736] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.324+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.324+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94778861657680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61c020 con 0x56336c60d600 2024-09-21T09:03:22.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.324+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61c9e0 con 0x56336c60d600 2024-09-21T09:03:22.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.325+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.325+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94778861667632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61ce00 con 0x56336c60d600 2024-09-21T09:03:22.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.325+0000 7fa9bfd2c800 20 add_watcher() i=0 2024-09-21T09:03:22.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.325+0000 7fa9bfd2c800 20 add_watcher() i=1 2024-09-21T09:03:22.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.325+0000 7fa9bfd2c800 20 add_watcher() i=2 2024-09-21T09:03:22.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.325+0000 7fa9bfd2c800 20 add_watcher() i=3 2024-09-21T09:03:22.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.325+0000 7fa9bfd2c800 20 add_watcher() i=4 2024-09-21T09:03:22.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.325+0000 7fa9bfd2c800 20 add_watcher() i=5 2024-09-21T09:03:22.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.325+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94778861657680] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.325+0000 7fa9bfd2c800 20 add_watcher() i=6 2024-09-21T09:03:22.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.326+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94778861667632] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.326+0000 7fa9bfd2c800 20 add_watcher() i=7 2024-09-21T09:03:22.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.326+0000 7fa9bfd2c800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:22.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.326+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c61ce00 con 0x56336c608c10 2024-09-21T09:03:22.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.326+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.326+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94778861668688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61cd70 con 0x56336c608c10 2024-09-21T09:03:22.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.327+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94778861668688] v29'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.327+0000 7fa871fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:22.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.327+0000 7fa9bfd2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:22.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.327+0000 7fa9bfd2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:22.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.328+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c628980 con 0x56336c608c10 2024-09-21T09:03:22.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.329+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.329+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c628fd0 con 0x56336c60d600 2024-09-21T09:03:22.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.330+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.330+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c628fd0 con 0x56336c612110 2024-09-21T09:03:22.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.331+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.331+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c629860 con 0x56336c608c10 2024-09-21T09:03:22.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.332+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'135 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.332+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c624620 con 0x7fa9ac078070 2024-09-21T09:03:22.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.333+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.333+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c6245f0 con 0x56336c612110 2024-09-21T09:03:22.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.334+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.334+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62a410 con 0x56336c608c10 2024-09-21T09:03:22.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.335+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.335+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62a510 con 0x56336c60d600 2024-09-21T09:03:22.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.336+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.336+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62a510 con 0x7fa9ac078070 2024-09-21T09:03:22.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.337+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.337+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62aa20 con 0x56336c612110 2024-09-21T09:03:22.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.338+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.338+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62aa20 con 0x7fa9ac078070 2024-09-21T09:03:22.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.339+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.339+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62aa20 con 0x56336c60d600 2024-09-21T09:03:22.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.340+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.340+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62aa20 con 0x7fa9ac078070 2024-09-21T09:03:22.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.341+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.341+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62aa20 con 0x56336c60d600 2024-09-21T09:03:22.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.342+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.342+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62aa20 con 0x56336c608c10 2024-09-21T09:03:22.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.343+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.343+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62aa20 con 0x56336c612110 2024-09-21T09:03:22.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.344+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.344+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x7fa9ac078070 2024-09-21T09:03:22.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.345+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.345+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x56336c612110 2024-09-21T09:03:22.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.346+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.346+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x56336c608c10 2024-09-21T09:03:22.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.347+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.347+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x56336c608c10 2024-09-21T09:03:22.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.348+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'137 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.348+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x56336c612110 2024-09-21T09:03:22.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.349+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.349+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x7fa9ac078070 2024-09-21T09:03:22.352 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.350+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.352 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.350+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x56336c612110 2024-09-21T09:03:22.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.351+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.351+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x56336c612110 2024-09-21T09:03:22.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.352+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.352+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x56336c612110 2024-09-21T09:03:22.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.353+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.353+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x56336c612110 2024-09-21T09:03:22.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.354+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.354+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x56336c60d600 2024-09-21T09:03:22.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.355+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.355+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x56336c612110 2024-09-21T09:03:22.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.356+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.356+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x56336c60d600 2024-09-21T09:03:22.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.357+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.357+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x56336c612110 2024-09-21T09:03:22.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.358+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.358+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x56336c60d600 2024-09-21T09:03:22.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.359+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.359+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c62ae20 con 0x7fa9ac078070 2024-09-21T09:03:22.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.360+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.360+0000 7fa870fe1640 20 reqs_thread_entry: start 2024-09-21T09:03:22.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.361+0000 7fa9bfd2c800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:22.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.361+0000 7fa9bfd2c800 20 Filter name: none 2024-09-21T09:03:22.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.361+0000 7fa7ea7fc640 20 reqs_thread_entry: start 2024-09-21T09:03:22.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.361+0000 7fa9bfd2c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-21T09:03:22.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.361+0000 7fa9bfd2c800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.361+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c655c10 con 0x56336c60d600 2024-09-21T09:03:22.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.361+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.361+0000 7fa9bfd2c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-21T09:03:22.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.361+0000 7fa9bfd2c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-21T09:03:22.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.361+0000 7fa9bfd2c800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-21T09:03:22.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.361+0000 7fa9bfd2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:22.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.361+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c655bd0 con 0x56336c608c10 2024-09-21T09:03:22.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.362+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv4 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.362+0000 7fa9bfd2c800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-21T09:03:22.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.362+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c655bd0 con 0x56336c60d600 2024-09-21T09:03:22.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.363+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v29'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.363+0000 7fa9bfd2c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T09:03:22.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.363+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94778861908336 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c658b30 con 0x56336c612110 2024-09-21T09:03:22.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.363+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== watch-notify(notify (1) cookie 94778861651696 notify 124554051589 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56336c44a560 con 0x56336c612110 2024-09-21T09:03:22.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.363+0000 7fa89affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051589 cookie 94778861651696 notifier 4567 bl.length()=170 2024-09-21T09:03:22.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.363+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 27 ==== osd_op_reply(97 notify.2 [notify cookie 94778861908336 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.363+0000 7fa89affd640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fa880003d60 con 0x56336c612110 2024-09-21T09:03:22.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.363+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 28 ==== watch-notify(notify_complete (2) cookie 94778861908336 notify 124554051589 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa9ac0a1040 con 0x56336c612110 2024-09-21T09:03:22.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.363+0000 7fa9bfd2c800 10 removing email index: 2024-09-21T09:03:22.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.363+0000 7fa9bfd2c800 10 removing user buckets index 2024-09-21T09:03:22.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.363+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.363+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c656610 con 0x56336c608c10 2024-09-21T09:03:22.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.364+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v29'5 uv5 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.364+0000 7fa9bfd2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-21T09:03:22.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.364+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94778861908336 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c658b30 con 0x56336c608c10 2024-09-21T09:03:22.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.365+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== watch-notify(notify (1) cookie 94778861654080 notify 124554051599 ret 0) ==== 217+0+0 (crc 0 0 0) 0x56336c62aab0 con 0x56336c608c10 2024-09-21T09:03:22.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.365+0000 7fa89affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051599 cookie 94778861654080 notifier 4567 bl.length()=175 2024-09-21T09:03:22.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.365+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(100 notify.4 [notify cookie 94778861908336 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.365+0000 7fa89affd640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fa880003d60 con 0x56336c608c10 2024-09-21T09:03:22.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.365+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.365+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== watch-notify(notify_complete (2) cookie 94778861908336 notify 124554051599 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56336c623f70 con 0x56336c608c10 2024-09-21T09:03:22.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.365+0000 7fa9bfd2c800 10 removing user index: testx$tenanteduser 2024-09-21T09:03:22.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.365+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c658180 con 0x56336c60d600 2024-09-21T09:03:22.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.366+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v29'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.366+0000 7fa9bfd2c800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-21T09:03:22.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.366+0000 7fa9bfd2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-21T09:03:22.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.366+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94778861904144 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56336c6579f0 con 0x7fa9ac078070 2024-09-21T09:03:22.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.367+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== watch-notify(notify (1) cookie 94778861656624 notify 124554051603 ret 0) ==== 209+0+0 (crc 0 0 0) 0x56336c623f70 con 0x7fa9ac078070 2024-09-21T09:03:22.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.367+0000 7fa89affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051603 cookie 94778861656624 notifier 4567 bl.length()=167 2024-09-21T09:03:22.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.367+0000 7fa89affd640 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fa880003d60 con 0x7fa9ac078070 2024-09-21T09:03:22.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.367+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(103 notify.3 [notify cookie 94778861904144 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.367+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== watch-notify(notify_complete (2) cookie 94778861904144 notify 124554051603 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56336c6284b0 con 0x7fa9ac078070 2024-09-21T09:03:22.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.367+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.368+0000 7fa871fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:22.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.368+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94778861668688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c6272d0 con 0x56336c608c10 2024-09-21T09:03:22.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.369+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94778861668688] v29'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.369+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94778861645328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61c950 con 0x7fa9ac078070 2024-09-21T09:03:22.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.370+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94778861645328] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.370+0000 7fa9bfd2c800 20 remove_watcher() i=0 2024-09-21T09:03:22.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.370+0000 7fa9bfd2c800 2 removed watcher, disabling cache 2024-09-21T09:03:22.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.370+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94778861643248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61c950 con 0x56336c608c10 2024-09-21T09:03:22.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.371+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 35 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94778861643248] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.371+0000 7fa9bfd2c800 20 remove_watcher() i=1 2024-09-21T09:03:22.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.371+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94778861651696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61c950 con 0x56336c612110 2024-09-21T09:03:22.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.372+0000 7fa9bba59640 1 -- 172.21.15.178:0/1799730264 <== osd.3 v2:172.21.15.178:6808/24558189 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94778861651696] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ac07f070 con 0x56336c612110 2024-09-21T09:03:22.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.372+0000 7fa9bfd2c800 20 remove_watcher() i=2 2024-09-21T09:03:22.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.372+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94778861656624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61c950 con 0x7fa9ac078070 2024-09-21T09:03:22.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.373+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.2 v2:172.21.15.178:6816/3267136144 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94778861656624] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x7fa9ac078070 2024-09-21T09:03:22.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.373+0000 7fa9bfd2c800 20 remove_watcher() i=3 2024-09-21T09:03:22.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.373+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94778861654080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c619a30 con 0x56336c608c10 2024-09-21T09:03:22.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.374+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 <== osd.1 v2:172.21.15.178:6800/627496675 36 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94778861654080] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b002b040 con 0x56336c608c10 2024-09-21T09:03:22.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.374+0000 7fa9bfd2c800 20 remove_watcher() i=4 2024-09-21T09:03:22.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.374+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94778861662736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61c950 con 0x56336c60d600 2024-09-21T09:03:22.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.375+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94778861662736] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.375+0000 7fa9bfd2c800 20 remove_watcher() i=5 2024-09-21T09:03:22.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.375+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94778861657680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c619040 con 0x56336c60d600 2024-09-21T09:03:22.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.376+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94778861657680] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.376+0000 7fa9bfd2c800 20 remove_watcher() i=6 2024-09-21T09:03:22.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.376+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94778861667632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56336c61b210 con 0x56336c60d600 2024-09-21T09:03:22.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.377+0000 7fa9bc25a640 1 -- 172.21.15.178:0/1799730264 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94778861667632] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b403dd70 con 0x56336c60d600 2024-09-21T09:03:22.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.377+0000 7fa9bfd2c800 20 remove_watcher() i=7 2024-09-21T09:03:22.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.377+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56336c60d600 msgr2=0x56336c60f9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.377+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56336c60d600 0x56336c60f9f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.377+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56336c608c10 msgr2=0x56336c60b0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.377+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56336c608c10 0x56336c60b0d0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.377+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fa9ac078070 msgr2=0x7fa9ac068120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.377+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fa9ac078070 0x7fa9ac068120 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.377+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56336c612110 msgr2=0x56336c6145d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.377+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56336c612110 0x56336c6145d0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa884036b90 msgr2=0x7fa884039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa884036b90 0x7fa884039050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac067040 tx=0x7fa9ac089000 comp rx=0 tx=0).stop 2024-09-21T09:03:22.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bb258640 1 -- 172.21.15.178:0/1799730264 reap_dead start 2024-09-21T09:03:22.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5f38e0 msgr2=0x56336c44b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5f38e0 0x56336c44b6e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa9b404bc10 tx=0x7fa9b404ccd0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 shutdown_connections 2024-09-21T09:03:22.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1799730264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5f38e0 0x56336c44b6e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 >> 172.21.15.178:0/1799730264 conn(0x56336c5efc40 msgr2=0x56336c5edd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 shutdown_connections 2024-09-21T09:03:22.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1799730264 wait complete. 2024-09-21T09:03:22.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1344648964 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa894036b40 msgr2=0x7fa894039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1344648964 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa894036b40 0x7fa894039000 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x56336c5d3940 tx=0x7fa9ac050f90 comp rx=0 tx=0).stop 2024-09-21T09:03:22.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1344648964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5e6c10 msgr2=0x56336c5e7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1344648964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5e6c10 0x56336c5e7030 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x56336c5d38d0 tx=0x7fa9b4018830 comp rx=0 tx=0).stop 2024-09-21T09:03:22.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1344648964 shutdown_connections 2024-09-21T09:03:22.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1344648964 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa894036b40 0x7fa894039000 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/1344648964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c5e6c10 0x56336c5e7030 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1344648964 >> 172.21.15.178:0/1344648964 conn(0x56336c5dbba0 msgr2=0x56336c5de720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1344648964 shutdown_connections 2024-09-21T09:03:22.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/1344648964 wait complete. 2024-09-21T09:03:22.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56336c5d5800 msgr2=0x56336c5d7bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56336c5d5800 0x56336c5d7bf0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56336c4d6050 msgr2=0x56336c5d2f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.378+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56336c4d6050 0x56336c5d2f20 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.379+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa8a4036b90 msgr2=0x7fa8a4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.379+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa8a4036b90 0x7fa8a4039050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0000c00 tx=0x7fa9b00013b0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.379+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 msgr2=0x56336c5cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.379+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c5cbeb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00a520 tx=0x7fa9ac002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.379+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 shutdown_connections 2024-09-21T09:03:22.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.379+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56336c5d5800 0x56336c5d7bf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.379+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56336c4d6050 0x56336c5d2f20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.379+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa8a4036b90 0x7fa8a4039050 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.379+0000 7fa9bfd2c800 1 --2- 172.21.15.178:0/3023029194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56336c4d5710 0x56336c5cbeb0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.379+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 >> 172.21.15.178:0/3023029194 conn(0x56336c4d0fe0 msgr2=0x56336c5be940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.379+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 shutdown_connections 2024-09-21T09:03:22.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.379+0000 7fa9bfd2c800 1 -- 172.21.15.178:0/3023029194 wait complete. 2024-09-21T09:03:22.395 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-21T09:03:22.397 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-21T09:03:22.400 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:22.400 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-21T09:03:22.400 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-21T09:03:22.400 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-21T09:03:22.446 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:22.446 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:22.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.445+0000 7f3610498800 1 Processor -- start 2024-09-21T09:03:22.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.445+0000 7f3610498800 1 -- start start 2024-09-21T09:03:22.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.445+0000 7f3610498800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55cd1ffd4880 0x55cd1ffd6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.445+0000 7f3610498800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cd1fe8fb30 con 0x55cd1ff446d0 2024-09-21T09:03:22.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.445+0000 7f3610498800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55cd1fe71360 con 0x55cd1ffd4880 2024-09-21T09:03:22.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.446+0000 7f360d78b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55cd1ffd4880 0x55cd1ffd6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.446+0000 7f360df8c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55cd1ff446d0 0x55cd1ffd3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46892/0 (socket says 172.21.15.178:46892) 2024-09-21T09:03:22.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.446+0000 7f360d78b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55cd1ffd4880 0x55cd1ffd6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44126/0 (socket says 172.21.15.178:44126) 2024-09-21T09:03:22.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.446+0000 7f360df8c640 1 -- 172.21.15.178:0/1231405070 learned_addr learned my addr 172.21.15.178:0/1231405070 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:22.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.446+0000 7f360d78b640 1 -- 172.21.15.178:0/1231405070 >> v1:172.21.15.44:6789/0 conn(0x55cd1ff446d0 legacy=0x55cd1ffd3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.446+0000 7f360cf8a640 1 -- 172.21.15.178:0/1231405070 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1312271721 0 0) 0x55cd1fe8fb30 con 0x55cd1ff446d0 2024-09-21T09:03:22.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.446+0000 7f360d78b640 1 -- 172.21.15.178:0/1231405070 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1fe97e00 con 0x55cd1ffd4880 2024-09-21T09:03:22.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.448+0000 7f360d78b640 1 --2- 172.21.15.178:0/1231405070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ffd4880 0x55cd1ffd6c90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f360400a470 tx=0x7f3604045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d41e1670b78334 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.448+0000 7f360cf8a640 1 -- 172.21.15.178:0/1231405070 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3604053570 con 0x55cd1ffd4880 2024-09-21T09:03:22.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.448+0000 7f360cf8a640 1 -- 172.21.15.178:0/1231405070 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3604058070 con 0x55cd1ffd4880 2024-09-21T09:03:22.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.448+0000 7f360cf8a640 1 -- 172.21.15.178:0/1231405070 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3604053880 con 0x55cd1ffd4880 2024-09-21T09:03:22.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.448+0000 7f3610498800 1 -- 172.21.15.178:0/1231405070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ffd4880 msgr2=0x55cd1ffd6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.448+0000 7f3610498800 1 --2- 172.21.15.178:0/1231405070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ffd4880 0x55cd1ffd6c90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f360400a470 tx=0x7f3604045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:22.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.448+0000 7f3610498800 1 -- 172.21.15.178:0/1231405070 shutdown_connections 2024-09-21T09:03:22.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.448+0000 7f3610498800 1 --2- 172.21.15.178:0/1231405070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ffd4880 0x55cd1ffd6c90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.448+0000 7f3610498800 1 -- 172.21.15.178:0/1231405070 >> 172.21.15.178:0/1231405070 conn(0x55cd1ffcadb0 msgr2=0x55cd1ffcd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.448+0000 7f3610498800 1 -- 172.21.15.178:0/1231405070 shutdown_connections 2024-09-21T09:03:22.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.448+0000 7f3610498800 1 -- 172.21.15.178:0/1231405070 wait complete. 2024-09-21T09:03:22.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.462+0000 7f3610498800 1 Processor -- start 2024-09-21T09:03:22.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.462+0000 7f3610498800 1 -- start start 2024-09-21T09:03:22.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.462+0000 7f3610498800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ff446d0 0x55cd200bf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.462+0000 7f3610498800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cd1ff1c360 con 0x55cd1ff446d0 2024-09-21T09:03:22.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.462+0000 7f360df8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ff446d0 0x55cd200bf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.463+0000 7f360df8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ff446d0 0x55cd200bf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44134/0 (socket says 172.21.15.178:44134) 2024-09-21T09:03:22.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.463+0000 7f360df8c640 1 -- 172.21.15.178:0/2343920280 learned_addr learned my addr 172.21.15.178:0/2343920280 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.463+0000 7f360df8c640 1 -- 172.21.15.178:0/2343920280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1fe69bc0 con 0x55cd1ff446d0 2024-09-21T09:03:22.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.463+0000 7f360df8c640 1 --2- 172.21.15.178:0/2343920280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ff446d0 0x55cd200bf630 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f360000b240 tx=0x7f360000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb542f775aa34019 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.463+0000 7f34fbe07640 1 -- 172.21.15.178:0/2343920280 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3600008070 con 0x55cd1ff446d0 2024-09-21T09:03:22.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.463+0000 7f34fbe07640 1 -- 172.21.15.178:0/2343920280 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360000d500 con 0x55cd1ff446d0 2024-09-21T09:03:22.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.463+0000 7f34fbe07640 1 -- 172.21.15.178:0/2343920280 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f360000d860 con 0x55cd1ff446d0 2024-09-21T09:03:22.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.464+0000 7f3610498800 1 -- 172.21.15.178:0/2343920280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ff446d0 msgr2=0x55cd200bf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.464+0000 7f3610498800 1 --2- 172.21.15.178:0/2343920280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ff446d0 0x55cd200bf630 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f360000b240 tx=0x7f360000b700 comp rx=0 tx=0).stop 2024-09-21T09:03:22.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.464+0000 7f3610498800 1 -- 172.21.15.178:0/2343920280 shutdown_connections 2024-09-21T09:03:22.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.464+0000 7f3610498800 1 --2- 172.21.15.178:0/2343920280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ff446d0 0x55cd200bf630 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.464+0000 7f3610498800 1 -- 172.21.15.178:0/2343920280 >> 172.21.15.178:0/2343920280 conn(0x55cd1ffcadb0 msgr2=0x55cd200baff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.464+0000 7f3610498800 1 -- 172.21.15.178:0/2343920280 shutdown_connections 2024-09-21T09:03:22.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.464+0000 7f3610498800 1 -- 172.21.15.178:0/2343920280 wait complete. 2024-09-21T09:03:22.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.464+0000 7f3610498800 1 Processor -- start 2024-09-21T09:03:22.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.464+0000 7f3610498800 1 -- start start 2024-09-21T09:03:22.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.464+0000 7f3610498800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ff446d0 0x55cd200c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.464+0000 7f3610498800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cd1ffd7610 con 0x55cd1ff446d0 2024-09-21T09:03:22.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.465+0000 7f360df8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ff446d0 0x55cd200c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.465+0000 7f360df8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ff446d0 0x55cd200c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44148/0 (socket says 172.21.15.178:44148) 2024-09-21T09:03:22.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.465+0000 7f360df8c640 1 -- 172.21.15.178:0/219164739 learned_addr learned my addr 172.21.15.178:0/219164739 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.465+0000 7f360df8c640 1 -- 172.21.15.178:0/219164739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1fe7dfe0 con 0x55cd1ff446d0 2024-09-21T09:03:22.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.465+0000 7f360df8c640 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ff446d0 0x55cd200c70b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x55cd200c0490 tx=0x7f3600000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.465+0000 7f34fa604640 1 -- 172.21.15.178:0/219164739 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3600019870 con 0x55cd1ff446d0 2024-09-21T09:03:22.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.465+0000 7f34fa604640 1 -- 172.21.15.178:0/219164739 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3600019a10 con 0x55cd1ff446d0 2024-09-21T09:03:22.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.465+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd200c75f0 con 0x55cd1ff446d0 2024-09-21T09:03:22.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.465+0000 7f34fa604640 1 -- 172.21.15.178:0/219164739 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3600019d30 con 0x55cd1ff446d0 2024-09-21T09:03:22.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.465+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd200c7b10 con 0x55cd1ff446d0 2024-09-21T09:03:22.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.466+0000 7f34fa604640 1 -- 172.21.15.178:0/219164739 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3600017040 con 0x55cd1ff446d0 2024-09-21T09:03:22.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.466+0000 7f34fa604640 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34f4036b40 0x7f34f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.466+0000 7f34fa604640 1 -- 172.21.15.178:0/219164739 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3600015020 con 0x55cd1ff446d0 2024-09-21T09:03:22.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.466+0000 7f360d78b640 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34f4036b40 0x7f34f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.467+0000 7f3610498800 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cd1ffd4880 0x55cd200ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.467+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd200ce660 con 0x55cd1ffd4880 2024-09-21T09:03:22.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.467+0000 7f360e78d640 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cd1ffd4880 0x55cd200ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.467+0000 7f360d78b640 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34f4036b40 0x7f34f4039000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3604057000 tx=0x7f3604052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.467+0000 7f360e78d640 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cd1ffd4880 0x55cd200ce120 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.467+0000 7f360e78d640 1 -- 172.21.15.178:0/219164739 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f360800a4a0 con 0x55cd1ffd4880 2024-09-21T09:03:22.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.467+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd200cb6d0 con 0x55cd1ffd4880 2024-09-21T09:03:22.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.468+0000 7f360e78d640 1 -- 172.21.15.178:0/219164739 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f360800a4a0 con 0x55cd1ffd4880 2024-09-21T09:03:22.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.468+0000 7f3610498800 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cd200d0970 0x55cd200d2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.468+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd200d3400 con 0x55cd200d0970 2024-09-21T09:03:22.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.468+0000 7f360df8c640 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cd200d0970 0x55cd200d2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.468+0000 7f360df8c640 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cd200d0970 0x55cd200d2d60 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.469+0000 7f360df8c640 1 -- 172.21.15.178:0/219164739 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f360002d070 con 0x55cd200d0970 2024-09-21T09:03:22.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.469+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd200cf810 con 0x55cd1ffd4880 2024-09-21T09:03:22.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.469+0000 7f360e78d640 1 -- 172.21.15.178:0/219164739 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f360800a4a0 con 0x55cd1ffd4880 2024-09-21T09:03:22.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.469+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd200cfcf0 con 0x55cd1ffd4880 2024-09-21T09:03:22.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.469+0000 7f360e78d640 1 -- 172.21.15.178:0/219164739 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f360800a4a0 con 0x55cd1ffd4880 2024-09-21T09:03:22.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.469+0000 7f3610498800 1 Processor -- start 2024-09-21T09:03:22.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.470+0000 7f3610498800 1 -- start start 2024-09-21T09:03:22.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.470+0000 7f3610498800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ffd0b30 0x55cd1ffcf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.470+0000 7f3610498800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cd1fe6b580 con 0x55cd1ffd0b30 2024-09-21T09:03:22.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.470+0000 7f360e78d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ffd0b30 0x55cd1ffcf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.470+0000 7f360e78d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ffd0b30 0x55cd1ffcf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44162/0 (socket says 172.21.15.178:44162) 2024-09-21T09:03:22.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.470+0000 7f360e78d640 1 -- 172.21.15.178:0/1438453583 learned_addr learned my addr 172.21.15.178:0/1438453583 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.470+0000 7f360e78d640 1 -- 172.21.15.178:0/1438453583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1ffd0f50 con 0x55cd1ffd0b30 2024-09-21T09:03:22.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.470+0000 7f360e78d640 1 --2- 172.21.15.178:0/1438453583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ffd0b30 0x55cd1ffcf180 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55cd200c8160 tx=0x7f36080188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.470+0000 7f34f37fe640 1 -- 172.21.15.178:0/1438453583 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3608014450 con 0x55cd1ffd0b30 2024-09-21T09:03:22.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.470+0000 7f34f37fe640 1 -- 172.21.15.178:0/1438453583 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36080145f0 con 0x55cd1ffd0b30 2024-09-21T09:03:22.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.470+0000 7f3610498800 1 -- 172.21.15.178:0/1438453583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd1ffcf780 con 0x55cd1ffd0b30 2024-09-21T09:03:22.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.471+0000 7f34f37fe640 1 -- 172.21.15.178:0/1438453583 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36080148d0 con 0x55cd1ffd0b30 2024-09-21T09:03:22.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.471+0000 7f3610498800 1 -- 172.21.15.178:0/1438453583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd1ffcfc80 con 0x55cd1ffd0b30 2024-09-21T09:03:22.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.471+0000 7f34f37fe640 1 -- 172.21.15.178:0/1438453583 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3608011040 con 0x55cd1ffd0b30 2024-09-21T09:03:22.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.471+0000 7f34f37fe640 1 --2- 172.21.15.178:0/1438453583 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34e8036b90 0x7f34e8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.471+0000 7f34f37fe640 1 -- 172.21.15.178:0/1438453583 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f360801e070 con 0x55cd1ffd0b30 2024-09-21T09:03:22.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.472+0000 7f360df8c640 1 --2- 172.21.15.178:0/1438453583 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34e8036b90 0x7f34e8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.472+0000 7f3610498800 1 Processor -- start 2024-09-21T09:03:22.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.472+0000 7f3610498800 1 -- start start 2024-09-21T09:03:22.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.472+0000 7f360df8c640 1 --2- 172.21.15.178:0/1438453583 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34e8036b90 0x7f34e8039050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55cd200ceab0 tx=0x7f360001b540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.472+0000 7f3610498800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd200f0c10 0x55cd200f1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.472+0000 7f3610498800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cd200bfde0 con 0x55cd200f0c10 2024-09-21T09:03:22.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.472+0000 7f360e78d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd200f0c10 0x55cd200f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.472+0000 7f360e78d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd200f0c10 0x55cd200f1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44170/0 (socket says 172.21.15.178:44170) 2024-09-21T09:03:22.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.472+0000 7f360e78d640 1 -- 172.21.15.178:0/1575515192 learned_addr learned my addr 172.21.15.178:0/1575515192 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.472+0000 7f360e78d640 1 -- 172.21.15.178:0/1575515192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd200f1550 con 0x55cd200f0c10 2024-09-21T09:03:22.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.473+0000 7f360e78d640 1 --2- 172.21.15.178:0/1575515192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd200f0c10 0x55cd200f1010 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f360804cbb0 tx=0x7f360803bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d0030369adff57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.473+0000 7f34f17fa640 1 -- 172.21.15.178:0/1575515192 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36080167c0 con 0x55cd200f0c10 2024-09-21T09:03:22.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.473+0000 7f34f17fa640 1 -- 172.21.15.178:0/1575515192 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3608013ca0 con 0x55cd200f0c10 2024-09-21T09:03:22.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.473+0000 7f34f17fa640 1 -- 172.21.15.178:0/1575515192 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3608016960 con 0x55cd200f0c10 2024-09-21T09:03:22.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.473+0000 7f3610498800 1 -- 172.21.15.178:0/1575515192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd200f0c10 msgr2=0x55cd200f1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.473+0000 7f3610498800 1 --2- 172.21.15.178:0/1575515192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd200f0c10 0x55cd200f1010 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f360804cbb0 tx=0x7f360803bf60 comp rx=0 tx=0).stop 2024-09-21T09:03:22.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.473+0000 7f3610498800 1 -- 172.21.15.178:0/1575515192 shutdown_connections 2024-09-21T09:03:22.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.473+0000 7f3610498800 1 --2- 172.21.15.178:0/1575515192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd200f0c10 0x55cd200f1010 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.473+0000 7f3610498800 1 -- 172.21.15.178:0/1575515192 >> 172.21.15.178:0/1575515192 conn(0x55cd200ecfc0 msgr2=0x55cd200eb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.473+0000 7f3610498800 1 -- 172.21.15.178:0/1575515192 shutdown_connections 2024-09-21T09:03:22.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.473+0000 7f3610498800 1 -- 172.21.15.178:0/1575515192 wait complete. 2024-09-21T09:03:22.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.473+0000 7f3610498800 1 Processor -- start 2024-09-21T09:03:22.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.474+0000 7f3610498800 1 -- start start 2024-09-21T09:03:22.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.474+0000 7f3610498800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd200f0c10 0x55cd200f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.474+0000 7f3610498800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cd200f1bf0 con 0x55cd200f0c10 2024-09-21T09:03:22.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.474+0000 7f360e78d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd200f0c10 0x55cd200f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.474+0000 7f360e78d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd200f0c10 0x55cd200f80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44172/0 (socket says 172.21.15.178:44172) 2024-09-21T09:03:22.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.474+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 learned_addr learned my addr 172.21.15.178:0/3641821165 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.474+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd200f8630 con 0x55cd200f0c10 2024-09-21T09:03:22.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.474+0000 7f360e78d640 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd200f0c10 0x55cd200f80f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f36080119b0 tx=0x7f360804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.474+0000 7f34df7fe640 1 -- 172.21.15.178:0/3641821165 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3608044070 con 0x55cd200f0c10 2024-09-21T09:03:22.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.474+0000 7f34df7fe640 1 -- 172.21.15.178:0/3641821165 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3608013e50 con 0x55cd200f0c10 2024-09-21T09:03:22.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.474+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd200f88c0 con 0x55cd200f0c10 2024-09-21T09:03:22.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.474+0000 7f34df7fe640 1 -- 172.21.15.178:0/3641821165 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3608014a70 con 0x55cd200f0c10 2024-09-21T09:03:22.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.475+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd200fb570 con 0x55cd200f0c10 2024-09-21T09:03:22.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.475+0000 7f34df7fe640 1 -- 172.21.15.178:0/3641821165 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3608014c10 con 0x55cd200f0c10 2024-09-21T09:03:22.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.475+0000 7f34df7fe640 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34d8036b90 0x7f34d8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.475+0000 7f34df7fe640 1 -- 172.21.15.178:0/3641821165 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f360800e040 con 0x55cd200f0c10 2024-09-21T09:03:22.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.475+0000 7f360df8c640 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34d8036b90 0x7f34d8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.476+0000 7f360df8c640 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34d8036b90 0x7f34d8039050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f360004d0b0 tx=0x7f3600035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.476+0000 7f3610498800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.476+0000 7f3610498800 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cd20103e20 0x55cd201062e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.476+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd20106a30 con 0x55cd20103e20 2024-09-21T09:03:22.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.476+0000 7f360d78b640 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cd20103e20 0x55cd201062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f360d78b640 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cd20103e20 0x55cd201062e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 20 realm 2024-09-21T09:03:22.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd20106e60 con 0x55cd20103e20 2024-09-21T09:03:22.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:22.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd20107730 con 0x55cd20103e20 2024-09-21T09:03:22.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd20107ad0 con 0x55cd20103e20 2024-09-21T09:03:22.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:22.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cd20108830 0x55cd2010ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.477+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010b230 con 0x55cd20108830 2024-09-21T09:03:22.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.478+0000 7f360e78d640 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cd20108830 0x55cd2010ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.478+0000 7f360e78d640 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cd20108830 0x55cd2010ac20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.478+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.478+0000 7f3610498800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:22.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.478+0000 7f3610498800 20 searching for the correct realm 2024-09-21T09:03:22.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.478+0000 7f3610498800 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cd2010d1c0 0x55cd2010f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.478+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd2010d1c0 2024-09-21T09:03:22.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.478+0000 7f360df8c640 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cd2010d1c0 0x55cd2010f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.479+0000 7f360df8c640 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cd2010d1c0 0x55cd2010f680 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.479+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.479+0000 7f360df8c640 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f360003d070 0x7f360001c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.479+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x7f360003d070 2024-09-21T09:03:22.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.479+0000 7f360d78b640 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f360003d070 0x7f360001c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.479+0000 7f360d78b640 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f360003d070 0x7f360001c610 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.480+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.480+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20108830 2024-09-21T09:03:22.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.480+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.480+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20103e20 2024-09-21T09:03:22.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.480+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.480+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20103e20 2024-09-21T09:03:22.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.480+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.480+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20108830 2024-09-21T09:03:22.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.481+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.481+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20108830 2024-09-21T09:03:22.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.481+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.481+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x7f360003d070 2024-09-21T09:03:22.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.481+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.481+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd2010d1c0 2024-09-21T09:03:22.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.481+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.481+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20103e20 2024-09-21T09:03:22.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.482+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.482+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20108830 2024-09-21T09:03:22.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.482+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.482+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20103e20 2024-09-21T09:03:22.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.482+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.482+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x7f360003d070 2024-09-21T09:03:22.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.482+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.482+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd2010d1c0 2024-09-21T09:03:22.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.483+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.483+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd2010d1c0 2024-09-21T09:03:22.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.483+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.483+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20108830 2024-09-21T09:03:22.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.483+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.483+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd2010d1c0 2024-09-21T09:03:22.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.483+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.483+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd2010d1c0 2024-09-21T09:03:22.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.484+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.484+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20103e20 2024-09-21T09:03:22.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.484+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.484+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20103e20 2024-09-21T09:03:22.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.484+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.484+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20108830 2024-09-21T09:03:22.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.484+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.485+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd2010d1c0 2024-09-21T09:03:22.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.485+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.485+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x7f360003d070 2024-09-21T09:03:22.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.485+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.485+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20103e20 2024-09-21T09:03:22.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.485+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.485+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20108830 2024-09-21T09:03:22.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.485+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.485+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd2010d1c0 2024-09-21T09:03:22.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.486+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.486+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20108830 2024-09-21T09:03:22.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.486+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.486+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x7f360003d070 2024-09-21T09:03:22.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.486+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.486+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd2010d1c0 2024-09-21T09:03:22.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.486+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.486+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20108830 2024-09-21T09:03:22.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.487+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.487+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x55cd20103e20 2024-09-21T09:03:22.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.487+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.487+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010fd50 con 0x7f360003d070 2024-09-21T09:03:22.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.487+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.487+0000 7f3610498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:22.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.487+0000 7f3610498800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:22.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.487+0000 7f3610498800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:22.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.487+0000 7f3610498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:22.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.487+0000 7f3610498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:22.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.487+0000 7f3610498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:22.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.487+0000 7f3610498800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.487+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010c710 con 0x55cd20103e20 2024-09-21T09:03:22.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010bf80 con 0x55cd20103e20 2024-09-21T09:03:22.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:22.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd2010b6c0 con 0x55cd20103e20 2024-09-21T09:03:22.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:22.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 20 zone default found 2024-09-21T09:03:22.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 4 Realm: () 2024-09-21T09:03:22.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:22.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:22.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:22.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 20 zonegroup default 2024-09-21T09:03:22.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd20110210 con 0x55cd20108830 2024-09-21T09:03:22.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.488+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd201124e0 con 0x55cd2010d1c0 2024-09-21T09:03:22.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.489+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.489+0000 7f3610498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.489+0000 7f3610498800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.489+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd20112880 con 0x55cd2010d1c0 2024-09-21T09:03:22.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.489+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.489+0000 7f3610498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.489+0000 7f3610498800 20 started sync module instance, tier type = 2024-09-21T09:03:22.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.489+0000 7f3610498800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:22.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.489+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20111970 con 0x7f360003d070 2024-09-21T09:03:22.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.490+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.490+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94339494649504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20111970 con 0x7f360003d070 2024-09-21T09:03:22.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.490+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20113290 con 0x55cd20103e20 2024-09-21T09:03:22.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.491+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94339494649504] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.491+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.491+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94339494653888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20111970 con 0x55cd20103e20 2024-09-21T09:03:22.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.491+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20113ce0 con 0x55cd2010d1c0 2024-09-21T09:03:22.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.492+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.492+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94339494655984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20114580 con 0x55cd2010d1c0 2024-09-21T09:03:22.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.492+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20115030 con 0x7f360003d070 2024-09-21T09:03:22.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.492+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94339494653888] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.493+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94339494655984] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.493+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.493+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94339494658256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20114b10 con 0x7f360003d070 2024-09-21T09:03:22.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.493+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20115910 con 0x55cd20103e20 2024-09-21T09:03:22.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.494+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.494+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94339494663120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20115d40 con 0x55cd20103e20 2024-09-21T09:03:22.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.494+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20116840 con 0x55cd20108830 2024-09-21T09:03:22.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.494+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94339494658256] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.495+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.495+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94339494667056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20116c30 con 0x55cd20108830 2024-09-21T09:03:22.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.495+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94339494663120] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.495+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20117630 con 0x55cd20108830 2024-09-21T09:03:22.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.496+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94339494667056] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.496+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.496+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94339494646976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20117140 con 0x55cd20108830 2024-09-21T09:03:22.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.497+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20117b40 con 0x55cd20108830 2024-09-21T09:03:22.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.497+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.497+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94339494671952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20117f60 con 0x55cd20108830 2024-09-21T09:03:22.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.497+0000 7f3610498800 20 add_watcher() i=0 2024-09-21T09:03:22.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.497+0000 7f3610498800 20 add_watcher() i=1 2024-09-21T09:03:22.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.497+0000 7f3610498800 20 add_watcher() i=2 2024-09-21T09:03:22.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.497+0000 7f3610498800 20 add_watcher() i=3 2024-09-21T09:03:22.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.497+0000 7f3610498800 20 add_watcher() i=4 2024-09-21T09:03:22.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.497+0000 7f3610498800 20 add_watcher() i=5 2024-09-21T09:03:22.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.498+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94339494646976] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.498+0000 7f3610498800 20 add_watcher() i=6 2024-09-21T09:03:22.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.498+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94339494671952] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.498+0000 7f3610498800 20 add_watcher() i=7 2024-09-21T09:03:22.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.498+0000 7f3610498800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:22.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.498+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd201157f0 con 0x55cd20103e20 2024-09-21T09:03:22.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.499+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.499+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94339494673008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd201157f0 con 0x55cd20103e20 2024-09-21T09:03:22.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.500+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94339494673008] v29'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.500+0000 7f34bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:22.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.500+0000 7f3610498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:22.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.500+0000 7f3610498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:22.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.500+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20123a30 con 0x55cd20103e20 2024-09-21T09:03:22.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.501+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.501+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20124100 con 0x55cd20108830 2024-09-21T09:03:22.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.502+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.502+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20124100 con 0x55cd2010d1c0 2024-09-21T09:03:22.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.503+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.503+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20124a50 con 0x55cd20103e20 2024-09-21T09:03:22.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.504+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'140 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.504+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20124e10 con 0x7f360003d070 2024-09-21T09:03:22.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.505+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.505+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125270 con 0x55cd2010d1c0 2024-09-21T09:03:22.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.506+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.506+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125610 con 0x55cd20103e20 2024-09-21T09:03:22.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.507+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.507+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125710 con 0x55cd20108830 2024-09-21T09:03:22.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.508+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.508+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125ba0 con 0x7f360003d070 2024-09-21T09:03:22.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.509+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.509+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125ba0 con 0x55cd2010d1c0 2024-09-21T09:03:22.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.510+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.510+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125ba0 con 0x7f360003d070 2024-09-21T09:03:22.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.511+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.511+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125ba0 con 0x55cd20108830 2024-09-21T09:03:22.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.512+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.512+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x7f360003d070 2024-09-21T09:03:22.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.513+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.513+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x55cd20108830 2024-09-21T09:03:22.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.514+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'33 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.514+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x55cd20103e20 2024-09-21T09:03:22.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.515+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'141 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.515+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x55cd2010d1c0 2024-09-21T09:03:22.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.516+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.516+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x7f360003d070 2024-09-21T09:03:22.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.517+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.517+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x55cd2010d1c0 2024-09-21T09:03:22.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.518+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.518+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x55cd20103e20 2024-09-21T09:03:22.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.519+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.519+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x55cd20103e20 2024-09-21T09:03:22.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.520+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.520+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x55cd2010d1c0 2024-09-21T09:03:22.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.521+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.521+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x7f360003d070 2024-09-21T09:03:22.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.522+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.522+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x55cd2010d1c0 2024-09-21T09:03:22.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.523+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.523+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x55cd2010d1c0 2024-09-21T09:03:22.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.524+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.524+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x55cd2010d1c0 2024-09-21T09:03:22.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.525+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.525+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x55cd2010d1c0 2024-09-21T09:03:22.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.526+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.526+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c30 con 0x55cd20108830 2024-09-21T09:03:22.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.527+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.527+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c50 con 0x55cd2010d1c0 2024-09-21T09:03:22.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.528+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.528+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c50 con 0x55cd20108830 2024-09-21T09:03:22.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.529+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.529+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c50 con 0x55cd2010d1c0 2024-09-21T09:03:22.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.530+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.530+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c50 con 0x55cd20108830 2024-09-21T09:03:22.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.531+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'34 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.531+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20125c50 con 0x7f360003d070 2024-09-21T09:03:22.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.532+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.532+0000 7f34be7fc640 20 reqs_thread_entry: start 2024-09-21T09:03:22.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.532+0000 7f3610498800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:22.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.532+0000 7f3610498800 20 Filter name: none 2024-09-21T09:03:22.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f342ffff640 20 reqs_thread_entry: start 2024-09-21T09:03:22.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f3610498800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T09:03:22.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f3610498800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd20150c70 con 0x7f360003d070 2024-09-21T09:03:22.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f3610498800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:22.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f3610498800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T09:03:22.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f3610498800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:22.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f3610498800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 : miss 2024-09-21T09:03:22.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f3610498800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:95 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd201526a0 con 0x55cd20108830 2024-09-21T09:03:22.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(95 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f3610498800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:22.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f3610498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:22.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f3610498800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:22.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f3610498800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:22.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.533+0000 7f3610498800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:22.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.534+0000 7f3610498800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 2024-09-21T09:03:22.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.534+0000 7f3610498800 20 get_obj_state: octx=0x7f3604053db0 obj=myfoo:four state=0x55cd20153968 s->prefetch_data=0 2024-09-21T09:03:22.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.534+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:96 3.36 3:6c011b67:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd20154790 con 0x7f360003d070 2024-09-21T09:03:22.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.534+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(96 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.534+0000 7f3610498800 10 manifest: total_size = 4 2024-09-21T09:03:22.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.534+0000 7f3610498800 20 get_obj_state: setting s->obj_tag to 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.6131582943082044228 2024-09-21T09:03:22.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.534+0000 7f3610498800 20 get_obj_state: octx=0x7f3604053db0 obj=myfoo:four state=0x55cd20153968 s->prefetch_data=0 2024-09-21T09:03:22.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.534+0000 7f3610498800 20 prepare_atomic_modification: state is not atomic. state=0x55cd20153968 2024-09-21T09:03:22.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.534+0000 7f3610498800 20 bucket index object: :.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6 2024-09-21T09:03:22.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.534+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:97 4.3f 4:fe592d9e:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20159150 con 0x7f360003d070 2024-09-21T09:03:22.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.535+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(97 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6 [stat,call,call] v29'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.535+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:98 3.36 3:6c011b67:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20159150 con 0x7f360003d070 2024-09-21T09:03:22.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.536+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 21 ==== osd_op_reply(98 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1_four [call] v29'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.536+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:99 4.3f 4:fe592d9e:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20159be0 con 0x7f360003d070 2024-09-21T09:03:22.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.537+0000 7f34bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:22.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.537+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94339494673008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20159be0 con 0x55cd20103e20 2024-09-21T09:03:22.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.537+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 22 ==== osd_op_reply(99 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6 [stat,call,call] v29'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.537+0000 7f34f17fa640 20 handle_completion(): completion ok for obj=four 2024-09-21T09:03:22.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.538+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94339494673008] v29'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.538+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94339494649504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20159ba0 con 0x7f360003d070 2024-09-21T09:03:22.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.539+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 23 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94339494649504] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.539+0000 7f3610498800 20 remove_watcher() i=0 2024-09-21T09:03:22.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.539+0000 7f3610498800 2 removed watcher, disabling cache 2024-09-21T09:03:22.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.539+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94339494653888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20159ba0 con 0x55cd20103e20 2024-09-21T09:03:22.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.540+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94339494653888] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.540+0000 7f3610498800 20 remove_watcher() i=1 2024-09-21T09:03:22.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.540+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94339494655984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20159ba0 con 0x55cd2010d1c0 2024-09-21T09:03:22.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.541+0000 7f360df8c640 1 -- 172.21.15.178:0/3641821165 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94339494655984] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3600044d70 con 0x55cd2010d1c0 2024-09-21T09:03:22.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.541+0000 7f3610498800 20 remove_watcher() i=2 2024-09-21T09:03:22.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.541+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94339494658256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20159ba0 con 0x7f360003d070 2024-09-21T09:03:22.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.542+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.2 v2:172.21.15.178:6816/3267136144 24 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94339494658256] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3604051070 con 0x7f360003d070 2024-09-21T09:03:22.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.542+0000 7f3610498800 20 remove_watcher() i=3 2024-09-21T09:03:22.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.542+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94339494663120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20159ba0 con 0x55cd20103e20 2024-09-21T09:03:22.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.543+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94339494663120] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3604051070 con 0x55cd20103e20 2024-09-21T09:03:22.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.543+0000 7f3610498800 20 remove_watcher() i=4 2024-09-21T09:03:22.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.543+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94339494667056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20159ba0 con 0x55cd20108830 2024-09-21T09:03:22.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.544+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94339494667056] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.544+0000 7f3610498800 20 remove_watcher() i=5 2024-09-21T09:03:22.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.544+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94339494646976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20159ba0 con 0x55cd20108830 2024-09-21T09:03:22.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.545+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94339494646976] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.545+0000 7f3610498800 20 remove_watcher() i=6 2024-09-21T09:03:22.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.545+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94339494671952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd20159ba0 con 0x55cd20108830 2024-09-21T09:03:22.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f360e78d640 1 -- 172.21.15.178:0/3641821165 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94339494671952] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3608034020 con 0x55cd20108830 2024-09-21T09:03:22.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 20 remove_watcher() i=7 2024-09-21T09:03:22.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cd20108830 msgr2=0x55cd2010ac20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cd20108830 0x55cd2010ac20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cd20103e20 msgr2=0x55cd201062e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cd20103e20 0x55cd201062e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f360003d070 msgr2=0x7f360001c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f360003d070 0x7f360001c610 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cd2010d1c0 msgr2=0x55cd2010f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55cd2010d1c0 0x55cd2010f680 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34d8036b90 msgr2=0x7f34d8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34d8036b90 0x7f34d8039050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f360004d0b0 tx=0x7f3600035000 comp rx=0 tx=0).stop 2024-09-21T09:03:22.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd200f0c10 msgr2=0x55cd200f80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 --2- 172.21.15.178:0/3641821165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd200f0c10 0x55cd200f80f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f36080119b0 tx=0x7f360804cb10 comp rx=0 tx=0).stop 2024-09-21T09:03:22.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 reap_dead start 2024-09-21T09:03:22.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f360d78b640 1 -- 172.21.15.178:0/3641821165 reap_dead start 2024-09-21T09:03:22.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 shutdown_connections 2024-09-21T09:03:22.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 >> 172.21.15.178:0/3641821165 conn(0x55cd200ecfc0 msgr2=0x55cd200eb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 shutdown_connections 2024-09-21T09:03:22.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 -- 172.21.15.178:0/3641821165 wait complete. 2024-09-21T09:03:22.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 -- 172.21.15.178:0/1438453583 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34e8036b90 msgr2=0x7f34e8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 --2- 172.21.15.178:0/1438453583 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34e8036b90 0x7f34e8039050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55cd200ceab0 tx=0x7f360001b540 comp rx=0 tx=0).stop 2024-09-21T09:03:22.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 -- 172.21.15.178:0/1438453583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ffd0b30 msgr2=0x55cd1ffcf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.546+0000 7f3610498800 1 --2- 172.21.15.178:0/1438453583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ffd0b30 0x55cd1ffcf180 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55cd200c8160 tx=0x7f36080188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 -- 172.21.15.178:0/1438453583 shutdown_connections 2024-09-21T09:03:22.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 --2- 172.21.15.178:0/1438453583 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34e8036b90 0x7f34e8039050 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 --2- 172.21.15.178:0/1438453583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ffd0b30 0x55cd1ffcf180 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 -- 172.21.15.178:0/1438453583 >> 172.21.15.178:0/1438453583 conn(0x55cd200d6d50 msgr2=0x55cd200d98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 -- 172.21.15.178:0/1438453583 shutdown_connections 2024-09-21T09:03:22.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 -- 172.21.15.178:0/1438453583 wait complete. 2024-09-21T09:03:22.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cd200d0970 msgr2=0x55cd200d2d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cd200d0970 0x55cd200d2d60 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cd1ffd4880 msgr2=0x55cd200ce120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cd1ffd4880 0x55cd200ce120 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34f4036b40 msgr2=0x7f34f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34f4036b40 0x7f34f4039000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3604057000 tx=0x7f3604052000 comp rx=0 tx=0).stop 2024-09-21T09:03:22.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ff446d0 msgr2=0x55cd200c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ff446d0 0x55cd200c70b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x55cd200c0490 tx=0x7f3600000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 shutdown_connections 2024-09-21T09:03:22.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55cd200d0970 0x55cd200d2d60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cd1ffd4880 0x55cd200ce120 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f34f4036b40 0x7f34f4039000 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 --2- 172.21.15.178:0/219164739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd1ff446d0 0x55cd200c70b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 >> 172.21.15.178:0/219164739 conn(0x55cd1ffcadb0 msgr2=0x55cd200b98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 shutdown_connections 2024-09-21T09:03:22.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.547+0000 7f3610498800 1 -- 172.21.15.178:0/219164739 wait complete. 2024-09-21T09:03:22.557 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-21T09:03:22.558 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-21T09:03:22.558 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-21T09:03:22.602 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:22.602 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:22.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.601+0000 7fc1b6340800 1 Processor -- start 2024-09-21T09:03:22.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.601+0000 7fc1b6340800 1 -- start start 2024-09-21T09:03:22.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.601+0000 7fc1b6340800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x560a694275f0 0x560a694b8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.601+0000 7fc1b6340800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560a69372b30 con 0x560a694b8bd0 2024-09-21T09:03:22.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.601+0000 7fc1b6340800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x560a69354360 con 0x560a694275f0 2024-09-21T09:03:22.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.601+0000 7fc1b20ca640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x560a694275f0 0x560a694b8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.602+0000 7fc1a98c9640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x560a694b8bd0 0x560a694bafc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46900/0 (socket says 172.21.15.178:46900) 2024-09-21T09:03:22.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.602+0000 7fc1b20ca640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x560a694275f0 0x560a694b8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44176/0 (socket says 172.21.15.178:44176) 2024-09-21T09:03:22.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.602+0000 7fc1a98c9640 1 -- 172.21.15.178:0/2663289336 learned_addr learned my addr 172.21.15.178:0/2663289336 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:22.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.602+0000 7fc1b20ca640 1 -- 172.21.15.178:0/2663289336 >> v1:172.21.15.44:6789/0 conn(0x560a694b8bd0 legacy=0x560a694bafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.602+0000 7fc1b20ca640 1 -- 172.21.15.178:0/2663289336 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a6937ae00 con 0x560a694275f0 2024-09-21T09:03:22.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.604+0000 7fc1b20ca640 1 --2- 172.21.15.178:0/2663289336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a694b8690 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400a470 tx=0x7fc1a4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9f8ed436376d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.604+0000 7fc1b18c9640 1 -- 172.21.15.178:0/2663289336 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a4053570 con 0x560a694275f0 2024-09-21T09:03:22.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.604+0000 7fc1b18c9640 1 -- 172.21.15.178:0/2663289336 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a4058070 con 0x560a694275f0 2024-09-21T09:03:22.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.604+0000 7fc1b18c9640 1 -- 172.21.15.178:0/2663289336 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a4053880 con 0x560a694275f0 2024-09-21T09:03:22.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.604+0000 7fc1b6340800 1 -- 172.21.15.178:0/2663289336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 msgr2=0x560a694b8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.604+0000 7fc1b6340800 1 --2- 172.21.15.178:0/2663289336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a694b8690 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400a470 tx=0x7fc1a4045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:22.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.604+0000 7fc1b6340800 1 -- 172.21.15.178:0/2663289336 shutdown_connections 2024-09-21T09:03:22.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.604+0000 7fc1b6340800 1 --2- 172.21.15.178:0/2663289336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a694b8690 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.604+0000 7fc1b6340800 1 -- 172.21.15.178:0/2663289336 >> 172.21.15.178:0/2663289336 conn(0x560a694adde0 msgr2=0x560a694b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.604+0000 7fc1b6340800 1 -- 172.21.15.178:0/2663289336 shutdown_connections 2024-09-21T09:03:22.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.604+0000 7fc1b6340800 1 -- 172.21.15.178:0/2663289336 wait complete. 2024-09-21T09:03:22.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.618+0000 7fc1b6340800 1 Processor -- start 2024-09-21T09:03:22.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.618+0000 7fc1b6340800 1 -- start start 2024-09-21T09:03:22.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.618+0000 7fc1b6340800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a695a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.618+0000 7fc1b6340800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560a693ff330 con 0x560a694275f0 2024-09-21T09:03:22.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.618+0000 7fc1b20ca640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a695a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.618+0000 7fc1b20ca640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a695a4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44184/0 (socket says 172.21.15.178:44184) 2024-09-21T09:03:22.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.618+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1106421295 learned_addr learned my addr 172.21.15.178:0/1106421295 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.619+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1106421295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a6934cbc0 con 0x560a694275f0 2024-09-21T09:03:22.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.619+0000 7fc1b20ca640 1 --2- 172.21.15.178:0/1106421295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a695a4a70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4025c20 tx=0x7fc1a4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d12b4e8ba26985 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.619+0000 7fc0a0608640 1 -- 172.21.15.178:0/1106421295 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a405c580 con 0x560a694275f0 2024-09-21T09:03:22.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.619+0000 7fc0a0608640 1 -- 172.21.15.178:0/1106421295 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a4063030 con 0x560a694275f0 2024-09-21T09:03:22.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.619+0000 7fc0a0608640 1 -- 172.21.15.178:0/1106421295 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a405c850 con 0x560a694275f0 2024-09-21T09:03:22.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.620+0000 7fc1b6340800 1 -- 172.21.15.178:0/1106421295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 msgr2=0x560a695a4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.620+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1106421295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a695a4a70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4025c20 tx=0x7fc1a4051000 comp rx=0 tx=0).stop 2024-09-21T09:03:22.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.620+0000 7fc1b6340800 1 -- 172.21.15.178:0/1106421295 shutdown_connections 2024-09-21T09:03:22.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.620+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1106421295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a695a4a70 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.620+0000 7fc1b6340800 1 -- 172.21.15.178:0/1106421295 >> 172.21.15.178:0/1106421295 conn(0x560a694adde0 msgr2=0x560a695a0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.620+0000 7fc1b6340800 1 -- 172.21.15.178:0/1106421295 shutdown_connections 2024-09-21T09:03:22.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.620+0000 7fc1b6340800 1 -- 172.21.15.178:0/1106421295 wait complete. 2024-09-21T09:03:22.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.620+0000 7fc1b6340800 1 Processor -- start 2024-09-21T09:03:22.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.620+0000 7fc1b6340800 1 -- start start 2024-09-21T09:03:22.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.620+0000 7fc1b6340800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a695ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.620+0000 7fc1b6340800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560a694bc980 con 0x560a694275f0 2024-09-21T09:03:22.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.620+0000 7fc1b20ca640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a695ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.620+0000 7fc1b20ca640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a695ac3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44186/0 (socket says 172.21.15.178:44186) 2024-09-21T09:03:22.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.620+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1190868365 learned_addr learned my addr 172.21.15.178:0/1190868365 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.621+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1190868365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a69360fe0 con 0x560a694275f0 2024-09-21T09:03:22.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.621+0000 7fc1b20ca640 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a695ac3e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x560a695a58d0 tx=0x7fc1a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.621+0000 7fc09ee05640 1 -- 172.21.15.178:0/1190868365 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a4054ad0 con 0x560a694275f0 2024-09-21T09:03:22.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.621+0000 7fc09ee05640 1 -- 172.21.15.178:0/1190868365 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a4054c70 con 0x560a694275f0 2024-09-21T09:03:22.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.621+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a695ac920 con 0x560a694275f0 2024-09-21T09:03:22.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.621+0000 7fc09ee05640 1 -- 172.21.15.178:0/1190868365 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a4068420 con 0x560a694275f0 2024-09-21T09:03:22.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.621+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a695ace40 con 0x560a694275f0 2024-09-21T09:03:22.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.622+0000 7fc09ee05640 1 -- 172.21.15.178:0/1190868365 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc1a40685c0 con 0x560a694275f0 2024-09-21T09:03:22.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.622+0000 7fc09ee05640 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc098036b40 0x7fc098039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.622+0000 7fc09ee05640 1 -- 172.21.15.178:0/1190868365 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc1a4070030 con 0x560a694275f0 2024-09-21T09:03:22.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.622+0000 7fc1a98c9640 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc098036b40 0x7fc098039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.622+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560a694b8bd0 0x560a695b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.622+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695b3a20 con 0x560a694b8bd0 2024-09-21T09:03:22.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.622+0000 7fc1b28cb640 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560a694b8bd0 0x560a695b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.622+0000 7fc1a98c9640 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc098036b40 0x7fc098039000 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc19c000f60 tx=0x7fc19c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.622+0000 7fc1b28cb640 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560a694b8bd0 0x560a695b3450 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.623+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1190868365 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1ac00a4a0 con 0x560a694b8bd0 2024-09-21T09:03:22.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.623+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695b0a00 con 0x560a694b8bd0 2024-09-21T09:03:22.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.623+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1190868365 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc1ac00a4a0 con 0x560a694b8bd0 2024-09-21T09:03:22.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.623+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560a695b5d80 0x560a695b8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.623+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695b8860 con 0x560a695b5d80 2024-09-21T09:03:22.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.623+0000 7fc1b20ca640 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560a695b5d80 0x560a695b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.624+0000 7fc1b20ca640 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560a695b5d80 0x560a695b8170 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.624+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1190868365 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695b5d80 2024-09-21T09:03:22.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.624+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695b4c20 con 0x560a694b8bd0 2024-09-21T09:03:22.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.624+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1190868365 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc1ac00a4a0 con 0x560a694b8bd0 2024-09-21T09:03:22.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.624+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695b50c0 con 0x560a694b8bd0 2024-09-21T09:03:22.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.625+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1190868365 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc1ac00a4a0 con 0x560a694b8bd0 2024-09-21T09:03:22.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.625+0000 7fc1b6340800 1 Processor -- start 2024-09-21T09:03:22.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.625+0000 7fc1b6340800 1 -- start start 2024-09-21T09:03:22.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.625+0000 7fc1b6340800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695c71a0 0x560a695c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.625+0000 7fc1b6340800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560a6934e580 con 0x560a695c71a0 2024-09-21T09:03:22.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.625+0000 7fc1b28cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695c71a0 0x560a695c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.625+0000 7fc1b28cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695c71a0 0x560a695c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44194/0 (socket says 172.21.15.178:44194) 2024-09-21T09:03:22.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.625+0000 7fc1b28cb640 1 -- 172.21.15.178:0/202004118 learned_addr learned my addr 172.21.15.178:0/202004118 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.626+0000 7fc1b28cb640 1 -- 172.21.15.178:0/202004118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a695c7b00 con 0x560a695c71a0 2024-09-21T09:03:22.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.626+0000 7fc1b28cb640 1 --2- 172.21.15.178:0/202004118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695c71a0 0x560a695c75c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x560a695b3e00 tx=0x7fc1ac018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.626+0000 7fc097fff640 1 -- 172.21.15.178:0/202004118 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1ac014450 con 0x560a695c71a0 2024-09-21T09:03:22.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.626+0000 7fc097fff640 1 -- 172.21.15.178:0/202004118 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1ac014610 con 0x560a695c71a0 2024-09-21T09:03:22.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.626+0000 7fc097fff640 1 -- 172.21.15.178:0/202004118 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1ac014930 con 0x560a695c71a0 2024-09-21T09:03:22.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.626+0000 7fc1b6340800 1 -- 172.21.15.178:0/202004118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a695c7d90 con 0x560a695c71a0 2024-09-21T09:03:22.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.626+0000 7fc1b6340800 1 -- 172.21.15.178:0/202004118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a695caa70 con 0x560a695c71a0 2024-09-21T09:03:22.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.627+0000 7fc097fff640 1 -- 172.21.15.178:0/202004118 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc1ac011040 con 0x560a695c71a0 2024-09-21T09:03:22.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.627+0000 7fc097fff640 1 --2- 172.21.15.178:0/202004118 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc08c036b90 0x7fc08c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.627+0000 7fc097fff640 1 -- 172.21.15.178:0/202004118 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc1ac01e070 con 0x560a695c71a0 2024-09-21T09:03:22.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.627+0000 7fc1b20ca640 1 --2- 172.21.15.178:0/202004118 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc08c036b90 0x7fc08c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.627+0000 7fc1b6340800 1 Processor -- start 2024-09-21T09:03:22.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.627+0000 7fc1b20ca640 1 --2- 172.21.15.178:0/202004118 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc08c036b90 0x7fc08c039050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x560a695b3ef0 tx=0x7fc1a4060ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.627+0000 7fc1b6340800 1 -- start start 2024-09-21T09:03:22.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.627+0000 7fc1b6340800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695d3e20 0x560a695d4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.627+0000 7fc1b6340800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560a695a51c0 con 0x560a695d3e20 2024-09-21T09:03:22.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.628+0000 7fc1b28cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695d3e20 0x560a695d4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.628+0000 7fc1b28cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695d3e20 0x560a695d4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44210/0 (socket says 172.21.15.178:44210) 2024-09-21T09:03:22.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.628+0000 7fc1b28cb640 1 -- 172.21.15.178:0/4102785095 learned_addr learned my addr 172.21.15.178:0/4102785095 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.628+0000 7fc1b28cb640 1 -- 172.21.15.178:0/4102785095 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a695d47f0 con 0x560a695d3e20 2024-09-21T09:03:22.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.628+0000 7fc1b28cb640 1 --2- 172.21.15.178:0/4102785095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695d3e20 0x560a695d4220 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac04cba0 tx=0x7fc1ac03bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185b700a54c41d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.628+0000 7fc095ffb640 1 -- 172.21.15.178:0/4102785095 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1ac0167c0 con 0x560a695d3e20 2024-09-21T09:03:22.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.628+0000 7fc095ffb640 1 -- 172.21.15.178:0/4102785095 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1ac013cb0 con 0x560a695d3e20 2024-09-21T09:03:22.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.628+0000 7fc095ffb640 1 -- 172.21.15.178:0/4102785095 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1ac016960 con 0x560a695d3e20 2024-09-21T09:03:22.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.629+0000 7fc1b6340800 1 -- 172.21.15.178:0/4102785095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695d3e20 msgr2=0x560a695d4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.629+0000 7fc1b6340800 1 --2- 172.21.15.178:0/4102785095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695d3e20 0x560a695d4220 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac04cba0 tx=0x7fc1ac03bf50 comp rx=0 tx=0).stop 2024-09-21T09:03:22.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.629+0000 7fc1b6340800 1 -- 172.21.15.178:0/4102785095 shutdown_connections 2024-09-21T09:03:22.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.629+0000 7fc1b6340800 1 --2- 172.21.15.178:0/4102785095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695d3e20 0x560a695d4220 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.629+0000 7fc1b6340800 1 -- 172.21.15.178:0/4102785095 >> 172.21.15.178:0/4102785095 conn(0x560a695d0180 msgr2=0x560a695ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.629+0000 7fc1b6340800 1 -- 172.21.15.178:0/4102785095 shutdown_connections 2024-09-21T09:03:22.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.629+0000 7fc1b6340800 1 -- 172.21.15.178:0/4102785095 wait complete. 2024-09-21T09:03:22.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.629+0000 7fc1b6340800 1 Processor -- start 2024-09-21T09:03:22.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.629+0000 7fc1b6340800 1 -- start start 2024-09-21T09:03:22.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.629+0000 7fc1b6340800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695d3e20 0x560a695db300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.629+0000 7fc1b6340800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560a695d4ea0 con 0x560a695d3e20 2024-09-21T09:03:22.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.629+0000 7fc1b28cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695d3e20 0x560a695db300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.629+0000 7fc1b28cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695d3e20 0x560a695db300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44214/0 (socket says 172.21.15.178:44214) 2024-09-21T09:03:22.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.629+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 learned_addr learned my addr 172.21.15.178:0/1489150579 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.630+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a695db840 con 0x560a695d3e20 2024-09-21T09:03:22.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.630+0000 7fc1b28cb640 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695d3e20 0x560a695db300 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac04ba90 tx=0x7fc1ac04cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.630+0000 7fc083fff640 1 -- 172.21.15.178:0/1489150579 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1ac013e60 con 0x560a695d3e20 2024-09-21T09:03:22.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.630+0000 7fc083fff640 1 -- 172.21.15.178:0/1489150579 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1ac04cd70 con 0x560a695d3e20 2024-09-21T09:03:22.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.630+0000 7fc083fff640 1 -- 172.21.15.178:0/1489150579 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1ac02bda0 con 0x560a695d3e20 2024-09-21T09:03:22.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.630+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a695dbad0 con 0x560a695d3e20 2024-09-21T09:03:22.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.630+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a695de780 con 0x560a695d3e20 2024-09-21T09:03:22.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.631+0000 7fc083fff640 1 -- 172.21.15.178:0/1489150579 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc1ac022a80 con 0x560a695d3e20 2024-09-21T09:03:22.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.631+0000 7fc083fff640 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc07c036b90 0x7fc07c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.631+0000 7fc083fff640 1 -- 172.21.15.178:0/1489150579 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc1ac00e040 con 0x560a695d3e20 2024-09-21T09:03:22.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.631+0000 7fc1b20ca640 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc07c036b90 0x7fc07c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.631+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.631+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560a695e6f30 0x560a695e93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.631+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695e9b40 con 0x560a695e6f30 2024-09-21T09:03:22.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.631+0000 7fc1a98c9640 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560a695e6f30 0x560a695e93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.631+0000 7fc1b20ca640 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc07c036b90 0x7fc07c039050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40547e0 tx=0x7fc1a4085000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1a98c9640 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560a695e6f30 0x560a695e93f0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc19c009050 con 0x560a695e6f30 2024-09-21T09:03:22.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1b6340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1b6340800 20 realm 2024-09-21T09:03:22.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695e6380 con 0x560a695e6f30 2024-09-21T09:03:22.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc19c009050 con 0x560a695e6f30 2024-09-21T09:03:22.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1b6340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1b6340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:22.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695ea620 con 0x560a695e6f30 2024-09-21T09:03:22.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc19c009050 con 0x560a695e6f30 2024-09-21T09:03:22.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1b6340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.632+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695eaef0 con 0x560a695e6f30 2024-09-21T09:03:22.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.633+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc19c009050 con 0x560a695e6f30 2024-09-21T09:03:22.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.633+0000 7fc1b6340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:22.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.633+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.633+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560a695eb7a0 0x560a695edb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.633+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695ee2d0 con 0x560a695eb7a0 2024-09-21T09:03:22.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.633+0000 7fc1b28cb640 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560a695eb7a0 0x560a695edb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.633+0000 7fc1b28cb640 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560a695eb7a0 0x560a695edb90 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.634+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.634+0000 7fc1b6340800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:22.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.634+0000 7fc1b6340800 20 searching for the correct realm 2024-09-21T09:03:22.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.634+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x560a695f0370 0x560a695f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.634+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560a695f2f00 con 0x560a695f0370 2024-09-21T09:03:22.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.634+0000 7fc1b20ca640 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x560a695f0370 0x560a695f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.634+0000 7fc1b20ca640 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x560a695f0370 0x560a695f2830 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.634+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.634+0000 7fc1b20ca640 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc1a405c070 0x7fc1a40688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.634+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560a695f2f00 con 0x7fc1a405c070 2024-09-21T09:03:22.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.634+0000 7fc1a98c9640 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc1a405c070 0x7fc1a40688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.635+0000 7fc1a98c9640 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc1a405c070 0x7fc1a40688b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.635+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c009050 con 0x7fc1a405c070 2024-09-21T09:03:22.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.635+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560a695f2f00 con 0x560a695eb7a0 2024-09-21T09:03:22.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.635+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.635+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560a695f2f00 con 0x560a695e6f30 2024-09-21T09:03:22.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.635+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c009050 con 0x560a695e6f30 2024-09-21T09:03:22.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.635+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560a695f2f00 con 0x560a695e6f30 2024-09-21T09:03:22.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.636+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c029040 con 0x560a695e6f30 2024-09-21T09:03:22.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.636+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560a695f2f00 con 0x560a695eb7a0 2024-09-21T09:03:22.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.636+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.636+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560a695f2f00 con 0x560a695eb7a0 2024-09-21T09:03:22.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.636+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.636+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560a695f2f00 con 0x7fc1a405c070 2024-09-21T09:03:22.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.637+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c029040 con 0x7fc1a405c070 2024-09-21T09:03:22.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.637+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560a695f2f00 con 0x560a695f0370 2024-09-21T09:03:22.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.637+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.637+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560a695f2f00 con 0x560a695e6f30 2024-09-21T09:03:22.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.637+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c029040 con 0x560a695e6f30 2024-09-21T09:03:22.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.637+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560a695f2f00 con 0x560a695eb7a0 2024-09-21T09:03:22.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.637+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.665 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.637+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560a695f2f00 con 0x560a695e6f30 2024-09-21T09:03:22.665 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.638+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c029040 con 0x560a695e6f30 2024-09-21T09:03:22.665 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.638+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560a695f2f00 con 0x7fc1a405c070 2024-09-21T09:03:22.665 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.638+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc19c029040 con 0x7fc1a405c070 2024-09-21T09:03:22.665 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.638+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560a695f2f00 con 0x560a695f0370 2024-09-21T09:03:22.665 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.638+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.665 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.638+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695f0370 2024-09-21T09:03:22.665 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.638+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.665 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.638+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695eb7a0 2024-09-21T09:03:22.665 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.639+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.665 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.639+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695f0370 2024-09-21T09:03:22.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.639+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.639+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695f0370 2024-09-21T09:03:22.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.639+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.639+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695e6f30 2024-09-21T09:03:22.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.639+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc19c029040 con 0x560a695e6f30 2024-09-21T09:03:22.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.639+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695e6f30 2024-09-21T09:03:22.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.639+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc19c029040 con 0x560a695e6f30 2024-09-21T09:03:22.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.639+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695eb7a0 2024-09-21T09:03:22.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.640+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.640+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695f0370 2024-09-21T09:03:22.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.640+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.640+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x7fc1a405c070 2024-09-21T09:03:22.667 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.640+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c029040 con 0x7fc1a405c070 2024-09-21T09:03:22.667 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.640+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695e6f30 2024-09-21T09:03:22.667 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.640+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c029040 con 0x560a695e6f30 2024-09-21T09:03:22.667 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.640+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695eb7a0 2024-09-21T09:03:22.667 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.641+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.667 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.641+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695f0370 2024-09-21T09:03:22.667 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.641+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.667 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.641+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695eb7a0 2024-09-21T09:03:22.667 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.641+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.667 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.641+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x7fc1a405c070 2024-09-21T09:03:22.667 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.641+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c029040 con 0x7fc1a405c070 2024-09-21T09:03:22.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.641+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695f0370 2024-09-21T09:03:22.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695eb7a0 2024-09-21T09:03:22.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x560a695e6f30 2024-09-21T09:03:22.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc19c029040 con 0x560a695e6f30 2024-09-21T09:03:22.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc1a40a9040 con 0x7fc1a405c070 2024-09-21T09:03:22.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c029040 con 0x7fc1a405c070 2024-09-21T09:03:22.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b6340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:22.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b6340800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:22.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b6340800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:22.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b6340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:22.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b6340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:22.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b6340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:22.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695eed70 con 0x560a695e6f30 2024-09-21T09:03:22.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc19c029040 con 0x560a695e6f30 2024-09-21T09:03:22.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b6340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.642+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695ee980 con 0x560a695e6f30 2024-09-21T09:03:22.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc19c029040 con 0x560a695e6f30 2024-09-21T09:03:22.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:22.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695ef660 con 0x560a695e6f30 2024-09-21T09:03:22.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:22.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 20 zone default found 2024-09-21T09:03:22.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 4 Realm: () 2024-09-21T09:03:22.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:22.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:22.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:22.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 20 zonegroup default 2024-09-21T09:03:22.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695f3380 con 0x560a695eb7a0 2024-09-21T09:03:22.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.643+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695ef250 con 0x560a695f0370 2024-09-21T09:03:22.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.644+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.644+0000 7fc1b6340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.644+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.644+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695f5760 con 0x560a695f0370 2024-09-21T09:03:22.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.644+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.644+0000 7fc1b6340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.644+0000 7fc1b6340800 20 started sync module instance, tier type = 2024-09-21T09:03:22.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.644+0000 7fc1b6340800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:22.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.644+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695f45a0 con 0x7fc1a405c070 2024-09-21T09:03:22.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.645+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c03d040 con 0x7fc1a405c070 2024-09-21T09:03:22.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.645+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94602717514432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695f45a0 con 0x7fc1a405c070 2024-09-21T09:03:22.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.645+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695f6270 con 0x560a695e6f30 2024-09-21T09:03:22.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.646+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94602717514432] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c03d040 con 0x7fc1a405c070 2024-09-21T09:03:22.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.646+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.646+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94602717519232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695f45a0 con 0x560a695e6f30 2024-09-21T09:03:22.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.646+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695f6d30 con 0x560a695f0370 2024-09-21T09:03:22.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.647+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.647+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94602717521920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695f75d0 con 0x560a695f0370 2024-09-21T09:03:22.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.647+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695f8070 con 0x7fc1a405c070 2024-09-21T09:03:22.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.647+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94602717519232] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.648+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94602717521920] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.648+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c03d040 con 0x7fc1a405c070 2024-09-21T09:03:22.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.648+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94602717524256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695f40f0 con 0x7fc1a405c070 2024-09-21T09:03:22.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.648+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695f8950 con 0x560a695e6f30 2024-09-21T09:03:22.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.649+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94602717524256] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c03d040 con 0x7fc1a405c070 2024-09-21T09:03:22.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.649+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.649+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94602717526848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695f8890 con 0x560a695e6f30 2024-09-21T09:03:22.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.649+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695f9360 con 0x560a695eb7a0 2024-09-21T09:03:22.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.650+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.650+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94602717531824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695f9bb0 con 0x560a695eb7a0 2024-09-21T09:03:22.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.650+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695fa680 con 0x560a695eb7a0 2024-09-21T09:03:22.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.650+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94602717526848] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.651+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94602717531824] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.651+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.651+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94602717536624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695f9740 con 0x560a695eb7a0 2024-09-21T09:03:22.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.651+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695fad10 con 0x560a695eb7a0 2024-09-21T09:03:22.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.652+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.652+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94602717536624] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.652+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94602717538400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695fb130 con 0x560a695eb7a0 2024-09-21T09:03:22.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.652+0000 7fc1b6340800 20 add_watcher() i=0 2024-09-21T09:03:22.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.652+0000 7fc1b6340800 20 add_watcher() i=1 2024-09-21T09:03:22.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.652+0000 7fc1b6340800 20 add_watcher() i=2 2024-09-21T09:03:22.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.652+0000 7fc1b6340800 20 add_watcher() i=3 2024-09-21T09:03:22.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.652+0000 7fc1b6340800 20 add_watcher() i=4 2024-09-21T09:03:22.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.652+0000 7fc1b6340800 20 add_watcher() i=5 2024-09-21T09:03:22.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.652+0000 7fc1b6340800 20 add_watcher() i=6 2024-09-21T09:03:22.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.653+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94602717538400] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.653+0000 7fc1b6340800 20 add_watcher() i=7 2024-09-21T09:03:22.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.653+0000 7fc1b6340800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:22.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.653+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a695fe160 con 0x560a695e6f30 2024-09-21T09:03:22.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.654+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.654+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94602717539456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a695fb550 con 0x560a695e6f30 2024-09-21T09:03:22.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.655+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94602717539456] v29'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.655+0000 7fc068fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:22.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.655+0000 7fc1b6340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:22.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.655+0000 7fc1b6340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:22.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.655+0000 7fc1b6340800 5 note: GC not initialized 2024-09-21T09:03:22.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.655+0000 7fbfe37fe640 20 reqs_thread_entry: start 2024-09-21T09:03:22.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.655+0000 7fc1b6340800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:22.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.655+0000 7fc1b6340800 20 Filter name: none 2024-09-21T09:03:22.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.655+0000 7fbfe17fa640 20 reqs_thread_entry: start 2024-09-21T09:03:22.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.655+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.655+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a696312d0 con 0x7fc1a405c070 2024-09-21T09:03:22.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.656+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc19c03d040 con 0x7fc1a405c070 2024-09-21T09:03:22.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.656+0000 7fc1b6340800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:22.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.656+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.656+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a69631c00 con 0x560a695eb7a0 2024-09-21T09:03:22.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.656+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.656+0000 7fc1b6340800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:22.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.656+0000 7fc1b6340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T09:03:22.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.656+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.656+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a69631bb0 con 0x7fc1a405c070 2024-09-21T09:03:22.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.656+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc19c03d040 con 0x7fc1a405c070 2024-09-21T09:03:22.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.656+0000 7fc1b6340800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:22.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.656+0000 7fc1b6340800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.656+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:65 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a69631bb0 con 0x560a695eb7a0 2024-09-21T09:03:22.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.657+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(65 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.657+0000 7fc1b6340800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:22.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.657+0000 7fc1b6340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T09:03:22.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.657+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 4.3 4:c0ba99c0:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a69634770 con 0x560a695e6f30 2024-09-21T09:03:22.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.657+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 4.3a 4:5c12a2f4:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a696370c0 con 0x560a695f0370 2024-09-21T09:03:22.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.657+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 4.2b 4:d7ea17ea:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a69639d00 con 0x560a695e6f30 2024-09-21T09:03:22.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.657+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 4.2f 4:f6e88df9:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a6963c5f0 con 0x560a695e6f30 2024-09-21T09:03:22.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.657+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 4.38 4:1f78f3cb:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a6963c5f0 con 0x560a695e6f30 2024-09-21T09:03:22.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.657+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 4.13 4:c8101c22:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a69641940 con 0x7fc1a405c070 2024-09-21T09:03:22.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.657+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 4.3f 4:fe592d9e:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a696446d0 con 0x7fc1a405c070 2024-09-21T09:03:22.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.657+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 4.3a 4:5c7f5cbc:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a696471b0 con 0x560a695f0370 2024-09-21T09:03:22.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.657+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 4.13 4:ca88a996:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a696446d0 con 0x7fc1a405c070 2024-09-21T09:03:22.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.657+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 4.c 4:303bfd52:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a6964c180 con 0x560a695e6f30 2024-09-21T09:03:22.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.657+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:76 4.30 4:0ce2a88a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560a6964f040 con 0x560a695f0370 2024-09-21T09:03:22.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.658+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(67 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.658+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(73 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.658+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(76 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.658+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(66 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.658+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(68 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.658+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(69 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.658+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(70 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.658+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(75 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.658+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(71 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.5 [call out=124b] v0'0 uv6 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc19c03d040 con 0x7fc1a405c070 2024-09-21T09:03:22.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.658+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc19c03d040 con 0x7fc1a405c070 2024-09-21T09:03:22.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.658+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1.8 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc19c03d040 con 0x7fc1a405c070 2024-09-21T09:03:22.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.659+0000 7fc068fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:22.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.659+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94602717539456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a6964c180 con 0x560a695e6f30 2024-09-21T09:03:22.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.660+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94602717539456] v29'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.660+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94602717514432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a6962ecf0 con 0x7fc1a405c070 2024-09-21T09:03:22.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.661+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94602717514432] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c03d040 con 0x7fc1a405c070 2024-09-21T09:03:22.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.661+0000 7fc1b6340800 20 remove_watcher() i=0 2024-09-21T09:03:22.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.661+0000 7fc1b6340800 2 removed watcher, disabling cache 2024-09-21T09:03:22.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.661+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94602717519232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a6962ecf0 con 0x560a695e6f30 2024-09-21T09:03:22.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.662+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94602717519232] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.662+0000 7fc1b6340800 20 remove_watcher() i=1 2024-09-21T09:03:22.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.662+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94602717521920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a6962ecf0 con 0x560a695f0370 2024-09-21T09:03:22.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.663+0000 7fc1b20ca640 1 -- 172.21.15.178:0/1489150579 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94602717521920] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a4051070 con 0x560a695f0370 2024-09-21T09:03:22.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.663+0000 7fc1b6340800 20 remove_watcher() i=2 2024-09-21T09:03:22.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.663+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94602717524256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a6962ecf0 con 0x7fc1a405c070 2024-09-21T09:03:22.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.664+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94602717524256] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c03d040 con 0x7fc1a405c070 2024-09-21T09:03:22.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.664+0000 7fc1b6340800 20 remove_watcher() i=3 2024-09-21T09:03:22.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.664+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94602717526848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a6962ecf0 con 0x560a695e6f30 2024-09-21T09:03:22.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.665+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94602717526848] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c03d040 con 0x560a695e6f30 2024-09-21T09:03:22.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.665+0000 7fc1b6340800 20 remove_watcher() i=4 2024-09-21T09:03:22.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.665+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94602717531824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a6962ecf0 con 0x560a695eb7a0 2024-09-21T09:03:22.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.666+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94602717531824] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.666+0000 7fc1b6340800 20 remove_watcher() i=5 2024-09-21T09:03:22.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.666+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94602717536624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a6962ecf0 con 0x560a695eb7a0 2024-09-21T09:03:22.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.667+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94602717536624] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.667+0000 7fc1b6340800 20 remove_watcher() i=6 2024-09-21T09:03:22.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.667+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94602717538400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560a6962ecf0 con 0x560a695eb7a0 2024-09-21T09:03:22.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b28cb640 1 -- 172.21.15.178:0/1489150579 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94602717538400] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1ac056040 con 0x560a695eb7a0 2024-09-21T09:03:22.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 20 remove_watcher() i=7 2024-09-21T09:03:22.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560a695eb7a0 msgr2=0x560a695edb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560a695eb7a0 0x560a695edb90 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560a695e6f30 msgr2=0x560a695e93f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560a695e6f30 0x560a695e93f0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc1a405c070 msgr2=0x7fc1a40688b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc1a405c070 0x7fc1a40688b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x560a695f0370 msgr2=0x560a695f2830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x560a695f0370 0x560a695f2830 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc07c036b90 msgr2=0x7fc07c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc07c036b90 0x7fc07c039050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40547e0 tx=0x7fc1a4085000 comp rx=0 tx=0).stop 2024-09-21T09:03:22.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1a98c9640 1 -- 172.21.15.178:0/1489150579 reap_dead start 2024-09-21T09:03:22.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695d3e20 msgr2=0x560a695db300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695d3e20 0x560a695db300 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac04ba90 tx=0x7fc1ac04cb00 comp rx=0 tx=0).stop 2024-09-21T09:03:22.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 shutdown_connections 2024-09-21T09:03:22.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1489150579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695d3e20 0x560a695db300 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 >> 172.21.15.178:0/1489150579 conn(0x560a695d0180 msgr2=0x560a695ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 shutdown_connections 2024-09-21T09:03:22.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.668+0000 7fc1b6340800 1 -- 172.21.15.178:0/1489150579 wait complete. 2024-09-21T09:03:22.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 -- 172.21.15.178:0/202004118 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc08c036b90 msgr2=0x7fc08c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 --2- 172.21.15.178:0/202004118 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc08c036b90 0x7fc08c039050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x560a695b3ef0 tx=0x7fc1a4060ee0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 -- 172.21.15.178:0/202004118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695c71a0 msgr2=0x560a695c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 --2- 172.21.15.178:0/202004118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695c71a0 0x560a695c75c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x560a695b3e00 tx=0x7fc1ac018830 comp rx=0 tx=0).stop 2024-09-21T09:03:22.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 -- 172.21.15.178:0/202004118 shutdown_connections 2024-09-21T09:03:22.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 --2- 172.21.15.178:0/202004118 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc08c036b90 0x7fc08c039050 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 --2- 172.21.15.178:0/202004118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a695c71a0 0x560a695c75c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 -- 172.21.15.178:0/202004118 >> 172.21.15.178:0/202004118 conn(0x560a695bc130 msgr2=0x560a695becb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 -- 172.21.15.178:0/202004118 shutdown_connections 2024-09-21T09:03:22.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 -- 172.21.15.178:0/202004118 wait complete. 2024-09-21T09:03:22.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560a695b5d80 msgr2=0x560a695b8170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560a695b5d80 0x560a695b8170 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560a694b8bd0 msgr2=0x560a695b3450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560a694b8bd0 0x560a695b3450 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc098036b40 msgr2=0x7fc098039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc098036b40 0x7fc098039000 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc19c000f60 tx=0x7fc19c0012b0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 msgr2=0x560a695ac3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a695ac3e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x560a695a58d0 tx=0x7fc1a4002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 shutdown_connections 2024-09-21T09:03:22.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x560a695b5d80 0x560a695b8170 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x560a694b8bd0 0x560a695b3450 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc098036b40 0x7fc098039000 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 --2- 172.21.15.178:0/1190868365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a694275f0 0x560a695ac3e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 >> 172.21.15.178:0/1190868365 conn(0x560a694adde0 msgr2=0x560a6959eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 shutdown_connections 2024-09-21T09:03:22.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.669+0000 7fc1b6340800 1 -- 172.21.15.178:0/1190868365 wait complete. 2024-09-21T09:03:22.696 INFO:teuthology.orchestra.run.smithi178.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"68ad48f1-b3da-4499-bba2-41066e92d255","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1","marker":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-21T09:03:22.196263Z","creation_time":"2024-09-21T09:03:19.558161Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-21T09:03:22.696 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68ad48f1-b3da-4499-bba2-41066e92d255', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1', 'marker': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T09:03:22.196263Z', 'creation_time': '2024-09-21T09:03:19.558161Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-21T09:03:22.696 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-21T09:03:22.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-21T09:03:22.697 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-21T09:03:22.739 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:22.739 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:22.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.738+0000 7fd0f6213800 1 Processor -- start 2024-09-21T09:03:22.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.738+0000 7fd0f6213800 1 -- start start 2024-09-21T09:03:22.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.738+0000 7fd0f6213800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x558ac7e2f980 0x558ac7e2fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.738+0000 7fd0f6213800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558ac7cf0b30 con 0x558ac7e302c0 2024-09-21T09:03:22.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.738+0000 7fd0f6213800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x558ac7cd2360 con 0x558ac7e2f980 2024-09-21T09:03:22.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.738+0000 7fd0f186e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x558ac7e2f980 0x558ac7e2fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.738+0000 7fd0f106d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x558ac7e302c0 0x558ac7e36ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46916/0 (socket says 172.21.15.178:46916) 2024-09-21T09:03:22.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.738+0000 7fd0f106d640 1 -- 172.21.15.178:0/4105625645 learned_addr learned my addr 172.21.15.178:0/4105625645 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:22.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.739+0000 7fd0f186e640 1 -- 172.21.15.178:0/4105625645 >> v1:172.21.15.44:6789/0 conn(0x558ac7e302c0 legacy=0x558ac7e36ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.739+0000 7fd0f086c640 1 -- 172.21.15.178:0/4105625645 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1000284749 0 0) 0x558ac7cf0b30 con 0x558ac7e302c0 2024-09-21T09:03:22.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.739+0000 7fd0f186e640 1 -- 172.21.15.178:0/4105625645 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac7cf8e00 con 0x558ac7e2f980 2024-09-21T09:03:22.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.740+0000 7fd0f186e640 1 --2- 172.21.15.178:0/4105625645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7e2fd80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400a470 tx=0x7fd0e4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe42e97fbcea8e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.740+0000 7fd0f086c640 1 -- 172.21.15.178:0/4105625645 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e4053570 con 0x558ac7e2f980 2024-09-21T09:03:22.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.740+0000 7fd0f086c640 1 -- 172.21.15.178:0/4105625645 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e4058070 con 0x558ac7e2f980 2024-09-21T09:03:22.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.740+0000 7fd0f086c640 1 -- 172.21.15.178:0/4105625645 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e4053880 con 0x558ac7e2f980 2024-09-21T09:03:22.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.741+0000 7fd0f6213800 1 -- 172.21.15.178:0/4105625645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 msgr2=0x558ac7e2fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.741+0000 7fd0f6213800 1 --2- 172.21.15.178:0/4105625645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7e2fd80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400a470 tx=0x7fd0e4045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:22.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.741+0000 7fd0f6213800 1 -- 172.21.15.178:0/4105625645 shutdown_connections 2024-09-21T09:03:22.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.741+0000 7fd0f6213800 1 --2- 172.21.15.178:0/4105625645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7e2fd80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.741+0000 7fd0f6213800 1 -- 172.21.15.178:0/4105625645 >> 172.21.15.178:0/4105625645 conn(0x558ac7e2b5b0 msgr2=0x558ac7e2d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.741+0000 7fd0f6213800 1 -- 172.21.15.178:0/4105625645 shutdown_connections 2024-09-21T09:03:22.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.741+0000 7fd0f6213800 1 -- 172.21.15.178:0/4105625645 wait complete. 2024-09-21T09:03:22.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.755+0000 7fd0f6213800 1 Processor -- start 2024-09-21T09:03:22.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.755+0000 7fd0f6213800 1 -- start start 2024-09-21T09:03:22.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.755+0000 7fd0f6213800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7f20670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.755+0000 7fd0f6213800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558ac7d7d320 con 0x558ac7e2f980 2024-09-21T09:03:22.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.755+0000 7fd0f186e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7f20670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.755+0000 7fd0f186e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7f20670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44234/0 (socket says 172.21.15.178:44234) 2024-09-21T09:03:22.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.755+0000 7fd0f186e640 1 -- 172.21.15.178:0/28301374 learned_addr learned my addr 172.21.15.178:0/28301374 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.756+0000 7fd0f186e640 1 -- 172.21.15.178:0/28301374 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac7ccabc0 con 0x558ac7e2f980 2024-09-21T09:03:22.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.756+0000 7fd0f186e640 1 --2- 172.21.15.178:0/28301374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7f20670 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4005870 tx=0x7fd0e4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8e99168d90cfb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.756+0000 7fcfdfe07640 1 -- 172.21.15.178:0/28301374 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e405c580 con 0x558ac7e2f980 2024-09-21T09:03:22.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.756+0000 7fcfdfe07640 1 -- 172.21.15.178:0/28301374 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e4063030 con 0x558ac7e2f980 2024-09-21T09:03:22.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.756+0000 7fcfdfe07640 1 -- 172.21.15.178:0/28301374 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e405c850 con 0x558ac7e2f980 2024-09-21T09:03:22.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.757+0000 7fd0f6213800 1 -- 172.21.15.178:0/28301374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 msgr2=0x558ac7f20670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.757+0000 7fd0f6213800 1 --2- 172.21.15.178:0/28301374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7f20670 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4005870 tx=0x7fd0e4051000 comp rx=0 tx=0).stop 2024-09-21T09:03:22.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.757+0000 7fd0f6213800 1 -- 172.21.15.178:0/28301374 shutdown_connections 2024-09-21T09:03:22.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.757+0000 7fd0f6213800 1 --2- 172.21.15.178:0/28301374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7f20670 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.757+0000 7fd0f6213800 1 -- 172.21.15.178:0/28301374 >> 172.21.15.178:0/28301374 conn(0x558ac7e2b5b0 msgr2=0x558ac7f1c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.757+0000 7fd0f6213800 1 -- 172.21.15.178:0/28301374 shutdown_connections 2024-09-21T09:03:22.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.757+0000 7fd0f6213800 1 -- 172.21.15.178:0/28301374 wait complete. 2024-09-21T09:03:22.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.757+0000 7fd0f6213800 1 Processor -- start 2024-09-21T09:03:22.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.757+0000 7fd0f6213800 1 -- start start 2024-09-21T09:03:22.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.757+0000 7fd0f6213800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7e32340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.757+0000 7fd0f6213800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558ac7e38640 con 0x558ac7e2f980 2024-09-21T09:03:22.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.757+0000 7fd0f186e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7e32340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.757+0000 7fd0f186e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7e32340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44250/0 (socket says 172.21.15.178:44250) 2024-09-21T09:03:22.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.757+0000 7fd0f186e640 1 -- 172.21.15.178:0/137926034 learned_addr learned my addr 172.21.15.178:0/137926034 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.758+0000 7fd0f186e640 1 -- 172.21.15.178:0/137926034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac7cdefe0 con 0x558ac7e2f980 2024-09-21T09:03:22.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.758+0000 7fd0f186e640 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7e32340 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4045f50 tx=0x7fd0e4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.758+0000 7fcfde604640 1 -- 172.21.15.178:0/137926034 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e4078070 con 0x558ac7e2f980 2024-09-21T09:03:22.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.758+0000 7fcfde604640 1 -- 172.21.15.178:0/137926034 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e4054a70 con 0x558ac7e2f980 2024-09-21T09:03:22.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.758+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ac7e30a30 con 0x558ac7e2f980 2024-09-21T09:03:22.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.758+0000 7fcfde604640 1 -- 172.21.15.178:0/137926034 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e4054d50 con 0x558ac7e2f980 2024-09-21T09:03:22.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.758+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ac7e30fb0 con 0x558ac7e2f980 2024-09-21T09:03:22.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.759+0000 7fcfde604640 1 -- 172.21.15.178:0/137926034 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd0e407b070 con 0x558ac7e2f980 2024-09-21T09:03:22.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.759+0000 7fcfde604640 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfd8036b90 0x7fcfd8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.759+0000 7fcfde604640 1 -- 172.21.15.178:0/137926034 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fd0e4070070 con 0x558ac7e2f980 2024-09-21T09:03:22.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.759+0000 7fd0f106d640 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfd8036b90 0x7fcfd8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.759+0000 7fd0f6213800 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558ac7e302c0 0x558ac7f31340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.759+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f31880 con 0x558ac7e302c0 2024-09-21T09:03:22.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.759+0000 7fd0f206f640 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558ac7e302c0 0x558ac7f31340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.759+0000 7fd0f106d640 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfd8036b90 0x7fcfd8039050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc000c00 tx=0x7fd0dc0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.760+0000 7fd0f206f640 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558ac7e302c0 0x558ac7f31340 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.760+0000 7fd0f206f640 1 -- 172.21.15.178:0/137926034 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0ec00a4a0 con 0x558ac7e302c0 2024-09-21T09:03:22.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.760+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f320d0 con 0x558ac7e302c0 2024-09-21T09:03:22.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.760+0000 7fd0f206f640 1 -- 172.21.15.178:0/137926034 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd0ec00a4a0 con 0x558ac7e302c0 2024-09-21T09:03:22.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.760+0000 7fd0f6213800 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558ac7f33b00 0x558ac7f35f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.760+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f366e0 con 0x558ac7f33b00 2024-09-21T09:03:22.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.760+0000 7fd0f186e640 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558ac7f33b00 0x558ac7f35f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.761+0000 7fd0f186e640 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558ac7f33b00 0x558ac7f35f50 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.761+0000 7fd0f186e640 1 -- 172.21.15.178:0/137926034 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f33b00 2024-09-21T09:03:22.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.761+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f32920 con 0x558ac7e302c0 2024-09-21T09:03:22.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.761+0000 7fd0f206f640 1 -- 172.21.15.178:0/137926034 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd0ec00a4a0 con 0x558ac7e302c0 2024-09-21T09:03:22.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.761+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f32d00 con 0x558ac7e302c0 2024-09-21T09:03:22.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.762+0000 7fd0f206f640 1 -- 172.21.15.178:0/137926034 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd0ec00a4a0 con 0x558ac7e302c0 2024-09-21T09:03:22.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.762+0000 7fd0f6213800 1 Processor -- start 2024-09-21T09:03:22.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.762+0000 7fd0f6213800 1 -- start start 2024-09-21T09:03:22.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.762+0000 7fd0f6213800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f45060 0x558ac7f45480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.762+0000 7fd0f6213800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558ac7e32880 con 0x558ac7f45060 2024-09-21T09:03:22.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.762+0000 7fd0f206f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f45060 0x558ac7f45480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.762+0000 7fd0f206f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f45060 0x558ac7f45480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44254/0 (socket says 172.21.15.178:44254) 2024-09-21T09:03:22.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.762+0000 7fd0f206f640 1 -- 172.21.15.178:0/3444666403 learned_addr learned my addr 172.21.15.178:0/3444666403 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.763+0000 7fd0f206f640 1 -- 172.21.15.178:0/3444666403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac7f459c0 con 0x558ac7f45060 2024-09-21T09:03:22.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.763+0000 7fd0f206f640 1 --2- 172.21.15.178:0/3444666403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f45060 0x558ac7f45480 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x558ac7e319d0 tx=0x7fd0ec018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.763+0000 7fcfd77fe640 1 -- 172.21.15.178:0/3444666403 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ec014450 con 0x558ac7f45060 2024-09-21T09:03:22.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.763+0000 7fcfd77fe640 1 -- 172.21.15.178:0/3444666403 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0ec014610 con 0x558ac7f45060 2024-09-21T09:03:22.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.763+0000 7fd0f6213800 1 -- 172.21.15.178:0/3444666403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ac7f45c50 con 0x558ac7f45060 2024-09-21T09:03:22.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.763+0000 7fcfd77fe640 1 -- 172.21.15.178:0/3444666403 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ec014930 con 0x558ac7f45060 2024-09-21T09:03:22.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.763+0000 7fd0f6213800 1 -- 172.21.15.178:0/3444666403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ac7f48930 con 0x558ac7f45060 2024-09-21T09:03:22.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.764+0000 7fcfd77fe640 1 -- 172.21.15.178:0/3444666403 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd0ec011040 con 0x558ac7f45060 2024-09-21T09:03:22.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.764+0000 7fcfd77fe640 1 --2- 172.21.15.178:0/3444666403 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfcc036b90 0x7fcfcc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.764+0000 7fcfd77fe640 1 -- 172.21.15.178:0/3444666403 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fd0ec01e070 con 0x558ac7f45060 2024-09-21T09:03:22.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.764+0000 7fd0f186e640 1 --2- 172.21.15.178:0/3444666403 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfcc036b90 0x7fcfcc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.764+0000 7fd0f6213800 1 Processor -- start 2024-09-21T09:03:22.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.764+0000 7fd0f6213800 1 -- start start 2024-09-21T09:03:22.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.764+0000 7fd0f186e640 1 --2- 172.21.15.178:0/3444666403 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfcc036b90 0x7fcfcc039050 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x558ac7e31500 tx=0x7fd0e4054f70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.764+0000 7fd0f6213800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f51c70 0x558ac7f52070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.764+0000 7fd0f6213800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558ac7ccc580 con 0x558ac7f51c70 2024-09-21T09:03:22.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.765+0000 7fd0f206f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f51c70 0x558ac7f52070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.765+0000 7fd0f206f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f51c70 0x558ac7f52070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44270/0 (socket says 172.21.15.178:44270) 2024-09-21T09:03:22.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.765+0000 7fd0f206f640 1 -- 172.21.15.178:0/4207224001 learned_addr learned my addr 172.21.15.178:0/4207224001 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.765+0000 7fd0f206f640 1 -- 172.21.15.178:0/4207224001 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac7f52640 con 0x558ac7f51c70 2024-09-21T09:03:22.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.765+0000 7fd0f206f640 1 --2- 172.21.15.178:0/4207224001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f51c70 0x558ac7f52070 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec04cb90 tx=0x7fd0ec011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1462d16ff5bd30f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.765+0000 7fcfd57fa640 1 -- 172.21.15.178:0/4207224001 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ec044070 con 0x558ac7f51c70 2024-09-21T09:03:22.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.765+0000 7fcfd57fa640 1 -- 172.21.15.178:0/4207224001 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0ec0167c0 con 0x558ac7f51c70 2024-09-21T09:03:22.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.765+0000 7fcfd57fa640 1 -- 172.21.15.178:0/4207224001 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ec013ca0 con 0x558ac7f51c70 2024-09-21T09:03:22.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.766+0000 7fd0f6213800 1 -- 172.21.15.178:0/4207224001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f51c70 msgr2=0x558ac7f52070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.766+0000 7fd0f6213800 1 --2- 172.21.15.178:0/4207224001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f51c70 0x558ac7f52070 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec04cb90 tx=0x7fd0ec011700 comp rx=0 tx=0).stop 2024-09-21T09:03:22.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.766+0000 7fd0f6213800 1 -- 172.21.15.178:0/4207224001 shutdown_connections 2024-09-21T09:03:22.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.766+0000 7fd0f6213800 1 --2- 172.21.15.178:0/4207224001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f51c70 0x558ac7f52070 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.766+0000 7fd0f6213800 1 -- 172.21.15.178:0/4207224001 >> 172.21.15.178:0/4207224001 conn(0x558ac7f4e020 msgr2=0x558ac7f4c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.766+0000 7fd0f6213800 1 -- 172.21.15.178:0/4207224001 shutdown_connections 2024-09-21T09:03:22.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.766+0000 7fd0f6213800 1 -- 172.21.15.178:0/4207224001 wait complete. 2024-09-21T09:03:22.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.766+0000 7fd0f6213800 1 Processor -- start 2024-09-21T09:03:22.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.766+0000 7fd0f6213800 1 -- start start 2024-09-21T09:03:22.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.766+0000 7fd0f6213800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f51c70 0x558ac7f58f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.766+0000 7fd0f6213800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558ac7f52ad0 con 0x558ac7f51c70 2024-09-21T09:03:22.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.766+0000 7fd0f206f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f51c70 0x558ac7f58f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.766+0000 7fd0f206f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f51c70 0x558ac7f58f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44274/0 (socket says 172.21.15.178:44274) 2024-09-21T09:03:22.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.766+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 learned_addr learned my addr 172.21.15.178:0/1048405743 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.767+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac7f59480 con 0x558ac7f51c70 2024-09-21T09:03:22.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.767+0000 7fd0f206f640 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f51c70 0x558ac7f58f40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec013bf0 tx=0x7fd0ec04cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.767+0000 7fcfc37fe640 1 -- 172.21.15.178:0/1048405743 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ec016440 con 0x558ac7f51c70 2024-09-21T09:03:22.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.767+0000 7fcfc37fe640 1 -- 172.21.15.178:0/1048405743 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0ec04e2e0 con 0x558ac7f51c70 2024-09-21T09:03:22.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.767+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ac7f59710 con 0x558ac7f51c70 2024-09-21T09:03:22.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.767+0000 7fcfc37fe640 1 -- 172.21.15.178:0/1048405743 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ec022a50 con 0x558ac7f51c70 2024-09-21T09:03:22.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.767+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ac7f5c3c0 con 0x558ac7f51c70 2024-09-21T09:03:22.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.768+0000 7fcfc37fe640 1 -- 172.21.15.178:0/1048405743 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd0ec03e020 con 0x558ac7f51c70 2024-09-21T09:03:22.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.768+0000 7fcfc37fe640 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfbc036b90 0x7fcfbc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.768+0000 7fcfc37fe640 1 -- 172.21.15.178:0/1048405743 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fd0ec03c020 con 0x558ac7f51c70 2024-09-21T09:03:22.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.768+0000 7fd0f186e640 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfbc036b90 0x7fcfbc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.768+0000 7fd0f6213800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.768+0000 7fd0f6213800 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558ac7f64c10 0x558ac7f670d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.768+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f67820 con 0x558ac7f64c10 2024-09-21T09:03:22.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.768+0000 7fd0f106d640 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558ac7f64c10 0x558ac7f670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f186e640 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfbc036b90 0x7fcfbc039050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd0e407c730 tx=0x7fd0e408a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f106d640 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558ac7f64c10 0x558ac7f670d0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0dc00f5f0 con 0x558ac7f64c10 2024-09-21T09:03:22.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f6213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f6213800 20 realm 2024-09-21T09:03:22.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f6213800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f64060 con 0x558ac7f64c10 2024-09-21T09:03:22.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0dc00f5f0 con 0x558ac7f64c10 2024-09-21T09:03:22.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f6213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f6213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:22.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f6213800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f68300 con 0x558ac7f64c10 2024-09-21T09:03:22.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0dc00f5f0 con 0x558ac7f64c10 2024-09-21T09:03:22.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f6213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f6213800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.769+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f68bd0 con 0x558ac7f64c10 2024-09-21T09:03:22.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.770+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd0dc00f5f0 con 0x558ac7f64c10 2024-09-21T09:03:22.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.770+0000 7fd0f6213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:22.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.770+0000 7fd0f6213800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.770+0000 7fd0f6213800 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558ac7f694d0 0x558ac7f6b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.770+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f694d0 2024-09-21T09:03:22.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.770+0000 7fd0f206f640 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558ac7f694d0 0x558ac7f6b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.770+0000 7fd0f206f640 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558ac7f694d0 0x558ac7f6b8e0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.771+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.771+0000 7fd0f6213800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:22.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.771+0000 7fd0f6213800 20 searching for the correct realm 2024-09-21T09:03:22.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.771+0000 7fd0f6213800 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558ac7f6e0f0 0x558ac7f705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.771+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f70c80 con 0x558ac7f6e0f0 2024-09-21T09:03:22.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.771+0000 7fd0f186e640 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558ac7f6e0f0 0x558ac7f705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.771+0000 7fd0f186e640 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558ac7f6e0f0 0x558ac7f705b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.771+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.771+0000 7fd0f186e640 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd0e407d060 0x7fd0e408e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.771+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f70c80 con 0x7fd0e407d060 2024-09-21T09:03:22.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.771+0000 7fd0f106d640 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd0e407d060 0x7fd0e408e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.772+0000 7fd0f106d640 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd0e407d060 0x7fd0e408e360 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.772+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc00f5f0 con 0x7fd0e407d060 2024-09-21T09:03:22.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.772+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f70c80 con 0x558ac7f694d0 2024-09-21T09:03:22.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.772+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.772+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f64c10 2024-09-21T09:03:22.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.773+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc00f5f0 con 0x558ac7f64c10 2024-09-21T09:03:22.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.773+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f64c10 2024-09-21T09:03:22.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.773+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.773+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f694d0 2024-09-21T09:03:22.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.773+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.773+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f694d0 2024-09-21T09:03:22.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.773+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.773+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x7fd0e407d060 2024-09-21T09:03:22.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.774+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc02b040 con 0x7fd0e407d060 2024-09-21T09:03:22.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.774+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f6e0f0 2024-09-21T09:03:22.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.774+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.774+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f64c10 2024-09-21T09:03:22.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.774+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.774+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f694d0 2024-09-21T09:03:22.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.775+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.775+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f64c10 2024-09-21T09:03:22.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.775+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.775+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x7fd0e407d060 2024-09-21T09:03:22.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.775+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd0dc02b040 con 0x7fd0e407d060 2024-09-21T09:03:22.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.775+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f6e0f0 2024-09-21T09:03:22.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.775+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.775+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f6e0f0 2024-09-21T09:03:22.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.776+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.776+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f694d0 2024-09-21T09:03:22.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.776+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.776+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f6e0f0 2024-09-21T09:03:22.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.776+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.776+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f6e0f0 2024-09-21T09:03:22.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.776+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.776+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f64c10 2024-09-21T09:03:22.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.777+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.777+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f64c10 2024-09-21T09:03:22.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.777+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.777+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f694d0 2024-09-21T09:03:22.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.777+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.777+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f6e0f0 2024-09-21T09:03:22.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.778+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.778+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x7fd0e407d060 2024-09-21T09:03:22.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.778+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc02b040 con 0x7fd0e407d060 2024-09-21T09:03:22.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.778+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f64c10 2024-09-21T09:03:22.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.778+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.778+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f694d0 2024-09-21T09:03:22.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.779+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.779+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f6e0f0 2024-09-21T09:03:22.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.779+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.779+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f694d0 2024-09-21T09:03:22.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.779+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.779+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x7fd0e407d060 2024-09-21T09:03:22.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.779+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc02b040 con 0x7fd0e407d060 2024-09-21T09:03:22.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.779+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f6e0f0 2024-09-21T09:03:22.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.780+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.780+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f694d0 2024-09-21T09:03:22.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.780+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.780+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x558ac7f64c10 2024-09-21T09:03:22.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.780+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.780+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c040 con 0x7fd0e407d060 2024-09-21T09:03:22.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.780+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc02b040 con 0x7fd0e407d060 2024-09-21T09:03:22.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.780+0000 7fd0f6213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:22.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:22.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:22.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:22.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:22.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:22.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6c9f0 con 0x558ac7f64c10 2024-09-21T09:03:22.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f64c10 2024-09-21T09:03:22.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:22.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6d200 con 0x558ac7f64c10 2024-09-21T09:03:22.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:22.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 20 zone default found 2024-09-21T09:03:22.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 4 Realm: () 2024-09-21T09:03:22.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:22.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:22.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:22.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 20 zonegroup default 2024-09-21T09:03:22.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.781+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6d630 con 0x558ac7f694d0 2024-09-21T09:03:22.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.782+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.782+0000 7fd0f6213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.782+0000 7fd0f6213800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.782+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f72b40 con 0x558ac7f6e0f0 2024-09-21T09:03:22.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.782+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.782+0000 7fd0f6213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.782+0000 7fd0f6213800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.782+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f73020 con 0x558ac7f6e0f0 2024-09-21T09:03:22.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.782+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.782+0000 7fd0f6213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.782+0000 7fd0f6213800 20 started sync module instance, tier type = 2024-09-21T09:03:22.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.782+0000 7fd0f6213800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:22.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.782+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f71f80 con 0x7fd0e407d060 2024-09-21T09:03:22.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.783+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc02b040 con 0x7fd0e407d060 2024-09-21T09:03:22.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.783+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94054548710608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f71f80 con 0x7fd0e407d060 2024-09-21T09:03:22.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.783+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f73b60 con 0x558ac7f64c10 2024-09-21T09:03:22.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.784+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94054548710608] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc02b040 con 0x7fd0e407d060 2024-09-21T09:03:22.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.785+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.785+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94054548715088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f71f80 con 0x558ac7f64c10 2024-09-21T09:03:22.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.785+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f745e0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.786+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94054548715088] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.786+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.786+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94054548708048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f71ef0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.786+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f753c0 con 0x7fd0e407d060 2024-09-21T09:03:22.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.787+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc02b040 con 0x7fd0e407d060 2024-09-21T09:03:22.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.787+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94054548721328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f75c60 con 0x7fd0e407d060 2024-09-21T09:03:22.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.787+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f76740 con 0x558ac7f64c10 2024-09-21T09:03:22.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.787+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94054548708048] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.788+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.788+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94054548726352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f76740 con 0x558ac7f64c10 2024-09-21T09:03:22.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.788+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f77150 con 0x558ac7f694d0 2024-09-21T09:03:22.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.788+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94054548721328] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc02b040 con 0x7fd0e407d060 2024-09-21T09:03:22.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.789+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.789+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94054548723632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f77150 con 0x558ac7f694d0 2024-09-21T09:03:22.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.789+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f77b60 con 0x558ac7f694d0 2024-09-21T09:03:22.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.789+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94054548726352] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.790+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94054548723632] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.790+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.790+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94054548728992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f770c0 con 0x558ac7f694d0 2024-09-21T09:03:22.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.790+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f78010 con 0x558ac7f694d0 2024-09-21T09:03:22.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.791+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.791+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94054548732768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f78490 con 0x558ac7f694d0 2024-09-21T09:03:22.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.791+0000 7fd0f6213800 20 add_watcher() i=0 2024-09-21T09:03:22.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.791+0000 7fd0f6213800 20 add_watcher() i=1 2024-09-21T09:03:22.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.791+0000 7fd0f6213800 20 add_watcher() i=2 2024-09-21T09:03:22.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.791+0000 7fd0f6213800 20 add_watcher() i=3 2024-09-21T09:03:22.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.791+0000 7fd0f6213800 20 add_watcher() i=4 2024-09-21T09:03:22.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.791+0000 7fd0f6213800 20 add_watcher() i=5 2024-09-21T09:03:22.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.791+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94054548728992] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.791+0000 7fd0f6213800 20 add_watcher() i=6 2024-09-21T09:03:22.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.792+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94054548732768] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.792+0000 7fd0f6213800 20 add_watcher() i=7 2024-09-21T09:03:22.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.792+0000 7fd0f6213800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:22.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.792+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f776b0 con 0x558ac7f64c10 2024-09-21T09:03:22.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.793+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.793+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94054548733824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f776b0 con 0x558ac7f64c10 2024-09-21T09:03:22.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.793+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94054548733824] v29'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.794+0000 7fcfa37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:22.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.794+0000 7fd0f6213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:22.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.794+0000 7fd0f6213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:22.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.794+0000 7fd0f6213800 5 note: GC not initialized 2024-09-21T09:03:22.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.794+0000 7fcfa27fc640 20 reqs_thread_entry: start 2024-09-21T09:03:22.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.794+0000 7fd0f6213800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:22.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.794+0000 7fd0f6213800 20 Filter name: none 2024-09-21T09:03:22.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.794+0000 7fcf13fff640 20 reqs_thread_entry: start 2024-09-21T09:03:22.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.794+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7fadd40 con 0x558ac7f694d0 2024-09-21T09:03:22.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.795+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(62 [pgnls start_epoch 29 out=254b] v29'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.795+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6d630 con 0x558ac7f694d0 2024-09-21T09:03:22.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.795+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(63 [pgnls start_epoch 29 out=131b] v29'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.795+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6d630 con 0x558ac7f6e0f0 2024-09-21T09:03:22.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.796+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.796+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6d630 con 0x558ac7f694d0 2024-09-21T09:03:22.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.796+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(65 [pgnls start_epoch 29 out=172b] v29'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.796+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6d630 con 0x558ac7f64c10 2024-09-21T09:03:22.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.796+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(66 [pgnls start_epoch 29 out=335b] v29'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.796+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x7fd0e407d060 2024-09-21T09:03:22.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.797+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(67 [pgnls start_epoch 29 out=213b] v29'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd0dc02b040 con 0x7fd0e407d060 2024-09-21T09:03:22.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.797+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.797+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(68 [pgnls start_epoch 29 out=254b] v29'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.797+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.797+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(69 [pgnls start_epoch 29 out=295b] v29'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.797+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.797+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=213b] v29'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.797+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x7fd0e407d060 2024-09-21T09:03:22.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.798+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(71 [pgnls start_epoch 29 out=172b] v29'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd0dc02b040 con 0x7fd0e407d060 2024-09-21T09:03:22.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.798+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x7fd0e407d060 2024-09-21T09:03:22.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.798+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(72 [pgnls start_epoch 29 out=336b] v29'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fd0dc02b040 con 0x7fd0e407d060 2024-09-21T09:03:22.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.798+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.798+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=131b] v29'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.798+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.799+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(74 [pgnls start_epoch 29 out=254b] v29'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.799+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.799+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(75 [pgnls start_epoch 29 out=90b] v29'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.799+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f64c10 2024-09-21T09:03:22.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.799+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(76 [pgnls start_epoch 29 out=213b] v29'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd0dc02b040 con 0x558ac7f64c10 2024-09-21T09:03:22.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.799+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.799+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(77 [pgnls start_epoch 29 out=254b] v29'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.799+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f64c10 2024-09-21T09:03:22.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.800+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(78 [pgnls start_epoch 29 out=254b] v29'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd0dc04b110 con 0x558ac7f64c10 2024-09-21T09:03:22.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.800+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.800+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(79 [pgnls start_epoch 29 out=213b] v29'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.800+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.800+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(80 [pgnls start_epoch 29 out=172b] v29'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.800+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f64c10 2024-09-21T09:03:22.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.800+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(81 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd0dc04b110 con 0x558ac7f64c10 2024-09-21T09:03:22.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.800+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x7fd0e407d060 2024-09-21T09:03:22.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.801+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(82 [pgnls start_epoch 29 out=276b] v29'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fd0dc04b110 con 0x7fd0e407d060 2024-09-21T09:03:22.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.801+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x7fd0e407d060 2024-09-21T09:03:22.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.801+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(83 [pgnls start_epoch 29 out=172b] v29'18 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd0dc04b110 con 0x7fd0e407d060 2024-09-21T09:03:22.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.801+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f64c10 2024-09-21T09:03:22.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.801+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(84 [pgnls start_epoch 29 out=295b] v29'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd0dc04b110 con 0x558ac7f64c10 2024-09-21T09:03:22.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.801+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f694d0 2024-09-21T09:03:22.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.802+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(85 [pgnls start_epoch 29 out=172b] v29'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.802+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x7fd0e407d060 2024-09-21T09:03:22.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.802+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(86 [pgnls start_epoch 29 out=213b] v29'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd0dc04b110 con 0x7fd0e407d060 2024-09-21T09:03:22.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.802+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f694d0 2024-09-21T09:03:22.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.803+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(87 [pgnls start_epoch 29 out=172b] v29'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.803+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.803+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(88 [pgnls start_epoch 29 out=172b] v29'18 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.803+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.803+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(89 [pgnls start_epoch 29 out=90b] v29'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.803+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.804+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(90 [pgnls start_epoch 29 out=90b] v29'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.804+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f64c10 2024-09-21T09:03:22.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.804+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(91 [pgnls start_epoch 29 out=131b] v29'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fd0dc04b110 con 0x558ac7f64c10 2024-09-21T09:03:22.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.804+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x7fd0e407d060 2024-09-21T09:03:22.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.804+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(92 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd0dc04b110 con 0x7fd0e407d060 2024-09-21T09:03:22.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.804+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6cde0 con 0x558ac7f694d0 2024-09-21T09:03:22.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.805+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(93 [pgnls start_epoch 29 out=213b] v29'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.827 INFO:teuthology.orchestra.run.smithi178.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-21T09:03:22.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.806+0000 7fcfa37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:22.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.806+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94054548733824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f6d630 con 0x558ac7f64c10 2024-09-21T09:03:22.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.807+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94054548733824] v29'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd0dc04b110 con 0x558ac7f64c10 2024-09-21T09:03:22.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.807+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94054548710608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7fac1b0 con 0x7fd0e407d060 2024-09-21T09:03:22.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.808+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94054548710608] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc04b110 con 0x7fd0e407d060 2024-09-21T09:03:22.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.808+0000 7fd0f6213800 20 remove_watcher() i=0 2024-09-21T09:03:22.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.808+0000 7fd0f6213800 2 removed watcher, disabling cache 2024-09-21T09:03:22.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.808+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94054548715088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7fac1b0 con 0x558ac7f64c10 2024-09-21T09:03:22.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.810+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94054548715088] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc04b110 con 0x558ac7f64c10 2024-09-21T09:03:22.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.810+0000 7fd0f6213800 20 remove_watcher() i=1 2024-09-21T09:03:22.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.810+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94054548708048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7fac1b0 con 0x558ac7f6e0f0 2024-09-21T09:03:22.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.811+0000 7fd0f186e640 1 -- 172.21.15.178:0/1048405743 <== osd.3 v2:172.21.15.178:6808/24558189 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94054548708048] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e407a030 con 0x558ac7f6e0f0 2024-09-21T09:03:22.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.811+0000 7fd0f6213800 20 remove_watcher() i=2 2024-09-21T09:03:22.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.811+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94054548721328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f724d0 con 0x7fd0e407d060 2024-09-21T09:03:22.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.812+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94054548721328] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc04b110 con 0x7fd0e407d060 2024-09-21T09:03:22.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.812+0000 7fd0f6213800 20 remove_watcher() i=3 2024-09-21T09:03:22.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.812+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94054548726352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f73650 con 0x558ac7f64c10 2024-09-21T09:03:22.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.813+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94054548726352] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc04b110 con 0x558ac7f64c10 2024-09-21T09:03:22.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.813+0000 7fd0f6213800 20 remove_watcher() i=4 2024-09-21T09:03:22.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.813+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94054548723632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f71ad0 con 0x558ac7f694d0 2024-09-21T09:03:22.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.814+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94054548723632] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.814+0000 7fd0f6213800 20 remove_watcher() i=5 2024-09-21T09:03:22.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.814+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94054548728992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f74eb0 con 0x558ac7f694d0 2024-09-21T09:03:22.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.815+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94054548728992] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.815+0000 7fd0f6213800 20 remove_watcher() i=6 2024-09-21T09:03:22.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.815+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94054548732768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558ac7f724d0 con 0x558ac7f694d0 2024-09-21T09:03:22.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f206f640 1 -- 172.21.15.178:0/1048405743 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94054548732768] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0ec02a070 con 0x558ac7f694d0 2024-09-21T09:03:22.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 20 remove_watcher() i=7 2024-09-21T09:03:22.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558ac7f694d0 msgr2=0x558ac7f6b8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558ac7f694d0 0x558ac7f6b8e0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558ac7f64c10 msgr2=0x558ac7f670d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558ac7f64c10 0x558ac7f670d0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd0e407d060 msgr2=0x7fd0e408e360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd0e407d060 0x7fd0e408e360 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558ac7f6e0f0 msgr2=0x558ac7f705b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558ac7f6e0f0 0x558ac7f705b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfbc036b90 msgr2=0x7fcfbc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfbc036b90 0x7fcfbc039050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd0e407c730 tx=0x7fd0e408a000 comp rx=0 tx=0).stop 2024-09-21T09:03:22.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f51c70 msgr2=0x558ac7f58f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 --2- 172.21.15.178:0/1048405743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f51c70 0x558ac7f58f40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec013bf0 tx=0x7fd0ec04cb20 comp rx=0 tx=0).stop 2024-09-21T09:03:22.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 reap_dead start 2024-09-21T09:03:22.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f106d640 1 -- 172.21.15.178:0/1048405743 reap_dead start 2024-09-21T09:03:22.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 shutdown_connections 2024-09-21T09:03:22.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 >> 172.21.15.178:0/1048405743 conn(0x558ac7f4e020 msgr2=0x558ac7f4c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 shutdown_connections 2024-09-21T09:03:22.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.816+0000 7fd0f6213800 1 -- 172.21.15.178:0/1048405743 wait complete. 2024-09-21T09:03:22.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 -- 172.21.15.178:0/3444666403 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfcc036b90 msgr2=0x7fcfcc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 --2- 172.21.15.178:0/3444666403 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfcc036b90 0x7fcfcc039050 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x558ac7e31500 tx=0x7fd0e4054f70 comp rx=0 tx=0).stop 2024-09-21T09:03:22.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 -- 172.21.15.178:0/3444666403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f45060 msgr2=0x558ac7f45480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 --2- 172.21.15.178:0/3444666403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f45060 0x558ac7f45480 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x558ac7e319d0 tx=0x7fd0ec018830 comp rx=0 tx=0).stop 2024-09-21T09:03:22.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 -- 172.21.15.178:0/3444666403 shutdown_connections 2024-09-21T09:03:22.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 --2- 172.21.15.178:0/3444666403 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfcc036b90 0x7fcfcc039050 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 --2- 172.21.15.178:0/3444666403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7f45060 0x558ac7f45480 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 -- 172.21.15.178:0/3444666403 >> 172.21.15.178:0/3444666403 conn(0x558ac7f39ff0 msgr2=0x558ac7f3cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 -- 172.21.15.178:0/3444666403 shutdown_connections 2024-09-21T09:03:22.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 -- 172.21.15.178:0/3444666403 wait complete. 2024-09-21T09:03:22.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558ac7f33b00 msgr2=0x558ac7f35f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558ac7f33b00 0x558ac7f35f50 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558ac7e302c0 msgr2=0x558ac7f31340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558ac7e302c0 0x558ac7f31340 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfd8036b90 msgr2=0x7fcfd8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfd8036b90 0x7fcfd8039050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc000c00 tx=0x7fd0dc0013b0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 msgr2=0x558ac7e32340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7e32340 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4045f50 tx=0x7fd0e4002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 shutdown_connections 2024-09-21T09:03:22.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558ac7f33b00 0x558ac7f35f50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558ac7e302c0 0x558ac7f31340 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcfd8036b90 0x7fcfd8039050 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 --2- 172.21.15.178:0/137926034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ac7e2f980 0x558ac7e32340 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 >> 172.21.15.178:0/137926034 conn(0x558ac7e2b5b0 msgr2=0x558ac7f1a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 shutdown_connections 2024-09-21T09:03:22.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.817+0000 7fd0f6213800 1 -- 172.21.15.178:0/137926034 wait complete. 2024-09-21T09:03:22.840 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-21T09:03:22.840 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-21T09:03:22.840 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-21T09:03:22.840 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-21T09:03:22.918 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:22.918 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:22.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.917+0000 7f91b8b24800 1 Processor -- start 2024-09-21T09:03:22.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.917+0000 7f91b8b24800 1 -- start start 2024-09-21T09:03:22.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.917+0000 7f91b8b24800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5568a6af4900 0x5568a6af6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.917+0000 7f91b8b24800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5568a69b0b30 con 0x5568a6af04c0 2024-09-21T09:03:22.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.917+0000 7f91b8b24800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5568a6992360 con 0x5568a6af4900 2024-09-21T09:03:22.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.917+0000 7f91affff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5568a6af4900 0x5568a6af6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.917+0000 7f91b48e0640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5568a6af04c0 0x5568a6af08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46926/0 (socket says 172.21.15.178:46926) 2024-09-21T09:03:22.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.917+0000 7f91b48e0640 1 -- 172.21.15.178:0/1658985393 learned_addr learned my addr 172.21.15.178:0/1658985393 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:22.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.917+0000 7f91affff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5568a6af4900 0x5568a6af6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44286/0 (socket says 172.21.15.178:44286) 2024-09-21T09:03:22.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.918+0000 7f91affff640 1 -- 172.21.15.178:0/1658985393 >> v1:172.21.15.44:6789/0 conn(0x5568a6af04c0 legacy=0x5568a6af08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.918+0000 7f91affff640 1 -- 172.21.15.178:0/1658985393 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568a69b8e00 con 0x5568a6af4900 2024-09-21T09:03:22.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.919+0000 7f91affff640 1 --2- 172.21.15.178:0/1658985393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af4900 0x5568a6af6cf0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f91a000a470 tx=0x7f91a0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4168aa49f7661f6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.919+0000 7f91af7fe640 1 -- 172.21.15.178:0/1658985393 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91a0053570 con 0x5568a6af4900 2024-09-21T09:03:22.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.919+0000 7f91af7fe640 1 -- 172.21.15.178:0/1658985393 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a0058070 con 0x5568a6af4900 2024-09-21T09:03:22.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.920+0000 7f91af7fe640 1 -- 172.21.15.178:0/1658985393 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91a0053880 con 0x5568a6af4900 2024-09-21T09:03:22.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.920+0000 7f91b8b24800 1 -- 172.21.15.178:0/1658985393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af4900 msgr2=0x5568a6af6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.920+0000 7f91b8b24800 1 --2- 172.21.15.178:0/1658985393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af4900 0x5568a6af6cf0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f91a000a470 tx=0x7f91a0045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:22.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.920+0000 7f91b8b24800 1 -- 172.21.15.178:0/1658985393 shutdown_connections 2024-09-21T09:03:22.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.920+0000 7f91b8b24800 1 --2- 172.21.15.178:0/1658985393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af4900 0x5568a6af6cf0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.920+0000 7f91b8b24800 1 -- 172.21.15.178:0/1658985393 >> 172.21.15.178:0/1658985393 conn(0x5568a6aebdf0 msgr2=0x5568a6aee210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.920+0000 7f91b8b24800 1 -- 172.21.15.178:0/1658985393 shutdown_connections 2024-09-21T09:03:22.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.920+0000 7f91b8b24800 1 -- 172.21.15.178:0/1658985393 wait complete. 2024-09-21T09:03:22.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.934+0000 7f91b8b24800 1 Processor -- start 2024-09-21T09:03:22.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.934+0000 7f91b8b24800 1 -- start start 2024-09-21T09:03:22.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.934+0000 7f91b8b24800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af04c0 0x5568a6bdf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.934+0000 7f91b8b24800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5568a6a3d330 con 0x5568a6af04c0 2024-09-21T09:03:22.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.934+0000 7f91b48e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af04c0 0x5568a6bdf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.934+0000 7f91b48e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af04c0 0x5568a6bdf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44296/0 (socket says 172.21.15.178:44296) 2024-09-21T09:03:22.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.934+0000 7f91b48e0640 1 -- 172.21.15.178:0/178155851 learned_addr learned my addr 172.21.15.178:0/178155851 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.934+0000 7f91b48e0640 1 -- 172.21.15.178:0/178155851 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568a698abc0 con 0x5568a6af04c0 2024-09-21T09:03:22.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.935+0000 7f91b48e0640 1 --2- 172.21.15.178:0/178155851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af04c0 0x5568a6bdf750 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f91a8001d80 tx=0x7f91a8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956dc31fdc962c12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.935+0000 7f90a2e05640 1 -- 172.21.15.178:0/178155851 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91a800b240 con 0x5568a6af04c0 2024-09-21T09:03:22.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.935+0000 7f90a2e05640 1 -- 172.21.15.178:0/178155851 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a8009460 con 0x5568a6af04c0 2024-09-21T09:03:22.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.935+0000 7f90a2e05640 1 -- 172.21.15.178:0/178155851 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91a8009800 con 0x5568a6af04c0 2024-09-21T09:03:22.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.935+0000 7f91b8b24800 1 -- 172.21.15.178:0/178155851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af04c0 msgr2=0x5568a6bdf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.935+0000 7f91b8b24800 1 --2- 172.21.15.178:0/178155851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af04c0 0x5568a6bdf750 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f91a8001d80 tx=0x7f91a8001e70 comp rx=0 tx=0).stop 2024-09-21T09:03:22.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.936+0000 7f91b8b24800 1 -- 172.21.15.178:0/178155851 shutdown_connections 2024-09-21T09:03:22.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.936+0000 7f91b8b24800 1 --2- 172.21.15.178:0/178155851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af04c0 0x5568a6bdf750 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.936+0000 7f91b8b24800 1 -- 172.21.15.178:0/178155851 >> 172.21.15.178:0/178155851 conn(0x5568a6aebdf0 msgr2=0x5568a6bdb110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.936+0000 7f91b8b24800 1 -- 172.21.15.178:0/178155851 shutdown_connections 2024-09-21T09:03:22.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.936+0000 7f91b8b24800 1 -- 172.21.15.178:0/178155851 wait complete. 2024-09-21T09:03:22.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.936+0000 7f91b8b24800 1 Processor -- start 2024-09-21T09:03:22.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.936+0000 7f91b8b24800 1 -- start start 2024-09-21T09:03:22.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.936+0000 7f91b8b24800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af04c0 0x5568a6bea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.936+0000 7f91b8b24800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5568a6af7530 con 0x5568a6af04c0 2024-09-21T09:03:22.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.936+0000 7f91b48e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af04c0 0x5568a6bea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.936+0000 7f91b48e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af04c0 0x5568a6bea4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44308/0 (socket says 172.21.15.178:44308) 2024-09-21T09:03:22.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.936+0000 7f91b48e0640 1 -- 172.21.15.178:0/2948314982 learned_addr learned my addr 172.21.15.178:0/2948314982 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.937+0000 7f91b48e0640 1 -- 172.21.15.178:0/2948314982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568a699efe0 con 0x5568a6af04c0 2024-09-21T09:03:22.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.937+0000 7f91b48e0640 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af04c0 0x5568a6bea4c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f91a8001ed0 tx=0x7f91a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.937+0000 7f90a1602640 1 -- 172.21.15.178:0/2948314982 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91a8016640 con 0x5568a6af04c0 2024-09-21T09:03:22.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.937+0000 7f90a1602640 1 -- 172.21.15.178:0/2948314982 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a801c070 con 0x5568a6af04c0 2024-09-21T09:03:22.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.937+0000 7f90a1602640 1 -- 172.21.15.178:0/2948314982 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91a8016990 con 0x5568a6af04c0 2024-09-21T09:03:22.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.937+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568a6beaa00 con 0x5568a6af04c0 2024-09-21T09:03:22.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.937+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568a6beaec0 con 0x5568a6af04c0 2024-09-21T09:03:22.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.938+0000 7f90a1602640 1 -- 172.21.15.178:0/2948314982 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f91a801e030 con 0x5568a6af04c0 2024-09-21T09:03:22.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.938+0000 7f90a1602640 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f909c036b40 0x7f909c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.938+0000 7f90a1602640 1 -- 172.21.15.178:0/2948314982 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f91a8011030 con 0x5568a6af04c0 2024-09-21T09:03:22.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.938+0000 7f91affff640 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f909c036b40 0x7f909c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.938+0000 7f91b8b24800 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5568a6af4900 0x5568a6bf1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.938+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6bf1b00 con 0x5568a6af4900 2024-09-21T09:03:22.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.938+0000 7f91b50e1640 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5568a6af4900 0x5568a6bf1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.938+0000 7f91affff640 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f909c036b40 0x7f909c039000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f91a0057000 tx=0x7f91a0052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.939+0000 7f91b50e1640 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5568a6af4900 0x5568a6bf1530 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.939+0000 7f91b50e1640 1 -- 172.21.15.178:0/2948314982 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91b000a4a0 con 0x5568a6af4900 2024-09-21T09:03:22.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.939+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6beeb00 con 0x5568a6af4900 2024-09-21T09:03:22.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.939+0000 7f91b50e1640 1 -- 172.21.15.178:0/2948314982 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f91b000a4a0 con 0x5568a6af4900 2024-09-21T09:03:22.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.939+0000 7f91b8b24800 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5568a6bf3e10 0x5568a6bf6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.939+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6bf68a0 con 0x5568a6bf3e10 2024-09-21T09:03:22.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.939+0000 7f91b48e0640 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5568a6bf3e10 0x5568a6bf6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.948 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.940+0000 7f91b48e0640 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5568a6bf3e10 0x5568a6bf6200 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.948 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.940+0000 7f91b48e0640 1 -- 172.21.15.178:0/2948314982 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6bf3e10 2024-09-21T09:03:22.948 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.940+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6bf2cb0 con 0x5568a6af4900 2024-09-21T09:03:22.948 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.940+0000 7f91b50e1640 1 -- 172.21.15.178:0/2948314982 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f91b000a4a0 con 0x5568a6af4900 2024-09-21T09:03:22.948 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.940+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6bf3190 con 0x5568a6af4900 2024-09-21T09:03:22.948 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.941+0000 7f91b50e1640 1 -- 172.21.15.178:0/2948314982 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f91b000a4a0 con 0x5568a6af4900 2024-09-21T09:03:22.948 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.941+0000 7f91b8b24800 1 Processor -- start 2024-09-21T09:03:22.948 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.941+0000 7f91b8b24800 1 -- start start 2024-09-21T09:03:22.948 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.941+0000 7f91b8b24800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c05260 0x5568a6c05680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.948 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.941+0000 7f91b8b24800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5568a698c580 con 0x5568a6c05260 2024-09-21T09:03:22.948 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.941+0000 7f91b50e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c05260 0x5568a6c05680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.948 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.941+0000 7f91b50e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c05260 0x5568a6c05680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44318/0 (socket says 172.21.15.178:44318) 2024-09-21T09:03:22.948 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.941+0000 7f91b50e1640 1 -- 172.21.15.178:0/704544460 learned_addr learned my addr 172.21.15.178:0/704544460 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.942+0000 7f91b50e1640 1 -- 172.21.15.178:0/704544460 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568a6c05bc0 con 0x5568a6c05260 2024-09-21T09:03:22.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.942+0000 7f91b50e1640 1 --2- 172.21.15.178:0/704544460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c05260 0x5568a6c05680 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x5568a6beb570 tx=0x7f91b00188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.942+0000 7f909a7fc640 1 -- 172.21.15.178:0/704544460 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b0014450 con 0x5568a6c05260 2024-09-21T09:03:22.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.942+0000 7f909a7fc640 1 -- 172.21.15.178:0/704544460 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b00145f0 con 0x5568a6c05260 2024-09-21T09:03:22.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.942+0000 7f91b8b24800 1 -- 172.21.15.178:0/704544460 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568a6c05e50 con 0x5568a6c05260 2024-09-21T09:03:22.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.942+0000 7f909a7fc640 1 -- 172.21.15.178:0/704544460 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b00148d0 con 0x5568a6c05260 2024-09-21T09:03:22.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.942+0000 7f91b8b24800 1 -- 172.21.15.178:0/704544460 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568a6c08b30 con 0x5568a6c05260 2024-09-21T09:03:22.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.943+0000 7f909a7fc640 1 -- 172.21.15.178:0/704544460 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f91b0011040 con 0x5568a6c05260 2024-09-21T09:03:22.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.943+0000 7f909a7fc640 1 --2- 172.21.15.178:0/704544460 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f908c036b90 0x7f908c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.943+0000 7f909a7fc640 1 -- 172.21.15.178:0/704544460 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f91b001e070 con 0x5568a6c05260 2024-09-21T09:03:22.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.943+0000 7f91b48e0640 1 --2- 172.21.15.178:0/704544460 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f908c036b90 0x7f908c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.943+0000 7f91b8b24800 1 Processor -- start 2024-09-21T09:03:22.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.943+0000 7f91b48e0640 1 --2- 172.21.15.178:0/704544460 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f908c036b90 0x7f908c039050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5568a6bf1f30 tx=0x7f91a8001500 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.944+0000 7f91b8b24800 1 -- start start 2024-09-21T09:03:22.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.944+0000 7f91b8b24800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c11f00 0x5568a6c12300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.944+0000 7f91b8b24800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5568a6bdff00 con 0x5568a6c11f00 2024-09-21T09:03:22.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.944+0000 7f91b50e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c11f00 0x5568a6c12300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.944+0000 7f91b50e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c11f00 0x5568a6c12300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44322/0 (socket says 172.21.15.178:44322) 2024-09-21T09:03:22.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.944+0000 7f91b50e1640 1 -- 172.21.15.178:0/3075646992 learned_addr learned my addr 172.21.15.178:0/3075646992 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.944+0000 7f91b50e1640 1 -- 172.21.15.178:0/3075646992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568a6c128d0 con 0x5568a6c11f00 2024-09-21T09:03:22.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.944+0000 7f91b50e1640 1 --2- 172.21.15.178:0/3075646992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c11f00 0x5568a6c12300 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f91b004cbb0 tx=0x7f91b0011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744c981fcffe18ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.944+0000 7f908bfff640 1 -- 172.21.15.178:0/3075646992 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b0013dc0 con 0x5568a6c11f00 2024-09-21T09:03:22.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.944+0000 7f908bfff640 1 -- 172.21.15.178:0/3075646992 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b004e0d0 con 0x5568a6c11f00 2024-09-21T09:03:22.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.944+0000 7f908bfff640 1 -- 172.21.15.178:0/3075646992 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b004e3b0 con 0x5568a6c11f00 2024-09-21T09:03:22.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.945+0000 7f91b8b24800 1 -- 172.21.15.178:0/3075646992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c11f00 msgr2=0x5568a6c12300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:22.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.945+0000 7f91b8b24800 1 --2- 172.21.15.178:0/3075646992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c11f00 0x5568a6c12300 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f91b004cbb0 tx=0x7f91b0011970 comp rx=0 tx=0).stop 2024-09-21T09:03:22.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.945+0000 7f91b8b24800 1 -- 172.21.15.178:0/3075646992 shutdown_connections 2024-09-21T09:03:22.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.945+0000 7f91b8b24800 1 --2- 172.21.15.178:0/3075646992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c11f00 0x5568a6c12300 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:22.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.945+0000 7f91b8b24800 1 -- 172.21.15.178:0/3075646992 >> 172.21.15.178:0/3075646992 conn(0x5568a6c0e210 msgr2=0x5568a6c0c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:22.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.945+0000 7f91b8b24800 1 -- 172.21.15.178:0/3075646992 shutdown_connections 2024-09-21T09:03:22.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.945+0000 7f91b8b24800 1 -- 172.21.15.178:0/3075646992 wait complete. 2024-09-21T09:03:22.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.945+0000 7f91b8b24800 1 Processor -- start 2024-09-21T09:03:22.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.945+0000 7f91b8b24800 1 -- start start 2024-09-21T09:03:22.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.945+0000 7f91b8b24800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c11f00 0x5568a6c19300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.945+0000 7f91b8b24800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5568a6c12ee0 con 0x5568a6c11f00 2024-09-21T09:03:22.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.946+0000 7f91b50e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c11f00 0x5568a6c19300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.946+0000 7f91b50e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c11f00 0x5568a6c19300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44324/0 (socket says 172.21.15.178:44324) 2024-09-21T09:03:22.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.946+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 learned_addr learned my addr 172.21.15.178:0/78783106 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:22.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.946+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568a6c19840 con 0x5568a6c11f00 2024-09-21T09:03:22.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.946+0000 7f91b50e1640 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c11f00 0x5568a6c19300 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f91b0011be0 tx=0x7f91b004cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.946+0000 7f908a7fc640 1 -- 172.21.15.178:0/78783106 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b0044030 con 0x5568a6c11f00 2024-09-21T09:03:22.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.946+0000 7f908a7fc640 1 -- 172.21.15.178:0/78783106 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b002ba60 con 0x5568a6c11f00 2024-09-21T09:03:22.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.946+0000 7f908a7fc640 1 -- 172.21.15.178:0/78783106 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b002bd40 con 0x5568a6c11f00 2024-09-21T09:03:22.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.946+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568a6c19ad0 con 0x5568a6c11f00 2024-09-21T09:03:22.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.946+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568a6c1c780 con 0x5568a6c11f00 2024-09-21T09:03:22.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.947+0000 7f908a7fc640 1 -- 172.21.15.178:0/78783106 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f91b0022a80 con 0x5568a6c11f00 2024-09-21T09:03:22.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.947+0000 7f908a7fc640 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9080036b90 0x7f9080039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.947+0000 7f908a7fc640 1 -- 172.21.15.178:0/78783106 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f91b0045070 con 0x5568a6c11f00 2024-09-21T09:03:22.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.947+0000 7f91b48e0640 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9080036b90 0x7f9080039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.948+0000 7f91b48e0640 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9080036b90 0x7f9080039050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f91a8013ff0 tx=0x7f91a8033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.948+0000 7f91b8b24800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.948+0000 7f91b8b24800 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5568a6c25040 0x5568a6c27500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.948+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c27c50 con 0x5568a6c25040 2024-09-21T09:03:22.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.948+0000 7f91affff640 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5568a6c25040 0x5568a6c27500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.948+0000 7f91affff640 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5568a6c25040 0x5568a6c27500 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 20 realm 2024-09-21T09:03:22.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c28080 con 0x5568a6c25040 2024-09-21T09:03:22.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:22.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c28950 con 0x5568a6c25040 2024-09-21T09:03:22.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c28cf0 con 0x5568a6c25040 2024-09-21T09:03:22.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:22.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5568a6c29a50 0x5568a6c2be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.949+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c2c450 con 0x5568a6c29a50 2024-09-21T09:03:22.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.950+0000 7f91b50e1640 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5568a6c29a50 0x5568a6c2be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.950+0000 7f91b50e1640 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5568a6c29a50 0x5568a6c2be40 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.950+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.950+0000 7f91b8b24800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:22.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.950+0000 7f91b8b24800 20 searching for the correct realm 2024-09-21T09:03:22.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.950+0000 7f91b8b24800 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5568a6c2e3e0 0x5568a6c308a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.950+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c2e3e0 2024-09-21T09:03:22.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.950+0000 7f91b48e0640 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5568a6c2e3e0 0x5568a6c308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.951+0000 7f91b48e0640 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5568a6c2e3e0 0x5568a6c308a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.951+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6c2e3e0 2024-09-21T09:03:22.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.951+0000 7f91b48e0640 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f91a803e180 0x7f91a8013350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:22.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.951+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x7f91a803e180 2024-09-21T09:03:22.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.951+0000 7f91affff640 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f91a803e180 0x7f91a8013350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:22.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.951+0000 7f91affff640 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f91a803e180 0x7f91a8013350 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:22.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.952+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a0051070 con 0x7f91a803e180 2024-09-21T09:03:22.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.952+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c29a50 2024-09-21T09:03:22.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.952+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.952+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c25040 2024-09-21T09:03:22.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.952+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.952+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c25040 2024-09-21T09:03:22.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.952+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.952+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c29a50 2024-09-21T09:03:22.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.953+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.953+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c29a50 2024-09-21T09:03:22.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.953+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.953+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x7f91a803e180 2024-09-21T09:03:22.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.953+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a0051070 con 0x7f91a803e180 2024-09-21T09:03:22.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.953+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c2e3e0 2024-09-21T09:03:22.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.953+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6c2e3e0 2024-09-21T09:03:22.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.953+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c25040 2024-09-21T09:03:22.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.954+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.954+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c29a50 2024-09-21T09:03:22.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.954+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.954+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c25040 2024-09-21T09:03:22.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.954+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.954+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x7f91a803e180 2024-09-21T09:03:22.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.954+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f91a0051070 con 0x7f91a803e180 2024-09-21T09:03:22.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.954+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c2e3e0 2024-09-21T09:03:22.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.955+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6c2e3e0 2024-09-21T09:03:22.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.955+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c2e3e0 2024-09-21T09:03:22.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.955+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6c2e3e0 2024-09-21T09:03:22.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.955+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c29a50 2024-09-21T09:03:22.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.955+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.955+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c2e3e0 2024-09-21T09:03:22.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.955+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6c2e3e0 2024-09-21T09:03:22.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.955+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c2e3e0 2024-09-21T09:03:22.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.956+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6c2e3e0 2024-09-21T09:03:22.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.956+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c25040 2024-09-21T09:03:22.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.956+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.956+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c25040 2024-09-21T09:03:22.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.956+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.956+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c29a50 2024-09-21T09:03:22.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.956+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.956+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c2e3e0 2024-09-21T09:03:22.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.957+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6c2e3e0 2024-09-21T09:03:22.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.957+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x7f91a803e180 2024-09-21T09:03:22.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.957+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a0051070 con 0x7f91a803e180 2024-09-21T09:03:22.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.957+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c25040 2024-09-21T09:03:22.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.957+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.957+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c29a50 2024-09-21T09:03:22.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.958+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.958+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c2e3e0 2024-09-21T09:03:22.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.958+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6c2e3e0 2024-09-21T09:03:22.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.958+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c29a50 2024-09-21T09:03:22.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.958+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.958+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x7f91a803e180 2024-09-21T09:03:22.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.958+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a0051070 con 0x7f91a803e180 2024-09-21T09:03:22.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.958+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c2e3e0 2024-09-21T09:03:22.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6c2e3e0 2024-09-21T09:03:22.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c29a50 2024-09-21T09:03:22.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x5568a6c25040 2024-09-21T09:03:22.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c30f70 con 0x7f91a803e180 2024-09-21T09:03:22.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91a0051070 con 0x7f91a803e180 2024-09-21T09:03:22.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91b8b24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:22.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91b8b24800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:22.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91b8b24800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:22.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91b8b24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:22.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91b8b24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:22.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91b8b24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:22.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91b8b24800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c2d930 con 0x5568a6c25040 2024-09-21T09:03:22.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.959+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c2c8e0 con 0x5568a6c25040 2024-09-21T09:03:22.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:22.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c2d2e0 con 0x5568a6c25040 2024-09-21T09:03:22.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:22.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 20 zone default found 2024-09-21T09:03:22.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 4 Realm: () 2024-09-21T09:03:22.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:22.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:22.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:22.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 20 zonegroup default 2024-09-21T09:03:22.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c318a0 con 0x5568a6c29a50 2024-09-21T09:03:22.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.960+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c33b40 con 0x5568a6c2e3e0 2024-09-21T09:03:22.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.961+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6c2e3e0 2024-09-21T09:03:22.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.961+0000 7f91b8b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.961+0000 7f91b8b24800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.961+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c33ee0 con 0x5568a6c2e3e0 2024-09-21T09:03:22.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.961+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6c2e3e0 2024-09-21T09:03:22.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.961+0000 7f91b8b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:22.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.961+0000 7f91b8b24800 20 started sync module instance, tier type = 2024-09-21T09:03:22.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.961+0000 7f91b8b24800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:22.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.961+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c32fd0 con 0x7f91a803e180 2024-09-21T09:03:22.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.962+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x7f91a803e180 2024-09-21T09:03:22.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.962+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93907962770688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c32fd0 con 0x7f91a803e180 2024-09-21T09:03:22.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.962+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c348f0 con 0x5568a6c25040 2024-09-21T09:03:22.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.963+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93907962770688] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x7f91a803e180 2024-09-21T09:03:22.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.963+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.963+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93907962775072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c32fd0 con 0x5568a6c25040 2024-09-21T09:03:22.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.964+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c35360 con 0x5568a6c2e3e0 2024-09-21T09:03:22.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.965+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6c2e3e0 2024-09-21T09:03:22.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.965+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93907962777168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c35c00 con 0x5568a6c2e3e0 2024-09-21T09:03:22.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.965+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c36680 con 0x7f91a803e180 2024-09-21T09:03:22.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.965+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93907962775072] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.966+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93907962777168] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6c2e3e0 2024-09-21T09:03:22.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.966+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x7f91a803e180 2024-09-21T09:03:22.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.966+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93907962779472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c32b20 con 0x7f91a803e180 2024-09-21T09:03:22.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.966+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c36f50 con 0x5568a6c25040 2024-09-21T09:03:22.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.967+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93907962779472] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x7f91a803e180 2024-09-21T09:03:22.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.967+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.967+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93907962782096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c36ea0 con 0x5568a6c25040 2024-09-21T09:03:22.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.967+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c37960 con 0x5568a6c29a50 2024-09-21T09:03:22.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.968+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.968+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93907962786992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c381b0 con 0x5568a6c29a50 2024-09-21T09:03:22.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.968+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c38c50 con 0x5568a6c29a50 2024-09-21T09:03:22.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.968+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93907962782096] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.969+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93907962786992] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.969+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.969+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93907962791712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c37d60 con 0x5568a6c29a50 2024-09-21T09:03:22.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.969+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c392e0 con 0x5568a6c29a50 2024-09-21T09:03:22.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.970+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93907962791712] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.970+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(58 notify.7 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.970+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93907962784240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c392e0 con 0x5568a6c29a50 2024-09-21T09:03:22.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.970+0000 7f91b8b24800 20 add_watcher() i=0 2024-09-21T09:03:22.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.970+0000 7f91b8b24800 20 add_watcher() i=1 2024-09-21T09:03:22.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.970+0000 7f91b8b24800 20 add_watcher() i=2 2024-09-21T09:03:22.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.970+0000 7f91b8b24800 20 add_watcher() i=3 2024-09-21T09:03:22.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.970+0000 7f91b8b24800 20 add_watcher() i=4 2024-09-21T09:03:22.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.970+0000 7f91b8b24800 20 add_watcher() i=5 2024-09-21T09:03:22.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.970+0000 7f91b8b24800 20 add_watcher() i=6 2024-09-21T09:03:22.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.971+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93907962784240] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.971+0000 7f91b8b24800 20 add_watcher() i=7 2024-09-21T09:03:22.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.971+0000 7f91b8b24800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:22.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.971+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c3c510 con 0x5568a6c25040 2024-09-21T09:03:22.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.971+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.971+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93907962793888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c39870 con 0x5568a6c25040 2024-09-21T09:03:22.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.972+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93907962793888] v29'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.972+0000 7f906afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:22.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.972+0000 7f91b8b24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:22.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.972+0000 7f91b8b24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:22.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.973+0000 7f91b8b24800 5 note: GC not initialized 2024-09-21T09:03:22.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.973+0000 7f9069fe3640 20 reqs_thread_entry: start 2024-09-21T09:03:22.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.973+0000 7f91b8b24800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:22.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.973+0000 7f91b8b24800 20 Filter name: none 2024-09-21T09:03:22.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.973+0000 7f8fdb7fe640 20 reqs_thread_entry: start 2024-09-21T09:03:22.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.973+0000 7f91b8b24800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:22.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.973+0000 7f91b8b24800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.973+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c6f960 con 0x5568a6c25040 2024-09-21T09:03:22.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.973+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.973+0000 7f91b8b24800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:22.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.973+0000 7f91b8b24800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:22.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.973+0000 7f91b8b24800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:22.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.973+0000 7f91b8b24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:22.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.973+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c723f0 con 0x7f91a803e180 2024-09-21T09:03:22.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f91a0051070 con 0x7f91a803e180 2024-09-21T09:03:22.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 20 disabling bucket name=myfoo 2024-09-21T09:03:22.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T09:03:22.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c703d0 con 0x7f91a803e180 2024-09-21T09:03:22.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f91a0051070 con 0x7f91a803e180 2024-09-21T09:03:22.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:22.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-21T09:03:22.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:22.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 : miss 2024-09-21T09:03:22.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 20 rados->read ofs=0 len=0 2024-09-21T09:03:22.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:65 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c72c60 con 0x5568a6c29a50 2024-09-21T09:03:22.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(65 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:22.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:22.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:22.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:22.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:22.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 2024-09-21T09:03:22.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.974+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:66 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c7a450 con 0x5568a6c29a50 2024-09-21T09:03:22.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(66 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v29'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b8b24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:22.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b8b24800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:22.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b8b24800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:22.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b8b24800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1, ofs0, ns] 2024-09-21T09:03:22.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 93907963028672 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c75b00 con 0x5568a6c29a50 2024-09-21T09:03:22.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== watch-notify(notify (1) cookie 93907962786992 notify 124554051599 ret 0) ==== 794+0+0 (crc 0 0 0) 0x5568a6c72180 con 0x5568a6c29a50 2024-09-21T09:03:22.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f908bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051599 cookie 93907962786992 notifier 4595 bl.length()=752 2024-09-21T09:03:22.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f908bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:22.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f908bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:22.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f908bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:22.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f908bfff640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9078003ea0 con 0x5568a6c29a50 2024-09-21T09:03:22.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(67 notify.5 [notify cookie 93907963028672 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:22.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== watch-notify(notify_complete (2) cookie 93907963028672 notify 124554051599 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5568a6c19ad0 con 0x5568a6c29a50 2024-09-21T09:03:22.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b8b24800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): orig_sources= new_sources= 2024-09-21T09:03:22.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b8b24800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): potential sources added=[] removed=[] 2024-09-21T09:03:22.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b8b24800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): orig_dests= new_dests= 2024-09-21T09:03:22.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b8b24800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): potential dests added=[] removed=[] 2024-09-21T09:03:22.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.976+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c75610 con 0x5568a6c25040 2024-09-21T09:03:22.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.978+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v29'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.978+0000 7f91b8b24800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:22.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.978+0000 7f91b8b24800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:22.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.978+0000 7f91b8b24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:22.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.978+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93907963010912 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c75610 con 0x5568a6c25040 2024-09-21T09:03:22.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.978+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify (1) cookie 93907962782096 notify 124554051600 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5568a69b8e00 con 0x5568a6c25040 2024-09-21T09:03:22.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.978+0000 7f908b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051600 cookie 93907962782096 notifier 4595 bl.length()=567 2024-09-21T09:03:22.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.978+0000 7f908b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:22.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.978+0000 7f908b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:22.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.978+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(70 notify.4 [notify cookie 93907963010912 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.978+0000 7f908b7fe640 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8fe8003430 con 0x5568a6c25040 2024-09-21T09:03:22.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.978+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.978+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== watch-notify(notify_complete (2) cookie 93907963010912 notify 124554051600 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f91a00876b0 con 0x5568a6c25040 2024-09-21T09:03:22.994 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:22.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.979+0000 7f906afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:22.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.979+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93907962793888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c6d6b0 con 0x5568a6c25040 2024-09-21T09:03:22.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.980+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93907962793888] v29'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.980+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93907962770688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c6d6b0 con 0x7f91a803e180 2024-09-21T09:03:22.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.981+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93907962770688] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x7f91a803e180 2024-09-21T09:03:22.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.981+0000 7f91b8b24800 20 remove_watcher() i=0 2024-09-21T09:03:22.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.981+0000 7f91b8b24800 2 removed watcher, disabling cache 2024-09-21T09:03:22.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.981+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93907962775072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c6d6b0 con 0x5568a6c25040 2024-09-21T09:03:22.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.982+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93907962775072] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:22.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.982+0000 7f91b8b24800 20 remove_watcher() i=1 2024-09-21T09:03:22.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.982+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93907962777168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c6d6b0 con 0x5568a6c2e3e0 2024-09-21T09:03:22.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.983+0000 7f91b48e0640 1 -- 172.21.15.178:0/78783106 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93907962777168] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a8006030 con 0x5568a6c2e3e0 2024-09-21T09:03:22.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.983+0000 7f91b8b24800 20 remove_watcher() i=2 2024-09-21T09:03:22.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.983+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93907962779472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c38fa0 con 0x7f91a803e180 2024-09-21T09:03:23.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.984+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93907962779472] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x7f91a803e180 2024-09-21T09:03:23.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.984+0000 7f91b8b24800 20 remove_watcher() i=3 2024-09-21T09:03:23.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.984+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93907962782096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c38fa0 con 0x5568a6c25040 2024-09-21T09:03:23.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.985+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93907962782096] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91a0051070 con 0x5568a6c25040 2024-09-21T09:03:23.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.985+0000 7f91b8b24800 20 remove_watcher() i=4 2024-09-21T09:03:23.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.985+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93907962786992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c38fa0 con 0x5568a6c29a50 2024-09-21T09:03:23.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.986+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93907962786992] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:23.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.986+0000 7f91b8b24800 20 remove_watcher() i=5 2024-09-21T09:03:23.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.986+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93907962791712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c38fa0 con 0x5568a6c29a50 2024-09-21T09:03:23.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.987+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93907962791712] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:23.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.987+0000 7f91b8b24800 20 remove_watcher() i=6 2024-09-21T09:03:23.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.987+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93907962784240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5568a6c38fa0 con 0x5568a6c29a50 2024-09-21T09:03:23.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b50e1640 1 -- 172.21.15.178:0/78783106 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93907962784240] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91b002a070 con 0x5568a6c29a50 2024-09-21T09:03:23.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 20 remove_watcher() i=7 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5568a6c29a50 msgr2=0x5568a6c2be40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5568a6c29a50 0x5568a6c2be40 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5568a6c25040 msgr2=0x5568a6c27500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5568a6c25040 0x5568a6c27500 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f91a803e180 msgr2=0x7f91a8013350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f91a803e180 0x7f91a8013350 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5568a6c2e3e0 msgr2=0x5568a6c308a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5568a6c2e3e0 0x5568a6c308a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9080036b90 msgr2=0x7f9080039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9080036b90 0x7f9080039050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f91a8013ff0 tx=0x7f91a8033000 comp rx=0 tx=0).stop 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c11f00 msgr2=0x5568a6c19300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 --2- 172.21.15.178:0/78783106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c11f00 0x5568a6c19300 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f91b0011be0 tx=0x7f91b004cb10 comp rx=0 tx=0).stop 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 reap_dead start 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91affff640 1 -- 172.21.15.178:0/78783106 reap_dead start 2024-09-21T09:03:23.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 shutdown_connections 2024-09-21T09:03:23.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 >> 172.21.15.178:0/78783106 conn(0x5568a6c0e210 msgr2=0x5568a6c0c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:23.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 shutdown_connections 2024-09-21T09:03:23.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/78783106 wait complete. 2024-09-21T09:03:23.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/704544460 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f908c036b90 msgr2=0x7f908c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 --2- 172.21.15.178:0/704544460 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f908c036b90 0x7f908c039050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5568a6bf1f30 tx=0x7f91a8001500 comp rx=0 tx=0).stop 2024-09-21T09:03:23.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/704544460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c05260 msgr2=0x5568a6c05680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 --2- 172.21.15.178:0/704544460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c05260 0x5568a6c05680 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x5568a6beb570 tx=0x7f91b00188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/704544460 shutdown_connections 2024-09-21T09:03:23.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 --2- 172.21.15.178:0/704544460 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f908c036b90 0x7f908c039050 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 --2- 172.21.15.178:0/704544460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6c05260 0x5568a6c05680 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/704544460 >> 172.21.15.178:0/704544460 conn(0x5568a6bfa1f0 msgr2=0x5568a6bfcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:23.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/704544460 shutdown_connections 2024-09-21T09:03:23.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.989+0000 7f91b8b24800 1 -- 172.21.15.178:0/704544460 wait complete. 2024-09-21T09:03:23.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5568a6bf3e10 msgr2=0x5568a6bf6200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5568a6bf3e10 0x5568a6bf6200 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5568a6af4900 msgr2=0x5568a6bf1530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5568a6af4900 0x5568a6bf1530 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f909c036b40 msgr2=0x7f909c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f909c036b40 0x7f909c039000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f91a0057000 tx=0x7f91a0052000 comp rx=0 tx=0).stop 2024-09-21T09:03:23.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af04c0 msgr2=0x5568a6bea4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af04c0 0x5568a6bea4c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f91a8001ed0 tx=0x7f91a8000bc0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 shutdown_connections 2024-09-21T09:03:23.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5568a6bf3e10 0x5568a6bf6200 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5568a6af4900 0x5568a6bf1530 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f909c036b40 0x7f909c039000 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 --2- 172.21.15.178:0/2948314982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568a6af04c0 0x5568a6bea4c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 >> 172.21.15.178:0/2948314982 conn(0x5568a6aebdf0 msgr2=0x5568a6bd9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:23.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 shutdown_connections 2024-09-21T09:03:23.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:22.990+0000 7f91b8b24800 1 -- 172.21.15.178:0/2948314982 wait complete. 2024-09-21T09:03:23.004 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:23.006 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-21T09:03:23.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-21T09:03:23.006 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-21T09:03:23.050 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:23.051 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:23.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.049+0000 7fda9c415800 1 Processor -- start 2024-09-21T09:03:23.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.050+0000 7fda9c415800 1 -- start start 2024-09-21T09:03:23.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.050+0000 7fda9c415800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x564062022a60 0x564062024e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.050+0000 7fda9c415800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564061eddb30 con 0x56406201e760 2024-09-21T09:03:23.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.050+0000 7fda9c415800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x564061ebf360 con 0x564062022a60 2024-09-21T09:03:23.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.050+0000 7fda8ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x564062022a60 0x564062024e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.050+0000 7fda97c3b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x56406201e760 0x56406201eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:46934/0 (socket says 172.21.15.178:46934) 2024-09-21T09:03:23.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.050+0000 7fda97c3b640 1 -- 172.21.15.178:0/3468463516 learned_addr learned my addr 172.21.15.178:0/3468463516 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:23.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.050+0000 7fda8ffff640 1 -- 172.21.15.178:0/3468463516 >> v1:172.21.15.44:6789/0 conn(0x56406201e760 legacy=0x56406201eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.050+0000 7fda8ffff640 1 -- 172.21.15.178:0/3468463516 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564061ee5e00 con 0x564062022a60 2024-09-21T09:03:23.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.052+0000 7fda8ffff640 1 --2- 172.21.15.178:0/3468463516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564062022a60 0x564062024e50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fda8000a470 tx=0x7fda80045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1105ba08db39c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.052+0000 7fda9743a640 1 -- 172.21.15.178:0/3468463516 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda80053570 con 0x564062022a60 2024-09-21T09:03:23.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.052+0000 7fda9743a640 1 -- 172.21.15.178:0/3468463516 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda80058070 con 0x564062022a60 2024-09-21T09:03:23.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.052+0000 7fda9743a640 1 -- 172.21.15.178:0/3468463516 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda80053880 con 0x564062022a60 2024-09-21T09:03:23.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.053+0000 7fda9c415800 1 -- 172.21.15.178:0/3468463516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564062022a60 msgr2=0x564062024e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.053+0000 7fda9c415800 1 --2- 172.21.15.178:0/3468463516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564062022a60 0x564062024e50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fda8000a470 tx=0x7fda80045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:23.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.053+0000 7fda9c415800 1 -- 172.21.15.178:0/3468463516 shutdown_connections 2024-09-21T09:03:23.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.053+0000 7fda9c415800 1 --2- 172.21.15.178:0/3468463516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564062022a60 0x564062024e50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.053+0000 7fda9c415800 1 -- 172.21.15.178:0/3468463516 >> 172.21.15.178:0/3468463516 conn(0x564062019ff0 msgr2=0x56406201c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:23.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.053+0000 7fda9c415800 1 -- 172.21.15.178:0/3468463516 shutdown_connections 2024-09-21T09:03:23.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.053+0000 7fda9c415800 1 -- 172.21.15.178:0/3468463516 wait complete. 2024-09-21T09:03:23.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.067+0000 7fda9c415800 1 Processor -- start 2024-09-21T09:03:23.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.067+0000 7fda9c415800 1 -- start start 2024-09-21T09:03:23.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.067+0000 7fda9c415800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406201e760 0x56406210d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.067+0000 7fda9c415800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564061f6a330 con 0x56406201e760 2024-09-21T09:03:23.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.067+0000 7fda97c3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406201e760 0x56406210d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.067+0000 7fda97c3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406201e760 0x56406210d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44336/0 (socket says 172.21.15.178:44336) 2024-09-21T09:03:23.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.067+0000 7fda97c3b640 1 -- 172.21.15.178:0/991351301 learned_addr learned my addr 172.21.15.178:0/991351301 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:23.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.067+0000 7fda97c3b640 1 -- 172.21.15.178:0/991351301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564061eb7bc0 con 0x56406201e760 2024-09-21T09:03:23.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.068+0000 7fda97c3b640 1 --2- 172.21.15.178:0/991351301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406201e760 0x56406210d860 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fda88001d80 tx=0x7fda88001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99c8add2251f60d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.068+0000 7fd985e0b640 1 -- 172.21.15.178:0/991351301 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda88013030 con 0x56406201e760 2024-09-21T09:03:23.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.068+0000 7fd985e0b640 1 -- 172.21.15.178:0/991351301 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8800e470 con 0x56406201e760 2024-09-21T09:03:23.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.068+0000 7fd985e0b640 1 -- 172.21.15.178:0/991351301 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8800e810 con 0x56406201e760 2024-09-21T09:03:23.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.068+0000 7fda9c415800 1 -- 172.21.15.178:0/991351301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406201e760 msgr2=0x56406210d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.068+0000 7fda9c415800 1 --2- 172.21.15.178:0/991351301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406201e760 0x56406210d860 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fda88001d80 tx=0x7fda88001e70 comp rx=0 tx=0).stop 2024-09-21T09:03:23.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.068+0000 7fda9c415800 1 -- 172.21.15.178:0/991351301 shutdown_connections 2024-09-21T09:03:23.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.069+0000 7fda9c415800 1 --2- 172.21.15.178:0/991351301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406201e760 0x56406210d860 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.069+0000 7fda9c415800 1 -- 172.21.15.178:0/991351301 >> 172.21.15.178:0/991351301 conn(0x564062019ff0 msgr2=0x564062109220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:23.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.069+0000 7fda9c415800 1 -- 172.21.15.178:0/991351301 shutdown_connections 2024-09-21T09:03:23.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.069+0000 7fda9c415800 1 -- 172.21.15.178:0/991351301 wait complete. 2024-09-21T09:03:23.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.069+0000 7fda9c415800 1 Processor -- start 2024-09-21T09:03:23.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.069+0000 7fda9c415800 1 -- start start 2024-09-21T09:03:23.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.069+0000 7fda9c415800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406201e760 0x564062115290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.069+0000 7fda9c415800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564062025690 con 0x56406201e760 2024-09-21T09:03:23.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.069+0000 7fda97c3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406201e760 0x564062115290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.069+0000 7fda97c3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406201e760 0x564062115290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44352/0 (socket says 172.21.15.178:44352) 2024-09-21T09:03:23.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.069+0000 7fda97c3b640 1 -- 172.21.15.178:0/1384090033 learned_addr learned my addr 172.21.15.178:0/1384090033 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:23.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.069+0000 7fda97c3b640 1 -- 172.21.15.178:0/1384090033 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564061ecbfe0 con 0x56406201e760 2024-09-21T09:03:23.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.070+0000 7fda97c3b640 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406201e760 0x564062115290 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fda88004000 tx=0x7fda88000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.070+0000 7fd97ffff640 1 -- 172.21.15.178:0/1384090033 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda88027070 con 0x56406201e760 2024-09-21T09:03:23.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.070+0000 7fd97ffff640 1 -- 172.21.15.178:0/1384090033 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda88019900 con 0x56406201e760 2024-09-21T09:03:23.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.070+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640621157d0 con 0x56406201e760 2024-09-21T09:03:23.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.070+0000 7fd97ffff640 1 -- 172.21.15.178:0/1384090033 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda88019c60 con 0x56406201e760 2024-09-21T09:03:23.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.070+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564062115cf0 con 0x56406201e760 2024-09-21T09:03:23.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.071+0000 7fd97ffff640 1 -- 172.21.15.178:0/1384090033 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fda8802a070 con 0x56406201e760 2024-09-21T09:03:23.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.071+0000 7fd97ffff640 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd980036b40 0x7fd980039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.071+0000 7fd97ffff640 1 -- 172.21.15.178:0/1384090033 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fda8801f070 con 0x56406201e760 2024-09-21T09:03:23.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.071+0000 7fda8ffff640 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd980036b40 0x7fd980039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.071+0000 7fda9c415800 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564062022a60 0x56406211c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.071+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56406211c8d0 con 0x564062022a60 2024-09-21T09:03:23.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.071+0000 7fda9843c640 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564062022a60 0x56406211c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.071+0000 7fda8ffff640 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd980036b40 0x7fd980039000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fda80057000 tx=0x7fda80052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.072+0000 7fda9843c640 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564062022a60 0x56406211c300 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.072+0000 7fda9843c640 1 -- 172.21.15.178:0/1384090033 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda9000a4a0 con 0x564062022a60 2024-09-21T09:03:23.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.072+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640621198d0 con 0x564062022a60 2024-09-21T09:03:23.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.072+0000 7fda9843c640 1 -- 172.21.15.178:0/1384090033 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda9000a4a0 con 0x564062022a60 2024-09-21T09:03:23.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.072+0000 7fda9c415800 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56406211ebe0 0x564062120fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.072+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564062121670 con 0x56406211ebe0 2024-09-21T09:03:23.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.072+0000 7fda97c3b640 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56406211ebe0 0x564062120fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.073+0000 7fda97c3b640 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56406211ebe0 0x564062120fd0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.073+0000 7fda97c3b640 1 -- 172.21.15.178:0/1384090033 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fda88029030 con 0x56406211ebe0 2024-09-21T09:03:23.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.073+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56406211da80 con 0x564062022a60 2024-09-21T09:03:23.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.073+0000 7fda9843c640 1 -- 172.21.15.178:0/1384090033 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda9000a4a0 con 0x564062022a60 2024-09-21T09:03:23.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.073+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56406211df60 con 0x564062022a60 2024-09-21T09:03:23.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.074+0000 7fda9843c640 1 -- 172.21.15.178:0/1384090033 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fda9000a4a0 con 0x564062022a60 2024-09-21T09:03:23.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.074+0000 7fda9c415800 1 Processor -- start 2024-09-21T09:03:23.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.074+0000 7fda9c415800 1 -- start start 2024-09-21T09:03:23.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.074+0000 7fda9c415800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564062130030 0x564062130450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.074+0000 7fda9c415800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564061eb9580 con 0x564062130030 2024-09-21T09:03:23.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.074+0000 7fda9843c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564062130030 0x564062130450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.074+0000 7fda9843c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564062130030 0x564062130450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44354/0 (socket says 172.21.15.178:44354) 2024-09-21T09:03:23.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.074+0000 7fda9843c640 1 -- 172.21.15.178:0/2239099426 learned_addr learned my addr 172.21.15.178:0/2239099426 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:23.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.075+0000 7fda9843c640 1 -- 172.21.15.178:0/2239099426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564062130990 con 0x564062130030 2024-09-21T09:03:23.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.075+0000 7fda9843c640 1 --2- 172.21.15.178:0/2239099426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564062130030 0x564062130450 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x564062116340 tx=0x7fda900188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.075+0000 7fd97d7fa640 1 -- 172.21.15.178:0/2239099426 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda90014450 con 0x564062130030 2024-09-21T09:03:23.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.075+0000 7fd97d7fa640 1 -- 172.21.15.178:0/2239099426 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda900145f0 con 0x564062130030 2024-09-21T09:03:23.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.075+0000 7fd97d7fa640 1 -- 172.21.15.178:0/2239099426 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda900148d0 con 0x564062130030 2024-09-21T09:03:23.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.075+0000 7fda9c415800 1 -- 172.21.15.178:0/2239099426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564062130c20 con 0x564062130030 2024-09-21T09:03:23.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.075+0000 7fda9c415800 1 -- 172.21.15.178:0/2239099426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564062133900 con 0x564062130030 2024-09-21T09:03:23.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.076+0000 7fd97d7fa640 1 -- 172.21.15.178:0/2239099426 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fda90011040 con 0x564062130030 2024-09-21T09:03:23.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.076+0000 7fd97d7fa640 1 --2- 172.21.15.178:0/2239099426 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd970036b90 0x7fd970039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.076+0000 7fd97d7fa640 1 -- 172.21.15.178:0/2239099426 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fda9001e070 con 0x564062130030 2024-09-21T09:03:23.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.076+0000 7fda97c3b640 1 --2- 172.21.15.178:0/2239099426 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd970036b90 0x7fd970039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.076+0000 7fda9c415800 1 Processor -- start 2024-09-21T09:03:23.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.076+0000 7fda97c3b640 1 --2- 172.21.15.178:0/2239099426 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd970036b90 0x7fd970039050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x56406211cd00 tx=0x7fda8804ad80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.076+0000 7fda9c415800 1 -- start start 2024-09-21T09:03:23.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.076+0000 7fda9c415800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406213cc90 0x56406213d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.076+0000 7fda9c415800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56406210e010 con 0x56406213cc90 2024-09-21T09:03:23.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.077+0000 7fda9843c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406213cc90 0x56406213d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.077+0000 7fda9843c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406213cc90 0x56406213d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44362/0 (socket says 172.21.15.178:44362) 2024-09-21T09:03:23.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.077+0000 7fda9843c640 1 -- 172.21.15.178:0/1927979503 learned_addr learned my addr 172.21.15.178:0/1927979503 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:23.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.077+0000 7fda9843c640 1 -- 172.21.15.178:0/1927979503 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56406213d660 con 0x56406213cc90 2024-09-21T09:03:23.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.077+0000 7fda9843c640 1 --2- 172.21.15.178:0/1927979503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406213cc90 0x56406213d090 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fda9004cbb0 tx=0x7fda90011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee0f4bdca46c9e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.077+0000 7fd976ffd640 1 -- 172.21.15.178:0/1927979503 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda90013dc0 con 0x56406213cc90 2024-09-21T09:03:23.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.077+0000 7fd976ffd640 1 -- 172.21.15.178:0/1927979503 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9004e0d0 con 0x56406213cc90 2024-09-21T09:03:23.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.077+0000 7fd976ffd640 1 -- 172.21.15.178:0/1927979503 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda9004e3b0 con 0x56406213cc90 2024-09-21T09:03:23.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9c415800 1 -- 172.21.15.178:0/1927979503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406213cc90 msgr2=0x56406213d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9c415800 1 --2- 172.21.15.178:0/1927979503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406213cc90 0x56406213d090 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fda9004cbb0 tx=0x7fda90011970 comp rx=0 tx=0).stop 2024-09-21T09:03:23.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9c415800 1 -- 172.21.15.178:0/1927979503 shutdown_connections 2024-09-21T09:03:23.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9c415800 1 --2- 172.21.15.178:0/1927979503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406213cc90 0x56406213d090 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9c415800 1 -- 172.21.15.178:0/1927979503 >> 172.21.15.178:0/1927979503 conn(0x564062139030 msgr2=0x564062137130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:23.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9c415800 1 -- 172.21.15.178:0/1927979503 shutdown_connections 2024-09-21T09:03:23.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9c415800 1 -- 172.21.15.178:0/1927979503 wait complete. 2024-09-21T09:03:23.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9c415800 1 Processor -- start 2024-09-21T09:03:23.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9c415800 1 -- start start 2024-09-21T09:03:23.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9c415800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406213cc90 0x564061f946a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9c415800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56406213dc80 con 0x56406213cc90 2024-09-21T09:03:23.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9843c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406213cc90 0x564061f946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9843c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406213cc90 0x564061f946a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:44366/0 (socket says 172.21.15.178:44366) 2024-09-21T09:03:23.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 learned_addr learned my addr 172.21.15.178:0/1086117793 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:23.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.078+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564061f92d90 con 0x56406213cc90 2024-09-21T09:03:23.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.079+0000 7fda9843c640 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406213cc90 0x564061f946a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fda90011be0 tx=0x7fda9004cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.079+0000 7fd9757fa640 1 -- 172.21.15.178:0/1086117793 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda90044030 con 0x56406213cc90 2024-09-21T09:03:23.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.079+0000 7fd9757fa640 1 -- 172.21.15.178:0/1086117793 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9002ba60 con 0x56406213cc90 2024-09-21T09:03:23.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.079+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564061f93020 con 0x56406213cc90 2024-09-21T09:03:23.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.079+0000 7fd9757fa640 1 -- 172.21.15.178:0/1086117793 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda9002bd40 con 0x56406213cc90 2024-09-21T09:03:23.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.079+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564061f934c0 con 0x56406213cc90 2024-09-21T09:03:23.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.079+0000 7fd9757fa640 1 -- 172.21.15.178:0/1086117793 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fda90022a80 con 0x56406213cc90 2024-09-21T09:03:23.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.080+0000 7fd9757fa640 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd960036b90 0x7fd960039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.080+0000 7fd9757fa640 1 -- 172.21.15.178:0/1086117793 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fda90045070 con 0x56406213cc90 2024-09-21T09:03:23.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.080+0000 7fda97c3b640 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd960036b90 0x7fd960039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.080+0000 7fda97c3b640 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd960036b90 0x7fd960039050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fda8802af70 tx=0x7fda88035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.080+0000 7fda9c415800 20 rados->read ofs=0 len=0 2024-09-21T09:03:23.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.081+0000 7fda9c415800 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564062152010 0x5640621544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.081+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564062154c20 con 0x564062152010 2024-09-21T09:03:23.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.081+0000 7fda8ffff640 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564062152010 0x5640621544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.081+0000 7fda8ffff640 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564062152010 0x5640621544d0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.081+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.081+0000 7fda9c415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:23.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.081+0000 7fda9c415800 20 realm 2024-09-21T09:03:23.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.081+0000 7fda9c415800 20 rados->read ofs=0 len=0 2024-09-21T09:03:23.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.081+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564062155050 con 0x564062152010 2024-09-21T09:03:23.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.081+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.081+0000 7fda9c415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:23.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.081+0000 7fda9c415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:23.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.081+0000 7fda9c415800 20 rados->read ofs=0 len=0 2024-09-21T09:03:23.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.081+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564062155920 con 0x564062152010 2024-09-21T09:03:23.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.082+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.082+0000 7fda9c415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:23.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.082+0000 7fda9c415800 20 rados->read ofs=0 len=0 2024-09-21T09:03:23.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.082+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564062155cc0 con 0x564062152010 2024-09-21T09:03:23.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.082+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.082+0000 7fda9c415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:23.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.082+0000 7fda9c415800 20 rados->read ofs=0 len=0 2024-09-21T09:03:23.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.082+0000 7fda9c415800 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564062156a20 0x564062158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.082+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564062159460 con 0x564062156a20 2024-09-21T09:03:23.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.082+0000 7fda9843c640 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564062156a20 0x564062158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.083+0000 7fda9843c640 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564062156a20 0x564062158e10 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.083+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.083+0000 7fda9c415800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:23.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.083+0000 7fda9c415800 20 searching for the correct realm 2024-09-21T09:03:23.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.083+0000 7fda9c415800 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56406215b410 0x56406215d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.083+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x56406215b410 2024-09-21T09:03:23.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.083+0000 7fda97c3b640 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56406215b410 0x56406215d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.083+0000 7fda97c3b640 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56406215b410 0x56406215d8d0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.084+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda88029030 con 0x56406215b410 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.084+0000 7fda97c3b640 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fda8802c060 0x7fda88040740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.084+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x7fda8802c060 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.084+0000 7fda8ffff640 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fda8802c060 0x7fda88040740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.084+0000 7fda8ffff640 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fda8802c060 0x7fda88040740 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.084+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda80051070 con 0x7fda8802c060 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.084+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062156a20 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.085+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.085+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062152010 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.085+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.085+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062152010 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.085+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.085+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062156a20 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.086+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.086+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062156a20 2024-09-21T09:03:23.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.086+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.086+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x7fda8802c060 2024-09-21T09:03:23.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.086+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda80051070 con 0x7fda8802c060 2024-09-21T09:03:23.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.086+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x56406215b410 2024-09-21T09:03:23.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.087+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda88029030 con 0x56406215b410 2024-09-21T09:03:23.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.087+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062152010 2024-09-21T09:03:23.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.087+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.087+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062156a20 2024-09-21T09:03:23.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.087+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.087+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062152010 2024-09-21T09:03:23.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.087+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.087+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x7fda8802c060 2024-09-21T09:03:23.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.088+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fda80051070 con 0x7fda8802c060 2024-09-21T09:03:23.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.088+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x56406215b410 2024-09-21T09:03:23.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.088+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda88029030 con 0x56406215b410 2024-09-21T09:03:23.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.088+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x56406215b410 2024-09-21T09:03:23.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.088+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda88029030 con 0x56406215b410 2024-09-21T09:03:23.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.088+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062156a20 2024-09-21T09:03:23.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.088+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.088+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x56406215b410 2024-09-21T09:03:23.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.089+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda88029030 con 0x56406215b410 2024-09-21T09:03:23.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.089+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x56406215b410 2024-09-21T09:03:23.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.089+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda88029030 con 0x56406215b410 2024-09-21T09:03:23.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.089+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062152010 2024-09-21T09:03:23.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.089+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.089+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062152010 2024-09-21T09:03:23.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.089+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.089+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062156a20 2024-09-21T09:03:23.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.090+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.090+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x56406215b410 2024-09-21T09:03:23.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.090+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda88029030 con 0x56406215b410 2024-09-21T09:03:23.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.090+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x7fda8802c060 2024-09-21T09:03:23.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.090+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda80051070 con 0x7fda8802c060 2024-09-21T09:03:23.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.090+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062152010 2024-09-21T09:03:23.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.090+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.090+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062156a20 2024-09-21T09:03:23.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.091+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.091+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x56406215b410 2024-09-21T09:03:23.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.091+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda88029030 con 0x56406215b410 2024-09-21T09:03:23.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.091+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062156a20 2024-09-21T09:03:23.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.091+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.091+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x7fda8802c060 2024-09-21T09:03:23.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.091+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda80051070 con 0x7fda8802c060 2024-09-21T09:03:23.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.091+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x56406215b410 2024-09-21T09:03:23.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.092+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda88029030 con 0x56406215b410 2024-09-21T09:03:23.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.092+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062156a20 2024-09-21T09:03:23.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.092+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.092+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x564062152010 2024-09-21T09:03:23.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.092+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.092+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56406215dfa0 con 0x7fda8802c060 2024-09-21T09:03:23.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda80051070 con 0x7fda8802c060 2024-09-21T09:03:23.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:23.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:23.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:23.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:23.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:23.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:23.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 rados->read ofs=0 len=0 2024-09-21T09:03:23.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564062159e20 con 0x564062152010 2024-09-21T09:03:23.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:23.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 rados->read ofs=0 len=0 2024-09-21T09:03:23.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564062159a60 con 0x564062152010 2024-09-21T09:03:23.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:23.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 rados->read ofs=0 len=0 2024-09-21T09:03:23.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56406215a800 con 0x564062152010 2024-09-21T09:03:23.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:23.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 zone default found 2024-09-21T09:03:23.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 4 Realm: () 2024-09-21T09:03:23.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:23.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:23.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:23.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 zonegroup default 2024-09-21T09:03:23.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 20 rados->read ofs=0 len=0 2024-09-21T09:03:23.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.093+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56406215e4b0 con 0x564062156a20 2024-09-21T09:03:23.111 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.094+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.111 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.094+0000 7fda9c415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:23.111 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.094+0000 7fda9c415800 20 rados->read ofs=0 len=0 2024-09-21T09:03:23.111 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.094+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564062160780 con 0x56406215b410 2024-09-21T09:03:23.111 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.094+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda88029030 con 0x56406215b410 2024-09-21T09:03:23.111 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.094+0000 7fda9c415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:23.111 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.094+0000 7fda9c415800 20 rados->read ofs=0 len=0 2024-09-21T09:03:23.111 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.094+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564062160b20 con 0x56406215b410 2024-09-21T09:03:23.111 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.094+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda88029030 con 0x56406215b410 2024-09-21T09:03:23.111 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.094+0000 7fda9c415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:23.111 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.094+0000 7fda9c415800 20 started sync module instance, tier type = 2024-09-21T09:03:23.111 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.094+0000 7fda9c415800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:23.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.094+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56406215fbc0 con 0x7fda8802c060 2024-09-21T09:03:23.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.095+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(44 notify.0 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda80051070 con 0x7fda8802c060 2024-09-21T09:03:23.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.095+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94834523504832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56406215fbc0 con 0x7fda8802c060 2024-09-21T09:03:23.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.095+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640621614e0 con 0x564062152010 2024-09-21T09:03:23.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.096+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94834523504832] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda80051070 con 0x7fda8802c060 2024-09-21T09:03:23.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.097+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.097+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94834523509264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56406215fbc0 con 0x564062152010 2024-09-21T09:03:23.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.097+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062161f50 con 0x56406215b410 2024-09-21T09:03:23.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.098+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda88029030 con 0x56406215b410 2024-09-21T09:03:23.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.098+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94834523511360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640621627f0 con 0x56406215b410 2024-09-21T09:03:23.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.098+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062163290 con 0x7fda8802c060 2024-09-21T09:03:23.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.098+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94834523509264] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.099+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94834523511360] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda88029030 con 0x56406215b410 2024-09-21T09:03:23.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.099+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(50 notify.3 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda80051070 con 0x7fda8802c060 2024-09-21T09:03:23.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.099+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94834523516256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062162340 con 0x7fda8802c060 2024-09-21T09:03:23.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.099+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062163b30 con 0x564062152010 2024-09-21T09:03:23.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.100+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94834523516256] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda80051070 con 0x7fda8802c060 2024-09-21T09:03:23.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.100+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.100+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94834523502352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062162340 con 0x564062152010 2024-09-21T09:03:23.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.100+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062164160 con 0x564062156a20 2024-09-21T09:03:23.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.101+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(54 notify.5 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.101+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94834523520112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062164a00 con 0x564062156a20 2024-09-21T09:03:23.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.101+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640621654a0 con 0x564062156a20 2024-09-21T09:03:23.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.101+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94834523502352] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.102+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94834523520112] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.102+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(56 notify.6 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.102+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94834523524976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640621645b0 con 0x564062156a20 2024-09-21T09:03:23.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.102+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062165b30 con 0x564062156a20 2024-09-21T09:03:23.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.103+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.103+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94834523524976] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.103+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94834523526784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062165aa0 con 0x564062156a20 2024-09-21T09:03:23.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.103+0000 7fda9c415800 20 add_watcher() i=0 2024-09-21T09:03:23.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.103+0000 7fda9c415800 20 add_watcher() i=1 2024-09-21T09:03:23.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.103+0000 7fda9c415800 20 add_watcher() i=2 2024-09-21T09:03:23.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.103+0000 7fda9c415800 20 add_watcher() i=3 2024-09-21T09:03:23.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.103+0000 7fda9c415800 20 add_watcher() i=4 2024-09-21T09:03:23.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.103+0000 7fda9c415800 20 add_watcher() i=5 2024-09-21T09:03:23.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.103+0000 7fda9c415800 20 add_watcher() i=6 2024-09-21T09:03:23.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.104+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94834523526784] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.104+0000 7fda9c415800 20 add_watcher() i=7 2024-09-21T09:03:23.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.104+0000 7fda9c415800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:23.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.104+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564062168f80 con 0x564062152010 2024-09-21T09:03:23.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.105+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.105+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94834523527840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062166370 con 0x564062152010 2024-09-21T09:03:23.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.105+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94834523527840] v29'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.106+0000 7fd94dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:23.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.106+0000 7fda9c415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:23.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.106+0000 7fda9c415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:23.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.106+0000 7fda9c415800 5 note: GC not initialized 2024-09-21T09:03:23.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.106+0000 7fd94cfe1640 20 reqs_thread_entry: start 2024-09-21T09:03:23.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.106+0000 7fda9c415800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:23.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.106+0000 7fda9c415800 20 Filter name: none 2024-09-21T09:03:23.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.106+0000 7fd8c67fc640 20 reqs_thread_entry: start 2024-09-21T09:03:23.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.106+0000 7fda9c415800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:23.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.106+0000 7fda9c415800 20 rados->read ofs=0 len=0 2024-09-21T09:03:23.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.106+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56406219c1d0 con 0x564062152010 2024-09-21T09:03:23.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:23.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:23.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:23.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:23.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56406219ec60 con 0x7fda8802c060 2024-09-21T09:03:23.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fda80051070 con 0x7fda8802c060 2024-09-21T09:03:23.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 20 enabling bucket name=myfoo 2024-09-21T09:03:23.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T09:03:23.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 20 rados->read ofs=0 len=0 2024-09-21T09:03:23.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56406219cc40 con 0x7fda8802c060 2024-09-21T09:03:23.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fda80051070 con 0x7fda8802c060 2024-09-21T09:03:23.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:23.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-21T09:03:23.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:23.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 : miss 2024-09-21T09:03:23.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 20 rados->read ofs=0 len=0 2024-09-21T09:03:23.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.107+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:65 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56406219f490 con 0x564062156a20 2024-09-21T09:03:23.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.108+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(65 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.108+0000 7fda9c415800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:23.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.108+0000 7fda9c415800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:23.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.108+0000 7fda9c415800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:23.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.108+0000 7fda9c415800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:23.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.108+0000 7fda9c415800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:23.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.108+0000 7fda9c415800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 2024-09-21T09:03:23.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.108+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:66 8.1e 8:7dec5709:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640621a6c60 con 0x564062156a20 2024-09-21T09:03:23.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(66 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v29'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9c415800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:23.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9c415800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:23.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9c415800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:23.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9c415800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1, ofs0, ns] 2024-09-21T09:03:23.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94834523761936 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640621a2310 con 0x564062156a20 2024-09-21T09:03:23.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== watch-notify(notify (1) cookie 94834523520112 notify 124554051600 ret 0) ==== 794+0+0 (crc 0 0 0) 0x56406219e9a0 con 0x564062156a20 2024-09-21T09:03:23.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fd976ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051600 cookie 94834523520112 notifier 4602 bl.length()=752 2024-09-21T09:03:23.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(67 notify.5 [notify cookie 94834523761936 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fd976ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 info.flags=0x17 2024-09-21T09:03:23.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fd976ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1 to cache LRU end 2024-09-21T09:03:23.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fd976ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:23.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fd976ffd640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fd95c003ea0 con 0x564062156a20 2024-09-21T09:03:23.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== watch-notify(notify_complete (2) cookie 94834523761936 notify 124554051600 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564061f93020 con 0x564062156a20 2024-09-21T09:03:23.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9c415800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): orig_sources= new_sources= 2024-09-21T09:03:23.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9c415800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): potential sources added=[] removed=[] 2024-09-21T09:03:23.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9c415800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): orig_dests= new_dests= 2024-09-21T09:03:23.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9c415800 20 handle_bi_update(): bucket=:myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1]): potential dests added=[] removed=[] 2024-09-21T09:03:23.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.110+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640621a1e20 con 0x564062152010 2024-09-21T09:03:23.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.111+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v29'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.111+0000 7fda9c415800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:23.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.111+0000 7fda9c415800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:23.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.111+0000 7fda9c415800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:23.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.111+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94834523744208 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640621a1e20 con 0x564062152010 2024-09-21T09:03:23.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.112+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify (1) cookie 94834523502352 notify 124554051601 ret 0) ==== 609+0+0 (crc 0 0 0) 0x564061ee5e00 con 0x564062152010 2024-09-21T09:03:23.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.112+0000 7fd976ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051601 cookie 94834523502352 notifier 4602 bl.length()=567 2024-09-21T09:03:23.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.112+0000 7fd976ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:23.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.112+0000 7fd976ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:23.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.112+0000 7fd976ffd640 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fd95c003ea0 con 0x564062152010 2024-09-21T09:03:23.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.112+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(70 notify.4 [notify cookie 94834523744208 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.112+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== watch-notify(notify_complete (2) cookie 94834523744208 notify 124554051601 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fda800885e0 con 0x564062152010 2024-09-21T09:03:23.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.112+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.127 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:23.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.113+0000 7fd94dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:23.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.113+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94834523527840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062199f20 con 0x564062152010 2024-09-21T09:03:23.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.114+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94834523527840] v29'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.114+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94834523504832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062199f20 con 0x7fda8802c060 2024-09-21T09:03:23.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.115+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94834523504832] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda80051070 con 0x7fda8802c060 2024-09-21T09:03:23.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.115+0000 7fda9c415800 20 remove_watcher() i=0 2024-09-21T09:03:23.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.115+0000 7fda9c415800 2 removed watcher, disabling cache 2024-09-21T09:03:23.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.115+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94834523509264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062199f20 con 0x564062152010 2024-09-21T09:03:23.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.116+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94834523509264] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.116+0000 7fda9c415800 20 remove_watcher() i=1 2024-09-21T09:03:23.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.116+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94834523511360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062199f20 con 0x56406215b410 2024-09-21T09:03:23.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.117+0000 7fda97c3b640 1 -- 172.21.15.178:0/1086117793 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94834523511360] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda88029030 con 0x56406215b410 2024-09-21T09:03:23.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.117+0000 7fda9c415800 20 remove_watcher() i=2 2024-09-21T09:03:23.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.117+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94834523516256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062199f20 con 0x7fda8802c060 2024-09-21T09:03:23.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.118+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94834523516256] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda80051070 con 0x7fda8802c060 2024-09-21T09:03:23.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.118+0000 7fda9c415800 20 remove_watcher() i=3 2024-09-21T09:03:23.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.118+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94834523502352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062199f20 con 0x564062152010 2024-09-21T09:03:23.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.119+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94834523502352] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda80051070 con 0x564062152010 2024-09-21T09:03:23.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.119+0000 7fda9c415800 20 remove_watcher() i=4 2024-09-21T09:03:23.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.119+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94834523520112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062199f20 con 0x564062156a20 2024-09-21T09:03:23.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.120+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94834523520112] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.120+0000 7fda9c415800 20 remove_watcher() i=5 2024-09-21T09:03:23.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.120+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94834523524976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062199f20 con 0x564062156a20 2024-09-21T09:03:23.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.121+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94834523524976] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.121+0000 7fda9c415800 20 remove_watcher() i=6 2024-09-21T09:03:23.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.121+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94834523526784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564062199f20 con 0x564062156a20 2024-09-21T09:03:23.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.122+0000 7fda9843c640 1 -- 172.21.15.178:0/1086117793 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94834523526784] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9002a070 con 0x564062156a20 2024-09-21T09:03:23.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.122+0000 7fda9c415800 20 remove_watcher() i=7 2024-09-21T09:03:23.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.122+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564062156a20 msgr2=0x564062158e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.122+0000 7fda9c415800 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564062156a20 0x564062158e10 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564062152010 msgr2=0x5640621544d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564062152010 0x5640621544d0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fda8802c060 msgr2=0x7fda88040740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fda8802c060 0x7fda88040740 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56406215b410 msgr2=0x56406215d8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56406215b410 0x56406215d8d0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd960036b90 msgr2=0x7fd960039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd960036b90 0x7fd960039050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fda8802af70 tx=0x7fda88035000 comp rx=0 tx=0).stop 2024-09-21T09:03:23.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406213cc90 msgr2=0x564061f946a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 --2- 172.21.15.178:0/1086117793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406213cc90 0x564061f946a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fda90011be0 tx=0x7fda9004cb10 comp rx=0 tx=0).stop 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 reap_dead start 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda8ffff640 1 -- 172.21.15.178:0/1086117793 reap_dead start 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 shutdown_connections 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 >> 172.21.15.178:0/1086117793 conn(0x564062139030 msgr2=0x564062137100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 shutdown_connections 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/1086117793 wait complete. 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/2239099426 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd970036b90 msgr2=0x7fd970039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 --2- 172.21.15.178:0/2239099426 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd970036b90 0x7fd970039050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x56406211cd00 tx=0x7fda8804ad80 comp rx=0 tx=0).stop 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/2239099426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564062130030 msgr2=0x564062130450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 --2- 172.21.15.178:0/2239099426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564062130030 0x564062130450 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x564062116340 tx=0x7fda900188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/2239099426 shutdown_connections 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 --2- 172.21.15.178:0/2239099426 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd970036b90 0x7fd970039050 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 --2- 172.21.15.178:0/2239099426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564062130030 0x564062130450 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/2239099426 >> 172.21.15.178:0/2239099426 conn(0x564062124fc0 msgr2=0x564062127b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/2239099426 shutdown_connections 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.123+0000 7fda9c415800 1 -- 172.21.15.178:0/2239099426 wait complete. 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56406211ebe0 msgr2=0x564062120fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56406211ebe0 0x564062120fd0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564062022a60 msgr2=0x56406211c300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564062022a60 0x56406211c300 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd980036b40 msgr2=0x7fd980039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd980036b40 0x7fd980039000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fda80057000 tx=0x7fda80052000 comp rx=0 tx=0).stop 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406201e760 msgr2=0x564062115290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406201e760 0x564062115290 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fda88004000 tx=0x7fda88000bc0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 shutdown_connections 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56406211ebe0 0x564062120fd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564062022a60 0x56406211c300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd980036b40 0x7fd980039000 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 --2- 172.21.15.178:0/1384090033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56406201e760 0x564062115290 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:23.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 >> 172.21.15.178:0/1384090033 conn(0x564062019ff0 msgr2=0x564062107a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:23.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 shutdown_connections 2024-09-21T09:03:23.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:23.124+0000 7fda9c415800 1 -- 172.21.15.178:0/1384090033 wait complete. 2024-09-21T09:03:23.137 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:23.143 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-21T09:03:23.375 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-21T09:03:23.381 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:38.383 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-21T09:03:38.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-21T09:03:38.383 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-21T09:03:38.433 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:38.434 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:38.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.432+0000 7fb6fad21800 1 Processor -- start 2024-09-21T09:03:38.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.432+0000 7fb6fad21800 1 -- start start 2024-09-21T09:03:38.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.433+0000 7fb6fad21800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55e5ca9c4990 0x55e5ca9c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.433+0000 7fb6fad21800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e5ca885b30 con 0x55e5ca9c52d0 2024-09-21T09:03:38.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.433+0000 7fb6fad21800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55e5ca867360 con 0x55e5ca9c4990 2024-09-21T09:03:38.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.433+0000 7fb6f6aac640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55e5ca9c4990 0x55e5ca9c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.433+0000 7fb6f6aac640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55e5ca9c4990 0x55e5ca9c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49342/0 (socket says 172.21.15.178:49342) 2024-09-21T09:03:38.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.433+0000 7fb6f62ab640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55e5ca9c52d0 0x55e5ca9cbaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:45112/0 (socket says 172.21.15.178:45112) 2024-09-21T09:03:38.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.433+0000 7fb6f6aac640 1 -- 172.21.15.178:0/3795353417 learned_addr learned my addr 172.21.15.178:0/3795353417 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.433+0000 7fb6f6aac640 1 -- 172.21.15.178:0/3795353417 >> v1:172.21.15.44:6789/0 conn(0x55e5ca9c52d0 legacy=0x55e5ca9cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.433+0000 7fb6f6aac640 1 -- 172.21.15.178:0/3795353417 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ca88de00 con 0x55e5ca9c4990 2024-09-21T09:03:38.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.436+0000 7fb6f6aac640 1 --2- 172.21.15.178:0/3795353417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5ca9c4d90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8005fd0 tx=0x7fb6e8045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a00fc1c6579ea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.436+0000 7fb6f5aaa640 1 -- 172.21.15.178:0/3795353417 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6e804e600 con 0x55e5ca9c4990 2024-09-21T09:03:38.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.436+0000 7fb6f5aaa640 1 -- 172.21.15.178:0/3795353417 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6e804e7a0 con 0x55e5ca9c4990 2024-09-21T09:03:38.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.436+0000 7fb6f5aaa640 1 -- 172.21.15.178:0/3795353417 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6e804eaa0 con 0x55e5ca9c4990 2024-09-21T09:03:38.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.436+0000 7fb6fad21800 1 -- 172.21.15.178:0/3795353417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 msgr2=0x55e5ca9c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.436+0000 7fb6fad21800 1 --2- 172.21.15.178:0/3795353417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5ca9c4d90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8005fd0 tx=0x7fb6e8045cf0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.436+0000 7fb6fad21800 1 -- 172.21.15.178:0/3795353417 shutdown_connections 2024-09-21T09:03:38.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.436+0000 7fb6fad21800 1 --2- 172.21.15.178:0/3795353417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5ca9c4d90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.436+0000 7fb6fad21800 1 -- 172.21.15.178:0/3795353417 >> 172.21.15.178:0/3795353417 conn(0x55e5ca9c05c0 msgr2=0x55e5ca9c29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.436+0000 7fb6fad21800 1 -- 172.21.15.178:0/3795353417 shutdown_connections 2024-09-21T09:03:38.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.436+0000 7fb6fad21800 1 -- 172.21.15.178:0/3795353417 wait complete. 2024-09-21T09:03:38.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.452+0000 7fb6fad21800 1 Processor -- start 2024-09-21T09:03:38.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.452+0000 7fb6fad21800 1 -- start start 2024-09-21T09:03:38.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.452+0000 7fb6fad21800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5caab5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.452+0000 7fb6fad21800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e5ca912330 con 0x55e5ca9c4990 2024-09-21T09:03:38.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.453+0000 7fb6f6aac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5caab5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.453+0000 7fb6f6aac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5caab5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49356/0 (socket says 172.21.15.178:49356) 2024-09-21T09:03:38.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.453+0000 7fb6f6aac640 1 -- 172.21.15.178:0/3068843115 learned_addr learned my addr 172.21.15.178:0/3068843115 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.453+0000 7fb6f6aac640 1 -- 172.21.15.178:0/3068843115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ca85fbc0 con 0x55e5ca9c4990 2024-09-21T09:03:38.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.453+0000 7fb6f6aac640 1 --2- 172.21.15.178:0/3068843115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5caab5870 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8045d30 tx=0x7fb6e8050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd183d2ab05839e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.453+0000 7fb5e4e09640 1 -- 172.21.15.178:0/3068843115 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6e804eb40 con 0x55e5ca9c4990 2024-09-21T09:03:38.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.453+0000 7fb5e4e09640 1 -- 172.21.15.178:0/3068843115 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6e805c040 con 0x55e5ca9c4990 2024-09-21T09:03:38.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.453+0000 7fb5e4e09640 1 -- 172.21.15.178:0/3068843115 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6e804ee10 con 0x55e5ca9c4990 2024-09-21T09:03:38.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.454+0000 7fb6fad21800 1 -- 172.21.15.178:0/3068843115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 msgr2=0x55e5caab5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.454+0000 7fb6fad21800 1 --2- 172.21.15.178:0/3068843115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5caab5870 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8045d30 tx=0x7fb6e8050000 comp rx=0 tx=0).stop 2024-09-21T09:03:38.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.454+0000 7fb6fad21800 1 -- 172.21.15.178:0/3068843115 shutdown_connections 2024-09-21T09:03:38.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.454+0000 7fb6fad21800 1 --2- 172.21.15.178:0/3068843115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5caab5870 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.454+0000 7fb6fad21800 1 -- 172.21.15.178:0/3068843115 >> 172.21.15.178:0/3068843115 conn(0x55e5ca9c05c0 msgr2=0x55e5caab1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.454+0000 7fb6fad21800 1 -- 172.21.15.178:0/3068843115 shutdown_connections 2024-09-21T09:03:38.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.454+0000 7fb6fad21800 1 -- 172.21.15.178:0/3068843115 wait complete. 2024-09-21T09:03:38.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.454+0000 7fb6fad21800 1 Processor -- start 2024-09-21T09:03:38.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.454+0000 7fb6fad21800 1 -- start start 2024-09-21T09:03:38.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.455+0000 7fb6fad21800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5caabd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.455+0000 7fb6fad21800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e5ca9cd650 con 0x55e5ca9c4990 2024-09-21T09:03:38.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.455+0000 7fb6f6aac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5caabd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.455+0000 7fb6f6aac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5caabd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49360/0 (socket says 172.21.15.178:49360) 2024-09-21T09:03:38.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.455+0000 7fb6f6aac640 1 -- 172.21.15.178:0/829674191 learned_addr learned my addr 172.21.15.178:0/829674191 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.455+0000 7fb6f6aac640 1 -- 172.21.15.178:0/829674191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ca873fe0 con 0x55e5ca9c4990 2024-09-21T09:03:38.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.455+0000 7fb6f6aac640 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5caabd1d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8045d30 tx=0x7fb6e8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.456+0000 7fb5e3606640 1 -- 172.21.15.178:0/829674191 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6e8061420 con 0x55e5ca9c4990 2024-09-21T09:03:38.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.456+0000 7fb5e3606640 1 -- 172.21.15.178:0/829674191 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6e8070070 con 0x55e5ca9c4990 2024-09-21T09:03:38.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.456+0000 7fb5e3606640 1 -- 172.21.15.178:0/829674191 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6e80616f0 con 0x55e5ca9c4990 2024-09-21T09:03:38.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.456+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5caabd710 con 0x55e5ca9c4990 2024-09-21T09:03:38.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.456+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5caabdbb0 con 0x55e5ca9c4990 2024-09-21T09:03:38.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.457+0000 7fb5e3606640 1 -- 172.21.15.178:0/829674191 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb6e8061890 con 0x55e5ca9c4990 2024-09-21T09:03:38.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.457+0000 7fb5e3606640 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5dc036b90 0x7fb5dc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.457+0000 7fb5e3606640 1 -- 172.21.15.178:0/829674191 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fb6e8066070 con 0x55e5ca9c4990 2024-09-21T09:03:38.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.457+0000 7fb6f62ab640 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5dc036b90 0x7fb5dc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.457+0000 7fb6fad21800 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e5ca9c52d0 0x55e5caac4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.457+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5caac46e0 con 0x55e5ca9c52d0 2024-09-21T09:03:38.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.457+0000 7fb6f72ad640 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e5ca9c52d0 0x55e5caac4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.457+0000 7fb6f62ab640 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5dc036b90 0x7fb5dc039050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0000f60 tx=0x7fb6e0001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.458+0000 7fb6f72ad640 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e5ca9c52d0 0x55e5caac4110 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.458+0000 7fb6f72ad640 1 -- 172.21.15.178:0/829674191 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6f000a4e0 con 0x55e5ca9c52d0 2024-09-21T09:03:38.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.458+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5caac17f0 con 0x55e5ca9c52d0 2024-09-21T09:03:38.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.458+0000 7fb6f72ad640 1 -- 172.21.15.178:0/829674191 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6f000a4e0 con 0x55e5ca9c52d0 2024-09-21T09:03:38.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.458+0000 7fb6fad21800 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e5caac6a10 0x55e5caac8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.458+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5caac94f0 con 0x55e5caac6a10 2024-09-21T09:03:38.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.459+0000 7fb6f6aac640 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e5caac6a10 0x55e5caac8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.459+0000 7fb6f6aac640 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e5caac6a10 0x55e5caac8e00 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.465+0000 7fb6f6aac640 1 -- 172.21.15.178:0/829674191 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb6e807c070 con 0x55e5caac6a10 2024-09-21T09:03:38.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.465+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5caac58b0 con 0x55e5ca9c52d0 2024-09-21T09:03:38.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.466+0000 7fb6f72ad640 1 -- 172.21.15.178:0/829674191 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6f000a4e0 con 0x55e5ca9c52d0 2024-09-21T09:03:38.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.466+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5caac5d70 con 0x55e5ca9c52d0 2024-09-21T09:03:38.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.466+0000 7fb6f72ad640 1 -- 172.21.15.178:0/829674191 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb6f000a4e0 con 0x55e5ca9c52d0 2024-09-21T09:03:38.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.466+0000 7fb6fad21800 1 Processor -- start 2024-09-21T09:03:38.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.466+0000 7fb6fad21800 1 -- start start 2024-09-21T09:03:38.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.467+0000 7fb6fad21800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c73b0 0x55e5ca9c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.467+0000 7fb6fad21800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e5ca861580 con 0x55e5ca9c73b0 2024-09-21T09:03:38.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.467+0000 7fb6f72ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c73b0 0x55e5ca9c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.467+0000 7fb6f72ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c73b0 0x55e5ca9c5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49374/0 (socket says 172.21.15.178:49374) 2024-09-21T09:03:38.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.467+0000 7fb6f72ad640 1 -- 172.21.15.178:0/4072161343 learned_addr learned my addr 172.21.15.178:0/4072161343 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.467+0000 7fb6f72ad640 1 -- 172.21.15.178:0/4072161343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ca9c77d0 con 0x55e5ca9c73b0 2024-09-21T09:03:38.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.467+0000 7fb6f72ad640 1 --2- 172.21.15.178:0/4072161343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c73b0 0x55e5ca9c5a00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55e5caabe5d0 tx=0x7fb6f0007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.468+0000 7fb5e0e01640 1 -- 172.21.15.178:0/4072161343 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f0008e00 con 0x55e5ca9c73b0 2024-09-21T09:03:38.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.468+0000 7fb5e0e01640 1 -- 172.21.15.178:0/4072161343 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f001e020 con 0x55e5ca9c73b0 2024-09-21T09:03:38.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.468+0000 7fb6fad21800 1 -- 172.21.15.178:0/4072161343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5ca9c5fa0 con 0x55e5ca9c73b0 2024-09-21T09:03:38.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.468+0000 7fb5e0e01640 1 -- 172.21.15.178:0/4072161343 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f0019590 con 0x55e5ca9c73b0 2024-09-21T09:03:38.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.468+0000 7fb6fad21800 1 -- 172.21.15.178:0/4072161343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5ca9c64a0 con 0x55e5ca9c73b0 2024-09-21T09:03:38.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.469+0000 7fb5e0e01640 1 -- 172.21.15.178:0/4072161343 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb6f0016040 con 0x55e5ca9c73b0 2024-09-21T09:03:38.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.469+0000 7fb5e0e01640 1 --2- 172.21.15.178:0/4072161343 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5d0036b40 0x7fb5d0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.469+0000 7fb5e0e01640 1 -- 172.21.15.178:0/4072161343 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fb6f001f030 con 0x55e5ca9c73b0 2024-09-21T09:03:38.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.469+0000 7fb6f6aac640 1 --2- 172.21.15.178:0/4072161343 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5d0036b40 0x7fb5d0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.470+0000 7fb6fad21800 1 Processor -- start 2024-09-21T09:03:38.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.470+0000 7fb6fad21800 1 -- start start 2024-09-21T09:03:38.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.470+0000 7fb6f6aac640 1 --2- 172.21.15.178:0/4072161343 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5d0036b40 0x7fb5d0039000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55e5caac4b80 tx=0x7fb6e8046130 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.470+0000 7fb6fad21800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5caae6d30 0x55e5caae7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.470+0000 7fb6fad21800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e5caab5f60 con 0x55e5caae6d30 2024-09-21T09:03:38.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.470+0000 7fb6f72ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5caae6d30 0x55e5caae7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.470+0000 7fb6f72ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5caae6d30 0x55e5caae7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49382/0 (socket says 172.21.15.178:49382) 2024-09-21T09:03:38.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.470+0000 7fb6f72ad640 1 -- 172.21.15.178:0/731987519 learned_addr learned my addr 172.21.15.178:0/731987519 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.471+0000 7fb6f72ad640 1 -- 172.21.15.178:0/731987519 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5caae7670 con 0x55e5caae6d30 2024-09-21T09:03:38.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.471+0000 7fb6f72ad640 1 --2- 172.21.15.178:0/731987519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5caae6d30 0x55e5caae7130 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb6f004d020 tx=0x7fb6f0017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e14a11620672fa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.471+0000 7fb5da7fc640 1 -- 172.21.15.178:0/731987519 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f001d030 con 0x55e5caae6d30 2024-09-21T09:03:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.471+0000 7fb5da7fc640 1 -- 172.21.15.178:0/731987519 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f0015c90 con 0x55e5caae6d30 2024-09-21T09:03:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.471+0000 7fb5da7fc640 1 -- 172.21.15.178:0/731987519 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f0022a60 con 0x55e5caae6d30 2024-09-21T09:03:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.471+0000 7fb6fad21800 1 -- 172.21.15.178:0/731987519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5caae6d30 msgr2=0x55e5caae7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.471+0000 7fb6fad21800 1 --2- 172.21.15.178:0/731987519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5caae6d30 0x55e5caae7130 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb6f004d020 tx=0x7fb6f0017fa0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.472+0000 7fb6fad21800 1 -- 172.21.15.178:0/731987519 shutdown_connections 2024-09-21T09:03:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.472+0000 7fb6fad21800 1 --2- 172.21.15.178:0/731987519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5caae6d30 0x55e5caae7130 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.472+0000 7fb6fad21800 1 -- 172.21.15.178:0/731987519 >> 172.21.15.178:0/731987519 conn(0x55e5caae30e0 msgr2=0x55e5caae11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.472+0000 7fb6fad21800 1 -- 172.21.15.178:0/731987519 shutdown_connections 2024-09-21T09:03:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.472+0000 7fb6fad21800 1 -- 172.21.15.178:0/731987519 wait complete. 2024-09-21T09:03:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.472+0000 7fb6fad21800 1 Processor -- start 2024-09-21T09:03:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.472+0000 7fb6fad21800 1 -- start start 2024-09-21T09:03:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.472+0000 7fb6fad21800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5caae6d30 0x55e5caaee170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.472+0000 7fb6fad21800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e5caae7d10 con 0x55e5caae6d30 2024-09-21T09:03:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.472+0000 7fb6f72ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5caae6d30 0x55e5caaee170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.472+0000 7fb6f72ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5caae6d30 0x55e5caaee170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49398/0 (socket says 172.21.15.178:49398) 2024-09-21T09:03:38.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.472+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 learned_addr learned my addr 172.21.15.178:0/2407789388 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.473+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5caaee6b0 con 0x55e5caae6d30 2024-09-21T09:03:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.473+0000 7fb6f72ad640 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5caae6d30 0x55e5caaee170 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb6f003d040 tx=0x7fb6f004cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.473+0000 7fb5d8ff9640 1 -- 172.21.15.178:0/2407789388 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f0040360 con 0x55e5caae6d30 2024-09-21T09:03:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.473+0000 7fb5d8ff9640 1 -- 172.21.15.178:0/2407789388 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f0040500 con 0x55e5caae6d30 2024-09-21T09:03:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.473+0000 7fb5d8ff9640 1 -- 172.21.15.178:0/2407789388 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f0019910 con 0x55e5caae6d30 2024-09-21T09:03:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.473+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5caaee940 con 0x55e5caae6d30 2024-09-21T09:03:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.473+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5caaf15f0 con 0x55e5caae6d30 2024-09-21T09:03:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.474+0000 7fb5d8ff9640 1 -- 172.21.15.178:0/2407789388 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb6f0019ab0 con 0x55e5caae6d30 2024-09-21T09:03:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.474+0000 7fb5d8ff9640 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5c0036b40 0x7fb5c0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.474+0000 7fb5d8ff9640 1 -- 172.21.15.178:0/2407789388 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fb6f0038bf0 con 0x55e5caae6d30 2024-09-21T09:03:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.474+0000 7fb6f6aac640 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5c0036b40 0x7fb5c0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.474+0000 7fb6fad21800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.475+0000 7fb6fad21800 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e5caaf9c60 0x55e5caafc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.475+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5caafc870 con 0x55e5caaf9c60 2024-09-21T09:03:38.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.475+0000 7fb6f62ab640 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e5caaf9c60 0x55e5caafc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.475+0000 7fb6f6aac640 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5c0036b40 0x7fb5c0039000 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb6e806cfd0 tx=0x7fb6e8081000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.475+0000 7fb6f62ab640 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e5caaf9c60 0x55e5caafc120 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.475+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6e000f610 con 0x55e5caaf9c60 2024-09-21T09:03:38.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.475+0000 7fb6fad21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.475+0000 7fb6fad21800 20 realm 2024-09-21T09:03:38.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.475+0000 7fb6fad21800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.475+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5caaf90b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.475+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6e000f610 con 0x55e5caaf9c60 2024-09-21T09:03:38.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.475+0000 7fb6fad21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.475+0000 7fb6fad21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:38.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.476+0000 7fb6fad21800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.476+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5caafd350 con 0x55e5caaf9c60 2024-09-21T09:03:38.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.476+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6e000f610 con 0x55e5caaf9c60 2024-09-21T09:03:38.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.476+0000 7fb6fad21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.476+0000 7fb6fad21800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.476+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5caafdc20 con 0x55e5caaf9c60 2024-09-21T09:03:38.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.476+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6e000f610 con 0x55e5caaf9c60 2024-09-21T09:03:38.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.476+0000 7fb6fad21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:38.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.476+0000 7fb6fad21800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.476+0000 7fb6fad21800 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e5caafe4d0 0x55e5cab008e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.476+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab01040 con 0x55e5caafe4d0 2024-09-21T09:03:38.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.476+0000 7fb6f72ad640 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e5caafe4d0 0x55e5cab008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.477+0000 7fb6f72ad640 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e5caafe4d0 0x55e5cab008e0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.477+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.477+0000 7fb6fad21800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:38.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.477+0000 7fb6fad21800 20 searching for the correct realm 2024-09-21T09:03:38.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.477+0000 7fb6fad21800 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e5cab03140 0x55e5cab05600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.477+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5cab03140 2024-09-21T09:03:38.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.477+0000 7fb6f6aac640 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e5cab03140 0x55e5cab05600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.478+0000 7fb6f6aac640 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e5cab03140 0x55e5cab05600 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.478+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e807c070 con 0x55e5cab03140 2024-09-21T09:03:38.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.478+0000 7fb6f6aac640 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb6e809c070 0x7fb6e806b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.478+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x7fb6e809c070 2024-09-21T09:03:38.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.478+0000 7fb6f62ab640 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb6e809c070 0x7fb6e806b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.478+0000 7fb6f62ab640 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb6e809c070 0x7fb6e806b3f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.478+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e000f610 con 0x7fb6e809c070 2024-09-21T09:03:38.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.478+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caafe4d0 2024-09-21T09:03:38.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.479+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.479+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caaf9c60 2024-09-21T09:03:38.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.479+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e000f610 con 0x55e5caaf9c60 2024-09-21T09:03:38.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.479+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caaf9c60 2024-09-21T09:03:38.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.479+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e002b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.479+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caafe4d0 2024-09-21T09:03:38.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.480+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.480+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caafe4d0 2024-09-21T09:03:38.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.480+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.480+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x7fb6e809c070 2024-09-21T09:03:38.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.480+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e002b040 con 0x7fb6e809c070 2024-09-21T09:03:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.480+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5cab03140 2024-09-21T09:03:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.480+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e807c070 con 0x55e5cab03140 2024-09-21T09:03:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.480+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caaf9c60 2024-09-21T09:03:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.481+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e002b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.481+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caafe4d0 2024-09-21T09:03:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.481+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.481+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caaf9c60 2024-09-21T09:03:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.481+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e002b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.481+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x7fb6e809c070 2024-09-21T09:03:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.481+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb6e002b040 con 0x7fb6e809c070 2024-09-21T09:03:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.481+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5cab03140 2024-09-21T09:03:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.482+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.482+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5cab03140 2024-09-21T09:03:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.482+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.482+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caafe4d0 2024-09-21T09:03:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.482+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.482+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5cab03140 2024-09-21T09:03:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.482+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.482+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5cab03140 2024-09-21T09:03:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.483+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.483+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caaf9c60 2024-09-21T09:03:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.483+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb6e002b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.483+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caaf9c60 2024-09-21T09:03:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.483+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb6e002b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.483+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caafe4d0 2024-09-21T09:03:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.484+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.484+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5cab03140 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.484+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.484+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x7fb6e809c070 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.484+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e002b040 con 0x7fb6e809c070 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.484+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caaf9c60 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.484+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e002b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.484+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caafe4d0 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.485+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.485+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5cab03140 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.485+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.485+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x7fb6e809c070 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.485+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e002b040 con 0x7fb6e809c070 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.485+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x7fb6e809c070 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.485+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e002b040 con 0x7fb6e809c070 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.485+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5cab03140 2024-09-21T09:03:38.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.486+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.486+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caafe4d0 2024-09-21T09:03:38.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.486+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.486+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x55e5caaf9c60 2024-09-21T09:03:38.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.486+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb6e002b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.486+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab05cd0 con 0x7fb6e809c070 2024-09-21T09:03:38.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e002b040 con 0x7fb6e809c070 2024-09-21T09:03:38.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:38.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:38.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:38.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:38.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:38.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:38.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab01b70 con 0x55e5caaf9c60 2024-09-21T09:03:38.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab01ff0 con 0x55e5caaf9c60 2024-09-21T09:03:38.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:38.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab024d0 con 0x55e5caaf9c60 2024-09-21T09:03:38.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:38.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 zone default found 2024-09-21T09:03:38.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 4 Realm: () 2024-09-21T09:03:38.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:38.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:38.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:38.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 zonegroup default 2024-09-21T09:03:38.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.487+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab06150 con 0x55e5caafe4d0 2024-09-21T09:03:38.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.488+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.488+0000 7fb6fad21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.488+0000 7fb6fad21800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.488+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab08380 con 0x55e5cab03140 2024-09-21T09:03:38.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.488+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.488+0000 7fb6fad21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.488+0000 7fb6fad21800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.488+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab08720 con 0x55e5cab03140 2024-09-21T09:03:38.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.488+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.488+0000 7fb6fad21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.488+0000 7fb6fad21800 20 started sync module instance, tier type = 2024-09-21T09:03:38.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.488+0000 7fb6fad21800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:38.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.488+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab077c0 con 0x7fb6e809c070 2024-09-21T09:03:38.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.489+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.490+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94445436435728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab077c0 con 0x7fb6e809c070 2024-09-21T09:03:38.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.490+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab090e0 con 0x55e5caaf9c60 2024-09-21T09:03:38.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.491+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94445436435728] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.491+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.491+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94445436433648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab090e0 con 0x55e5caaf9c60 2024-09-21T09:03:38.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.491+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab09ae0 con 0x55e5cab03140 2024-09-21T09:03:38.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.494+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94445436433648] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.494+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.494+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94445436439600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab09050 con 0x55e5cab03140 2024-09-21T09:03:38.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.494+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab0a9a0 con 0x7fb6e809c070 2024-09-21T09:03:38.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.495+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.495+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94445436446416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab0b160 con 0x7fb6e809c070 2024-09-21T09:03:38.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.495+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab0bc80 con 0x55e5caaf9c60 2024-09-21T09:03:38.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.496+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94445436439600] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.496+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94445436446416] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.497+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.497+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94445436450640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab0bc40 con 0x55e5caaf9c60 2024-09-21T09:03:38.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.497+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab0c520 con 0x55e5caafe4d0 2024-09-21T09:03:38.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.498+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.498+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94445436452976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab0bc40 con 0x55e5caafe4d0 2024-09-21T09:03:38.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.498+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab0d080 con 0x55e5caafe4d0 2024-09-21T09:03:38.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.498+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94445436450640] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.499+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94445436452976] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.499+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.499+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94445436454032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab09ed0 con 0x55e5caafe4d0 2024-09-21T09:03:38.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.499+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab0d570 con 0x55e5caafe4d0 2024-09-21T09:03:38.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.500+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94445436454032] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.500+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.500+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94445436455824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab0d530 con 0x55e5caafe4d0 2024-09-21T09:03:38.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.500+0000 7fb6fad21800 20 add_watcher() i=0 2024-09-21T09:03:38.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.500+0000 7fb6fad21800 20 add_watcher() i=1 2024-09-21T09:03:38.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.500+0000 7fb6fad21800 20 add_watcher() i=2 2024-09-21T09:03:38.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.500+0000 7fb6fad21800 20 add_watcher() i=3 2024-09-21T09:03:38.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.500+0000 7fb6fad21800 20 add_watcher() i=4 2024-09-21T09:03:38.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.500+0000 7fb6fad21800 20 add_watcher() i=5 2024-09-21T09:03:38.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.501+0000 7fb6fad21800 20 add_watcher() i=6 2024-09-21T09:03:38.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.501+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94445436455824] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.501+0000 7fb6fad21800 20 add_watcher() i=7 2024-09-21T09:03:38.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.501+0000 7fb6fad21800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:38.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.501+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab109c0 con 0x55e5caaf9c60 2024-09-21T09:03:38.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.502+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.502+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94445436457552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab0dee0 con 0x55e5caaf9c60 2024-09-21T09:03:38.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.503+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94445436457552] v31'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.503+0000 7fb5ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:38.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.503+0000 7fb6fad21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:38.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.503+0000 7fb6fad21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:38.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.503+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab19200 con 0x55e5caaf9c60 2024-09-21T09:03:38.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.504+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.504+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab19770 con 0x55e5caafe4d0 2024-09-21T09:03:38.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.505+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.505+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab19770 con 0x55e5cab03140 2024-09-21T09:03:38.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.506+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.506+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab19c20 con 0x55e5caaf9c60 2024-09-21T09:03:38.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.507+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'153 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.507+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab17330 con 0x7fb6e809c070 2024-09-21T09:03:38.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.508+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.508+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab17330 con 0x55e5cab03140 2024-09-21T09:03:38.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.509+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.509+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab172d0 con 0x55e5caaf9c60 2024-09-21T09:03:38.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.510+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.510+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab174a0 con 0x55e5caafe4d0 2024-09-21T09:03:38.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.511+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.511+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab174a0 con 0x7fb6e809c070 2024-09-21T09:03:38.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.512+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.513+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab174a0 con 0x55e5cab03140 2024-09-21T09:03:38.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.514+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.514+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab174a0 con 0x7fb6e809c070 2024-09-21T09:03:38.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.514+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.514+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a780 con 0x55e5caafe4d0 2024-09-21T09:03:38.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.516+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.516+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a780 con 0x7fb6e809c070 2024-09-21T09:03:38.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.517+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.517+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a780 con 0x55e5caafe4d0 2024-09-21T09:03:38.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.518+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'35 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.518+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a780 con 0x55e5caaf9c60 2024-09-21T09:03:38.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.519+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'154 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.519+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a780 con 0x55e5cab03140 2024-09-21T09:03:38.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.520+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.520+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a780 con 0x7fb6e809c070 2024-09-21T09:03:38.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.521+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.521+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a870 con 0x55e5cab03140 2024-09-21T09:03:38.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.522+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.522+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a870 con 0x55e5caaf9c60 2024-09-21T09:03:38.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.523+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.523+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a810 con 0x55e5caaf9c60 2024-09-21T09:03:38.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.524+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'155 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.524+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a840 con 0x55e5cab03140 2024-09-21T09:03:38.527 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.525+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.527 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.525+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a840 con 0x7fb6e809c070 2024-09-21T09:03:38.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.526+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.526+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a810 con 0x55e5cab03140 2024-09-21T09:03:38.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.527+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.527+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a810 con 0x55e5cab03140 2024-09-21T09:03:38.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.528+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.528+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a810 con 0x55e5cab03140 2024-09-21T09:03:38.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.529+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.529+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a810 con 0x55e5cab03140 2024-09-21T09:03:38.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.530+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.530+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a810 con 0x55e5caafe4d0 2024-09-21T09:03:38.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.531+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.531+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a810 con 0x55e5cab03140 2024-09-21T09:03:38.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.532+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.532+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a810 con 0x55e5caafe4d0 2024-09-21T09:03:38.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.533+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.533+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a810 con 0x55e5cab03140 2024-09-21T09:03:38.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.535+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.535+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a810 con 0x55e5caafe4d0 2024-09-21T09:03:38.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.536+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'36 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.536+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab1a810 con 0x7fb6e809c070 2024-09-21T09:03:38.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.537+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.537+0000 7fb527fff640 20 reqs_thread_entry: start 2024-09-21T09:03:38.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.538+0000 7fb6fad21800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:38.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.538+0000 7fb6fad21800 20 Filter name: none 2024-09-21T09:03:38.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.538+0000 7fb525ffb640 20 reqs_thread_entry: start 2024-09-21T09:03:38.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.538+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.538+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.538+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.538+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.538+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.539+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.539+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caafe4d0 2024-09-21T09:03:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.539+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.539+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caafe4d0 2024-09-21T09:03:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.539+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.539+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caafe4d0 2024-09-21T09:03:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.540+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.540+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.540+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.540+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.540+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.540+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.541+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.541+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.541+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.541+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.541+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.541+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.541+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.541+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.542+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.542+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.542+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.542+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.542+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.542+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.542+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.542+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.543+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.543+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.543+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.543+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.543+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.543+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.543+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.543+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.544+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e003f040 con 0x55e5caaf9c60 2024-09-21T09:03:38.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.544+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caafe4d0 2024-09-21T09:03:38.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.544+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.544+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caafe4d0 2024-09-21T09:03:38.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.544+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.544+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caafe4d0 2024-09-21T09:03:38.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.545+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.545+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.545+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.545+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.545+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.545+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.545+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.545+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.546+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.546+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.546+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.546+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.546+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.546+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.547+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.547+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.547+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.547+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.547+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.547+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caafe4d0 2024-09-21T09:03:38.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.548+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.548+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caafe4d0 2024-09-21T09:03:38.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.548+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.548+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caafe4d0 2024-09-21T09:03:38.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.549+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.549+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.549+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.549+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.549+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.549+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.550+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e003f040 con 0x7fb6e809c070 2024-09-21T09:03:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.550+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caafe4d0 2024-09-21T09:03:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.550+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.550+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caafe4d0 2024-09-21T09:03:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.550+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv10 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.550+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caafe4d0 2024-09-21T09:03:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.551+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.551+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.551+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e004b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.551+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.551+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e004b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.551+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.552+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e004b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.552+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.552+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.552+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.552+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.552+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.552+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.552+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.553+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e004b040 con 0x7fb6e809c070 2024-09-21T09:03:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.553+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.553+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e004b040 con 0x7fb6e809c070 2024-09-21T09:03:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.553+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.553+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e004b040 con 0x7fb6e809c070 2024-09-21T09:03:38.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.553+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.553+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.553+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.553+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.553+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.554+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.554+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.554+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e004b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.554+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.554+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e004b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.554+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.554+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e004b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.554+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.555+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e004b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.555+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.555+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e004b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.555+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5caaf9c60 2024-09-21T09:03:38.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.555+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e004b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.555+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.555+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.555+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.556+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.556+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.556+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.556+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.556+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e004b040 con 0x7fb6e809c070 2024-09-21T09:03:38.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.556+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.556+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e004b040 con 0x7fb6e809c070 2024-09-21T09:03:38.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.556+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x7fb6e809c070 2024-09-21T09:03:38.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.557+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e004b040 con 0x7fb6e809c070 2024-09-21T09:03:38.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.557+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.557+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.557+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.557+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.557+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.557+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.557+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.557+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.557+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.558+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.558+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.558+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.558+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.558+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.558+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.558+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.558+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.559+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.559+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.559+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.559+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.559+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.559+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab153b0 con 0x55e5cab03140 2024-09-21T09:03:38.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.559+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 55 ==== osd_op_reply(171 gc.25 [call out=1701b] v0'0 uv29 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.559+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab469d0 con 0x55e5caafe4d0 2024-09-21T09:03:38.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.560+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.560+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab459c0 con 0x55e5caafe4d0 2024-09-21T09:03:38.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.560+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.560+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab469d0 con 0x55e5caafe4d0 2024-09-21T09:03:38.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.560+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.560+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab469d0 con 0x55e5cab03140 2024-09-21T09:03:38.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.561+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.561+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab459c0 con 0x55e5cab03140 2024-09-21T09:03:38.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.561+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.561+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab469d0 con 0x55e5cab03140 2024-09-21T09:03:38.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.561+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.561+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab469d0 con 0x55e5caafe4d0 2024-09-21T09:03:38.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.562+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.562+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab459c0 con 0x55e5caafe4d0 2024-09-21T09:03:38.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.562+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.562+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab469d0 con 0x55e5caafe4d0 2024-09-21T09:03:38.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.563+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.563+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab469d0 con 0x55e5cab03140 2024-09-21T09:03:38.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.563+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.563+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab459c0 con 0x55e5cab03140 2024-09-21T09:03:38.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.563+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.563+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab469d0 con 0x55e5cab03140 2024-09-21T09:03:38.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.563+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.563+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab469d0 con 0x55e5caafe4d0 2024-09-21T09:03:38.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.564+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.564+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab459c0 con 0x55e5caafe4d0 2024-09-21T09:03:38.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.564+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.564+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab469d0 con 0x55e5caafe4d0 2024-09-21T09:03:38.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.565+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.565+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab469d0 con 0x7fb6e809c070 2024-09-21T09:03:38.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.565+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e004b040 con 0x7fb6e809c070 2024-09-21T09:03:38.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.565+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab459c0 con 0x7fb6e809c070 2024-09-21T09:03:38.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.565+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb6e004b040 con 0x7fb6e809c070 2024-09-21T09:03:38.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.565+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab469d0 con 0x7fb6e809c070 2024-09-21T09:03:38.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.565+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb6e004b040 con 0x7fb6e809c070 2024-09-21T09:03:38.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.566+0000 7fb5ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:38.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.566+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94445436457552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab14ab0 con 0x55e5caaf9c60 2024-09-21T09:03:38.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.567+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94445436457552] v31'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb6e004b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.567+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94445436435728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab14ab0 con 0x7fb6e809c070 2024-09-21T09:03:38.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.568+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94445436435728] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e004b040 con 0x7fb6e809c070 2024-09-21T09:03:38.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.568+0000 7fb6fad21800 20 remove_watcher() i=0 2024-09-21T09:03:38.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.568+0000 7fb6fad21800 2 removed watcher, disabling cache 2024-09-21T09:03:38.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.568+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94445436433648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab07d10 con 0x55e5caaf9c60 2024-09-21T09:03:38.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.570+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94445436433648] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e004b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.570+0000 7fb6fad21800 20 remove_watcher() i=1 2024-09-21T09:03:38.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.570+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94445436439600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab07d10 con 0x55e5cab03140 2024-09-21T09:03:38.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.571+0000 7fb6f6aac640 1 -- 172.21.15.178:0/2407789388 <== osd.3 v2:172.21.15.178:6808/24558189 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94445436439600] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e80ab040 con 0x55e5cab03140 2024-09-21T09:03:38.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.571+0000 7fb6fad21800 20 remove_watcher() i=2 2024-09-21T09:03:38.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.571+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94445436446416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab07d10 con 0x7fb6e809c070 2024-09-21T09:03:38.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.572+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.2 v2:172.21.15.178:6816/3267136144 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94445436446416] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e004b040 con 0x7fb6e809c070 2024-09-21T09:03:38.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.572+0000 7fb6fad21800 20 remove_watcher() i=3 2024-09-21T09:03:38.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.572+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94445436450640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab0a6d0 con 0x55e5caaf9c60 2024-09-21T09:03:38.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.573+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 <== osd.1 v2:172.21.15.178:6800/627496675 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94445436450640] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e004b040 con 0x55e5caaf9c60 2024-09-21T09:03:38.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.573+0000 7fb6fad21800 20 remove_watcher() i=4 2024-09-21T09:03:38.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.573+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94445436452976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab07d10 con 0x55e5caafe4d0 2024-09-21T09:03:38.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.574+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94445436452976] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.574+0000 7fb6fad21800 20 remove_watcher() i=5 2024-09-21T09:03:38.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.574+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94445436454032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab0b750 con 0x55e5caafe4d0 2024-09-21T09:03:38.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.575+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94445436454032] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.575+0000 7fb6fad21800 20 remove_watcher() i=6 2024-09-21T09:03:38.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.575+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94445436455824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cab0a6d0 con 0x55e5caafe4d0 2024-09-21T09:03:38.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6f72ad640 1 -- 172.21.15.178:0/2407789388 <== osd.0 v2:172.21.15.44:6800/2732047064 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94445436455824] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f002a070 con 0x55e5caafe4d0 2024-09-21T09:03:38.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 20 remove_watcher() i=7 2024-09-21T09:03:38.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e5caafe4d0 msgr2=0x55e5cab008e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e5caafe4d0 0x55e5cab008e0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e5caaf9c60 msgr2=0x55e5caafc120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e5caaf9c60 0x55e5caafc120 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb6e809c070 msgr2=0x7fb6e806b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb6e809c070 0x7fb6e806b3f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e5cab03140 msgr2=0x55e5cab05600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55e5cab03140 0x55e5cab05600 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5c0036b40 msgr2=0x7fb5c0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5c0036b40 0x7fb5c0039000 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb6e806cfd0 tx=0x7fb6e8081000 comp rx=0 tx=0).stop 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5caae6d30 msgr2=0x55e5caaee170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 --2- 172.21.15.178:0/2407789388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5caae6d30 0x55e5caaee170 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb6f003d040 tx=0x7fb6f004cf50 comp rx=0 tx=0).stop 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 reap_dead start 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6f62ab640 1 -- 172.21.15.178:0/2407789388 reap_dead start 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 shutdown_connections 2024-09-21T09:03:38.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 >> 172.21.15.178:0/2407789388 conn(0x55e5caae30e0 msgr2=0x55e5caae8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 shutdown_connections 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 -- 172.21.15.178:0/2407789388 wait complete. 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 -- 172.21.15.178:0/4072161343 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5d0036b40 msgr2=0x7fb5d0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 --2- 172.21.15.178:0/4072161343 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5d0036b40 0x7fb5d0039000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55e5caac4b80 tx=0x7fb6e8046130 comp rx=0 tx=0).stop 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 -- 172.21.15.178:0/4072161343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c73b0 msgr2=0x55e5ca9c5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 --2- 172.21.15.178:0/4072161343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c73b0 0x55e5ca9c5a00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55e5caabe5d0 tx=0x7fb6f0007740 comp rx=0 tx=0).stop 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 -- 172.21.15.178:0/4072161343 shutdown_connections 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 --2- 172.21.15.178:0/4072161343 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5d0036b40 0x7fb5d0039000 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 --2- 172.21.15.178:0/4072161343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c73b0 0x55e5ca9c5a00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.577+0000 7fb6fad21800 1 -- 172.21.15.178:0/4072161343 >> 172.21.15.178:0/4072161343 conn(0x55e5caacce60 msgr2=0x55e5caacf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 -- 172.21.15.178:0/4072161343 shutdown_connections 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 -- 172.21.15.178:0/4072161343 wait complete. 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e5caac6a10 msgr2=0x55e5caac8e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e5caac6a10 0x55e5caac8e00 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e5ca9c52d0 msgr2=0x55e5caac4110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e5ca9c52d0 0x55e5caac4110 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5dc036b90 msgr2=0x7fb5dc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5dc036b90 0x7fb5dc039050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0000f60 tx=0x7fb6e0001370 comp rx=0 tx=0).stop 2024-09-21T09:03:38.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 msgr2=0x55e5caabd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5caabd1d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8045d30 tx=0x7fb6e8003330 comp rx=0 tx=0).stop 2024-09-21T09:03:38.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 shutdown_connections 2024-09-21T09:03:38.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55e5caac6a10 0x55e5caac8e00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55e5ca9c52d0 0x55e5caac4110 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5dc036b90 0x7fb5dc039050 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 --2- 172.21.15.178:0/829674191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5ca9c4990 0x55e5caabd1d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 >> 172.21.15.178:0/829674191 conn(0x55e5ca9c05c0 msgr2=0x55e5caaafac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 shutdown_connections 2024-09-21T09:03:38.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.578+0000 7fb6fad21800 1 -- 172.21.15.178:0/829674191 wait complete. 2024-09-21T09:03:38.588 INFO:teuthology.orchestra.run.smithi178.stdout:[{"tag":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9137741560101507819\u0000","time":"2024-09-21T09:03:38.379772+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_7","key":"","instance":""}]}] 2024-09-21T09:03:38.588 DEBUG:tasks.util.rgw: json result: [{'tag': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9137741560101507819\x00', 'time': '2024-09-21T09:03:38.379772+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_7', 'key': '', 'instance': ''}]}] 2024-09-21T09:03:38.588 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-21T09:03:38.589 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-21T09:03:38.589 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-21T09:03:38.630 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:38.630 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:38.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.629+0000 7fd034726800 1 Processor -- start 2024-09-21T09:03:38.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.629+0000 7fd034726800 1 -- start start 2024-09-21T09:03:38.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.630+0000 7fd034726800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x558e6e157a90 0x558e6e157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.630+0000 7fd034726800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558e6e017b30 con 0x558e6e158400 2024-09-21T09:03:38.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.630+0000 7fd034726800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x558e6dff9360 con 0x558e6e157a90 2024-09-21T09:03:38.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.630+0000 7fd0303e3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x558e6e157a90 0x558e6e157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.630+0000 7fd02fbe2640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x558e6e158400 0x558e6e15c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:45114/0 (socket says 172.21.15.178:45114) 2024-09-21T09:03:38.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.630+0000 7fd0303e3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x558e6e157a90 0x558e6e157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49406/0 (socket says 172.21.15.178:49406) 2024-09-21T09:03:38.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.630+0000 7fd02fbe2640 1 -- 172.21.15.178:0/2090457046 learned_addr learned my addr 172.21.15.178:0/2090457046 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:38.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.630+0000 7fd0303e3640 1 -- 172.21.15.178:0/2090457046 >> v1:172.21.15.44:6789/0 conn(0x558e6e158400 legacy=0x558e6e15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.630+0000 7fd0303e3640 1 -- 172.21.15.178:0/2090457046 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e6e01fe00 con 0x558e6e157a90 2024-09-21T09:03:38.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.632+0000 7fd0303e3640 1 --2- 172.21.15.178:0/2090457046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e157e90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd028005fd0 tx=0x7fd028045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e984dda27f7c97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.632+0000 7fd02f3e1640 1 -- 172.21.15.178:0/2090457046 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd028058530 con 0x558e6e157a90 2024-09-21T09:03:38.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.632+0000 7fd02f3e1640 1 -- 172.21.15.178:0/2090457046 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0280586d0 con 0x558e6e157a90 2024-09-21T09:03:38.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.633+0000 7fd02f3e1640 1 -- 172.21.15.178:0/2090457046 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0280589d0 con 0x558e6e157a90 2024-09-21T09:03:38.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.633+0000 7fd034726800 1 -- 172.21.15.178:0/2090457046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 msgr2=0x558e6e157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.633+0000 7fd034726800 1 --2- 172.21.15.178:0/2090457046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e157e90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd028005fd0 tx=0x7fd028045c30 comp rx=0 tx=0).stop 2024-09-21T09:03:38.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.633+0000 7fd034726800 1 -- 172.21.15.178:0/2090457046 shutdown_connections 2024-09-21T09:03:38.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.633+0000 7fd034726800 1 --2- 172.21.15.178:0/2090457046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e157e90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.633+0000 7fd034726800 1 -- 172.21.15.178:0/2090457046 >> 172.21.15.178:0/2090457046 conn(0x558e6e1525b0 msgr2=0x558e6e1549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.633+0000 7fd034726800 1 -- 172.21.15.178:0/2090457046 shutdown_connections 2024-09-21T09:03:38.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.633+0000 7fd034726800 1 -- 172.21.15.178:0/2090457046 wait complete. 2024-09-21T09:03:38.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.647+0000 7fd034726800 1 Processor -- start 2024-09-21T09:03:38.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.647+0000 7fd034726800 1 -- start start 2024-09-21T09:03:38.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.647+0000 7fd034726800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e157220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.647+0000 7fd034726800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558e6e0a4320 con 0x558e6e157a90 2024-09-21T09:03:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.647+0000 7fd0303e3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.647+0000 7fd0303e3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49410/0 (socket says 172.21.15.178:49410) 2024-09-21T09:03:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.647+0000 7fd0303e3640 1 -- 172.21.15.178:0/524148079 learned_addr learned my addr 172.21.15.178:0/524148079 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.648+0000 7fd0303e3640 1 -- 172.21.15.178:0/524148079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e6dff1bc0 con 0x558e6e157a90 2024-09-21T09:03:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.648+0000 7fd0303e3640 1 --2- 172.21.15.178:0/524148079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e157220 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd02800a3f0 tx=0x7fd028051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78faffb3699acbe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.648+0000 7fcf1e60c640 1 -- 172.21.15.178:0/524148079 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd028058a30 con 0x558e6e157a90 2024-09-21T09:03:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.648+0000 7fcf1e60c640 1 -- 172.21.15.178:0/524148079 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd028068070 con 0x558e6e157a90 2024-09-21T09:03:38.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.648+0000 7fcf1e60c640 1 -- 172.21.15.178:0/524148079 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd028058d60 con 0x558e6e157a90 2024-09-21T09:03:38.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.649+0000 7fd034726800 1 -- 172.21.15.178:0/524148079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 msgr2=0x558e6e157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.649+0000 7fd034726800 1 --2- 172.21.15.178:0/524148079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e157220 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd02800a3f0 tx=0x7fd028051000 comp rx=0 tx=0).stop 2024-09-21T09:03:38.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.649+0000 7fd034726800 1 -- 172.21.15.178:0/524148079 shutdown_connections 2024-09-21T09:03:38.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.649+0000 7fd034726800 1 --2- 172.21.15.178:0/524148079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e157220 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.649+0000 7fd034726800 1 -- 172.21.15.178:0/524148079 >> 172.21.15.178:0/524148079 conn(0x558e6e1525b0 msgr2=0x558e6e242100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.649+0000 7fd034726800 1 -- 172.21.15.178:0/524148079 shutdown_connections 2024-09-21T09:03:38.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.649+0000 7fd034726800 1 -- 172.21.15.178:0/524148079 wait complete. 2024-09-21T09:03:38.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.649+0000 7fd034726800 1 Processor -- start 2024-09-21T09:03:38.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.649+0000 7fd034726800 1 -- start start 2024-09-21T09:03:38.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.649+0000 7fd034726800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e24f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.649+0000 7fd034726800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558e6e15e540 con 0x558e6e157a90 2024-09-21T09:03:38.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.650+0000 7fd0303e3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e24f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.650+0000 7fd0303e3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e24f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49420/0 (socket says 172.21.15.178:49420) 2024-09-21T09:03:38.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.650+0000 7fd0303e3640 1 -- 172.21.15.178:0/3290435058 learned_addr learned my addr 172.21.15.178:0/3290435058 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.650+0000 7fd0303e3640 1 -- 172.21.15.178:0/3290435058 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e6e005fe0 con 0x558e6e157a90 2024-09-21T09:03:38.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.650+0000 7fd0303e3640 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e24f100 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd028046130 tx=0x7fd028003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.650+0000 7fcf1ce09640 1 -- 172.21.15.178:0/3290435058 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0280636b0 con 0x558e6e157a90 2024-09-21T09:03:38.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.650+0000 7fcf1ce09640 1 -- 172.21.15.178:0/3290435058 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd028063850 con 0x558e6e157a90 2024-09-21T09:03:38.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.650+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e6e24f640 con 0x558e6e157a90 2024-09-21T09:03:38.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.650+0000 7fcf1ce09640 1 -- 172.21.15.178:0/3290435058 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd028063b70 con 0x558e6e157a90 2024-09-21T09:03:38.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.650+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e6e24fb60 con 0x558e6e157a90 2024-09-21T09:03:38.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.651+0000 7fcf1ce09640 1 -- 172.21.15.178:0/3290435058 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd028075020 con 0x558e6e157a90 2024-09-21T09:03:38.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.651+0000 7fcf1ce09640 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf18036b90 0x7fcf18039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.651+0000 7fcf1ce09640 1 -- 172.21.15.178:0/3290435058 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fd028090dc0 con 0x558e6e157a90 2024-09-21T09:03:38.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.651+0000 7fd02fbe2640 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf18036b90 0x7fcf18039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.652+0000 7fd034726800 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558e6e158400 0x558e6e256170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.652+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2566b0 con 0x558e6e158400 2024-09-21T09:03:38.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.652+0000 7fd030be4640 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558e6e158400 0x558e6e256170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.652+0000 7fd02fbe2640 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf18036b90 0x7fcf18039050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd024000f60 tx=0x7fd0240012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.652+0000 7fd030be4640 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558e6e158400 0x558e6e256170 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.652+0000 7fd030be4640 1 -- 172.21.15.178:0/3290435058 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0200083e0 con 0x558e6e158400 2024-09-21T09:03:38.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.652+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e253700 con 0x558e6e158400 2024-09-21T09:03:38.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.652+0000 7fd030be4640 1 -- 172.21.15.178:0/3290435058 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd0200083e0 con 0x558e6e158400 2024-09-21T09:03:38.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.653+0000 7fd034726800 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558e6e258980 0x558e6e25ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.653+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e25b440 con 0x558e6e258980 2024-09-21T09:03:38.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.653+0000 7fd0303e3640 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558e6e258980 0x558e6e25ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.653+0000 7fd0303e3640 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558e6e258980 0x558e6e25ad70 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.654+0000 7fd0303e3640 1 -- 172.21.15.178:0/3290435058 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e258980 2024-09-21T09:03:38.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.654+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e257820 con 0x558e6e158400 2024-09-21T09:03:38.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.654+0000 7fd030be4640 1 -- 172.21.15.178:0/3290435058 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd0200083e0 con 0x558e6e158400 2024-09-21T09:03:38.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.654+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e257cc0 con 0x558e6e158400 2024-09-21T09:03:38.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.654+0000 7fd030be4640 1 -- 172.21.15.178:0/3290435058 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd0200083e0 con 0x558e6e158400 2024-09-21T09:03:38.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.654+0000 7fd034726800 1 Processor -- start 2024-09-21T09:03:38.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.654+0000 7fd034726800 1 -- start start 2024-09-21T09:03:38.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.655+0000 7fd034726800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e269e10 0x558e6e26a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.655+0000 7fd034726800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558e6dff3580 con 0x558e6e269e10 2024-09-21T09:03:38.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.655+0000 7fd030be4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e269e10 0x558e6e26a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.655+0000 7fd030be4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e269e10 0x558e6e26a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49424/0 (socket says 172.21.15.178:49424) 2024-09-21T09:03:38.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.655+0000 7fd030be4640 1 -- 172.21.15.178:0/3925262987 learned_addr learned my addr 172.21.15.178:0/3925262987 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.655+0000 7fd030be4640 1 -- 172.21.15.178:0/3925262987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e6e26a770 con 0x558e6e269e10 2024-09-21T09:03:38.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.655+0000 7fd030be4640 1 --2- 172.21.15.178:0/3925262987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e269e10 0x558e6e26a230 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x558e6e2501b0 tx=0x7fd02000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.656+0000 7fcf15ffb640 1 -- 172.21.15.178:0/3925262987 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd020007d00 con 0x558e6e269e10 2024-09-21T09:03:38.660 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.656+0000 7fcf15ffb640 1 -- 172.21.15.178:0/3925262987 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02001e020 con 0x558e6e269e10 2024-09-21T09:03:38.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.656+0000 7fd034726800 1 -- 172.21.15.178:0/3925262987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e6e26aa00 con 0x558e6e269e10 2024-09-21T09:03:38.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.656+0000 7fcf15ffb640 1 -- 172.21.15.178:0/3925262987 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd020019420 con 0x558e6e269e10 2024-09-21T09:03:38.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.656+0000 7fd034726800 1 -- 172.21.15.178:0/3925262987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e6e26d6e0 con 0x558e6e269e10 2024-09-21T09:03:38.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.656+0000 7fcf15ffb640 1 -- 172.21.15.178:0/3925262987 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd020016040 con 0x558e6e269e10 2024-09-21T09:03:38.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.657+0000 7fcf15ffb640 1 --2- 172.21.15.178:0/3925262987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf08036b40 0x7fcf08039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.657+0000 7fcf15ffb640 1 -- 172.21.15.178:0/3925262987 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fd02001f030 con 0x558e6e269e10 2024-09-21T09:03:38.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.657+0000 7fd0303e3640 1 --2- 172.21.15.178:0/3925262987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf08036b40 0x7fcf08039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.657+0000 7fd034726800 1 Processor -- start 2024-09-21T09:03:38.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.657+0000 7fd0303e3640 1 --2- 172.21.15.178:0/3925262987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf08036b40 0x7fcf08039000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x558e6e256ab0 tx=0x7fd028000f40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.657+0000 7fd034726800 1 -- start start 2024-09-21T09:03:38.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.657+0000 7fd034726800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e246560 0x558e6e246960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.657+0000 7fd034726800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558e6e24a660 con 0x558e6e246560 2024-09-21T09:03:38.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.658+0000 7fd030be4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e246560 0x558e6e246960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.658+0000 7fd030be4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e246560 0x558e6e246960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49438/0 (socket says 172.21.15.178:49438) 2024-09-21T09:03:38.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.658+0000 7fd030be4640 1 -- 172.21.15.178:0/1803435069 learned_addr learned my addr 172.21.15.178:0/1803435069 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.658+0000 7fd030be4640 1 -- 172.21.15.178:0/1803435069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e6e246f30 con 0x558e6e246560 2024-09-21T09:03:38.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.658+0000 7fd030be4640 1 --2- 172.21.15.178:0/1803435069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e246560 0x558e6e246960 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd02004cf20 tx=0x7fd020017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7048092152c4a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.658+0000 7fcf0f7fe640 1 -- 172.21.15.178:0/1803435069 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd02001d030 con 0x558e6e246560 2024-09-21T09:03:38.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.658+0000 7fcf0f7fe640 1 -- 172.21.15.178:0/1803435069 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd020015d00 con 0x558e6e246560 2024-09-21T09:03:38.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.658+0000 7fcf0f7fe640 1 -- 172.21.15.178:0/1803435069 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0200197f0 con 0x558e6e246560 2024-09-21T09:03:38.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.658+0000 7fd034726800 1 -- 172.21.15.178:0/1803435069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e246560 msgr2=0x558e6e246960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.658+0000 7fd034726800 1 --2- 172.21.15.178:0/1803435069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e246560 0x558e6e246960 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd02004cf20 tx=0x7fd020017fa0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.659+0000 7fd034726800 1 -- 172.21.15.178:0/1803435069 shutdown_connections 2024-09-21T09:03:38.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.659+0000 7fd034726800 1 --2- 172.21.15.178:0/1803435069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e246560 0x558e6e246960 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.659+0000 7fd034726800 1 -- 172.21.15.178:0/1803435069 >> 172.21.15.178:0/1803435069 conn(0x558e6e272d60 msgr2=0x558e6e270eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.659+0000 7fd034726800 1 -- 172.21.15.178:0/1803435069 shutdown_connections 2024-09-21T09:03:38.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.659+0000 7fd034726800 1 -- 172.21.15.178:0/1803435069 wait complete. 2024-09-21T09:03:38.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.659+0000 7fd034726800 1 Processor -- start 2024-09-21T09:03:38.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.659+0000 7fd034726800 1 -- start start 2024-09-21T09:03:38.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.659+0000 7fd034726800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e246560 0x558e6e27ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.659+0000 7fd034726800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558e6e247530 con 0x558e6e246560 2024-09-21T09:03:38.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.659+0000 7fd030be4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e246560 0x558e6e27ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.659+0000 7fd030be4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e246560 0x558e6e27ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49440/0 (socket says 172.21.15.178:49440) 2024-09-21T09:03:38.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.659+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 learned_addr learned my addr 172.21.15.178:0/1795156844 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.660+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e6e2804d0 con 0x558e6e246560 2024-09-21T09:03:38.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.660+0000 7fd030be4640 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e246560 0x558e6e27ff90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd02003d040 tx=0x7fd02004ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.660+0000 7fcf0dffb640 1 -- 172.21.15.178:0/1795156844 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd02003b070 con 0x558e6e246560 2024-09-21T09:03:38.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.660+0000 7fcf0dffb640 1 -- 172.21.15.178:0/1795156844 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd020019b70 con 0x558e6e246560 2024-09-21T09:03:38.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.660+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e6e280760 con 0x558e6e246560 2024-09-21T09:03:38.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.660+0000 7fcf0dffb640 1 -- 172.21.15.178:0/1795156844 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0200179a0 con 0x558e6e246560 2024-09-21T09:03:38.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.660+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e6e283410 con 0x558e6e246560 2024-09-21T09:03:38.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.661+0000 7fcf0dffb640 1 -- 172.21.15.178:0/1795156844 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd0200153e0 con 0x558e6e246560 2024-09-21T09:03:38.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.661+0000 7fcf0dffb640 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf00036af0 0x7fcf00038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.661+0000 7fcf0dffb640 1 -- 172.21.15.178:0/1795156844 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fd020037ba0 con 0x558e6e246560 2024-09-21T09:03:38.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.661+0000 7fd0303e3640 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf00036af0 0x7fcf00038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd034726800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd034726800 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558e6e28bae0 0x558e6e28dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e28e6f0 con 0x558e6e28bae0 2024-09-21T09:03:38.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd0303e3640 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf00036af0 0x7fcf00038fb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x558e6e25b840 tx=0x7fd028094000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd02fbe2640 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558e6e28bae0 0x558e6e28dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd02fbe2640 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558e6e28bae0 0x558e6e28dfa0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd024009050 con 0x558e6e28bae0 2024-09-21T09:03:38.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd034726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd034726800 20 realm 2024-09-21T09:03:38.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd034726800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e28af30 con 0x558e6e28bae0 2024-09-21T09:03:38.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd024009050 con 0x558e6e28bae0 2024-09-21T09:03:38.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd034726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd034726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:38.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.662+0000 7fd034726800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.663+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e28f1e0 con 0x558e6e28bae0 2024-09-21T09:03:38.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.663+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd024009050 con 0x558e6e28bae0 2024-09-21T09:03:38.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.663+0000 7fd034726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.663+0000 7fd034726800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.663+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e28fab0 con 0x558e6e28bae0 2024-09-21T09:03:38.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.663+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd024009050 con 0x558e6e28bae0 2024-09-21T09:03:38.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.663+0000 7fd034726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:38.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.663+0000 7fd034726800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.663+0000 7fd034726800 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558e6e2903f0 0x558e6e292800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.663+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e292f90 con 0x558e6e2903f0 2024-09-21T09:03:38.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.663+0000 7fd030be4640 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558e6e2903f0 0x558e6e292800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.664+0000 7fd030be4640 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558e6e2903f0 0x558e6e292800 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.664+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.664+0000 7fd034726800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:38.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.664+0000 7fd034726800 20 searching for the correct realm 2024-09-21T09:03:38.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.664+0000 7fd034726800 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558e6e294f60 0x558e6e297420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.664+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e294f60 2024-09-21T09:03:38.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.664+0000 7fd0303e3640 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558e6e294f60 0x558e6e297420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.665+0000 7fd0303e3640 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558e6e294f60 0x558e6e297420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.665+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.665+0000 7fd0303e3640 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd028089680 0x7fd028089aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.665+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x7fd028089680 2024-09-21T09:03:38.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.665+0000 7fd02fbe2640 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd028089680 0x7fd028089aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.665+0000 7fd02fbe2640 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd028089680 0x7fd028089aa0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.666+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd024009050 con 0x7fd028089680 2024-09-21T09:03:38.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.666+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e2903f0 2024-09-21T09:03:38.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.666+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.666+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e28bae0 2024-09-21T09:03:38.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.666+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd024009050 con 0x558e6e28bae0 2024-09-21T09:03:38.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.666+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e28bae0 2024-09-21T09:03:38.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.666+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd024029040 con 0x558e6e28bae0 2024-09-21T09:03:38.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.666+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e2903f0 2024-09-21T09:03:38.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.667+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.667+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e2903f0 2024-09-21T09:03:38.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.667+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.667+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x7fd028089680 2024-09-21T09:03:38.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.667+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd024029040 con 0x7fd028089680 2024-09-21T09:03:38.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.667+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e294f60 2024-09-21T09:03:38.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.667+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.667+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e28bae0 2024-09-21T09:03:38.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.668+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd024029040 con 0x558e6e28bae0 2024-09-21T09:03:38.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.668+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e2903f0 2024-09-21T09:03:38.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.668+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.668+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e28bae0 2024-09-21T09:03:38.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.668+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd024029040 con 0x558e6e28bae0 2024-09-21T09:03:38.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.668+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x7fd028089680 2024-09-21T09:03:38.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.668+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd024029040 con 0x7fd028089680 2024-09-21T09:03:38.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.668+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e294f60 2024-09-21T09:03:38.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.669+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.669+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e294f60 2024-09-21T09:03:38.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.669+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.669+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e2903f0 2024-09-21T09:03:38.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.669+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.669+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e294f60 2024-09-21T09:03:38.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.670+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.670+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e294f60 2024-09-21T09:03:38.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.670+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.670+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e28bae0 2024-09-21T09:03:38.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.670+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd024029040 con 0x558e6e28bae0 2024-09-21T09:03:38.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.670+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e28bae0 2024-09-21T09:03:38.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.670+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd024029040 con 0x558e6e28bae0 2024-09-21T09:03:38.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.670+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e2903f0 2024-09-21T09:03:38.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.671+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.671+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e294f60 2024-09-21T09:03:38.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.671+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.671+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x7fd028089680 2024-09-21T09:03:38.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.671+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd024029040 con 0x7fd028089680 2024-09-21T09:03:38.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.671+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e28bae0 2024-09-21T09:03:38.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.671+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd024029040 con 0x558e6e28bae0 2024-09-21T09:03:38.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.671+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e2903f0 2024-09-21T09:03:38.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.672+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.672+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e294f60 2024-09-21T09:03:38.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.672+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.672+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x7fd028089680 2024-09-21T09:03:38.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.672+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd024029040 con 0x7fd028089680 2024-09-21T09:03:38.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.672+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x7fd028089680 2024-09-21T09:03:38.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.672+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd024029040 con 0x7fd028089680 2024-09-21T09:03:38.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.672+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e294f60 2024-09-21T09:03:38.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.672+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.672+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e2903f0 2024-09-21T09:03:38.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.673+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.673+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x558e6e28bae0 2024-09-21T09:03:38.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.673+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd024029040 con 0x558e6e28bae0 2024-09-21T09:03:38.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.673+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297af0 con 0x7fd028089680 2024-09-21T09:03:38.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.673+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd024029040 con 0x7fd028089680 2024-09-21T09:03:38.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.673+0000 7fd034726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:38.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.673+0000 7fd034726800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:38.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.673+0000 7fd034726800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:38.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.673+0000 7fd034726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:38.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.673+0000 7fd034726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:38.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.673+0000 7fd034726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:38.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.673+0000 7fd034726800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.673+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e293950 con 0x558e6e28bae0 2024-09-21T09:03:38.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd024029040 con 0x558e6e28bae0 2024-09-21T09:03:38.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e293590 con 0x558e6e28bae0 2024-09-21T09:03:38.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:38.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2942f0 con 0x558e6e28bae0 2024-09-21T09:03:38.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:38.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 20 zone default found 2024-09-21T09:03:38.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 4 Realm: () 2024-09-21T09:03:38.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:38.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:38.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:38.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 20 zonegroup default 2024-09-21T09:03:38.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.674+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e297fb0 con 0x558e6e2903f0 2024-09-21T09:03:38.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.675+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.675+0000 7fd034726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.675+0000 7fd034726800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.675+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29a280 con 0x558e6e294f60 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.675+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.675+0000 7fd034726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.675+0000 7fd034726800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.675+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29a620 con 0x558e6e294f60 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.675+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.675+0000 7fd034726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.675+0000 7fd034726800 20 started sync module instance, tier type = 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.675+0000 7fd034726800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.675+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2996c0 con 0x7fd028089680 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.676+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.676+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94070221937632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2996c0 con 0x7fd028089680 2024-09-21T09:03:38.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.676+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29afe0 con 0x558e6e28bae0 2024-09-21T09:03:38.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.677+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94070221937632] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.678+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.678+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94070221942032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2996c0 con 0x558e6e28bae0 2024-09-21T09:03:38.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.678+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29ba70 con 0x558e6e294f60 2024-09-21T09:03:38.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.679+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94070221942032] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.679+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.679+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94070221935120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e299630 con 0x558e6e294f60 2024-09-21T09:03:38.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.679+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29c930 con 0x7fd028089680 2024-09-21T09:03:38.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.680+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.680+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94070221948544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29d1d0 con 0x7fd028089680 2024-09-21T09:03:38.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.680+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29dc80 con 0x558e6e28bae0 2024-09-21T09:03:38.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.680+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94070221935120] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.681+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94070221948544] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.682+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.682+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94070221946464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29cc20 con 0x558e6e28bae0 2024-09-21T09:03:38.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.682+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29d1b0 con 0x558e6e2903f0 2024-09-21T09:03:38.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.683+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94070221946464] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.683+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.683+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94070221952864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29d1b0 con 0x558e6e2903f0 2024-09-21T09:03:38.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.683+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29eb40 con 0x558e6e2903f0 2024-09-21T09:03:38.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.684+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(56 notify.6 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.684+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94070221956752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29efa0 con 0x558e6e2903f0 2024-09-21T09:03:38.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.684+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29fa80 con 0x558e6e2903f0 2024-09-21T09:03:38.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.684+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94070221952864] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.685+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94070221956752] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.685+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.685+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94070221955184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29f590 con 0x558e6e2903f0 2024-09-21T09:03:38.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.685+0000 7fd034726800 20 add_watcher() i=0 2024-09-21T09:03:38.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.685+0000 7fd034726800 20 add_watcher() i=1 2024-09-21T09:03:38.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.685+0000 7fd034726800 20 add_watcher() i=2 2024-09-21T09:03:38.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.685+0000 7fd034726800 20 add_watcher() i=3 2024-09-21T09:03:38.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.685+0000 7fd034726800 20 add_watcher() i=4 2024-09-21T09:03:38.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.685+0000 7fd034726800 20 add_watcher() i=5 2024-09-21T09:03:38.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.685+0000 7fd034726800 20 add_watcher() i=6 2024-09-21T09:03:38.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.686+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94070221955184] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.686+0000 7fd034726800 20 add_watcher() i=7 2024-09-21T09:03:38.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.686+0000 7fd034726800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:38.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.686+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29f590 con 0x558e6e28bae0 2024-09-21T09:03:38.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.687+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.687+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94070221957808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29f590 con 0x558e6e28bae0 2024-09-21T09:03:38.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.688+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94070221957808] v31'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.688+0000 7fcee67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:38.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.688+0000 7fd034726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:38.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.688+0000 7fd034726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:38.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.688+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ab480 con 0x558e6e28bae0 2024-09-21T09:03:38.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.689+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.689+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2abb50 con 0x558e6e2903f0 2024-09-21T09:03:38.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.690+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.690+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2abb50 con 0x558e6e294f60 2024-09-21T09:03:38.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.691+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.691+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ac570 con 0x558e6e28bae0 2024-09-21T09:03:38.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.692+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'158 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.692+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2a7290 con 0x7fd028089680 2024-09-21T09:03:38.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.693+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'47 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.693+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad0d0 con 0x558e6e294f60 2024-09-21T09:03:38.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.694+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.694+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2acf00 con 0x558e6e28bae0 2024-09-21T09:03:38.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.695+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.695+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2acf00 con 0x558e6e2903f0 2024-09-21T09:03:38.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.697+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.697+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2acf90 con 0x7fd028089680 2024-09-21T09:03:38.699 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.698+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.698+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2acf90 con 0x558e6e294f60 2024-09-21T09:03:38.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.699+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.699+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad5a0 con 0x7fd028089680 2024-09-21T09:03:38.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.700+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.700+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e2903f0 2024-09-21T09:03:38.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.701+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.701+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x7fd028089680 2024-09-21T09:03:38.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.702+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.702+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e2903f0 2024-09-21T09:03:38.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.703+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'37 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.703+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e28bae0 2024-09-21T09:03:38.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.704+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'159 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.704+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e294f60 2024-09-21T09:03:38.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.705+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.705+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x7fd028089680 2024-09-21T09:03:38.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.706+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.706+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e294f60 2024-09-21T09:03:38.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.707+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.707+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e28bae0 2024-09-21T09:03:38.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.708+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.708+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e28bae0 2024-09-21T09:03:38.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.709+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.709+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e294f60 2024-09-21T09:03:38.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.710+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.710+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x7fd028089680 2024-09-21T09:03:38.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.711+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.711+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e294f60 2024-09-21T09:03:38.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.712+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.714 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.712+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e294f60 2024-09-21T09:03:38.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.713+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.713+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e294f60 2024-09-21T09:03:38.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.714+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.714+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e294f60 2024-09-21T09:03:38.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.715+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.715+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e2903f0 2024-09-21T09:03:38.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.716+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.716+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e294f60 2024-09-21T09:03:38.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.717+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.717+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e2903f0 2024-09-21T09:03:38.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.718+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.718+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e294f60 2024-09-21T09:03:38.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.719+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.719+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ad520 con 0x558e6e2903f0 2024-09-21T09:03:38.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.720+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'38 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.720+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2a6c20 con 0x7fd028089680 2024-09-21T09:03:38.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.721+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.722+0000 7fcee57e2640 20 reqs_thread_entry: start 2024-09-21T09:03:38.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.722+0000 7fd034726800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:38.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.722+0000 7fd034726800 20 Filter name: none 2024-09-21T09:03:38.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.722+0000 7fce56ffd640 20 reqs_thread_entry: start 2024-09-21T09:03:38.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.722+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-21T09:03:38.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.722+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:94 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.723+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(94 gc.17 [call] v31'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.723+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:95 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.723+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 27 ==== osd_op_reply(95 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.723+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.723+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:96 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d8530 con 0x558e6e294f60 2024-09-21T09:03:38.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.723+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 28 ==== osd_op_reply(96 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.723+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:97 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.724+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 29 ==== osd_op_reply(97 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.724+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.724+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:98 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.724+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 30 ==== osd_op_reply(98 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.724+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.724+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:99 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.725+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 31 ==== osd_op_reply(99 gc.17 [call] v31'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.725+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-21T09:03:38.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.725+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:100 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e28bae0 2024-09-21T09:03:38.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.726+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(100 gc.18 [call] v31'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.726+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:101 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e28bae0 2024-09-21T09:03:38.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.726+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(101 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.726+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.726+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:102 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d8530 con 0x558e6e28bae0 2024-09-21T09:03:38.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.726+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(102 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.727+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:103 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e28bae0 2024-09-21T09:03:38.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.727+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(103 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.727+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.727+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:104 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e28bae0 2024-09-21T09:03:38.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.727+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(104 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.727+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.727+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:105 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e28bae0 2024-09-21T09:03:38.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.728+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== osd_op_reply(105 gc.18 [call] v31'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.728+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-21T09:03:38.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.728+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:106 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e28bae0 2024-09-21T09:03:38.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.729+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(106 gc.19 [call] v31'161 uv161 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.729+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:107 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e28bae0 2024-09-21T09:03:38.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.729+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 35 ==== osd_op_reply(107 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.729+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.729+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:108 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d8530 con 0x558e6e28bae0 2024-09-21T09:03:38.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.730+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 36 ==== osd_op_reply(108 gc.19 [call out=24b] v0'0 uv161 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.730+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:109 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e28bae0 2024-09-21T09:03:38.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.730+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 37 ==== osd_op_reply(109 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.730+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.730+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:110 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e28bae0 2024-09-21T09:03:38.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.730+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 38 ==== osd_op_reply(110 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.730+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.730+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:111 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e28bae0 2024-09-21T09:03:38.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.731+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 39 ==== osd_op_reply(111 gc.19 [call] v31'162 uv162 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.731+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-21T09:03:38.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.731+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:112 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.732+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 32 ==== osd_op_reply(112 gc.20 [call] v31'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.733+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:113 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.733+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 33 ==== osd_op_reply(113 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.733+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.733+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:114 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d8530 con 0x558e6e294f60 2024-09-21T09:03:38.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.733+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 34 ==== osd_op_reply(114 gc.20 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.733+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:115 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.733+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 35 ==== osd_op_reply(115 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.733+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.733+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:116 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.733+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 36 ==== osd_op_reply(116 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.733+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.733+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:117 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.735+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 37 ==== osd_op_reply(117 gc.20 [call] v31'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.735+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-21T09:03:38.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.735+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:118 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x7fd028089680 2024-09-21T09:03:38.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.736+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(118 gc.21 [call] v31'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.736+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:119 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x7fd028089680 2024-09-21T09:03:38.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.736+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(119 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.736+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.736+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:120 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d8530 con 0x7fd028089680 2024-09-21T09:03:38.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.737+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 21 ==== osd_op_reply(120 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.737+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:121 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x7fd028089680 2024-09-21T09:03:38.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.737+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 22 ==== osd_op_reply(121 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.737+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.737+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:122 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x7fd028089680 2024-09-21T09:03:38.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.737+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 23 ==== osd_op_reply(122 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.737+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.737+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:123 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x7fd028089680 2024-09-21T09:03:38.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.738+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 24 ==== osd_op_reply(123 gc.21 [call] v31'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.738+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-21T09:03:38.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.738+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:124 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.739+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 38 ==== osd_op_reply(124 gc.22 [call] v31'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.739+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:125 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.739+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 39 ==== osd_op_reply(125 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.739+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.739+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:126 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d8530 con 0x558e6e294f60 2024-09-21T09:03:38.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.739+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 40 ==== osd_op_reply(126 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.739+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:127 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.740+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 41 ==== osd_op_reply(127 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.740+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.740+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:128 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.740+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 42 ==== osd_op_reply(128 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.740+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.740+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:129 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.741+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 43 ==== osd_op_reply(129 gc.22 [call] v31'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.741+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-21T09:03:38.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.741+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:130 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.742+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 44 ==== osd_op_reply(130 gc.23 [call] v31'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.742+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:131 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.742+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 45 ==== osd_op_reply(131 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.742+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.742+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:132 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d8530 con 0x558e6e294f60 2024-09-21T09:03:38.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.742+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 46 ==== osd_op_reply(132 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.742+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:133 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.743+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 47 ==== osd_op_reply(133 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.743+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.743+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:134 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.743+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 48 ==== osd_op_reply(134 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.743+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.743+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:135 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.744+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 49 ==== osd_op_reply(135 gc.23 [call] v31'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.744+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-21T09:03:38.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.744+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:136 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.745+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 50 ==== osd_op_reply(136 gc.24 [call] v31'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.745+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:137 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.745+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 51 ==== osd_op_reply(137 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.745+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.745+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:138 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d8530 con 0x558e6e294f60 2024-09-21T09:03:38.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.745+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 52 ==== osd_op_reply(138 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.745+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:139 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.745+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 53 ==== osd_op_reply(139 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.745+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.745+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:140 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.745+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 54 ==== osd_op_reply(140 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.745+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.745+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:141 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.746+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 55 ==== osd_op_reply(141 gc.24 [call] v31'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.746+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-21T09:03:38.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.746+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:142 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.747+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 56 ==== osd_op_reply(142 gc.25 [call] v31'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.747+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:143 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.748+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 57 ==== osd_op_reply(143 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.748+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.748+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:144 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d8530 con 0x558e6e294f60 2024-09-21T09:03:38.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.748+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 58 ==== osd_op_reply(144 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.748+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:145 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.748+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 59 ==== osd_op_reply(145 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.748+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.748+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:146 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d9540 con 0x558e6e294f60 2024-09-21T09:03:38.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.748+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 60 ==== osd_op_reply(146 gc.25 [call out=1701b] v0'0 uv34 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.748+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-21T09:03:38.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.748+0000 7fd034726800 20 garbage collection: RGWGC::process iterating over entry tag='5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9137741560101507819', time=2024-09-21T09:03:38.379772+0000, chain.objs.size()=7 2024-09-21T09:03:38.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.748+0000 7fd034726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_1 2024-09-21T09:03:38.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.749+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:147 3.24 3:273d3bed:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d7870 con 0x558e6e2903f0 2024-09-21T09:03:38.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.749+0000 7fd034726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_2 2024-09-21T09:03:38.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.749+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:148 3.1b 3:d974135c:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2dc7a0 con 0x558e6e294f60 2024-09-21T09:03:38.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.749+0000 7fd034726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_3 2024-09-21T09:03:38.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.749+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:149 3.32 3:4ce1e97a:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2df330 con 0x558e6e294f60 2024-09-21T09:03:38.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.749+0000 7fd034726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_4 2024-09-21T09:03:38.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.749+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:150 3.28 3:147ba91b:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2e1c40 con 0x558e6e294f60 2024-09-21T09:03:38.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.749+0000 7fd034726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_5 2024-09-21T09:03:38.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.749+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:151 3.a 3:53a81bae:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2e4510 con 0x558e6e294f60 2024-09-21T09:03:38.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.749+0000 7fd034726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_6 2024-09-21T09:03:38.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.749+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:152 3.2d 3:b7fa71b8:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2e1c40 con 0x558e6e294f60 2024-09-21T09:03:38.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.749+0000 7fd034726800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_7 2024-09-21T09:03:38.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.749+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:153 3.4 3:215809f9:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2e4510 con 0x558e6e2903f0 2024-09-21T09:03:38.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.751+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(153 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_7 [call] v31'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.751+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(147 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_1 [call] v31'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.752+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 61 ==== osd_op_reply(150 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_4 [call] v31'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.752+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 62 ==== osd_op_reply(148 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_2 [call] v31'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.752+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 63 ==== osd_op_reply(151 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_5 [call] v31'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.752+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 64 ==== osd_op_reply(149 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_3 [call] v31'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.752+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 65 ==== osd_op_reply(152 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1__shadow_.yrOppYFOIUJVk77XCcGzHia_UX_rd6l_6 [call] v31'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.752+0000 7fd034726800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-21T09:03:38.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.752+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:154 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2e1c40 con 0x558e6e294f60 2024-09-21T09:03:38.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.753+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 66 ==== osd_op_reply(154 gc.25 [call] v31'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.753+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:155 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2dec40 con 0x558e6e294f60 2024-09-21T09:03:38.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.754+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 67 ==== osd_op_reply(155 gc.25 [call] v31'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.754+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-21T09:03:38.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.754+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:156 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2dec40 con 0x558e6e2903f0 2024-09-21T09:03:38.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.755+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(156 gc.26 [call] v31'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.755+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:157 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2dec40 con 0x558e6e2903f0 2024-09-21T09:03:38.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.755+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(157 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.755+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.755+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:158 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddc30 con 0x558e6e2903f0 2024-09-21T09:03:38.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.755+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(158 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.755+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:159 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d7210 con 0x558e6e2903f0 2024-09-21T09:03:38.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.756+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(159 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.756+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.756+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:160 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d7210 con 0x558e6e2903f0 2024-09-21T09:03:38.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.756+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== osd_op_reply(160 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.756+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.756+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:161 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2d7210 con 0x558e6e2903f0 2024-09-21T09:03:38.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.757+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 31 ==== osd_op_reply(161 gc.26 [call] v31'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.757+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-21T09:03:38.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.757+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:162 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2debf0 con 0x558e6e294f60 2024-09-21T09:03:38.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.758+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 68 ==== osd_op_reply(162 gc.27 [call] v31'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.758+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:163 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2debf0 con 0x558e6e294f60 2024-09-21T09:03:38.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.758+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 69 ==== osd_op_reply(163 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.758+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.758+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:164 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddbe0 con 0x558e6e294f60 2024-09-21T09:03:38.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.758+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 70 ==== osd_op_reply(164 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.758+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:165 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2debf0 con 0x558e6e294f60 2024-09-21T09:03:38.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.759+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 71 ==== osd_op_reply(165 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.759+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.759+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:166 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2debf0 con 0x558e6e294f60 2024-09-21T09:03:38.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.759+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 72 ==== osd_op_reply(166 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.759+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.759+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:167 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2debf0 con 0x558e6e294f60 2024-09-21T09:03:38.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.760+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 73 ==== osd_op_reply(167 gc.27 [call] v31'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.760+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-21T09:03:38.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.760+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:168 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2debf0 con 0x558e6e2903f0 2024-09-21T09:03:38.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.761+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 32 ==== osd_op_reply(168 gc.28 [call] v31'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.761+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:169 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.761+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 33 ==== osd_op_reply(169 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.761+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.761+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:170 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e2903f0 2024-09-21T09:03:38.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.762+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 34 ==== osd_op_reply(170 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.762+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:171 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e2903f0 2024-09-21T09:03:38.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.762+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 35 ==== osd_op_reply(171 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.762+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.762+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:172 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e2903f0 2024-09-21T09:03:38.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.762+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 36 ==== osd_op_reply(172 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.762+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.762+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:173 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e2903f0 2024-09-21T09:03:38.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.764+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 37 ==== osd_op_reply(173 gc.28 [call] v31'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.764+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-21T09:03:38.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.764+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:174 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e294f60 2024-09-21T09:03:38.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.765+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 74 ==== osd_op_reply(174 gc.29 [call] v31'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.765+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:175 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e294f60 2024-09-21T09:03:38.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.765+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 75 ==== osd_op_reply(175 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.765+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.765+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:176 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2dcaf0 con 0x558e6e294f60 2024-09-21T09:03:38.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.765+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 76 ==== osd_op_reply(176 gc.29 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.765+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:177 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2dcaf0 con 0x558e6e294f60 2024-09-21T09:03:38.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.765+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 77 ==== osd_op_reply(177 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.765+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.765+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:178 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2dcaf0 con 0x558e6e294f60 2024-09-21T09:03:38.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.765+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 78 ==== osd_op_reply(178 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.765+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.765+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:179 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e294f60 2024-09-21T09:03:38.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.767+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 79 ==== osd_op_reply(179 gc.29 [call] v31'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.767+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-21T09:03:38.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.767+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:180 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e2903f0 2024-09-21T09:03:38.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.768+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 38 ==== osd_op_reply(180 gc.30 [call] v31'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.768+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:181 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.768+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 39 ==== osd_op_reply(181 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.768+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.768+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:182 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e2903f0 2024-09-21T09:03:38.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.768+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 40 ==== osd_op_reply(182 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.768+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:183 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.769+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 41 ==== osd_op_reply(183 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.769+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.769+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.769+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.769+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.769+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.770+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 43 ==== osd_op_reply(185 gc.30 [call] v31'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.770+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-21T09:03:38.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.770+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:186 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.771+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 25 ==== osd_op_reply(186 gc.31 [call] v31'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.771+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.771+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 26 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.771+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.771+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x7fd028089680 2024-09-21T09:03:38.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.771+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 27 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.771+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x7fd028089680 2024-09-21T09:03:38.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.772+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 28 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.772+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.772+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:190 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x7fd028089680 2024-09-21T09:03:38.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.772+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 29 ==== osd_op_reply(190 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.772+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.772+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:191 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.773+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 30 ==== osd_op_reply(191 gc.31 [call] v31'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.773+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-21T09:03:38.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.773+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:192 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e28bae0 2024-09-21T09:03:38.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.774+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 40 ==== osd_op_reply(192 gc.0 [call] v31'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.774+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:193 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e28bae0 2024-09-21T09:03:38.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.774+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 41 ==== osd_op_reply(193 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.774+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.774+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:194 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e28bae0 2024-09-21T09:03:38.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.774+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 42 ==== osd_op_reply(194 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.774+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:195 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e28bae0 2024-09-21T09:03:38.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.775+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 43 ==== osd_op_reply(195 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.775+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.775+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:196 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e28bae0 2024-09-21T09:03:38.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.775+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 44 ==== osd_op_reply(196 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.775+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.775+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:197 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e28bae0 2024-09-21T09:03:38.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.776+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 45 ==== osd_op_reply(197 gc.0 [call] v31'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.776+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-21T09:03:38.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.776+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:198 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.777+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 44 ==== osd_op_reply(198 gc.1 [call] v31'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.777+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:199 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.777+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 45 ==== osd_op_reply(199 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.777+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.777+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:200 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e2903f0 2024-09-21T09:03:38.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.778+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 46 ==== osd_op_reply(200 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.778+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:201 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.778+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 47 ==== osd_op_reply(201 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.778+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.778+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:202 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.779+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 48 ==== osd_op_reply(202 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.779+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.779+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:203 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.780+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 49 ==== osd_op_reply(203 gc.1 [call] v31'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.780+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-21T09:03:38.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.780+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:204 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e294f60 2024-09-21T09:03:38.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.781+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 80 ==== osd_op_reply(204 gc.2 [call] v31'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.781+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:205 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e294f60 2024-09-21T09:03:38.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.781+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 81 ==== osd_op_reply(205 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.781+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.781+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:206 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e294f60 2024-09-21T09:03:38.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.781+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 82 ==== osd_op_reply(206 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.781+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:207 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e294f60 2024-09-21T09:03:38.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.781+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 83 ==== osd_op_reply(207 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.781+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.781+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:208 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e294f60 2024-09-21T09:03:38.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.782+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 84 ==== osd_op_reply(208 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.782+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.782+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:209 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e294f60 2024-09-21T09:03:38.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.782+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 85 ==== osd_op_reply(209 gc.2 [call] v31'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.783+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-21T09:03:38.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.783+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:210 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e28bae0 2024-09-21T09:03:38.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.784+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 46 ==== osd_op_reply(210 gc.3 [call] v31'163 uv163 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.784+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:211 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e28bae0 2024-09-21T09:03:38.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.784+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 47 ==== osd_op_reply(211 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.784+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.784+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:212 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e28bae0 2024-09-21T09:03:38.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.784+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 48 ==== osd_op_reply(212 gc.3 [call out=24b] v0'0 uv163 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.784+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:213 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e28bae0 2024-09-21T09:03:38.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.784+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 49 ==== osd_op_reply(213 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.784+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.784+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:214 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e28bae0 2024-09-21T09:03:38.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.785+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 50 ==== osd_op_reply(214 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.785+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.785+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:215 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e28bae0 2024-09-21T09:03:38.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.786+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 51 ==== osd_op_reply(215 gc.3 [call] v31'164 uv164 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.786+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-21T09:03:38.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.786+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:216 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.787+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 31 ==== osd_op_reply(216 gc.4 [call] v31'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.787+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:217 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.787+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 32 ==== osd_op_reply(217 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.787+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.787+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:218 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x7fd028089680 2024-09-21T09:03:38.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.787+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 33 ==== osd_op_reply(218 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.787+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:219 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.788+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 34 ==== osd_op_reply(219 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.788+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.788+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:220 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.788+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 35 ==== osd_op_reply(220 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.788+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.788+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:221 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.789+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 36 ==== osd_op_reply(221 gc.4 [call] v31'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.789+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-21T09:03:38.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.789+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:222 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e294f60 2024-09-21T09:03:38.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.790+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 86 ==== osd_op_reply(222 gc.5 [call] v31'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.790+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:223 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e294f60 2024-09-21T09:03:38.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.790+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 87 ==== osd_op_reply(223 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.790+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.792 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.790+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:224 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e294f60 2024-09-21T09:03:38.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.790+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 88 ==== osd_op_reply(224 gc.5 [call out=24b] v0'0 uv37 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.790+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:225 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e294f60 2024-09-21T09:03:38.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.791+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 89 ==== osd_op_reply(225 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.791+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.791+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:226 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e294f60 2024-09-21T09:03:38.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.791+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 90 ==== osd_op_reply(226 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.791+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.791+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:227 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e294f60 2024-09-21T09:03:38.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.792+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 91 ==== osd_op_reply(227 gc.5 [call] v31'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.792+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-21T09:03:38.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.792+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:228 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e28bae0 2024-09-21T09:03:38.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.793+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 52 ==== osd_op_reply(228 gc.6 [call] v31'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.793+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:229 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e28bae0 2024-09-21T09:03:38.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.794+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 53 ==== osd_op_reply(229 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.794+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.794+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:230 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e28bae0 2024-09-21T09:03:38.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.794+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 54 ==== osd_op_reply(230 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.794+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:231 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e28bae0 2024-09-21T09:03:38.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.794+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 55 ==== osd_op_reply(231 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.794+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.794+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:232 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e28bae0 2024-09-21T09:03:38.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.794+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 56 ==== osd_op_reply(232 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.794+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.794+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:233 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e28bae0 2024-09-21T09:03:38.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.795+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 57 ==== osd_op_reply(233 gc.6 [call] v31'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.795+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-21T09:03:38.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.795+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:234 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.797+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 50 ==== osd_op_reply(234 gc.7 [call] v31'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.797+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:235 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.797+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 51 ==== osd_op_reply(235 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.797+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.797+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:236 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e2903f0 2024-09-21T09:03:38.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.797+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 52 ==== osd_op_reply(236 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.797+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:237 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.798+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 53 ==== osd_op_reply(237 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.798+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.798+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:238 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.798+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 54 ==== osd_op_reply(238 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.798+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.798+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:239 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.799+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 55 ==== osd_op_reply(239 gc.7 [call] v31'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.799+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-21T09:03:38.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.799+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:240 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.800+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 37 ==== osd_op_reply(240 gc.8 [call] v31'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.800+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:241 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.801+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 38 ==== osd_op_reply(241 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.801+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.801+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:242 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x7fd028089680 2024-09-21T09:03:38.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.801+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 39 ==== osd_op_reply(242 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.801+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:243 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.801+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 40 ==== osd_op_reply(243 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.801+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.801+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:244 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.801+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 41 ==== osd_op_reply(244 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.801+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.801+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:245 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.802+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 42 ==== osd_op_reply(245 gc.8 [call] v31'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.802+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-21T09:03:38.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.803+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:246 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e294f60 2024-09-21T09:03:38.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.803+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 92 ==== osd_op_reply(246 gc.9 [call] v31'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.803+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:247 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e294f60 2024-09-21T09:03:38.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.804+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 93 ==== osd_op_reply(247 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.804+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.804+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:248 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e294f60 2024-09-21T09:03:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.804+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 94 ==== osd_op_reply(248 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.804+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:249 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e294f60 2024-09-21T09:03:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.804+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 95 ==== osd_op_reply(249 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.804+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.804+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:250 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e294f60 2024-09-21T09:03:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.804+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 96 ==== osd_op_reply(250 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.804+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.804+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:251 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e294f60 2024-09-21T09:03:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.805+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 97 ==== osd_op_reply(251 gc.9 [call] v31'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.808 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.805+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-21T09:03:38.808 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.805+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:252 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.806+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 43 ==== osd_op_reply(252 gc.10 [call] v31'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.806+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:253 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.806+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 44 ==== osd_op_reply(253 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.806+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.806+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:254 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x7fd028089680 2024-09-21T09:03:38.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.807+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 45 ==== osd_op_reply(254 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.807+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:255 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x7fd028089680 2024-09-21T09:03:38.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.807+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 46 ==== osd_op_reply(255 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.807+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.807+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:256 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x7fd028089680 2024-09-21T09:03:38.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.807+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 47 ==== osd_op_reply(256 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.807+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.807+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:257 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.808+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 48 ==== osd_op_reply(257 gc.10 [call] v31'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.808+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-21T09:03:38.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.808+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:258 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.809+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 56 ==== osd_op_reply(258 gc.11 [call] v31'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.809+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:259 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.810+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 57 ==== osd_op_reply(259 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.810+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.810+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:260 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e2903f0 2024-09-21T09:03:38.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.810+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 58 ==== osd_op_reply(260 gc.11 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.810+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:261 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.810+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 59 ==== osd_op_reply(261 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.810+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.810+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:262 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.810+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 60 ==== osd_op_reply(262 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.810+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.810+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:263 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.811+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 61 ==== osd_op_reply(263 gc.11 [call] v31'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.811+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-21T09:03:38.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.811+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:264 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.812+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 49 ==== osd_op_reply(264 gc.12 [call] v31'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.812+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:265 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.813+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 50 ==== osd_op_reply(265 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.813+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.813+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:266 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x7fd028089680 2024-09-21T09:03:38.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.813+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 51 ==== osd_op_reply(266 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.813+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:267 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.813+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 52 ==== osd_op_reply(267 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.813+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.813+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:268 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.813+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 53 ==== osd_op_reply(268 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.813+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.813+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:269 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x7fd028089680 2024-09-21T09:03:38.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.814+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 54 ==== osd_op_reply(269 gc.12 [call] v31'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.814+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-21T09:03:38.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.814+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:270 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.816+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 62 ==== osd_op_reply(270 gc.13 [call] v31'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.816+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:271 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2deb10 con 0x558e6e2903f0 2024-09-21T09:03:38.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.816+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 63 ==== osd_op_reply(271 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.816+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.816+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:272 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e2903f0 2024-09-21T09:03:38.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.816+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 64 ==== osd_op_reply(272 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.816+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:273 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e2903f0 2024-09-21T09:03:38.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.816+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 65 ==== osd_op_reply(273 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.816+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.816+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:274 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e2903f0 2024-09-21T09:03:38.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.817+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 66 ==== osd_op_reply(274 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.817+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.817+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:275 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e2903f0 2024-09-21T09:03:38.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.818+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 67 ==== osd_op_reply(275 gc.13 [call] v31'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.818+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-21T09:03:38.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.818+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:276 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e28bae0 2024-09-21T09:03:38.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.819+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 58 ==== osd_op_reply(276 gc.14 [call] v31'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.819+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:277 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e28bae0 2024-09-21T09:03:38.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.819+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 59 ==== osd_op_reply(277 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.819+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.819+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:278 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2dcaf0 con 0x558e6e28bae0 2024-09-21T09:03:38.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.819+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 60 ==== osd_op_reply(278 gc.14 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.819+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:279 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e28bae0 2024-09-21T09:03:38.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.819+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 61 ==== osd_op_reply(279 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.819+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.819+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:280 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e28bae0 2024-09-21T09:03:38.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.820+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 62 ==== osd_op_reply(280 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.820+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.820+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:281 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e28bae0 2024-09-21T09:03:38.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.820+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 63 ==== osd_op_reply(281 gc.14 [call] v31'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.820+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-21T09:03:38.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.820+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:282 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e294f60 2024-09-21T09:03:38.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.822+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 98 ==== osd_op_reply(282 gc.15 [call] v31'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.822+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:283 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e294f60 2024-09-21T09:03:38.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.822+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 99 ==== osd_op_reply(283 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.822+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.822+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:284 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2dcaf0 con 0x558e6e294f60 2024-09-21T09:03:38.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.822+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 100 ==== osd_op_reply(284 gc.15 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.822+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:285 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e294f60 2024-09-21T09:03:38.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.822+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 101 ==== osd_op_reply(285 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.822+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.822+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:286 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e294f60 2024-09-21T09:03:38.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.823+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 102 ==== osd_op_reply(286 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.823+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.823+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:287 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x558e6e294f60 2024-09-21T09:03:38.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.824+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 103 ==== osd_op_reply(287 gc.15 [call] v31'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.824+0000 7fd034726800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-21T09:03:38.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.824+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:288 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x7fd028089680 2024-09-21T09:03:38.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.825+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 55 ==== osd_op_reply(288 gc.16 [call] v31'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.825+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:289 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x7fd028089680 2024-09-21T09:03:38.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.825+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 56 ==== osd_op_reply(289 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.825+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.825+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:290 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2dcaf0 con 0x7fd028089680 2024-09-21T09:03:38.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.825+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 57 ==== osd_op_reply(290 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.825+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:291 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x7fd028089680 2024-09-21T09:03:38.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.826+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 58 ==== osd_op_reply(291 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.826+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:03:38.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.826+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:292 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x7fd028089680 2024-09-21T09:03:38.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.826+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 59 ==== osd_op_reply(292 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.826+0000 7fd034726800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:03:38.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.826+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:293 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2ddb00 con 0x7fd028089680 2024-09-21T09:03:38.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.827+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 60 ==== osd_op_reply(293 gc.16 [call] v31'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.828+0000 7fcee67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:38.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.828+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94070221957808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e2a61d0 con 0x558e6e28bae0 2024-09-21T09:03:38.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.829+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94070221957808] v31'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.829+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94070221937632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29eab0 con 0x7fd028089680 2024-09-21T09:03:38.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.830+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 61 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94070221937632] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.830+0000 7fd034726800 20 remove_watcher() i=0 2024-09-21T09:03:38.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.830+0000 7fd034726800 2 removed watcher, disabling cache 2024-09-21T09:03:38.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.830+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94070221942032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29eab0 con 0x558e6e28bae0 2024-09-21T09:03:38.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.831+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94070221942032] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.831+0000 7fd034726800 20 remove_watcher() i=1 2024-09-21T09:03:38.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.831+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94070221935120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29ad10 con 0x558e6e294f60 2024-09-21T09:03:38.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.832+0000 7fd0303e3640 1 -- 172.21.15.178:0/1795156844 <== osd.3 v2:172.21.15.178:6808/24558189 104 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94070221935120] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd028077c10 con 0x558e6e294f60 2024-09-21T09:03:38.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.832+0000 7fd034726800 20 remove_watcher() i=2 2024-09-21T09:03:38.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.832+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94070221948544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29eab0 con 0x7fd028089680 2024-09-21T09:03:38.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.833+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.2 v2:172.21.15.178:6816/3267136144 62 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94070221948544] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x7fd028089680 2024-09-21T09:03:38.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.833+0000 7fd034726800 20 remove_watcher() i=3 2024-09-21T09:03:38.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.833+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94070221946464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e299210 con 0x558e6e28bae0 2024-09-21T09:03:38.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.834+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 <== osd.1 v2:172.21.15.178:6800/627496675 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94070221946464] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02403d040 con 0x558e6e28bae0 2024-09-21T09:03:38.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.834+0000 7fd034726800 20 remove_watcher() i=4 2024-09-21T09:03:38.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.834+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94070221952864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29ad10 con 0x558e6e2903f0 2024-09-21T09:03:38.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.835+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94070221952864] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.835+0000 7fd034726800 20 remove_watcher() i=5 2024-09-21T09:03:38.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.835+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94070221956752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e29eab0 con 0x558e6e2903f0 2024-09-21T09:03:38.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.836+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94070221956752] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.836+0000 7fd034726800 20 remove_watcher() i=6 2024-09-21T09:03:38.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.836+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94070221955184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558e6e299210 con 0x558e6e2903f0 2024-09-21T09:03:38.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd030be4640 1 -- 172.21.15.178:0/1795156844 <== osd.0 v2:172.21.15.44:6800/2732047064 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94070221955184] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd020055070 con 0x558e6e2903f0 2024-09-21T09:03:38.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd034726800 20 remove_watcher() i=7 2024-09-21T09:03:38.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558e6e2903f0 msgr2=0x558e6e292800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd034726800 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558e6e2903f0 0x558e6e292800 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558e6e28bae0 msgr2=0x558e6e28dfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd034726800 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558e6e28bae0 0x558e6e28dfa0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd028089680 msgr2=0x7fd028089aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd034726800 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fd028089680 0x7fd028089aa0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558e6e294f60 msgr2=0x558e6e297420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd034726800 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558e6e294f60 0x558e6e297420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf00036af0 msgr2=0x7fcf00038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd034726800 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf00036af0 0x7fcf00038fb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x558e6e25b840 tx=0x7fd028094000 comp rx=0 tx=0).stop 2024-09-21T09:03:38.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e246560 msgr2=0x558e6e27ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd034726800 1 --2- 172.21.15.178:0/1795156844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e246560 0x558e6e27ff90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd02003d040 tx=0x7fd02004ce80 comp rx=0 tx=0).stop 2024-09-21T09:03:38.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 reap_dead start 2024-09-21T09:03:38.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.837+0000 7fd02fbe2640 1 -- 172.21.15.178:0/1795156844 reap_dead start 2024-09-21T09:03:38.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 shutdown_connections 2024-09-21T09:03:38.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 >> 172.21.15.178:0/1795156844 conn(0x558e6e272d60 msgr2=0x558e6e270e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 shutdown_connections 2024-09-21T09:03:38.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/1795156844 wait complete. 2024-09-21T09:03:38.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/3925262987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf08036b40 msgr2=0x7fcf08039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 --2- 172.21.15.178:0/3925262987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf08036b40 0x7fcf08039000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x558e6e256ab0 tx=0x7fd028000f40 comp rx=0 tx=0).stop 2024-09-21T09:03:38.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/3925262987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e269e10 msgr2=0x558e6e26a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 --2- 172.21.15.178:0/3925262987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e269e10 0x558e6e26a230 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x558e6e2501b0 tx=0x7fd02000aec0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/3925262987 shutdown_connections 2024-09-21T09:03:38.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 --2- 172.21.15.178:0/3925262987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf08036b40 0x7fcf08039000 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 --2- 172.21.15.178:0/3925262987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e269e10 0x558e6e26a230 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/3925262987 >> 172.21.15.178:0/3925262987 conn(0x558e6e25eda0 msgr2=0x558e6e261920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/3925262987 shutdown_connections 2024-09-21T09:03:38.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/3925262987 wait complete. 2024-09-21T09:03:38.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558e6e258980 msgr2=0x558e6e25ad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558e6e258980 0x558e6e25ad70 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558e6e158400 msgr2=0x558e6e256170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558e6e158400 0x558e6e256170 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf18036b90 msgr2=0x7fcf18039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf18036b90 0x7fcf18039050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd024000f60 tx=0x7fd0240012b0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 msgr2=0x558e6e24f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e24f100 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd028046130 tx=0x7fd028003330 comp rx=0 tx=0).stop 2024-09-21T09:03:38.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 shutdown_connections 2024-09-21T09:03:38.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558e6e258980 0x558e6e25ad70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558e6e158400 0x558e6e256170 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fcf18036b90 0x7fcf18039050 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 --2- 172.21.15.178:0/3290435058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e6e157a90 0x558e6e24f100 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.838+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 >> 172.21.15.178:0/3290435058 conn(0x558e6e1525b0 msgr2=0x558e6e240970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.839+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 shutdown_connections 2024-09-21T09:03:38.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.839+0000 7fd034726800 1 -- 172.21.15.178:0/3290435058 wait complete. 2024-09-21T09:03:38.849 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-21T09:03:38.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-21T09:03:38.849 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-21T09:03:38.931 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:38.932 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:38.932 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.930+0000 7f8340e2f800 1 Processor -- start 2024-09-21T09:03:38.932 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.930+0000 7f8340e2f800 1 -- start start 2024-09-21T09:03:38.932 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.931+0000 7f8340e2f800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556563d96630 0x556563e25250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.932 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.931+0000 7f8340e2f800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556563ce1b30 con 0x556563e25790 2024-09-21T09:03:38.933 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.931+0000 7f8340e2f800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x556563cc3360 con 0x556563d96630 2024-09-21T09:03:38.933 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.931+0000 7f833e92a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556563d96630 0x556563e25250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.933 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.931+0000 7f833e129640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x556563e25790 0x556563e27b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:45118/0 (socket says 172.21.15.178:45118) 2024-09-21T09:03:38.933 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.931+0000 7f833e92a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556563d96630 0x556563e25250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49448/0 (socket says 172.21.15.178:49448) 2024-09-21T09:03:38.934 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.931+0000 7f833e129640 1 -- 172.21.15.178:0/2849638620 learned_addr learned my addr 172.21.15.178:0/2849638620 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:38.934 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.931+0000 7f833e92a640 1 -- 172.21.15.178:0/2849638620 >> v1:172.21.15.44:6789/0 conn(0x556563e25790 legacy=0x556563e27b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.934 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.931+0000 7f833e92a640 1 -- 172.21.15.178:0/2849638620 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556563ce9e00 con 0x556563d96630 2024-09-21T09:03:38.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.933+0000 7f833e92a640 1 --2- 172.21.15.178:0/2849638620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563e25250 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8330005fd0 tx=0x7f8330045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987ff9d811da2868 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.933+0000 7f833d928640 1 -- 172.21.15.178:0/2849638620 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8330058530 con 0x556563d96630 2024-09-21T09:03:38.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.933+0000 7f833d928640 1 -- 172.21.15.178:0/2849638620 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83300586d0 con 0x556563d96630 2024-09-21T09:03:38.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.933+0000 7f833d928640 1 -- 172.21.15.178:0/2849638620 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83300589d0 con 0x556563d96630 2024-09-21T09:03:38.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.934+0000 7f8340e2f800 1 -- 172.21.15.178:0/2849638620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 msgr2=0x556563e25250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.934+0000 7f8340e2f800 1 --2- 172.21.15.178:0/2849638620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563e25250 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8330005fd0 tx=0x7f8330045c30 comp rx=0 tx=0).stop 2024-09-21T09:03:38.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.934+0000 7f8340e2f800 1 -- 172.21.15.178:0/2849638620 shutdown_connections 2024-09-21T09:03:38.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.934+0000 7f8340e2f800 1 --2- 172.21.15.178:0/2849638620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563e25250 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.934+0000 7f8340e2f800 1 -- 172.21.15.178:0/2849638620 >> 172.21.15.178:0/2849638620 conn(0x556563e1cde0 msgr2=0x556563e1f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.934+0000 7f8340e2f800 1 -- 172.21.15.178:0/2849638620 shutdown_connections 2024-09-21T09:03:38.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.934+0000 7f8340e2f800 1 -- 172.21.15.178:0/2849638620 wait complete. 2024-09-21T09:03:38.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.947+0000 7f8340e2f800 1 Processor -- start 2024-09-21T09:03:38.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.948+0000 7f8340e2f800 1 -- start start 2024-09-21T09:03:38.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.948+0000 7f8340e2f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563e22b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.948+0000 7f8340e2f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556563d6e330 con 0x556563d96630 2024-09-21T09:03:38.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.948+0000 7f833e92a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563e22b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.948+0000 7f833e92a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563e22b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49464/0 (socket says 172.21.15.178:49464) 2024-09-21T09:03:38.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.948+0000 7f833e92a640 1 -- 172.21.15.178:0/152209187 learned_addr learned my addr 172.21.15.178:0/152209187 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.948+0000 7f833e92a640 1 -- 172.21.15.178:0/152209187 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556563cbbbc0 con 0x556563d96630 2024-09-21T09:03:38.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.949+0000 7f833e92a640 1 --2- 172.21.15.178:0/152209187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563e22b80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f833000a3f0 tx=0x7f8330051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37990c0763660cff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.949+0000 7f822ce09640 1 -- 172.21.15.178:0/152209187 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8330058a30 con 0x556563d96630 2024-09-21T09:03:38.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.949+0000 7f822ce09640 1 -- 172.21.15.178:0/152209187 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8330068070 con 0x556563d96630 2024-09-21T09:03:38.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.949+0000 7f822ce09640 1 -- 172.21.15.178:0/152209187 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8330058d60 con 0x556563d96630 2024-09-21T09:03:38.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.949+0000 7f8340e2f800 1 -- 172.21.15.178:0/152209187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 msgr2=0x556563e22b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.949+0000 7f8340e2f800 1 --2- 172.21.15.178:0/152209187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563e22b80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f833000a3f0 tx=0x7f8330051000 comp rx=0 tx=0).stop 2024-09-21T09:03:38.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.949+0000 7f8340e2f800 1 -- 172.21.15.178:0/152209187 shutdown_connections 2024-09-21T09:03:38.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.949+0000 7f8340e2f800 1 --2- 172.21.15.178:0/152209187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563e22b80 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.949+0000 7f8340e2f800 1 -- 172.21.15.178:0/152209187 >> 172.21.15.178:0/152209187 conn(0x556563e1cde0 msgr2=0x556563f0d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.950+0000 7f8340e2f800 1 -- 172.21.15.178:0/152209187 shutdown_connections 2024-09-21T09:03:38.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.950+0000 7f8340e2f800 1 -- 172.21.15.178:0/152209187 wait complete. 2024-09-21T09:03:38.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.950+0000 7f8340e2f800 1 Processor -- start 2024-09-21T09:03:38.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.950+0000 7f8340e2f800 1 -- start start 2024-09-21T09:03:38.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.950+0000 7f8340e2f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563f1b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.950+0000 7f8340e2f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556563e29690 con 0x556563d96630 2024-09-21T09:03:38.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.950+0000 7f833e92a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563f1b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.950+0000 7f833e92a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563f1b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49480/0 (socket says 172.21.15.178:49480) 2024-09-21T09:03:38.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.950+0000 7f833e92a640 1 -- 172.21.15.178:0/2685529526 learned_addr learned my addr 172.21.15.178:0/2685529526 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.951+0000 7f833e92a640 1 -- 172.21.15.178:0/2685529526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556563ccffe0 con 0x556563d96630 2024-09-21T09:03:38.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.951+0000 7f833e92a640 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563f1b430 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8330046130 tx=0x7f8330003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.951+0000 7f822b606640 1 -- 172.21.15.178:0/2685529526 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8330063630 con 0x556563d96630 2024-09-21T09:03:38.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.951+0000 7f822b606640 1 -- 172.21.15.178:0/2685529526 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83300637d0 con 0x556563d96630 2024-09-21T09:03:38.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.951+0000 7f822b606640 1 -- 172.21.15.178:0/2685529526 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8330063af0 con 0x556563d96630 2024-09-21T09:03:38.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.951+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556563f1b970 con 0x556563d96630 2024-09-21T09:03:38.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.951+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556563f1bef0 con 0x556563d96630 2024-09-21T09:03:38.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.952+0000 7f822b606640 1 -- 172.21.15.178:0/2685529526 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8330063c90 con 0x556563d96630 2024-09-21T09:03:38.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.952+0000 7f822b606640 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8224036b90 0x7f8224039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.952+0000 7f822b606640 1 -- 172.21.15.178:0/2685529526 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8330090c40 con 0x556563d96630 2024-09-21T09:03:38.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.952+0000 7f833e129640 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8224036b90 0x7f8224039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.952+0000 7f8340e2f800 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556563e25790 0x556563f224a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.952+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f229e0 con 0x556563e25790 2024-09-21T09:03:38.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.952+0000 7f833f12b640 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556563e25790 0x556563f224a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.953+0000 7f833e129640 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8224036b90 0x7f8224039050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8334000f60 tx=0x7f83340012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.953+0000 7f833f12b640 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556563e25790 0x556563f224a0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.953+0000 7f833f12b640 1 -- 172.21.15.178:0/2685529526 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83380083e0 con 0x556563e25790 2024-09-21T09:03:38.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.953+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f1fa50 con 0x556563e25790 2024-09-21T09:03:38.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.953+0000 7f833f12b640 1 -- 172.21.15.178:0/2685529526 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83380083e0 con 0x556563e25790 2024-09-21T09:03:38.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.953+0000 7f8340e2f800 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556563f24cb0 0x556563f270a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.953+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f27790 con 0x556563f24cb0 2024-09-21T09:03:38.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.954+0000 7f833e92a640 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556563f24cb0 0x556563f270a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.954+0000 7f833e92a640 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556563f24cb0 0x556563f270a0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.954+0000 7f833e92a640 1 -- 172.21.15.178:0/2685529526 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f24cb0 2024-09-21T09:03:38.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.954+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f23b50 con 0x556563e25790 2024-09-21T09:03:38.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.954+0000 7f833f12b640 1 -- 172.21.15.178:0/2685529526 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83380083e0 con 0x556563e25790 2024-09-21T09:03:38.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.954+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f23ff0 con 0x556563e25790 2024-09-21T09:03:38.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.955+0000 7f833f12b640 1 -- 172.21.15.178:0/2685529526 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f83380083e0 con 0x556563e25790 2024-09-21T09:03:38.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.955+0000 7f8340e2f800 1 Processor -- start 2024-09-21T09:03:38.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.955+0000 7f8340e2f800 1 -- start start 2024-09-21T09:03:38.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.955+0000 7f8340e2f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f36160 0x556563f36580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.955+0000 7f8340e2f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556563cbd580 con 0x556563f36160 2024-09-21T09:03:38.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.955+0000 7f833f12b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f36160 0x556563f36580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.956+0000 7f833f12b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f36160 0x556563f36580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49482/0 (socket says 172.21.15.178:49482) 2024-09-21T09:03:38.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.956+0000 7f833f12b640 1 -- 172.21.15.178:0/909298327 learned_addr learned my addr 172.21.15.178:0/909298327 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.956+0000 7f833f12b640 1 -- 172.21.15.178:0/909298327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556563f36ac0 con 0x556563f36160 2024-09-21T09:03:38.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.956+0000 7f833f12b640 1 --2- 172.21.15.178:0/909298327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f36160 0x556563f36580 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x556563f1c4e0 tx=0x7f833800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.956+0000 7f8228e01640 1 -- 172.21.15.178:0/909298327 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8338007d00 con 0x556563f36160 2024-09-21T09:03:38.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.956+0000 7f8228e01640 1 -- 172.21.15.178:0/909298327 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f833801e020 con 0x556563f36160 2024-09-21T09:03:38.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.956+0000 7f8340e2f800 1 -- 172.21.15.178:0/909298327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556563f36d50 con 0x556563f36160 2024-09-21T09:03:38.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.956+0000 7f8228e01640 1 -- 172.21.15.178:0/909298327 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8338019420 con 0x556563f36160 2024-09-21T09:03:38.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.956+0000 7f8340e2f800 1 -- 172.21.15.178:0/909298327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556563f39a30 con 0x556563f36160 2024-09-21T09:03:38.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.957+0000 7f8228e01640 1 -- 172.21.15.178:0/909298327 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8338016040 con 0x556563f36160 2024-09-21T09:03:38.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.957+0000 7f8228e01640 1 --2- 172.21.15.178:0/909298327 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8218036b40 0x7f8218039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.957+0000 7f8228e01640 1 -- 172.21.15.178:0/909298327 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f833801f030 con 0x556563f36160 2024-09-21T09:03:38.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.958+0000 7f833e92a640 1 --2- 172.21.15.178:0/909298327 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8218036b40 0x7f8218039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.958+0000 7f8340e2f800 1 Processor -- start 2024-09-21T09:03:38.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.958+0000 7f833e92a640 1 --2- 172.21.15.178:0/909298327 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8218036b40 0x7f8218039000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x556563f22e20 tx=0x7f833007ef70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.958+0000 7f8340e2f800 1 -- start start 2024-09-21T09:03:38.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.958+0000 7f8340e2f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f42dc0 0x556563f431c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.958+0000 7f8340e2f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556563e21160 con 0x556563f42dc0 2024-09-21T09:03:38.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.958+0000 7f833f12b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f42dc0 0x556563f431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.958+0000 7f833f12b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f42dc0 0x556563f431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49496/0 (socket says 172.21.15.178:49496) 2024-09-21T09:03:38.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.958+0000 7f833f12b640 1 -- 172.21.15.178:0/1264082675 learned_addr learned my addr 172.21.15.178:0/1264082675 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.958+0000 7f833f12b640 1 -- 172.21.15.178:0/1264082675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556563f43700 con 0x556563f42dc0 2024-09-21T09:03:38.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.959+0000 7f833f12b640 1 --2- 172.21.15.178:0/1264082675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f42dc0 0x556563f431c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f833804cef0 tx=0x7f8338017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a403d715602e1d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.959+0000 7f82227fc640 1 -- 172.21.15.178:0/1264082675 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f833801d030 con 0x556563f42dc0 2024-09-21T09:03:38.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.959+0000 7f82227fc640 1 -- 172.21.15.178:0/1264082675 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8338015e30 con 0x556563f42dc0 2024-09-21T09:03:38.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.959+0000 7f82227fc640 1 -- 172.21.15.178:0/1264082675 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8338023580 con 0x556563f42dc0 2024-09-21T09:03:38.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.959+0000 7f8340e2f800 1 -- 172.21.15.178:0/1264082675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f42dc0 msgr2=0x556563f431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:38.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.959+0000 7f8340e2f800 1 --2- 172.21.15.178:0/1264082675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f42dc0 0x556563f431c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f833804cef0 tx=0x7f8338017fa0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.959+0000 7f8340e2f800 1 -- 172.21.15.178:0/1264082675 shutdown_connections 2024-09-21T09:03:38.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.959+0000 7f8340e2f800 1 --2- 172.21.15.178:0/1264082675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f42dc0 0x556563f431c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:38.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.959+0000 7f8340e2f800 1 -- 172.21.15.178:0/1264082675 >> 172.21.15.178:0/1264082675 conn(0x556563f3f170 msgr2=0x556563f3d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:38.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.959+0000 7f8340e2f800 1 -- 172.21.15.178:0/1264082675 shutdown_connections 2024-09-21T09:03:38.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.959+0000 7f8340e2f800 1 -- 172.21.15.178:0/1264082675 wait complete. 2024-09-21T09:03:38.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.960+0000 7f8340e2f800 1 Processor -- start 2024-09-21T09:03:38.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.960+0000 7f8340e2f800 1 -- start start 2024-09-21T09:03:38.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.960+0000 7f8340e2f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f42dc0 0x556563f4a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.960+0000 7f8340e2f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556563f43da0 con 0x556563f42dc0 2024-09-21T09:03:38.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.960+0000 7f833f12b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f42dc0 0x556563f4a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.960+0000 7f833f12b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f42dc0 0x556563f4a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49504/0 (socket says 172.21.15.178:49504) 2024-09-21T09:03:38.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.960+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 learned_addr learned my addr 172.21.15.178:0/3415475342 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:38.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.960+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556563f4a780 con 0x556563f42dc0 2024-09-21T09:03:38.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.960+0000 7f833f12b640 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f42dc0 0x556563f4a240 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8338022f90 tx=0x7f833804ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.961+0000 7f8220ff9640 1 -- 172.21.15.178:0/3415475342 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f833803b070 con 0x556563f42dc0 2024-09-21T09:03:38.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.961+0000 7f8220ff9640 1 -- 172.21.15.178:0/3415475342 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8338040150 con 0x556563f42dc0 2024-09-21T09:03:38.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.961+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556563f4aa10 con 0x556563f42dc0 2024-09-21T09:03:38.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.961+0000 7f8220ff9640 1 -- 172.21.15.178:0/3415475342 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8338017770 con 0x556563f42dc0 2024-09-21T09:03:38.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.961+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556563f4d6c0 con 0x556563f42dc0 2024-09-21T09:03:38.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.961+0000 7f8220ff9640 1 -- 172.21.15.178:0/3415475342 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8338040450 con 0x556563f42dc0 2024-09-21T09:03:38.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.962+0000 7f8220ff9640 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8208036b90 0x7f8208039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.962+0000 7f8220ff9640 1 -- 172.21.15.178:0/3415475342 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8338037ba0 con 0x556563f42dc0 2024-09-21T09:03:38.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.962+0000 7f833e92a640 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8208036b90 0x7f8208039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.962+0000 7f8340e2f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.962+0000 7f8340e2f800 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556563f55ce0 0x556563f581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.962+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f588f0 con 0x556563f55ce0 2024-09-21T09:03:38.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.962+0000 7f833e92a640 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8208036b90 0x7f8208039050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x556563f27b90 tx=0x7f8330093000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.962+0000 7f833e129640 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556563f55ce0 0x556563f581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.962+0000 7f833e129640 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556563f55ce0 0x556563f581a0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8334009050 con 0x556563f55ce0 2024-09-21T09:03:38.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 20 realm 2024-09-21T09:03:38.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f55130 con 0x556563f55ce0 2024-09-21T09:03:38.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8334009050 con 0x556563f55ce0 2024-09-21T09:03:38.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f593d0 con 0x556563f55ce0 2024-09-21T09:03:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8334009050 con 0x556563f55ce0 2024-09-21T09:03:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f59ca0 con 0x556563f55ce0 2024-09-21T09:03:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8334009050 con 0x556563f55ce0 2024-09-21T09:03:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556563f5a550 0x556563f5c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.963+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f5d080 con 0x556563f5a550 2024-09-21T09:03:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.964+0000 7f833f12b640 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556563f5a550 0x556563f5c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.964+0000 7f833f12b640 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556563f5a550 0x556563f5c940 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.964+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.964+0000 7f8340e2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:38.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.964+0000 7f8340e2f800 20 searching for the correct realm 2024-09-21T09:03:38.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.964+0000 7f8340e2f800 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556563f5f130 0x556563f615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.964+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5f130 2024-09-21T09:03:38.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.965+0000 7f833e92a640 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556563f5f130 0x556563f615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.965+0000 7f833e92a640 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556563f5f130 0x556563f615f0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.965+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.965+0000 7f833e92a640 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8330087680 0x7f8330087aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:38.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.965+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x7f8330087680 2024-09-21T09:03:38.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.965+0000 7f833e129640 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8330087680 0x7f8330087aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:38.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.966+0000 7f833e129640 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8330087680 0x7f8330087aa0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:38.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.966+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8334009050 con 0x7f8330087680 2024-09-21T09:03:38.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.966+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5a550 2024-09-21T09:03:38.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.966+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.966+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f55ce0 2024-09-21T09:03:38.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.967+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8334009050 con 0x556563f55ce0 2024-09-21T09:03:38.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.967+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f55ce0 2024-09-21T09:03:38.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.967+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8334029040 con 0x556563f55ce0 2024-09-21T09:03:38.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.967+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5a550 2024-09-21T09:03:38.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.967+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.967+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5a550 2024-09-21T09:03:38.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.967+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.967+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x7f8330087680 2024-09-21T09:03:38.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.968+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8334029040 con 0x7f8330087680 2024-09-21T09:03:38.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.968+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5f130 2024-09-21T09:03:38.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.968+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.968+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f55ce0 2024-09-21T09:03:38.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.968+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8334029040 con 0x556563f55ce0 2024-09-21T09:03:38.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.968+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5a550 2024-09-21T09:03:38.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.969+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.969+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f55ce0 2024-09-21T09:03:38.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.969+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8334029040 con 0x556563f55ce0 2024-09-21T09:03:38.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.969+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x7f8330087680 2024-09-21T09:03:38.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.969+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8334029040 con 0x7f8330087680 2024-09-21T09:03:38.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.969+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5f130 2024-09-21T09:03:38.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.969+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.969+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5f130 2024-09-21T09:03:38.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.970+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.970+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5a550 2024-09-21T09:03:38.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.970+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.970+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5f130 2024-09-21T09:03:38.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.970+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.970+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5f130 2024-09-21T09:03:38.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.970+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.970+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f55ce0 2024-09-21T09:03:38.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.971+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8334029040 con 0x556563f55ce0 2024-09-21T09:03:38.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.971+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f55ce0 2024-09-21T09:03:38.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.971+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8334029040 con 0x556563f55ce0 2024-09-21T09:03:38.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.971+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5a550 2024-09-21T09:03:38.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.971+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.971+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5f130 2024-09-21T09:03:38.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.971+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.971+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x7f8330087680 2024-09-21T09:03:38.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.972+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8334029040 con 0x7f8330087680 2024-09-21T09:03:38.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.972+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f55ce0 2024-09-21T09:03:38.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.972+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8334029040 con 0x556563f55ce0 2024-09-21T09:03:38.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.972+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5a550 2024-09-21T09:03:38.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.972+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.972+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5f130 2024-09-21T09:03:38.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.972+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.972+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x7f8330087680 2024-09-21T09:03:38.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.973+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8334029040 con 0x7f8330087680 2024-09-21T09:03:38.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.973+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x7f8330087680 2024-09-21T09:03:38.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.973+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8334029040 con 0x7f8330087680 2024-09-21T09:03:38.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.973+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5f130 2024-09-21T09:03:38.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.973+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.973+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f5a550 2024-09-21T09:03:38.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x556563f55ce0 2024-09-21T09:03:38.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8334029040 con 0x556563f55ce0 2024-09-21T09:03:38.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556563f61cc0 con 0x7f8330087680 2024-09-21T09:03:38.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8334029040 con 0x7f8330087680 2024-09-21T09:03:38.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f8340e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:38.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f8340e2f800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:38.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f8340e2f800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:38.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f8340e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:38.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f8340e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:38.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f8340e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:38.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f8340e2f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f5db60 con 0x556563f55ce0 2024-09-21T09:03:38.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8334029040 con 0x556563f55ce0 2024-09-21T09:03:38.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f8340e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f8340e2f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f5dfe0 con 0x556563f55ce0 2024-09-21T09:03:38.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:38.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.974+0000 7f8340e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:38.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f5e4c0 con 0x556563f55ce0 2024-09-21T09:03:38.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:38.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:38.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 20 zone default found 2024-09-21T09:03:38.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 4 Realm: () 2024-09-21T09:03:38.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:38.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:38.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:38.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 20 zonegroup default 2024-09-21T09:03:38.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f62140 con 0x556563f5a550 2024-09-21T09:03:38.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f64370 con 0x556563f5f130 2024-09-21T09:03:38.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 20 rados->read ofs=0 len=0 2024-09-21T09:03:38.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.975+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f64710 con 0x556563f5f130 2024-09-21T09:03:38.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.976+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.976+0000 7f8340e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:38.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.976+0000 7f8340e2f800 20 started sync module instance, tier type = 2024-09-21T09:03:38.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.976+0000 7f8340e2f800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:38.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.976+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f637b0 con 0x7f8330087680 2024-09-21T09:03:38.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.977+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:38.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.977+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93893957139408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f637b0 con 0x7f8330087680 2024-09-21T09:03:38.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.977+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f650d0 con 0x556563f55ce0 2024-09-21T09:03:38.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.978+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93893957139408] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:38.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.978+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:38.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.978+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93893957137632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f650d0 con 0x556563f55ce0 2024-09-21T09:03:38.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.978+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f65ad0 con 0x556563f5f130 2024-09-21T09:03:38.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.979+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93893957137632] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:38.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.979+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.979+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93893957143584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f65040 con 0x556563f5f130 2024-09-21T09:03:38.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.979+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f66990 con 0x7f8330087680 2024-09-21T09:03:38.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.980+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93893957143584] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.980+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:38.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.980+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93893957149920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f66db0 con 0x7f8330087680 2024-09-21T09:03:38.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.980+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f67770 con 0x556563f55ce0 2024-09-21T09:03:38.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.982+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93893957149920] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:38.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.982+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:38.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.982+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93893957151456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f67770 con 0x556563f55ce0 2024-09-21T09:03:38.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.982+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f68130 con 0x556563f5a550 2024-09-21T09:03:38.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.983+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.983+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93893957155968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f68550 con 0x556563f5a550 2024-09-21T09:03:38.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.983+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f69030 con 0x556563f5a550 2024-09-21T09:03:38.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.983+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93893957151456] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:38.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.984+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93893957155968] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.984+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.984+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93893957159744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f680e0 con 0x556563f5a550 2024-09-21T09:03:38.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.984+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f696c0 con 0x556563f5a550 2024-09-21T09:03:38.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.985+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(58 notify.7 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.985+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93893957161488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f69ae0 con 0x556563f5a550 2024-09-21T09:03:38.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.985+0000 7f8340e2f800 20 add_watcher() i=0 2024-09-21T09:03:38.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.985+0000 7f8340e2f800 20 add_watcher() i=1 2024-09-21T09:03:38.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.985+0000 7f8340e2f800 20 add_watcher() i=2 2024-09-21T09:03:38.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.985+0000 7f8340e2f800 20 add_watcher() i=3 2024-09-21T09:03:38.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.985+0000 7f8340e2f800 20 add_watcher() i=4 2024-09-21T09:03:38.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.985+0000 7f8340e2f800 20 add_watcher() i=5 2024-09-21T09:03:38.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.986+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93893957159744] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.986+0000 7f8340e2f800 20 add_watcher() i=6 2024-09-21T09:03:38.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.986+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93893957161488] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.986+0000 7f8340e2f800 20 add_watcher() i=7 2024-09-21T09:03:38.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.986+0000 7f8340e2f800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:38.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.987+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563f6cb10 con 0x556563f55ce0 2024-09-21T09:03:38.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.987+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:38.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.987+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93893957162544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f69fd0 con 0x556563f55ce0 2024-09-21T09:03:38.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.988+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93893957162544] v31'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:38.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.988+0000 7f81f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:38.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.988+0000 7f8340e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:38.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.988+0000 7f8340e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:38.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.988+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f751b0 con 0x556563f55ce0 2024-09-21T09:03:38.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.989+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:38.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.989+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f75720 con 0x556563f5a550 2024-09-21T09:03:38.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.990+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.990+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f75720 con 0x556563f5f130 2024-09-21T09:03:38.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.991+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.991+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f75fd0 con 0x556563f55ce0 2024-09-21T09:03:38.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.992+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'169 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:38.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.992+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f731c0 con 0x7f8330087680 2024-09-21T09:03:38.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.993+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:38.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.993+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f73190 con 0x556563f5f130 2024-09-21T09:03:38.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.994+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'39 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:38.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.994+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f76b60 con 0x556563f55ce0 2024-09-21T09:03:38.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.995+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:38.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.995+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f76b60 con 0x556563f5a550 2024-09-21T09:03:38.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.996+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:38.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.996+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f76bf0 con 0x7f8330087680 2024-09-21T09:03:38.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.997+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:38.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.997+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f76bf0 con 0x556563f5f130 2024-09-21T09:03:39.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.998+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.998+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77220 con 0x7f8330087680 2024-09-21T09:03:39.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.999+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:38.999+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77190 con 0x556563f5a550 2024-09-21T09:03:39.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.000+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.000+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x7f8330087680 2024-09-21T09:03:39.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.001+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.001+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f5a550 2024-09-21T09:03:39.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.002+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.002+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f55ce0 2024-09-21T09:03:39.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.003+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'170 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.003+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f5f130 2024-09-21T09:03:39.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.004+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'50 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.004+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x7f8330087680 2024-09-21T09:03:39.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.005+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.005+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f5f130 2024-09-21T09:03:39.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.006+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.006+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f55ce0 2024-09-21T09:03:39.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.008+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.008+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f55ce0 2024-09-21T09:03:39.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.009+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'171 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.009+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f5f130 2024-09-21T09:03:39.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.010+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'51 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.010+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x7f8330087680 2024-09-21T09:03:39.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.011+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.011+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f5f130 2024-09-21T09:03:39.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.012+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.012+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f5f130 2024-09-21T09:03:39.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.013+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.013+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f5f130 2024-09-21T09:03:39.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.014+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.014+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f5f130 2024-09-21T09:03:39.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.015+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.015+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f5a550 2024-09-21T09:03:39.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.016+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.016+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f5f130 2024-09-21T09:03:39.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.017+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.017+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f5a550 2024-09-21T09:03:39.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.018+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.018+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f5f130 2024-09-21T09:03:39.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.019+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'52 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.019+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x556563f5a550 2024-09-21T09:03:39.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.020+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.020+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f77130 con 0x7f8330087680 2024-09-21T09:03:39.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.021+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.021+0000 7f816ffff640 20 reqs_thread_entry: start 2024-09-21T09:03:39.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.021+0000 7f8340e2f800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:39.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.021+0000 7f8340e2f800 20 Filter name: none 2024-09-21T09:03:39.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.021+0000 7f816dffb640 20 reqs_thread_entry: start 2024-09-21T09:03:39.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.021+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f55ce0 2024-09-21T09:03:39.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.022+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.022+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f55ce0 2024-09-21T09:03:39.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.022+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.022+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f55ce0 2024-09-21T09:03:39.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.022+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.022+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5a550 2024-09-21T09:03:39.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.022+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.023+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5a550 2024-09-21T09:03:39.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.023+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.023+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5a550 2024-09-21T09:03:39.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.023+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.023+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.023+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.023+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5f130 2024-09-21T09:03:39.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.024+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.024+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.024+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.024+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f55ce0 2024-09-21T09:03:39.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.024+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.024+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f55ce0 2024-09-21T09:03:39.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.024+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv164 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.024+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f55ce0 2024-09-21T09:03:39.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.025+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.025+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x7f8330087680 2024-09-21T09:03:39.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.025+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.025+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x7f8330087680 2024-09-21T09:03:39.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.025+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.025+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x7f8330087680 2024-09-21T09:03:39.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.026+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.026+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.026+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.026+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5f130 2024-09-21T09:03:39.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.026+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.026+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.026+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.026+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f55ce0 2024-09-21T09:03:39.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.026+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.027+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f55ce0 2024-09-21T09:03:39.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.027+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.027+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f55ce0 2024-09-21T09:03:39.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.027+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.027+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5a550 2024-09-21T09:03:39.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.027+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.027+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5a550 2024-09-21T09:03:39.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.028+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.028+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5a550 2024-09-21T09:03:39.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.028+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.028+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x7f8330087680 2024-09-21T09:03:39.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.029+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.029+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x7f8330087680 2024-09-21T09:03:39.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.029+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.029+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x7f8330087680 2024-09-21T09:03:39.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.029+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.029+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.029+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.029+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5f130 2024-09-21T09:03:39.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.030+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.030+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.030+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.030+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x7f8330087680 2024-09-21T09:03:39.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.030+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.030+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x7f8330087680 2024-09-21T09:03:39.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.030+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.030+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x7f8330087680 2024-09-21T09:03:39.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.030+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.031+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5a550 2024-09-21T09:03:39.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.031+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.031+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5a550 2024-09-21T09:03:39.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.031+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.031+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5a550 2024-09-21T09:03:39.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.032+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.032+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x7f8330087680 2024-09-21T09:03:39.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.032+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.032+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x7f8330087680 2024-09-21T09:03:39.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.032+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.032+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x7f8330087680 2024-09-21T09:03:39.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.032+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.032+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5a550 2024-09-21T09:03:39.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.033+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.033+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5a550 2024-09-21T09:03:39.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.033+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.033+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5a550 2024-09-21T09:03:39.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.033+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.033+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f55ce0 2024-09-21T09:03:39.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.034+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.034+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f55ce0 2024-09-21T09:03:39.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.034+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.034+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f55ce0 2024-09-21T09:03:39.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.034+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.034+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.034+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.034+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5f130 2024-09-21T09:03:39.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.035+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.035+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.035+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.035+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x7f8330087680 2024-09-21T09:03:39.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.035+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.035+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x7f8330087680 2024-09-21T09:03:39.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.035+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.035+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x7f8330087680 2024-09-21T09:03:39.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.036+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.036+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.036+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.036+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5f130 2024-09-21T09:03:39.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.036+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.036+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.036+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.036+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f55ce0 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.037+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.037+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f55ce0 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.037+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.037+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f55ce0 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.037+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.037+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f55ce0 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.037+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.037+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f55ce0 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.038+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv162 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.038+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f55ce0 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.038+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.038+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.038+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.038+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5f130 2024-09-21T09:03:39.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.038+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.038+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.039+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.039+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x7f8330087680 2024-09-21T09:03:39.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.039+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.039+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x7f8330087680 2024-09-21T09:03:39.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.039+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.039+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x7f8330087680 2024-09-21T09:03:39.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.039+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.040+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.040+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.040+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5f130 2024-09-21T09:03:39.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.040+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.040+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.040+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.040+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.040+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.040+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.041+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.041+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.041+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.041+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.041+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.041+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.041+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.041+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.041+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.042+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.042+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.042+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5f130 2024-09-21T09:03:39.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.042+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.042+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.042+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.042+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5a550 2024-09-21T09:03:39.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.043+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.043+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5a550 2024-09-21T09:03:39.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.043+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.043+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5a550 2024-09-21T09:03:39.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.043+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.043+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.044+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.044+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5f130 2024-09-21T09:03:39.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.044+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.044+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.044+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.044+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5a550 2024-09-21T09:03:39.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.045+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.045+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5a550 2024-09-21T09:03:39.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.045+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.045+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5a550 2024-09-21T09:03:39.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.046+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.046+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.046+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.046+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5f130 2024-09-21T09:03:39.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.046+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.046+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5f130 2024-09-21T09:03:39.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.046+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.046+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5a550 2024-09-21T09:03:39.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.047+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.047+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x556563f5a550 2024-09-21T09:03:39.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.047+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.047+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x556563f5a550 2024-09-21T09:03:39.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.047+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.047+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x7f8330087680 2024-09-21T09:03:39.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.048+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.048+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa1a00 con 0x7f8330087680 2024-09-21T09:03:39.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.048+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.048+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556563fa2a10 con 0x7f8330087680 2024-09-21T09:03:39.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.048+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.049+0000 7f81f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:39.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.049+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93893957162544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f53390 con 0x556563f55ce0 2024-09-21T09:03:39.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.050+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93893957162544] v31'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.050+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93893957139408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f69630 con 0x7f8330087680 2024-09-21T09:03:39.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.051+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93893957139408] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.051+0000 7f8340e2f800 20 remove_watcher() i=0 2024-09-21T09:03:39.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.051+0000 7f8340e2f800 2 removed watcher, disabling cache 2024-09-21T09:03:39.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.051+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93893957137632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f69630 con 0x556563f55ce0 2024-09-21T09:03:39.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.052+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93893957137632] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.053+0000 7f8340e2f800 20 remove_watcher() i=1 2024-09-21T09:03:39.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.053+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93893957143584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f634e0 con 0x556563f5f130 2024-09-21T09:03:39.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.054+0000 7f833e92a640 1 -- 172.21.15.178:0/3415475342 <== osd.3 v2:172.21.15.178:6808/24558189 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93893957143584] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833006c3f0 con 0x556563f5f130 2024-09-21T09:03:39.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.054+0000 7f8340e2f800 20 remove_watcher() i=2 2024-09-21T09:03:39.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.054+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93893957149920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f69630 con 0x7f8330087680 2024-09-21T09:03:39.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.054+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.2 v2:172.21.15.178:6816/3267136144 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93893957149920] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833403d040 con 0x7f8330087680 2024-09-21T09:03:39.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.054+0000 7f8340e2f800 20 remove_watcher() i=3 2024-09-21T09:03:39.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.054+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93893957151456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f64c20 con 0x556563f55ce0 2024-09-21T09:03:39.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.056+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 <== osd.1 v2:172.21.15.178:6800/627496675 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93893957151456] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833403d040 con 0x556563f55ce0 2024-09-21T09:03:39.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.056+0000 7f8340e2f800 20 remove_watcher() i=4 2024-09-21T09:03:39.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.056+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93893957155968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f664e0 con 0x556563f5a550 2024-09-21T09:03:39.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.057+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93893957155968] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.057+0000 7f8340e2f800 20 remove_watcher() i=5 2024-09-21T09:03:39.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.057+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93893957159744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f69630 con 0x556563f5a550 2024-09-21T09:03:39.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.058+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93893957159744] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.058+0000 7f8340e2f800 20 remove_watcher() i=6 2024-09-21T09:03:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.058+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93893957161488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556563f66ae0 con 0x556563f5a550 2024-09-21T09:03:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.058+0000 7f833f12b640 1 -- 172.21.15.178:0/3415475342 <== osd.0 v2:172.21.15.44:6800/2732047064 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93893957161488] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8338055070 con 0x556563f5a550 2024-09-21T09:03:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.058+0000 7f8340e2f800 20 remove_watcher() i=7 2024-09-21T09:03:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556563f5a550 msgr2=0x556563f5c940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556563f5a550 0x556563f5c940 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556563f55ce0 msgr2=0x556563f581a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556563f55ce0 0x556563f581a0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8330087680 msgr2=0x7f8330087aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8330087680 0x7f8330087aa0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556563f5f130 msgr2=0x556563f615f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556563f5f130 0x556563f615f0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8208036b90 msgr2=0x7f8208039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8208036b90 0x7f8208039050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x556563f27b90 tx=0x7f8330093000 comp rx=0 tx=0).stop 2024-09-21T09:03:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f42dc0 msgr2=0x556563f4a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 --2- 172.21.15.178:0/3415475342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f42dc0 0x556563f4a240 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8338022f90 tx=0x7f833804ce80 comp rx=0 tx=0).stop 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 reap_dead start 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f833e129640 1 -- 172.21.15.178:0/3415475342 reap_dead start 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 shutdown_connections 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 >> 172.21.15.178:0/3415475342 conn(0x556563f3f170 msgr2=0x556563f44500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 shutdown_connections 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/3415475342 wait complete. 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/909298327 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8218036b40 msgr2=0x7f8218039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 --2- 172.21.15.178:0/909298327 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8218036b40 0x7f8218039000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x556563f22e20 tx=0x7f833007ef70 comp rx=0 tx=0).stop 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/909298327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f36160 msgr2=0x556563f36580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 --2- 172.21.15.178:0/909298327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f36160 0x556563f36580 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x556563f1c4e0 tx=0x7f833800aec0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/909298327 shutdown_connections 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 --2- 172.21.15.178:0/909298327 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8218036b40 0x7f8218039000 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 --2- 172.21.15.178:0/909298327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563f36160 0x556563f36580 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/909298327 >> 172.21.15.178:0/909298327 conn(0x556563f2b0f0 msgr2=0x556563f2dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/909298327 shutdown_connections 2024-09-21T09:03:39.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.059+0000 7f8340e2f800 1 -- 172.21.15.178:0/909298327 wait complete. 2024-09-21T09:03:39.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556563f24cb0 msgr2=0x556563f270a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556563f24cb0 0x556563f270a0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556563e25790 msgr2=0x556563f224a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556563e25790 0x556563f224a0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8224036b90 msgr2=0x7f8224039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8224036b90 0x7f8224039050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8334000f60 tx=0x7f83340012b0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 msgr2=0x556563f1b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563f1b430 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8330046130 tx=0x7f8330003330 comp rx=0 tx=0).stop 2024-09-21T09:03:39.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 shutdown_connections 2024-09-21T09:03:39.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556563f24cb0 0x556563f270a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556563e25790 0x556563f224a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8224036b90 0x7f8224039050 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 --2- 172.21.15.178:0/2685529526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556563d96630 0x556563f1b430 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 >> 172.21.15.178:0/2685529526 conn(0x556563e1cde0 msgr2=0x556563f0ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 shutdown_connections 2024-09-21T09:03:39.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.060+0000 7f8340e2f800 1 -- 172.21.15.178:0/2685529526 wait complete. 2024-09-21T09:03:39.070 INFO:teuthology.orchestra.run.smithi178.stdout:[] 2024-09-21T09:03:39.070 DEBUG:tasks.util.rgw: json result: [] 2024-09-21T09:03:39.071 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-21T09:03:39.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-21T09:03:39.071 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-21T09:03:39.155 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:39.155 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:39.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.154+0000 7f3bce010800 1 Processor -- start 2024-09-21T09:03:39.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.154+0000 7f3bce010800 1 -- start start 2024-09-21T09:03:39.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.155+0000 7f3bce010800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5616296a25d0 0x5616297336b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.155+0000 7f3bce010800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5616295edb30 con 0x561629733bf0 2024-09-21T09:03:39.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.155+0000 7f3bce010800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5616295cf360 con 0x5616296a25d0 2024-09-21T09:03:39.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.155+0000 7f3bc96f7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5616296a25d0 0x5616297336b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.155+0000 7f3bc96f7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5616296a25d0 0x5616297336b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49506/0 (socket says 172.21.15.178:49506) 2024-09-21T09:03:39.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.155+0000 7f3bc96f7640 1 -- 172.21.15.178:0/1973596359 learned_addr learned my addr 172.21.15.178:0/1973596359 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.155+0000 7f3bc0ef6640 1 --1- 172.21.15.178:0/1973596359 >> v1:172.21.15.44:6789/0 conn(0x561629733bf0 0x561629735fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:45124/0 (socket says 172.21.15.178:45124) 2024-09-21T09:03:39.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.155+0000 7f3bc96f7640 1 -- 172.21.15.178:0/1973596359 >> v1:172.21.15.44:6789/0 conn(0x561629733bf0 legacy=0x561629735fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.158 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.155+0000 7f3bc96f7640 1 -- 172.21.15.178:0/1973596359 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616295f5e00 con 0x5616296a25d0 2024-09-21T09:03:39.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.157+0000 7f3bc96f7640 1 --2- 172.21.15.178:0/1973596359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x5616297336b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00a520 tx=0x7f3bbc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a9ba94d38a84eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.157+0000 7f3bc8ef6640 1 -- 172.21.15.178:0/1973596359 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc055070 con 0x5616296a25d0 2024-09-21T09:03:39.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.157+0000 7f3bc8ef6640 1 -- 172.21.15.178:0/1973596359 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bbc0515b0 con 0x5616296a25d0 2024-09-21T09:03:39.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.157+0000 7f3bc8ef6640 1 -- 172.21.15.178:0/1973596359 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc0518d0 con 0x5616296a25d0 2024-09-21T09:03:39.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.158+0000 7f3bce010800 1 -- 172.21.15.178:0/1973596359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 msgr2=0x5616297336b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.158+0000 7f3bce010800 1 --2- 172.21.15.178:0/1973596359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x5616297336b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00a520 tx=0x7f3bbc045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.158+0000 7f3bce010800 1 -- 172.21.15.178:0/1973596359 shutdown_connections 2024-09-21T09:03:39.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.158+0000 7f3bce010800 1 --2- 172.21.15.178:0/1973596359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x5616297336b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.158+0000 7f3bce010800 1 -- 172.21.15.178:0/1973596359 >> 172.21.15.178:0/1973596359 conn(0x561629728de0 msgr2=0x56162972b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.158+0000 7f3bce010800 1 -- 172.21.15.178:0/1973596359 shutdown_connections 2024-09-21T09:03:39.160 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.158+0000 7f3bce010800 1 -- 172.21.15.178:0/1973596359 wait complete. 2024-09-21T09:03:39.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.171+0000 7f3bce010800 1 Processor -- start 2024-09-21T09:03:39.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.171+0000 7f3bce010800 1 -- start start 2024-09-21T09:03:39.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.172+0000 7f3bce010800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x56162981fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.172+0000 7f3bce010800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56162967a330 con 0x5616296a25d0 2024-09-21T09:03:39.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.172+0000 7f3bc96f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x56162981fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.172+0000 7f3bc96f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x56162981fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49514/0 (socket says 172.21.15.178:49514) 2024-09-21T09:03:39.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.172+0000 7f3bc96f7640 1 -- 172.21.15.178:0/936092878 learned_addr learned my addr 172.21.15.178:0/936092878 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.172+0000 7f3bc96f7640 1 -- 172.21.15.178:0/936092878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616295c7bc0 con 0x5616296a25d0 2024-09-21T09:03:39.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.173+0000 7f3bc96f7640 1 --2- 172.21.15.178:0/936092878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x56162981fa80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc025da0 tx=0x7f3bbc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f8120e8cf65ea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.173+0000 7f3ab7606640 1 -- 172.21.15.178:0/936092878 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc051950 con 0x5616296a25d0 2024-09-21T09:03:39.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.173+0000 7f3ab7606640 1 -- 172.21.15.178:0/936092878 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bbc051af0 con 0x5616296a25d0 2024-09-21T09:03:39.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.173+0000 7f3ab7606640 1 -- 172.21.15.178:0/936092878 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc051dd0 con 0x5616296a25d0 2024-09-21T09:03:39.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.174+0000 7f3bce010800 1 -- 172.21.15.178:0/936092878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 msgr2=0x56162981fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.174+0000 7f3bce010800 1 --2- 172.21.15.178:0/936092878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x56162981fa80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc025da0 tx=0x7f3bbc051000 comp rx=0 tx=0).stop 2024-09-21T09:03:39.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.174+0000 7f3bce010800 1 -- 172.21.15.178:0/936092878 shutdown_connections 2024-09-21T09:03:39.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.174+0000 7f3bce010800 1 --2- 172.21.15.178:0/936092878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x56162981fa80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.174+0000 7f3bce010800 1 -- 172.21.15.178:0/936092878 >> 172.21.15.178:0/936092878 conn(0x561629728de0 msgr2=0x56162981b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.177 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.174+0000 7f3bce010800 1 -- 172.21.15.178:0/936092878 shutdown_connections 2024-09-21T09:03:39.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.174+0000 7f3bce010800 1 -- 172.21.15.178:0/936092878 wait complete. 2024-09-21T09:03:39.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.174+0000 7f3bce010800 1 Processor -- start 2024-09-21T09:03:39.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.174+0000 7f3bce010800 1 -- start start 2024-09-21T09:03:39.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.174+0000 7f3bce010800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x5616298272b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.174+0000 7f3bce010800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5616297379a0 con 0x5616296a25d0 2024-09-21T09:03:39.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.175+0000 7f3bc96f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x5616298272b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.175+0000 7f3bc96f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x5616298272b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49518/0 (socket says 172.21.15.178:49518) 2024-09-21T09:03:39.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.175+0000 7f3bc96f7640 1 -- 172.21.15.178:0/803174762 learned_addr learned my addr 172.21.15.178:0/803174762 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.175+0000 7f3bc96f7640 1 -- 172.21.15.178:0/803174762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616295dbfe0 con 0x5616296a25d0 2024-09-21T09:03:39.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.175+0000 7f3bc96f7640 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x5616298272b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc067040 tx=0x7f3bbc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.175+0000 7f3ab5e03640 1 -- 172.21.15.178:0/803174762 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc073070 con 0x5616296a25d0 2024-09-21T09:03:39.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.175+0000 7f3ab5e03640 1 -- 172.21.15.178:0/803174762 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bbc05a450 con 0x5616296a25d0 2024-09-21T09:03:39.178 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.175+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616298277f0 con 0x5616296a25d0 2024-09-21T09:03:39.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.175+0000 7f3ab5e03640 1 -- 172.21.15.178:0/803174762 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc05a730 con 0x5616296a25d0 2024-09-21T09:03:39.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.175+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561629827d70 con 0x5616296a25d0 2024-09-21T09:03:39.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.176+0000 7f3ab5e03640 1 -- 172.21.15.178:0/803174762 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3bbc076070 con 0x5616296a25d0 2024-09-21T09:03:39.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.176+0000 7f3ab5e03640 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3ab0036b90 0x7f3ab0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.176+0000 7f3ab5e03640 1 -- 172.21.15.178:0/803174762 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f3bbc062070 con 0x5616296a25d0 2024-09-21T09:03:39.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.176+0000 7f3bc0ef6640 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3ab0036b90 0x7f3ab0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.177+0000 7f3bce010800 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561629733bf0 0x56162982e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.177+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56162982e8a0 con 0x561629733bf0 2024-09-21T09:03:39.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.177+0000 7f3bc9ef8640 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561629733bf0 0x56162982e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.177+0000 7f3bc0ef6640 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3ab0036b90 0x7f3ab0039050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4000f60 tx=0x7f3bb4001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.177+0000 7f3bc9ef8640 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561629733bf0 0x56162982e320 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.177+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/803174762 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bc400a4a0 con 0x561629733bf0 2024-09-21T09:03:39.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.177+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56162982b8f0 con 0x561629733bf0 2024-09-21T09:03:39.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.178+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/803174762 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3bc400a4a0 con 0x561629733bf0 2024-09-21T09:03:39.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.178+0000 7f3bce010800 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561629830bd0 0x561629832fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.178+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5616298336b0 con 0x561629830bd0 2024-09-21T09:03:39.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.178+0000 7f3bc96f7640 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561629830bd0 0x561629832fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.178+0000 7f3bc96f7640 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561629830bd0 0x561629832fc0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.178+0000 7f3bc96f7640 1 -- 172.21.15.178:0/803174762 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3bbc07f070 con 0x561629830bd0 2024-09-21T09:03:39.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.178+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56162982fa70 con 0x561629733bf0 2024-09-21T09:03:39.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.179+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/803174762 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3bc400a4a0 con 0x561629733bf0 2024-09-21T09:03:39.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.179+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56162982ff50 con 0x561629733bf0 2024-09-21T09:03:39.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.179+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/803174762 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3bc400a4a0 con 0x561629733bf0 2024-09-21T09:03:39.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.179+0000 7f3bce010800 1 Processor -- start 2024-09-21T09:03:39.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.179+0000 7f3bce010800 1 -- start start 2024-09-21T09:03:39.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.179+0000 7f3bce010800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561629842030 0x561629842450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.179+0000 7f3bce010800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5616295c9580 con 0x561629842030 2024-09-21T09:03:39.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.180+0000 7f3bc9ef8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561629842030 0x561629842450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.180+0000 7f3bc9ef8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561629842030 0x561629842450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49526/0 (socket says 172.21.15.178:49526) 2024-09-21T09:03:39.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.180+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/254279146 learned_addr learned my addr 172.21.15.178:0/254279146 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.180+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/254279146 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561629842990 con 0x561629842030 2024-09-21T09:03:39.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.180+0000 7f3bc9ef8640 1 --2- 172.21.15.178:0/254279146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561629842030 0x561629842450 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x56162982ec80 tx=0x7f3bc4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.180+0000 7f3aaeffd640 1 -- 172.21.15.178:0/254279146 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bc4014450 con 0x561629842030 2024-09-21T09:03:39.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.180+0000 7f3aaeffd640 1 -- 172.21.15.178:0/254279146 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc4014610 con 0x561629842030 2024-09-21T09:03:39.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.180+0000 7f3aaeffd640 1 -- 172.21.15.178:0/254279146 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bc4014930 con 0x561629842030 2024-09-21T09:03:39.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.180+0000 7f3bce010800 1 -- 172.21.15.178:0/254279146 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561629842c20 con 0x561629842030 2024-09-21T09:03:39.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.180+0000 7f3bce010800 1 -- 172.21.15.178:0/254279146 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561629845900 con 0x561629842030 2024-09-21T09:03:39.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.181+0000 7f3aaeffd640 1 -- 172.21.15.178:0/254279146 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3bc4011040 con 0x561629842030 2024-09-21T09:03:39.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.181+0000 7f3aaeffd640 1 --2- 172.21.15.178:0/254279146 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3aa0036b90 0x7f3aa0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.181+0000 7f3aaeffd640 1 -- 172.21.15.178:0/254279146 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f3bc401e070 con 0x561629842030 2024-09-21T09:03:39.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.181+0000 7f3bc96f7640 1 --2- 172.21.15.178:0/254279146 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3aa0036b90 0x7f3aa0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.182+0000 7f3bce010800 1 Processor -- start 2024-09-21T09:03:39.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.182+0000 7f3bce010800 1 -- start start 2024-09-21T09:03:39.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.182+0000 7f3bc96f7640 1 --2- 172.21.15.178:0/254279146 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3aa0036b90 0x7f3aa0039050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x56162982ed20 tx=0x7f3bbc065ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.182+0000 7f3bce010800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56162984ec90 0x56162984f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.182+0000 7f3bce010800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561629820170 con 0x56162984ec90 2024-09-21T09:03:39.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.182+0000 7f3bc9ef8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56162984ec90 0x56162984f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.182+0000 7f3bc9ef8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56162984ec90 0x56162984f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49532/0 (socket says 172.21.15.178:49532) 2024-09-21T09:03:39.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.182+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/468019813 learned_addr learned my addr 172.21.15.178:0/468019813 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.182+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/468019813 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162984f660 con 0x56162984ec90 2024-09-21T09:03:39.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.183+0000 7f3bc9ef8640 1 --2- 172.21.15.178:0/468019813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56162984ec90 0x56162984f090 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3bc404cb80 tx=0x7f3bc403bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0df8c082583dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.183+0000 7f3aacff9640 1 -- 172.21.15.178:0/468019813 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bc40168f0 con 0x56162984ec90 2024-09-21T09:03:39.191 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.183+0000 7f3aacff9640 1 -- 172.21.15.178:0/468019813 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc4044020 con 0x56162984ec90 2024-09-21T09:03:39.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.183+0000 7f3aacff9640 1 -- 172.21.15.178:0/468019813 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bc4014c00 con 0x56162984ec90 2024-09-21T09:03:39.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.183+0000 7f3bce010800 1 -- 172.21.15.178:0/468019813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56162984ec90 msgr2=0x56162984f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.183+0000 7f3bce010800 1 --2- 172.21.15.178:0/468019813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56162984ec90 0x56162984f090 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3bc404cb80 tx=0x7f3bc403bf60 comp rx=0 tx=0).stop 2024-09-21T09:03:39.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.183+0000 7f3bce010800 1 -- 172.21.15.178:0/468019813 shutdown_connections 2024-09-21T09:03:39.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.183+0000 7f3bce010800 1 --2- 172.21.15.178:0/468019813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56162984ec90 0x56162984f090 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.183+0000 7f3bce010800 1 -- 172.21.15.178:0/468019813 >> 172.21.15.178:0/468019813 conn(0x56162984aff0 msgr2=0x5616298490f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.183+0000 7f3bce010800 1 -- 172.21.15.178:0/468019813 shutdown_connections 2024-09-21T09:03:39.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.183+0000 7f3bce010800 1 -- 172.21.15.178:0/468019813 wait complete. 2024-09-21T09:03:39.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.183+0000 7f3bce010800 1 Processor -- start 2024-09-21T09:03:39.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.184+0000 7f3bce010800 1 -- start start 2024-09-21T09:03:39.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.184+0000 7f3bce010800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56162984ec90 0x561629856130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.184+0000 7f3bce010800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56162984fcd0 con 0x56162984ec90 2024-09-21T09:03:39.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.184+0000 7f3bc9ef8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56162984ec90 0x561629856130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.192 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.184+0000 7f3bc9ef8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56162984ec90 0x561629856130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49542/0 (socket says 172.21.15.178:49542) 2024-09-21T09:03:39.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.184+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 learned_addr learned my addr 172.21.15.178:0/2280396282 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.184+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561629856670 con 0x56162984ec90 2024-09-21T09:03:39.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.184+0000 7f3bc9ef8640 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56162984ec90 0x561629856130 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3bc404cb80 tx=0x7f3bc404cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.184+0000 7f3a9effd640 1 -- 172.21.15.178:0/2280396282 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bc4022e60 con 0x56162984ec90 2024-09-21T09:03:39.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.184+0000 7f3a9effd640 1 -- 172.21.15.178:0/2280396282 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc404e2e0 con 0x56162984ec90 2024-09-21T09:03:39.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.185+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561629856900 con 0x56162984ec90 2024-09-21T09:03:39.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.185+0000 7f3a9effd640 1 -- 172.21.15.178:0/2280396282 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bc404b250 con 0x56162984ec90 2024-09-21T09:03:39.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.185+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616298595b0 con 0x56162984ec90 2024-09-21T09:03:39.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.185+0000 7f3a9effd640 1 -- 172.21.15.178:0/2280396282 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3bc404b3f0 con 0x56162984ec90 2024-09-21T09:03:39.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.185+0000 7f3a9effd640 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a94036b40 0x7f3a94039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.186+0000 7f3a9effd640 1 -- 172.21.15.178:0/2280396282 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f3bc4033030 con 0x56162984ec90 2024-09-21T09:03:39.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.186+0000 7f3bc96f7640 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a94036b40 0x7f3a94039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.186+0000 7f3bc96f7640 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a94036b40 0x7f3a94039000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x561629833ab0 tx=0x7f3bbc08b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.186+0000 7f3bce010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.186+0000 7f3bce010800 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561629861e60 0x561629864320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.186+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561629864a70 con 0x561629861e60 2024-09-21T09:03:39.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.186+0000 7f3bc0ef6640 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561629861e60 0x561629864320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bc0ef6640 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561629861e60 0x561629864320 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bb400f610 con 0x561629861e60 2024-09-21T09:03:39.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bce010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bce010800 20 realm 2024-09-21T09:03:39.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bce010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5616298612b0 con 0x561629861e60 2024-09-21T09:03:39.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bb400f610 con 0x561629861e60 2024-09-21T09:03:39.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bce010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bce010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:39.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bce010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561629865560 con 0x561629861e60 2024-09-21T09:03:39.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bb400f610 con 0x561629861e60 2024-09-21T09:03:39.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bce010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bce010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.187+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561629865e30 con 0x561629861e60 2024-09-21T09:03:39.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.188+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3bb400f610 con 0x561629861e60 2024-09-21T09:03:39.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.188+0000 7f3bce010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:39.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.188+0000 7f3bce010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.188+0000 7f3bce010800 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561629866850 0x561629868c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.188+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561629869330 con 0x561629866850 2024-09-21T09:03:39.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.188+0000 7f3bc9ef8640 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561629866850 0x561629868c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.188+0000 7f3bc9ef8640 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561629866850 0x561629868c40 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.189+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.189+0000 7f3bce010800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:39.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.189+0000 7f3bce010800 20 searching for the correct realm 2024-09-21T09:03:39.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.189+0000 7f3bce010800 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56162986b2e0 0x56162986d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.189+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x56162986b2e0 2024-09-21T09:03:39.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.189+0000 7f3bc96f7640 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56162986b2e0 0x56162986d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.189+0000 7f3bc96f7640 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56162986b2e0 0x56162986d7a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.189+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.189+0000 7f3bc96f7640 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3bbc078070 0x7f3bbc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.189+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x7f3bbc078070 2024-09-21T09:03:39.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.189+0000 7f3bc0ef6640 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3bbc078070 0x7f3bbc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.190+0000 7f3bc0ef6640 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3bbc078070 0x7f3bbc06e3c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.190+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb400f610 con 0x7f3bbc078070 2024-09-21T09:03:39.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.190+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629866850 2024-09-21T09:03:39.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.190+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.190+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629861e60 2024-09-21T09:03:39.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.191+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb400f610 con 0x561629861e60 2024-09-21T09:03:39.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.191+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629861e60 2024-09-21T09:03:39.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.191+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb402b040 con 0x561629861e60 2024-09-21T09:03:39.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.191+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629866850 2024-09-21T09:03:39.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.191+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.191+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629866850 2024-09-21T09:03:39.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.191+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.191+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x7f3bbc078070 2024-09-21T09:03:39.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.192+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb402b040 con 0x7f3bbc078070 2024-09-21T09:03:39.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.192+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x56162986b2e0 2024-09-21T09:03:39.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.192+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.192+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629861e60 2024-09-21T09:03:39.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.192+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb402b040 con 0x561629861e60 2024-09-21T09:03:39.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.192+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629866850 2024-09-21T09:03:39.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.193+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.193+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629861e60 2024-09-21T09:03:39.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.193+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb402b040 con 0x561629861e60 2024-09-21T09:03:39.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.193+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x7f3bbc078070 2024-09-21T09:03:39.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.193+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3bb402b040 con 0x7f3bbc078070 2024-09-21T09:03:39.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.193+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x56162986b2e0 2024-09-21T09:03:39.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.193+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.193+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x56162986b2e0 2024-09-21T09:03:39.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.193+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.193+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629866850 2024-09-21T09:03:39.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.194+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.194+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x56162986b2e0 2024-09-21T09:03:39.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.194+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.194+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x56162986b2e0 2024-09-21T09:03:39.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.194+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.194+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629861e60 2024-09-21T09:03:39.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.194+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3bb402b040 con 0x561629861e60 2024-09-21T09:03:39.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.194+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629861e60 2024-09-21T09:03:39.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.195+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3bb402b040 con 0x561629861e60 2024-09-21T09:03:39.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.195+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629866850 2024-09-21T09:03:39.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.195+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.195+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x56162986b2e0 2024-09-21T09:03:39.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.195+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.195+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x7f3bbc078070 2024-09-21T09:03:39.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.195+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb402b040 con 0x7f3bbc078070 2024-09-21T09:03:39.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.195+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629861e60 2024-09-21T09:03:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.196+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb402b040 con 0x561629861e60 2024-09-21T09:03:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.196+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629866850 2024-09-21T09:03:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.196+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.196+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x56162986b2e0 2024-09-21T09:03:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.196+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.196+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x7f3bbc078070 2024-09-21T09:03:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.196+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb402b040 con 0x7f3bbc078070 2024-09-21T09:03:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.196+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x7f3bbc078070 2024-09-21T09:03:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.197+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb402b040 con 0x7f3bbc078070 2024-09-21T09:03:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.197+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x56162986b2e0 2024-09-21T09:03:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.197+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.197+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629866850 2024-09-21T09:03:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.197+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.197+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x561629861e60 2024-09-21T09:03:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.197+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3bb402b040 con 0x561629861e60 2024-09-21T09:03:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.197+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56162986de70 con 0x7f3bbc078070 2024-09-21T09:03:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb402b040 con 0x7f3bbc078070 2024-09-21T09:03:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561629869cf0 con 0x561629861e60 2024-09-21T09:03:39.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561629869930 con 0x561629861e60 2024-09-21T09:03:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56162986a6d0 con 0x561629861e60 2024-09-21T09:03:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 zone default found 2024-09-21T09:03:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 4 Realm: () 2024-09-21T09:03:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:39.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 zonegroup default 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.198+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56162986e360 con 0x561629866850 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.199+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.199+0000 7f3bce010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.199+0000 7f3bce010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.199+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561629870630 con 0x56162986b2e0 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.199+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.199+0000 7f3bce010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.199+0000 7f3bce010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.199+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5616298709d0 con 0x56162986b2e0 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.199+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.199+0000 7f3bce010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.199+0000 7f3bce010800 20 started sync module instance, tier type = 2024-09-21T09:03:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.199+0000 7f3bce010800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.199+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56162986fac0 con 0x7f3bbc078070 2024-09-21T09:03:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.200+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x7f3bbc078070 2024-09-21T09:03:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.200+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94653185982448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56162986fac0 con 0x7f3bbc078070 2024-09-21T09:03:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.200+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298713e0 con 0x561629861e60 2024-09-21T09:03:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.201+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94653185982448] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x7f3bbc078070 2024-09-21T09:03:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.202+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.202+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94653185986832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56162986fac0 con 0x561629861e60 2024-09-21T09:03:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.202+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629871e30 con 0x56162986b2e0 2024-09-21T09:03:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.203+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94653185986832] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.203+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.203+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94653185979920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56162986fa30 con 0x56162986b2e0 2024-09-21T09:03:39.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.203+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629872cf0 con 0x7f3bbc078070 2024-09-21T09:03:39.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.204+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x7f3bbc078070 2024-09-21T09:03:39.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.204+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94653185993248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629873430 con 0x7f3bbc078070 2024-09-21T09:03:39.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.204+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629873f30 con 0x561629861e60 2024-09-21T09:03:39.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.204+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94653185979920] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.205+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94653185993248] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x7f3bbc078070 2024-09-21T09:03:39.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.205+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.205+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94653185997344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629873ef0 con 0x561629861e60 2024-09-21T09:03:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.205+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629874800 con 0x561629866850 2024-09-21T09:03:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.206+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.206+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94653185999696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629873ef0 con 0x561629866850 2024-09-21T09:03:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.206+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94653185997344] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.207+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629873ef0 con 0x561629866850 2024-09-21T09:03:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.208+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(56 notify.6 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.208+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94653185999696] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.208+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94653185991280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629874e70 con 0x561629866850 2024-09-21T09:03:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.208+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629875890 con 0x561629866850 2024-09-21T09:03:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.209+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94653185991280] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.209+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.209+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94653186000752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629875860 con 0x561629866850 2024-09-21T09:03:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.209+0000 7f3bce010800 20 add_watcher() i=0 2024-09-21T09:03:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.209+0000 7f3bce010800 20 add_watcher() i=1 2024-09-21T09:03:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.209+0000 7f3bce010800 20 add_watcher() i=2 2024-09-21T09:03:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.209+0000 7f3bce010800 20 add_watcher() i=3 2024-09-21T09:03:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.209+0000 7f3bce010800 20 add_watcher() i=4 2024-09-21T09:03:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.209+0000 7f3bce010800 20 add_watcher() i=5 2024-09-21T09:03:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.209+0000 7f3bce010800 20 add_watcher() i=6 2024-09-21T09:03:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.210+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94653186000752] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.210+0000 7f3bce010800 20 add_watcher() i=7 2024-09-21T09:03:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.210+0000 7f3bce010800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.210+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561629878cc0 con 0x561629861e60 2024-09-21T09:03:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.210+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.210+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94653186004352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629876210 con 0x561629861e60 2024-09-21T09:03:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.211+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94653186004352] v31'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.211+0000 7f3a7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.211+0000 7f3bce010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.211+0000 7f3bce010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.211+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298817b0 con 0x561629861e60 2024-09-21T09:03:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.212+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.212+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629881e00 con 0x561629866850 2024-09-21T09:03:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.213+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.213+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629881e00 con 0x56162986b2e0 2024-09-21T09:03:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.214+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.214+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629882670 con 0x561629861e60 2024-09-21T09:03:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.215+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'174 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.215+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56162987d4b0 con 0x7f3bbc078070 2024-09-21T09:03:39.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.216+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x7f3bbc078070 2024-09-21T09:03:39.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.216+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56162987d450 con 0x56162986b2e0 2024-09-21T09:03:39.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.217+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'41 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.217+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298831b0 con 0x561629861e60 2024-09-21T09:03:39.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.218+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.218+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298831b0 con 0x561629866850 2024-09-21T09:03:39.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.220+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.220+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298831b0 con 0x7f3bbc078070 2024-09-21T09:03:39.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.221+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x7f3bbc078070 2024-09-21T09:03:39.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.221+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298831b0 con 0x56162986b2e0 2024-09-21T09:03:39.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.222+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.222+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298831b0 con 0x7f3bbc078070 2024-09-21T09:03:39.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.222+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x7f3bbc078070 2024-09-21T09:03:39.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.222+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298831b0 con 0x561629866850 2024-09-21T09:03:39.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.224+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.224+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x7f3bbc078070 2024-09-21T09:03:39.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.225+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x7f3bbc078070 2024-09-21T09:03:39.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.225+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x561629866850 2024-09-21T09:03:39.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.226+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.226+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x561629861e60 2024-09-21T09:03:39.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.227+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'175 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.227+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x56162986b2e0 2024-09-21T09:03:39.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.228+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'53 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.228+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x7f3bbc078070 2024-09-21T09:03:39.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.229+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x7f3bbc078070 2024-09-21T09:03:39.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.229+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x56162986b2e0 2024-09-21T09:03:39.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.230+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.230+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x561629861e60 2024-09-21T09:03:39.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.231+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.231+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x561629861e60 2024-09-21T09:03:39.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.232+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'176 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.232+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x56162986b2e0 2024-09-21T09:03:39.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.233+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'54 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.233+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x7f3bbc078070 2024-09-21T09:03:39.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.234+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x7f3bbc078070 2024-09-21T09:03:39.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.234+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x56162986b2e0 2024-09-21T09:03:39.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.235+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.235+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x56162986b2e0 2024-09-21T09:03:39.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.236+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.236+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x56162986b2e0 2024-09-21T09:03:39.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.237+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.237+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x56162986b2e0 2024-09-21T09:03:39.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.237+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.237+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x561629866850 2024-09-21T09:03:39.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.238+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.238+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x56162986b2e0 2024-09-21T09:03:39.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.239+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.239+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x561629866850 2024-09-21T09:03:39.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.241+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.241+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x56162986b2e0 2024-09-21T09:03:39.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.242+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'55 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.242+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x561629866850 2024-09-21T09:03:39.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.243+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.243+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298837a0 con 0x7f3bbc078070 2024-09-21T09:03:39.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.244+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x7f3bbc078070 2024-09-21T09:03:39.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.244+0000 7f3a7e7e4640 20 reqs_thread_entry: start 2024-09-21T09:03:39.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.244+0000 7f3bce010800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:39.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.244+0000 7f3bce010800 20 Filter name: none 2024-09-21T09:03:39.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.244+0000 7f39effff640 20 reqs_thread_entry: start 2024-09-21T09:03:39.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.244+0000 7f3bce010800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:39.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.244+0000 7f3bce010800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.244+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5616298ae4b0 con 0x561629861e60 2024-09-21T09:03:39.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.245+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.245+0000 7f3bce010800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:39.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.245+0000 7f3bce010800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:39.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.245+0000 7f3bce010800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:39.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.245+0000 7f3bce010800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:39.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.245+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5616298ae4a0 con 0x7f3bbc078070 2024-09-21T09:03:39.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.245+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3bb403f040 con 0x7f3bbc078070 2024-09-21T09:03:39.248 INFO:teuthology.orchestra.run.smithi178.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-21T09:03:39.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.246+0000 7f3a7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:39.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.246+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94653186004352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5616298805e0 con 0x561629861e60 2024-09-21T09:03:39.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.247+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94653186004352] v31'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.247+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94653185982448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629875550 con 0x7f3bbc078070 2024-09-21T09:03:39.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.248+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94653185982448] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x7f3bbc078070 2024-09-21T09:03:39.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.248+0000 7f3bce010800 20 remove_watcher() i=0 2024-09-21T09:03:39.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.248+0000 7f3bce010800 2 removed watcher, disabling cache 2024-09-21T09:03:39.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.248+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94653185986832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56162986fff0 con 0x561629861e60 2024-09-21T09:03:39.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.249+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94653185986832] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.249+0000 7f3bce010800 20 remove_watcher() i=1 2024-09-21T09:03:39.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.249+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94653185979920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629871110 con 0x56162986b2e0 2024-09-21T09:03:39.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.250+0000 7f3bc96f7640 1 -- 172.21.15.178:0/2280396282 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94653185979920] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bbc07f070 con 0x56162986b2e0 2024-09-21T09:03:39.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.250+0000 7f3bce010800 20 remove_watcher() i=2 2024-09-21T09:03:39.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.250+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94653185993248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629871110 con 0x7f3bbc078070 2024-09-21T09:03:39.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.251+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.2 v2:172.21.15.178:6816/3267136144 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94653185993248] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x7f3bbc078070 2024-09-21T09:03:39.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.251+0000 7f3bce010800 20 remove_watcher() i=3 2024-09-21T09:03:39.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.251+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94653185997344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629872a20 con 0x561629861e60 2024-09-21T09:03:39.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.252+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94653185997344] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb403f040 con 0x561629861e60 2024-09-21T09:03:39.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.252+0000 7f3bce010800 20 remove_watcher() i=4 2024-09-21T09:03:39.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.252+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94653185999696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629871110 con 0x561629866850 2024-09-21T09:03:39.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.253+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94653185999696] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.253+0000 7f3bce010800 20 remove_watcher() i=5 2024-09-21T09:03:39.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.253+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94653185991280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629873a20 con 0x561629866850 2024-09-21T09:03:39.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.254+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94653185991280] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.254+0000 7f3bce010800 20 remove_watcher() i=6 2024-09-21T09:03:39.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.254+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94653186000752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561629874350 con 0x561629866850 2024-09-21T09:03:39.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.255+0000 7f3bc9ef8640 1 -- 172.21.15.178:0/2280396282 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94653186000752] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bc402a070 con 0x561629866850 2024-09-21T09:03:39.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.255+0000 7f3bce010800 20 remove_watcher() i=7 2024-09-21T09:03:39.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.255+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561629866850 msgr2=0x561629868c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.255+0000 7f3bce010800 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561629866850 0x561629868c40 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.255+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561629861e60 msgr2=0x561629864320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.255+0000 7f3bce010800 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561629861e60 0x561629864320 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.255+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3bbc078070 msgr2=0x7f3bbc06e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.255+0000 7f3bce010800 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f3bbc078070 0x7f3bbc06e3c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.255+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56162986b2e0 msgr2=0x56162986d7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.255+0000 7f3bce010800 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56162986b2e0 0x56162986d7a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a94036b40 msgr2=0x7f3a94039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3a94036b40 0x7f3a94039000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x561629833ab0 tx=0x7f3bbc08b000 comp rx=0 tx=0).stop 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56162984ec90 msgr2=0x561629856130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bc0ef6640 1 -- 172.21.15.178:0/2280396282 reap_dead start 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56162984ec90 0x561629856130 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3bc404cb80 tx=0x7f3bc404cb10 comp rx=0 tx=0).stop 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 shutdown_connections 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 --2- 172.21.15.178:0/2280396282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56162984ec90 0x561629856130 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 >> 172.21.15.178:0/2280396282 conn(0x56162984aff0 msgr2=0x5616298490c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 shutdown_connections 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/2280396282 wait complete. 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/254279146 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3aa0036b90 msgr2=0x7f3aa0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 --2- 172.21.15.178:0/254279146 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3aa0036b90 0x7f3aa0039050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x56162982ed20 tx=0x7f3bbc065ef0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/254279146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561629842030 msgr2=0x561629842450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 --2- 172.21.15.178:0/254279146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561629842030 0x561629842450 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x56162982ec80 tx=0x7f3bc4018830 comp rx=0 tx=0).stop 2024-09-21T09:03:39.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/254279146 shutdown_connections 2024-09-21T09:03:39.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 --2- 172.21.15.178:0/254279146 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3aa0036b90 0x7f3aa0039050 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 --2- 172.21.15.178:0/254279146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561629842030 0x561629842450 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/254279146 >> 172.21.15.178:0/254279146 conn(0x561629836fc0 msgr2=0x561629839b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/254279146 shutdown_connections 2024-09-21T09:03:39.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/254279146 wait complete. 2024-09-21T09:03:39.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561629830bd0 msgr2=0x561629832fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561629830bd0 0x561629832fc0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561629733bf0 msgr2=0x56162982e320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561629733bf0 0x56162982e320 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3ab0036b90 msgr2=0x7f3ab0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3ab0036b90 0x7f3ab0039050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4000f60 tx=0x7f3bb4001370 comp rx=0 tx=0).stop 2024-09-21T09:03:39.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.256+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 msgr2=0x5616298272b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.257+0000 7f3bce010800 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x5616298272b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc067040 tx=0x7f3bbc002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.257+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 shutdown_connections 2024-09-21T09:03:39.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.257+0000 7f3bce010800 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561629830bd0 0x561629832fc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.257+0000 7f3bce010800 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561629733bf0 0x56162982e320 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.257+0000 7f3bce010800 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3ab0036b90 0x7f3ab0039050 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.257+0000 7f3bce010800 1 --2- 172.21.15.178:0/803174762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616296a25d0 0x5616298272b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.257+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 >> 172.21.15.178:0/803174762 conn(0x561629728de0 msgr2=0x561629819cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.257+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 shutdown_connections 2024-09-21T09:03:39.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.257+0000 7f3bce010800 1 -- 172.21.15.178:0/803174762 wait complete. 2024-09-21T09:03:39.267 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-21T09:03:39.275 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-21T09:03:39.279 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:39.305 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:39.314 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:39.359 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-21T09:03:39.363 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:39.363 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-21T09:03:39.363 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-21T09:03:39.363 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-21T09:03:39.409 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:39.409 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:39.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.408+0000 7f95e9526800 1 Processor -- start 2024-09-21T09:03:39.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.408+0000 7f95e9526800 1 -- start start 2024-09-21T09:03:39.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.408+0000 7f95e9526800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x564cfe313920 0x564cfe315d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.408+0000 7f95e9526800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564cfe1cfb30 con 0x564cfe30f4e0 2024-09-21T09:03:39.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.408+0000 7f95e9526800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x564cfe1b1360 con 0x564cfe313920 2024-09-21T09:03:39.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.408+0000 7f95dc912640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x564cfe313920 0x564cfe315d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.408+0000 7f95dc912640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x564cfe313920 0x564cfe315d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49548/0 (socket says 172.21.15.178:49548) 2024-09-21T09:03:39.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.408+0000 7f95dc912640 1 -- 172.21.15.178:0/2908880957 learned_addr learned my addr 172.21.15.178:0/2908880957 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.408+0000 7f95e5113640 1 --1- 172.21.15.178:0/2908880957 >> v1:172.21.15.44:6789/0 conn(0x564cfe30f4e0 0x564cfe30f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:45140/0 (socket says 172.21.15.178:45140) 2024-09-21T09:03:39.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.409+0000 7f95dc912640 1 -- 172.21.15.178:0/2908880957 >> v1:172.21.15.44:6789/0 conn(0x564cfe30f4e0 legacy=0x564cfe30f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.409+0000 7f95e4912640 1 -- 172.21.15.178:0/2908880957 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1017700972 0 0) 0x564cfe1cfb30 con 0x564cfe30f4e0 2024-09-21T09:03:39.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.409+0000 7f95dc912640 1 -- 172.21.15.178:0/2908880957 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cfe1d7e00 con 0x564cfe313920 2024-09-21T09:03:39.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.410+0000 7f95dc912640 1 --2- 172.21.15.178:0/2908880957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe313920 0x564cfe315d10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f95d000a520 tx=0x7f95d0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98efd5feefd7c121 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.411+0000 7f95e4912640 1 -- 172.21.15.178:0/2908880957 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95d0055070 con 0x564cfe313920 2024-09-21T09:03:39.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.411+0000 7f95e4912640 1 -- 172.21.15.178:0/2908880957 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d00515b0 con 0x564cfe313920 2024-09-21T09:03:39.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.411+0000 7f95e4912640 1 -- 172.21.15.178:0/2908880957 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95d00518d0 con 0x564cfe313920 2024-09-21T09:03:39.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.411+0000 7f95e9526800 1 -- 172.21.15.178:0/2908880957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe313920 msgr2=0x564cfe315d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.411+0000 7f95e9526800 1 --2- 172.21.15.178:0/2908880957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe313920 0x564cfe315d10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f95d000a520 tx=0x7f95d0045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.411+0000 7f95e9526800 1 -- 172.21.15.178:0/2908880957 shutdown_connections 2024-09-21T09:03:39.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.411+0000 7f95e9526800 1 --2- 172.21.15.178:0/2908880957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe313920 0x564cfe315d10 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.411+0000 7f95e9526800 1 -- 172.21.15.178:0/2908880957 >> 172.21.15.178:0/2908880957 conn(0x564cfe30add0 msgr2=0x564cfe30d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.411+0000 7f95e9526800 1 -- 172.21.15.178:0/2908880957 shutdown_connections 2024-09-21T09:03:39.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.411+0000 7f95e9526800 1 -- 172.21.15.178:0/2908880957 wait complete. 2024-09-21T09:03:39.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.425+0000 7f95e9526800 1 Processor -- start 2024-09-21T09:03:39.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.425+0000 7f95e9526800 1 -- start start 2024-09-21T09:03:39.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.425+0000 7f95e9526800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe30f4e0 0x564cfe283da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.425+0000 7f95e9526800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564cfe25c360 con 0x564cfe30f4e0 2024-09-21T09:03:39.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.425+0000 7f95e5113640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe30f4e0 0x564cfe283da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.425+0000 7f95e5113640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe30f4e0 0x564cfe283da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49550/0 (socket says 172.21.15.178:49550) 2024-09-21T09:03:39.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.425+0000 7f95e5113640 1 -- 172.21.15.178:0/3117597243 learned_addr learned my addr 172.21.15.178:0/3117597243 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.426+0000 7f95e5113640 1 -- 172.21.15.178:0/3117597243 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cfe1a9bc0 con 0x564cfe30f4e0 2024-09-21T09:03:39.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.426+0000 7f95e5113640 1 --2- 172.21.15.178:0/3117597243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe30f4e0 0x564cfe283da0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f95d8001660 tx=0x7f95d8001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7abe6fd6f2819 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.426+0000 7f94d3606640 1 -- 172.21.15.178:0/3117597243 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95d8003450 con 0x564cfe30f4e0 2024-09-21T09:03:39.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.426+0000 7f94d3606640 1 -- 172.21.15.178:0/3117597243 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d8003610 con 0x564cfe30f4e0 2024-09-21T09:03:39.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.426+0000 7f94d3606640 1 -- 172.21.15.178:0/3117597243 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95d80039b0 con 0x564cfe30f4e0 2024-09-21T09:03:39.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.427+0000 7f95e9526800 1 -- 172.21.15.178:0/3117597243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe30f4e0 msgr2=0x564cfe283da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.427+0000 7f95e9526800 1 --2- 172.21.15.178:0/3117597243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe30f4e0 0x564cfe283da0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f95d8001660 tx=0x7f95d8001b20 comp rx=0 tx=0).stop 2024-09-21T09:03:39.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.427+0000 7f95e9526800 1 -- 172.21.15.178:0/3117597243 shutdown_connections 2024-09-21T09:03:39.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.427+0000 7f95e9526800 1 --2- 172.21.15.178:0/3117597243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe30f4e0 0x564cfe283da0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.427+0000 7f95e9526800 1 -- 172.21.15.178:0/3117597243 >> 172.21.15.178:0/3117597243 conn(0x564cfe30add0 msgr2=0x564cfe3f9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.427+0000 7f95e9526800 1 -- 172.21.15.178:0/3117597243 shutdown_connections 2024-09-21T09:03:39.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.427+0000 7f95e9526800 1 -- 172.21.15.178:0/3117597243 wait complete. 2024-09-21T09:03:39.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.427+0000 7f95e9526800 1 Processor -- start 2024-09-21T09:03:39.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.427+0000 7f95e9526800 1 -- start start 2024-09-21T09:03:39.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.427+0000 7f95e9526800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe30f4e0 0x564cfe4070c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.427+0000 7f95e9526800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564cfe316550 con 0x564cfe30f4e0 2024-09-21T09:03:39.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.427+0000 7f95e5113640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe30f4e0 0x564cfe4070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.427+0000 7f95e5113640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe30f4e0 0x564cfe4070c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49554/0 (socket says 172.21.15.178:49554) 2024-09-21T09:03:39.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.427+0000 7f95e5113640 1 -- 172.21.15.178:0/4160282414 learned_addr learned my addr 172.21.15.178:0/4160282414 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.428+0000 7f95e5113640 1 -- 172.21.15.178:0/4160282414 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cfe1bdfe0 con 0x564cfe30f4e0 2024-09-21T09:03:39.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.428+0000 7f95e5113640 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe30f4e0 0x564cfe4070c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x564cfe2834a0 tx=0x7f95d8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.428+0000 7f94d1e03640 1 -- 172.21.15.178:0/4160282414 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95d8025070 con 0x564cfe30f4e0 2024-09-21T09:03:39.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.428+0000 7f94d1e03640 1 -- 172.21.15.178:0/4160282414 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d8019040 con 0x564cfe30f4e0 2024-09-21T09:03:39.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.428+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cfe407600 con 0x564cfe30f4e0 2024-09-21T09:03:39.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.428+0000 7f94d1e03640 1 -- 172.21.15.178:0/4160282414 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95d8013950 con 0x564cfe30f4e0 2024-09-21T09:03:39.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.428+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cfe407b80 con 0x564cfe30f4e0 2024-09-21T09:03:39.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.429+0000 7f94d1e03640 1 -- 172.21.15.178:0/4160282414 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f95d8010070 con 0x564cfe30f4e0 2024-09-21T09:03:39.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.429+0000 7f94d1e03640 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94cc036b90 0x7f94cc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.429+0000 7f94d1e03640 1 -- 172.21.15.178:0/4160282414 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f95d804bfe0 con 0x564cfe30f4e0 2024-09-21T09:03:39.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.429+0000 7f95dc912640 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94cc036b90 0x7f94cc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.429+0000 7f95e9526800 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564cfe313920 0x564cfe40e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.429+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe40e6b0 con 0x564cfe313920 2024-09-21T09:03:39.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.430+0000 7f95e5914640 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564cfe313920 0x564cfe40e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.430+0000 7f95dc912640 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94cc036b90 0x7f94cc039050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f95d0057000 tx=0x7f95d0052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.430+0000 7f95e5914640 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564cfe313920 0x564cfe40e130 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.430+0000 7f95e5914640 1 -- 172.21.15.178:0/4160282414 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe313920 2024-09-21T09:03:39.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.430+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe40b6e0 con 0x564cfe313920 2024-09-21T09:03:39.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.430+0000 7f95e5914640 1 -- 172.21.15.178:0/4160282414 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe313920 2024-09-21T09:03:39.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.430+0000 7f95e9526800 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564cfe4109e0 0x564cfe412dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.430+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe4134c0 con 0x564cfe4109e0 2024-09-21T09:03:39.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.431+0000 7f95e5113640 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564cfe4109e0 0x564cfe412dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.431+0000 7f95e5113640 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564cfe4109e0 0x564cfe412dd0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.431+0000 7f95e5113640 1 -- 172.21.15.178:0/4160282414 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f95d800f030 con 0x564cfe4109e0 2024-09-21T09:03:39.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.431+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe40f850 con 0x564cfe313920 2024-09-21T09:03:39.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.432+0000 7f95e5914640 1 -- 172.21.15.178:0/4160282414 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe313920 2024-09-21T09:03:39.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.432+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe40fcf0 con 0x564cfe313920 2024-09-21T09:03:39.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.432+0000 7f95e5914640 1 -- 172.21.15.178:0/4160282414 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe313920 2024-09-21T09:03:39.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.432+0000 7f95e9526800 1 Processor -- start 2024-09-21T09:03:39.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.432+0000 7f95e9526800 1 -- start start 2024-09-21T09:03:39.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.432+0000 7f95e9526800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe3ffde0 0x564cfe3fe430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.432+0000 7f95e9526800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564cfe1ab580 con 0x564cfe3ffde0 2024-09-21T09:03:39.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.433+0000 7f95e5914640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe3ffde0 0x564cfe3fe430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.433+0000 7f95e5914640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe3ffde0 0x564cfe3fe430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49566/0 (socket says 172.21.15.178:49566) 2024-09-21T09:03:39.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.433+0000 7f95e5914640 1 -- 172.21.15.178:0/1064456125 learned_addr learned my addr 172.21.15.178:0/1064456125 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.433+0000 7f95e5914640 1 -- 172.21.15.178:0/1064456125 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cfe400200 con 0x564cfe3ffde0 2024-09-21T09:03:39.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.433+0000 7f95e5914640 1 --2- 172.21.15.178:0/1064456125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe3ffde0 0x564cfe3fe430 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x564cfe4084c0 tx=0x7f95e000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.433+0000 7f94caffd640 1 -- 172.21.15.178:0/1064456125 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e0007d00 con 0x564cfe3ffde0 2024-09-21T09:03:39.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.433+0000 7f94caffd640 1 -- 172.21.15.178:0/1064456125 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e001e020 con 0x564cfe3ffde0 2024-09-21T09:03:39.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.433+0000 7f95e9526800 1 -- 172.21.15.178:0/1064456125 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cfe3fea30 con 0x564cfe3ffde0 2024-09-21T09:03:39.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.433+0000 7f94caffd640 1 -- 172.21.15.178:0/1064456125 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e0019420 con 0x564cfe3ffde0 2024-09-21T09:03:39.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.433+0000 7f95e9526800 1 -- 172.21.15.178:0/1064456125 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cfe3fef30 con 0x564cfe3ffde0 2024-09-21T09:03:39.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.434+0000 7f94caffd640 1 -- 172.21.15.178:0/1064456125 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f95e0016040 con 0x564cfe3ffde0 2024-09-21T09:03:39.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.434+0000 7f94caffd640 1 --2- 172.21.15.178:0/1064456125 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94bc036b90 0x7f94bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.434+0000 7f94caffd640 1 -- 172.21.15.178:0/1064456125 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f95e001f030 con 0x564cfe3ffde0 2024-09-21T09:03:39.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.434+0000 7f95e5113640 1 --2- 172.21.15.178:0/1064456125 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94bc036b90 0x7f94bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.435+0000 7f95e9526800 1 Processor -- start 2024-09-21T09:03:39.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.435+0000 7f95e9526800 1 -- start start 2024-09-21T09:03:39.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.435+0000 7f95e5113640 1 --2- 172.21.15.178:0/1064456125 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94bc036b90 0x7f94bc039050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95d804a500 tx=0x7f95d8040040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.435+0000 7f95e9526800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe430d30 0x564cfe431130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.435+0000 7f95e9526800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564cfe402580 con 0x564cfe430d30 2024-09-21T09:03:39.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.435+0000 7f95e5914640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe430d30 0x564cfe431130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.435+0000 7f95e5914640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe430d30 0x564cfe431130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49568/0 (socket says 172.21.15.178:49568) 2024-09-21T09:03:39.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.435+0000 7f95e5914640 1 -- 172.21.15.178:0/1534649912 learned_addr learned my addr 172.21.15.178:0/1534649912 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.435+0000 7f95e5914640 1 -- 172.21.15.178:0/1534649912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cfe431700 con 0x564cfe430d30 2024-09-21T09:03:39.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.435+0000 7f95e5914640 1 --2- 172.21.15.178:0/1534649912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe430d30 0x564cfe431130 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f95e004cb20 tx=0x7f95e0014650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e94d715e118cc28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.436+0000 7f94c8ff9640 1 -- 172.21.15.178:0/1534649912 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e001d040 con 0x564cfe430d30 2024-09-21T09:03:39.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.436+0000 7f94c8ff9640 1 -- 172.21.15.178:0/1534649912 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e004a030 con 0x564cfe430d30 2024-09-21T09:03:39.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.436+0000 7f94c8ff9640 1 -- 172.21.15.178:0/1534649912 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e004e410 con 0x564cfe430d30 2024-09-21T09:03:39.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.436+0000 7f95e9526800 1 -- 172.21.15.178:0/1534649912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe430d30 msgr2=0x564cfe431130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.436+0000 7f95e9526800 1 --2- 172.21.15.178:0/1534649912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe430d30 0x564cfe431130 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f95e004cb20 tx=0x7f95e0014650 comp rx=0 tx=0).stop 2024-09-21T09:03:39.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.436+0000 7f95e9526800 1 -- 172.21.15.178:0/1534649912 shutdown_connections 2024-09-21T09:03:39.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.436+0000 7f95e9526800 1 --2- 172.21.15.178:0/1534649912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe430d30 0x564cfe431130 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.436+0000 7f95e9526800 1 -- 172.21.15.178:0/1534649912 >> 172.21.15.178:0/1534649912 conn(0x564cfe42d090 msgr2=0x564cfe42b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.436+0000 7f95e9526800 1 -- 172.21.15.178:0/1534649912 shutdown_connections 2024-09-21T09:03:39.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.436+0000 7f95e9526800 1 -- 172.21.15.178:0/1534649912 wait complete. 2024-09-21T09:03:39.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.436+0000 7f95e9526800 1 Processor -- start 2024-09-21T09:03:39.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.436+0000 7f95e9526800 1 -- start start 2024-09-21T09:03:39.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.436+0000 7f95e9526800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe430d30 0x564cfe438230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.436+0000 7f95e9526800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564cfe431d70 con 0x564cfe430d30 2024-09-21T09:03:39.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.437+0000 7f95e5914640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe430d30 0x564cfe438230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.437+0000 7f95e5914640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe430d30 0x564cfe438230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49584/0 (socket says 172.21.15.178:49584) 2024-09-21T09:03:39.446 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.437+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 learned_addr learned my addr 172.21.15.178:0/2032643574 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.437+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cfe438770 con 0x564cfe430d30 2024-09-21T09:03:39.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.437+0000 7f95e5914640 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe430d30 0x564cfe438230 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f95e00157d0 tx=0x7f95e004ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.437+0000 7f94baffd640 1 -- 172.21.15.178:0/2032643574 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e001d070 con 0x564cfe430d30 2024-09-21T09:03:39.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.437+0000 7f94baffd640 1 -- 172.21.15.178:0/2032643574 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e0024ce0 con 0x564cfe430d30 2024-09-21T09:03:39.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.437+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cfe438a00 con 0x564cfe430d30 2024-09-21T09:03:39.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.437+0000 7f94baffd640 1 -- 172.21.15.178:0/2032643574 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e0014a80 con 0x564cfe430d30 2024-09-21T09:03:39.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.437+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cfe43b6b0 con 0x564cfe430d30 2024-09-21T09:03:39.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.438+0000 7f94baffd640 1 -- 172.21.15.178:0/2032643574 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f95e0014c20 con 0x564cfe430d30 2024-09-21T09:03:39.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.438+0000 7f94baffd640 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94b0036b90 0x7f94b0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.438+0000 7f94baffd640 1 -- 172.21.15.178:0/2032643574 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f95e0034030 con 0x564cfe430d30 2024-09-21T09:03:39.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.438+0000 7f95e5113640 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94b0036b90 0x7f94b0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.439+0000 7f95e5113640 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94b0036b90 0x7f94b0039050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95d8013fd0 tx=0x7f95d8042000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.439+0000 7f95e9526800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.439+0000 7f95e9526800 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564cfe443c60 0x564cfe446120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.439+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe446870 con 0x564cfe443c60 2024-09-21T09:03:39.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.439+0000 7f95dc912640 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564cfe443c60 0x564cfe446120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.439+0000 7f95dc912640 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564cfe443c60 0x564cfe446120 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 20 realm 2024-09-21T09:03:39.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe446ca0 con 0x564cfe443c60 2024-09-21T09:03:39.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:39.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe447570 con 0x564cfe443c60 2024-09-21T09:03:39.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe447910 con 0x564cfe443c60 2024-09-21T09:03:39.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:39.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564cfe448670 0x564cfe44aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.440+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44b070 con 0x564cfe448670 2024-09-21T09:03:39.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.441+0000 7f95e5914640 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564cfe448670 0x564cfe44aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.441+0000 7f95e5914640 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564cfe448670 0x564cfe44aa60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.449 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.441+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.441+0000 7f95e9526800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:39.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.441+0000 7f95e9526800 20 searching for the correct realm 2024-09-21T09:03:39.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.441+0000 7f95e9526800 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564cfe44d000 0x564cfe44f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.441+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe44d000 2024-09-21T09:03:39.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.441+0000 7f95e5113640 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564cfe44d000 0x564cfe44f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.442+0000 7f95e5113640 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564cfe44d000 0x564cfe44f4c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.442+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.442+0000 7f95e5113640 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f95d80123c0 0x7f95d801d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.442+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x7f95d80123c0 2024-09-21T09:03:39.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.442+0000 7f95dc912640 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f95d80123c0 0x7f95d801d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.442+0000 7f95dc912640 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f95d80123c0 0x7f95d801d380 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.443+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.443+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe448670 2024-09-21T09:03:39.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.443+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.443+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe443c60 2024-09-21T09:03:39.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.443+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.443+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe443c60 2024-09-21T09:03:39.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.444+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.444+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe448670 2024-09-21T09:03:39.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.444+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.444+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe448670 2024-09-21T09:03:39.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.445+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.445+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x7f95d80123c0 2024-09-21T09:03:39.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.445+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.445+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe44d000 2024-09-21T09:03:39.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.445+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.445+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe443c60 2024-09-21T09:03:39.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.445+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.445+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe448670 2024-09-21T09:03:39.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.446+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.446+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe443c60 2024-09-21T09:03:39.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.446+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.446+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x7f95d80123c0 2024-09-21T09:03:39.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.446+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.446+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe44d000 2024-09-21T09:03:39.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.446+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.446+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe44d000 2024-09-21T09:03:39.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.446+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.446+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe448670 2024-09-21T09:03:39.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.447+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.447+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe44d000 2024-09-21T09:03:39.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.447+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.447+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe44d000 2024-09-21T09:03:39.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.447+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.447+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe443c60 2024-09-21T09:03:39.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.447+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.447+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe443c60 2024-09-21T09:03:39.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.448+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.448+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe448670 2024-09-21T09:03:39.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.448+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.448+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe44d000 2024-09-21T09:03:39.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.448+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.448+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x7f95d80123c0 2024-09-21T09:03:39.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.448+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.448+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe443c60 2024-09-21T09:03:39.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.449+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.449+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe448670 2024-09-21T09:03:39.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.449+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.449+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe44d000 2024-09-21T09:03:39.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.449+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.449+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x7f95d80123c0 2024-09-21T09:03:39.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.449+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.450+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x7f95d80123c0 2024-09-21T09:03:39.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.450+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.450+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe44d000 2024-09-21T09:03:39.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.450+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.450+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe448670 2024-09-21T09:03:39.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x564cfe443c60 2024-09-21T09:03:39.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44fb90 con 0x7f95d80123c0 2024-09-21T09:03:39.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95e9526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:39.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95e9526800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:39.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95e9526800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:39.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95e9526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:39.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95e9526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:39.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95e9526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:39.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95e9526800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44b8c0 con 0x564cfe443c60 2024-09-21T09:03:39.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95e9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95e9526800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.451+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44bcb0 con 0x564cfe443c60 2024-09-21T09:03:39.464 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe450010 con 0x564cfe443c60 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 20 zone default found 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 4 Realm: () 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 20 zonegroup default 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe44b510 con 0x564cfe448670 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe4523f0 con 0x564cfe44d000 2024-09-21T09:03:39.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.452+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe452790 con 0x564cfe44d000 2024-09-21T09:03:39.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.453+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.453+0000 7f95e9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.453+0000 7f95e9526800 20 started sync module instance, tier type = 2024-09-21T09:03:39.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.453+0000 7f95e9526800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:39.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.453+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe451880 con 0x7f95d80123c0 2024-09-21T09:03:39.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.454+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.454+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94888683445664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe451880 con 0x7f95d80123c0 2024-09-21T09:03:39.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.454+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe453190 con 0x564cfe443c60 2024-09-21T09:03:39.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.455+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94888683445664] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.455+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.455+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94888683449504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe451880 con 0x564cfe443c60 2024-09-21T09:03:39.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.455+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe453be0 con 0x564cfe44d000 2024-09-21T09:03:39.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.456+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94888683449504] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.456+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.456+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94888683443152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe4517f0 con 0x564cfe44d000 2024-09-21T09:03:39.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.456+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe454aa0 con 0x7f95d80123c0 2024-09-21T09:03:39.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.457+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.457+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94888683456464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe455240 con 0x7f95d80123c0 2024-09-21T09:03:39.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.457+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe455d60 con 0x564cfe443c60 2024-09-21T09:03:39.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.457+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94888683443152] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.458+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.458+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94888683460656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe455d20 con 0x564cfe443c60 2024-09-21T09:03:39.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.458+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe456770 con 0x564cfe448670 2024-09-21T09:03:39.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.458+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94888683456464] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.459+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94888683460656] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.459+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.459+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94888683454416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe454c90 con 0x564cfe448670 2024-09-21T09:03:39.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.459+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe457010 con 0x564cfe448670 2024-09-21T09:03:39.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.460+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(56 notify.6 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.460+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94888683465568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe457470 con 0x564cfe448670 2024-09-21T09:03:39.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.460+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe457f60 con 0x564cfe448670 2024-09-21T09:03:39.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.460+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94888683454416] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.461+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(58 notify.7 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.461+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94888683465568] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.461+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94888683469360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe4562c0 con 0x564cfe448670 2024-09-21T09:03:39.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.461+0000 7f95e9526800 20 add_watcher() i=0 2024-09-21T09:03:39.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.461+0000 7f95e9526800 20 add_watcher() i=1 2024-09-21T09:03:39.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.461+0000 7f95e9526800 20 add_watcher() i=2 2024-09-21T09:03:39.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.461+0000 7f95e9526800 20 add_watcher() i=3 2024-09-21T09:03:39.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.461+0000 7f95e9526800 20 add_watcher() i=4 2024-09-21T09:03:39.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.461+0000 7f95e9526800 20 add_watcher() i=5 2024-09-21T09:03:39.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.461+0000 7f95e9526800 20 add_watcher() i=6 2024-09-21T09:03:39.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.463+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94888683469360] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.463+0000 7f95e9526800 20 add_watcher() i=7 2024-09-21T09:03:39.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.463+0000 7f95e9526800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:39.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.463+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe45af50 con 0x564cfe443c60 2024-09-21T09:03:39.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.463+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.463+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94888683466624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe4583d0 con 0x564cfe443c60 2024-09-21T09:03:39.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.464+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94888683466624] v31'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.464+0000 7f949b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:39.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.464+0000 7f95e9526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:39.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.464+0000 7f95e9526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:39.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f95e9526800 5 note: GC not initialized 2024-09-21T09:03:39.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f949a7e4640 20 reqs_thread_entry: start 2024-09-21T09:03:39.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f95e9526800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:39.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f95e9526800 20 Filter name: none 2024-09-21T09:03:39.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f940bfff640 20 reqs_thread_entry: start 2024-09-21T09:03:39.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f95e9526800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T09:03:39.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f95e9526800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe48e6b0 con 0x7f95d80123c0 2024-09-21T09:03:39.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f95e9526800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:39.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f95e9526800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T09:03:39.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f95e9526800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:39.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f95e9526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 : miss 2024-09-21T09:03:39.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f95e9526800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.465+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 8.1f 8:fafbe283:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe490270 con 0x7f95d80123c0 2024-09-21T09:03:39.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.466+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(63 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.466+0000 7f95e9526800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:39.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.466+0000 7f95e9526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 info.flags=0x17 2024-09-21T09:03:39.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.466+0000 7f95e9526800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 to cache LRU end 2024-09-21T09:03:39.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.466+0000 7f95e9526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:39.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.466+0000 7f95e9526800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:39.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.466+0000 7f95e9526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 2024-09-21T09:03:39.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.466+0000 7f95e9526800 20 get_obj_state: octx=0x7f95d0051c00 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x564cfe492938 s->prefetch_data=0 2024-09-21T09:03:39.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.466+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 3.a 3:5395bc93:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cfe493a60 con 0x564cfe44d000 2024-09-21T09:03:39.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.466+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.466+0000 7f95e9526800 10 manifest: total_size = 5 2024-09-21T09:03:39.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.466+0000 7f95e9526800 20 get_obj_state: setting s->obj_tag to _Y_2VrF2rV8HN5FD1g8PGe_UEe2--nCz 2024-09-21T09:03:39.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.467+0000 7f949b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:39.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.467+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94888683466624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe48bfa0 con 0x564cfe443c60 2024-09-21T09:03:39.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.468+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94888683466624] v31'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.468+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94888683445664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe48bfa0 con 0x7f95d80123c0 2024-09-21T09:03:39.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.469+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94888683445664] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.469+0000 7f95e9526800 20 remove_watcher() i=0 2024-09-21T09:03:39.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.469+0000 7f95e9526800 2 removed watcher, disabling cache 2024-09-21T09:03:39.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.469+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94888683449504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe451da0 con 0x564cfe443c60 2024-09-21T09:03:39.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.470+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94888683449504] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.470+0000 7f95e9526800 20 remove_watcher() i=1 2024-09-21T09:03:39.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.470+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94888683443152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe48bfa0 con 0x564cfe44d000 2024-09-21T09:03:39.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.471+0000 7f95e5113640 1 -- 172.21.15.178:0/2032643574 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94888683443152] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803d070 con 0x564cfe44d000 2024-09-21T09:03:39.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.471+0000 7f95e9526800 20 remove_watcher() i=2 2024-09-21T09:03:39.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.471+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94888683456464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe452ca0 con 0x7f95d80123c0 2024-09-21T09:03:39.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.472+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94888683456464] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x7f95d80123c0 2024-09-21T09:03:39.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.472+0000 7f95e9526800 20 remove_watcher() i=3 2024-09-21T09:03:39.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.472+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94888683460656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe451da0 con 0x564cfe443c60 2024-09-21T09:03:39.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.473+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94888683460656] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d0057030 con 0x564cfe443c60 2024-09-21T09:03:39.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.473+0000 7f95e9526800 20 remove_watcher() i=4 2024-09-21T09:03:39.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.473+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94888683454416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe4513d0 con 0x564cfe448670 2024-09-21T09:03:39.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.474+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94888683454416] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.474+0000 7f95e9526800 20 remove_watcher() i=5 2024-09-21T09:03:39.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.474+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94888683465568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe48bfa0 con 0x564cfe448670 2024-09-21T09:03:39.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.476+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94888683465568] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.476+0000 7f95e9526800 20 remove_watcher() i=6 2024-09-21T09:03:39.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.476+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94888683469360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cfe4547d0 con 0x564cfe448670 2024-09-21T09:03:39.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e5914640 1 -- 172.21.15.178:0/2032643574 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94888683469360] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e00083e0 con 0x564cfe448670 2024-09-21T09:03:39.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 20 remove_watcher() i=7 2024-09-21T09:03:39.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564cfe448670 msgr2=0x564cfe44aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564cfe448670 0x564cfe44aa60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564cfe443c60 msgr2=0x564cfe446120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564cfe443c60 0x564cfe446120 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f95d80123c0 msgr2=0x7f95d801d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f95d80123c0 0x7f95d801d380 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564cfe44d000 msgr2=0x564cfe44f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564cfe44d000 0x564cfe44f4c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94b0036b90 msgr2=0x7f94b0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94b0036b90 0x7f94b0039050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95d8013fd0 tx=0x7f95d8042000 comp rx=0 tx=0).stop 2024-09-21T09:03:39.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe430d30 msgr2=0x564cfe438230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95dc912640 1 -- 172.21.15.178:0/2032643574 reap_dead start 2024-09-21T09:03:39.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe430d30 0x564cfe438230 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f95e00157d0 tx=0x7f95e004ca80 comp rx=0 tx=0).stop 2024-09-21T09:03:39.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 shutdown_connections 2024-09-21T09:03:39.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 --2- 172.21.15.178:0/2032643574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe430d30 0x564cfe438230 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 >> 172.21.15.178:0/2032643574 conn(0x564cfe42d090 msgr2=0x564cfe42b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 shutdown_connections 2024-09-21T09:03:39.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 -- 172.21.15.178:0/2032643574 wait complete. 2024-09-21T09:03:39.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 -- 172.21.15.178:0/1064456125 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94bc036b90 msgr2=0x7f94bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 --2- 172.21.15.178:0/1064456125 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94bc036b90 0x7f94bc039050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95d804a500 tx=0x7f95d8040040 comp rx=0 tx=0).stop 2024-09-21T09:03:39.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 -- 172.21.15.178:0/1064456125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe3ffde0 msgr2=0x564cfe3fe430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 --2- 172.21.15.178:0/1064456125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe3ffde0 0x564cfe3fe430 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x564cfe4084c0 tx=0x7f95e000aec0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 -- 172.21.15.178:0/1064456125 shutdown_connections 2024-09-21T09:03:39.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 --2- 172.21.15.178:0/1064456125 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94bc036b90 0x7f94bc039050 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 --2- 172.21.15.178:0/1064456125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe3ffde0 0x564cfe3fe430 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.477+0000 7f95e9526800 1 -- 172.21.15.178:0/1064456125 >> 172.21.15.178:0/1064456125 conn(0x564cfe416de0 msgr2=0x564cfe419960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 -- 172.21.15.178:0/1064456125 shutdown_connections 2024-09-21T09:03:39.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 -- 172.21.15.178:0/1064456125 wait complete. 2024-09-21T09:03:39.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564cfe4109e0 msgr2=0x564cfe412dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564cfe4109e0 0x564cfe412dd0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564cfe313920 msgr2=0x564cfe40e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564cfe313920 0x564cfe40e130 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94cc036b90 msgr2=0x7f94cc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94cc036b90 0x7f94cc039050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f95d0057000 tx=0x7f95d0052000 comp rx=0 tx=0).stop 2024-09-21T09:03:39.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe30f4e0 msgr2=0x564cfe4070c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe30f4e0 0x564cfe4070c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x564cfe2834a0 tx=0x7f95d8001250 comp rx=0 tx=0).stop 2024-09-21T09:03:39.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 shutdown_connections 2024-09-21T09:03:39.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564cfe4109e0 0x564cfe412dd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564cfe313920 0x564cfe40e130 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f94cc036b90 0x7f94cc039050 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 --2- 172.21.15.178:0/4160282414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564cfe30f4e0 0x564cfe4070c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 >> 172.21.15.178:0/4160282414 conn(0x564cfe30add0 msgr2=0x564cfe3f88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 shutdown_connections 2024-09-21T09:03:39.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.478+0000 7f95e9526800 1 -- 172.21.15.178:0/4160282414 wait complete. 2024-09-21T09:03:39.488 INFO:teuthology.orchestra.run.smithi178.stdout:fooFoofooFooFULL_CONTROL 2024-09-21T09:03:39.488 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-21T09:03:39.490 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-21T09:03:39.494 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:39.495 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-21T09:03:39.495 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-21T09:03:39.495 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-21T09:03:39.540 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:39.540 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:39.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.539+0000 7faae5f08800 1 Processor -- start 2024-09-21T09:03:39.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.539+0000 7faae5f08800 1 -- start start 2024-09-21T09:03:39.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.539+0000 7faae5f08800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5637f75c84c0 0x5637f765c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.539+0000 7faae5f08800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5637f7512b30 con 0x5637f75c95d0 2024-09-21T09:03:39.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.539+0000 7faae5f08800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5637f74f4360 con 0x5637f75c84c0 2024-09-21T09:03:39.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.540+0000 7faadbfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5637f75c84c0 0x5637f765c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.540+0000 7faae39fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5637f75c95d0 0x5637f75c7db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:45148/0 (socket says 172.21.15.178:45148) 2024-09-21T09:03:39.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.540+0000 7faae39fc640 1 -- 172.21.15.178:0/2992690919 learned_addr learned my addr 172.21.15.178:0/2992690919 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:39.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.540+0000 7faadbfff640 1 -- 172.21.15.178:0/2992690919 >> v1:172.21.15.44:6789/0 conn(0x5637f75c95d0 legacy=0x5637f75c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.540+0000 7faadbfff640 1 -- 172.21.15.178:0/2992690919 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f751ae00 con 0x5637f75c84c0 2024-09-21T09:03:39.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.542+0000 7faadbfff640 1 --2- 172.21.15.178:0/2992690919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f765c690 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7faacc00a470 tx=0x7faacc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3704796d354f8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.542+0000 7faae31fb640 1 -- 172.21.15.178:0/2992690919 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faacc053570 con 0x5637f75c84c0 2024-09-21T09:03:39.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.542+0000 7faae31fb640 1 -- 172.21.15.178:0/2992690919 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faacc058070 con 0x5637f75c84c0 2024-09-21T09:03:39.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.542+0000 7faae31fb640 1 -- 172.21.15.178:0/2992690919 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faacc053880 con 0x5637f75c84c0 2024-09-21T09:03:39.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.542+0000 7faae5f08800 1 -- 172.21.15.178:0/2992690919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 msgr2=0x5637f765c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.542+0000 7faae5f08800 1 --2- 172.21.15.178:0/2992690919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f765c690 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7faacc00a470 tx=0x7faacc045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:39.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.542+0000 7faae5f08800 1 -- 172.21.15.178:0/2992690919 shutdown_connections 2024-09-21T09:03:39.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.542+0000 7faae5f08800 1 --2- 172.21.15.178:0/2992690919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f765c690 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.542+0000 7faae5f08800 1 -- 172.21.15.178:0/2992690919 >> 172.21.15.178:0/2992690919 conn(0x5637f764efe0 msgr2=0x5637f7651400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.542+0000 7faae5f08800 1 -- 172.21.15.178:0/2992690919 shutdown_connections 2024-09-21T09:03:39.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.543+0000 7faae5f08800 1 -- 172.21.15.178:0/2992690919 wait complete. 2024-09-21T09:03:39.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.556+0000 7faae5f08800 1 Processor -- start 2024-09-21T09:03:39.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.556+0000 7faae5f08800 1 -- start start 2024-09-21T09:03:39.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.556+0000 7faae5f08800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f7744ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.558 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.556+0000 7faae5f08800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5637f759f360 con 0x5637f75c84c0 2024-09-21T09:03:39.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.557+0000 7faae39fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f7744ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.557+0000 7faae39fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f7744ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49614/0 (socket says 172.21.15.178:49614) 2024-09-21T09:03:39.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.557+0000 7faae39fc640 1 -- 172.21.15.178:0/2273592049 learned_addr learned my addr 172.21.15.178:0/2273592049 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.557+0000 7faae39fc640 1 -- 172.21.15.178:0/2273592049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f74ecbc0 con 0x5637f75c84c0 2024-09-21T09:03:39.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.557+0000 7faae39fc640 1 --2- 172.21.15.178:0/2273592049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f7744ae0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7faad4001e10 tx=0x7faad400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2562997f430d055b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.557+0000 7fa9d1e0b640 1 -- 172.21.15.178:0/2273592049 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad4012020 con 0x5637f75c84c0 2024-09-21T09:03:39.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.557+0000 7fa9d1e0b640 1 -- 172.21.15.178:0/2273592049 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad400e5a0 con 0x5637f75c84c0 2024-09-21T09:03:39.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.557+0000 7fa9d1e0b640 1 -- 172.21.15.178:0/2273592049 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad400e8e0 con 0x5637f75c84c0 2024-09-21T09:03:39.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.558+0000 7faae5f08800 1 -- 172.21.15.178:0/2273592049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 msgr2=0x5637f7744ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.558+0000 7faae5f08800 1 --2- 172.21.15.178:0/2273592049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f7744ae0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7faad4001e10 tx=0x7faad400b780 comp rx=0 tx=0).stop 2024-09-21T09:03:39.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.558+0000 7faae5f08800 1 -- 172.21.15.178:0/2273592049 shutdown_connections 2024-09-21T09:03:39.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.558+0000 7faae5f08800 1 --2- 172.21.15.178:0/2273592049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f7744ae0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.558+0000 7faae5f08800 1 -- 172.21.15.178:0/2273592049 >> 172.21.15.178:0/2273592049 conn(0x5637f764efe0 msgr2=0x5637f77404a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.558+0000 7faae5f08800 1 -- 172.21.15.178:0/2273592049 shutdown_connections 2024-09-21T09:03:39.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.558+0000 7faae5f08800 1 -- 172.21.15.178:0/2273592049 wait complete. 2024-09-21T09:03:39.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.559+0000 7faae5f08800 1 Processor -- start 2024-09-21T09:03:39.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.559+0000 7faae5f08800 1 -- start start 2024-09-21T09:03:39.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.559+0000 7faae5f08800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f774c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.559+0000 7faae5f08800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5637f75c8bb0 con 0x5637f75c84c0 2024-09-21T09:03:39.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.559+0000 7faae39fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f774c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.559+0000 7faae39fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f774c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49620/0 (socket says 172.21.15.178:49620) 2024-09-21T09:03:39.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.559+0000 7faae39fc640 1 -- 172.21.15.178:0/3607489481 learned_addr learned my addr 172.21.15.178:0/3607489481 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.559+0000 7faae39fc640 1 -- 172.21.15.178:0/3607489481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f7500fe0 con 0x5637f75c84c0 2024-09-21T09:03:39.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.559+0000 7faae39fc640 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f774c4c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7faad400b7c0 tx=0x7faad4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.560+0000 7fa9cbfff640 1 -- 172.21.15.178:0/3607489481 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad4012030 con 0x5637f75c84c0 2024-09-21T09:03:39.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.560+0000 7fa9cbfff640 1 -- 172.21.15.178:0/3607489481 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad4001470 con 0x5637f75c84c0 2024-09-21T09:03:39.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.560+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637f774ca00 con 0x5637f75c84c0 2024-09-21T09:03:39.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.560+0000 7fa9cbfff640 1 -- 172.21.15.178:0/3607489481 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad401a8d0 con 0x5637f75c84c0 2024-09-21T09:03:39.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.560+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637f774cf20 con 0x5637f75c84c0 2024-09-21T09:03:39.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.560+0000 7fa9cbfff640 1 -- 172.21.15.178:0/3607489481 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faad4015020 con 0x5637f75c84c0 2024-09-21T09:03:39.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.561+0000 7fa9cbfff640 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9cc036b90 0x7fa9cc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.561+0000 7fa9cbfff640 1 -- 172.21.15.178:0/3607489481 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7faad4020030 con 0x5637f75c84c0 2024-09-21T09:03:39.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.561+0000 7faadbfff640 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9cc036b90 0x7fa9cc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.561+0000 7faae5f08800 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5637f75c95d0 0x5637f7753530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.561+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f7753a70 con 0x5637f75c95d0 2024-09-21T09:03:39.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.561+0000 7faae41fd640 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5637f75c95d0 0x5637f7753530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.561+0000 7faadbfff640 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9cc036b90 0x7fa9cc039050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faacc057000 tx=0x7faacc052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.561+0000 7faae41fd640 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5637f75c95d0 0x5637f7753530 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.562+0000 7faae41fd640 1 -- 172.21.15.178:0/3607489481 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faadc00a4a0 con 0x5637f75c95d0 2024-09-21T09:03:39.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.562+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f7750b00 con 0x5637f75c95d0 2024-09-21T09:03:39.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.562+0000 7faae41fd640 1 -- 172.21.15.178:0/3607489481 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faadc00a4a0 con 0x5637f75c95d0 2024-09-21T09:03:39.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.562+0000 7faae5f08800 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5637f7755dc0 0x5637f77581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.562+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f7758850 con 0x5637f7755dc0 2024-09-21T09:03:39.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.562+0000 7faae39fc640 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5637f7755dc0 0x5637f77581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.563+0000 7faae39fc640 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5637f7755dc0 0x5637f77581b0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.563+0000 7faae39fc640 1 -- 172.21.15.178:0/3607489481 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faad4018950 con 0x5637f7755dc0 2024-09-21T09:03:39.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.563+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f7754c60 con 0x5637f75c95d0 2024-09-21T09:03:39.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.563+0000 7faae41fd640 1 -- 172.21.15.178:0/3607489481 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faadc00a4a0 con 0x5637f75c95d0 2024-09-21T09:03:39.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.563+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f7755140 con 0x5637f75c95d0 2024-09-21T09:03:39.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.563+0000 7faae41fd640 1 -- 172.21.15.178:0/3607489481 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faadc00a4a0 con 0x5637f75c95d0 2024-09-21T09:03:39.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.564+0000 7faae5f08800 1 Processor -- start 2024-09-21T09:03:39.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.564+0000 7faae5f08800 1 -- start start 2024-09-21T09:03:39.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.564+0000 7faae5f08800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7767250 0x5637f7767670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.564+0000 7faae5f08800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5637f74ee580 con 0x5637f7767250 2024-09-21T09:03:39.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.564+0000 7faae41fd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7767250 0x5637f7767670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.564+0000 7faae41fd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7767250 0x5637f7767670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49630/0 (socket says 172.21.15.178:49630) 2024-09-21T09:03:39.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.564+0000 7faae41fd640 1 -- 172.21.15.178:0/2550197853 learned_addr learned my addr 172.21.15.178:0/2550197853 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.565+0000 7faae41fd640 1 -- 172.21.15.178:0/2550197853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f7767bb0 con 0x5637f7767250 2024-09-21T09:03:39.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.565+0000 7faae41fd640 1 --2- 172.21.15.178:0/2550197853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7767250 0x5637f7767670 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x5637f774d570 tx=0x7faadc0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.565+0000 7fa9c97fa640 1 -- 172.21.15.178:0/2550197853 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faadc014450 con 0x5637f7767250 2024-09-21T09:03:39.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.565+0000 7fa9c97fa640 1 -- 172.21.15.178:0/2550197853 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faadc0145f0 con 0x5637f7767250 2024-09-21T09:03:39.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.565+0000 7faae5f08800 1 -- 172.21.15.178:0/2550197853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637f7767e40 con 0x5637f7767250 2024-09-21T09:03:39.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.565+0000 7fa9c97fa640 1 -- 172.21.15.178:0/2550197853 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faadc0148d0 con 0x5637f7767250 2024-09-21T09:03:39.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.565+0000 7faae5f08800 1 -- 172.21.15.178:0/2550197853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637f776ab20 con 0x5637f7767250 2024-09-21T09:03:39.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.566+0000 7fa9c97fa640 1 -- 172.21.15.178:0/2550197853 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faadc011040 con 0x5637f7767250 2024-09-21T09:03:39.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.566+0000 7fa9c97fa640 1 --2- 172.21.15.178:0/2550197853 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9bc036b90 0x7fa9bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.566+0000 7fa9c97fa640 1 -- 172.21.15.178:0/2550197853 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7faadc01e070 con 0x5637f7767250 2024-09-21T09:03:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.566+0000 7faae39fc640 1 --2- 172.21.15.178:0/2550197853 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9bc036b90 0x7fa9bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.566+0000 7faae5f08800 1 Processor -- start 2024-09-21T09:03:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.566+0000 7faae5f08800 1 -- start start 2024-09-21T09:03:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.566+0000 7faae39fc640 1 --2- 172.21.15.178:0/2550197853 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9bc036b90 0x7fa9bc039050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x5637f7753ee0 tx=0x7faad4024ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.567+0000 7faae5f08800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7773e80 0x5637f7774280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.567+0000 7faae5f08800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5637f7745290 con 0x5637f7773e80 2024-09-21T09:03:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.567+0000 7faae41fd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7773e80 0x5637f7774280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.567+0000 7faae41fd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7773e80 0x5637f7774280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49638/0 (socket says 172.21.15.178:49638) 2024-09-21T09:03:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.567+0000 7faae41fd640 1 -- 172.21.15.178:0/2061735049 learned_addr learned my addr 172.21.15.178:0/2061735049 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.567+0000 7faae41fd640 1 -- 172.21.15.178:0/2061735049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f7774850 con 0x5637f7773e80 2024-09-21T09:03:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.567+0000 7faae41fd640 1 --2- 172.21.15.178:0/2061735049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7773e80 0x5637f7774280 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7faadc04cb30 tx=0x7faadc011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d0f69a929c1501 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.567+0000 7fa9c2ffd640 1 -- 172.21.15.178:0/2061735049 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faadc014e40 con 0x5637f7773e80 2024-09-21T09:03:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.567+0000 7fa9c2ffd640 1 -- 172.21.15.178:0/2061735049 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faadc02ba60 con 0x5637f7773e80 2024-09-21T09:03:39.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.567+0000 7fa9c2ffd640 1 -- 172.21.15.178:0/2061735049 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faadc02bd40 con 0x5637f7773e80 2024-09-21T09:03:39.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.568+0000 7faae5f08800 1 -- 172.21.15.178:0/2061735049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7773e80 msgr2=0x5637f7774280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.568+0000 7faae5f08800 1 --2- 172.21.15.178:0/2061735049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7773e80 0x5637f7774280 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7faadc04cb30 tx=0x7faadc011700 comp rx=0 tx=0).stop 2024-09-21T09:03:39.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.568+0000 7faae5f08800 1 -- 172.21.15.178:0/2061735049 shutdown_connections 2024-09-21T09:03:39.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.568+0000 7faae5f08800 1 --2- 172.21.15.178:0/2061735049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7773e80 0x5637f7774280 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.568+0000 7faae5f08800 1 -- 172.21.15.178:0/2061735049 >> 172.21.15.178:0/2061735049 conn(0x5637f77701e0 msgr2=0x5637f776e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.568+0000 7faae5f08800 1 -- 172.21.15.178:0/2061735049 shutdown_connections 2024-09-21T09:03:39.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.568+0000 7faae5f08800 1 -- 172.21.15.178:0/2061735049 wait complete. 2024-09-21T09:03:39.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.568+0000 7faae5f08800 1 Processor -- start 2024-09-21T09:03:39.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.568+0000 7faae5f08800 1 -- start start 2024-09-21T09:03:39.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.568+0000 7faae5f08800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7773e80 0x5637f777b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.568+0000 7faae5f08800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5637f7774ec0 con 0x5637f7773e80 2024-09-21T09:03:39.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.569+0000 7faae41fd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7773e80 0x5637f777b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.569+0000 7faae41fd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7773e80 0x5637f777b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49642/0 (socket says 172.21.15.178:49642) 2024-09-21T09:03:39.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.569+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 learned_addr learned my addr 172.21.15.178:0/3862906708 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.569+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f777b870 con 0x5637f7773e80 2024-09-21T09:03:39.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.569+0000 7faae41fd640 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7773e80 0x5637f777b330 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7faadc04ba20 tx=0x7faadc00a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.569+0000 7fa9c17fa640 1 -- 172.21.15.178:0/3862906708 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faadc04e280 con 0x5637f7773e80 2024-09-21T09:03:39.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.569+0000 7fa9c17fa640 1 -- 172.21.15.178:0/3862906708 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faadc04e440 con 0x5637f7773e80 2024-09-21T09:03:39.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.569+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637f777bb00 con 0x5637f7773e80 2024-09-21T09:03:39.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.569+0000 7fa9c17fa640 1 -- 172.21.15.178:0/3862906708 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faadc02b4c0 con 0x5637f7773e80 2024-09-21T09:03:39.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.569+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637f777e7b0 con 0x5637f7773e80 2024-09-21T09:03:39.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.570+0000 7fa9c17fa640 1 -- 172.21.15.178:0/3862906708 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faadc02b660 con 0x5637f7773e80 2024-09-21T09:03:39.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.570+0000 7fa9c17fa640 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9ac036b90 0x7fa9ac039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.570+0000 7fa9c17fa640 1 -- 172.21.15.178:0/3862906708 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7faadc00e040 con 0x5637f7773e80 2024-09-21T09:03:39.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.570+0000 7faae39fc640 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9ac036b90 0x7fa9ac039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.571+0000 7faae39fc640 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9ac036b90 0x7fa9ac039050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faad400bcd0 tx=0x7faad4038000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.571+0000 7faae5f08800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.571+0000 7faae5f08800 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5637f7786db0 0x5637f7789270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.571+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f77899c0 con 0x5637f7786db0 2024-09-21T09:03:39.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.571+0000 7faadbfff640 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5637f7786db0 0x5637f7789270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.571+0000 7faadbfff640 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5637f7786db0 0x5637f7789270 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 20 realm 2024-09-21T09:03:39.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f7789df0 con 0x5637f7786db0 2024-09-21T09:03:39.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:39.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f778a6c0 con 0x5637f7786db0 2024-09-21T09:03:39.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f778aa60 con 0x5637f7786db0 2024-09-21T09:03:39.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:39.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5637f778b7c0 0x5637f778dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.572+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f778e1c0 con 0x5637f778b7c0 2024-09-21T09:03:39.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.573+0000 7faae41fd640 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5637f778b7c0 0x5637f778dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.573+0000 7faae41fd640 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5637f778b7c0 0x5637f778dbb0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.573+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.573+0000 7faae5f08800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:39.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.573+0000 7faae5f08800 20 searching for the correct realm 2024-09-21T09:03:39.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.573+0000 7faae5f08800 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5637f7790150 0x5637f7792610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.573+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7790150 2024-09-21T09:03:39.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.573+0000 7faae39fc640 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5637f7790150 0x5637f7792610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.574+0000 7faae39fc640 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5637f7790150 0x5637f7792610 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.574+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.574+0000 7faae39fc640 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7faad4059040 0x7faad4024420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.574+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x7faad4059040 2024-09-21T09:03:39.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.574+0000 7faadbfff640 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7faad4059040 0x7faad4024420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.574+0000 7faadbfff640 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7faad4059040 0x7faad4024420 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.574+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.574+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f778b7c0 2024-09-21T09:03:39.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.575+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.575+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7786db0 2024-09-21T09:03:39.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.575+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.575+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7786db0 2024-09-21T09:03:39.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.575+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.575+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f778b7c0 2024-09-21T09:03:39.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.575+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.575+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f778b7c0 2024-09-21T09:03:39.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.576+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.576+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x7faad4059040 2024-09-21T09:03:39.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.576+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.576+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7790150 2024-09-21T09:03:39.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.576+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.576+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7786db0 2024-09-21T09:03:39.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.576+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.576+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f778b7c0 2024-09-21T09:03:39.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.577+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.577+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7786db0 2024-09-21T09:03:39.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.577+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.577+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x7faad4059040 2024-09-21T09:03:39.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.577+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.577+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7790150 2024-09-21T09:03:39.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.577+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.577+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7790150 2024-09-21T09:03:39.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.578+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.578+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f778b7c0 2024-09-21T09:03:39.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.578+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.578+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7790150 2024-09-21T09:03:39.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.578+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.578+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7790150 2024-09-21T09:03:39.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.578+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.578+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7786db0 2024-09-21T09:03:39.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.578+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.578+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7786db0 2024-09-21T09:03:39.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.579+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.579+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f778b7c0 2024-09-21T09:03:39.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.579+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.579+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7790150 2024-09-21T09:03:39.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.579+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.579+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x7faad4059040 2024-09-21T09:03:39.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.579+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.579+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7786db0 2024-09-21T09:03:39.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.580+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.580+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f778b7c0 2024-09-21T09:03:39.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.580+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.580+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7790150 2024-09-21T09:03:39.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.580+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.580+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x7faad4059040 2024-09-21T09:03:39.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.580+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.580+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x7faad4059040 2024-09-21T09:03:39.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.581+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.581+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7790150 2024-09-21T09:03:39.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.581+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.581+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f778b7c0 2024-09-21T09:03:39.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.581+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.581+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x5637f7786db0 2024-09-21T09:03:39.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.581+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.581+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5637f7792ce0 con 0x7faad4059040 2024-09-21T09:03:39.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:39.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:39.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:39.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:39.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:39.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:39.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f778ea10 con 0x5637f7786db0 2024-09-21T09:03:39.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f778ee00 con 0x5637f7786db0 2024-09-21T09:03:39.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:39.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f7793160 con 0x5637f7786db0 2024-09-21T09:03:39.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:39.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 zone default found 2024-09-21T09:03:39.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 4 Realm: () 2024-09-21T09:03:39.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:39.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:39.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:39.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 zonegroup default 2024-09-21T09:03:39.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.582+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f77931d0 con 0x5637f778b7c0 2024-09-21T09:03:39.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.583+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.583+0000 7faae5f08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.583+0000 7faae5f08800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.583+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f77954a0 con 0x5637f7790150 2024-09-21T09:03:39.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.583+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.583+0000 7faae5f08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.583+0000 7faae5f08800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.583+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f7795840 con 0x5637f7790150 2024-09-21T09:03:39.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.583+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.583+0000 7faae5f08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.583+0000 7faae5f08800 20 started sync module instance, tier type = 2024-09-21T09:03:39.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.583+0000 7faae5f08800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:39.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.583+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f7794930 con 0x7faad4059040 2024-09-21T09:03:39.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.584+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.584+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94798375112320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f7794930 con 0x7faad4059040 2024-09-21T09:03:39.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.584+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f7796250 con 0x5637f7786db0 2024-09-21T09:03:39.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.585+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94798375112320] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.586+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.586+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94798375116672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f7794930 con 0x5637f7786db0 2024-09-21T09:03:39.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.586+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f7796ca0 con 0x5637f7790150 2024-09-21T09:03:39.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.587+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94798375116672] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.587+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.587+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94798375109760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f77948a0 con 0x5637f7790150 2024-09-21T09:03:39.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.587+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f7797b60 con 0x7faad4059040 2024-09-21T09:03:39.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.588+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94798375109760] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.588+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.588+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94798375122608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f7797f80 con 0x7faad4059040 2024-09-21T09:03:39.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.588+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f7798850 con 0x5637f7786db0 2024-09-21T09:03:39.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.589+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94798375122608] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.589+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.589+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94798375123664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f77983a0 con 0x5637f7786db0 2024-09-21T09:03:39.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.589+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f7799260 con 0x5637f778b7c0 2024-09-21T09:03:39.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.590+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94798375123664] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.590+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.590+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94798375124720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f7798310 con 0x5637f778b7c0 2024-09-21T09:03:39.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.590+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f779a120 con 0x5637f778b7c0 2024-09-21T09:03:39.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.591+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94798375124720] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.591+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.591+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94798375130624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f779a120 con 0x5637f778b7c0 2024-09-21T09:03:39.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.591+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f779aae0 con 0x5637f778b7c0 2024-09-21T09:03:39.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.592+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94798375130624] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.593+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.593+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94798375132752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f779aae0 con 0x5637f778b7c0 2024-09-21T09:03:39.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.593+0000 7faae5f08800 20 add_watcher() i=0 2024-09-21T09:03:39.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.593+0000 7faae5f08800 20 add_watcher() i=1 2024-09-21T09:03:39.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.593+0000 7faae5f08800 20 add_watcher() i=2 2024-09-21T09:03:39.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.593+0000 7faae5f08800 20 add_watcher() i=3 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.593+0000 7faae5f08800 20 add_watcher() i=4 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.593+0000 7faae5f08800 20 add_watcher() i=5 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.593+0000 7faae5f08800 20 add_watcher() i=6 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.594+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94798375132752] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.594+0000 7faae5f08800 20 add_watcher() i=7 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.594+0000 7faae5f08800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.594+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f779df10 con 0x5637f7786db0 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.594+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.594+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94798375135232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f779b3d0 con 0x5637f7786db0 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.595+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94798375135232] v31'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.595+0000 7fa999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.595+0000 7faae5f08800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.595+0000 7faae5f08800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.595+0000 7faae5f08800 5 note: GC not initialized 2024-09-21T09:03:39.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.595+0000 7fa998fe1640 20 reqs_thread_entry: start 2024-09-21T09:03:39.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.595+0000 7faae5f08800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:39.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.595+0000 7faae5f08800 20 Filter name: none 2024-09-21T09:03:39.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7fa9127fc640 20 reqs_thread_entry: start 2024-09-21T09:03:39.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T09:03:39.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f77d1770 con 0x7faad4059040 2024-09-21T09:03:39.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:39.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T09:03:39.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:39.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 : miss 2024-09-21T09:03:39.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 8.1f 8:fafbe283:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f77d3350 con 0x7faad4059040 2024-09-21T09:03:39.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(63 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:39.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 info.flags=0x17 2024-09-21T09:03:39.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 to cache LRU end 2024-09-21T09:03:39.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:39.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:39.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 2024-09-21T09:03:39.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 20 get_obj_state: octx=0x5637f7774260 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5637f77d5a18 s->prefetch_data=0 2024-09-21T09:03:39.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.596+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 3.a 3:5395bc93:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5637f77d6b30 con 0x5637f7790150 2024-09-21T09:03:39.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.597+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.597+0000 7faae5f08800 10 manifest: total_size = 5 2024-09-21T09:03:39.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.597+0000 7faae5f08800 20 get_obj_state: setting s->obj_tag to _t8E73o760AVGsgmOI1KKnRMjLP6E5B7 2024-09-21T09:03:39.609 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.597+0000 7fa999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:39.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.597+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94798375135232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f77d6520 con 0x5637f7786db0 2024-09-21T09:03:39.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.598+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94798375135232] v31'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.598+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94798375112320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f77d6520 con 0x7faad4059040 2024-09-21T09:03:39.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.599+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94798375112320] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.599+0000 7faae5f08800 20 remove_watcher() i=0 2024-09-21T09:03:39.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.599+0000 7faae5f08800 2 removed watcher, disabling cache 2024-09-21T09:03:39.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.599+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94798375116672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f77cf060 con 0x5637f7786db0 2024-09-21T09:03:39.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.600+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94798375116672] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.600+0000 7faae5f08800 20 remove_watcher() i=1 2024-09-21T09:03:39.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.600+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94798375109760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f77cf060 con 0x5637f7790150 2024-09-21T09:03:39.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.601+0000 7faae39fc640 1 -- 172.21.15.178:0/3862906708 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94798375109760] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad4018950 con 0x5637f7790150 2024-09-21T09:03:39.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.601+0000 7faae5f08800 20 remove_watcher() i=2 2024-09-21T09:03:39.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.601+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94798375122608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f77cf060 con 0x7faad4059040 2024-09-21T09:03:39.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.602+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94798375122608] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc051070 con 0x7faad4059040 2024-09-21T09:03:39.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.602+0000 7faae5f08800 20 remove_watcher() i=3 2024-09-21T09:03:39.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.602+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94798375123664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f77976b0 con 0x5637f7786db0 2024-09-21T09:03:39.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.603+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94798375123664] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc051070 con 0x5637f7786db0 2024-09-21T09:03:39.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.603+0000 7faae5f08800 20 remove_watcher() i=4 2024-09-21T09:03:39.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.603+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94798375124720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f77cf060 con 0x5637f778b7c0 2024-09-21T09:03:39.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.604+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94798375124720] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.605+0000 7faae5f08800 20 remove_watcher() i=5 2024-09-21T09:03:39.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.605+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94798375130624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f77cf060 con 0x5637f778b7c0 2024-09-21T09:03:39.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.606+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94798375130624] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.606+0000 7faae5f08800 20 remove_watcher() i=6 2024-09-21T09:03:39.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.606+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94798375132752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5637f7799600 con 0x5637f778b7c0 2024-09-21T09:03:39.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.606+0000 7faae41fd640 1 -- 172.21.15.178:0/3862906708 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94798375132752] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc040020 con 0x5637f778b7c0 2024-09-21T09:03:39.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.606+0000 7faae5f08800 20 remove_watcher() i=7 2024-09-21T09:03:39.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5637f778b7c0 msgr2=0x5637f778dbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5637f778b7c0 0x5637f778dbb0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5637f7786db0 msgr2=0x5637f7789270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5637f7786db0 0x5637f7789270 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7faad4059040 msgr2=0x7faad4024420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7faad4059040 0x7faad4024420 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5637f7790150 msgr2=0x5637f7792610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5637f7790150 0x5637f7792610 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9ac036b90 msgr2=0x7fa9ac039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9ac036b90 0x7fa9ac039050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faad400bcd0 tx=0x7faad4038000 comp rx=0 tx=0).stop 2024-09-21T09:03:39.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7773e80 msgr2=0x5637f777b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faadbfff640 1 -- 172.21.15.178:0/3862906708 reap_dead start 2024-09-21T09:03:39.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7773e80 0x5637f777b330 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7faadc04ba20 tx=0x7faadc00a0e0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 shutdown_connections 2024-09-21T09:03:39.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 --2- 172.21.15.178:0/3862906708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7773e80 0x5637f777b330 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 >> 172.21.15.178:0/3862906708 conn(0x5637f77701e0 msgr2=0x5637f776e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 shutdown_connections 2024-09-21T09:03:39.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/3862906708 wait complete. 2024-09-21T09:03:39.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/2550197853 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9bc036b90 msgr2=0x7fa9bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 --2- 172.21.15.178:0/2550197853 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9bc036b90 0x7fa9bc039050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x5637f7753ee0 tx=0x7faad4024ec0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/2550197853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7767250 msgr2=0x5637f7767670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 --2- 172.21.15.178:0/2550197853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7767250 0x5637f7767670 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x5637f774d570 tx=0x7faadc0188f0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/2550197853 shutdown_connections 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 --2- 172.21.15.178:0/2550197853 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9bc036b90 0x7fa9bc039050 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 --2- 172.21.15.178:0/2550197853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f7767250 0x5637f7767670 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/2550197853 >> 172.21.15.178:0/2550197853 conn(0x5637f775c1e0 msgr2=0x5637f775ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/2550197853 shutdown_connections 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.607+0000 7faae5f08800 1 -- 172.21.15.178:0/2550197853 wait complete. 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5637f7755dc0 msgr2=0x5637f77581b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5637f7755dc0 0x5637f77581b0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5637f75c95d0 msgr2=0x5637f7753530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5637f75c95d0 0x5637f7753530 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9cc036b90 msgr2=0x7fa9cc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9cc036b90 0x7fa9cc039050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faacc057000 tx=0x7faacc052000 comp rx=0 tx=0).stop 2024-09-21T09:03:39.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 msgr2=0x5637f774c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f774c4c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7faad400b7c0 tx=0x7faad4000ed0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 shutdown_connections 2024-09-21T09:03:39.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5637f7755dc0 0x5637f77581b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5637f75c95d0 0x5637f7753530 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa9cc036b90 0x7fa9cc039050 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 --2- 172.21.15.178:0/3607489481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637f75c84c0 0x5637f774c4c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 >> 172.21.15.178:0/3607489481 conn(0x5637f764efe0 msgr2=0x5637f773ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 shutdown_connections 2024-09-21T09:03:39.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.608+0000 7faae5f08800 1 -- 172.21.15.178:0/3607489481 wait complete. 2024-09-21T09:03:39.619 INFO:teuthology.orchestra.run.smithi178.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-21T09:03:39.619 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-21T09:03:39.622 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-21T09:03:39.635 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:39.691 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-21T09:03:39.691 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-21T09:03:39.691 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-21T09:03:39.691 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-21T09:03:39.691 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-21T09:03:39.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-21T09:03:39.692 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-21T09:03:39.737 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:39.737 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:39.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.736+0000 7fe410539800 1 Processor -- start 2024-09-21T09:03:39.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.736+0000 7fe410539800 1 -- start start 2024-09-21T09:03:39.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.736+0000 7fe410539800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55b2980b5650 0x55b2981441e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.736+0000 7fe410539800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b298000b30 con 0x55b298144720 2024-09-21T09:03:39.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.736+0000 7fe410539800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55b297fe2360 con 0x55b2980b5650 2024-09-21T09:03:39.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.736+0000 7fe40c1d8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55b2980b5650 0x55b2981441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.736+0000 7fe40c1d8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55b2980b5650 0x55b2981441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49650/0 (socket says 172.21.15.178:49650) 2024-09-21T09:03:39.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.736+0000 7fe40c1d8640 1 -- 172.21.15.178:0/3604241006 learned_addr learned my addr 172.21.15.178:0/3604241006 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.736+0000 7fe40b9d7640 1 --1- 172.21.15.178:0/3604241006 >> v1:172.21.15.44:6789/0 conn(0x55b298144720 0x55b298146b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:45162/0 (socket says 172.21.15.178:45162) 2024-09-21T09:03:39.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.737+0000 7fe40c1d8640 1 -- 172.21.15.178:0/3604241006 >> v1:172.21.15.44:6789/0 conn(0x55b298144720 legacy=0x55b298146b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.737+0000 7fe40c1d8640 1 -- 172.21.15.178:0/3604241006 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b298008e00 con 0x55b2980b5650 2024-09-21T09:03:39.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.738+0000 7fe40c1d8640 1 --2- 172.21.15.178:0/3604241006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b2981441e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc00a520 tx=0x7fe3fc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818f0180a11d8115 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.739+0000 7fe40b1d6640 1 -- 172.21.15.178:0/3604241006 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3fc055070 con 0x55b2980b5650 2024-09-21T09:03:39.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.739+0000 7fe40b1d6640 1 -- 172.21.15.178:0/3604241006 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3fc0515b0 con 0x55b2980b5650 2024-09-21T09:03:39.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.739+0000 7fe40b1d6640 1 -- 172.21.15.178:0/3604241006 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3fc0518d0 con 0x55b2980b5650 2024-09-21T09:03:39.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.739+0000 7fe410539800 1 -- 172.21.15.178:0/3604241006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 msgr2=0x55b2981441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.739+0000 7fe410539800 1 --2- 172.21.15.178:0/3604241006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b2981441e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc00a520 tx=0x7fe3fc045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.739+0000 7fe410539800 1 -- 172.21.15.178:0/3604241006 shutdown_connections 2024-09-21T09:03:39.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.739+0000 7fe410539800 1 --2- 172.21.15.178:0/3604241006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b2981441e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.739+0000 7fe410539800 1 -- 172.21.15.178:0/3604241006 >> 172.21.15.178:0/3604241006 conn(0x55b29813bdb0 msgr2=0x55b29813e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.739+0000 7fe410539800 1 -- 172.21.15.178:0/3604241006 shutdown_connections 2024-09-21T09:03:39.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.739+0000 7fe410539800 1 -- 172.21.15.178:0/3604241006 wait complete. 2024-09-21T09:03:39.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.753+0000 7fe410539800 1 Processor -- start 2024-09-21T09:03:39.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.753+0000 7fe410539800 1 -- start start 2024-09-21T09:03:39.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.753+0000 7fe410539800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b298230880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.753+0000 7fe410539800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b29808d360 con 0x55b2980b5650 2024-09-21T09:03:39.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.753+0000 7fe40c1d8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b298230880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.753+0000 7fe40c1d8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b298230880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49656/0 (socket says 172.21.15.178:49656) 2024-09-21T09:03:39.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.753+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1207611895 learned_addr learned my addr 172.21.15.178:0/1207611895 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.754+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1207611895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b297fdabc0 con 0x55b2980b5650 2024-09-21T09:03:39.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.754+0000 7fe40c1d8640 1 --2- 172.21.15.178:0/1207611895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b298230880 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc025da0 tx=0x7fe3fc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df90df21c217fff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.754+0000 7fe2fa60c640 1 -- 172.21.15.178:0/1207611895 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3fc051950 con 0x55b2980b5650 2024-09-21T09:03:39.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.754+0000 7fe2fa60c640 1 -- 172.21.15.178:0/1207611895 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3fc051af0 con 0x55b2980b5650 2024-09-21T09:03:39.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.754+0000 7fe2fa60c640 1 -- 172.21.15.178:0/1207611895 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3fc051dd0 con 0x55b2980b5650 2024-09-21T09:03:39.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.755+0000 7fe410539800 1 -- 172.21.15.178:0/1207611895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 msgr2=0x55b298230880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.755+0000 7fe410539800 1 --2- 172.21.15.178:0/1207611895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b298230880 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc025da0 tx=0x7fe3fc051000 comp rx=0 tx=0).stop 2024-09-21T09:03:39.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.755+0000 7fe410539800 1 -- 172.21.15.178:0/1207611895 shutdown_connections 2024-09-21T09:03:39.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.755+0000 7fe410539800 1 --2- 172.21.15.178:0/1207611895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b298230880 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.755+0000 7fe410539800 1 -- 172.21.15.178:0/1207611895 >> 172.21.15.178:0/1207611895 conn(0x55b29813bdb0 msgr2=0x55b29822c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.755+0000 7fe410539800 1 -- 172.21.15.178:0/1207611895 shutdown_connections 2024-09-21T09:03:39.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.755+0000 7fe410539800 1 -- 172.21.15.178:0/1207611895 wait complete. 2024-09-21T09:03:39.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.755+0000 7fe410539800 1 Processor -- start 2024-09-21T09:03:39.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.755+0000 7fe410539800 1 -- start start 2024-09-21T09:03:39.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.755+0000 7fe410539800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b298141b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.755+0000 7fe410539800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b298148620 con 0x55b2980b5650 2024-09-21T09:03:39.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.755+0000 7fe40c1d8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b298141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.755+0000 7fe40c1d8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b298141b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49660/0 (socket says 172.21.15.178:49660) 2024-09-21T09:03:39.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.755+0000 7fe40c1d8640 1 -- 172.21.15.178:0/542077098 learned_addr learned my addr 172.21.15.178:0/542077098 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.756+0000 7fe40c1d8640 1 -- 172.21.15.178:0/542077098 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b297feefe0 con 0x55b2980b5650 2024-09-21T09:03:39.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.756+0000 7fe40c1d8640 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b298141b10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc067040 tx=0x7fe3fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.756+0000 7fe2f8e09640 1 -- 172.21.15.178:0/542077098 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3fc073070 con 0x55b2980b5650 2024-09-21T09:03:39.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.756+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b298140200 con 0x55b2980b5650 2024-09-21T09:03:39.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.756+0000 7fe2f8e09640 1 -- 172.21.15.178:0/542077098 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3fc05a450 con 0x55b2980b5650 2024-09-21T09:03:39.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.756+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b298140780 con 0x55b2980b5650 2024-09-21T09:03:39.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.756+0000 7fe2f8e09640 1 -- 172.21.15.178:0/542077098 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3fc07d060 con 0x55b2980b5650 2024-09-21T09:03:39.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.757+0000 7fe2f8e09640 1 -- 172.21.15.178:0/542077098 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe3fc076070 con 0x55b2980b5650 2024-09-21T09:03:39.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.757+0000 7fe2f8e09640 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2f4036b40 0x7fe2f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.757+0000 7fe2f8e09640 1 -- 172.21.15.178:0/542077098 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe3fc062070 con 0x55b2980b5650 2024-09-21T09:03:39.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.757+0000 7fe40b9d7640 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2f4036b40 0x7fe2f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.757+0000 7fe410539800 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b298144720 0x55b2982414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.757+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982419e0 con 0x55b298144720 2024-09-21T09:03:39.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.758+0000 7fe40c9d9640 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b298144720 0x55b2982414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.758+0000 7fe40b9d7640 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2f4036b40 0x7fe2f4039000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe400000f60 tx=0x7fe400001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.758+0000 7fe40c9d9640 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b298144720 0x55b2982414a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.758+0000 7fe40c9d9640 1 -- 172.21.15.178:0/542077098 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe40400a4a0 con 0x55b298144720 2024-09-21T09:03:39.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.758+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298242230 con 0x55b298144720 2024-09-21T09:03:39.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.758+0000 7fe40c9d9640 1 -- 172.21.15.178:0/542077098 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe40400a4a0 con 0x55b298144720 2024-09-21T09:03:39.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.758+0000 7fe410539800 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b298243c60 0x55b298246090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.758+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298246820 con 0x55b298243c60 2024-09-21T09:03:39.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.759+0000 7fe40c1d8640 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b298243c60 0x55b298246090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.759+0000 7fe40c1d8640 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b298243c60 0x55b298246090 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.759+0000 7fe40c1d8640 1 -- 172.21.15.178:0/542077098 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b298243c60 2024-09-21T09:03:39.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.759+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298242a80 con 0x55b298144720 2024-09-21T09:03:39.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.760+0000 7fe40c9d9640 1 -- 172.21.15.178:0/542077098 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe40400a4a0 con 0x55b298144720 2024-09-21T09:03:39.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.760+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298242e60 con 0x55b298144720 2024-09-21T09:03:39.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.760+0000 7fe40c9d9640 1 -- 172.21.15.178:0/542077098 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe40400a4a0 con 0x55b298144720 2024-09-21T09:03:39.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.760+0000 7fe410539800 1 Processor -- start 2024-09-21T09:03:39.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.760+0000 7fe410539800 1 -- start start 2024-09-21T09:03:39.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.760+0000 7fe410539800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2982551c0 0x55b2982555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.760+0000 7fe410539800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b298142050 con 0x55b2982551c0 2024-09-21T09:03:39.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.761+0000 7fe40c9d9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2982551c0 0x55b2982555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.761+0000 7fe40c9d9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2982551c0 0x55b2982555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49676/0 (socket says 172.21.15.178:49676) 2024-09-21T09:03:39.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.761+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1089041356 learned_addr learned my addr 172.21.15.178:0/1089041356 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.761+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1089041356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b298255b20 con 0x55b2982551c0 2024-09-21T09:03:39.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.761+0000 7fe40c9d9640 1 --2- 172.21.15.178:0/1089041356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2982551c0 0x55b2982555e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x55b298141500 tx=0x7fe404018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.761+0000 7fe2f1ffb640 1 -- 172.21.15.178:0/1089041356 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe404014450 con 0x55b2982551c0 2024-09-21T09:03:39.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.761+0000 7fe2f1ffb640 1 -- 172.21.15.178:0/1089041356 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4040145f0 con 0x55b2982551c0 2024-09-21T09:03:39.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.761+0000 7fe410539800 1 -- 172.21.15.178:0/1089041356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b298255db0 con 0x55b2982551c0 2024-09-21T09:03:39.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.761+0000 7fe2f1ffb640 1 -- 172.21.15.178:0/1089041356 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4040148f0 con 0x55b2982551c0 2024-09-21T09:03:39.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.761+0000 7fe410539800 1 -- 172.21.15.178:0/1089041356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b298258a90 con 0x55b2982551c0 2024-09-21T09:03:39.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.762+0000 7fe2f1ffb640 1 -- 172.21.15.178:0/1089041356 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe404011040 con 0x55b2982551c0 2024-09-21T09:03:39.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.762+0000 7fe2f1ffb640 1 --2- 172.21.15.178:0/1089041356 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2e4036b40 0x7fe2e4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.762+0000 7fe2f1ffb640 1 -- 172.21.15.178:0/1089041356 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe40401e070 con 0x55b2982551c0 2024-09-21T09:03:39.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.762+0000 7fe40c1d8640 1 --2- 172.21.15.178:0/1089041356 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2e4036b40 0x7fe2e4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.763+0000 7fe410539800 1 Processor -- start 2024-09-21T09:03:39.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.763+0000 7fe40c1d8640 1 --2- 172.21.15.178:0/1089041356 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2e4036b40 0x7fe2e4039000 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc064c10 tx=0x7fe3fc064ba0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.763+0000 7fe410539800 1 -- start start 2024-09-21T09:03:39.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.763+0000 7fe410539800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b298261e90 0x55b298262290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.763+0000 7fe410539800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b297fdc580 con 0x55b298261e90 2024-09-21T09:03:39.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.763+0000 7fe40c9d9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b298261e90 0x55b298262290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.763+0000 7fe40c9d9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b298261e90 0x55b298262290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49688/0 (socket says 172.21.15.178:49688) 2024-09-21T09:03:39.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.763+0000 7fe40c9d9640 1 -- 172.21.15.178:0/323118879 learned_addr learned my addr 172.21.15.178:0/323118879 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.763+0000 7fe40c9d9640 1 -- 172.21.15.178:0/323118879 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b298262860 con 0x55b298261e90 2024-09-21T09:03:39.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.764+0000 7fe40c9d9640 1 --2- 172.21.15.178:0/323118879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b298261e90 0x55b298262290 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe40404ccf0 tx=0x7fe40404cfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325fcf3916bcc872 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.764+0000 7fe2eb7fe640 1 -- 172.21.15.178:0/323118879 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe404013cb0 con 0x55b298261e90 2024-09-21T09:03:39.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.764+0000 7fe2eb7fe640 1 -- 172.21.15.178:0/323118879 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe404013e50 con 0x55b298261e90 2024-09-21T09:03:39.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.764+0000 7fe2eb7fe640 1 -- 172.21.15.178:0/323118879 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe404046c10 con 0x55b298261e90 2024-09-21T09:03:39.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.764+0000 7fe410539800 1 -- 172.21.15.178:0/323118879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b298261e90 msgr2=0x55b298262290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.764+0000 7fe410539800 1 --2- 172.21.15.178:0/323118879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b298261e90 0x55b298262290 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe40404ccf0 tx=0x7fe40404cfc0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.764+0000 7fe410539800 1 -- 172.21.15.178:0/323118879 shutdown_connections 2024-09-21T09:03:39.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.764+0000 7fe410539800 1 --2- 172.21.15.178:0/323118879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b298261e90 0x55b298262290 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.764+0000 7fe410539800 1 -- 172.21.15.178:0/323118879 >> 172.21.15.178:0/323118879 conn(0x55b29825e1f0 msgr2=0x55b29825c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.764+0000 7fe410539800 1 -- 172.21.15.178:0/323118879 shutdown_connections 2024-09-21T09:03:39.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.764+0000 7fe410539800 1 -- 172.21.15.178:0/323118879 wait complete. 2024-09-21T09:03:39.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.764+0000 7fe410539800 1 Processor -- start 2024-09-21T09:03:39.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.765+0000 7fe410539800 1 -- start start 2024-09-21T09:03:39.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.765+0000 7fe410539800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b298261e90 0x55b2982691c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.765+0000 7fe410539800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b298262d50 con 0x55b298261e90 2024-09-21T09:03:39.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.765+0000 7fe40c9d9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b298261e90 0x55b2982691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.765+0000 7fe40c9d9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b298261e90 0x55b2982691c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49690/0 (socket says 172.21.15.178:49690) 2024-09-21T09:03:39.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.765+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 learned_addr learned my addr 172.21.15.178:0/1876138484 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.765+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b298269700 con 0x55b298261e90 2024-09-21T09:03:39.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.765+0000 7fe40c9d9640 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b298261e90 0x55b2982691c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe40403d040 tx=0x7fe40404cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.765+0000 7fe2e9ffb640 1 -- 172.21.15.178:0/1876138484 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe40403b070 con 0x55b298261e90 2024-09-21T09:03:39.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.765+0000 7fe2e9ffb640 1 -- 172.21.15.178:0/1876138484 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe404022dc0 con 0x55b298261e90 2024-09-21T09:03:39.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.765+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b298269990 con 0x55b298261e90 2024-09-21T09:03:39.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.765+0000 7fe2e9ffb640 1 -- 172.21.15.178:0/1876138484 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe404013500 con 0x55b298261e90 2024-09-21T09:03:39.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.766+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b29826c640 con 0x55b298261e90 2024-09-21T09:03:39.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.766+0000 7fe2e9ffb640 1 -- 172.21.15.178:0/1876138484 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe4040136a0 con 0x55b298261e90 2024-09-21T09:03:39.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.766+0000 7fe2e9ffb640 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2dc036b90 0x7fe2dc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.766+0000 7fe2e9ffb640 1 -- 172.21.15.178:0/1876138484 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe40400e040 con 0x55b298261e90 2024-09-21T09:03:39.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.766+0000 7fe40c1d8640 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2dc036b90 0x7fe2dc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.767+0000 7fe40c1d8640 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2dc036b90 0x7fe2dc039050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc08f2b0 tx=0x7fe3fc089000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.767+0000 7fe410539800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.767+0000 7fe410539800 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b298274d20 0x55b2982771e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.767+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298277930 con 0x55b298274d20 2024-09-21T09:03:39.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.767+0000 7fe40b9d7640 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b298274d20 0x55b2982771e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.767+0000 7fe40b9d7640 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b298274d20 0x55b2982771e0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe40000f610 con 0x55b298274d20 2024-09-21T09:03:39.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 20 realm 2024-09-21T09:03:39.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298274170 con 0x55b298274d20 2024-09-21T09:03:39.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe40000f610 con 0x55b298274d20 2024-09-21T09:03:39.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:39.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298278420 con 0x55b298274d20 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe40000f610 con 0x55b298274d20 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298278cf0 con 0x55b298274d20 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe40000f610 con 0x55b298274d20 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b298279710 0x55b29827bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.768+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b29827c1f0 con 0x55b298279710 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.769+0000 7fe40c9d9640 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b298279710 0x55b29827bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.769+0000 7fe40c9d9640 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b298279710 0x55b29827bb00 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.769+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.769+0000 7fe410539800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.769+0000 7fe410539800 20 searching for the correct realm 2024-09-21T09:03:39.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.769+0000 7fe410539800 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55b29827e1c0 0x55b298280680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.770+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b29827e1c0 2024-09-21T09:03:39.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.770+0000 7fe40c1d8640 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55b29827e1c0 0x55b298280680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.770+0000 7fe40c1d8640 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55b29827e1c0 0x55b298280680 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.770+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.770+0000 7fe40c1d8640 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe3fc078070 0x7fe3fc06f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.770+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x7fe3fc078070 2024-09-21T09:03:39.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.770+0000 7fe40b9d7640 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe3fc078070 0x7fe3fc06f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.770+0000 7fe40b9d7640 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe3fc078070 0x7fe3fc06f900 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.771+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe40000f610 con 0x7fe3fc078070 2024-09-21T09:03:39.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.771+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298279710 2024-09-21T09:03:39.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.771+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.771+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298274d20 2024-09-21T09:03:39.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.771+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe40000f610 con 0x55b298274d20 2024-09-21T09:03:39.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.771+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298274d20 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.772+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe40002b040 con 0x55b298274d20 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.772+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298279710 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.772+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.772+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298279710 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.772+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.772+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x7fe3fc078070 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.772+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe40002b040 con 0x7fe3fc078070 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.772+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b29827e1c0 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.772+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.773+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298274d20 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.773+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe40002b040 con 0x55b298274d20 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.773+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298279710 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.773+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.773+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298274d20 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.773+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe40002b040 con 0x55b298274d20 2024-09-21T09:03:39.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.773+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x7fe3fc078070 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.774+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe40002b040 con 0x7fe3fc078070 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.774+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b29827e1c0 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.774+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.774+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b29827e1c0 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.774+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.774+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298279710 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.774+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.774+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b29827e1c0 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.774+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.774+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b29827e1c0 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.775+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.775+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298274d20 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.775+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe40002b040 con 0x55b298274d20 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.775+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298274d20 2024-09-21T09:03:39.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.775+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe40002b040 con 0x55b298274d20 2024-09-21T09:03:39.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.775+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298279710 2024-09-21T09:03:39.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.776+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.776+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b29827e1c0 2024-09-21T09:03:39.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.776+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.776+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x7fe3fc078070 2024-09-21T09:03:39.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.776+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe40002b040 con 0x7fe3fc078070 2024-09-21T09:03:39.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.776+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298274d20 2024-09-21T09:03:39.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.776+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe40002b040 con 0x55b298274d20 2024-09-21T09:03:39.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.776+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298279710 2024-09-21T09:03:39.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.777+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.777+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b29827e1c0 2024-09-21T09:03:39.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.777+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.777+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x7fe3fc078070 2024-09-21T09:03:39.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.777+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe40002b040 con 0x7fe3fc078070 2024-09-21T09:03:39.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.777+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x7fe3fc078070 2024-09-21T09:03:39.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.777+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe40002b040 con 0x7fe3fc078070 2024-09-21T09:03:39.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.777+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b29827e1c0 2024-09-21T09:03:39.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298279710 2024-09-21T09:03:39.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x55b298274d20 2024-09-21T09:03:39.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe40002b040 con 0x55b298274d20 2024-09-21T09:03:39.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b298280d50 con 0x7fe3fc078070 2024-09-21T09:03:39.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe40002b040 con 0x7fe3fc078070 2024-09-21T09:03:39.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe410539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:39.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe410539800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:39.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe410539800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:39.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe410539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:39.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe410539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:39.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe410539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:39.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe410539800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.778+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b29827cbe0 con 0x55b298274d20 2024-09-21T09:03:39.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b29827d480 con 0x55b298274d20 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b29827c820 con 0x55b298274d20 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 20 zone default found 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 4 Realm: () 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:39.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 20 zonegroup default 2024-09-21T09:03:39.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.779+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b29827d090 con 0x55b298279710 2024-09-21T09:03:39.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.780+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.780+0000 7fe410539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.780+0000 7fe410539800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.780+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298283560 con 0x55b29827e1c0 2024-09-21T09:03:39.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.780+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.780+0000 7fe410539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.780+0000 7fe410539800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.780+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298283900 con 0x55b29827e1c0 2024-09-21T09:03:39.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.780+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.780+0000 7fe410539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.780+0000 7fe410539800 20 started sync module instance, tier type = 2024-09-21T09:03:39.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.780+0000 7fe410539800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.780+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982829f0 con 0x7fe3fc078070 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.781+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.781+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94225545309968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982829f0 con 0x7fe3fc078070 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.781+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298284310 con 0x55b298274d20 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.782+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94225545309968] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.782+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.782+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94225545307936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298284310 con 0x55b298274d20 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.783+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298284d50 con 0x55b29827e1c0 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.784+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94225545307936] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.784+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.784+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94225545313888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298284280 con 0x55b29827e1c0 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.784+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298285c10 con 0x7fe3fc078070 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.785+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94225545313888] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.785+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.785+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94225545320288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298285b80 con 0x7fe3fc078070 2024-09-21T09:03:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.785+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298286ad0 con 0x55b298274d20 2024-09-21T09:03:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.786+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94225545320288] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.786+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.786+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94225545322384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298286ad0 con 0x55b298274d20 2024-09-21T09:03:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.786+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298287490 con 0x55b298279710 2024-09-21T09:03:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.787+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.787+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94225545322384] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.787+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94225545324064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298286a40 con 0x55b298279710 2024-09-21T09:03:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.787+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982881d0 con 0x55b298279710 2024-09-21T09:03:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.788+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94225545324064] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.788+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.788+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94225545328688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298288140 con 0x55b298279710 2024-09-21T09:03:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.788+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298288c00 con 0x55b298279710 2024-09-21T09:03:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.789+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(58 notify.7 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.789+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94225545328688] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.789+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94225545332432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298288bc0 con 0x55b298279710 2024-09-21T09:03:39.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.789+0000 7fe410539800 20 add_watcher() i=0 2024-09-21T09:03:39.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.789+0000 7fe410539800 20 add_watcher() i=1 2024-09-21T09:03:39.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.789+0000 7fe410539800 20 add_watcher() i=2 2024-09-21T09:03:39.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.789+0000 7fe410539800 20 add_watcher() i=3 2024-09-21T09:03:39.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.789+0000 7fe410539800 20 add_watcher() i=4 2024-09-21T09:03:39.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.789+0000 7fe410539800 20 add_watcher() i=5 2024-09-21T09:03:39.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.789+0000 7fe410539800 20 add_watcher() i=6 2024-09-21T09:03:39.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.790+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94225545332432] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.790+0000 7fe410539800 20 add_watcher() i=7 2024-09-21T09:03:39.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.790+0000 7fe410539800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:39.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.790+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298288bc0 con 0x55b298274d20 2024-09-21T09:03:39.800 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.791+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.791+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94225545334768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982898c0 con 0x55b298274d20 2024-09-21T09:03:39.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.792+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94225545334768] v31'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.792+0000 7fe2c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:39.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.792+0000 7fe410539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:39.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.792+0000 7fe410539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:39.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.792+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298294af0 con 0x55b298274d20 2024-09-21T09:03:39.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.793+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.793+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982951c0 con 0x55b298279710 2024-09-21T09:03:39.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.794+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.795+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298295640 con 0x55b29827e1c0 2024-09-21T09:03:39.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.795+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.795+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982959e0 con 0x55b298274d20 2024-09-21T09:03:39.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.796+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'183 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.796+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298295f50 con 0x7fe3fc078070 2024-09-21T09:03:39.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.797+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.797+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298296110 con 0x55b29827e1c0 2024-09-21T09:03:39.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.798+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'43 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.798+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298296510 con 0x55b298274d20 2024-09-21T09:03:39.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.800+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.800+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298296510 con 0x55b298279710 2024-09-21T09:03:39.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.801+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.801+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x7fe3fc078070 2024-09-21T09:03:39.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.802+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.802+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b29827e1c0 2024-09-21T09:03:39.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.803+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.803+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x7fe3fc078070 2024-09-21T09:03:39.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.803+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.804+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b298279710 2024-09-21T09:03:39.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.805+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.805+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x7fe3fc078070 2024-09-21T09:03:39.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.806+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.806+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b298279710 2024-09-21T09:03:39.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.807+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.807+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b298274d20 2024-09-21T09:03:39.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.808+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'184 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.808+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b29827e1c0 2024-09-21T09:03:39.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.809+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'56 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.809+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x7fe3fc078070 2024-09-21T09:03:39.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.810+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.810+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b29827e1c0 2024-09-21T09:03:39.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.811+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.813 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.811+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b298274d20 2024-09-21T09:03:39.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.812+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.814 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.812+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b298274d20 2024-09-21T09:03:39.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.813+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'185 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.813+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b29827e1c0 2024-09-21T09:03:39.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.814+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'57 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.814+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x7fe3fc078070 2024-09-21T09:03:39.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.815+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.815+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b29827e1c0 2024-09-21T09:03:39.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.816+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.818 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.816+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b29827e1c0 2024-09-21T09:03:39.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.817+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.817+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b29827e1c0 2024-09-21T09:03:39.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.818+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.818+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b29827e1c0 2024-09-21T09:03:39.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.819+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'44 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.819+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b298279710 2024-09-21T09:03:39.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.820+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.820+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b29827e1c0 2024-09-21T09:03:39.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.821+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.821+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b298279710 2024-09-21T09:03:39.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.822+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.822+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b29827e1c0 2024-09-21T09:03:39.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.823+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'58 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.823+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x55b298279710 2024-09-21T09:03:39.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.824+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.824+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982965c0 con 0x7fe3fc078070 2024-09-21T09:03:39.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.825+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.825+0000 7fe2c17e2640 20 reqs_thread_entry: start 2024-09-21T09:03:39.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.825+0000 7fe410539800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:39.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.825+0000 7fe410539800 20 Filter name: none 2024-09-21T09:03:39.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.825+0000 7fe232ffd640 20 reqs_thread_entry: start 2024-09-21T09:03:39.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.825+0000 7fe410539800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T09:03:39.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.825+0000 7fe410539800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.825+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c1bf0 con 0x7fe3fc078070 2024-09-21T09:03:39.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe410539800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:03:39.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe410539800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T09:03:39.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe410539800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:03:39.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe410539800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 : miss 2024-09-21T09:03:39.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe410539800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:95 8.1f 8:fafbe283:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c3650 con 0x7fe3fc078070 2024-09-21T09:03:39.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(95 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe410539800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:03:39.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe410539800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 info.flags=0x17 2024-09-21T09:03:39.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe410539800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 to cache LRU end 2024-09-21T09:03:39.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe410539800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:39.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe410539800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:03:39.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe410539800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 2024-09-21T09:03:39.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:96 4.2f 4:f6bd69eb:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298340e60 con 0x55b298274d20 2024-09-21T09:03:39.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(96 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.826+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:97 4.1 4:82357e3f:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298340e60 con 0x7fe3fc078070 2024-09-21T09:03:39.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.827+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 21 ==== osd_op_reply(97 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.827+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:98 4.21 4:85f17c25:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298340e60 con 0x55b298279710 2024-09-21T09:03:39.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.827+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(98 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.2 [call out=425b] v0'0 uv7 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.827+0000 7fe410539800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-21T09:03:39.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.827+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:99 4.1c 4:3b0eb500:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298341350 con 0x55b298279710 2024-09-21T09:03:39.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.827+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(99 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.827+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:100 4.2d 4:b7adc1f4:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298341350 con 0x55b298279710 2024-09-21T09:03:39.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.828+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(100 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.828+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:101 4.3d 4:bdd3644c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298341350 con 0x55b29827e1c0 2024-09-21T09:03:39.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.828+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(101 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.828+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:102 4.3e 4:7f7b73ee:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298341350 con 0x7fe3fc078070 2024-09-21T09:03:39.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.829+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 22 ==== osd_op_reply(102 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.6 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.829+0000 7fe410539800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-21T09:03:39.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.829+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:103 4.27 4:e4f3c974:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298341350 con 0x55b298274d20 2024-09-21T09:03:39.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.829+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(103 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.829+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:104 4.27 4:e52985fe:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298341350 con 0x55b298274d20 2024-09-21T09:03:39.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.829+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(104 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.8 [call out=425b] v0'0 uv8 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.829+0000 7fe410539800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-21T09:03:39.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.829+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:105 4.b 4:d37a33c0:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298341350 con 0x7fe3fc078070 2024-09-21T09:03:39.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.830+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 23 ==== osd_op_reply(105 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.830+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:106 4.2b 4:d5582577:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298341350 con 0x7fe3fc078070 2024-09-21T09:03:39.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.830+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 24 ==== osd_op_reply(106 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10 [call out=698b] v0'0 uv13 ondisk = 0) ==== 195+0+698 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.830+0000 7fe410539800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-21T09:03:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.830+0000 7fe410539800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-21T09:03:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.830+0000 7fe410539800 20 get_obj_state: octx=0x55b298262290 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55b2983404c8 s->prefetch_data=0 2024-09-21T09:03:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.830+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:107 3.26 3:67f09ca3:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b29833e9c0 con 0x7fe3fc078070 2024-09-21T09:03:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.830+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 25 ==== osd_op_reply(107 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.830+0000 7fe410539800 10 manifest: total_size = 6 2024-09-21T09:03:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.830+0000 7fe410539800 20 get_obj_state: setting s->obj_tag to 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.8116505059771371047 2024-09-21T09:03:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.830+0000 7fe410539800 20 get_obj_state: octx=0x55b298262290 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55b2983404c8 s->prefetch_data=0 2024-09-21T09:03:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.830+0000 7fe410539800 20 prepare_atomic_modification: state is not atomic. state=0x55b2983404c8 2024-09-21T09:03:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.830+0000 7fe410539800 20 bucket index object: :.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.2 2024-09-21T09:03:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.830+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:108 4.21 4:85f17c25:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c8c60 con 0x55b298279710 2024-09-21T09:03:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.832+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(108 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.2 [stat,call,call] v31'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.832+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:109 3.26 3:67f09ca3:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c8c60 con 0x7fe3fc078070 2024-09-21T09:03:39.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.833+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 26 ==== osd_op_reply(109 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_9c8454ddf7aa50116496bac348d7550d [call] v31'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.833+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:110 4.21 4:85f17c25:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c96f0 con 0x55b298279710 2024-09-21T09:03:39.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.833+0000 7fe410539800 20 get_obj_state: octx=0x55b298262290 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55b2983404c8 s->prefetch_data=0 2024-09-21T09:03:39.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.833+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:111 3.c 3:30eebeda:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c96f0 con 0x55b29827e1c0 2024-09-21T09:03:39.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.833+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 27 ==== osd_op_reply(111 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.833+0000 7fe410539800 10 manifest: total_size = 3 2024-09-21T09:03:39.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.833+0000 7fe410539800 20 get_obj_state: setting s->obj_tag to 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7156608458851682236 2024-09-21T09:03:39.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.833+0000 7fe410539800 20 get_obj_state: octx=0x55b298262290 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55b2983404c8 s->prefetch_data=0 2024-09-21T09:03:39.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.833+0000 7fe410539800 20 prepare_atomic_modification: state is not atomic. state=0x55b2983404c8 2024-09-21T09:03:39.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.833+0000 7fe410539800 20 bucket index object: :.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.6 2024-09-21T09:03:39.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.833+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:112 4.3e 4:7f7b73ee:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982ce330 con 0x7fe3fc078070 2024-09-21T09:03:39.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.834+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(110 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.2 [stat,call,call] v31'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.834+0000 7fe2eb7fe640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-21T09:03:39.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.834+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 27 ==== osd_op_reply(112 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.6 [stat,call,call] v31'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.834+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:113 3.c 3:30eebeda:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c6690 con 0x55b29827e1c0 2024-09-21T09:03:39.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.835+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 28 ==== osd_op_reply(113 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_b1b9a972ccd8c962a473909b97007eb4 [call] v31'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.835+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:114 4.3e 4:7f7b73ee:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982ca2f0 con 0x7fe3fc078070 2024-09-21T09:03:39.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.835+0000 7fe410539800 20 get_obj_state: octx=0x55b298262290 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55b2983404c8 s->prefetch_data=0 2024-09-21T09:03:39.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.835+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:115 3.9 3:900ea9ed:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982ca2f0 con 0x55b29827e1c0 2024-09-21T09:03:39.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.835+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 29 ==== osd_op_reply(115 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.835+0000 7fe410539800 10 manifest: total_size = 4 2024-09-21T09:03:39.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.836+0000 7fe410539800 20 get_obj_state: setting s->obj_tag to 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.1693293704802032300 2024-09-21T09:03:39.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.836+0000 7fe410539800 20 get_obj_state: octx=0x55b298262290 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55b2983404c8 s->prefetch_data=0 2024-09-21T09:03:39.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.836+0000 7fe410539800 20 prepare_atomic_modification: state is not atomic. state=0x55b2983404c8 2024-09-21T09:03:39.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.836+0000 7fe410539800 20 bucket index object: :.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.8 2024-09-21T09:03:39.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.836+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:116 4.27 4:e52985fe:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982ca2f0 con 0x55b298274d20 2024-09-21T09:03:39.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.836+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 28 ==== osd_op_reply(114 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.6 [stat,call,call] v31'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.836+0000 7fe2eaffd640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-21T09:03:39.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.837+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(116 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.8 [stat,call,call] v31'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.837+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:117 3.9 3:900ea9ed:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982ca0e0 con 0x55b29827e1c0 2024-09-21T09:03:39.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.838+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 30 ==== osd_op_reply(117 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v31'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.838+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:118 4.27 4:e52985fe:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982cda60 con 0x55b298274d20 2024-09-21T09:03:39.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.838+0000 7fe410539800 20 get_obj_state: octx=0x55b298262290 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55b2983404c8 s->prefetch_data=0 2024-09-21T09:03:39.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.838+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:119 3.25 3:a5cfe97d:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982cda60 con 0x55b298274d20 2024-09-21T09:03:39.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.838+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(119 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.838+0000 7fe410539800 10 manifest: total_size = 5 2024-09-21T09:03:39.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.838+0000 7fe410539800 20 get_obj_state: setting s->obj_tag to 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.18003226730078305036 2024-09-21T09:03:39.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.838+0000 7fe410539800 20 get_obj_state: octx=0x55b298262290 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55b2983404c8 s->prefetch_data=0 2024-09-21T09:03:39.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.838+0000 7fe410539800 20 prepare_atomic_modification: state is not atomic. state=0x55b2983404c8 2024-09-21T09:03:39.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.838+0000 7fe410539800 20 bucket index object: :.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10 2024-09-21T09:03:39.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.838+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:120 4.2b 4:d5582577:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982cda60 con 0x7fe3fc078070 2024-09-21T09:03:39.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.839+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== osd_op_reply(118 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.8 [stat,call,call] v31'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.839+0000 7fe2eb7fe640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-21T09:03:39.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.839+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 29 ==== osd_op_reply(120 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10 [stat,call,call] v31'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.839+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:121 3.25 3:a5cfe97d:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982ce1c0 con 0x55b298274d20 2024-09-21T09:03:39.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.840+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(121 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_24d27c169c2c881eb09a065116f2aa5c [call] v31'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.840+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:122 4.2b 4:d5582577:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982cda60 con 0x7fe3fc078070 2024-09-21T09:03:39.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.840+0000 7fe410539800 20 get_obj_state: octx=0x55b298262290 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55b2983404c8 s->prefetch_data=0 2024-09-21T09:03:39.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.840+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:123 3.a 3:5395bc93:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c4b20 con 0x55b29827e1c0 2024-09-21T09:03:39.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.840+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 31 ==== osd_op_reply(123 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.840+0000 7fe410539800 10 manifest: total_size = 5 2024-09-21T09:03:39.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.840+0000 7fe410539800 20 get_obj_state: setting s->obj_tag to _t8E73o760AVGsgmOI1KKnRMjLP6E5B7 2024-09-21T09:03:39.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.840+0000 7fe410539800 20 get_obj_state: octx=0x55b298262290 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55b2983404c8 s->prefetch_data=0 2024-09-21T09:03:39.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.840+0000 7fe410539800 20 prepare_atomic_modification: state is not atomic. state=0x55b2983404c8 2024-09-21T09:03:39.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.840+0000 7fe410539800 20 bucket index object: :.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10 2024-09-21T09:03:39.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.840+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:124 4.2b 4:d5582577:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982cda60 con 0x7fe3fc078070 2024-09-21T09:03:39.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.841+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 30 ==== osd_op_reply(122 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10 [stat,call,call] v31'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.841+0000 7fe2eaffd640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-21T09:03:39.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.842+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 31 ==== osd_op_reply(124 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10 [stat,call,call] v31'16 uv16 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.842+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:125 3.a 3:5395bc93:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982cdff0 con 0x55b29827e1c0 2024-09-21T09:03:39.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 32 ==== osd_op_reply(125 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5_bb3aec0fdcdbc2974890f805c585d432 [call] v31'6 uv6 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:126 4.2b 4:d5582577:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982cdff0 con 0x7fe3fc078070 2024-09-21T09:03:39.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe410539800 20 list_objects_ordered: starting attempt 1 2024-09-21T09:03:39.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe410539800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-21T09:03:39.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:127 4.2f 4:f6bd69eb:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982cdff0 con 0x55b298274d20 2024-09-21T09:03:39.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:128 4.1 4:82357e3f:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298340790 con 0x7fe3fc078070 2024-09-21T09:03:39.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:129 4.21 4:85f17c25:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982d2480 con 0x55b298279710 2024-09-21T09:03:39.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:130 4.1c 4:3b0eb500:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b298340790 con 0x55b298279710 2024-09-21T09:03:39.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:131 4.2d 4:b7adc1f4:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982d2480 con 0x55b298279710 2024-09-21T09:03:39.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:132 4.3d 4:bdd3644c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982d99e0 con 0x55b29827e1c0 2024-09-21T09:03:39.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:133 4.3e 4:7f7b73ee:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982d99e0 con 0x7fe3fc078070 2024-09-21T09:03:39.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(129 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 32 ==== osd_op_reply(128 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== osd_op_reply(130 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 35 ==== osd_op_reply(127 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 31 ==== osd_op_reply(131 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 33 ==== osd_op_reply(132 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:134 4.27 4:e4f3c974:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2983402e0 con 0x55b298274d20 2024-09-21T09:03:39.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:135 4.27 4:e52985fe:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982d93f0 con 0x55b298274d20 2024-09-21T09:03:39.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:136 4.b 4:d37a33c0:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c6c70 con 0x7fe3fc078070 2024-09-21T09:03:39.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.843+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:137 4.2b 4:d5582577:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982d3820 con 0x7fe3fc078070 2024-09-21T09:03:39.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 33 ==== osd_op_reply(133 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 36 ==== osd_op_reply(134 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 34 ==== osd_op_reply(136 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 35 ==== osd_op_reply(126 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10 [stat,call,call] v31'17 uv17 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe2eb7fe640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-21T09:03:39.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 37 ==== osd_op_reply(135 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.8 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 36 ==== osd_op_reply(137 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10 [call out=124b] v0'0 uv17 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe410539800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-21T09:03:39.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe410539800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-21T09:03:39.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe410539800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-21T09:03:39.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe410539800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-21T09:03:39.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe410539800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5])"; uploads.size()=0; is_truncated=0 2024-09-21T09:03:39.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:138 4.2f 4:f6bd69eb:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982d93f0 con 0x55b298274d20 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:139 4.1 4:82357e3f:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c80f0 con 0x7fe3fc078070 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:140 4.21 4:85f17c25:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c6c50 con 0x55b298279710 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:141 4.1c 4:3b0eb500:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982d93f0 con 0x55b298279710 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:142 4.2d 4:b7adc1f4:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982d36b0 con 0x55b298279710 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:143 4.3d 4:bdd3644c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c80f0 con 0x55b29827e1c0 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.844+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:144 4.3e 4:7f7b73ee:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982d93f0 con 0x7fe3fc078070 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:145 4.27 4:e4f3c974:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982d36b0 con 0x55b298274d20 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:146 4.27 4:e52985fe:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c80f0 con 0x55b298274d20 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 34 ==== osd_op_reply(143 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:147 4.b 4:d37a33c0:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982dfeb0 con 0x7fe3fc078070 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:148 4.2b 4:d5582577:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982e03c0 con 0x7fe3fc078070 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 37 ==== osd_op_reply(139 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 38 ==== osd_op_reply(144 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 32 ==== osd_op_reply(140 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 33 ==== osd_op_reply(141 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 34 ==== osd_op_reply(142 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 38 ==== osd_op_reply(138 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 39 ==== osd_op_reply(145 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 40 ==== osd_op_reply(146 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.8 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 39 ==== osd_op_reply(147 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 40 ==== osd_op_reply(148 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10 [call out=124b] v0'0 uv17 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.845+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982ce270 con 0x7fe3fc078070 2024-09-21T09:03:39.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.847+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 41 ==== osd_op_reply(149 foo.buckets [call] v31'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.847+0000 7fe410539800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-21T09:03:39.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.847+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b29833ec80 con 0x7fe3fc078070 2024-09-21T09:03:39.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.848+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 42 ==== osd_op_reply(150 myfoo [call,call,delete] v31'40 uv40 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.848+0000 7fe410539800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-21T09:03:39.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.848+0000 7fe410539800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T09:03:39.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.848+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94225546079360 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2982d2590 con 0x55b298279710 2024-09-21T09:03:39.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.848+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 35 ==== watch-notify(notify (1) cookie 94225545328688 notify 133143986199 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55b298294520 con 0x55b298279710 2024-09-21T09:03:39.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.848+0000 7fe2eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986199 cookie 94225545328688 notifier 4651 bl.length()=149 2024-09-21T09:03:39.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.848+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 36 ==== osd_op_reply(151 notify.6 [notify cookie 94225546079360 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.848+0000 7fe2eaffd640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe240003320 con 0x55b298279710 2024-09-21T09:03:39.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.848+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 37 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.848+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 38 ==== watch-notify(notify_complete (2) cookie 94225546079360 notify 133143986199 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b298269990 con 0x55b298279710 2024-09-21T09:03:39.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.848+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:153 8.1f 8:fafbe283:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b29833ec80 con 0x7fe3fc078070 2024-09-21T09:03:39.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.849+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 43 ==== osd_op_reply(153 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 [call,call,delete] v31'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.849+0000 7fe410539800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 from cache 2024-09-21T09:03:39.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.849+0000 7fe410539800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5, ofs0, ns] 2024-09-21T09:03:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.849+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:154 7.3 7:c609908c:::notify.5:head [notify cookie 94225545575632 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b29833ec80 con 0x55b298279710 2024-09-21T09:03:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 39 ==== watch-notify(notify (1) cookie 94225545324064 notify 133143986200 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55b298269990 con 0x55b298279710 2024-09-21T09:03:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe2eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986200 cookie 94225545324064 notifier 4651 bl.length()=206 2024-09-21T09:03:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe2eb7fe640 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:155 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe2d0003d60 con 0x55b298279710 2024-09-21T09:03:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 40 ==== osd_op_reply(154 notify.5 [notify cookie 94225545575632 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 41 ==== osd_op_reply(155 notify.5 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 42 ==== watch-notify(notify_complete (2) cookie 94225545575632 notify 133143986200 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b298269700 con 0x55b298279710 2024-09-21T09:03:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:156 4.2f 4:f6bd69eb:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b29833ec80 con 0x55b298274d20 2024-09-21T09:03:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:157 4.1 4:82357e3f:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c06d0 con 0x7fe3fc078070 2024-09-21T09:03:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:158 4.21 4:85f17c25:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c0f20 con 0x55b298279710 2024-09-21T09:03:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:159 4.1c 4:3b0eb500:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c12c0 con 0x55b298279710 2024-09-21T09:03:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:160 4.2d 4:b7adc1f4:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982cf1d0 con 0x55b298279710 2024-09-21T09:03:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:161 4.3d 4:bdd3644c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b29833ec80 con 0x55b29827e1c0 2024-09-21T09:03:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:162 4.3e 4:7f7b73ee:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c0f20 con 0x7fe3fc078070 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:163 4.27 4:e4f3c974:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c12c0 con 0x55b298274d20 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:164 4.27 4:e52985fe:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982c06d0 con 0x55b298274d20 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:165 4.b 4:d37a33c0:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982cf1d0 con 0x7fe3fc078070 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.850+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:166 4.2b 4:d5582577:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2982d33a0 con 0x7fe3fc078070 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.852+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 43 ==== osd_op_reply(160 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.4 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.852+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 44 ==== osd_op_reply(165 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.9 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.852+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 45 ==== osd_op_reply(157 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.1 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.852+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 46 ==== osd_op_reply(162 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.6 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.852+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 47 ==== osd_op_reply(166 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.10 [delete] v31'18 uv18 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.852+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 44 ==== osd_op_reply(158 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.2 [delete] v31'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.852+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 41 ==== osd_op_reply(156 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.0 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.852+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 45 ==== osd_op_reply(159 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.3 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.852+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 42 ==== osd_op_reply(163 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.7 [delete] v31'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.853+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 35 ==== osd_op_reply(161 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.5 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.853+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 43 ==== osd_op_reply(164 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5.8 [delete] v31'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.853+0000 7fe410539800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 : miss 2024-09-21T09:03:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.853+0000 7fe410539800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.853+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:167 6.1f 6:f870dcf1:::pubsub..bucket.myfoo%2f5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b29833ec80 con 0x55b298279710 2024-09-21T09:03:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.853+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 46 ==== osd_op_reply(167 pubsub..bucket.myfoo/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.853+0000 7fe410539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.853+0000 7fe410539800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 info.flags=0x0 2024-09-21T09:03:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.853+0000 7fe410539800 10 adding default.rgw.log++pubsub..bucket.myfoo/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 to cache LRU end 2024-09-21T09:03:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.853+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:168 6.1f 6:f870dcf1:::pubsub..bucket.myfoo%2f5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b29833ec80 con 0x55b298279710 2024-09-21T09:03:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.854+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 47 ==== osd_op_reply(168 pubsub..bucket.myfoo/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.5 [delete] v31'27 uv23 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.854+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298340b00 con 0x7fe3fc078070 2024-09-21T09:03:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.855+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 48 ==== osd_op_reply(169 foo.buckets [call] v31'41 uv41 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.856+0000 7fe2c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.856+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94225545334768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b29833ec80 con 0x55b298274d20 2024-09-21T09:03:39.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.857+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 44 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94225545334768] v31'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.857+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94225545309968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b29833ec80 con 0x7fe3fc078070 2024-09-21T09:03:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.858+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 49 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94225545309968] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.858+0000 7fe410539800 20 remove_watcher() i=0 2024-09-21T09:03:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.858+0000 7fe410539800 2 removed watcher, disabling cache 2024-09-21T09:03:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.858+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94225545307936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298282f10 con 0x55b298274d20 2024-09-21T09:03:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.859+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 45 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94225545307936] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.859+0000 7fe410539800 20 remove_watcher() i=1 2024-09-21T09:03:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.859+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94225545313888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298282f10 con 0x55b29827e1c0 2024-09-21T09:03:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.861+0000 7fe40c1d8640 1 -- 172.21.15.178:0/1876138484 <== osd.3 v2:172.21.15.178:6808/24558189 36 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94225545313888] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3fc07f070 con 0x55b29827e1c0 2024-09-21T09:03:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.861+0000 7fe410539800 20 remove_watcher() i=2 2024-09-21T09:03:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.861+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94225545320288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298282f10 con 0x7fe3fc078070 2024-09-21T09:03:39.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.862+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.2 v2:172.21.15.178:6816/3267136144 50 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94225545320288] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x7fe3fc078070 2024-09-21T09:03:39.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.862+0000 7fe410539800 20 remove_watcher() i=3 2024-09-21T09:03:39.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.862+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94225545322384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298285760 con 0x55b298274d20 2024-09-21T09:03:39.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.863+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 <== osd.1 v2:172.21.15.178:6800/627496675 46 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94225545322384] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe40003f040 con 0x55b298274d20 2024-09-21T09:03:39.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.863+0000 7fe410539800 20 remove_watcher() i=4 2024-09-21T09:03:39.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.863+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94225545324064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298282f10 con 0x55b298279710 2024-09-21T09:03:39.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.864+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 48 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94225545324064] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.864+0000 7fe410539800 20 remove_watcher() i=5 2024-09-21T09:03:39.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.864+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94225545328688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298285760 con 0x55b298279710 2024-09-21T09:03:39.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.865+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 49 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94225545328688] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.865+0000 7fe410539800 20 remove_watcher() i=6 2024-09-21T09:03:39.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.865+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94225545332432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b298286620 con 0x55b298279710 2024-09-21T09:03:39.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe40c9d9640 1 -- 172.21.15.178:0/1876138484 <== osd.0 v2:172.21.15.44:6800/2732047064 50 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94225545332432] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe404055070 con 0x55b298279710 2024-09-21T09:03:39.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 20 remove_watcher() i=7 2024-09-21T09:03:39.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b298279710 msgr2=0x55b29827bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b298279710 0x55b29827bb00 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b298274d20 msgr2=0x55b2982771e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b298274d20 0x55b2982771e0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe3fc078070 msgr2=0x7fe3fc06f900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe3fc078070 0x7fe3fc06f900 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55b29827e1c0 msgr2=0x55b298280680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55b29827e1c0 0x55b298280680 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2dc036b90 msgr2=0x7fe2dc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2dc036b90 0x7fe2dc039050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc08f2b0 tx=0x7fe3fc089000 comp rx=0 tx=0).stop 2024-09-21T09:03:39.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b298261e90 msgr2=0x55b2982691c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe40b9d7640 1 -- 172.21.15.178:0/1876138484 reap_dead start 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b298261e90 0x55b2982691c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe40403d040 tx=0x7fe40404cc80 comp rx=0 tx=0).stop 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 shutdown_connections 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 --2- 172.21.15.178:0/1876138484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b298261e90 0x55b2982691c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 >> 172.21.15.178:0/1876138484 conn(0x55b29825e1f0 msgr2=0x55b29825c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 shutdown_connections 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 -- 172.21.15.178:0/1876138484 wait complete. 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 -- 172.21.15.178:0/1089041356 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2e4036b40 msgr2=0x7fe2e4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 --2- 172.21.15.178:0/1089041356 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2e4036b40 0x7fe2e4039000 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc064c10 tx=0x7fe3fc064ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 -- 172.21.15.178:0/1089041356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2982551c0 msgr2=0x55b2982555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.866+0000 7fe410539800 1 --2- 172.21.15.178:0/1089041356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2982551c0 0x55b2982555e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x55b298141500 tx=0x7fe404018830 comp rx=0 tx=0).stop 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 -- 172.21.15.178:0/1089041356 shutdown_connections 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 --2- 172.21.15.178:0/1089041356 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2e4036b40 0x7fe2e4039000 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 --2- 172.21.15.178:0/1089041356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2982551c0 0x55b2982555e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 -- 172.21.15.178:0/1089041356 >> 172.21.15.178:0/1089041356 conn(0x55b29824a150 msgr2=0x55b29824ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 -- 172.21.15.178:0/1089041356 shutdown_connections 2024-09-21T09:03:39.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 -- 172.21.15.178:0/1089041356 wait complete. 2024-09-21T09:03:39.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b298243c60 msgr2=0x55b298246090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b298243c60 0x55b298246090 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b298144720 msgr2=0x55b2982414a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b298144720 0x55b2982414a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2f4036b40 msgr2=0x7fe2f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2f4036b40 0x7fe2f4039000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe400000f60 tx=0x7fe400001370 comp rx=0 tx=0).stop 2024-09-21T09:03:39.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 msgr2=0x55b298141b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b298141b10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc067040 tx=0x7fe3fc002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 shutdown_connections 2024-09-21T09:03:39.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b298243c60 0x55b298246090 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b298144720 0x55b2982414a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe2f4036b40 0x7fe2f4039000 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 --2- 172.21.15.178:0/542077098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2980b5650 0x55b298141b10 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 >> 172.21.15.178:0/542077098 conn(0x55b29813bdb0 msgr2=0x55b29822aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 shutdown_connections 2024-09-21T09:03:39.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.867+0000 7fe410539800 1 -- 172.21.15.178:0/542077098 wait complete. 2024-09-21T09:03:39.877 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-21T09:03:39.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-21T09:03:39.878 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-21T09:03:39.924 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:39.924 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:39.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.923+0000 7ff36340e800 1 Processor -- start 2024-09-21T09:03:39.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.923+0000 7ff36340e800 1 -- start start 2024-09-21T09:03:39.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.923+0000 7ff36340e800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5601c664a4e0 0x5601c664a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.923+0000 7ff36340e800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5601c650ab30 con 0x5601c664ae20 2024-09-21T09:03:39.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.923+0000 7ff36340e800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5601c64ec360 con 0x5601c664a4e0 2024-09-21T09:03:39.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.923+0000 7ff35eb1a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5601c664a4e0 0x5601c664a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.923+0000 7ff357fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5601c664ae20 0x5601c664f9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:45174/0 (socket says 172.21.15.178:45174) 2024-09-21T09:03:39.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.923+0000 7ff357fff640 1 -- 172.21.15.178:0/675697137 learned_addr learned my addr 172.21.15.178:0/675697137 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:03:39.926 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.924+0000 7ff35eb1a640 1 -- 172.21.15.178:0/675697137 >> v1:172.21.15.44:6789/0 conn(0x5601c664ae20 legacy=0x5601c664f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.926 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.924+0000 7ff35eb1a640 1 -- 172.21.15.178:0/675697137 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601c6512e00 con 0x5601c664a4e0 2024-09-21T09:03:39.927 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.926+0000 7ff35eb1a640 1 --2- 172.21.15.178:0/675697137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c664a8e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff35000a470 tx=0x7ff350045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d64757ca736403 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.927 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.926+0000 7ff35e319640 1 -- 172.21.15.178:0/675697137 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff350053570 con 0x5601c664a4e0 2024-09-21T09:03:39.928 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.926+0000 7ff35e319640 1 -- 172.21.15.178:0/675697137 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff350058070 con 0x5601c664a4e0 2024-09-21T09:03:39.928 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.926+0000 7ff35e319640 1 -- 172.21.15.178:0/675697137 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff350053880 con 0x5601c664a4e0 2024-09-21T09:03:39.928 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.926+0000 7ff36340e800 1 -- 172.21.15.178:0/675697137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 msgr2=0x5601c664a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.928 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.926+0000 7ff36340e800 1 --2- 172.21.15.178:0/675697137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c664a8e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff35000a470 tx=0x7ff350045a20 comp rx=0 tx=0).stop 2024-09-21T09:03:39.928 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.926+0000 7ff36340e800 1 -- 172.21.15.178:0/675697137 shutdown_connections 2024-09-21T09:03:39.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.926+0000 7ff36340e800 1 --2- 172.21.15.178:0/675697137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c664a8e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.926+0000 7ff36340e800 1 -- 172.21.15.178:0/675697137 >> 172.21.15.178:0/675697137 conn(0x5601c6645db0 msgr2=0x5601c66481d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.926+0000 7ff36340e800 1 -- 172.21.15.178:0/675697137 shutdown_connections 2024-09-21T09:03:39.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.926+0000 7ff36340e800 1 -- 172.21.15.178:0/675697137 wait complete. 2024-09-21T09:03:39.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.940+0000 7ff36340e800 1 Processor -- start 2024-09-21T09:03:39.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.940+0000 7ff36340e800 1 -- start start 2024-09-21T09:03:39.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.940+0000 7ff36340e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c65bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.940+0000 7ff36340e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5601c6597360 con 0x5601c664a4e0 2024-09-21T09:03:39.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.941+0000 7ff35eb1a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c65bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.941+0000 7ff35eb1a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c65bf5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49708/0 (socket says 172.21.15.178:49708) 2024-09-21T09:03:39.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.941+0000 7ff35eb1a640 1 -- 172.21.15.178:0/281577842 learned_addr learned my addr 172.21.15.178:0/281577842 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.941+0000 7ff35eb1a640 1 -- 172.21.15.178:0/281577842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601c64e4bc0 con 0x5601c664a4e0 2024-09-21T09:03:39.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.941+0000 7ff35eb1a640 1 --2- 172.21.15.178:0/281577842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c65bf5c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff350025c20 tx=0x7ff350051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc796498b9947fcf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.945 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.941+0000 7ff24ce09640 1 -- 172.21.15.178:0/281577842 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff350053ba0 con 0x5601c664a4e0 2024-09-21T09:03:39.945 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.941+0000 7ff24ce09640 1 -- 172.21.15.178:0/281577842 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff350063030 con 0x5601c664a4e0 2024-09-21T09:03:39.945 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.941+0000 7ff24ce09640 1 -- 172.21.15.178:0/281577842 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff350053440 con 0x5601c664a4e0 2024-09-21T09:03:39.945 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.942+0000 7ff36340e800 1 -- 172.21.15.178:0/281577842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 msgr2=0x5601c65bf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.942+0000 7ff36340e800 1 --2- 172.21.15.178:0/281577842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c65bf5c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff350025c20 tx=0x7ff350051000 comp rx=0 tx=0).stop 2024-09-21T09:03:39.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.942+0000 7ff36340e800 1 -- 172.21.15.178:0/281577842 shutdown_connections 2024-09-21T09:03:39.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.942+0000 7ff36340e800 1 --2- 172.21.15.178:0/281577842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c65bf5c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.942+0000 7ff36340e800 1 -- 172.21.15.178:0/281577842 >> 172.21.15.178:0/281577842 conn(0x5601c6645db0 msgr2=0x5601c6735150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.942+0000 7ff36340e800 1 -- 172.21.15.178:0/281577842 shutdown_connections 2024-09-21T09:03:39.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.942+0000 7ff36340e800 1 -- 172.21.15.178:0/281577842 wait complete. 2024-09-21T09:03:39.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.942+0000 7ff36340e800 1 Processor -- start 2024-09-21T09:03:39.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.942+0000 7ff36340e800 1 -- start start 2024-09-21T09:03:39.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.943+0000 7ff36340e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c67443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.943+0000 7ff36340e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5601c6651500 con 0x5601c664a4e0 2024-09-21T09:03:39.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.943+0000 7ff35eb1a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c67443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.943+0000 7ff35eb1a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c67443c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49718/0 (socket says 172.21.15.178:49718) 2024-09-21T09:03:39.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.943+0000 7ff35eb1a640 1 -- 172.21.15.178:0/2634842748 learned_addr learned my addr 172.21.15.178:0/2634842748 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.943+0000 7ff35eb1a640 1 -- 172.21.15.178:0/2634842748 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601c64f8fe0 con 0x5601c664a4e0 2024-09-21T09:03:39.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.943+0000 7ff35eb1a640 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c67443c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x5601c65becc0 tx=0x7ff350002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.944+0000 7ff24b606640 1 -- 172.21.15.178:0/2634842748 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff350078070 con 0x5601c664a4e0 2024-09-21T09:03:39.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.944+0000 7ff24b606640 1 -- 172.21.15.178:0/2634842748 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff350053570 con 0x5601c664a4e0 2024-09-21T09:03:39.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.944+0000 7ff24b606640 1 -- 172.21.15.178:0/2634842748 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff350053850 con 0x5601c664a4e0 2024-09-21T09:03:39.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.944+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601c6744900 con 0x5601c664a4e0 2024-09-21T09:03:39.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.944+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601c6744e80 con 0x5601c664a4e0 2024-09-21T09:03:39.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.944+0000 7ff24b606640 1 -- 172.21.15.178:0/2634842748 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff35007b070 con 0x5601c664a4e0 2024-09-21T09:03:39.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.945+0000 7ff24b606640 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff244036b40 0x7ff244039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.945+0000 7ff24b606640 1 -- 172.21.15.178:0/2634842748 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ff350070070 con 0x5601c664a4e0 2024-09-21T09:03:39.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.945+0000 7ff357fff640 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff244036b40 0x7ff244039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.945+0000 7ff36340e800 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5601c664ae20 0x5601c674b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.945+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c674ba50 con 0x5601c664ae20 2024-09-21T09:03:39.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.945+0000 7ff35f31b640 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5601c664ae20 0x5601c674b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.945+0000 7ff357fff640 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff244036b40 0x7ff244039000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff348000f60 tx=0x7ff3480012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.945+0000 7ff35f31b640 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5601c664ae20 0x5601c674b430 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.946+0000 7ff35f31b640 1 -- 172.21.15.178:0/2634842748 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff35800a4a0 con 0x5601c664ae20 2024-09-21T09:03:39.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.946+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c6748a00 con 0x5601c664ae20 2024-09-21T09:03:39.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.946+0000 7ff35f31b640 1 -- 172.21.15.178:0/2634842748 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff35800a4a0 con 0x5601c664ae20 2024-09-21T09:03:39.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.946+0000 7ff36340e800 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5601c674dda0 0x5601c6750190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.946+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c6750880 con 0x5601c674dda0 2024-09-21T09:03:39.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.946+0000 7ff35eb1a640 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5601c674dda0 0x5601c6750190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.947+0000 7ff35eb1a640 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5601c674dda0 0x5601c6750190 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.947+0000 7ff35eb1a640 1 -- 172.21.15.178:0/2634842748 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff35007a030 con 0x5601c674dda0 2024-09-21T09:03:39.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.947+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c674cb80 con 0x5601c664ae20 2024-09-21T09:03:39.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.947+0000 7ff35f31b640 1 -- 172.21.15.178:0/2634842748 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff35800a4a0 con 0x5601c664ae20 2024-09-21T09:03:39.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.947+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c674d060 con 0x5601c664ae20 2024-09-21T09:03:39.951 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.948+0000 7ff35f31b640 1 -- 172.21.15.178:0/2634842748 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff35800a4a0 con 0x5601c664ae20 2024-09-21T09:03:39.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.948+0000 7ff36340e800 1 Processor -- start 2024-09-21T09:03:39.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.948+0000 7ff36340e800 1 -- start start 2024-09-21T09:03:39.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.948+0000 7ff36340e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c675f160 0x5601c675f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.948+0000 7ff36340e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5601c64e6580 con 0x5601c675f160 2024-09-21T09:03:39.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.948+0000 7ff35f31b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c675f160 0x5601c675f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.948+0000 7ff35f31b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c675f160 0x5601c675f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49722/0 (socket says 172.21.15.178:49722) 2024-09-21T09:03:39.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.948+0000 7ff35f31b640 1 -- 172.21.15.178:0/2580645947 learned_addr learned my addr 172.21.15.178:0/2580645947 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.948+0000 7ff35f31b640 1 -- 172.21.15.178:0/2580645947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601c675fac0 con 0x5601c675f160 2024-09-21T09:03:39.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.949+0000 7ff35f31b640 1 --2- 172.21.15.178:0/2580645947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c675f160 0x5601c675f580 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x5601c674be50 tx=0x7ff358018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.949+0000 7ff248e01640 1 -- 172.21.15.178:0/2580645947 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff358014450 con 0x5601c675f160 2024-09-21T09:03:39.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.949+0000 7ff248e01640 1 -- 172.21.15.178:0/2580645947 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff358014610 con 0x5601c675f160 2024-09-21T09:03:39.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.949+0000 7ff36340e800 1 -- 172.21.15.178:0/2580645947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601c675fd50 con 0x5601c675f160 2024-09-21T09:03:39.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.949+0000 7ff248e01640 1 -- 172.21.15.178:0/2580645947 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff358014930 con 0x5601c675f160 2024-09-21T09:03:39.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.949+0000 7ff36340e800 1 -- 172.21.15.178:0/2580645947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601c6762a30 con 0x5601c675f160 2024-09-21T09:03:39.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.949+0000 7ff248e01640 1 -- 172.21.15.178:0/2580645947 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff358011040 con 0x5601c675f160 2024-09-21T09:03:39.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.950+0000 7ff248e01640 1 --2- 172.21.15.178:0/2580645947 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff238036c00 0x7ff2380390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.950+0000 7ff248e01640 1 -- 172.21.15.178:0/2580645947 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ff35801e070 con 0x5601c675f160 2024-09-21T09:03:39.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.950+0000 7ff35eb1a640 1 --2- 172.21.15.178:0/2580645947 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff238036c00 0x7ff2380390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.950+0000 7ff36340e800 1 Processor -- start 2024-09-21T09:03:39.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.950+0000 7ff35eb1a640 1 --2- 172.21.15.178:0/2580645947 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff238036c00 0x7ff2380390c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x5601c674bef0 tx=0x7ff35008ec10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.950+0000 7ff36340e800 1 -- start start 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.950+0000 7ff36340e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c676bdc0 0x5601c676c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.950+0000 7ff36340e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5601c673f9c0 con 0x5601c676bdc0 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.951+0000 7ff35f31b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c676bdc0 0x5601c676c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.951+0000 7ff35f31b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c676bdc0 0x5601c676c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49732/0 (socket says 172.21.15.178:49732) 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.951+0000 7ff35f31b640 1 -- 172.21.15.178:0/4123516098 learned_addr learned my addr 172.21.15.178:0/4123516098 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.951+0000 7ff35f31b640 1 -- 172.21.15.178:0/4123516098 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601c676c790 con 0x5601c676bdc0 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.951+0000 7ff35f31b640 1 --2- 172.21.15.178:0/4123516098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c676bdc0 0x5601c676c1c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff35804cbc0 tx=0x7ff358011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a094fa94a751fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.951+0000 7ff2427fc640 1 -- 172.21.15.178:0/4123516098 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff358040150 con 0x5601c676bdc0 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.951+0000 7ff2427fc640 1 -- 172.21.15.178:0/4123516098 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3580167e0 con 0x5601c676bdc0 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.951+0000 7ff2427fc640 1 -- 172.21.15.178:0/4123516098 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff358014ad0 con 0x5601c676bdc0 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.952+0000 7ff36340e800 1 -- 172.21.15.178:0/4123516098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c676bdc0 msgr2=0x5601c676c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.952+0000 7ff36340e800 1 --2- 172.21.15.178:0/4123516098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c676bdc0 0x5601c676c1c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff35804cbc0 tx=0x7ff358011b10 comp rx=0 tx=0).stop 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.952+0000 7ff36340e800 1 -- 172.21.15.178:0/4123516098 shutdown_connections 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.952+0000 7ff36340e800 1 --2- 172.21.15.178:0/4123516098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c676bdc0 0x5601c676c1c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.952+0000 7ff36340e800 1 -- 172.21.15.178:0/4123516098 >> 172.21.15.178:0/4123516098 conn(0x5601c6768120 msgr2=0x5601c6766220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.952+0000 7ff36340e800 1 -- 172.21.15.178:0/4123516098 shutdown_connections 2024-09-21T09:03:39.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.952+0000 7ff36340e800 1 -- 172.21.15.178:0/4123516098 wait complete. 2024-09-21T09:03:39.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.952+0000 7ff36340e800 1 Processor -- start 2024-09-21T09:03:39.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.952+0000 7ff36340e800 1 -- start start 2024-09-21T09:03:39.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.952+0000 7ff36340e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c676bdc0 0x5601c6773230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.952+0000 7ff36340e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5601c676ce00 con 0x5601c676bdc0 2024-09-21T09:03:39.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.952+0000 7ff35f31b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c676bdc0 0x5601c6773230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.952+0000 7ff35f31b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c676bdc0 0x5601c6773230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49736/0 (socket says 172.21.15.178:49736) 2024-09-21T09:03:39.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.952+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 learned_addr learned my addr 172.21.15.178:0/1012788459 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:39.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.953+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601c6773770 con 0x5601c676bdc0 2024-09-21T09:03:39.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.953+0000 7ff35f31b640 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c676bdc0 0x5601c6773230 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff358013e80 tx=0x7ff35804cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.953+0000 7ff240ff9640 1 -- 172.21.15.178:0/1012788459 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff358011510 con 0x5601c676bdc0 2024-09-21T09:03:39.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.953+0000 7ff240ff9640 1 -- 172.21.15.178:0/1012788459 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3580116b0 con 0x5601c676bdc0 2024-09-21T09:03:39.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.953+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601c6773a00 con 0x5601c676bdc0 2024-09-21T09:03:39.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.953+0000 7ff240ff9640 1 -- 172.21.15.178:0/1012788459 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3580133b0 con 0x5601c676bdc0 2024-09-21T09:03:39.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.953+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601c67766b0 con 0x5601c676bdc0 2024-09-21T09:03:39.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.954+0000 7ff240ff9640 1 -- 172.21.15.178:0/1012788459 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff358013550 con 0x5601c676bdc0 2024-09-21T09:03:39.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.954+0000 7ff240ff9640 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff228036b90 0x7ff228039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.954+0000 7ff240ff9640 1 -- 172.21.15.178:0/1012788459 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ff358033030 con 0x5601c676bdc0 2024-09-21T09:03:39.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.954+0000 7ff35eb1a640 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff228036b90 0x7ff228039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.954+0000 7ff35eb1a640 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff228036b90 0x7ff228039050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff35000a470 tx=0x7ff350093000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.954+0000 7ff36340e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.954+0000 7ff36340e800 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5601c677eee0 0x5601c67813a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.954+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c6781af0 con 0x5601c677eee0 2024-09-21T09:03:39.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff357fff640 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5601c677eee0 0x5601c67813a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff357fff640 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5601c677eee0 0x5601c67813a0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff348009050 con 0x5601c677eee0 2024-09-21T09:03:39.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff36340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff36340e800 20 realm 2024-09-21T09:03:39.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff36340e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c677e330 con 0x5601c677eee0 2024-09-21T09:03:39.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff348009050 con 0x5601c677eee0 2024-09-21T09:03:39.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff36340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff36340e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:39.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff36340e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c67825e0 con 0x5601c677eee0 2024-09-21T09:03:39.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff348009050 con 0x5601c677eee0 2024-09-21T09:03:39.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff36340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.955+0000 7ff36340e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.956+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c6782eb0 con 0x5601c677eee0 2024-09-21T09:03:39.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.956+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff348009050 con 0x5601c677eee0 2024-09-21T09:03:39.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.956+0000 7ff36340e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:39.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.956+0000 7ff36340e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.956+0000 7ff36340e800 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5601c67837f0 0x5601c6785be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.956+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c6786370 con 0x5601c67837f0 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.956+0000 7ff35f31b640 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5601c67837f0 0x5601c6785be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.956+0000 7ff35f31b640 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5601c67837f0 0x5601c6785be0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.957+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.957+0000 7ff36340e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.957+0000 7ff36340e800 20 searching for the correct realm 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.957+0000 7ff36340e800 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5601c6788340 0x5601c678a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.957+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c6788340 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.957+0000 7ff35eb1a640 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5601c6788340 0x5601c678a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.957+0000 7ff35eb1a640 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5601c6788340 0x5601c678a800 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.957+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35007a030 con 0x5601c6788340 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.957+0000 7ff35eb1a640 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff35007d060 0x7ff350004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.957+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x7ff35007d060 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.957+0000 7ff357fff640 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff35007d060 0x7ff350004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:39.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.958+0000 7ff357fff640 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff35007d060 0x7ff350004280 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:39.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.958+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff348009050 con 0x7ff35007d060 2024-09-21T09:03:39.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.958+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c67837f0 2024-09-21T09:03:39.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.958+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.958+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c677eee0 2024-09-21T09:03:39.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.959+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff348009050 con 0x5601c677eee0 2024-09-21T09:03:39.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.959+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c677eee0 2024-09-21T09:03:39.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.959+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff348029040 con 0x5601c677eee0 2024-09-21T09:03:39.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.959+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c67837f0 2024-09-21T09:03:39.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.959+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.959+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c67837f0 2024-09-21T09:03:39.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.960+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.960+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x7ff35007d060 2024-09-21T09:03:39.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.960+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff348029040 con 0x7ff35007d060 2024-09-21T09:03:39.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.960+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c6788340 2024-09-21T09:03:39.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.960+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35007a030 con 0x5601c6788340 2024-09-21T09:03:39.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.960+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c677eee0 2024-09-21T09:03:39.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.960+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff348029040 con 0x5601c677eee0 2024-09-21T09:03:39.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.960+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c67837f0 2024-09-21T09:03:39.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.961+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.961+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c677eee0 2024-09-21T09:03:39.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.961+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff348029040 con 0x5601c677eee0 2024-09-21T09:03:39.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.961+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x7ff35007d060 2024-09-21T09:03:39.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.961+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff348029040 con 0x7ff35007d060 2024-09-21T09:03:39.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.961+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c6788340 2024-09-21T09:03:39.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.961+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35007a030 con 0x5601c6788340 2024-09-21T09:03:39.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.961+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c6788340 2024-09-21T09:03:39.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.961+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35007a030 con 0x5601c6788340 2024-09-21T09:03:39.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.961+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c67837f0 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.962+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.962+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c6788340 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.962+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35007a030 con 0x5601c6788340 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.962+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c6788340 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.962+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35007a030 con 0x5601c6788340 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.962+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c677eee0 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.962+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff348029040 con 0x5601c677eee0 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.962+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c677eee0 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.963+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff348029040 con 0x5601c677eee0 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.963+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c67837f0 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.963+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.963+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c6788340 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.963+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35007a030 con 0x5601c6788340 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.963+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x7ff35007d060 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.963+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff348029040 con 0x7ff35007d060 2024-09-21T09:03:39.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.963+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c677eee0 2024-09-21T09:03:39.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.963+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff348029040 con 0x5601c677eee0 2024-09-21T09:03:39.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.963+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c67837f0 2024-09-21T09:03:39.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.964+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.964+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c6788340 2024-09-21T09:03:39.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.964+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35007a030 con 0x5601c6788340 2024-09-21T09:03:39.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.964+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x7ff35007d060 2024-09-21T09:03:39.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.964+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff348029040 con 0x7ff35007d060 2024-09-21T09:03:39.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.964+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x7ff35007d060 2024-09-21T09:03:39.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.964+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff348029040 con 0x7ff35007d060 2024-09-21T09:03:39.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.965+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c6788340 2024-09-21T09:03:39.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.965+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35007a030 con 0x5601c6788340 2024-09-21T09:03:39.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.965+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c67837f0 2024-09-21T09:03:39.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.965+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.965+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x5601c677eee0 2024-09-21T09:03:39.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff348029040 con 0x5601c677eee0 2024-09-21T09:03:39.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5601c678aed0 con 0x7ff35007d060 2024-09-21T09:03:39.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff348029040 con 0x7ff35007d060 2024-09-21T09:03:39.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff36340e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:39.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff36340e800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:39.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff36340e800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff36340e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff36340e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff36340e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff36340e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c6786d60 con 0x5601c677eee0 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff348029040 con 0x5601c677eee0 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff36340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff36340e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c6787600 con 0x5601c677eee0 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff36340e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff36340e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.966+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c67869a0 con 0x5601c677eee0 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:39.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 20 zone default found 2024-09-21T09:03:39.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 4 Realm: () 2024-09-21T09:03:39.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:39.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:39.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:39.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 20 zonegroup default 2024-09-21T09:03:39.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c678b3e0 con 0x5601c67837f0 2024-09-21T09:03:39.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c678d6b0 con 0x5601c6788340 2024-09-21T09:03:39.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff35007a030 con 0x5601c6788340 2024-09-21T09:03:39.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c678da50 con 0x5601c6788340 2024-09-21T09:03:39.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff35007a030 con 0x5601c6788340 2024-09-21T09:03:39.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:39.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.967+0000 7ff36340e800 20 started sync module instance, tier type = 2024-09-21T09:03:39.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.968+0000 7ff36340e800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:39.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.968+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c678cb40 con 0x7ff35007d060 2024-09-21T09:03:39.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.968+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x7ff35007d060 2024-09-21T09:03:39.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.968+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94565624762480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c678cb40 con 0x7ff35007d060 2024-09-21T09:03:39.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.969+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c678e460 con 0x5601c677eee0 2024-09-21T09:03:39.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.970+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94565624762480] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x7ff35007d060 2024-09-21T09:03:39.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.970+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.970+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94565624766864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c678cb40 con 0x5601c677eee0 2024-09-21T09:03:39.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.970+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c678eeb0 con 0x5601c6788340 2024-09-21T09:03:39.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.971+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94565624766864] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.971+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35007a030 con 0x5601c6788340 2024-09-21T09:03:39.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.971+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94565624759952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c678cab0 con 0x5601c6788340 2024-09-21T09:03:39.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.971+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c678fd70 con 0x7ff35007d060 2024-09-21T09:03:39.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.972+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x7ff35007d060 2024-09-21T09:03:39.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.972+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94565624773280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c67904b0 con 0x7ff35007d060 2024-09-21T09:03:39.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.972+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c6790fd0 con 0x5601c677eee0 2024-09-21T09:03:39.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.973+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94565624759952] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35007a030 con 0x5601c6788340 2024-09-21T09:03:39.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.973+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94565624773280] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x7ff35007d060 2024-09-21T09:03:39.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.973+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.973+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94565624777376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c6790f90 con 0x5601c677eee0 2024-09-21T09:03:39.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.973+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c6791870 con 0x5601c67837f0 2024-09-21T09:03:39.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.974+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.974+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94565624779712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c6790f90 con 0x5601c67837f0 2024-09-21T09:03:39.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.974+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c67923d0 con 0x5601c67837f0 2024-09-21T09:03:39.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.975+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94565624777376] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.975+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94565624779712] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.975+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.975+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94565624780768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c6791ee0 con 0x5601c67837f0 2024-09-21T09:03:39.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.975+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c67928e0 con 0x5601c67837f0 2024-09-21T09:03:39.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.976+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94565624780768] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.976+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.976+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94565624771232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c67928a0 con 0x5601c67837f0 2024-09-21T09:03:39.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.976+0000 7ff36340e800 20 add_watcher() i=0 2024-09-21T09:03:39.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.976+0000 7ff36340e800 20 add_watcher() i=1 2024-09-21T09:03:39.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.976+0000 7ff36340e800 20 add_watcher() i=2 2024-09-21T09:03:39.984 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.976+0000 7ff36340e800 20 add_watcher() i=3 2024-09-21T09:03:39.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.976+0000 7ff36340e800 20 add_watcher() i=4 2024-09-21T09:03:39.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.976+0000 7ff36340e800 20 add_watcher() i=5 2024-09-21T09:03:39.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.976+0000 7ff36340e800 20 add_watcher() i=6 2024-09-21T09:03:39.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.978+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94565624771232] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.978+0000 7ff36340e800 20 add_watcher() i=7 2024-09-21T09:03:39.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.978+0000 7ff36340e800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:39.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.978+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c6795d30 con 0x5601c677eee0 2024-09-21T09:03:39.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.978+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.978+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94565624784320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c6793250 con 0x5601c677eee0 2024-09-21T09:03:39.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.979+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94565624784320] v31'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.979+0000 7ff2157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:39.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.979+0000 7ff36340e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:39.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.979+0000 7ff36340e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:39.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.979+0000 7ff36340e800 5 note: GC not initialized 2024-09-21T09:03:39.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.980+0000 7ff18ffff640 20 reqs_thread_entry: start 2024-09-21T09:03:39.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.980+0000 7ff36340e800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:39.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.980+0000 7ff36340e800 20 Filter name: none 2024-09-21T09:03:39.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.980+0000 7ff18dffb640 20 reqs_thread_entry: start 2024-09-21T09:03:39.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.980+0000 7ff36340e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:39.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.980+0000 7ff36340e800 20 rados->read ofs=0 len=0 2024-09-21T09:03:39.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.980+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c67c9220 con 0x5601c677eee0 2024-09-21T09:03:39.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.980+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.980+0000 7ff36340e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:39.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.980+0000 7ff36340e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:39.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.980+0000 7ff36340e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:39.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.980+0000 7ff36340e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:39.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.980+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c67cf470 con 0x5601c677eee0 2024-09-21T09:03:39.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.981+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v31'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.981+0000 7ff36340e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:39.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.981+0000 7ff36340e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:39.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.982+0000 7ff36340e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:39.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.982+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94565625032272 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5601c67caca0 con 0x5601c677eee0 2024-09-21T09:03:39.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.982+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify (1) cookie 94565624777376 notify 133143986194 ret 0) ==== 621+0+0 (crc 0 0 0) 0x5601c650ab30 con 0x5601c677eee0 2024-09-21T09:03:39.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.982+0000 7ff2427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94565624777376 notifier 4658 bl.length()=579 2024-09-21T09:03:39.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.982+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(64 notify.4 [notify cookie 94565625032272 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.982+0000 7ff2427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:39.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.982+0000 7ff2427fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:39.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.982+0000 7ff2427fc640 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7ff224003ea0 con 0x5601c677eee0 2024-09-21T09:03:39.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.982+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.982+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== watch-notify(notify_complete (2) cookie 94565625032272 notify 133143986194 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff34803ea80 con 0x5601c677eee0 2024-09-21T09:03:39.990 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:39.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.983+0000 7ff2157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:39.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.983+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94565624784320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c67c6fb0 con 0x5601c677eee0 2024-09-21T09:03:39.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.984+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94565624784320] v31'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.984+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94565624762480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c67c6fb0 con 0x7ff35007d060 2024-09-21T09:03:39.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.985+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94565624762480] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x7ff35007d060 2024-09-21T09:03:39.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.985+0000 7ff36340e800 20 remove_watcher() i=0 2024-09-21T09:03:39.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.985+0000 7ff36340e800 2 removed watcher, disabling cache 2024-09-21T09:03:39.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.985+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94565624766864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c67c6fb0 con 0x5601c677eee0 2024-09-21T09:03:39.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.986+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94565624766864] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.986+0000 7ff36340e800 20 remove_watcher() i=1 2024-09-21T09:03:39.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.986+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94565624759952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c67c6fb0 con 0x5601c6788340 2024-09-21T09:03:39.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.988+0000 7ff35eb1a640 1 -- 172.21.15.178:0/1012788459 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94565624759952] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35007a030 con 0x5601c6788340 2024-09-21T09:03:39.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.988+0000 7ff36340e800 20 remove_watcher() i=2 2024-09-21T09:03:39.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.988+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94565624773280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c678c690 con 0x7ff35007d060 2024-09-21T09:03:39.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.989+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94565624773280] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x7ff35007d060 2024-09-21T09:03:39.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.989+0000 7ff36340e800 20 remove_watcher() i=3 2024-09-21T09:03:39.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.989+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94565624777376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c678faa0 con 0x5601c677eee0 2024-09-21T09:03:39.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.990+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94565624777376] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34803d040 con 0x5601c677eee0 2024-09-21T09:03:39.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.990+0000 7ff36340e800 20 remove_watcher() i=4 2024-09-21T09:03:39.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.990+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94565624779712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c678c690 con 0x5601c67837f0 2024-09-21T09:03:39.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.991+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94565624779712] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.991+0000 7ff36340e800 20 remove_watcher() i=5 2024-09-21T09:03:39.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.991+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94565624780768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c6790aa0 con 0x5601c67837f0 2024-09-21T09:03:39.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.992+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94565624780768] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.992+0000 7ff36340e800 20 remove_watcher() i=6 2024-09-21T09:03:39.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.992+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94565624771232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5601c678c690 con 0x5601c67837f0 2024-09-21T09:03:39.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff35f31b640 1 -- 172.21.15.178:0/1012788459 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94565624771232] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35802a070 con 0x5601c67837f0 2024-09-21T09:03:39.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 20 remove_watcher() i=7 2024-09-21T09:03:39.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5601c67837f0 msgr2=0x5601c6785be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5601c67837f0 0x5601c6785be0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5601c677eee0 msgr2=0x5601c67813a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5601c677eee0 0x5601c67813a0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff35007d060 msgr2=0x7ff350004280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff35007d060 0x7ff350004280 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5601c6788340 msgr2=0x5601c678a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5601c6788340 0x5601c678a800 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff228036b90 msgr2=0x7ff228039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff228036b90 0x7ff228039050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff35000a470 tx=0x7ff350093000 comp rx=0 tx=0).stop 2024-09-21T09:03:39.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c676bdc0 msgr2=0x5601c6773230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c676bdc0 0x5601c6773230 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff358013e80 tx=0x7ff35804cb50 comp rx=0 tx=0).stop 2024-09-21T09:03:39.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff357fff640 1 -- 172.21.15.178:0/1012788459 reap_dead start 2024-09-21T09:03:39.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 shutdown_connections 2024-09-21T09:03:39.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 --2- 172.21.15.178:0/1012788459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c676bdc0 0x5601c6773230 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 >> 172.21.15.178:0/1012788459 conn(0x5601c6768120 msgr2=0x5601c67661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 shutdown_connections 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.993+0000 7ff36340e800 1 -- 172.21.15.178:0/1012788459 wait complete. 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 -- 172.21.15.178:0/2580645947 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff238036c00 msgr2=0x7ff2380390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 --2- 172.21.15.178:0/2580645947 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff238036c00 0x7ff2380390c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x5601c674bef0 tx=0x7ff35008ec10 comp rx=0 tx=0).stop 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 -- 172.21.15.178:0/2580645947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c675f160 msgr2=0x5601c675f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 --2- 172.21.15.178:0/2580645947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c675f160 0x5601c675f580 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x5601c674be50 tx=0x7ff358018830 comp rx=0 tx=0).stop 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 -- 172.21.15.178:0/2580645947 shutdown_connections 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 --2- 172.21.15.178:0/2580645947 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff238036c00 0x7ff2380390c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 --2- 172.21.15.178:0/2580645947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c675f160 0x5601c675f580 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 -- 172.21.15.178:0/2580645947 >> 172.21.15.178:0/2580645947 conn(0x5601c67540f0 msgr2=0x5601c6756c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 -- 172.21.15.178:0/2580645947 shutdown_connections 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 -- 172.21.15.178:0/2580645947 wait complete. 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5601c674dda0 msgr2=0x5601c6750190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5601c674dda0 0x5601c6750190 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5601c664ae20 msgr2=0x5601c674b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:39.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5601c664ae20 0x5601c674b430 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff244036b40 msgr2=0x7ff244039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff244036b40 0x7ff244039000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff348000f60 tx=0x7ff3480012b0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 msgr2=0x5601c67443c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c67443c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x5601c65becc0 tx=0x7ff350002fb0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 shutdown_connections 2024-09-21T09:03:40.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5601c674dda0 0x5601c6750190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5601c664ae20 0x5601c674b430 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff244036b40 0x7ff244039000 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 --2- 172.21.15.178:0/2634842748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5601c664a4e0 0x5601c67443c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 >> 172.21.15.178:0/2634842748 conn(0x5601c6645db0 msgr2=0x5601c67339c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:40.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 shutdown_connections 2024-09-21T09:03:40.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:39.994+0000 7ff36340e800 1 -- 172.21.15.178:0/2634842748 wait complete. 2024-09-21T09:03:40.005 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:40.005 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-21T09:03:40.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-21T09:03:40.005 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-21T09:03:40.051 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:40.051 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:40.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.050+0000 7f18df328800 1 Processor -- start 2024-09-21T09:03:40.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.050+0000 7f18df328800 1 -- start start 2024-09-21T09:03:40.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.051+0000 7f18df328800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5556284e49a0 0x5556284e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.051+0000 7f18df328800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55562839fb30 con 0x5556284545b0 2024-09-21T09:03:40.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.051+0000 7f18df328800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x555628381360 con 0x5556284e49a0 2024-09-21T09:03:40.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.051+0000 7f18da81c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5556284e49a0 0x5556284e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.051+0000 7f18da81c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5556284e49a0 0x5556284e6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49746/0 (socket says 172.21.15.178:49746) 2024-09-21T09:03:40.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.051+0000 7f18da81c640 1 -- 172.21.15.178:0/3829537839 learned_addr learned my addr 172.21.15.178:0/3829537839 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:40.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.051+0000 7f18db01d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5556284545b0 0x5556284e3280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:45176/0 (socket says 172.21.15.178:45176) 2024-09-21T09:03:40.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.051+0000 7f18da81c640 1 -- 172.21.15.178:0/3829537839 >> v1:172.21.15.44:6789/0 conn(0x5556284545b0 legacy=0x5556284e3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.051+0000 7f18da81c640 1 -- 172.21.15.178:0/3829537839 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556283a7e00 con 0x5556284e49a0 2024-09-21T09:03:40.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.053+0000 7f18da81c640 1 --2- 172.21.15.178:0/3829537839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284e49a0 0x5556284e6d90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f18d000a520 tx=0x7f18d0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5394dcc5d6027f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.053+0000 7f18da01b640 1 -- 172.21.15.178:0/3829537839 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18d0055070 con 0x5556284e49a0 2024-09-21T09:03:40.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.053+0000 7f18da01b640 1 -- 172.21.15.178:0/3829537839 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d00515b0 con 0x5556284e49a0 2024-09-21T09:03:40.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.053+0000 7f18da01b640 1 -- 172.21.15.178:0/3829537839 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18d00518d0 con 0x5556284e49a0 2024-09-21T09:03:40.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.054+0000 7f18df328800 1 -- 172.21.15.178:0/3829537839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284e49a0 msgr2=0x5556284e6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.054+0000 7f18df328800 1 --2- 172.21.15.178:0/3829537839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284e49a0 0x5556284e6d90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f18d000a520 tx=0x7f18d0045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.054+0000 7f18df328800 1 -- 172.21.15.178:0/3829537839 shutdown_connections 2024-09-21T09:03:40.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.054+0000 7f18df328800 1 --2- 172.21.15.178:0/3829537839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284e49a0 0x5556284e6d90 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.054+0000 7f18df328800 1 -- 172.21.15.178:0/3829537839 >> 172.21.15.178:0/3829537839 conn(0x5556284dadb0 msgr2=0x5556284dd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:40.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.054+0000 7f18df328800 1 -- 172.21.15.178:0/3829537839 shutdown_connections 2024-09-21T09:03:40.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.054+0000 7f18df328800 1 -- 172.21.15.178:0/3829537839 wait complete. 2024-09-21T09:03:40.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.067+0000 7f18df328800 1 Processor -- start 2024-09-21T09:03:40.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.067+0000 7f18df328800 1 -- start start 2024-09-21T09:03:40.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.067+0000 7f18df328800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284545b0 0x5556284e0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.067+0000 7f18df328800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55562842c360 con 0x5556284545b0 2024-09-21T09:03:40.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.068+0000 7f18db01d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284545b0 0x5556284e0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.068+0000 7f18db01d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284545b0 0x5556284e0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49762/0 (socket says 172.21.15.178:49762) 2024-09-21T09:03:40.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.068+0000 7f18db01d640 1 -- 172.21.15.178:0/3448818208 learned_addr learned my addr 172.21.15.178:0/3448818208 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:40.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.068+0000 7f18db01d640 1 -- 172.21.15.178:0/3448818208 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555628379bc0 con 0x5556284545b0 2024-09-21T09:03:40.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.068+0000 7f18db01d640 1 --2- 172.21.15.178:0/3448818208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284545b0 0x5556284e0bb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f18cc001610 tx=0x7f18cc001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c411e5ffd8333d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.068+0000 7f17c960a640 1 -- 172.21.15.178:0/3448818208 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18cc013420 con 0x5556284545b0 2024-09-21T09:03:40.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.068+0000 7f17c960a640 1 -- 172.21.15.178:0/3448818208 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18cc0135c0 con 0x5556284545b0 2024-09-21T09:03:40.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.068+0000 7f17c960a640 1 -- 172.21.15.178:0/3448818208 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18cc0138e0 con 0x5556284545b0 2024-09-21T09:03:40.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.069+0000 7f18df328800 1 -- 172.21.15.178:0/3448818208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284545b0 msgr2=0x5556284e0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.069+0000 7f18df328800 1 --2- 172.21.15.178:0/3448818208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284545b0 0x5556284e0bb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f18cc001610 tx=0x7f18cc001ad0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.069+0000 7f18df328800 1 -- 172.21.15.178:0/3448818208 shutdown_connections 2024-09-21T09:03:40.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.069+0000 7f18df328800 1 --2- 172.21.15.178:0/3448818208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284545b0 0x5556284e0bb0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.069+0000 7f18df328800 1 -- 172.21.15.178:0/3448818208 >> 172.21.15.178:0/3448818208 conn(0x5556284dadb0 msgr2=0x5556285cb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:40.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.069+0000 7f18df328800 1 -- 172.21.15.178:0/3448818208 shutdown_connections 2024-09-21T09:03:40.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.069+0000 7f18df328800 1 -- 172.21.15.178:0/3448818208 wait complete. 2024-09-21T09:03:40.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.069+0000 7f18df328800 1 Processor -- start 2024-09-21T09:03:40.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.070+0000 7f18df328800 1 -- start start 2024-09-21T09:03:40.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.070+0000 7f18df328800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284545b0 0x5556285d9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.070+0000 7f18df328800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5556284e7660 con 0x5556284545b0 2024-09-21T09:03:40.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.070+0000 7f18db01d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284545b0 0x5556285d9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.070+0000 7f18db01d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284545b0 0x5556285d9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49778/0 (socket says 172.21.15.178:49778) 2024-09-21T09:03:40.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.070+0000 7f18db01d640 1 -- 172.21.15.178:0/2034555085 learned_addr learned my addr 172.21.15.178:0/2034555085 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:40.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.070+0000 7f18db01d640 1 -- 172.21.15.178:0/2034555085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55562838dfe0 con 0x5556284545b0 2024-09-21T09:03:40.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.070+0000 7f18db01d640 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284545b0 0x5556285d9460 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f18cc007fd0 tx=0x7f18cc000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.070+0000 7f17c7e07640 1 -- 172.21.15.178:0/2034555085 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18cc022020 con 0x5556284545b0 2024-09-21T09:03:40.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.070+0000 7f17c7e07640 1 -- 172.21.15.178:0/2034555085 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18cc019040 con 0x5556284545b0 2024-09-21T09:03:40.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.070+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556285d99a0 con 0x5556284545b0 2024-09-21T09:03:40.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.071+0000 7f17c7e07640 1 -- 172.21.15.178:0/2034555085 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18cc004a40 con 0x5556284545b0 2024-09-21T09:03:40.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.071+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556285d9ec0 con 0x5556284545b0 2024-09-21T09:03:40.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.071+0000 7f17c7e07640 1 -- 172.21.15.178:0/2034555085 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f18cc025020 con 0x5556284545b0 2024-09-21T09:03:40.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.072+0000 7f17c7e07640 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17c0036b40 0x7f17c0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.072+0000 7f17c7e07640 1 -- 172.21.15.178:0/2034555085 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f18cc04c9c0 con 0x5556284545b0 2024-09-21T09:03:40.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.072+0000 7f18da81c640 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17c0036b40 0x7f17c0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.072+0000 7f18df328800 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5556284e49a0 0x5556285e04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.072+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556285e0a50 con 0x5556284e49a0 2024-09-21T09:03:40.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.072+0000 7f18db81e640 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5556284e49a0 0x5556285e04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.072+0000 7f18da81c640 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17c0036b40 0x7f17c0039000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f18d000a520 tx=0x7f18d0052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.072+0000 7f18db81e640 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5556284e49a0 0x5556285e04d0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.072+0000 7f18db81e640 1 -- 172.21.15.178:0/2034555085 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18d40083e0 con 0x5556284e49a0 2024-09-21T09:03:40.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.072+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556285dda80 con 0x5556284e49a0 2024-09-21T09:03:40.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.073+0000 7f18db81e640 1 -- 172.21.15.178:0/2034555085 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f18d40083e0 con 0x5556284e49a0 2024-09-21T09:03:40.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.073+0000 7f18df328800 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5556285e2d60 0x5556285e5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.073+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556285e5840 con 0x5556285e2d60 2024-09-21T09:03:40.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.073+0000 7f18db01d640 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5556285e2d60 0x5556285e5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.073+0000 7f18db01d640 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5556285e2d60 0x5556285e5150 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.074+0000 7f18db01d640 1 -- 172.21.15.178:0/2034555085 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f18cc00f030 con 0x5556285e2d60 2024-09-21T09:03:40.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.074+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556285e1c00 con 0x5556284e49a0 2024-09-21T09:03:40.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.074+0000 7f18db81e640 1 -- 172.21.15.178:0/2034555085 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f18d40083e0 con 0x5556284e49a0 2024-09-21T09:03:40.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.074+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556285e20a0 con 0x5556284e49a0 2024-09-21T09:03:40.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.074+0000 7f18db81e640 1 -- 172.21.15.178:0/2034555085 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f18d40083e0 con 0x5556284e49a0 2024-09-21T09:03:40.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.074+0000 7f18df328800 1 Processor -- start 2024-09-21T09:03:40.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.074+0000 7f18df328800 1 -- start start 2024-09-21T09:03:40.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.075+0000 7f18df328800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556285f4210 0x5556285f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.075+0000 7f18df328800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55562837b580 con 0x5556285f4210 2024-09-21T09:03:40.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.075+0000 7f18db81e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556285f4210 0x5556285f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.075+0000 7f18db81e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556285f4210 0x5556285f4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49780/0 (socket says 172.21.15.178:49780) 2024-09-21T09:03:40.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.075+0000 7f18db81e640 1 -- 172.21.15.178:0/2032579764 learned_addr learned my addr 172.21.15.178:0/2032579764 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:40.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.075+0000 7f18db81e640 1 -- 172.21.15.178:0/2032579764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556285f4b70 con 0x5556285f4210 2024-09-21T09:03:40.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.075+0000 7f18db81e640 1 --2- 172.21.15.178:0/2032579764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556285f4210 0x5556285f4630 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x5556285da510 tx=0x7f18d400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.075+0000 7f17c5602640 1 -- 172.21.15.178:0/2032579764 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18d4007d00 con 0x5556285f4210 2024-09-21T09:03:40.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.075+0000 7f17c5602640 1 -- 172.21.15.178:0/2032579764 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d401e020 con 0x5556285f4210 2024-09-21T09:03:40.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.075+0000 7f17c5602640 1 -- 172.21.15.178:0/2032579764 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18d4019420 con 0x5556285f4210 2024-09-21T09:03:40.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.075+0000 7f18df328800 1 -- 172.21.15.178:0/2032579764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556285f4e00 con 0x5556285f4210 2024-09-21T09:03:40.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.076+0000 7f18df328800 1 -- 172.21.15.178:0/2032579764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556285f7ae0 con 0x5556285f4210 2024-09-21T09:03:40.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.076+0000 7f17c5602640 1 -- 172.21.15.178:0/2032579764 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f18d4016040 con 0x5556285f4210 2024-09-21T09:03:40.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.076+0000 7f17c5602640 1 --2- 172.21.15.178:0/2032579764 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17b4036b90 0x7f17b4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.076+0000 7f17c5602640 1 -- 172.21.15.178:0/2032579764 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f18d401f030 con 0x5556285f4210 2024-09-21T09:03:40.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.076+0000 7f18db01d640 1 --2- 172.21.15.178:0/2032579764 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17b4036b90 0x7f17b4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.077+0000 7f18df328800 1 Processor -- start 2024-09-21T09:03:40.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.077+0000 7f18db01d640 1 --2- 172.21.15.178:0/2032579764 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17b4036b90 0x7f17b4039050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x5556285e0ed0 tx=0x7f18cc004cf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.077+0000 7f18df328800 1 -- start start 2024-09-21T09:03:40.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.077+0000 7f18df328800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555628600df0 0x5556286011f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.077+0000 7f18df328800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5556284df280 con 0x555628600df0 2024-09-21T09:03:40.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.077+0000 7f18db81e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555628600df0 0x5556286011f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.077+0000 7f18db81e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555628600df0 0x5556286011f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49784/0 (socket says 172.21.15.178:49784) 2024-09-21T09:03:40.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.077+0000 7f18db81e640 1 -- 172.21.15.178:0/4049832236 learned_addr learned my addr 172.21.15.178:0/4049832236 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:40.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.077+0000 7f18db81e640 1 -- 172.21.15.178:0/4049832236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556286017c0 con 0x555628600df0 2024-09-21T09:03:40.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.078+0000 7f18db81e640 1 --2- 172.21.15.178:0/4049832236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555628600df0 0x5556286011f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f18d4022470 tx=0x7f18d4017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb02ecfb6e20f666 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.078+0000 7f17beffd640 1 -- 172.21.15.178:0/4049832236 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18d401d030 con 0x555628600df0 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.078+0000 7f17beffd640 1 -- 172.21.15.178:0/4049832236 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d4015d00 con 0x555628600df0 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.078+0000 7f17beffd640 1 -- 172.21.15.178:0/4049832236 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18d40197a0 con 0x555628600df0 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.078+0000 7f18df328800 1 -- 172.21.15.178:0/4049832236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555628600df0 msgr2=0x5556286011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.078+0000 7f18df328800 1 --2- 172.21.15.178:0/4049832236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555628600df0 0x5556286011f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f18d4022470 tx=0x7f18d4017fa0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.078+0000 7f18df328800 1 -- 172.21.15.178:0/4049832236 shutdown_connections 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.078+0000 7f18df328800 1 --2- 172.21.15.178:0/4049832236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555628600df0 0x5556286011f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.078+0000 7f18df328800 1 -- 172.21.15.178:0/4049832236 >> 172.21.15.178:0/4049832236 conn(0x5556285fd190 msgr2=0x5556285fb290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.078+0000 7f18df328800 1 -- 172.21.15.178:0/4049832236 shutdown_connections 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.078+0000 7f18df328800 1 -- 172.21.15.178:0/4049832236 wait complete. 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.079+0000 7f18df328800 1 Processor -- start 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.079+0000 7f18df328800 1 -- start start 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.079+0000 7f18df328800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555628600df0 0x555628608290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.079+0000 7f18df328800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555628601de0 con 0x555628600df0 2024-09-21T09:03:40.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.079+0000 7f18db81e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555628600df0 0x555628608290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.079+0000 7f18db81e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555628600df0 0x555628608290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49800/0 (socket says 172.21.15.178:49800) 2024-09-21T09:03:40.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.079+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 learned_addr learned my addr 172.21.15.178:0/2591912473 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:40.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.079+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556286087d0 con 0x555628600df0 2024-09-21T09:03:40.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.079+0000 7f18db81e640 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555628600df0 0x555628608290 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f18d404be00 tx=0x7f18d404ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.080+0000 7f17bd7fa640 1 -- 172.21.15.178:0/2591912473 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18d4019b20 con 0x555628600df0 2024-09-21T09:03:40.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.080+0000 7f17bd7fa640 1 -- 172.21.15.178:0/2591912473 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d40153e0 con 0x555628600df0 2024-09-21T09:03:40.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.080+0000 7f17bd7fa640 1 -- 172.21.15.178:0/2591912473 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18d4019cc0 con 0x555628600df0 2024-09-21T09:03:40.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.080+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555628608a60 con 0x555628600df0 2024-09-21T09:03:40.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.080+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55562860b710 con 0x555628600df0 2024-09-21T09:03:40.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.080+0000 7f17bd7fa640 1 -- 172.21.15.178:0/2591912473 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f18d402b350 con 0x555628600df0 2024-09-21T09:03:40.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.081+0000 7f17bd7fa640 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17a4036b10 0x7f17a4038fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.081+0000 7f17bd7fa640 1 -- 172.21.15.178:0/2591912473 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f18d4043ba0 con 0x555628600df0 2024-09-21T09:03:40.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.081+0000 7f18db01d640 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17a4036b10 0x7f17a4038fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.081+0000 7f18db01d640 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17a4036b10 0x7f17a4038fd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0106e0 tx=0x7f18cc042000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.081+0000 7f18df328800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.081+0000 7f18df328800 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555628613d80 0x555628616240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.081+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555628616990 con 0x555628613d80 2024-09-21T09:03:40.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.081+0000 7f18da81c640 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555628613d80 0x555628616240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18da81c640 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555628613d80 0x555628616240 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18df328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:40.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18df328800 20 realm 2024-09-21T09:03:40.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18df328800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555628616dc0 con 0x555628613d80 2024-09-21T09:03:40.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18df328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:40.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18df328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:40.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18df328800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555628617690 con 0x555628613d80 2024-09-21T09:03:40.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18df328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:40.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18df328800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.082+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555628617a30 con 0x555628613d80 2024-09-21T09:03:40.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.083+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.083+0000 7f18df328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:40.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.083+0000 7f18df328800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.083+0000 7f18df328800 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555628618790 0x55562861ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.083+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55562861b1d0 con 0x555628618790 2024-09-21T09:03:40.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.083+0000 7f18db81e640 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555628618790 0x55562861ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.083+0000 7f18db81e640 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555628618790 0x55562861ab80 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.084+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.084+0000 7f18df328800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:40.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.084+0000 7f18df328800 20 searching for the correct realm 2024-09-21T09:03:40.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.084+0000 7f18df328800 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55562861d180 0x55562861f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.084+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x55562861d180 2024-09-21T09:03:40.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.084+0000 7f18db01d640 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55562861d180 0x55562861f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.084+0000 7f18db01d640 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55562861d180 0x55562861f640 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.084+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18cc00f030 con 0x55562861d180 2024-09-21T09:03:40.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.084+0000 7f18db01d640 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f18cc027020 0x7f18cc0494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.084+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x7f18cc027020 2024-09-21T09:03:40.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.084+0000 7f18da81c640 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f18cc027020 0x7f18cc0494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.085+0000 7f18da81c640 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f18cc027020 0x7f18cc0494a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.085+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d0064070 con 0x7f18cc027020 2024-09-21T09:03:40.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.085+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628618790 2024-09-21T09:03:40.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.085+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.085+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628613d80 2024-09-21T09:03:40.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.085+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.085+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628613d80 2024-09-21T09:03:40.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.086+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.086+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628618790 2024-09-21T09:03:40.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.086+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.086+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628618790 2024-09-21T09:03:40.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.086+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.086+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x7f18cc027020 2024-09-21T09:03:40.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.086+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d0064070 con 0x7f18cc027020 2024-09-21T09:03:40.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.086+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x55562861d180 2024-09-21T09:03:40.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.087+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18cc00f030 con 0x55562861d180 2024-09-21T09:03:40.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.087+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628613d80 2024-09-21T09:03:40.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.087+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.087+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628618790 2024-09-21T09:03:40.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.087+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.087+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628613d80 2024-09-21T09:03:40.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.087+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.087+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x7f18cc027020 2024-09-21T09:03:40.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.088+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f18d0064070 con 0x7f18cc027020 2024-09-21T09:03:40.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.088+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x55562861d180 2024-09-21T09:03:40.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.088+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18cc00f030 con 0x55562861d180 2024-09-21T09:03:40.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.088+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x55562861d180 2024-09-21T09:03:40.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.088+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18cc00f030 con 0x55562861d180 2024-09-21T09:03:40.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.088+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628618790 2024-09-21T09:03:40.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.088+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.088+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x55562861d180 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.088+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18cc00f030 con 0x55562861d180 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.088+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x55562861d180 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.089+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18cc00f030 con 0x55562861d180 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.089+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628613d80 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.089+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.089+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628613d80 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.089+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.089+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628618790 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.089+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.089+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x55562861d180 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.090+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18cc00f030 con 0x55562861d180 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.090+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x7f18cc027020 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.090+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d0064070 con 0x7f18cc027020 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.090+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628613d80 2024-09-21T09:03:40.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.090+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.090+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628618790 2024-09-21T09:03:40.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.090+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.090+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x55562861d180 2024-09-21T09:03:40.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.091+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18cc00f030 con 0x55562861d180 2024-09-21T09:03:40.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.091+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x7f18cc027020 2024-09-21T09:03:40.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.091+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d0064070 con 0x7f18cc027020 2024-09-21T09:03:40.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.091+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x7f18cc027020 2024-09-21T09:03:40.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.091+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d0064070 con 0x7f18cc027020 2024-09-21T09:03:40.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.091+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x55562861d180 2024-09-21T09:03:40.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.091+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18cc00f030 con 0x55562861d180 2024-09-21T09:03:40.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.091+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628618790 2024-09-21T09:03:40.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x555628613d80 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55562861fd10 con 0x7f18cc027020 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18d0064070 con 0x7f18cc027020 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18df328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18df328800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18df328800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18df328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18df328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18df328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18df328800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55562861bbc0 con 0x555628613d80 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18df328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18df328800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.092+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55562861c460 con 0x555628613d80 2024-09-21T09:03:40.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:40.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55562861b800 con 0x555628613d80 2024-09-21T09:03:40.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:40.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 20 zone default found 2024-09-21T09:03:40.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 4 Realm: () 2024-09-21T09:03:40.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:40.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:40.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:40.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 20 zonegroup default 2024-09-21T09:03:40.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55562861c0b0 con 0x555628618790 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555628622570 con 0x55562861d180 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f18cc00f030 con 0x55562861d180 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.093+0000 7f18df328800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.094+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555628622910 con 0x55562861d180 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.094+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f18cc00f030 con 0x55562861d180 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.094+0000 7f18df328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.094+0000 7f18df328800 20 started sync module instance, tier type = 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.094+0000 7f18df328800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.094+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628621a00 con 0x7f18cc027020 2024-09-21T09:03:40.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.095+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x7f18cc027020 2024-09-21T09:03:40.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.095+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93828533067600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628621a00 con 0x7f18cc027020 2024-09-21T09:03:40.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.095+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628623320 con 0x555628613d80 2024-09-21T09:03:40.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.096+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93828533067600] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x7f18cc027020 2024-09-21T09:03:40.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.096+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.096+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93828533065520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628623320 con 0x555628613d80 2024-09-21T09:03:40.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.096+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628623d60 con 0x55562861d180 2024-09-21T09:03:40.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.097+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93828533065520] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.097+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18cc00f030 con 0x55562861d180 2024-09-21T09:03:40.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.097+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93828533071472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628623290 con 0x55562861d180 2024-09-21T09:03:40.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.097+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628624c20 con 0x7f18cc027020 2024-09-21T09:03:40.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.098+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93828533071472] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18cc00f030 con 0x55562861d180 2024-09-21T09:03:40.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.098+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x7f18cc027020 2024-09-21T09:03:40.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.098+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93828533077872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628625040 con 0x7f18cc027020 2024-09-21T09:03:40.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.098+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628625a00 con 0x555628613d80 2024-09-21T09:03:40.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.099+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93828533077872] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x7f18cc027020 2024-09-21T09:03:40.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.099+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.099+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93828533079408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628625a00 con 0x555628613d80 2024-09-21T09:03:40.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.100+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556286263c0 con 0x555628618790 2024-09-21T09:03:40.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.100+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.101+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93828533083920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628626c60 con 0x555628618790 2024-09-21T09:03:40.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.101+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93828533079408] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.101+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556286276d0 con 0x555628618790 2024-09-21T09:03:40.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.101+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93828533083920] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.102+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.102+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93828533088672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628626760 con 0x555628618790 2024-09-21T09:03:40.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.102+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628627cb0 con 0x555628618790 2024-09-21T09:03:40.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.103+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93828533088672] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.103+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.103+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93828533081424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628627cb0 con 0x555628618790 2024-09-21T09:03:40.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.103+0000 7f18df328800 20 add_watcher() i=0 2024-09-21T09:03:40.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.103+0000 7f18df328800 20 add_watcher() i=1 2024-09-21T09:03:40.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.103+0000 7f18df328800 20 add_watcher() i=2 2024-09-21T09:03:40.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.103+0000 7f18df328800 20 add_watcher() i=3 2024-09-21T09:03:40.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.103+0000 7f18df328800 20 add_watcher() i=4 2024-09-21T09:03:40.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.103+0000 7f18df328800 20 add_watcher() i=5 2024-09-21T09:03:40.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.103+0000 7f18df328800 20 add_watcher() i=6 2024-09-21T09:03:40.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.103+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93828533081424] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.103+0000 7f18df328800 20 add_watcher() i=7 2024-09-21T09:03:40.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.103+0000 7f18df328800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:40.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.103+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55562862af90 con 0x555628613d80 2024-09-21T09:03:40.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.104+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.104+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93828533090672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628628240 con 0x555628613d80 2024-09-21T09:03:40.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.105+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93828533090672] v31'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.105+0000 7f1791fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:40.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.105+0000 7f18df328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:40.115 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.105+0000 7f18df328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.105+0000 7f18df328800 5 note: GC not initialized 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.105+0000 7f1790fe1640 20 reqs_thread_entry: start 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.105+0000 7f18df328800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.105+0000 7f18df328800 20 Filter name: none 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.105+0000 7f170a7fc640 20 reqs_thread_entry: start 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.106+0000 7f18df328800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.106+0000 7f18df328800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.106+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55562865e380 con 0x555628613d80 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.106+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.106+0000 7f18df328800 20 rados_obj.operate() r=0 bl.length=403 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.106+0000 7f18df328800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.106+0000 7f18df328800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.106+0000 7f18df328800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.106+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628664620 con 0x555628613d80 2024-09-21T09:03:40.116 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.107+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v31'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.107+0000 7f18df328800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:40.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.107+0000 7f18df328800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:40.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.107+0000 7f18df328800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:03:40.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.107+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93828533338080 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55562865fe00 con 0x555628613d80 2024-09-21T09:03:40.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.107+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify (1) cookie 93828533079408 notify 133143986195 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f18d007a040 con 0x555628613d80 2024-09-21T09:03:40.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.107+0000 7f17beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 93828533079408 notifier 4665 bl.length()=567 2024-09-21T09:03:40.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.107+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(64 notify.4 [notify cookie 93828533338080 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.107+0000 7f17beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T09:03:40.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.107+0000 7f17beffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:40.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.107+0000 7f17beffd640 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f17a0003ea0 con 0x555628613d80 2024-09-21T09:03:40.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.108+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== watch-notify(notify_complete (2) cookie 93828533338080 notify 133143986195 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f18d006e040 con 0x555628613d80 2024-09-21T09:03:40.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.108+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.117 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T09:03:16.866974Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:03:16.866961Z","tags":[],"group_ids":[]} 2024-09-21T09:03:40.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.109+0000 7f1791fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:40.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.109+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93828533090672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55562865c0d0 con 0x555628613d80 2024-09-21T09:03:40.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.110+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93828533090672] v31'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.110+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93828533067600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55562865c0d0 con 0x7f18cc027020 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.111+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93828533067600] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x7f18cc027020 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.111+0000 7f18df328800 20 remove_watcher() i=0 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.111+0000 7f18df328800 2 removed watcher, disabling cache 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.111+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93828533065520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55562865c0d0 con 0x555628613d80 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.112+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93828533065520] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.112+0000 7f18df328800 20 remove_watcher() i=1 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.112+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93828533071472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55562865c0d0 con 0x55562861d180 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.113+0000 7f18db01d640 1 -- 172.21.15.178:0/2591912473 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93828533071472] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18cc00f030 con 0x55562861d180 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.113+0000 7f18df328800 20 remove_watcher() i=2 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.113+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93828533077872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628621730 con 0x7f18cc027020 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.114+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93828533077872] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x7f18cc027020 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.114+0000 7f18df328800 20 remove_watcher() i=3 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.114+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93828533079408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628622e70 con 0x555628613d80 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.115+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93828533079408] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d0064070 con 0x555628613d80 2024-09-21T09:03:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.115+0000 7f18df328800 20 remove_watcher() i=4 2024-09-21T09:03:40.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.115+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93828533083920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628624770 con 0x555628618790 2024-09-21T09:03:40.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.116+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93828533083920] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.116+0000 7f18df328800 20 remove_watcher() i=5 2024-09-21T09:03:40.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.116+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93828533088672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628621730 con 0x555628618790 2024-09-21T09:03:40.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.117+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93828533088672] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.117+0000 7f18df328800 20 remove_watcher() i=6 2024-09-21T09:03:40.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.117+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93828533081424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555628622e70 con 0x555628618790 2024-09-21T09:03:40.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18db81e640 1 -- 172.21.15.178:0/2591912473 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93828533081424] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18d4056040 con 0x555628618790 2024-09-21T09:03:40.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 20 remove_watcher() i=7 2024-09-21T09:03:40.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555628618790 msgr2=0x55562861ab80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555628618790 0x55562861ab80 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555628613d80 msgr2=0x555628616240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555628613d80 0x555628616240 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f18cc027020 msgr2=0x7f18cc0494a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f18cc027020 0x7f18cc0494a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55562861d180 msgr2=0x55562861f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55562861d180 0x55562861f640 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17a4036b10 msgr2=0x7f17a4038fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17a4036b10 0x7f17a4038fd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0106e0 tx=0x7f18cc042000 comp rx=0 tx=0).stop 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555628600df0 msgr2=0x555628608290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 --2- 172.21.15.178:0/2591912473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555628600df0 0x555628608290 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f18d404be00 tx=0x7f18d404ce20 comp rx=0 tx=0).stop 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 reap_dead start 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18da81c640 1 -- 172.21.15.178:0/2591912473 reap_dead start 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 shutdown_connections 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 >> 172.21.15.178:0/2591912473 conn(0x5556285fd190 msgr2=0x5556285fb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 shutdown_connections 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2591912473 wait complete. 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2032579764 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17b4036b90 msgr2=0x7f17b4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 --2- 172.21.15.178:0/2032579764 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17b4036b90 0x7f17b4039050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x5556285e0ed0 tx=0x7f18cc004cf0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2032579764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556285f4210 msgr2=0x5556285f4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 --2- 172.21.15.178:0/2032579764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556285f4210 0x5556285f4630 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x5556285da510 tx=0x7f18d400aec0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2032579764 shutdown_connections 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 --2- 172.21.15.178:0/2032579764 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17b4036b90 0x7f17b4039050 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 --2- 172.21.15.178:0/2032579764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556285f4210 0x5556285f4630 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2032579764 >> 172.21.15.178:0/2032579764 conn(0x5556285e91a0 msgr2=0x5556285ebd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2032579764 shutdown_connections 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.118+0000 7f18df328800 1 -- 172.21.15.178:0/2032579764 wait complete. 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5556285e2d60 msgr2=0x5556285e5150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5556285e2d60 0x5556285e5150 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5556284e49a0 msgr2=0x5556285e04d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5556284e49a0 0x5556285e04d0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17c0036b40 msgr2=0x7f17c0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17c0036b40 0x7f17c0039000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f18d000a520 tx=0x7f18d0052000 comp rx=0 tx=0).stop 2024-09-21T09:03:40.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284545b0 msgr2=0x5556285d9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284545b0 0x5556285d9460 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f18cc007fd0 tx=0x7f18cc000f40 comp rx=0 tx=0).stop 2024-09-21T09:03:40.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 shutdown_connections 2024-09-21T09:03:40.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5556285e2d60 0x5556285e5150 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5556284e49a0 0x5556285e04d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f17c0036b40 0x7f17c0039000 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 --2- 172.21.15.178:0/2034555085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556284545b0 0x5556285d9460 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 >> 172.21.15.178:0/2034555085 conn(0x5556284dadb0 msgr2=0x5556285cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:40.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 shutdown_connections 2024-09-21T09:03:40.127 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.119+0000 7f18df328800 1 -- 172.21.15.178:0/2034555085 wait complete. 2024-09-21T09:03:40.129 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T09:03:16.866974Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:03:16.866961Z', 'tags': [], 'group_ids': []} 2024-09-21T09:03:40.138 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:40.139 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-21T09:03:40.139 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-21T09:03:40.139 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-21T09:03:40.183 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:03:40.183 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:03:40.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.182+0000 7f6ca9040800 1 Processor -- start 2024-09-21T09:03:40.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.182+0000 7f6ca9040800 1 -- start start 2024-09-21T09:03:40.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.182+0000 7f6ca9040800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55d8b8bc6ad0 0x55d8b8bc8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.182+0000 7f6ca9040800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d8b8a81b30 con 0x55d8b8bc0a30 2024-09-21T09:03:40.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.182+0000 7f6ca9040800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55d8b8a63360 con 0x55d8b8bc6ad0 2024-09-21T09:03:40.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.182+0000 7f6c9e333640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55d8b8bc6ad0 0x55d8b8bc8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.182+0000 7f6c9e333640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55d8b8bc6ad0 0x55d8b8bc8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49810/0 (socket says 172.21.15.178:49810) 2024-09-21T09:03:40.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.182+0000 7f6c9e333640 1 -- 172.21.15.178:0/867019162 learned_addr learned my addr 172.21.15.178:0/867019162 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:40.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.182+0000 7f6ca6b34640 1 --1- 172.21.15.178:0/867019162 >> v1:172.21.15.44:6789/0 conn(0x55d8b8bc0a30 0x55d8b8bc0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:45180/0 (socket says 172.21.15.178:45180) 2024-09-21T09:03:40.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.183+0000 7f6c9e333640 1 -- 172.21.15.178:0/867019162 >> v1:172.21.15.44:6789/0 conn(0x55d8b8bc0a30 legacy=0x55d8b8bc0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.183+0000 7f6c9e333640 1 -- 172.21.15.178:0/867019162 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b8a89e00 con 0x55d8b8bc6ad0 2024-09-21T09:03:40.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.184+0000 7f6c9e333640 1 --2- 172.21.15.178:0/867019162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc6ad0 0x55d8b8bc8ec0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000a520 tx=0x7f6c90045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e027e31337e94 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.185+0000 7f6ca6333640 1 -- 172.21.15.178:0/867019162 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c90055070 con 0x55d8b8bc6ad0 2024-09-21T09:03:40.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.185+0000 7f6ca6333640 1 -- 172.21.15.178:0/867019162 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c900515b0 con 0x55d8b8bc6ad0 2024-09-21T09:03:40.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.185+0000 7f6ca6333640 1 -- 172.21.15.178:0/867019162 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c900518d0 con 0x55d8b8bc6ad0 2024-09-21T09:03:40.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.185+0000 7f6ca9040800 1 -- 172.21.15.178:0/867019162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc6ad0 msgr2=0x55d8b8bc8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.185+0000 7f6ca9040800 1 --2- 172.21.15.178:0/867019162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc6ad0 0x55d8b8bc8ec0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000a520 tx=0x7f6c90045ba0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.185+0000 7f6ca9040800 1 -- 172.21.15.178:0/867019162 shutdown_connections 2024-09-21T09:03:40.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.185+0000 7f6ca9040800 1 --2- 172.21.15.178:0/867019162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc6ad0 0x55d8b8bc8ec0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.185+0000 7f6ca9040800 1 -- 172.21.15.178:0/867019162 >> 172.21.15.178:0/867019162 conn(0x55d8b8bbc5c0 msgr2=0x55d8b8bbe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:40.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.185+0000 7f6ca9040800 1 -- 172.21.15.178:0/867019162 shutdown_connections 2024-09-21T09:03:40.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.185+0000 7f6ca9040800 1 -- 172.21.15.178:0/867019162 wait complete. 2024-09-21T09:03:40.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.199+0000 7f6ca9040800 1 Processor -- start 2024-09-21T09:03:40.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.199+0000 7f6ca9040800 1 -- start start 2024-09-21T09:03:40.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.199+0000 7f6ca9040800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc0a30 0x55d8b8cb1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.199+0000 7f6ca9040800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d8b8b0e330 con 0x55d8b8bc0a30 2024-09-21T09:03:40.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.199+0000 7f6ca6b34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc0a30 0x55d8b8cb1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.199+0000 7f6ca6b34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc0a30 0x55d8b8cb1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49826/0 (socket says 172.21.15.178:49826) 2024-09-21T09:03:40.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.199+0000 7f6ca6b34640 1 -- 172.21.15.178:0/3690763710 learned_addr learned my addr 172.21.15.178:0/3690763710 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:40.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.200+0000 7f6ca6b34640 1 -- 172.21.15.178:0/3690763710 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b8a5bbc0 con 0x55d8b8bc0a30 2024-09-21T09:03:40.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.200+0000 7f6ca6b34640 1 --2- 172.21.15.178:0/3690763710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc0a30 0x55d8b8cb1840 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6c98001e40 tx=0x7f6c98001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc93df902e29667d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.200+0000 7f6b94e09640 1 -- 172.21.15.178:0/3690763710 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c9800e5c0 con 0x55d8b8bc0a30 2024-09-21T09:03:40.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.200+0000 7f6b94e09640 1 -- 172.21.15.178:0/3690763710 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c98006070 con 0x55d8b8bc0a30 2024-09-21T09:03:40.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.200+0000 7f6b94e09640 1 -- 172.21.15.178:0/3690763710 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c9800e910 con 0x55d8b8bc0a30 2024-09-21T09:03:40.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.201+0000 7f6ca9040800 1 -- 172.21.15.178:0/3690763710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc0a30 msgr2=0x55d8b8cb1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.201+0000 7f6ca9040800 1 --2- 172.21.15.178:0/3690763710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc0a30 0x55d8b8cb1840 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6c98001e40 tx=0x7f6c98001e70 comp rx=0 tx=0).stop 2024-09-21T09:03:40.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.201+0000 7f6ca9040800 1 -- 172.21.15.178:0/3690763710 shutdown_connections 2024-09-21T09:03:40.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.201+0000 7f6ca9040800 1 --2- 172.21.15.178:0/3690763710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc0a30 0x55d8b8cb1840 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.201+0000 7f6ca9040800 1 -- 172.21.15.178:0/3690763710 >> 172.21.15.178:0/3690763710 conn(0x55d8b8bbc5c0 msgr2=0x55d8b8cad200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:40.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.201+0000 7f6ca9040800 1 -- 172.21.15.178:0/3690763710 shutdown_connections 2024-09-21T09:03:40.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.201+0000 7f6ca9040800 1 -- 172.21.15.178:0/3690763710 wait complete. 2024-09-21T09:03:40.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.201+0000 7f6ca9040800 1 Processor -- start 2024-09-21T09:03:40.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.201+0000 7f6ca9040800 1 -- start start 2024-09-21T09:03:40.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.201+0000 7f6ca9040800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc0a30 0x55d8b8bc33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.201+0000 7f6ca9040800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d8b8bc9700 con 0x55d8b8bc0a30 2024-09-21T09:03:40.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.201+0000 7f6ca6b34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc0a30 0x55d8b8bc33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.201+0000 7f6ca6b34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc0a30 0x55d8b8bc33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49842/0 (socket says 172.21.15.178:49842) 2024-09-21T09:03:40.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.201+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1994212671 learned_addr learned my addr 172.21.15.178:0/1994212671 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:40.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.202+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1994212671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b8a6ffe0 con 0x55d8b8bc0a30 2024-09-21T09:03:40.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.202+0000 7f6ca6b34640 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc0a30 0x55d8b8bc33f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6c98000f60 tx=0x7f6c98000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.202+0000 7f6b93606640 1 -- 172.21.15.178:0/1994212671 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c9800f8d0 con 0x55d8b8bc0a30 2024-09-21T09:03:40.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.202+0000 7f6b93606640 1 -- 172.21.15.178:0/1994212671 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9800fa70 con 0x55d8b8bc0a30 2024-09-21T09:03:40.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.202+0000 7f6b93606640 1 -- 172.21.15.178:0/1994212671 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c9800fd90 con 0x55d8b8bc0a30 2024-09-21T09:03:40.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.202+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8b8bc1ae0 con 0x55d8b8bc0a30 2024-09-21T09:03:40.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.202+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b8bc2000 con 0x55d8b8bc0a30 2024-09-21T09:03:40.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.203+0000 7f6b93606640 1 -- 172.21.15.178:0/1994212671 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6c98017070 con 0x55d8b8bc0a30 2024-09-21T09:03:40.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.203+0000 7f6b93606640 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b8c036af0 0x7f6b8c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.203+0000 7f6b93606640 1 -- 172.21.15.178:0/1994212671 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f6c98015020 con 0x55d8b8bc0a30 2024-09-21T09:03:40.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.203+0000 7f6c9e333640 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b8c036af0 0x7f6b8c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.203+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d8b8bc6ad0 0x55d8b8cc2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.203+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8cc2ba0 con 0x55d8b8bc6ad0 2024-09-21T09:03:40.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.203+0000 7f6ca7335640 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d8b8bc6ad0 0x55d8b8cc2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.203+0000 7f6c9e333640 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b8c036af0 0x7f6b8c038fb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6c90057000 tx=0x7f6c90052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.204+0000 7f6ca7335640 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d8b8bc6ad0 0x55d8b8cc2660 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.204+0000 7f6ca7335640 1 -- 172.21.15.178:0/1994212671 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ca000a4a0 con 0x55d8b8bc6ad0 2024-09-21T09:03:40.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.204+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8cc33f0 con 0x55d8b8bc6ad0 2024-09-21T09:03:40.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.204+0000 7f6ca7335640 1 -- 172.21.15.178:0/1994212671 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ca000a4a0 con 0x55d8b8bc6ad0 2024-09-21T09:03:40.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.204+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d8b8cc4e20 0x55d8b8cc7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.204+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8cc7a20 con 0x55d8b8cc4e20 2024-09-21T09:03:40.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.204+0000 7f6ca6b34640 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d8b8cc4e20 0x55d8b8cc7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.205+0000 7f6ca6b34640 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d8b8cc4e20 0x55d8b8cc7290 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.205+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1994212671 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cc4e20 2024-09-21T09:03:40.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.205+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8cc3c40 con 0x55d8b8bc6ad0 2024-09-21T09:03:40.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.205+0000 7f6ca7335640 1 -- 172.21.15.178:0/1994212671 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ca000a4a0 con 0x55d8b8bc6ad0 2024-09-21T09:03:40.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.205+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8cc4060 con 0x55d8b8bc6ad0 2024-09-21T09:03:40.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.206+0000 7f6ca7335640 1 -- 172.21.15.178:0/1994212671 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6ca000a4a0 con 0x55d8b8bc6ad0 2024-09-21T09:03:40.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.206+0000 7f6ca9040800 1 Processor -- start 2024-09-21T09:03:40.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.206+0000 7f6ca9040800 1 -- start start 2024-09-21T09:03:40.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.206+0000 7f6ca9040800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8cd63a0 0x55d8b8cd67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.206+0000 7f6ca9040800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d8b8bc3930 con 0x55d8b8cd63a0 2024-09-21T09:03:40.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.206+0000 7f6ca7335640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8cd63a0 0x55d8b8cd67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.206+0000 7f6ca7335640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8cd63a0 0x55d8b8cd67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49858/0 (socket says 172.21.15.178:49858) 2024-09-21T09:03:40.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.206+0000 7f6ca7335640 1 -- 172.21.15.178:0/992766582 learned_addr learned my addr 172.21.15.178:0/992766582 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:40.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.206+0000 7f6ca7335640 1 -- 172.21.15.178:0/992766582 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b8cd6d00 con 0x55d8b8cd63a0 2024-09-21T09:03:40.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.207+0000 7f6ca7335640 1 --2- 172.21.15.178:0/992766582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8cd63a0 0x55d8b8cd67c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x55d8b8bc3130 tx=0x7f6ca0012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.207+0000 7f6b90e01640 1 -- 172.21.15.178:0/992766582 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca0014450 con 0x55d8b8cd63a0 2024-09-21T09:03:40.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.207+0000 7f6b90e01640 1 -- 172.21.15.178:0/992766582 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca0014610 con 0x55d8b8cd63a0 2024-09-21T09:03:40.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.207+0000 7f6b90e01640 1 -- 172.21.15.178:0/992766582 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca0014930 con 0x55d8b8cd63a0 2024-09-21T09:03:40.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.207+0000 7f6ca9040800 1 -- 172.21.15.178:0/992766582 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8b8cd6f90 con 0x55d8b8cd63a0 2024-09-21T09:03:40.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.207+0000 7f6ca9040800 1 -- 172.21.15.178:0/992766582 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b8cd9c70 con 0x55d8b8cd63a0 2024-09-21T09:03:40.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.208+0000 7f6b90e01640 1 -- 172.21.15.178:0/992766582 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6ca0011040 con 0x55d8b8cd63a0 2024-09-21T09:03:40.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.208+0000 7f6b90e01640 1 --2- 172.21.15.178:0/992766582 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b80036b90 0x7f6b80039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.208+0000 7f6b90e01640 1 -- 172.21.15.178:0/992766582 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f6ca001e070 con 0x55d8b8cd63a0 2024-09-21T09:03:40.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.208+0000 7f6ca6b34640 1 --2- 172.21.15.178:0/992766582 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b80036b90 0x7f6b80039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.208+0000 7f6ca9040800 1 Processor -- start 2024-09-21T09:03:40.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.208+0000 7f6ca6b34640 1 --2- 172.21.15.178:0/992766582 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b80036b90 0x7f6b80039050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55d8b8bc2570 tx=0x7f6c9804b760 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.208+0000 7f6ca9040800 1 -- start start 2024-09-21T09:03:40.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.208+0000 7f6ca9040800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8ce3020 0x55d8b8ce3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.208+0000 7f6ca9040800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d8b8a5d580 con 0x55d8b8ce3020 2024-09-21T09:03:40.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.209+0000 7f6ca7335640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8ce3020 0x55d8b8ce3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.209+0000 7f6ca7335640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8ce3020 0x55d8b8ce3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49864/0 (socket says 172.21.15.178:49864) 2024-09-21T09:03:40.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.209+0000 7f6ca7335640 1 -- 172.21.15.178:0/1123004975 learned_addr learned my addr 172.21.15.178:0/1123004975 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:40.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.209+0000 7f6ca7335640 1 -- 172.21.15.178:0/1123004975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b8ce39f0 con 0x55d8b8ce3020 2024-09-21T09:03:40.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.209+0000 7f6ca7335640 1 --2- 172.21.15.178:0/1123004975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8ce3020 0x55d8b8ce3420 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6ca004cca0 tx=0x7f6ca00167c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe01d8e05e876914 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.209+0000 7f6b8a7fc640 1 -- 172.21.15.178:0/1123004975 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca0014c00 con 0x55d8b8ce3020 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.209+0000 7f6b8a7fc640 1 -- 172.21.15.178:0/1123004975 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca0014da0 con 0x55d8b8ce3020 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.209+0000 7f6b8a7fc640 1 -- 172.21.15.178:0/1123004975 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca0046bc0 con 0x55d8b8ce3020 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.210+0000 7f6ca9040800 1 -- 172.21.15.178:0/1123004975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8ce3020 msgr2=0x55d8b8ce3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.210+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1123004975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8ce3020 0x55d8b8ce3420 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6ca004cca0 tx=0x7f6ca00167c0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.210+0000 7f6ca9040800 1 -- 172.21.15.178:0/1123004975 shutdown_connections 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.210+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1123004975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8ce3020 0x55d8b8ce3420 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.210+0000 7f6ca9040800 1 -- 172.21.15.178:0/1123004975 >> 172.21.15.178:0/1123004975 conn(0x55d8b8cdf380 msgr2=0x55d8b8cdd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.210+0000 7f6ca9040800 1 -- 172.21.15.178:0/1123004975 shutdown_connections 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.210+0000 7f6ca9040800 1 -- 172.21.15.178:0/1123004975 wait complete. 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.210+0000 7f6ca9040800 1 Processor -- start 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.210+0000 7f6ca9040800 1 -- start start 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.210+0000 7f6ca9040800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8ce3020 0x55d8b8cea310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.210+0000 7f6ca9040800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d8b8ce3f20 con 0x55d8b8ce3020 2024-09-21T09:03:40.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.210+0000 7f6ca7335640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8ce3020 0x55d8b8cea310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.210+0000 7f6ca7335640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8ce3020 0x55d8b8cea310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:49870/0 (socket says 172.21.15.178:49870) 2024-09-21T09:03:40.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.210+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 learned_addr learned my addr 172.21.15.178:0/1491823111 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:03:40.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.211+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b8cea850 con 0x55d8b8ce3020 2024-09-21T09:03:40.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.211+0000 7f6ca7335640 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8ce3020 0x55d8b8cea310 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00117d0 tx=0x7f6ca004cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.211+0000 7f6b88ff9640 1 -- 172.21.15.178:0/1491823111 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca00133b0 con 0x55d8b8ce3020 2024-09-21T09:03:40.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.211+0000 7f6b88ff9640 1 -- 172.21.15.178:0/1491823111 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca0013550 con 0x55d8b8ce3020 2024-09-21T09:03:40.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.211+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8b8ceaae0 con 0x55d8b8ce3020 2024-09-21T09:03:40.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.211+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b8ced790 con 0x55d8b8ce3020 2024-09-21T09:03:40.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.211+0000 7f6b88ff9640 1 -- 172.21.15.178:0/1491823111 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca004e0d0 con 0x55d8b8ce3020 2024-09-21T09:03:40.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.212+0000 7f6b88ff9640 1 -- 172.21.15.178:0/1491823111 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6ca004e270 con 0x55d8b8ce3020 2024-09-21T09:03:40.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.212+0000 7f6b88ff9640 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b70036b40 0x7f6b70039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.212+0000 7f6b88ff9640 1 -- 172.21.15.178:0/1491823111 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f6ca0033030 con 0x55d8b8ce3020 2024-09-21T09:03:40.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.212+0000 7f6ca6b34640 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b70036b40 0x7f6b70039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.212+0000 7f6ca6b34640 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b70036b40 0x7f6b70039000 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c98024410 tx=0x7f6c9804d000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.213+0000 7f6ca9040800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.213+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d8b8cf5e40 0x55d8b8cf8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.213+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8cf8a50 con 0x55d8b8cf5e40 2024-09-21T09:03:40.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.213+0000 7f6c9e333640 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d8b8cf5e40 0x55d8b8cf8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.213+0000 7f6c9e333640 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d8b8cf5e40 0x55d8b8cf8300 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.213+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.213+0000 7f6ca9040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:40.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.213+0000 7f6ca9040800 20 realm 2024-09-21T09:03:40.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.213+0000 7f6ca9040800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.213+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8cf8e20 con 0x55d8b8cf5e40 2024-09-21T09:03:40.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6ca9040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:40.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6ca9040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:03:40.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6ca9040800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8cf96c0 con 0x55d8b8cf5e40 2024-09-21T09:03:40.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6ca9040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6ca9040800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8cf9a60 con 0x55d8b8cf5e40 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6ca9040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6ca9040800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d8b8cfa7c0 0x55d8b8cfcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8cfd180 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.214+0000 7f6ca7335640 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d8b8cfa7c0 0x55d8b8cfcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.215+0000 7f6ca7335640 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d8b8cfa7c0 0x55d8b8cfcbb0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.215+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.215+0000 7f6ca9040800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.215+0000 7f6ca9040800 20 searching for the correct realm 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.215+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d8b8cff180 0x55d8b8d01640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.215+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cff180 2024-09-21T09:03:40.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.215+0000 7f6ca6b34640 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d8b8cff180 0x55d8b8d01640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.216+0000 7f6ca6b34640 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d8b8cff180 0x55d8b8d01640 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.216+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.216+0000 7f6ca6b34640 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6c9800f070 0x7f6c9801d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:03:40.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.216+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x7f6c9800f070 2024-09-21T09:03:40.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.216+0000 7f6c9e333640 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6c9800f070 0x7f6c9801d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:03:40.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.217+0000 7f6c9e333640 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6c9800f070 0x7f6c9801d5f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:03:40.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.217+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.217+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.217+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.217+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cf5e40 2024-09-21T09:03:40.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.217+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.217+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cf5e40 2024-09-21T09:03:40.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.218+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.218+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.218+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.218+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.218+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.218+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x7f6c9800f070 2024-09-21T09:03:40.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.219+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.219+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cff180 2024-09-21T09:03:40.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.219+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.219+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cf5e40 2024-09-21T09:03:40.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.219+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.219+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.219+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.219+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cf5e40 2024-09-21T09:03:40.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.220+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.220+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x7f6c9800f070 2024-09-21T09:03:40.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.220+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.220+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cff180 2024-09-21T09:03:40.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.220+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.220+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cff180 2024-09-21T09:03:40.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.220+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.220+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.221+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.221+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cff180 2024-09-21T09:03:40.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.221+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.221+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cff180 2024-09-21T09:03:40.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.221+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.221+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cf5e40 2024-09-21T09:03:40.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.221+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.221+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cf5e40 2024-09-21T09:03:40.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.222+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.222+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.222+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.222+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cff180 2024-09-21T09:03:40.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.222+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.222+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x7f6c9800f070 2024-09-21T09:03:40.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.223+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.223+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cf5e40 2024-09-21T09:03:40.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.223+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.223+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.223+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.223+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cff180 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.223+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.223+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x7f6c9800f070 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.224+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.224+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x7f6c9800f070 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.224+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.224+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cff180 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.224+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.224+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.225+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.225+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x55d8b8cf5e40 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.225+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.225+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d01d10 con 0x7f6c9800f070 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.225+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.225+0000 7f6ca9040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:03:40.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.225+0000 7f6ca9040800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:03:40.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.225+0000 7f6ca9040800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:03:40.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.225+0000 7f6ca9040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:03:40.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.225+0000 7f6ca9040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:03:40.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.225+0000 7f6ca9040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:03:40.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.225+0000 7f6ca9040800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.225+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8cfe6d0 con 0x55d8b8cf5e40 2024-09-21T09:03:40.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.225+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:40.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8cfd650 con 0x55d8b8cf5e40 2024-09-21T09:03:40.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:03:40.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8cfe010 con 0x55d8b8cf5e40 2024-09-21T09:03:40.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:03:40.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 20 zone default found 2024-09-21T09:03:40.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 4 Realm: () 2024-09-21T09:03:40.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:03:40.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:03:40.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:03:40.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 20 zonegroup default 2024-09-21T09:03:40.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.226+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d02640 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.227+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.227+0000 7f6ca9040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:40.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.227+0000 7f6ca9040800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.227+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d04870 con 0x55d8b8cff180 2024-09-21T09:03:40.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.227+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.227+0000 7f6ca9040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:40.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.227+0000 7f6ca9040800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.227+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d04c10 con 0x55d8b8cff180 2024-09-21T09:03:40.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.227+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.227+0000 7f6ca9040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:03:40.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.227+0000 7f6ca9040800 20 started sync module instance, tier type = 2024-09-21T09:03:40.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.227+0000 7f6ca9040800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:03:40.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.227+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d03cb0 con 0x7f6c9800f070 2024-09-21T09:03:40.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.228+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.228+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94389301952912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d03cb0 con 0x7f6c9800f070 2024-09-21T09:03:40.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.228+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d055d0 con 0x55d8b8cf5e40 2024-09-21T09:03:40.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.229+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94389301952912] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.229+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.229+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94389301957376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d03cb0 con 0x55d8b8cf5e40 2024-09-21T09:03:40.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.229+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d06040 con 0x55d8b8cff180 2024-09-21T09:03:40.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.231+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94389301957376] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.231+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.231+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94389301950464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d03c20 con 0x55d8b8cff180 2024-09-21T09:03:40.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.231+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d06f00 con 0x7f6c9800f070 2024-09-21T09:03:40.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.232+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94389301950464] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.232+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.232+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94389301963344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d07320 con 0x7f6c9800f070 2024-09-21T09:03:40.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.232+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d07bb0 con 0x55d8b8cf5e40 2024-09-21T09:03:40.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.233+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94389301963344] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.233+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.233+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94389301964400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d07740 con 0x55d8b8cf5e40 2024-09-21T09:03:40.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.233+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d08480 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.234+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94389301964400] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.234+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.234+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94389301968848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d08860 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.234+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d09350 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.235+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94389301968848] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.235+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.235+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94389301972512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d09310 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.235+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d09dd0 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.236+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94389301972512] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.236+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.236+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94389301975200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d09d90 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.236+0000 7f6ca9040800 20 add_watcher() i=0 2024-09-21T09:03:40.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.236+0000 7f6ca9040800 20 add_watcher() i=1 2024-09-21T09:03:40.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.236+0000 7f6ca9040800 20 add_watcher() i=2 2024-09-21T09:03:40.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.236+0000 7f6ca9040800 20 add_watcher() i=3 2024-09-21T09:03:40.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.236+0000 7f6ca9040800 20 add_watcher() i=4 2024-09-21T09:03:40.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.236+0000 7f6ca9040800 20 add_watcher() i=5 2024-09-21T09:03:40.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.236+0000 7f6ca9040800 20 add_watcher() i=6 2024-09-21T09:03:40.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.237+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94389301975200] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.237+0000 7f6ca9040800 20 add_watcher() i=7 2024-09-21T09:03:40.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.237+0000 7f6ca9040800 2 all 8 watchers are set, enabling cache 2024-09-21T09:03:40.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.237+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d0d250 con 0x55d8b8cf5e40 2024-09-21T09:03:40.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.238+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.238+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94389301965456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d0a740 con 0x55d8b8cf5e40 2024-09-21T09:03:40.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.238+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94389301965456] v31'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.239+0000 7f6b5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:40.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.239+0000 7f6ca9040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:03:40.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.239+0000 7f6ca9040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:03:40.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.239+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d15d10 con 0x55d8b8cf5e40 2024-09-21T09:03:40.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.240+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.240+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d163c0 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.241+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.241+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d163c0 con 0x55d8b8cff180 2024-09-21T09:03:40.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.242+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.242+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d16e60 con 0x55d8b8cf5e40 2024-09-21T09:03:40.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.243+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'192 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.243+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d13a40 con 0x7f6c9800f070 2024-09-21T09:03:40.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.244+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.244+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d13a40 con 0x55d8b8cff180 2024-09-21T09:03:40.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.245+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'45 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.245+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d17ca0 con 0x55d8b8cf5e40 2024-09-21T09:03:40.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.246+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.246+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d17c70 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.247+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.247+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d17c70 con 0x7f6c9800f070 2024-09-21T09:03:40.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.248+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.248+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cff180 2024-09-21T09:03:40.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.249+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.249+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x7f6c9800f070 2024-09-21T09:03:40.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.250+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.250+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.251+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.251+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x7f6c9800f070 2024-09-21T09:03:40.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.252+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.252+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.253+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.253+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cf5e40 2024-09-21T09:03:40.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.254+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'193 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.254+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cff180 2024-09-21T09:03:40.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.255+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'59 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.255+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x7f6c9800f070 2024-09-21T09:03:40.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.256+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.256+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cff180 2024-09-21T09:03:40.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.257+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.257+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cf5e40 2024-09-21T09:03:40.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.258+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.258+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cf5e40 2024-09-21T09:03:40.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.259+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'194 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.259+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cff180 2024-09-21T09:03:40.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.260+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'60 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.260+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x7f6c9800f070 2024-09-21T09:03:40.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.261+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.261+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cff180 2024-09-21T09:03:40.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.262+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.262+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cff180 2024-09-21T09:03:40.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.263+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.263+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cff180 2024-09-21T09:03:40.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.264+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.264+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cff180 2024-09-21T09:03:40.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.265+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'46 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.265+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.266+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.266+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cff180 2024-09-21T09:03:40.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.267+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.267+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.268+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.268+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cff180 2024-09-21T09:03:40.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.269+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'61 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.269+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.269+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.269+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d180c0 con 0x7f6c9800f070 2024-09-21T09:03:40.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.270+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.271+0000 7f6ad7fff640 20 reqs_thread_entry: start 2024-09-21T09:03:40.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.271+0000 7f6ca9040800 20 init_complete bucket index max shards: 11 2024-09-21T09:03:40.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.271+0000 7f6ca9040800 20 Filter name: none 2024-09-21T09:03:40.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.271+0000 7f6ad5ffb640 20 reqs_thread_entry: start 2024-09-21T09:03:40.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.271+0000 7f6ca9040800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:03:40.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.271+0000 7f6ca9040800 20 rados->read ofs=0 len=0 2024-09-21T09:03:40.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.271+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d43290 con 0x55d8b8cf5e40 2024-09-21T09:03:40.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.271+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.271+0000 7f6ca9040800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:03:40.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.271+0000 7f6ca9040800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:03:40.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.271+0000 7f6ca9040800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:03:40.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.271+0000 7f6ca9040800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:03:40.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.271+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d455a0 con 0x7f6c9800f070 2024-09-21T09:03:40.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.272+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.275 INFO:teuthology.orchestra.run.smithi178.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-21T09:03:40.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.273+0000 7f6b5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:03:40.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.273+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94389301965456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d14b10 con 0x55d8b8cf5e40 2024-09-21T09:03:40.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.274+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94389301965456] v31'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.274+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94389301952912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d07290 con 0x7f6c9800f070 2024-09-21T09:03:40.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.275+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94389301952912] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.275+0000 7f6ca9040800 20 remove_watcher() i=0 2024-09-21T09:03:40.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.275+0000 7f6ca9040800 2 removed watcher, disabling cache 2024-09-21T09:03:40.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.275+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94389301957376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d07290 con 0x55d8b8cf5e40 2024-09-21T09:03:40.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.276+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94389301957376] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.276+0000 7f6ca9040800 20 remove_watcher() i=1 2024-09-21T09:03:40.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.276+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94389301950464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d07290 con 0x55d8b8cff180 2024-09-21T09:03:40.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.277+0000 7f6ca6b34640 1 -- 172.21.15.178:0/1491823111 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94389301950464] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9802e070 con 0x55d8b8cff180 2024-09-21T09:03:40.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.277+0000 7f6ca9040800 20 remove_watcher() i=2 2024-09-21T09:03:40.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.277+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94389301963344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d07290 con 0x7f6c9800f070 2024-09-21T09:03:40.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.278+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.2 v2:172.21.15.178:6816/3267136144 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94389301963344] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x7f6c9800f070 2024-09-21T09:03:40.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.278+0000 7f6ca9040800 20 remove_watcher() i=3 2024-09-21T09:03:40.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.278+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94389301964400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d06a50 con 0x55d8b8cf5e40 2024-09-21T09:03:40.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.279+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94389301964400] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c90057030 con 0x55d8b8cf5e40 2024-09-21T09:03:40.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.279+0000 7f6ca9040800 20 remove_watcher() i=4 2024-09-21T09:03:40.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.279+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94389301968848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d03800 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.280+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94389301968848] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.280+0000 7f6ca9040800 20 remove_watcher() i=5 2024-09-21T09:03:40.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.280+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94389301972512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d03800 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.281+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94389301972512] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.281+0000 7f6ca9040800 20 remove_watcher() i=6 2024-09-21T09:03:40.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.281+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94389301975200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8b8d08e20 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.285 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca7335640 1 -- 172.21.15.178:0/1491823111 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94389301975200] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca002a070 con 0x55d8b8cfa7c0 2024-09-21T09:03:40.285 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 20 remove_watcher() i=7 2024-09-21T09:03:40.285 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d8b8cfa7c0 msgr2=0x55d8b8cfcbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d8b8cfa7c0 0x55d8b8cfcbb0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d8b8cf5e40 msgr2=0x55d8b8cf8300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d8b8cf5e40 0x55d8b8cf8300 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6c9800f070 msgr2=0x7f6c9801d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6c9800f070 0x7f6c9801d5f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d8b8cff180 msgr2=0x55d8b8d01640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d8b8cff180 0x55d8b8d01640 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b70036b40 msgr2=0x7f6b70039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b70036b40 0x7f6b70039000 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c98024410 tx=0x7f6c9804d000 comp rx=0 tx=0).stop 2024-09-21T09:03:40.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8ce3020 msgr2=0x55d8b8cea310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8ce3020 0x55d8b8cea310 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00117d0 tx=0x7f6ca004cc30 comp rx=0 tx=0).stop 2024-09-21T09:03:40.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6c9e333640 1 -- 172.21.15.178:0/1491823111 reap_dead start 2024-09-21T09:03:40.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 shutdown_connections 2024-09-21T09:03:40.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1491823111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8ce3020 0x55d8b8cea310 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 >> 172.21.15.178:0/1491823111 conn(0x55d8b8cdf380 msgr2=0x55d8b8cdd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:40.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 shutdown_connections 2024-09-21T09:03:40.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/1491823111 wait complete. 2024-09-21T09:03:40.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/992766582 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b80036b90 msgr2=0x7f6b80039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 --2- 172.21.15.178:0/992766582 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b80036b90 0x7f6b80039050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55d8b8bc2570 tx=0x7f6c9804b760 comp rx=0 tx=0).stop 2024-09-21T09:03:40.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/992766582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8cd63a0 msgr2=0x55d8b8cd67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 --2- 172.21.15.178:0/992766582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8cd63a0 0x55d8b8cd67c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x55d8b8bc3130 tx=0x7f6ca0012fd0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/992766582 shutdown_connections 2024-09-21T09:03:40.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 --2- 172.21.15.178:0/992766582 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b80036b90 0x7f6b80039050 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 --2- 172.21.15.178:0/992766582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8cd63a0 0x55d8b8cd67c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/992766582 >> 172.21.15.178:0/992766582 conn(0x55d8b8ccb330 msgr2=0x55d8b8ccdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:40.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/992766582 shutdown_connections 2024-09-21T09:03:40.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.282+0000 7f6ca9040800 1 -- 172.21.15.178:0/992766582 wait complete. 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d8b8cc4e20 msgr2=0x55d8b8cc7290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d8b8cc4e20 0x55d8b8cc7290 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d8b8bc6ad0 msgr2=0x55d8b8cc2660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d8b8bc6ad0 0x55d8b8cc2660 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b8c036af0 msgr2=0x7f6b8c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b8c036af0 0x7f6b8c038fb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6c90057000 tx=0x7f6c90052000 comp rx=0 tx=0).stop 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc0a30 msgr2=0x55d8b8bc33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc0a30 0x55d8b8bc33f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6c98000f60 tx=0x7f6c98000bc0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 shutdown_connections 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d8b8cc4e20 0x55d8b8cc7290 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d8b8bc6ad0 0x55d8b8cc2660 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6b8c036af0 0x7f6b8c038fb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 --2- 172.21.15.178:0/1994212671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8b8bc0a30 0x55d8b8bc33f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 >> 172.21.15.178:0/1994212671 conn(0x55d8b8bbc5c0 msgr2=0x55d8b8caba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:03:40.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 shutdown_connections 2024-09-21T09:03:40.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:03:40.283+0000 7f6ca9040800 1 -- 172.21.15.178:0/1994212671 wait complete. 2024-09-21T09:03:40.293 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-21T09:03:40.306 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:03:40.355 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-21T09:04:15.357 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-21T09:04:15.357 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-21T09:04:15.358 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-21T09:04:15.409 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:04:15.410 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:04:15.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.409+0000 7fe100939800 1 Processor -- start 2024-09-21T09:04:15.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.409+0000 7fe100939800 1 -- start start 2024-09-21T09:04:15.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.409+0000 7fe100939800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55b93e74a860 0x55b93e74cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.409+0000 7fe100939800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b93e605b30 con 0x55b93e6b9e90 2024-09-21T09:04:15.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.409+0000 7fe100939800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55b93e5e7360 con 0x55b93e74a860 2024-09-21T09:04:15.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.409+0000 7fe0fbdf4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55b93e74a860 0x55b93e74cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.409+0000 7fe0fc5f5640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55b93e6b9e90 0x55b93e749140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:56322/0 (socket says 172.21.15.178:56322) 2024-09-21T09:04:15.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.409+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/3965208876 learned_addr learned my addr 172.21.15.178:0/3965208876 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:04:15.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.410+0000 7fe0fb5f3640 1 -- 172.21.15.178:0/3965208876 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366467843 0 0) 0x55b93e605b30 con 0x55b93e6b9e90 2024-09-21T09:04:15.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.410+0000 7fe0fb5f3640 1 -- 172.21.15.178:0/3965208876 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0e4001e10 con 0x55b93e6b9e90 2024-09-21T09:04:15.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.410+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/3965208876 >> v1:172.21.15.44:6789/0 conn(0x55b93e6b9e90 legacy=0x55b93e749140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.410+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/3965208876 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93e60de00 con 0x55b93e74a860 2024-09-21T09:04:15.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.412+0000 7fe0fbdf4640 1 --2- 172.21.15.178:0/3965208876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e74a860 0x55b93e74cc70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000a470 tx=0x7fe0f0045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abafed43a746dd4f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.412+0000 7fe0fb5f3640 1 -- 172.21.15.178:0/3965208876 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f0059070 con 0x55b93e74a860 2024-09-21T09:04:15.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.412+0000 7fe0fb5f3640 1 -- 172.21.15.178:0/3965208876 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f0054570 con 0x55b93e74a860 2024-09-21T09:04:15.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.412+0000 7fe0fb5f3640 1 -- 172.21.15.178:0/3965208876 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f0054870 con 0x55b93e74a860 2024-09-21T09:04:15.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.413+0000 7fe100939800 1 -- 172.21.15.178:0/3965208876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e74a860 msgr2=0x55b93e74cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.413+0000 7fe100939800 1 --2- 172.21.15.178:0/3965208876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e74a860 0x55b93e74cc70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000a470 tx=0x7fe0f0045920 comp rx=0 tx=0).stop 2024-09-21T09:04:15.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.413+0000 7fe100939800 1 -- 172.21.15.178:0/3965208876 shutdown_connections 2024-09-21T09:04:15.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.413+0000 7fe100939800 1 --2- 172.21.15.178:0/3965208876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e74a860 0x55b93e74cc70 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.413+0000 7fe100939800 1 -- 172.21.15.178:0/3965208876 >> 172.21.15.178:0/3965208876 conn(0x55b93e740df0 msgr2=0x55b93e743210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.413+0000 7fe100939800 1 -- 172.21.15.178:0/3965208876 shutdown_connections 2024-09-21T09:04:15.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.413+0000 7fe100939800 1 -- 172.21.15.178:0/3965208876 wait complete. 2024-09-21T09:04:15.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.428+0000 7fe100939800 1 Processor -- start 2024-09-21T09:04:15.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.429+0000 7fe100939800 1 -- start start 2024-09-21T09:04:15.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.429+0000 7fe100939800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e6b9e90 0x55b93e8356f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.429+0000 7fe100939800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b93e692330 con 0x55b93e6b9e90 2024-09-21T09:04:15.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.429+0000 7fe0fc5f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e6b9e90 0x55b93e8356f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.429+0000 7fe0fc5f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e6b9e90 0x55b93e8356f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42286/0 (socket says 172.21.15.178:42286) 2024-09-21T09:04:15.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.429+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4078848842 learned_addr learned my addr 172.21.15.178:0/4078848842 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.430+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4078848842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93e5dfbc0 con 0x55b93e6b9e90 2024-09-21T09:04:15.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.430+0000 7fe0fc5f5640 1 --2- 172.21.15.178:0/4078848842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e6b9e90 0x55b93e8356f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec001e30 tx=0x7fe0ec00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d64ecdc6463161b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.430+0000 7fdfea60c640 1 -- 172.21.15.178:0/4078848842 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0ec012020 con 0x55b93e6b9e90 2024-09-21T09:04:15.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.430+0000 7fdfea60c640 1 -- 172.21.15.178:0/4078848842 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ec00e5a0 con 0x55b93e6b9e90 2024-09-21T09:04:15.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.430+0000 7fdfea60c640 1 -- 172.21.15.178:0/4078848842 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0ec00e8e0 con 0x55b93e6b9e90 2024-09-21T09:04:15.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.431+0000 7fe100939800 1 -- 172.21.15.178:0/4078848842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e6b9e90 msgr2=0x55b93e8356f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.431+0000 7fe100939800 1 --2- 172.21.15.178:0/4078848842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e6b9e90 0x55b93e8356f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec001e30 tx=0x7fe0ec00b780 comp rx=0 tx=0).stop 2024-09-21T09:04:15.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.431+0000 7fe100939800 1 -- 172.21.15.178:0/4078848842 shutdown_connections 2024-09-21T09:04:15.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.431+0000 7fe100939800 1 --2- 172.21.15.178:0/4078848842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e6b9e90 0x55b93e8356f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.431+0000 7fe100939800 1 -- 172.21.15.178:0/4078848842 >> 172.21.15.178:0/4078848842 conn(0x55b93e740df0 msgr2=0x55b93e8310b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.431+0000 7fe100939800 1 -- 172.21.15.178:0/4078848842 shutdown_connections 2024-09-21T09:04:15.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.431+0000 7fe100939800 1 -- 172.21.15.178:0/4078848842 wait complete. 2024-09-21T09:04:15.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.431+0000 7fe100939800 1 Processor -- start 2024-09-21T09:04:15.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.431+0000 7fe100939800 1 -- start start 2024-09-21T09:04:15.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.431+0000 7fe100939800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e6b9e90 0x55b93e83d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.431+0000 7fe100939800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b93e74d5f0 con 0x55b93e6b9e90 2024-09-21T09:04:15.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.432+0000 7fe0fc5f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e6b9e90 0x55b93e83d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.432+0000 7fe0fc5f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e6b9e90 0x55b93e83d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42302/0 (socket says 172.21.15.178:42302) 2024-09-21T09:04:15.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.432+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/2528516427 learned_addr learned my addr 172.21.15.178:0/2528516427 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.432+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/2528516427 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93e5f3fe0 con 0x55b93e6b9e90 2024-09-21T09:04:15.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.432+0000 7fe0fc5f5640 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e6b9e90 0x55b93e83d0f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec001e30 tx=0x7fe0ec000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.433+0000 7fdfe8e09640 1 -- 172.21.15.178:0/2528516427 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0ec012030 con 0x55b93e6b9e90 2024-09-21T09:04:15.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.433+0000 7fdfe8e09640 1 -- 172.21.15.178:0/2528516427 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ec001490 con 0x55b93e6b9e90 2024-09-21T09:04:15.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.433+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b93e83d630 con 0x55b93e6b9e90 2024-09-21T09:04:15.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.433+0000 7fdfe8e09640 1 -- 172.21.15.178:0/2528516427 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0ec01a8f0 con 0x55b93e6b9e90 2024-09-21T09:04:15.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.433+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b93e83db50 con 0x55b93e6b9e90 2024-09-21T09:04:15.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.434+0000 7fdfe8e09640 1 -- 172.21.15.178:0/2528516427 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe0ec015020 con 0x55b93e6b9e90 2024-09-21T09:04:15.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.434+0000 7fdfe8e09640 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfe4036b90 0x7fdfe4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.434+0000 7fdfe8e09640 1 -- 172.21.15.178:0/2528516427 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe0ec020030 con 0x55b93e6b9e90 2024-09-21T09:04:15.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.434+0000 7fe0fbdf4640 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfe4036b90 0x7fdfe4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.434+0000 7fe100939800 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b93e74a860 0x55b93e844160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.434+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8446a0 con 0x55b93e74a860 2024-09-21T09:04:15.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.434+0000 7fe0fcdf6640 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b93e74a860 0x55b93e844160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.434+0000 7fe0fbdf4640 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfe4036b90 0x7fdfe4039050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55b93e6b95d0 tx=0x7fe0f0050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.434+0000 7fe0fcdf6640 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b93e74a860 0x55b93e844160 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.435+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/2528516427 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0f400a4a0 con 0x55b93e74a860 2024-09-21T09:04:15.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.435+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e841680 con 0x55b93e74a860 2024-09-21T09:04:15.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.435+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/2528516427 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe0f400a4a0 con 0x55b93e74a860 2024-09-21T09:04:15.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.435+0000 7fe100939800 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b93e846770 0x55b93e848c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.435+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8493c0 con 0x55b93e846770 2024-09-21T09:04:15.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.436+0000 7fe0fc5f5640 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b93e846770 0x55b93e848c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.436+0000 7fe0fc5f5640 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b93e846770 0x55b93e848c30 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.436+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/2528516427 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e846770 2024-09-21T09:04:15.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.436+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e844f80 con 0x55b93e74a860 2024-09-21T09:04:15.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.437+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/2528516427 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe0f400a4a0 con 0x55b93e74a860 2024-09-21T09:04:15.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.437+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8453a0 con 0x55b93e74a860 2024-09-21T09:04:15.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.437+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/2528516427 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe0f400a4a0 con 0x55b93e74a860 2024-09-21T09:04:15.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.437+0000 7fe100939800 1 Processor -- start 2024-09-21T09:04:15.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.438+0000 7fe100939800 1 -- start start 2024-09-21T09:04:15.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.438+0000 7fe100939800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e746af0 0x55b93e745140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.438+0000 7fe100939800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b93e5e1580 con 0x55b93e746af0 2024-09-21T09:04:15.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.438+0000 7fe0fcdf6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e746af0 0x55b93e745140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.441 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.438+0000 7fe0fcdf6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e746af0 0x55b93e745140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42314/0 (socket says 172.21.15.178:42314) 2024-09-21T09:04:15.441 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.438+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/2655162690 learned_addr learned my addr 172.21.15.178:0/2655162690 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.441 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.438+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/2655162690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93e746f10 con 0x55b93e746af0 2024-09-21T09:04:15.443 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.438+0000 7fe0fcdf6640 1 --2- 172.21.15.178:0/2655162690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e746af0 0x55b93e745140 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x55b93e83e1a0 tx=0x7fe0f40188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.443 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.439+0000 7fdfe1ffb640 1 -- 172.21.15.178:0/2655162690 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f4014450 con 0x55b93e746af0 2024-09-21T09:04:15.443 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.439+0000 7fdfe1ffb640 1 -- 172.21.15.178:0/2655162690 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f40145f0 con 0x55b93e746af0 2024-09-21T09:04:15.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.439+0000 7fdfe1ffb640 1 -- 172.21.15.178:0/2655162690 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f40148d0 con 0x55b93e746af0 2024-09-21T09:04:15.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.439+0000 7fe100939800 1 -- 172.21.15.178:0/2655162690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b93e745740 con 0x55b93e746af0 2024-09-21T09:04:15.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.439+0000 7fe100939800 1 -- 172.21.15.178:0/2655162690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b93e745c40 con 0x55b93e746af0 2024-09-21T09:04:15.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.440+0000 7fdfe1ffb640 1 -- 172.21.15.178:0/2655162690 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe0f4011040 con 0x55b93e746af0 2024-09-21T09:04:15.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.440+0000 7fdfe1ffb640 1 --2- 172.21.15.178:0/2655162690 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfd4036b40 0x7fdfd4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.440+0000 7fdfe1ffb640 1 -- 172.21.15.178:0/2655162690 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe0f401e070 con 0x55b93e746af0 2024-09-21T09:04:15.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.440+0000 7fe0fc5f5640 1 --2- 172.21.15.178:0/2655162690 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfd4036b40 0x7fdfd4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.440+0000 7fe100939800 1 Processor -- start 2024-09-21T09:04:15.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.440+0000 7fe0fc5f5640 1 --2- 172.21.15.178:0/2655162690 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfd4036b40 0x7fdfd4039000 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec01af20 tx=0x7fe0ec0189d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.440+0000 7fe100939800 1 -- start start 2024-09-21T09:04:15.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.441+0000 7fe100939800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e866bf0 0x55b93e866ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.441+0000 7fe100939800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b93e835ea0 con 0x55b93e866bf0 2024-09-21T09:04:15.444 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.441+0000 7fe0fcdf6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e866bf0 0x55b93e866ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.441+0000 7fe0fcdf6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e866bf0 0x55b93e866ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42322/0 (socket says 172.21.15.178:42322) 2024-09-21T09:04:15.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.441+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/1124425224 learned_addr learned my addr 172.21.15.178:0/1124425224 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.441+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/1124425224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93e8675c0 con 0x55b93e866bf0 2024-09-21T09:04:15.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.441+0000 7fe0fcdf6640 1 --2- 172.21.15.178:0/1124425224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e866bf0 0x55b93e866ff0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe0f404cbb0 tx=0x7fe0f4011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbcd52d39abfdf3c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.441+0000 7fdfd37fe640 1 -- 172.21.15.178:0/1124425224 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f4013dc0 con 0x55b93e866bf0 2024-09-21T09:04:15.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.442+0000 7fdfd37fe640 1 -- 172.21.15.178:0/1124425224 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f4014a70 con 0x55b93e866bf0 2024-09-21T09:04:15.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.442+0000 7fdfd37fe640 1 -- 172.21.15.178:0/1124425224 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f4014d50 con 0x55b93e866bf0 2024-09-21T09:04:15.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.442+0000 7fe100939800 1 -- 172.21.15.178:0/1124425224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e866bf0 msgr2=0x55b93e866ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.442+0000 7fe100939800 1 --2- 172.21.15.178:0/1124425224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e866bf0 0x55b93e866ff0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe0f404cbb0 tx=0x7fe0f4011970 comp rx=0 tx=0).stop 2024-09-21T09:04:15.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.442+0000 7fe100939800 1 -- 172.21.15.178:0/1124425224 shutdown_connections 2024-09-21T09:04:15.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.442+0000 7fe100939800 1 --2- 172.21.15.178:0/1124425224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e866bf0 0x55b93e866ff0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.442+0000 7fe100939800 1 -- 172.21.15.178:0/1124425224 >> 172.21.15.178:0/1124425224 conn(0x55b93e862f50 msgr2=0x55b93e8610a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.442+0000 7fe100939800 1 -- 172.21.15.178:0/1124425224 shutdown_connections 2024-09-21T09:04:15.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.442+0000 7fe100939800 1 -- 172.21.15.178:0/1124425224 wait complete. 2024-09-21T09:04:15.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.442+0000 7fe100939800 1 Processor -- start 2024-09-21T09:04:15.452 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.442+0000 7fe100939800 1 -- start start 2024-09-21T09:04:15.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.442+0000 7fe100939800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e866bf0 0x55b93e86e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.443+0000 7fe100939800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b93e867b90 con 0x55b93e866bf0 2024-09-21T09:04:15.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.443+0000 7fe0fcdf6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e866bf0 0x55b93e86e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.443+0000 7fe0fcdf6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e866bf0 0x55b93e86e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42330/0 (socket says 172.21.15.178:42330) 2024-09-21T09:04:15.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.443+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 learned_addr learned my addr 172.21.15.178:0/4051691324 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.443+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93e86e580 con 0x55b93e866bf0 2024-09-21T09:04:15.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.443+0000 7fe0fcdf6640 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e866bf0 0x55b93e86e040 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4011be0 tx=0x7fe0f404cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.443+0000 7fdfd1ffb640 1 -- 172.21.15.178:0/4051691324 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f4044030 con 0x55b93e866bf0 2024-09-21T09:04:15.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.443+0000 7fdfd1ffb640 1 -- 172.21.15.178:0/4051691324 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f4022a80 con 0x55b93e866bf0 2024-09-21T09:04:15.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.443+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b93e86e810 con 0x55b93e866bf0 2024-09-21T09:04:15.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.443+0000 7fdfd1ffb640 1 -- 172.21.15.178:0/4051691324 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f4016440 con 0x55b93e866bf0 2024-09-21T09:04:15.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.443+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b93e8714c0 con 0x55b93e866bf0 2024-09-21T09:04:15.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.444+0000 7fdfd1ffb640 1 -- 172.21.15.178:0/4051691324 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe0f404e0d0 con 0x55b93e866bf0 2024-09-21T09:04:15.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.444+0000 7fdfd1ffb640 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfc4036b40 0x7fdfc4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.445+0000 7fdfd1ffb640 1 -- 172.21.15.178:0/4051691324 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe0f4045070 con 0x55b93e866bf0 2024-09-21T09:04:15.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.445+0000 7fe0fc5f5640 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfc4036b40 0x7fdfc4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.445+0000 7fe100939800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.445+0000 7fe100939800 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b93e879d30 0x55b93e87c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.445+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e87c940 con 0x55b93e879d30 2024-09-21T09:04:15.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.445+0000 7fe0fbdf4640 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b93e879d30 0x55b93e87c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.445+0000 7fe0fc5f5640 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfc4036b40 0x7fdfc4039000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55b93e845ae0 tx=0x7fe0ec035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.445+0000 7fe0fbdf4640 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b93e879d30 0x55b93e87c1f0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.445+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 20 realm 2024-09-21T09:04:15.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e87cd70 con 0x55b93e879d30 2024-09-21T09:04:15.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:04:15.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e87d640 con 0x55b93e879d30 2024-09-21T09:04:15.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e87d9e0 con 0x55b93e879d30 2024-09-21T09:04:15.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:15.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b93e87e740 0x55b93e880b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.446+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e881070 con 0x55b93e87e740 2024-09-21T09:04:15.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.447+0000 7fe0fcdf6640 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b93e87e740 0x55b93e880b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.447+0000 7fe0fcdf6640 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b93e87e740 0x55b93e880b30 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.447+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.447+0000 7fe100939800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:04:15.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.447+0000 7fe100939800 20 searching for the correct realm 2024-09-21T09:04:15.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.447+0000 7fe100939800 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55b93e8830f0 0x55b93e8855b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.447+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e8830f0 2024-09-21T09:04:15.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.448+0000 7fe0fc5f5640 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55b93e8830f0 0x55b93e8855b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.448+0000 7fe0fc5f5640 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55b93e8830f0 0x55b93e8855b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.448+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.448+0000 7fe0fc5f5640 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe0ec017050 0x7fe0ec00d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.448+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x7fe0ec017050 2024-09-21T09:04:15.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.448+0000 7fe0fbdf4640 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe0ec017050 0x7fe0ec00d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.448+0000 7fe0fbdf4640 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe0ec017050 0x7fe0ec00d3d0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.449+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.449+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e87e740 2024-09-21T09:04:15.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.449+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.449+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e879d30 2024-09-21T09:04:15.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.449+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.449+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e879d30 2024-09-21T09:04:15.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.450+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.450+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e87e740 2024-09-21T09:04:15.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.450+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.450+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e87e740 2024-09-21T09:04:15.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.450+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.450+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x7fe0ec017050 2024-09-21T09:04:15.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.451+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.451+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e8830f0 2024-09-21T09:04:15.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.451+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.451+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e879d30 2024-09-21T09:04:15.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.451+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.451+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e87e740 2024-09-21T09:04:15.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.452+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.452+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e879d30 2024-09-21T09:04:15.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.452+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.452+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x7fe0ec017050 2024-09-21T09:04:15.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.452+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.452+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e8830f0 2024-09-21T09:04:15.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.452+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.452+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e8830f0 2024-09-21T09:04:15.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.452+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.452+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e87e740 2024-09-21T09:04:15.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.453+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.453+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e8830f0 2024-09-21T09:04:15.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.453+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.453+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e8830f0 2024-09-21T09:04:15.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.453+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.453+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e879d30 2024-09-21T09:04:15.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.454+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.454+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e879d30 2024-09-21T09:04:15.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.454+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.454+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e87e740 2024-09-21T09:04:15.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.454+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.454+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e8830f0 2024-09-21T09:04:15.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.454+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.454+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x7fe0ec017050 2024-09-21T09:04:15.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.455+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.455+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e879d30 2024-09-21T09:04:15.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.455+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.455+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e87e740 2024-09-21T09:04:15.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.455+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.456+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e8830f0 2024-09-21T09:04:15.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.456+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.456+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x7fe0ec017050 2024-09-21T09:04:15.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.456+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.456+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x7fe0ec017050 2024-09-21T09:04:15.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.456+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.456+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e8830f0 2024-09-21T09:04:15.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.456+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.456+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e87e740 2024-09-21T09:04:15.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.457+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.457+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x55b93e879d30 2024-09-21T09:04:15.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.457+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.457+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b93e885c80 con 0x7fe0ec017050 2024-09-21T09:04:15.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.457+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.457+0000 7fe100939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:04:15.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.457+0000 7fe100939800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:04:15.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.457+0000 7fe100939800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:04:15.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.457+0000 7fe100939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:04:15.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.457+0000 7fe100939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:04:15.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.457+0000 7fe100939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:04:15.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.457+0000 7fe100939800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.457+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e881b20 con 0x55b93e879d30 2024-09-21T09:04:15.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e881f70 con 0x55b93e879d30 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e882390 con 0x55b93e879d30 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 20 zone default found 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 4 Realm: () 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 20 zonegroup default 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.458+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e882390 con 0x55b93e87e740 2024-09-21T09:04:15.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.459+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.459+0000 7fe100939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.459+0000 7fe100939800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.459+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e887f90 con 0x55b93e8830f0 2024-09-21T09:04:15.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.459+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.459+0000 7fe100939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.459+0000 7fe100939800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.459+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e888330 con 0x55b93e8830f0 2024-09-21T09:04:15.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.459+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.459+0000 7fe100939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.459+0000 7fe100939800 20 started sync module instance, tier type = 2024-09-21T09:04:15.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.459+0000 7fe100939800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:04:15.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.459+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8873d0 con 0x7fe0ec017050 2024-09-21T09:04:15.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.460+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.460+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94254106441968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8873d0 con 0x7fe0ec017050 2024-09-21T09:04:15.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.460+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e888cf0 con 0x55b93e879d30 2024-09-21T09:04:15.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.461+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94254106441968] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.462+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.462+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94254106446368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8873d0 con 0x55b93e879d30 2024-09-21T09:04:15.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.462+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e889780 con 0x55b93e8830f0 2024-09-21T09:04:15.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.463+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94254106446368] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.463+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.463+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94254106439456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e887340 con 0x55b93e8830f0 2024-09-21T09:04:15.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.463+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88a640 con 0x7fe0ec017050 2024-09-21T09:04:15.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.464+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.464+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94254106452848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88aee0 con 0x7fe0ec017050 2024-09-21T09:04:15.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.464+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88b990 con 0x55b93e879d30 2024-09-21T09:04:15.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.464+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94254106439456] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.465+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94254106452848] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.465+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.465+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94254106450800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88a9c0 con 0x55b93e879d30 2024-09-21T09:04:15.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.466+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88c230 con 0x55b93e87e740 2024-09-21T09:04:15.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.467+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.467+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94254106459520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88a9c0 con 0x55b93e87e740 2024-09-21T09:04:15.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.467+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88d160 con 0x55b93e87e740 2024-09-21T09:04:15.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.467+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94254106450800] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.468+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94254106459520] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.468+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.468+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94254106463312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88c5d0 con 0x55b93e87e740 2024-09-21T09:04:15.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.468+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88d740 con 0x55b93e87e740 2024-09-21T09:04:15.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.469+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94254106463312] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.469+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.469+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94254106457248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88d740 con 0x55b93e87e740 2024-09-21T09:04:15.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.469+0000 7fe100939800 20 add_watcher() i=0 2024-09-21T09:04:15.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.469+0000 7fe100939800 20 add_watcher() i=1 2024-09-21T09:04:15.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.469+0000 7fe100939800 20 add_watcher() i=2 2024-09-21T09:04:15.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.469+0000 7fe100939800 20 add_watcher() i=3 2024-09-21T09:04:15.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.469+0000 7fe100939800 20 add_watcher() i=4 2024-09-21T09:04:15.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.469+0000 7fe100939800 20 add_watcher() i=5 2024-09-21T09:04:15.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.469+0000 7fe100939800 20 add_watcher() i=6 2024-09-21T09:04:15.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.470+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94254106457248] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.470+0000 7fe100939800 20 add_watcher() i=7 2024-09-21T09:04:15.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.470+0000 7fe100939800 2 all 8 watchers are set, enabling cache 2024-09-21T09:04:15.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.470+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8909e0 con 0x55b93e879d30 2024-09-21T09:04:15.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.471+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.471+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94254106465280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88dcd0 con 0x55b93e879d30 2024-09-21T09:04:15.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.472+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94254106465280] v31'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.472+0000 7fdfb27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:15.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.472+0000 7fe100939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:04:15.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.472+0000 7fe100939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:04:15.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.472+0000 7fe100939800 5 note: GC not initialized 2024-09-21T09:04:15.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.472+0000 7fdfb17e2640 20 reqs_thread_entry: start 2024-09-21T09:04:15.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.473+0000 7fe100939800 20 init_complete bucket index max shards: 11 2024-09-21T09:04:15.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.473+0000 7fe100939800 20 Filter name: none 2024-09-21T09:04:15.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.473+0000 7fdf22ffd640 20 reqs_thread_entry: start 2024-09-21T09:04:15.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.473+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c42d0 con 0x55b93e879d30 2024-09-21T09:04:15.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.473+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.473+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c42d0 con 0x7fe0ec017050 2024-09-21T09:04:15.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.473+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.473+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c4290 con 0x55b93e879d30 2024-09-21T09:04:15.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.474+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.474+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c4290 con 0x55b93e8830f0 2024-09-21T09:04:15.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.474+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.474+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c4750 con 0x55b93e8830f0 2024-09-21T09:04:15.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.474+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.474+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c4b60 con 0x55b93e8830f0 2024-09-21T09:04:15.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.474+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.474+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c4b60 con 0x55b93e879d30 2024-09-21T09:04:15.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.474+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.475+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c4b60 con 0x55b93e879d30 2024-09-21T09:04:15.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.475+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.475+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c4b60 con 0x55b93e8830f0 2024-09-21T09:04:15.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.475+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.475+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c4b60 con 0x55b93e8830f0 2024-09-21T09:04:15.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.475+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.475+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c4b60 con 0x55b93e87e740 2024-09-21T09:04:15.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.476+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.476+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e879d30 2024-09-21T09:04:15.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.476+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.476+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x7fe0ec017050 2024-09-21T09:04:15.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.476+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.476+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e8830f0 2024-09-21T09:04:15.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.476+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.477+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e87e740 2024-09-21T09:04:15.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.477+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.477+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e87e740 2024-09-21T09:04:15.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.477+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.477+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e8830f0 2024-09-21T09:04:15.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.477+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.477+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e87e740 2024-09-21T09:04:15.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.478+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.478+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e879d30 2024-09-21T09:04:15.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.478+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.478+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e8830f0 2024-09-21T09:04:15.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.478+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.478+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e87e740 2024-09-21T09:04:15.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.479+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.479+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x7fe0ec017050 2024-09-21T09:04:15.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.479+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.479+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e87e740 2024-09-21T09:04:15.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.479+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.479+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e879d30 2024-09-21T09:04:15.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.479+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.479+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e879d30 2024-09-21T09:04:15.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.480+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.480+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e8830f0 2024-09-21T09:04:15.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.480+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.480+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e879d30 2024-09-21T09:04:15.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.480+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.480+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e879d30 2024-09-21T09:04:15.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.480+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.480+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e8830f0 2024-09-21T09:04:15.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.480+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.480+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e8830f0 2024-09-21T09:04:15.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.481+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.481+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e8830f0 2024-09-21T09:04:15.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.481+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.481+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b93e8c6730 con 0x55b93e87e740 2024-09-21T09:04:15.491 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.481+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.482+0000 7fdfb27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:15.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.482+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94254106465280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88f9c0 con 0x55b93e879d30 2024-09-21T09:04:15.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.483+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94254106465280] v31'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.483+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94254106441968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88d400 con 0x7fe0ec017050 2024-09-21T09:04:15.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.484+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94254106441968] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.484+0000 7fe100939800 20 remove_watcher() i=0 2024-09-21T09:04:15.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.484+0000 7fe100939800 2 removed watcher, disabling cache 2024-09-21T09:04:15.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.484+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94254106446368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88d400 con 0x55b93e879d30 2024-09-21T09:04:15.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.485+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94254106446368] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.485+0000 7fe100939800 20 remove_watcher() i=1 2024-09-21T09:04:15.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.485+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94254106439456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88d400 con 0x55b93e8830f0 2024-09-21T09:04:15.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.486+0000 7fe0fc5f5640 1 -- 172.21.15.178:0/4051691324 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94254106439456] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0ec01ac70 con 0x55b93e8830f0 2024-09-21T09:04:15.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.486+0000 7fe100939800 20 remove_watcher() i=2 2024-09-21T09:04:15.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.486+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94254106452848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e886f20 con 0x7fe0ec017050 2024-09-21T09:04:15.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.487+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94254106452848] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x7fe0ec017050 2024-09-21T09:04:15.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.487+0000 7fe100939800 20 remove_watcher() i=3 2024-09-21T09:04:15.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.487+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94254106450800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88d400 con 0x55b93e879d30 2024-09-21T09:04:15.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.489+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94254106450800] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x55b93e879d30 2024-09-21T09:04:15.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.489+0000 7fe100939800 20 remove_watcher() i=4 2024-09-21T09:04:15.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.489+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94254106459520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e88a370 con 0x55b93e87e740 2024-09-21T09:04:15.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.490+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94254106459520] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.490+0000 7fe100939800 20 remove_watcher() i=5 2024-09-21T09:04:15.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.490+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94254106463312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e886f20 con 0x55b93e87e740 2024-09-21T09:04:15.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.491+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94254106463312] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.491+0000 7fe100939800 20 remove_watcher() i=6 2024-09-21T09:04:15.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.491+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94254106457248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b93e889b70 con 0x55b93e87e740 2024-09-21T09:04:15.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.492+0000 7fe0fcdf6640 1 -- 172.21.15.178:0/4051691324 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94254106457248] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f402a070 con 0x55b93e87e740 2024-09-21T09:04:15.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.492+0000 7fe100939800 20 remove_watcher() i=7 2024-09-21T09:04:15.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b93e87e740 msgr2=0x55b93e880b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b93e87e740 0x55b93e880b30 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b93e879d30 msgr2=0x55b93e87c1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b93e879d30 0x55b93e87c1f0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe0ec017050 msgr2=0x7fe0ec00d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe0ec017050 0x7fe0ec00d3d0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55b93e8830f0 msgr2=0x55b93e8855b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55b93e8830f0 0x55b93e8855b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfc4036b40 msgr2=0x7fdfc4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfc4036b40 0x7fdfc4039000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55b93e845ae0 tx=0x7fe0ec035000 comp rx=0 tx=0).stop 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e866bf0 msgr2=0x55b93e86e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe0fbdf4640 1 -- 172.21.15.178:0/4051691324 reap_dead start 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e866bf0 0x55b93e86e040 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4011be0 tx=0x7fe0f404cb10 comp rx=0 tx=0).stop 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 shutdown_connections 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 --2- 172.21.15.178:0/4051691324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e866bf0 0x55b93e86e040 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 >> 172.21.15.178:0/4051691324 conn(0x55b93e862f50 msgr2=0x55b93e861010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 shutdown_connections 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/4051691324 wait complete. 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/2655162690 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfd4036b40 msgr2=0x7fdfd4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 --2- 172.21.15.178:0/2655162690 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfd4036b40 0x7fdfd4039000 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec01af20 tx=0x7fe0ec0189d0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/2655162690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e746af0 msgr2=0x55b93e745140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 --2- 172.21.15.178:0/2655162690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e746af0 0x55b93e745140 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x55b93e83e1a0 tx=0x7fe0f40188f0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/2655162690 shutdown_connections 2024-09-21T09:04:15.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 --2- 172.21.15.178:0/2655162690 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfd4036b40 0x7fdfd4039000 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 --2- 172.21.15.178:0/2655162690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e746af0 0x55b93e745140 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/2655162690 >> 172.21.15.178:0/2655162690 conn(0x55b93e84cd50 msgr2=0x55b93e84f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/2655162690 shutdown_connections 2024-09-21T09:04:15.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.493+0000 7fe100939800 1 -- 172.21.15.178:0/2655162690 wait complete. 2024-09-21T09:04:15.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b93e846770 msgr2=0x55b93e848c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b93e846770 0x55b93e848c30 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b93e74a860 msgr2=0x55b93e844160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b93e74a860 0x55b93e844160 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfe4036b90 msgr2=0x7fdfe4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfe4036b90 0x7fdfe4039050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55b93e6b95d0 tx=0x7fe0f0050000 comp rx=0 tx=0).stop 2024-09-21T09:04:15.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e6b9e90 msgr2=0x55b93e83d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e6b9e90 0x55b93e83d0f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec001e30 tx=0x7fe0ec000ed0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 shutdown_connections 2024-09-21T09:04:15.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55b93e846770 0x55b93e848c30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55b93e74a860 0x55b93e844160 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdfe4036b90 0x7fdfe4039050 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 --2- 172.21.15.178:0/2528516427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b93e6b9e90 0x55b93e83d0f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 >> 172.21.15.178:0/2528516427 conn(0x55b93e740df0 msgr2=0x55b93e82f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 shutdown_connections 2024-09-21T09:04:15.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.494+0000 7fe100939800 1 -- 172.21.15.178:0/2528516427 wait complete. 2024-09-21T09:04:15.504 INFO:teuthology.orchestra.run.smithi178.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-21T09:04:15.504 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-21T09:04:15.505 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-21T09:04:15.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-21T09:04:15.505 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-21T09:04:15.547 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:04:15.547 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:04:15.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.546+0000 7efebe721800 1 Processor -- start 2024-09-21T09:04:15.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.546+0000 7efebe721800 1 -- start start 2024-09-21T09:04:15.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.546+0000 7efebe721800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x559317c10540 0x559317c10940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.546+0000 7efebe721800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559317ad0b30 con 0x559317c10e80 2024-09-21T09:04:15.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.546+0000 7efebe721800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x559317ab2360 con 0x559317c10540 2024-09-21T09:04:15.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.546+0000 7efeba44e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x559317c10540 0x559317c10940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.546+0000 7efeba44e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x559317c10540 0x559317c10940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42338/0 (socket says 172.21.15.178:42338) 2024-09-21T09:04:15.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.546+0000 7efeba44e640 1 -- 172.21.15.178:0/2603733639 learned_addr learned my addr 172.21.15.178:0/2603733639 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.546+0000 7efeb9c4d640 1 --1- 172.21.15.178:0/2603733639 >> v1:172.21.15.44:6789/0 conn(0x559317c10e80 0x559317c15a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:56326/0 (socket says 172.21.15.178:56326) 2024-09-21T09:04:15.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.547+0000 7efeba44e640 1 -- 172.21.15.178:0/2603733639 >> v1:172.21.15.44:6789/0 conn(0x559317c10e80 legacy=0x559317c15a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.547+0000 7efeba44e640 1 -- 172.21.15.178:0/2603733639 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559317ad8e00 con 0x559317c10540 2024-09-21T09:04:15.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.548+0000 7efeba44e640 1 --2- 172.21.15.178:0/2603733639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10540 0x559317c10940 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7efeb400a6b0 tx=0x7efeb4047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2042344233e18577 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.549+0000 7efeb944c640 1 -- 172.21.15.178:0/2603733639 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb400a200 con 0x559317c10540 2024-09-21T09:04:15.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.549+0000 7efeb944c640 1 -- 172.21.15.178:0/2603733639 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb400a3a0 con 0x559317c10540 2024-09-21T09:04:15.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.549+0000 7efeb944c640 1 -- 172.21.15.178:0/2603733639 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb4008700 con 0x559317c10540 2024-09-21T09:04:15.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.549+0000 7efebe721800 1 -- 172.21.15.178:0/2603733639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10540 msgr2=0x559317c10940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.549+0000 7efebe721800 1 --2- 172.21.15.178:0/2603733639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10540 0x559317c10940 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7efeb400a6b0 tx=0x7efeb4047e30 comp rx=0 tx=0).stop 2024-09-21T09:04:15.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.549+0000 7efebe721800 1 -- 172.21.15.178:0/2603733639 shutdown_connections 2024-09-21T09:04:15.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.549+0000 7efebe721800 1 --2- 172.21.15.178:0/2603733639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10540 0x559317c10940 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.549+0000 7efebe721800 1 -- 172.21.15.178:0/2603733639 >> 172.21.15.178:0/2603733639 conn(0x559317c0bdd0 msgr2=0x559317c0e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.549+0000 7efebe721800 1 -- 172.21.15.178:0/2603733639 shutdown_connections 2024-09-21T09:04:15.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.549+0000 7efebe721800 1 -- 172.21.15.178:0/2603733639 wait complete. 2024-09-21T09:04:15.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.563+0000 7efebe721800 1 Processor -- start 2024-09-21T09:04:15.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.563+0000 7efebe721800 1 -- start start 2024-09-21T09:04:15.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.563+0000 7efebe721800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10540 0x559317d02a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.563+0000 7efebe721800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559317b5d320 con 0x559317c10540 2024-09-21T09:04:15.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.563+0000 7efeba44e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10540 0x559317d02a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.563+0000 7efeba44e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10540 0x559317d02a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42348/0 (socket says 172.21.15.178:42348) 2024-09-21T09:04:15.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.563+0000 7efeba44e640 1 -- 172.21.15.178:0/1348977991 learned_addr learned my addr 172.21.15.178:0/1348977991 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.564+0000 7efeba44e640 1 -- 172.21.15.178:0/1348977991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559317aaabc0 con 0x559317c10540 2024-09-21T09:04:15.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.564+0000 7efeba44e640 1 --2- 172.21.15.178:0/1348977991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10540 0x559317d02a30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efeb4048360 tx=0x7efeb4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dc1800efe92718 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.564+0000 7efda8608640 1 -- 172.21.15.178:0/1348977991 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb4064070 con 0x559317c10540 2024-09-21T09:04:15.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.564+0000 7efda8608640 1 -- 172.21.15.178:0/1348977991 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb404f4c0 con 0x559317c10540 2024-09-21T09:04:15.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.564+0000 7efda8608640 1 -- 172.21.15.178:0/1348977991 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb400a200 con 0x559317c10540 2024-09-21T09:04:15.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.565+0000 7efebe721800 1 -- 172.21.15.178:0/1348977991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10540 msgr2=0x559317d02a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.565+0000 7efebe721800 1 --2- 172.21.15.178:0/1348977991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10540 0x559317d02a30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efeb4048360 tx=0x7efeb4051000 comp rx=0 tx=0).stop 2024-09-21T09:04:15.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.565+0000 7efebe721800 1 -- 172.21.15.178:0/1348977991 shutdown_connections 2024-09-21T09:04:15.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.565+0000 7efebe721800 1 --2- 172.21.15.178:0/1348977991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10540 0x559317d02a30 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.565+0000 7efebe721800 1 -- 172.21.15.178:0/1348977991 >> 172.21.15.178:0/1348977991 conn(0x559317c0bdd0 msgr2=0x559317cf9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.565+0000 7efebe721800 1 -- 172.21.15.178:0/1348977991 shutdown_connections 2024-09-21T09:04:15.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.565+0000 7efebe721800 1 -- 172.21.15.178:0/1348977991 wait complete. 2024-09-21T09:04:15.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.565+0000 7efebe721800 1 Processor -- start 2024-09-21T09:04:15.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.565+0000 7efebe721800 1 -- start start 2024-09-21T09:04:15.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.565+0000 7efebe721800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10e80 0x559317d0a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.565+0000 7efebe721800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559317c17500 con 0x559317c10e80 2024-09-21T09:04:15.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.566+0000 7efeba44e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10e80 0x559317d0a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.566+0000 7efeba44e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10e80 0x559317d0a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42356/0 (socket says 172.21.15.178:42356) 2024-09-21T09:04:15.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.566+0000 7efeba44e640 1 -- 172.21.15.178:0/2439856581 learned_addr learned my addr 172.21.15.178:0/2439856581 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.566+0000 7efeba44e640 1 -- 172.21.15.178:0/2439856581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559317abefe0 con 0x559317c10e80 2024-09-21T09:04:15.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.566+0000 7efeba44e640 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10e80 0x559317d0a620 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efeb4059040 tx=0x7efeb4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.566+0000 7efda6e05640 1 -- 172.21.15.178:0/2439856581 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb406d020 con 0x559317c10e80 2024-09-21T09:04:15.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.567+0000 7efda6e05640 1 -- 172.21.15.178:0/2439856581 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb4065040 con 0x559317c10e80 2024-09-21T09:04:15.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.567+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559317d0ab60 con 0x559317c10e80 2024-09-21T09:04:15.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.567+0000 7efda6e05640 1 -- 172.21.15.178:0/2439856581 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb4064070 con 0x559317c10e80 2024-09-21T09:04:15.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.567+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559317d0b080 con 0x559317c10e80 2024-09-21T09:04:15.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.567+0000 7efda6e05640 1 -- 172.21.15.178:0/2439856581 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efeb404f970 con 0x559317c10e80 2024-09-21T09:04:15.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.568+0000 7efda6e05640 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efda0036b90 0x7efda0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.568+0000 7efda6e05640 1 -- 172.21.15.178:0/2439856581 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7efeb408ede0 con 0x559317c10e80 2024-09-21T09:04:15.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.568+0000 7efeb9c4d640 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efda0036b90 0x7efda0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.568+0000 7efebe721800 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559317d0f680 0x559317d11a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.568+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d11ff0 con 0x559317d0f680 2024-09-21T09:04:15.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.568+0000 7efebac4f640 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559317d0f680 0x559317d11a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.568+0000 7efeb9c4d640 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efda0036b90 0x7efda0039050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efea4000f60 tx=0x7efea4001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.568+0000 7efebac4f640 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559317d0f680 0x559317d11a70 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.569+0000 7efebac4f640 1 -- 172.21.15.178:0/2439856581 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x559317d0f680 2024-09-21T09:04:15.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.569+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d0ec60 con 0x559317d0f680 2024-09-21T09:04:15.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.569+0000 7efebac4f640 1 -- 172.21.15.178:0/2439856581 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efeac00a4a0 con 0x559317d0f680 2024-09-21T09:04:15.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.569+0000 7efebe721800 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559317d14320 0x559317d16710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.569+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d16e00 con 0x559317d14320 2024-09-21T09:04:15.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.569+0000 7efeba44e640 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559317d14320 0x559317d16710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.569+0000 7efeba44e640 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559317d14320 0x559317d16710 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.570+0000 7efeba44e640 1 -- 172.21.15.178:0/2439856581 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efeb406f020 con 0x559317d14320 2024-09-21T09:04:15.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.570+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d131c0 con 0x559317d0f680 2024-09-21T09:04:15.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.570+0000 7efebac4f640 1 -- 172.21.15.178:0/2439856581 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efeac00a4a0 con 0x559317d0f680 2024-09-21T09:04:15.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.570+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d136a0 con 0x559317d0f680 2024-09-21T09:04:15.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.571+0000 7efebac4f640 1 -- 172.21.15.178:0/2439856581 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efeac00a4a0 con 0x559317d0f680 2024-09-21T09:04:15.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.571+0000 7efebe721800 1 Processor -- start 2024-09-21T09:04:15.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.571+0000 7efebe721800 1 -- start start 2024-09-21T09:04:15.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.571+0000 7efebe721800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d25780 0x559317d25ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.571+0000 7efebe721800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559317aac580 con 0x559317d25780 2024-09-21T09:04:15.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.571+0000 7efebac4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d25780 0x559317d25ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.571+0000 7efebac4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d25780 0x559317d25ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42364/0 (socket says 172.21.15.178:42364) 2024-09-21T09:04:15.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.571+0000 7efebac4f640 1 -- 172.21.15.178:0/1895216941 learned_addr learned my addr 172.21.15.178:0/1895216941 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.572+0000 7efebac4f640 1 -- 172.21.15.178:0/1895216941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559317d260e0 con 0x559317d25780 2024-09-21T09:04:15.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.572+0000 7efebac4f640 1 --2- 172.21.15.178:0/1895216941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d25780 0x559317d25ba0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x559317d123d0 tx=0x7efeac018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.572+0000 7efd9ffff640 1 -- 172.21.15.178:0/1895216941 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeac014450 con 0x559317d25780 2024-09-21T09:04:15.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.572+0000 7efd9ffff640 1 -- 172.21.15.178:0/1895216941 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeac014610 con 0x559317d25780 2024-09-21T09:04:15.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.572+0000 7efebe721800 1 -- 172.21.15.178:0/1895216941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559317d26370 con 0x559317d25780 2024-09-21T09:04:15.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.572+0000 7efd9ffff640 1 -- 172.21.15.178:0/1895216941 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeac014930 con 0x559317d25780 2024-09-21T09:04:15.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.572+0000 7efebe721800 1 -- 172.21.15.178:0/1895216941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559317d29050 con 0x559317d25780 2024-09-21T09:04:15.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.573+0000 7efd9ffff640 1 -- 172.21.15.178:0/1895216941 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efeac011040 con 0x559317d25780 2024-09-21T09:04:15.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.573+0000 7efd9ffff640 1 --2- 172.21.15.178:0/1895216941 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd94036b40 0x7efd94039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.573+0000 7efd9ffff640 1 -- 172.21.15.178:0/1895216941 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7efeac01e070 con 0x559317d25780 2024-09-21T09:04:15.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.573+0000 7efeba44e640 1 --2- 172.21.15.178:0/1895216941 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd94036b40 0x7efd94039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.579 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.574+0000 7efebe721800 1 Processor -- start 2024-09-21T09:04:15.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.574+0000 7efebe721800 1 -- start start 2024-09-21T09:04:15.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.574+0000 7efeba44e640 1 --2- 172.21.15.178:0/1895216941 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd94036b40 0x7efd94039000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x559317d12470 tx=0x7efeb408d440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.574+0000 7efebe721800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d32430 0x559317d32830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.574+0000 7efebe721800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559317d03180 con 0x559317d32430 2024-09-21T09:04:15.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.574+0000 7efebac4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d32430 0x559317d32830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.574+0000 7efebac4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d32430 0x559317d32830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42370/0 (socket says 172.21.15.178:42370) 2024-09-21T09:04:15.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.574+0000 7efebac4f640 1 -- 172.21.15.178:0/3340977046 learned_addr learned my addr 172.21.15.178:0/3340977046 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.575+0000 7efebac4f640 1 -- 172.21.15.178:0/3340977046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559317d32e00 con 0x559317d32430 2024-09-21T09:04:15.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.575+0000 7efebac4f640 1 --2- 172.21.15.178:0/3340977046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d32430 0x559317d32830 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7efeac04cba0 tx=0x7efeac02b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1baa5c642caf051 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.575+0000 7efd9dffb640 1 -- 172.21.15.178:0/3340977046 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeac028040 con 0x559317d32430 2024-09-21T09:04:15.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.575+0000 7efd9dffb640 1 -- 172.21.15.178:0/3340977046 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeac0400c0 con 0x559317d32430 2024-09-21T09:04:15.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.575+0000 7efd9dffb640 1 -- 172.21.15.178:0/3340977046 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeac016980 con 0x559317d32430 2024-09-21T09:04:15.580 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.575+0000 7efebe721800 1 -- 172.21.15.178:0/3340977046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d32430 msgr2=0x559317d32830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.575+0000 7efebe721800 1 --2- 172.21.15.178:0/3340977046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d32430 0x559317d32830 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7efeac04cba0 tx=0x7efeac02b410 comp rx=0 tx=0).stop 2024-09-21T09:04:15.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.575+0000 7efebe721800 1 -- 172.21.15.178:0/3340977046 shutdown_connections 2024-09-21T09:04:15.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.575+0000 7efebe721800 1 --2- 172.21.15.178:0/3340977046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d32430 0x559317d32830 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.575+0000 7efebe721800 1 -- 172.21.15.178:0/3340977046 >> 172.21.15.178:0/3340977046 conn(0x559317d2e790 msgr2=0x559317d2c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.576+0000 7efebe721800 1 -- 172.21.15.178:0/3340977046 shutdown_connections 2024-09-21T09:04:15.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.576+0000 7efebe721800 1 -- 172.21.15.178:0/3340977046 wait complete. 2024-09-21T09:04:15.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.576+0000 7efebe721800 1 Processor -- start 2024-09-21T09:04:15.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.576+0000 7efebe721800 1 -- start start 2024-09-21T09:04:15.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.576+0000 7efebe721800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d32430 0x559317d398a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.576+0000 7efebe721800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559317d33470 con 0x559317d32430 2024-09-21T09:04:15.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.576+0000 7efebac4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d32430 0x559317d398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.576+0000 7efebac4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d32430 0x559317d398a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42378/0 (socket says 172.21.15.178:42378) 2024-09-21T09:04:15.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.576+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 learned_addr learned my addr 172.21.15.178:0/2623745023 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.576+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559317d39de0 con 0x559317d32430 2024-09-21T09:04:15.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.577+0000 7efebac4f640 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d32430 0x559317d398a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7efeac03f040 tx=0x7efeac04cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.577+0000 7efd8bfff640 1 -- 172.21.15.178:0/2623745023 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeac028040 con 0x559317d32430 2024-09-21T09:04:15.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.577+0000 7efd8bfff640 1 -- 172.21.15.178:0/2623745023 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeac031030 con 0x559317d32430 2024-09-21T09:04:15.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.577+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559317d3a070 con 0x559317d32430 2024-09-21T09:04:15.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.577+0000 7efd8bfff640 1 -- 172.21.15.178:0/2623745023 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeac016ab0 con 0x559317d32430 2024-09-21T09:04:15.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.577+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559317d3cd20 con 0x559317d32430 2024-09-21T09:04:15.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.578+0000 7efd8bfff640 1 -- 172.21.15.178:0/2623745023 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efeac04e070 con 0x559317d32430 2024-09-21T09:04:15.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.578+0000 7efd8bfff640 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd84036aa0 0x7efd84038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.578+0000 7efd8bfff640 1 -- 172.21.15.178:0/2623745023 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7efeac00e040 con 0x559317d32430 2024-09-21T09:04:15.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.578+0000 7efeba44e640 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd84036aa0 0x7efd84038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.578+0000 7efebe721800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.578+0000 7efebe721800 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559317d454d0 0x559317d47990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.578+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d480e0 con 0x559317d454d0 2024-09-21T09:04:15.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.578+0000 7efeb9c4d640 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559317d454d0 0x559317d47990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.578+0000 7efeba44e640 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd84036aa0 0x7efd84038f60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efeb4005530 tx=0x7efeb4082000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efeb9c4d640 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559317d454d0 0x559317d47990 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efea400f610 con 0x559317d454d0 2024-09-21T09:04:15.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efebe721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efebe721800 20 realm 2024-09-21T09:04:15.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efebe721800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d44920 con 0x559317d454d0 2024-09-21T09:04:15.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efea400f610 con 0x559317d454d0 2024-09-21T09:04:15.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efebe721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efebe721800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:04:15.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efebe721800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d48bc0 con 0x559317d454d0 2024-09-21T09:04:15.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efea400f610 con 0x559317d454d0 2024-09-21T09:04:15.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efebe721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efebe721800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.579+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d49490 con 0x559317d454d0 2024-09-21T09:04:15.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.580+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efea400f610 con 0x559317d454d0 2024-09-21T09:04:15.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.580+0000 7efebe721800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:15.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.580+0000 7efebe721800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.580+0000 7efebe721800 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559317d49d40 0x559317d4c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.580+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d4c8b0 con 0x559317d49d40 2024-09-21T09:04:15.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.580+0000 7efebac4f640 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559317d49d40 0x559317d4c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.580+0000 7efebac4f640 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559317d49d40 0x559317d4c150 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.581+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.581+0000 7efebe721800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:04:15.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.581+0000 7efebe721800 20 searching for the correct realm 2024-09-21T09:04:15.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.581+0000 7efebe721800 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559317d4e9b0 0x559317d50e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.581+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559317d51540 con 0x559317d4e9b0 2024-09-21T09:04:15.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.581+0000 7efeba44e640 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559317d4e9b0 0x559317d50e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.581+0000 7efeba44e640 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559317d4e9b0 0x559317d50e70 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.581+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.581+0000 7efeba44e640 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7efeb4072020 0x7efeb40715e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.581+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559317d51540 con 0x7efeb4072020 2024-09-21T09:04:15.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.581+0000 7efeb9c4d640 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7efeb4072020 0x7efeb40715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.582+0000 7efeb9c4d640 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7efeb4072020 0x7efeb40715e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.582+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efea400f610 con 0x7efeb4072020 2024-09-21T09:04:15.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.582+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559317d51540 con 0x559317d49d40 2024-09-21T09:04:15.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.582+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.582+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559317d51540 con 0x559317d454d0 2024-09-21T09:04:15.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.582+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efea400f610 con 0x559317d454d0 2024-09-21T09:04:15.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.582+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559317d51540 con 0x559317d454d0 2024-09-21T09:04:15.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.583+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efea402b040 con 0x559317d454d0 2024-09-21T09:04:15.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.583+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559317d51540 con 0x559317d49d40 2024-09-21T09:04:15.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.583+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.583+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559317d51540 con 0x559317d49d40 2024-09-21T09:04:15.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.583+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.583+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559317d51540 con 0x7efeb4072020 2024-09-21T09:04:15.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.583+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efea402b040 con 0x7efeb4072020 2024-09-21T09:04:15.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.583+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559317d51540 con 0x559317d4e9b0 2024-09-21T09:04:15.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.584+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.584+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559317d51540 con 0x559317d454d0 2024-09-21T09:04:15.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.584+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efea402b040 con 0x559317d454d0 2024-09-21T09:04:15.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.584+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559317d51540 con 0x559317d49d40 2024-09-21T09:04:15.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.584+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.599 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.584+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559317d51540 con 0x559317d454d0 2024-09-21T09:04:15.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.584+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efea402b040 con 0x559317d454d0 2024-09-21T09:04:15.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.584+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559317d51540 con 0x7efeb4072020 2024-09-21T09:04:15.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.585+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efea402b040 con 0x7efeb4072020 2024-09-21T09:04:15.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.585+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559317d51540 con 0x559317d4e9b0 2024-09-21T09:04:15.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.585+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.585+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x559317d4e9b0 2024-09-21T09:04:15.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.585+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.585+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x559317d49d40 2024-09-21T09:04:15.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.586+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.586+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x559317d4e9b0 2024-09-21T09:04:15.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.586+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.600 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.586+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x559317d4e9b0 2024-09-21T09:04:15.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.586+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.586+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x559317d454d0 2024-09-21T09:04:15.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.586+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efea402b040 con 0x559317d454d0 2024-09-21T09:04:15.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.586+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x559317d454d0 2024-09-21T09:04:15.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.586+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efea402b040 con 0x559317d454d0 2024-09-21T09:04:15.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.586+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x559317d49d40 2024-09-21T09:04:15.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.587+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.587+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x559317d4e9b0 2024-09-21T09:04:15.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.587+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.587+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x7efeb4072020 2024-09-21T09:04:15.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.587+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efea402b040 con 0x7efeb4072020 2024-09-21T09:04:15.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.587+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x559317d454d0 2024-09-21T09:04:15.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.587+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efea402b040 con 0x559317d454d0 2024-09-21T09:04:15.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.587+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x559317d49d40 2024-09-21T09:04:15.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.588+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.588+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x559317d4e9b0 2024-09-21T09:04:15.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.588+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.588+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x7efeb4072020 2024-09-21T09:04:15.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.588+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efea402b040 con 0x7efeb4072020 2024-09-21T09:04:15.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.588+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x7efeb4072020 2024-09-21T09:04:15.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.588+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efea402b040 con 0x7efeb4072020 2024-09-21T09:04:15.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.588+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x559317d4e9b0 2024-09-21T09:04:15.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.589+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.589+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x559317d49d40 2024-09-21T09:04:15.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.589+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.589+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x559317d454d0 2024-09-21T09:04:15.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.589+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efea402b040 con 0x559317d454d0 2024-09-21T09:04:15.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.589+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efeb40a5040 con 0x7efeb4072020 2024-09-21T09:04:15.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efea402b040 con 0x7efeb4072020 2024-09-21T09:04:15.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:04:15.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:04:15.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:04:15.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:04:15.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:04:15.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:04:15.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d4d3b0 con 0x559317d454d0 2024-09-21T09:04:15.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d4d830 con 0x559317d454d0 2024-09-21T09:04:15.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:15.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d4dd10 con 0x559317d454d0 2024-09-21T09:04:15.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:04:15.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 zone default found 2024-09-21T09:04:15.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 4 Realm: () 2024-09-21T09:04:15.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:04:15.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:04:15.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:04:15.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 zonegroup default 2024-09-21T09:04:15.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.590+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d519c0 con 0x559317d49d40 2024-09-21T09:04:15.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.591+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.591+0000 7efebe721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.591+0000 7efebe721800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.591+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d53bf0 con 0x559317d4e9b0 2024-09-21T09:04:15.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.591+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.591+0000 7efebe721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.591+0000 7efebe721800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.591+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d53f90 con 0x559317d4e9b0 2024-09-21T09:04:15.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.591+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.591+0000 7efebe721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.591+0000 7efebe721800 20 started sync module instance, tier type = 2024-09-21T09:04:15.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.591+0000 7efebe721800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:04:15.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.591+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d53030 con 0x7efeb4072020 2024-09-21T09:04:15.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.592+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x7efeb4072020 2024-09-21T09:04:15.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.592+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94090248402256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d53030 con 0x7efeb4072020 2024-09-21T09:04:15.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.592+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d54950 con 0x559317d454d0 2024-09-21T09:04:15.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.593+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94090248402256] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x7efeb4072020 2024-09-21T09:04:15.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.594+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.594+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94090248400224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d54950 con 0x559317d454d0 2024-09-21T09:04:15.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.594+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d55350 con 0x559317d4e9b0 2024-09-21T09:04:15.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.595+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.595+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94090248408672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d55bf0 con 0x559317d4e9b0 2024-09-21T09:04:15.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.595+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94090248400224] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.595+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d56160 con 0x7efeb4072020 2024-09-21T09:04:15.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.596+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x7efeb4072020 2024-09-21T09:04:15.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.596+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94090248406176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d56a00 con 0x7efeb4072020 2024-09-21T09:04:15.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.596+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d57480 con 0x559317d454d0 2024-09-21T09:04:15.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.596+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94090248408672] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.597+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.597+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94090248406176] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x7efeb4072020 2024-09-21T09:04:15.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.597+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94090248417136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d57440 con 0x559317d454d0 2024-09-21T09:04:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.597+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d56580 con 0x559317d49d40 2024-09-21T09:04:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.598+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94090248417136] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.598+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.598+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94090248410944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d57e30 con 0x559317d49d40 2024-09-21T09:04:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.598+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d58720 con 0x559317d49d40 2024-09-21T09:04:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.599+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94090248410944] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.600+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.600+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94090248419712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d58900 con 0x559317d49d40 2024-09-21T09:04:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.600+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d59150 con 0x559317d49d40 2024-09-21T09:04:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.601+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94090248419712] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.601+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.601+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94090248423680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d59540 con 0x559317d49d40 2024-09-21T09:04:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.601+0000 7efebe721800 20 add_watcher() i=0 2024-09-21T09:04:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.601+0000 7efebe721800 20 add_watcher() i=1 2024-09-21T09:04:15.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.601+0000 7efebe721800 20 add_watcher() i=2 2024-09-21T09:04:15.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.601+0000 7efebe721800 20 add_watcher() i=3 2024-09-21T09:04:15.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.601+0000 7efebe721800 20 add_watcher() i=4 2024-09-21T09:04:15.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.601+0000 7efebe721800 20 add_watcher() i=5 2024-09-21T09:04:15.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.601+0000 7efebe721800 20 add_watcher() i=6 2024-09-21T09:04:15.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.602+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94090248423680] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.602+0000 7efebe721800 20 add_watcher() i=7 2024-09-21T09:04:15.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.602+0000 7efebe721800 2 all 8 watchers are set, enabling cache 2024-09-21T09:04:15.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.602+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d5c570 con 0x559317d454d0 2024-09-21T09:04:15.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.602+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.602+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94090248425200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d59ac0 con 0x559317d454d0 2024-09-21T09:04:15.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.603+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94090248425200] v31'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.603+0000 7efd70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.603+0000 7efebe721800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:04:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.603+0000 7efebe721800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:04:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.603+0000 7efebe721800 5 note: GC not initialized 2024-09-21T09:04:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.603+0000 7efceb7fe640 20 reqs_thread_entry: start 2024-09-21T09:04:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.603+0000 7efebe721800 20 init_complete bucket index max shards: 11 2024-09-21T09:04:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.603+0000 7efebe721800 20 Filter name: none 2024-09-21T09:04:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.604+0000 7efce97fa640 20 reqs_thread_entry: start 2024-09-21T09:04:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.604+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d8fdb0 con 0x559317d454d0 2024-09-21T09:04:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.604+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.604+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d8fdb0 con 0x7efeb4072020 2024-09-21T09:04:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.604+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efea403f040 con 0x7efeb4072020 2024-09-21T09:04:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.604+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d8fd70 con 0x559317d454d0 2024-09-21T09:04:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.604+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.604+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d8fd70 con 0x559317d4e9b0 2024-09-21T09:04:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.605+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.605+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d90280 con 0x559317d4e9b0 2024-09-21T09:04:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.605+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.605+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d90280 con 0x559317d4e9b0 2024-09-21T09:04:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.605+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.605+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d90280 con 0x559317d454d0 2024-09-21T09:04:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.605+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.605+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d90280 con 0x559317d454d0 2024-09-21T09:04:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.605+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.605+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d90230 con 0x559317d4e9b0 2024-09-21T09:04:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.606+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.606+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d90230 con 0x559317d4e9b0 2024-09-21T09:04:15.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.606+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.606+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d90230 con 0x559317d49d40 2024-09-21T09:04:15.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.606+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.606+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d454d0 2024-09-21T09:04:15.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.606+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.606+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x7efeb4072020 2024-09-21T09:04:15.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.607+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x7efeb4072020 2024-09-21T09:04:15.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.607+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d4e9b0 2024-09-21T09:04:15.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.607+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.607+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d49d40 2024-09-21T09:04:15.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.607+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.607+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d49d40 2024-09-21T09:04:15.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.607+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.607+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d4e9b0 2024-09-21T09:04:15.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.608+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.608+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d49d40 2024-09-21T09:04:15.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.608+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.608+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d454d0 2024-09-21T09:04:15.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.608+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.608+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d4e9b0 2024-09-21T09:04:15.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.609+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.609+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d49d40 2024-09-21T09:04:15.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.609+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.609+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x7efeb4072020 2024-09-21T09:04:15.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.609+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x7efeb4072020 2024-09-21T09:04:15.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.609+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d49d40 2024-09-21T09:04:15.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.609+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.609+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d454d0 2024-09-21T09:04:15.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.610+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.610+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d454d0 2024-09-21T09:04:15.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.610+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.610+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d4e9b0 2024-09-21T09:04:15.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.610+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.610+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d454d0 2024-09-21T09:04:15.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.610+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.610+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d454d0 2024-09-21T09:04:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.610+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.610+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d4e9b0 2024-09-21T09:04:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.611+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.611+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d4e9b0 2024-09-21T09:04:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.611+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.611+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d4e9b0 2024-09-21T09:04:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.611+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.611+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559317d91890 con 0x559317d49d40 2024-09-21T09:04:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.612+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.612+0000 7efd70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.612+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94090248425200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d8dcc0 con 0x559317d454d0 2024-09-21T09:04:15.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.613+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94090248425200] v31'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.613+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94090248402256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d8d2c0 con 0x7efeb4072020 2024-09-21T09:04:15.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.614+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94090248402256] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x7efeb4072020 2024-09-21T09:04:15.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.614+0000 7efebe721800 20 remove_watcher() i=0 2024-09-21T09:04:15.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.614+0000 7efebe721800 2 removed watcher, disabling cache 2024-09-21T09:04:15.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.614+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94090248400224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d8d2c0 con 0x559317d454d0 2024-09-21T09:04:15.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.615+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94090248400224] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.615+0000 7efebe721800 20 remove_watcher() i=1 2024-09-21T09:04:15.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.615+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94090248408672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d8d2c0 con 0x559317d4e9b0 2024-09-21T09:04:15.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.617+0000 7efeba44e640 1 -- 172.21.15.178:0/2623745023 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94090248408672] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb406f020 con 0x559317d4e9b0 2024-09-21T09:04:15.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.617+0000 7efebe721800 20 remove_watcher() i=2 2024-09-21T09:04:15.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.617+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94090248406176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d8d2c0 con 0x7efeb4072020 2024-09-21T09:04:15.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.618+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94090248406176] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x7efeb4072020 2024-09-21T09:04:15.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.618+0000 7efebe721800 20 remove_watcher() i=3 2024-09-21T09:04:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.618+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94090248417136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d8d2c0 con 0x559317d454d0 2024-09-21T09:04:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.619+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94090248417136] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efea403f040 con 0x559317d454d0 2024-09-21T09:04:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.619+0000 7efebe721800 20 remove_watcher() i=4 2024-09-21T09:04:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.619+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94090248410944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d8d2c0 con 0x559317d49d40 2024-09-21T09:04:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.620+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94090248410944] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.620+0000 7efebe721800 20 remove_watcher() i=5 2024-09-21T09:04:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.620+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94090248419712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d8d2c0 con 0x559317d49d40 2024-09-21T09:04:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.621+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94090248419712] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.621+0000 7efebe721800 20 remove_watcher() i=6 2024-09-21T09:04:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.621+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94090248423680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559317d8d2c0 con 0x559317d49d40 2024-09-21T09:04:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebac4f640 1 -- 172.21.15.178:0/2623745023 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94090248423680] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeac02a070 con 0x559317d49d40 2024-09-21T09:04:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 20 remove_watcher() i=7 2024-09-21T09:04:15.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559317d49d40 msgr2=0x559317d4c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559317d49d40 0x559317d4c150 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559317d454d0 msgr2=0x559317d47990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559317d454d0 0x559317d47990 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7efeb4072020 msgr2=0x7efeb40715e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7efeb4072020 0x7efeb40715e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559317d4e9b0 msgr2=0x559317d50e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559317d4e9b0 0x559317d50e70 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd84036aa0 msgr2=0x7efd84038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd84036aa0 0x7efd84038f60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efeb4005530 tx=0x7efeb4082000 comp rx=0 tx=0).stop 2024-09-21T09:04:15.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d32430 msgr2=0x559317d398a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efeb9c4d640 1 -- 172.21.15.178:0/2623745023 reap_dead start 2024-09-21T09:04:15.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d32430 0x559317d398a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7efeac03f040 tx=0x7efeac04cb30 comp rx=0 tx=0).stop 2024-09-21T09:04:15.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 shutdown_connections 2024-09-21T09:04:15.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 --2- 172.21.15.178:0/2623745023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d32430 0x559317d398a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.622+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 >> 172.21.15.178:0/2623745023 conn(0x559317d2e790 msgr2=0x559317d2c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 shutdown_connections 2024-09-21T09:04:15.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/2623745023 wait complete. 2024-09-21T09:04:15.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/1895216941 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd94036b40 msgr2=0x7efd94039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 --2- 172.21.15.178:0/1895216941 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd94036b40 0x7efd94039000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x559317d12470 tx=0x7efeb408d440 comp rx=0 tx=0).stop 2024-09-21T09:04:15.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/1895216941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d25780 msgr2=0x559317d25ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 --2- 172.21.15.178:0/1895216941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d25780 0x559317d25ba0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x559317d123d0 tx=0x7efeac018830 comp rx=0 tx=0).stop 2024-09-21T09:04:15.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/1895216941 shutdown_connections 2024-09-21T09:04:15.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 --2- 172.21.15.178:0/1895216941 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efd94036b40 0x7efd94039000 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 --2- 172.21.15.178:0/1895216941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317d25780 0x559317d25ba0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/1895216941 >> 172.21.15.178:0/1895216941 conn(0x559317d1a710 msgr2=0x559317d1d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/1895216941 shutdown_connections 2024-09-21T09:04:15.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/1895216941 wait complete. 2024-09-21T09:04:15.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559317d14320 msgr2=0x559317d16710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559317d14320 0x559317d16710 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559317d0f680 msgr2=0x559317d11a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559317d0f680 0x559317d11a70 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efda0036b90 msgr2=0x7efda0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efda0036b90 0x7efda0039050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efea4000f60 tx=0x7efea4001370 comp rx=0 tx=0).stop 2024-09-21T09:04:15.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10e80 msgr2=0x559317d0a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10e80 0x559317d0a620 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efeb4059040 tx=0x7efeb4002fb0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 shutdown_connections 2024-09-21T09:04:15.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559317d14320 0x559317d16710 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559317d0f680 0x559317d11a70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7efda0036b90 0x7efda0039050 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 --2- 172.21.15.178:0/2439856581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559317c10e80 0x559317d0a620 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 >> 172.21.15.178:0/2439856581 conn(0x559317c0bdd0 msgr2=0x559317cf8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 shutdown_connections 2024-09-21T09:04:15.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.623+0000 7efebe721800 1 -- 172.21.15.178:0/2439856581 wait complete. 2024-09-21T09:04:15.636 INFO:teuthology.orchestra.run.smithi178.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-21T09:04:15.636 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-21T09:04:15.636 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-21T09:04:15.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-21T09:04:15.636 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-21T09:04:15.721 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:04:15.721 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:04:15.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.721+0000 7f109052c800 1 Processor -- start 2024-09-21T09:04:15.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.721+0000 7f109052c800 1 -- start start 2024-09-21T09:04:15.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.721+0000 7f109052c800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55c5e4d1a5f0 0x55c5e4dab690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.721+0000 7f109052c800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c5e4c65b30 con 0x55c5e4dabbd0 2024-09-21T09:04:15.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.721+0000 7f109052c800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55c5e4c47360 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.721+0000 7f108c2b7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55c5e4d1a5f0 0x55c5e4dab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.721+0000 7f108c2b7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55c5e4d1a5f0 0x55c5e4dab690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42386/0 (socket says 172.21.15.178:42386) 2024-09-21T09:04:15.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.721+0000 7f108c2b7640 1 -- 172.21.15.178:0/4244395010 learned_addr learned my addr 172.21.15.178:0/4244395010 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.721+0000 7f1083ab6640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55c5e4dabbd0 0x55c5e4dadfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:56328/0 (socket says 172.21.15.178:56328) 2024-09-21T09:04:15.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.722+0000 7f108c2b7640 1 -- 172.21.15.178:0/4244395010 >> v1:172.21.15.44:6789/0 conn(0x55c5e4dabbd0 legacy=0x55c5e4dadfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.722+0000 7f108c2b7640 1 -- 172.21.15.178:0/4244395010 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5e4c6de00 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.723+0000 7f108c2b7640 1 --2- 172.21.15.178:0/4244395010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4dab690 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f107c00a520 tx=0x7f107c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b240fc5047e8e4ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.724+0000 7f108bab6640 1 -- 172.21.15.178:0/4244395010 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c055070 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.724+0000 7f108bab6640 1 -- 172.21.15.178:0/4244395010 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c0515b0 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.724+0000 7f108bab6640 1 -- 172.21.15.178:0/4244395010 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c0518d0 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.724+0000 7f109052c800 1 -- 172.21.15.178:0/4244395010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 msgr2=0x55c5e4dab690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.724+0000 7f109052c800 1 --2- 172.21.15.178:0/4244395010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4dab690 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f107c00a520 tx=0x7f107c045ba0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.724+0000 7f109052c800 1 -- 172.21.15.178:0/4244395010 shutdown_connections 2024-09-21T09:04:15.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.724+0000 7f109052c800 1 --2- 172.21.15.178:0/4244395010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4dab690 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.724+0000 7f109052c800 1 -- 172.21.15.178:0/4244395010 >> 172.21.15.178:0/4244395010 conn(0x55c5e4da0de0 msgr2=0x55c5e4da3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.724+0000 7f109052c800 1 -- 172.21.15.178:0/4244395010 shutdown_connections 2024-09-21T09:04:15.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.724+0000 7f109052c800 1 -- 172.21.15.178:0/4244395010 wait complete. 2024-09-21T09:04:15.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.738+0000 7f109052c800 1 Processor -- start 2024-09-21T09:04:15.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.738+0000 7f109052c800 1 -- start start 2024-09-21T09:04:15.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.738+0000 7f109052c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4e97a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.738+0000 7f109052c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c5e4cf2330 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.738+0000 7f108c2b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4e97a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.738+0000 7f108c2b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4e97a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42390/0 (socket says 172.21.15.178:42390) 2024-09-21T09:04:15.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.738+0000 7f108c2b7640 1 -- 172.21.15.178:0/221742169 learned_addr learned my addr 172.21.15.178:0/221742169 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.739+0000 7f108c2b7640 1 -- 172.21.15.178:0/221742169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5e4c3fbc0 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.739+0000 7f108c2b7640 1 --2- 172.21.15.178:0/221742169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4e97a70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f107c025da0 tx=0x7f107c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a7d9eca50ab775 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.739+0000 7f0f7a60c640 1 -- 172.21.15.178:0/221742169 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c051950 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.739+0000 7f0f7a60c640 1 -- 172.21.15.178:0/221742169 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c051af0 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.739+0000 7f0f7a60c640 1 -- 172.21.15.178:0/221742169 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c051dd0 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.740+0000 7f109052c800 1 -- 172.21.15.178:0/221742169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 msgr2=0x55c5e4e97a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.740+0000 7f109052c800 1 --2- 172.21.15.178:0/221742169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4e97a70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f107c025da0 tx=0x7f107c051000 comp rx=0 tx=0).stop 2024-09-21T09:04:15.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.740+0000 7f109052c800 1 -- 172.21.15.178:0/221742169 shutdown_connections 2024-09-21T09:04:15.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.740+0000 7f109052c800 1 --2- 172.21.15.178:0/221742169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4e97a70 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.740+0000 7f109052c800 1 -- 172.21.15.178:0/221742169 >> 172.21.15.178:0/221742169 conn(0x55c5e4da0de0 msgr2=0x55c5e4e93430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.740+0000 7f109052c800 1 -- 172.21.15.178:0/221742169 shutdown_connections 2024-09-21T09:04:15.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.740+0000 7f109052c800 1 -- 172.21.15.178:0/221742169 wait complete. 2024-09-21T09:04:15.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.740+0000 7f109052c800 1 Processor -- start 2024-09-21T09:04:15.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.740+0000 7f109052c800 1 -- start start 2024-09-21T09:04:15.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.740+0000 7f109052c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4e9f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.740+0000 7f109052c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c5e4daf980 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.741+0000 7f108c2b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4e9f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.741+0000 7f108c2b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4e9f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42398/0 (socket says 172.21.15.178:42398) 2024-09-21T09:04:15.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.741+0000 7f108c2b7640 1 -- 172.21.15.178:0/587216312 learned_addr learned my addr 172.21.15.178:0/587216312 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.741+0000 7f108c2b7640 1 -- 172.21.15.178:0/587216312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5e4c53fe0 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.741+0000 7f108c2b7640 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4e9f340 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f107c067040 tx=0x7f107c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.741+0000 7f0f78e09640 1 -- 172.21.15.178:0/587216312 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c073070 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.741+0000 7f0f78e09640 1 -- 172.21.15.178:0/587216312 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c05a450 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.741+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5e4e9f880 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.742+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5e4e9fe00 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.742+0000 7f0f78e09640 1 -- 172.21.15.178:0/587216312 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c07d060 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.742+0000 7f0f78e09640 1 -- 172.21.15.178:0/587216312 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f107c076070 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.743+0000 7f0f78e09640 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f74036b40 0x7f0f74039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.743+0000 7f0f78e09640 1 -- 172.21.15.178:0/587216312 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f107c062070 con 0x55c5e4d1a5f0 2024-09-21T09:04:15.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.743+0000 7f1083ab6640 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f74036b40 0x7f0f74039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.743+0000 7f109052c800 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55c5e4dabbd0 0x55c5e4ea63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.743+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ea6930 con 0x55c5e4dabbd0 2024-09-21T09:04:15.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.743+0000 7f108cab8640 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55c5e4dabbd0 0x55c5e4ea63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.743+0000 7f1083ab6640 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f74036b40 0x7f0f74039000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1074000f60 tx=0x7f1074001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.743+0000 7f108cab8640 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55c5e4dabbd0 0x55c5e4ea63b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.743+0000 7f108cab8640 1 -- 172.21.15.178:0/587216312 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f108400a4a0 con 0x55c5e4dabbd0 2024-09-21T09:04:15.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.744+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ea3980 con 0x55c5e4dabbd0 2024-09-21T09:04:15.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.744+0000 7f108cab8640 1 -- 172.21.15.178:0/587216312 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f108400a4a0 con 0x55c5e4dabbd0 2024-09-21T09:04:15.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.744+0000 7f109052c800 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55c5e4ea8c60 0x55c5e4eab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.744+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eab6f0 con 0x55c5e4ea8c60 2024-09-21T09:04:15.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.744+0000 7f108c2b7640 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55c5e4ea8c60 0x55c5e4eab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.744+0000 7f108c2b7640 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55c5e4ea8c60 0x55c5e4eab050 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.745+0000 7f108c2b7640 1 -- 172.21.15.178:0/587216312 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ea8c60 2024-09-21T09:04:15.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.745+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ea7b00 con 0x55c5e4dabbd0 2024-09-21T09:04:15.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.745+0000 7f108cab8640 1 -- 172.21.15.178:0/587216312 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f108400a4a0 con 0x55c5e4dabbd0 2024-09-21T09:04:15.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.745+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ea7fe0 con 0x55c5e4dabbd0 2024-09-21T09:04:15.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.745+0000 7f108cab8640 1 -- 172.21.15.178:0/587216312 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f108400a4a0 con 0x55c5e4dabbd0 2024-09-21T09:04:15.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.746+0000 7f109052c800 1 Processor -- start 2024-09-21T09:04:15.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.746+0000 7f109052c800 1 -- start start 2024-09-21T09:04:15.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.746+0000 7f109052c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4eba0b0 0x55c5e4eba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.746+0000 7f109052c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c5e4c41580 con 0x55c5e4eba0b0 2024-09-21T09:04:15.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.746+0000 7f108cab8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4eba0b0 0x55c5e4eba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.746+0000 7f108cab8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4eba0b0 0x55c5e4eba4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42408/0 (socket says 172.21.15.178:42408) 2024-09-21T09:04:15.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.746+0000 7f108cab8640 1 -- 172.21.15.178:0/3874210762 learned_addr learned my addr 172.21.15.178:0/3874210762 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.746+0000 7f108cab8640 1 -- 172.21.15.178:0/3874210762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5e4ebaa10 con 0x55c5e4eba0b0 2024-09-21T09:04:15.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.747+0000 7f108cab8640 1 --2- 172.21.15.178:0/3874210762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4eba0b0 0x55c5e4eba4d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55c5e4ea03f0 tx=0x7f10840188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.747+0000 7f0f71ffb640 1 -- 172.21.15.178:0/3874210762 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1084014450 con 0x55c5e4eba0b0 2024-09-21T09:04:15.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.747+0000 7f0f71ffb640 1 -- 172.21.15.178:0/3874210762 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10840145f0 con 0x55c5e4eba0b0 2024-09-21T09:04:15.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.747+0000 7f0f71ffb640 1 -- 172.21.15.178:0/3874210762 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10840148d0 con 0x55c5e4eba0b0 2024-09-21T09:04:15.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.747+0000 7f109052c800 1 -- 172.21.15.178:0/3874210762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5e4ebaca0 con 0x55c5e4eba0b0 2024-09-21T09:04:15.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.747+0000 7f109052c800 1 -- 172.21.15.178:0/3874210762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5e4ebd980 con 0x55c5e4eba0b0 2024-09-21T09:04:15.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.748+0000 7f0f71ffb640 1 -- 172.21.15.178:0/3874210762 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1084011040 con 0x55c5e4eba0b0 2024-09-21T09:04:15.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.748+0000 7f0f71ffb640 1 --2- 172.21.15.178:0/3874210762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f64036b40 0x7f0f64039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.748+0000 7f0f71ffb640 1 -- 172.21.15.178:0/3874210762 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f108401e070 con 0x55c5e4eba0b0 2024-09-21T09:04:15.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.748+0000 7f108c2b7640 1 --2- 172.21.15.178:0/3874210762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f64036b40 0x7f0f64039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.748+0000 7f109052c800 1 Processor -- start 2024-09-21T09:04:15.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.748+0000 7f108c2b7640 1 --2- 172.21.15.178:0/3874210762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f64036b40 0x7f0f64039000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55c5e4ea6d80 tx=0x7f107c08f5f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.748+0000 7f109052c800 1 -- start start 2024-09-21T09:04:15.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.748+0000 7f109052c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4ec6d50 0x55c5e4ec7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.748+0000 7f109052c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c5e4e98160 con 0x55c5e4ec6d50 2024-09-21T09:04:15.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.749+0000 7f108cab8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4ec6d50 0x55c5e4ec7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.749+0000 7f108cab8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4ec6d50 0x55c5e4ec7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42414/0 (socket says 172.21.15.178:42414) 2024-09-21T09:04:15.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.749+0000 7f108cab8640 1 -- 172.21.15.178:0/59340601 learned_addr learned my addr 172.21.15.178:0/59340601 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.749+0000 7f108cab8640 1 -- 172.21.15.178:0/59340601 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5e4ec7720 con 0x55c5e4ec6d50 2024-09-21T09:04:15.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.749+0000 7f108cab8640 1 --2- 172.21.15.178:0/59340601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4ec6d50 0x55c5e4ec7150 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f108404cb90 tx=0x7f1084011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa14a356d999888 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.749+0000 7f0f637fe640 1 -- 172.21.15.178:0/59340601 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1084044070 con 0x55c5e4ec6d50 2024-09-21T09:04:15.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.749+0000 7f0f637fe640 1 -- 172.21.15.178:0/59340601 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1084013c90 con 0x55c5e4ec6d50 2024-09-21T09:04:15.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.749+0000 7f0f637fe640 1 -- 172.21.15.178:0/59340601 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f108402ba60 con 0x55c5e4ec6d50 2024-09-21T09:04:15.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.750+0000 7f109052c800 1 -- 172.21.15.178:0/59340601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4ec6d50 msgr2=0x55c5e4ec7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.750+0000 7f109052c800 1 --2- 172.21.15.178:0/59340601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4ec6d50 0x55c5e4ec7150 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f108404cb90 tx=0x7f1084011700 comp rx=0 tx=0).stop 2024-09-21T09:04:15.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.750+0000 7f109052c800 1 -- 172.21.15.178:0/59340601 shutdown_connections 2024-09-21T09:04:15.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.750+0000 7f109052c800 1 --2- 172.21.15.178:0/59340601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4ec6d50 0x55c5e4ec7150 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.750+0000 7f109052c800 1 -- 172.21.15.178:0/59340601 >> 172.21.15.178:0/59340601 conn(0x55c5e4ec3100 msgr2=0x55c5e4ec1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.750+0000 7f109052c800 1 -- 172.21.15.178:0/59340601 shutdown_connections 2024-09-21T09:04:15.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.750+0000 7f109052c800 1 -- 172.21.15.178:0/59340601 wait complete. 2024-09-21T09:04:15.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.750+0000 7f109052c800 1 Processor -- start 2024-09-21T09:04:15.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.750+0000 7f109052c800 1 -- start start 2024-09-21T09:04:15.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.750+0000 7f109052c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4ec6d50 0x55c5e4ece1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.750+0000 7f109052c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c5e4ec7cf0 con 0x55c5e4ec6d50 2024-09-21T09:04:15.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.750+0000 7f108cab8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4ec6d50 0x55c5e4ece1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.750+0000 7f108cab8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4ec6d50 0x55c5e4ece1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42424/0 (socket says 172.21.15.178:42424) 2024-09-21T09:04:15.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.750+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 learned_addr learned my addr 172.21.15.178:0/771757095 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.751+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5e4ece6e0 con 0x55c5e4ec6d50 2024-09-21T09:04:15.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.751+0000 7f108cab8640 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4ec6d50 0x55c5e4ece1a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1084016ad0 tx=0x7f108404cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.751+0000 7f0f61ffb640 1 -- 172.21.15.178:0/771757095 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f108404e2e0 con 0x55c5e4ec6d50 2024-09-21T09:04:15.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.751+0000 7f0f61ffb640 1 -- 172.21.15.178:0/771757095 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108404e480 con 0x55c5e4ec6d50 2024-09-21T09:04:15.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.751+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5e4ece970 con 0x55c5e4ec6d50 2024-09-21T09:04:15.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.751+0000 7f0f61ffb640 1 -- 172.21.15.178:0/771757095 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f108402b4a0 con 0x55c5e4ec6d50 2024-09-21T09:04:15.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.751+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5e4ed1620 con 0x55c5e4ec6d50 2024-09-21T09:04:15.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.752+0000 7f0f61ffb640 1 -- 172.21.15.178:0/771757095 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f108403e020 con 0x55c5e4ec6d50 2024-09-21T09:04:15.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.752+0000 7f0f61ffb640 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f54036b40 0x7f0f54039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.752+0000 7f0f61ffb640 1 -- 172.21.15.178:0/771757095 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f108403c020 con 0x55c5e4ec6d50 2024-09-21T09:04:15.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.752+0000 7f108c2b7640 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f54036b40 0x7f0f54039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.752+0000 7f109052c800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.752+0000 7f109052c800 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55c5e4ed9e00 0x55c5e4edc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.752+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4edca10 con 0x55c5e4ed9e00 2024-09-21T09:04:15.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.752+0000 7f1083ab6640 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55c5e4ed9e00 0x55c5e4edc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.752+0000 7f108c2b7640 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f54036b40 0x7f0f54039000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f107c0674a0 tx=0x7f107c095000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f1083ab6640 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55c5e4ed9e00 0x55c5e4edc2c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f107400f610 con 0x55c5e4ed9e00 2024-09-21T09:04:15.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f109052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f109052c800 20 realm 2024-09-21T09:04:15.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f109052c800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ed9250 con 0x55c5e4ed9e00 2024-09-21T09:04:15.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f107400f610 con 0x55c5e4ed9e00 2024-09-21T09:04:15.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f109052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f109052c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:04:15.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f109052c800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4edd4f0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f107400f610 con 0x55c5e4ed9e00 2024-09-21T09:04:15.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f109052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f109052c800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.753+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4edddc0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.754+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f107400f610 con 0x55c5e4ed9e00 2024-09-21T09:04:15.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.754+0000 7f109052c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:15.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.754+0000 7f109052c800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.754+0000 7f109052c800 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55c5e4ede670 0x55c5e4ee0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.754+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee11e0 con 0x55c5e4ede670 2024-09-21T09:04:15.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.754+0000 7f108cab8640 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55c5e4ede670 0x55c5e4ee0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.755+0000 7f108cab8640 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55c5e4ede670 0x55c5e4ee0a80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.755+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.755+0000 7f109052c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:04:15.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.755+0000 7f109052c800 20 searching for the correct realm 2024-09-21T09:04:15.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.755+0000 7f109052c800 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55c5e4ee32e0 0x55c5e4ee57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.755+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee5e70 con 0x55c5e4ee32e0 2024-09-21T09:04:15.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.755+0000 7f108c2b7640 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55c5e4ee32e0 0x55c5e4ee57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.755+0000 7f108c2b7640 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55c5e4ee32e0 0x55c5e4ee57a0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.756+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ee32e0 2024-09-21T09:04:15.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.756+0000 7f108c2b7640 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f107c094070 0x7f107c065400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.756+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee5e70 con 0x7f107c094070 2024-09-21T09:04:15.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.756+0000 7f1083ab6640 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f107c094070 0x7f107c065400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.756+0000 7f1083ab6640 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f107c094070 0x7f107c065400 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.756+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107400f610 con 0x7f107c094070 2024-09-21T09:04:15.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.756+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee5e70 con 0x55c5e4ede670 2024-09-21T09:04:15.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.757+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.757+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee11e0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.757+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107400f610 con 0x55c5e4ed9e00 2024-09-21T09:04:15.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.757+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee11e0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.757+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107402b040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.757+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee11e0 con 0x55c5e4ede670 2024-09-21T09:04:15.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.757+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.757+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee11e0 con 0x55c5e4ede670 2024-09-21T09:04:15.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.758+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.758+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee11e0 con 0x7f107c094070 2024-09-21T09:04:15.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.758+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107402b040 con 0x7f107c094070 2024-09-21T09:04:15.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.758+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee11e0 con 0x55c5e4ee32e0 2024-09-21T09:04:15.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.758+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ee32e0 2024-09-21T09:04:15.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.758+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee11e0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.758+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107402b040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.758+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee11e0 con 0x55c5e4ede670 2024-09-21T09:04:15.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.759+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.759+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee11e0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.759+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107402b040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.759+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee11e0 con 0x7f107c094070 2024-09-21T09:04:15.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.759+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f107402b040 con 0x7f107c094070 2024-09-21T09:04:15.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.759+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee11e0 con 0x55c5e4ee32e0 2024-09-21T09:04:15.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.759+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ee32e0 2024-09-21T09:04:15.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.759+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x55c5e4ee32e0 2024-09-21T09:04:15.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.760+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ee32e0 2024-09-21T09:04:15.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.760+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x55c5e4ede670 2024-09-21T09:04:15.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.760+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.760+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x55c5e4ee32e0 2024-09-21T09:04:15.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.760+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ee32e0 2024-09-21T09:04:15.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.760+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x55c5e4ee32e0 2024-09-21T09:04:15.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.760+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ee32e0 2024-09-21T09:04:15.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.760+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.760+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f107402b040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.760+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.761+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f107402b040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.761+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x55c5e4ede670 2024-09-21T09:04:15.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.761+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.761+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x55c5e4ee32e0 2024-09-21T09:04:15.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.761+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ee32e0 2024-09-21T09:04:15.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.761+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x7f107c094070 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.762+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107402b040 con 0x7f107c094070 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.762+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.762+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107402b040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.762+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x55c5e4ede670 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.762+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.762+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x55c5e4ee32e0 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.762+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ee32e0 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.762+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x7f107c094070 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.763+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107402b040 con 0x7f107c094070 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.763+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x7f107c094070 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.763+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107402b040 con 0x7f107c094070 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.763+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x55c5e4ee32e0 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.763+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ee32e0 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.763+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x55c5e4ede670 2024-09-21T09:04:15.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.763+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.763+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f107402b040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f107c0ae040 con 0x7f107c094070 2024-09-21T09:04:15.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107402b040 con 0x7f107c094070 2024-09-21T09:04:15.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f109052c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:04:15.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f109052c800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:04:15.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f109052c800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:04:15.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f109052c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:04:15.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f109052c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:04:15.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f109052c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:04:15.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f109052c800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee1be0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f107403f040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f109052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f109052c800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee1fd0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f107403f040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f109052c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:15.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f109052c800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.764+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee23f0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f107403f040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:04:15.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 20 zone default found 2024-09-21T09:04:15.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 4 Realm: () 2024-09-21T09:04:15.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:04:15.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:04:15.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:04:15.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 20 zonegroup default 2024-09-21T09:04:15.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee2820 con 0x55c5e4ede670 2024-09-21T09:04:15.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee8180 con 0x55c5e4ee32e0 2024-09-21T09:04:15.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ee32e0 2024-09-21T09:04:15.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.765+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee8520 con 0x55c5e4ee32e0 2024-09-21T09:04:15.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.766+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ee32e0 2024-09-21T09:04:15.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.766+0000 7f109052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.766+0000 7f109052c800 20 started sync module instance, tier type = 2024-09-21T09:04:15.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.766+0000 7f109052c800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:04:15.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.766+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee75c0 con 0x7f107c094070 2024-09-21T09:04:15.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.767+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f107c094070 2024-09-21T09:04:15.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.767+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94308437752240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee75c0 con 0x7f107c094070 2024-09-21T09:04:15.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.767+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee8ee0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.768+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94308437752240] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f107c094070 2024-09-21T09:04:15.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.768+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.768+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94308437750304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee8ee0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.768+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee98a0 con 0x55c5e4ee32e0 2024-09-21T09:04:15.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.769+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ee32e0 2024-09-21T09:04:15.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.769+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94308437758960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eea0f0 con 0x55c5e4ee32e0 2024-09-21T09:04:15.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.769+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eeab20 con 0x7f107c094070 2024-09-21T09:04:15.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.770+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94308437750304] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.770+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f107c094070 2024-09-21T09:04:15.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.770+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94308437763632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eeaf40 con 0x7f107c094070 2024-09-21T09:04:15.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.770+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eeb900 con 0x55c5e4ed9e00 2024-09-21T09:04:15.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.770+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94308437758960] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ee32e0 2024-09-21T09:04:15.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.771+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94308437763632] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f107c094070 2024-09-21T09:04:15.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.772+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.772+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94308437756464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eeb450 con 0x55c5e4ed9e00 2024-09-21T09:04:15.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.772+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eec1d0 con 0x55c5e4ede670 2024-09-21T09:04:15.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.773+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.773+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94308437769504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eeb450 con 0x55c5e4ede670 2024-09-21T09:04:15.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.773+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eecd40 con 0x55c5e4ede670 2024-09-21T09:04:15.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.773+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94308437756464] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.774+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(56 notify.6 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.774+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94308437772304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eecd00 con 0x55c5e4ede670 2024-09-21T09:04:15.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.774+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94308437769504] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.774+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eed2a0 con 0x55c5e4ede670 2024-09-21T09:04:15.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.775+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94308437772304] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.775+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.775+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94308437761088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eed2a0 con 0x55c5e4ede670 2024-09-21T09:04:15.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.775+0000 7f109052c800 20 add_watcher() i=0 2024-09-21T09:04:15.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.775+0000 7f109052c800 20 add_watcher() i=1 2024-09-21T09:04:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.775+0000 7f109052c800 20 add_watcher() i=2 2024-09-21T09:04:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.775+0000 7f109052c800 20 add_watcher() i=3 2024-09-21T09:04:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.775+0000 7f109052c800 20 add_watcher() i=4 2024-09-21T09:04:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.775+0000 7f109052c800 20 add_watcher() i=5 2024-09-21T09:04:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.775+0000 7f109052c800 20 add_watcher() i=6 2024-09-21T09:04:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.776+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94308437761088] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.776+0000 7f109052c800 20 add_watcher() i=7 2024-09-21T09:04:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.776+0000 7f109052c800 2 all 8 watchers are set, enabling cache 2024-09-21T09:04:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.776+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ef0780 con 0x55c5e4ed9e00 2024-09-21T09:04:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.777+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f107403f040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.777+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94308437775008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eedb70 con 0x55c5e4ed9e00 2024-09-21T09:04:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.777+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94308437775008] v31'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f107403f040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.778+0000 7f0f427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:15.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.778+0000 7f109052c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:04:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.778+0000 7f109052c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:04:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.778+0000 7f109052c800 5 note: GC not initialized 2024-09-21T09:04:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.778+0000 7f0f417e2640 20 reqs_thread_entry: start 2024-09-21T09:04:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.778+0000 7f109052c800 20 init_complete bucket index max shards: 11 2024-09-21T09:04:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.778+0000 7f109052c800 20 Filter name: none 2024-09-21T09:04:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.778+0000 7f0eb2ffd640 20 reqs_thread_entry: start 2024-09-21T09:04:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.778+0000 7f109052c800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.778+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4f236a0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.779+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f107403f040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.779+0000 7f109052c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:04:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.779+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4f24bf0 con 0x55c5e4ede670 2024-09-21T09:04:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.779+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.780+0000 7f0f427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:15.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.780+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94308437775008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ef99f0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.781+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94308437775008] v31'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f107403f040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.781+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94308437752240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eed2a0 con 0x7f107c094070 2024-09-21T09:04:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.782+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94308437752240] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f107c094070 2024-09-21T09:04:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.782+0000 7f109052c800 20 remove_watcher() i=0 2024-09-21T09:04:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.782+0000 7f109052c800 2 removed watcher, disabling cache 2024-09-21T09:04:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.782+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94308437750304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eed2a0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.784+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94308437750304] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.784+0000 7f109052c800 20 remove_watcher() i=1 2024-09-21T09:04:15.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.784+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94308437758960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee7220 con 0x55c5e4ee32e0 2024-09-21T09:04:15.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.785+0000 7f108c2b7640 1 -- 172.21.15.178:0/771757095 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94308437758960] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c075030 con 0x55c5e4ee32e0 2024-09-21T09:04:15.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.785+0000 7f109052c800 20 remove_watcher() i=2 2024-09-21T09:04:15.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.785+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94308437763632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eed2a0 con 0x7f107c094070 2024-09-21T09:04:15.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.786+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94308437763632] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f107c094070 2024-09-21T09:04:15.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.786+0000 7f109052c800 20 remove_watcher() i=3 2024-09-21T09:04:15.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.786+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94308437756464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee93f0 con 0x55c5e4ed9e00 2024-09-21T09:04:15.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.787+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94308437756464] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x55c5e4ed9e00 2024-09-21T09:04:15.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.787+0000 7f109052c800 20 remove_watcher() i=4 2024-09-21T09:04:15.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.787+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94308437769504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4eed2a0 con 0x55c5e4ede670 2024-09-21T09:04:15.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.788+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94308437769504] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.788+0000 7f109052c800 20 remove_watcher() i=5 2024-09-21T09:04:15.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.788+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94308437772304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee8a30 con 0x55c5e4ede670 2024-09-21T09:04:15.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.789+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94308437772304] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.789+0000 7f109052c800 20 remove_watcher() i=6 2024-09-21T09:04:15.795 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.789+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94308437761088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c5e4ee93f0 con 0x55c5e4ede670 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f108cab8640 1 -- 172.21.15.178:0/771757095 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94308437761088] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108402a070 con 0x55c5e4ede670 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 20 remove_watcher() i=7 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55c5e4ede670 msgr2=0x55c5e4ee0a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55c5e4ede670 0x55c5e4ee0a80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55c5e4ed9e00 msgr2=0x55c5e4edc2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55c5e4ed9e00 0x55c5e4edc2c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f107c094070 msgr2=0x7f107c065400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f107c094070 0x7f107c065400 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55c5e4ee32e0 msgr2=0x55c5e4ee57a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55c5e4ee32e0 0x55c5e4ee57a0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f54036b40 msgr2=0x7f0f54039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f54036b40 0x7f0f54039000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f107c0674a0 tx=0x7f107c095000 comp rx=0 tx=0).stop 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4ec6d50 msgr2=0x55c5e4ece1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f1083ab6640 1 -- 172.21.15.178:0/771757095 reap_dead start 2024-09-21T09:04:15.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4ec6d50 0x55c5e4ece1a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1084016ad0 tx=0x7f108404cb20 comp rx=0 tx=0).stop 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 shutdown_connections 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 --2- 172.21.15.178:0/771757095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4ec6d50 0x55c5e4ece1a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.790+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 >> 172.21.15.178:0/771757095 conn(0x55c5e4ec3100 msgr2=0x55c5e4ec11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 shutdown_connections 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/771757095 wait complete. 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/3874210762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f64036b40 msgr2=0x7f0f64039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 --2- 172.21.15.178:0/3874210762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f64036b40 0x7f0f64039000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55c5e4ea6d80 tx=0x7f107c08f5f0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/3874210762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4eba0b0 msgr2=0x55c5e4eba4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 --2- 172.21.15.178:0/3874210762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4eba0b0 0x55c5e4eba4d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55c5e4ea03f0 tx=0x7f10840188f0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/3874210762 shutdown_connections 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 --2- 172.21.15.178:0/3874210762 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f64036b40 0x7f0f64039000 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 --2- 172.21.15.178:0/3874210762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4eba0b0 0x55c5e4eba4d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/3874210762 >> 172.21.15.178:0/3874210762 conn(0x55c5e4eaf040 msgr2=0x55c5e4eb1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/3874210762 shutdown_connections 2024-09-21T09:04:15.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/3874210762 wait complete. 2024-09-21T09:04:15.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55c5e4ea8c60 msgr2=0x55c5e4eab050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55c5e4ea8c60 0x55c5e4eab050 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55c5e4dabbd0 msgr2=0x55c5e4ea63b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55c5e4dabbd0 0x55c5e4ea63b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f74036b40 msgr2=0x7f0f74039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f74036b40 0x7f0f74039000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1074000f60 tx=0x7f1074001370 comp rx=0 tx=0).stop 2024-09-21T09:04:15.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 msgr2=0x55c5e4e9f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4e9f340 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f107c067040 tx=0x7f107c002fb0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 shutdown_connections 2024-09-21T09:04:15.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55c5e4ea8c60 0x55c5e4eab050 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55c5e4dabbd0 0x55c5e4ea63b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0f74036b40 0x7f0f74039000 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 --2- 172.21.15.178:0/587216312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5e4d1a5f0 0x55c5e4e9f340 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 >> 172.21.15.178:0/587216312 conn(0x55c5e4da0de0 msgr2=0x55c5e4e91ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 shutdown_connections 2024-09-21T09:04:15.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.791+0000 7f109052c800 1 -- 172.21.15.178:0/587216312 wait complete. 2024-09-21T09:04:15.801 INFO:teuthology.orchestra.run.smithi178.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-21T09:04:15.801 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-21T09:04:15.802 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-21T09:04:15.802 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-21T09:04:15.802 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-21T09:04:15.848 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:04:15.848 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:04:15.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.847+0000 7f19c220e800 1 Processor -- start 2024-09-21T09:04:15.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.847+0000 7f19c220e800 1 -- start start 2024-09-21T09:04:15.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.847+0000 7f19c220e800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x563a5aa0f900 0x563a5aa11cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.847+0000 7f19c220e800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563a5a8cab30 con 0x563a5a97f650 2024-09-21T09:04:15.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.847+0000 7f19c220e800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x563a5a8ac360 con 0x563a5aa0f900 2024-09-21T09:04:15.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.847+0000 7f19bd23a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x563a5aa0f900 0x563a5aa11cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.848+0000 7f19bda3b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x563a5a97f650 0x563a5aa0e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:56330/0 (socket says 172.21.15.178:56330) 2024-09-21T09:04:15.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.848+0000 7f19bd23a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x563a5aa0f900 0x563a5aa11cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42430/0 (socket says 172.21.15.178:42430) 2024-09-21T09:04:15.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.848+0000 7f19bda3b640 1 -- 172.21.15.178:0/2550720232 learned_addr learned my addr 172.21.15.178:0/2550720232 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:04:15.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.848+0000 7f19bd23a640 1 -- 172.21.15.178:0/2550720232 >> v1:172.21.15.44:6789/0 conn(0x563a5a97f650 legacy=0x563a5aa0e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.848+0000 7f19bd23a640 1 -- 172.21.15.178:0/2550720232 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5a8d2e00 con 0x563a5aa0f900 2024-09-21T09:04:15.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.850+0000 7f19bd23a640 1 --2- 172.21.15.178:0/2550720232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5aa0f900 0x563a5aa11cf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f19b400a470 tx=0x7f19b4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219294f7b69a5bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.850+0000 7f19bca39640 1 -- 172.21.15.178:0/2550720232 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b4053570 con 0x563a5aa0f900 2024-09-21T09:04:15.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.850+0000 7f19bca39640 1 -- 172.21.15.178:0/2550720232 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b4058070 con 0x563a5aa0f900 2024-09-21T09:04:15.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.850+0000 7f19bca39640 1 -- 172.21.15.178:0/2550720232 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b4053880 con 0x563a5aa0f900 2024-09-21T09:04:15.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.850+0000 7f19c220e800 1 -- 172.21.15.178:0/2550720232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5aa0f900 msgr2=0x563a5aa11cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.850+0000 7f19c220e800 1 --2- 172.21.15.178:0/2550720232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5aa0f900 0x563a5aa11cf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f19b400a470 tx=0x7f19b4045a20 comp rx=0 tx=0).stop 2024-09-21T09:04:15.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.850+0000 7f19c220e800 1 -- 172.21.15.178:0/2550720232 shutdown_connections 2024-09-21T09:04:15.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.850+0000 7f19c220e800 1 --2- 172.21.15.178:0/2550720232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5aa0f900 0x563a5aa11cf0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.850+0000 7f19c220e800 1 -- 172.21.15.178:0/2550720232 >> 172.21.15.178:0/2550720232 conn(0x563a5aa05db0 msgr2=0x563a5aa081d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.850+0000 7f19c220e800 1 -- 172.21.15.178:0/2550720232 shutdown_connections 2024-09-21T09:04:15.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.850+0000 7f19c220e800 1 -- 172.21.15.178:0/2550720232 wait complete. 2024-09-21T09:04:15.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.864+0000 7f19c220e800 1 Processor -- start 2024-09-21T09:04:15.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.864+0000 7f19c220e800 1 -- start start 2024-09-21T09:04:15.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.864+0000 7f19c220e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5a97f650 0x563a5aafa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.864+0000 7f19c220e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563a5a957360 con 0x563a5a97f650 2024-09-21T09:04:15.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.864+0000 7f19bda3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5a97f650 0x563a5aafa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.865+0000 7f19bda3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5a97f650 0x563a5aafa8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42440/0 (socket says 172.21.15.178:42440) 2024-09-21T09:04:15.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.865+0000 7f19bda3b640 1 -- 172.21.15.178:0/1518976632 learned_addr learned my addr 172.21.15.178:0/1518976632 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.865+0000 7f19bda3b640 1 -- 172.21.15.178:0/1518976632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5a8a4bc0 con 0x563a5a97f650 2024-09-21T09:04:15.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.865+0000 7f19bda3b640 1 --2- 172.21.15.178:0/1518976632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5a97f650 0x563a5aafa8c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f19b0001e10 tx=0x7f19b000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651316a6fc1db132 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.865+0000 7f18abe07640 1 -- 172.21.15.178:0/1518976632 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b0012020 con 0x563a5a97f650 2024-09-21T09:04:15.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.865+0000 7f18abe07640 1 -- 172.21.15.178:0/1518976632 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b000e5a0 con 0x563a5a97f650 2024-09-21T09:04:15.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.865+0000 7f18abe07640 1 -- 172.21.15.178:0/1518976632 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b000e8e0 con 0x563a5a97f650 2024-09-21T09:04:15.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.866+0000 7f19c220e800 1 -- 172.21.15.178:0/1518976632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5a97f650 msgr2=0x563a5aafa8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.866+0000 7f19c220e800 1 --2- 172.21.15.178:0/1518976632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5a97f650 0x563a5aafa8c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f19b0001e10 tx=0x7f19b000b780 comp rx=0 tx=0).stop 2024-09-21T09:04:15.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.866+0000 7f19c220e800 1 -- 172.21.15.178:0/1518976632 shutdown_connections 2024-09-21T09:04:15.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.866+0000 7f19c220e800 1 --2- 172.21.15.178:0/1518976632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5a97f650 0x563a5aafa8c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.866+0000 7f19c220e800 1 -- 172.21.15.178:0/1518976632 >> 172.21.15.178:0/1518976632 conn(0x563a5aa05db0 msgr2=0x563a5aaf6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.866+0000 7f19c220e800 1 -- 172.21.15.178:0/1518976632 shutdown_connections 2024-09-21T09:04:15.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.866+0000 7f19c220e800 1 -- 172.21.15.178:0/1518976632 wait complete. 2024-09-21T09:04:15.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.866+0000 7f19c220e800 1 Processor -- start 2024-09-21T09:04:15.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.866+0000 7f19c220e800 1 -- start start 2024-09-21T09:04:15.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.866+0000 7f19c220e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5a97f650 0x563a5ab022a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.866+0000 7f19c220e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563a5aa12620 con 0x563a5a97f650 2024-09-21T09:04:15.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.867+0000 7f19bda3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5a97f650 0x563a5ab022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.867+0000 7f19bda3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5a97f650 0x563a5ab022a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42448/0 (socket says 172.21.15.178:42448) 2024-09-21T09:04:15.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.867+0000 7f19bda3b640 1 -- 172.21.15.178:0/1446289651 learned_addr learned my addr 172.21.15.178:0/1446289651 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.867+0000 7f19bda3b640 1 -- 172.21.15.178:0/1446289651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5a8b8fe0 con 0x563a5a97f650 2024-09-21T09:04:15.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.867+0000 7f19bda3b640 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5a97f650 0x563a5ab022a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f19b000b7c0 tx=0x7f19b0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.867+0000 7f18aa604640 1 -- 172.21.15.178:0/1446289651 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b0012030 con 0x563a5a97f650 2024-09-21T09:04:15.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.867+0000 7f18aa604640 1 -- 172.21.15.178:0/1446289651 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b0001470 con 0x563a5a97f650 2024-09-21T09:04:15.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.867+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a5ab027e0 con 0x563a5a97f650 2024-09-21T09:04:15.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.867+0000 7f18aa604640 1 -- 172.21.15.178:0/1446289651 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b001a8d0 con 0x563a5a97f650 2024-09-21T09:04:15.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.868+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a5ab02d00 con 0x563a5a97f650 2024-09-21T09:04:15.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.868+0000 7f18aa604640 1 -- 172.21.15.178:0/1446289651 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f19b0015020 con 0x563a5a97f650 2024-09-21T09:04:15.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.869+0000 7f18aa604640 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f18a4036b90 0x7f18a4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.869+0000 7f18aa604640 1 -- 172.21.15.178:0/1446289651 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f19b0020030 con 0x563a5a97f650 2024-09-21T09:04:15.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.869+0000 7f19bd23a640 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f18a4036b90 0x7f18a4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.869+0000 7f19c220e800 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563a5aa0f900 0x563a5ab09310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.869+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab09890 con 0x563a5aa0f900 2024-09-21T09:04:15.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.869+0000 7f19be23c640 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563a5aa0f900 0x563a5ab09310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.869+0000 7f19bd23a640 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f18a4036b90 0x7f18a4039050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f19b4057000 tx=0x7f19b4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.869+0000 7f19be23c640 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563a5aa0f900 0x563a5ab09310 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.869+0000 7f19be23c640 1 -- 172.21.15.178:0/1446289651 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19b800a4a0 con 0x563a5aa0f900 2024-09-21T09:04:15.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.869+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab068e0 con 0x563a5aa0f900 2024-09-21T09:04:15.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.870+0000 7f19be23c640 1 -- 172.21.15.178:0/1446289651 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19b800a4a0 con 0x563a5aa0f900 2024-09-21T09:04:15.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.870+0000 7f19c220e800 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563a5ab0bba0 0x563a5ab0df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.870+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab0e630 con 0x563a5ab0bba0 2024-09-21T09:04:15.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.870+0000 7f19bda3b640 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563a5ab0bba0 0x563a5ab0df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.870+0000 7f19bda3b640 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563a5ab0bba0 0x563a5ab0df90 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.871+0000 7f19bda3b640 1 -- 172.21.15.178:0/1446289651 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab0bba0 2024-09-21T09:04:15.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.871+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab0aa40 con 0x563a5aa0f900 2024-09-21T09:04:15.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.871+0000 7f19be23c640 1 -- 172.21.15.178:0/1446289651 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19b800a4a0 con 0x563a5aa0f900 2024-09-21T09:04:15.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.871+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab0af20 con 0x563a5aa0f900 2024-09-21T09:04:15.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.871+0000 7f19be23c640 1 -- 172.21.15.178:0/1446289651 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f19b800a4a0 con 0x563a5aa0f900 2024-09-21T09:04:15.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.871+0000 7f19c220e800 1 Processor -- start 2024-09-21T09:04:15.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.872+0000 7f19c220e800 1 -- start start 2024-09-21T09:04:15.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.872+0000 7f19c220e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab1cff0 0x563a5ab1d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.872+0000 7f19c220e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563a5a8a6580 con 0x563a5ab1cff0 2024-09-21T09:04:15.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.872+0000 7f19be23c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab1cff0 0x563a5ab1d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.872+0000 7f19be23c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab1cff0 0x563a5ab1d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42456/0 (socket says 172.21.15.178:42456) 2024-09-21T09:04:15.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.872+0000 7f19be23c640 1 -- 172.21.15.178:0/2523602396 learned_addr learned my addr 172.21.15.178:0/2523602396 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.872+0000 7f19be23c640 1 -- 172.21.15.178:0/2523602396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5ab1d950 con 0x563a5ab1cff0 2024-09-21T09:04:15.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.872+0000 7f19be23c640 1 --2- 172.21.15.178:0/2523602396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab1cff0 0x563a5ab1d410 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x563a5ab03350 tx=0x7f19b80188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.873+0000 7f18a37fe640 1 -- 172.21.15.178:0/2523602396 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b8014450 con 0x563a5ab1cff0 2024-09-21T09:04:15.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.873+0000 7f18a37fe640 1 -- 172.21.15.178:0/2523602396 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b80145f0 con 0x563a5ab1cff0 2024-09-21T09:04:15.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.873+0000 7f19c220e800 1 -- 172.21.15.178:0/2523602396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a5ab1dbe0 con 0x563a5ab1cff0 2024-09-21T09:04:15.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.873+0000 7f18a37fe640 1 -- 172.21.15.178:0/2523602396 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b80148d0 con 0x563a5ab1cff0 2024-09-21T09:04:15.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.873+0000 7f19c220e800 1 -- 172.21.15.178:0/2523602396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a5ab208c0 con 0x563a5ab1cff0 2024-09-21T09:04:15.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.873+0000 7f18a37fe640 1 -- 172.21.15.178:0/2523602396 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f19b8011040 con 0x563a5ab1cff0 2024-09-21T09:04:15.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.874+0000 7f18a37fe640 1 --2- 172.21.15.178:0/2523602396 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1898036b40 0x7f1898039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.874+0000 7f18a37fe640 1 -- 172.21.15.178:0/2523602396 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f19b801e070 con 0x563a5ab1cff0 2024-09-21T09:04:15.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.874+0000 7f19bda3b640 1 --2- 172.21.15.178:0/2523602396 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1898036b40 0x7f1898039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.874+0000 7f19c220e800 1 Processor -- start 2024-09-21T09:04:15.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.874+0000 7f19c220e800 1 -- start start 2024-09-21T09:04:15.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.874+0000 7f19bda3b640 1 --2- 172.21.15.178:0/2523602396 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1898036b40 0x7f1898039000 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x563a5ab09cc0 tx=0x7f19b004b030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.874+0000 7f19c220e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab29c90 0x563a5ab2a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.874+0000 7f19c220e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563a5aafb070 con 0x563a5ab29c90 2024-09-21T09:04:15.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.875+0000 7f19be23c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab29c90 0x563a5ab2a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.875+0000 7f19be23c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab29c90 0x563a5ab2a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42462/0 (socket says 172.21.15.178:42462) 2024-09-21T09:04:15.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.875+0000 7f19be23c640 1 -- 172.21.15.178:0/4269424912 learned_addr learned my addr 172.21.15.178:0/4269424912 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.875+0000 7f19be23c640 1 -- 172.21.15.178:0/4269424912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5ab2a660 con 0x563a5ab29c90 2024-09-21T09:04:15.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.875+0000 7f19be23c640 1 --2- 172.21.15.178:0/4269424912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab29c90 0x563a5ab2a090 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f19b804cb80 tx=0x7f19b803bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22944ad3e1288267 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.875+0000 7f18a17fa640 1 -- 172.21.15.178:0/4269424912 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b80168f0 con 0x563a5ab29c90 2024-09-21T09:04:15.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.875+0000 7f18a17fa640 1 -- 172.21.15.178:0/4269424912 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b8013c80 con 0x563a5ab29c90 2024-09-21T09:04:15.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.875+0000 7f18a17fa640 1 -- 172.21.15.178:0/4269424912 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b8014a70 con 0x563a5ab29c90 2024-09-21T09:04:15.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.875+0000 7f19c220e800 1 -- 172.21.15.178:0/4269424912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab29c90 msgr2=0x563a5ab2a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.875+0000 7f19c220e800 1 --2- 172.21.15.178:0/4269424912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab29c90 0x563a5ab2a090 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f19b804cb80 tx=0x7f19b803bf60 comp rx=0 tx=0).stop 2024-09-21T09:04:15.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.876+0000 7f19c220e800 1 -- 172.21.15.178:0/4269424912 shutdown_connections 2024-09-21T09:04:15.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.876+0000 7f19c220e800 1 --2- 172.21.15.178:0/4269424912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab29c90 0x563a5ab2a090 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.876+0000 7f19c220e800 1 -- 172.21.15.178:0/4269424912 >> 172.21.15.178:0/4269424912 conn(0x563a5ab26040 msgr2=0x563a5ab24140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.876+0000 7f19c220e800 1 -- 172.21.15.178:0/4269424912 shutdown_connections 2024-09-21T09:04:15.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.876+0000 7f19c220e800 1 -- 172.21.15.178:0/4269424912 wait complete. 2024-09-21T09:04:15.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.876+0000 7f19c220e800 1 Processor -- start 2024-09-21T09:04:15.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.876+0000 7f19c220e800 1 -- start start 2024-09-21T09:04:15.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.876+0000 7f19c220e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab29c90 0x563a5ab31120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.876+0000 7f19c220e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563a5ab2ac30 con 0x563a5ab29c90 2024-09-21T09:04:15.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.876+0000 7f19be23c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab29c90 0x563a5ab31120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.876+0000 7f19be23c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab29c90 0x563a5ab31120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42476/0 (socket says 172.21.15.178:42476) 2024-09-21T09:04:15.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.876+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 learned_addr learned my addr 172.21.15.178:0/1997211611 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.877+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5ab31660 con 0x563a5ab29c90 2024-09-21T09:04:15.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.877+0000 7f19be23c640 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab29c90 0x563a5ab31120 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f19b803e040 tx=0x7f19b804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.877+0000 7f188f7fe640 1 -- 172.21.15.178:0/1997211611 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b8044030 con 0x563a5ab29c90 2024-09-21T09:04:15.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.877+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a5ab318f0 con 0x563a5ab29c90 2024-09-21T09:04:15.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.877+0000 7f188f7fe640 1 -- 172.21.15.178:0/1997211611 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b8013e30 con 0x563a5ab29c90 2024-09-21T09:04:15.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.877+0000 7f188f7fe640 1 -- 172.21.15.178:0/1997211611 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b8022bb0 con 0x563a5ab29c90 2024-09-21T09:04:15.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.877+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a5ab345a0 con 0x563a5ab29c90 2024-09-21T09:04:15.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.878+0000 7f188f7fe640 1 -- 172.21.15.178:0/1997211611 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f19b80133b0 con 0x563a5ab29c90 2024-09-21T09:04:15.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.878+0000 7f188f7fe640 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1888036b40 0x7f1888039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.878+0000 7f188f7fe640 1 -- 172.21.15.178:0/1997211611 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f19b8045070 con 0x563a5ab29c90 2024-09-21T09:04:15.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.878+0000 7f19bda3b640 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1888036b40 0x7f1888039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.878+0000 7f19c220e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.878+0000 7f19c220e800 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563a5ab3cd10 0x563a5ab3f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.878+0000 7f19bd23a640 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563a5ab3cd10 0x563a5ab3f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.878+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab3f920 con 0x563a5ab3cd10 2024-09-21T09:04:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.878+0000 7f19bda3b640 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1888036b40 0x7f1888039000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f19b0000fd0 tx=0x7f19b0033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19bd23a640 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563a5ab3cd10 0x563a5ab3f1d0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19b4051070 con 0x563a5ab3cd10 2024-09-21T09:04:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19c220e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19c220e800 20 realm 2024-09-21T09:04:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19c220e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab3fd50 con 0x563a5ab3cd10 2024-09-21T09:04:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19b4051070 con 0x563a5ab3cd10 2024-09-21T09:04:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19c220e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19c220e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:04:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19c220e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab40620 con 0x563a5ab3cd10 2024-09-21T09:04:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19b4051070 con 0x563a5ab3cd10 2024-09-21T09:04:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19c220e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19c220e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.879+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab409c0 con 0x563a5ab3cd10 2024-09-21T09:04:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.880+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19b4051070 con 0x563a5ab3cd10 2024-09-21T09:04:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.880+0000 7f19c220e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.880+0000 7f19c220e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.880+0000 7f19c220e800 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563a5ab41720 0x563a5ab43b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.880+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab44050 con 0x563a5ab41720 2024-09-21T09:04:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.880+0000 7f19be23c640 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563a5ab41720 0x563a5ab43b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.880+0000 7f19be23c640 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563a5ab41720 0x563a5ab43b10 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.881+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.881+0000 7f19c220e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:04:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.881+0000 7f19c220e800 20 searching for the correct realm 2024-09-21T09:04:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.881+0000 7f19c220e800 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563a5ab46090 0x563a5ab48550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.881+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab46090 2024-09-21T09:04:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.881+0000 7f19bda3b640 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563a5ab46090 0x563a5ab48550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.881+0000 7f19bda3b640 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563a5ab46090 0x563a5ab48550 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.881+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab46090 2024-09-21T09:04:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.881+0000 7f19bda3b640 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f19b0017050 0x7f19b002d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.881+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x7f19b0017050 2024-09-21T09:04:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.881+0000 7f19bd23a640 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f19b0017050 0x7f19b002d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.882+0000 7f19bd23a640 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f19b0017050 0x7f19b002d3f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.882+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4051070 con 0x7f19b0017050 2024-09-21T09:04:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.882+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab41720 2024-09-21T09:04:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.882+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.882+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab3cd10 2024-09-21T09:04:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.882+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4051070 con 0x563a5ab3cd10 2024-09-21T09:04:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.883+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab3cd10 2024-09-21T09:04:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.883+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4051070 con 0x563a5ab3cd10 2024-09-21T09:04:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.883+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab41720 2024-09-21T09:04:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.883+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.883+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab41720 2024-09-21T09:04:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.883+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.883+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x7f19b0017050 2024-09-21T09:04:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.883+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4051070 con 0x7f19b0017050 2024-09-21T09:04:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.884+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab46090 2024-09-21T09:04:15.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.884+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab46090 2024-09-21T09:04:15.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.884+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab3cd10 2024-09-21T09:04:15.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.884+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4051070 con 0x563a5ab3cd10 2024-09-21T09:04:15.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.884+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab41720 2024-09-21T09:04:15.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.884+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.884+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab3cd10 2024-09-21T09:04:15.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.885+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4051070 con 0x563a5ab3cd10 2024-09-21T09:04:15.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.885+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x7f19b0017050 2024-09-21T09:04:15.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.885+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f19b4051070 con 0x7f19b0017050 2024-09-21T09:04:15.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.885+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab46090 2024-09-21T09:04:15.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.885+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab46090 2024-09-21T09:04:15.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.885+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab46090 2024-09-21T09:04:15.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.885+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab46090 2024-09-21T09:04:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.885+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab41720 2024-09-21T09:04:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.886+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.886+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab46090 2024-09-21T09:04:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.886+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab46090 2024-09-21T09:04:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.886+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab46090 2024-09-21T09:04:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.886+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab46090 2024-09-21T09:04:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.886+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab3cd10 2024-09-21T09:04:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.886+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f19b4051070 con 0x563a5ab3cd10 2024-09-21T09:04:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.886+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab3cd10 2024-09-21T09:04:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.887+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f19b4051070 con 0x563a5ab3cd10 2024-09-21T09:04:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.887+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab41720 2024-09-21T09:04:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.887+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.887+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab46090 2024-09-21T09:04:15.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.887+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab46090 2024-09-21T09:04:15.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.887+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x7f19b0017050 2024-09-21T09:04:15.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.887+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4051070 con 0x7f19b0017050 2024-09-21T09:04:15.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.887+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab3cd10 2024-09-21T09:04:15.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.888+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4051070 con 0x563a5ab3cd10 2024-09-21T09:04:15.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.888+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab41720 2024-09-21T09:04:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.888+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.888+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab46090 2024-09-21T09:04:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.888+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab46090 2024-09-21T09:04:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.888+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x7f19b0017050 2024-09-21T09:04:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.888+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4051070 con 0x7f19b0017050 2024-09-21T09:04:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.888+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x7f19b0017050 2024-09-21T09:04:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.889+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4051070 con 0x7f19b0017050 2024-09-21T09:04:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.889+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab46090 2024-09-21T09:04:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.889+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab46090 2024-09-21T09:04:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.889+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab41720 2024-09-21T09:04:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.889+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.889+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x563a5ab3cd10 2024-09-21T09:04:15.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.889+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f19b4051070 con 0x563a5ab3cd10 2024-09-21T09:04:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.889+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab48c20 con 0x7f19b0017050 2024-09-21T09:04:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b4086040 con 0x7f19b0017050 2024-09-21T09:04:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:04:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:04:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:04:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:04:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:04:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:04:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab44ac0 con 0x563a5ab3cd10 2024-09-21T09:04:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x563a5ab3cd10 2024-09-21T09:04:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab44f40 con 0x563a5ab3cd10 2024-09-21T09:04:15.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19b4086040 con 0x563a5ab3cd10 2024-09-21T09:04:15.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:15.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab45420 con 0x563a5ab3cd10 2024-09-21T09:04:15.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f19b4086040 con 0x563a5ab3cd10 2024-09-21T09:04:15.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:04:15.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 zone default found 2024-09-21T09:04:15.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 4 Realm: () 2024-09-21T09:04:15.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:04:15.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:04:15.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:04:15.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 zonegroup default 2024-09-21T09:04:15.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.890+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab490a0 con 0x563a5ab41720 2024-09-21T09:04:15.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.891+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.891+0000 7f19c220e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.891+0000 7f19c220e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.891+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4b2d0 con 0x563a5ab46090 2024-09-21T09:04:15.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.891+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab46090 2024-09-21T09:04:15.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.891+0000 7f19c220e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.891+0000 7f19c220e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.891+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4b670 con 0x563a5ab46090 2024-09-21T09:04:15.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.891+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab46090 2024-09-21T09:04:15.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.891+0000 7f19c220e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:15.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.891+0000 7f19c220e800 20 started sync module instance, tier type = 2024-09-21T09:04:15.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.891+0000 7f19c220e800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:04:15.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.891+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4a710 con 0x7f19b0017050 2024-09-21T09:04:15.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.892+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x7f19b0017050 2024-09-21T09:04:15.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.892+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94808629881600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4a710 con 0x7f19b0017050 2024-09-21T09:04:15.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.893+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4a710 con 0x563a5ab3cd10 2024-09-21T09:04:15.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.893+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94808629881600] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x7f19b0017050 2024-09-21T09:04:15.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.894+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x563a5ab3cd10 2024-09-21T09:04:15.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.894+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94808629879872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4c030 con 0x563a5ab3cd10 2024-09-21T09:04:15.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.894+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4c9f0 con 0x563a5ab46090 2024-09-21T09:04:15.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.895+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94808629879872] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x563a5ab3cd10 2024-09-21T09:04:15.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.895+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab46090 2024-09-21T09:04:15.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.895+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94808629885824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4bfa0 con 0x563a5ab46090 2024-09-21T09:04:15.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.895+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4d8b0 con 0x7f19b0017050 2024-09-21T09:04:15.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.896+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94808629885824] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab46090 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.896+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x7f19b0017050 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.896+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94808629892096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4dcd0 con 0x7f19b0017050 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.896+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4e690 con 0x563a5ab3cd10 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.897+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94808629892096] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x7f19b0017050 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.897+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x563a5ab3cd10 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.897+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94808629893632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4e690 con 0x563a5ab3cd10 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.898+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4f050 con 0x563a5ab41720 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.899+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.899+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94808629898144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4f8a0 con 0x563a5ab41720 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.899+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab50300 con 0x563a5ab41720 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.899+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94808629893632] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x563a5ab3cd10 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.900+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94808629898144] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.900+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.900+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94808629902768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4f430 con 0x563a5ab41720 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.900+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab509b0 con 0x563a5ab41720 2024-09-21T09:04:15.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.901+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94808629902768] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.901+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.901+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94808629895648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab509b0 con 0x563a5ab41720 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.901+0000 7f19c220e800 20 add_watcher() i=0 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.901+0000 7f19c220e800 20 add_watcher() i=1 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.901+0000 7f19c220e800 20 add_watcher() i=2 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.901+0000 7f19c220e800 20 add_watcher() i=3 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.901+0000 7f19c220e800 20 add_watcher() i=4 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.901+0000 7f19c220e800 20 add_watcher() i=5 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.901+0000 7f19c220e800 20 add_watcher() i=6 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.902+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94808629895648] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.902+0000 7f19c220e800 20 add_watcher() i=7 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.902+0000 7f19c220e800 2 all 8 watchers are set, enabling cache 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.902+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab53bc0 con 0x563a5ab3cd10 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.902+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f19b4086040 con 0x563a5ab3cd10 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.902+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94808629904608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab50db0 con 0x563a5ab3cd10 2024-09-21T09:04:15.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.903+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94808629904608] v31'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x563a5ab3cd10 2024-09-21T09:04:15.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.903+0000 7f186f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:15.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.903+0000 7f19c220e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:04:15.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.903+0000 7f19c220e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:04:15.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.903+0000 7f19c220e800 5 note: GC not initialized 2024-09-21T09:04:15.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.904+0000 7f186e7fc640 20 reqs_thread_entry: start 2024-09-21T09:04:15.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.904+0000 7f19c220e800 20 init_complete bucket index max shards: 11 2024-09-21T09:04:15.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.904+0000 7f19c220e800 20 Filter name: none 2024-09-21T09:04:15.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.904+0000 7f17dffff640 20 reqs_thread_entry: start 2024-09-21T09:04:15.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.904+0000 7f19c220e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:15.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.904+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab86b30 con 0x563a5ab3cd10 2024-09-21T09:04:15.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.904+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f19b4086040 con 0x563a5ab3cd10 2024-09-21T09:04:15.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.904+0000 7f19c220e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:04:15.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.904+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab88080 con 0x563a5ab41720 2024-09-21T09:04:15.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.905+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.905+0000 7f186f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:15.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.905+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94808629904608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab52ac0 con 0x563a5ab3cd10 2024-09-21T09:04:15.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.906+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94808629904608] v31'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x563a5ab3cd10 2024-09-21T09:04:15.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.906+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94808629881600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab504e0 con 0x7f19b0017050 2024-09-21T09:04:15.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.907+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94808629881600] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x7f19b0017050 2024-09-21T09:04:15.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.907+0000 7f19c220e800 20 remove_watcher() i=0 2024-09-21T09:04:15.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.907+0000 7f19c220e800 2 removed watcher, disabling cache 2024-09-21T09:04:15.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.907+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94808629879872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab504e0 con 0x563a5ab3cd10 2024-09-21T09:04:15.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.909+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94808629879872] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x563a5ab3cd10 2024-09-21T09:04:15.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.909+0000 7f19c220e800 20 remove_watcher() i=1 2024-09-21T09:04:15.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.909+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94808629885824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4a440 con 0x563a5ab46090 2024-09-21T09:04:15.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.910+0000 7f19bda3b640 1 -- 172.21.15.178:0/1997211611 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94808629885824] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b002dcf0 con 0x563a5ab46090 2024-09-21T09:04:15.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.910+0000 7f19c220e800 20 remove_watcher() i=2 2024-09-21T09:04:15.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.910+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94808629892096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4bb80 con 0x7f19b0017050 2024-09-21T09:04:15.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.911+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94808629892096] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x7f19b0017050 2024-09-21T09:04:15.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.911+0000 7f19c220e800 20 remove_watcher() i=3 2024-09-21T09:04:15.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.911+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94808629893632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4d400 con 0x563a5ab3cd10 2024-09-21T09:04:15.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.912+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94808629893632] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b4086040 con 0x563a5ab3cd10 2024-09-21T09:04:15.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.912+0000 7f19c220e800 20 remove_watcher() i=4 2024-09-21T09:04:15.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.912+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94808629898144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4bb80 con 0x563a5ab41720 2024-09-21T09:04:15.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.913+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94808629898144] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.913+0000 7f19c220e800 20 remove_watcher() i=5 2024-09-21T09:04:15.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.913+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94808629902768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4d400 con 0x563a5ab41720 2024-09-21T09:04:15.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.914+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94808629902768] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.914+0000 7f19c220e800 20 remove_watcher() i=6 2024-09-21T09:04:15.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.914+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94808629895648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5ab4d400 con 0x563a5ab41720 2024-09-21T09:04:15.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19be23c640 1 -- 172.21.15.178:0/1997211611 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94808629895648] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b802a070 con 0x563a5ab41720 2024-09-21T09:04:15.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19c220e800 20 remove_watcher() i=7 2024-09-21T09:04:15.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563a5ab41720 msgr2=0x563a5ab43b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19c220e800 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563a5ab41720 0x563a5ab43b10 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563a5ab3cd10 msgr2=0x563a5ab3f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19c220e800 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563a5ab3cd10 0x563a5ab3f1d0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f19b0017050 msgr2=0x7f19b002d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19c220e800 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f19b0017050 0x7f19b002d3f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563a5ab46090 msgr2=0x563a5ab48550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19c220e800 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563a5ab46090 0x563a5ab48550 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1888036b40 msgr2=0x7f1888039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19c220e800 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1888036b40 0x7f1888039000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f19b0000fd0 tx=0x7f19b0033000 comp rx=0 tx=0).stop 2024-09-21T09:04:15.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab29c90 msgr2=0x563a5ab31120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19c220e800 1 --2- 172.21.15.178:0/1997211611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab29c90 0x563a5ab31120 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f19b803e040 tx=0x7f19b804cb10 comp rx=0 tx=0).stop 2024-09-21T09:04:15.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 reap_dead start 2024-09-21T09:04:15.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19bd23a640 1 -- 172.21.15.178:0/1997211611 reap_dead start 2024-09-21T09:04:15.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.915+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 shutdown_connections 2024-09-21T09:04:15.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 >> 172.21.15.178:0/1997211611 conn(0x563a5ab26040 msgr2=0x563a5ab2b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 shutdown_connections 2024-09-21T09:04:15.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/1997211611 wait complete. 2024-09-21T09:04:15.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/2523602396 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1898036b40 msgr2=0x7f1898039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 --2- 172.21.15.178:0/2523602396 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1898036b40 0x7f1898039000 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x563a5ab09cc0 tx=0x7f19b004b030 comp rx=0 tx=0).stop 2024-09-21T09:04:15.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/2523602396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab1cff0 msgr2=0x563a5ab1d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 --2- 172.21.15.178:0/2523602396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab1cff0 0x563a5ab1d410 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x563a5ab03350 tx=0x7f19b80188f0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/2523602396 shutdown_connections 2024-09-21T09:04:15.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 --2- 172.21.15.178:0/2523602396 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1898036b40 0x7f1898039000 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 --2- 172.21.15.178:0/2523602396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5ab1cff0 0x563a5ab1d410 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/2523602396 >> 172.21.15.178:0/2523602396 conn(0x563a5ab11f80 msgr2=0x563a5ab14b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/2523602396 shutdown_connections 2024-09-21T09:04:15.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/2523602396 wait complete. 2024-09-21T09:04:15.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563a5ab0bba0 msgr2=0x563a5ab0df90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563a5ab0bba0 0x563a5ab0df90 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563a5aa0f900 msgr2=0x563a5ab09310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563a5aa0f900 0x563a5ab09310 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f18a4036b90 msgr2=0x7f18a4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f18a4036b90 0x7f18a4039050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f19b4057000 tx=0x7f19b4052000 comp rx=0 tx=0).stop 2024-09-21T09:04:15.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5a97f650 msgr2=0x563a5ab022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5a97f650 0x563a5ab022a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f19b000b7c0 tx=0x7f19b0000ed0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 shutdown_connections 2024-09-21T09:04:15.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563a5ab0bba0 0x563a5ab0df90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563a5aa0f900 0x563a5ab09310 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f18a4036b90 0x7f18a4039050 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 --2- 172.21.15.178:0/1446289651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a5a97f650 0x563a5ab022a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 >> 172.21.15.178:0/1446289651 conn(0x563a5aa05db0 msgr2=0x563a5aaf4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.916+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 shutdown_connections 2024-09-21T09:04:15.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.917+0000 7f19c220e800 1 -- 172.21.15.178:0/1446289651 wait complete. 2024-09-21T09:04:15.927 INFO:teuthology.orchestra.run.smithi178.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-09-21T09:04:15.927 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-21T09:04:15.927 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-21T09:04:15.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-21T09:04:15.927 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-21T09:04:15.973 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:04:15.973 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:04:15.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.972+0000 7f9cc8b51800 1 Processor -- start 2024-09-21T09:04:15.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.972+0000 7f9cc8b51800 1 -- start start 2024-09-21T09:04:15.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.972+0000 7f9cc8b51800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55bee9ad4920 0x55bee9ad6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.972+0000 7f9cc8b51800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bee9990b30 con 0x55bee9ad04e0 2024-09-21T09:04:15.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.972+0000 7f9cc8b51800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55bee9972360 con 0x55bee9ad4920 2024-09-21T09:04:15.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.973+0000 7f9cc5e44640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55bee9ad4920 0x55bee9ad6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.973+0000 7f9cc6645640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55bee9ad04e0 0x55bee9ad08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:56342/0 (socket says 172.21.15.178:56342) 2024-09-21T09:04:15.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.973+0000 7f9cc6645640 1 -- 172.21.15.178:0/1192792952 learned_addr learned my addr 172.21.15.178:0/1192792952 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:04:15.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.973+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1192792952 >> v1:172.21.15.44:6789/0 conn(0x55bee9ad04e0 legacy=0x55bee9ad08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.973+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1192792952 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bee9998e00 con 0x55bee9ad4920 2024-09-21T09:04:15.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.975+0000 7f9cc5e44640 1 --2- 172.21.15.178:0/1192792952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad4920 0x55bee9ad6d10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000a470 tx=0x7f9cb0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f15c2c5bf073fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.975+0000 7f9cc5643640 1 -- 172.21.15.178:0/1192792952 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb0053570 con 0x55bee9ad4920 2024-09-21T09:04:15.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.975+0000 7f9cc5643640 1 -- 172.21.15.178:0/1192792952 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb0058070 con 0x55bee9ad4920 2024-09-21T09:04:15.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.975+0000 7f9cc5643640 1 -- 172.21.15.178:0/1192792952 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb0053880 con 0x55bee9ad4920 2024-09-21T09:04:15.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.976+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1192792952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad4920 msgr2=0x55bee9ad6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.976+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1192792952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad4920 0x55bee9ad6d10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000a470 tx=0x7f9cb0045a20 comp rx=0 tx=0).stop 2024-09-21T09:04:15.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.976+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1192792952 shutdown_connections 2024-09-21T09:04:15.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.976+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1192792952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad4920 0x55bee9ad6d10 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.976+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1192792952 >> 172.21.15.178:0/1192792952 conn(0x55bee9acbdb0 msgr2=0x55bee9ace1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.976+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1192792952 shutdown_connections 2024-09-21T09:04:15.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.976+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1192792952 wait complete. 2024-09-21T09:04:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.989+0000 7f9cc8b51800 1 Processor -- start 2024-09-21T09:04:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.989+0000 7f9cc8b51800 1 -- start start 2024-09-21T09:04:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.990+0000 7f9cc8b51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad04e0 0x55bee9bc08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.990+0000 7f9cc8b51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bee9a1d360 con 0x55bee9ad04e0 2024-09-21T09:04:15.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.990+0000 7f9cc6645640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad04e0 0x55bee9bc08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.990+0000 7f9cc6645640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad04e0 0x55bee9bc08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42502/0 (socket says 172.21.15.178:42502) 2024-09-21T09:04:15.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.990+0000 7f9cc6645640 1 -- 172.21.15.178:0/1065723677 learned_addr learned my addr 172.21.15.178:0/1065723677 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.990+0000 7f9cc6645640 1 -- 172.21.15.178:0/1065723677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bee996abc0 con 0x55bee9ad04e0 2024-09-21T09:04:15.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.991+0000 7f9cc6645640 1 --2- 172.21.15.178:0/1065723677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad04e0 0x55bee9bc08b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00017a0 tx=0x7f9cc0001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889f81001d20a1af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.991+0000 7f9bb4608640 1 -- 172.21.15.178:0/1065723677 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc0016070 con 0x55bee9ad04e0 2024-09-21T09:04:15.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.991+0000 7f9bb4608640 1 -- 172.21.15.178:0/1065723677 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc0004520 con 0x55bee9ad04e0 2024-09-21T09:04:15.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.991+0000 7f9bb4608640 1 -- 172.21.15.178:0/1065723677 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc0004820 con 0x55bee9ad04e0 2024-09-21T09:04:15.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.991+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1065723677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad04e0 msgr2=0x55bee9bc08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:15.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.991+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1065723677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad04e0 0x55bee9bc08b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00017a0 tx=0x7f9cc0001c60 comp rx=0 tx=0).stop 2024-09-21T09:04:15.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.992+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1065723677 shutdown_connections 2024-09-21T09:04:15.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.992+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1065723677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad04e0 0x55bee9bc08b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:15.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.992+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1065723677 >> 172.21.15.178:0/1065723677 conn(0x55bee9acbdb0 msgr2=0x55bee9bbed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:15.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.992+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1065723677 shutdown_connections 2024-09-21T09:04:15.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.992+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1065723677 wait complete. 2024-09-21T09:04:15.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.992+0000 7f9cc8b51800 1 Processor -- start 2024-09-21T09:04:15.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.992+0000 7f9cc8b51800 1 -- start start 2024-09-21T09:04:15.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.992+0000 7f9cc8b51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad04e0 0x55bee9bbc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.992+0000 7f9cc8b51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bee9ad7550 con 0x55bee9ad04e0 2024-09-21T09:04:15.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.992+0000 7f9cc6645640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad04e0 0x55bee9bbc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.992+0000 7f9cc6645640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad04e0 0x55bee9bbc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42506/0 (socket says 172.21.15.178:42506) 2024-09-21T09:04:15.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.992+0000 7f9cc6645640 1 -- 172.21.15.178:0/1759325717 learned_addr learned my addr 172.21.15.178:0/1759325717 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:15.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.993+0000 7f9cc6645640 1 -- 172.21.15.178:0/1759325717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bee997efe0 con 0x55bee9ad04e0 2024-09-21T09:04:15.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.993+0000 7f9cc6645640 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad04e0 0x55bee9bbc670 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0000f80 tx=0x7f9cc0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:15.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.993+0000 7f9bb2e05640 1 -- 172.21.15.178:0/1759325717 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc0016040 con 0x55bee9ad04e0 2024-09-21T09:04:15.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.993+0000 7f9bb2e05640 1 -- 172.21.15.178:0/1759325717 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc0011530 con 0x55bee9ad04e0 2024-09-21T09:04:15.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.993+0000 7f9bb2e05640 1 -- 172.21.15.178:0/1759325717 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc0011890 con 0x55bee9ad04e0 2024-09-21T09:04:15.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.993+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bee9bbad60 con 0x55bee9ad04e0 2024-09-21T09:04:15.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.993+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bee9bbb2e0 con 0x55bee9ad04e0 2024-09-21T09:04:15.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.994+0000 7f9bb2e05640 1 -- 172.21.15.178:0/1759325717 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9cc001c3f0 con 0x55bee9ad04e0 2024-09-21T09:04:15.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.994+0000 7f9bb2e05640 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9bac036b40 0x7f9bac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:15.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.994+0000 7f9bb2e05640 1 -- 172.21.15.178:0/1759325717 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f9cc004bc30 con 0x55bee9ad04e0 2024-09-21T09:04:15.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.994+0000 7f9cc5e44640 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9bac036b40 0x7f9bac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:15.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.995+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55bee9ad4920 0x55bee9bd16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.995+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9bd1c10 con 0x55bee9ad4920 2024-09-21T09:04:16.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.995+0000 7f9cc6e46640 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55bee9ad4920 0x55bee9bd16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.995+0000 7f9cc5e44640 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9bac036b40 0x7f9bac039000 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0057000 tx=0x7f9cb0052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.995+0000 7f9cc6e46640 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55bee9ad4920 0x55bee9bd16d0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.995+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1759325717 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9ad4920 2024-09-21T09:04:16.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.995+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9bd2460 con 0x55bee9ad4920 2024-09-21T09:04:16.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.996+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1759325717 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9ad4920 2024-09-21T09:04:16.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.996+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55bee9bd3db0 0x55bee9bd6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.996+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9bd6a00 con 0x55bee9bd3db0 2024-09-21T09:04:16.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.996+0000 7f9cc6645640 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55bee9bd3db0 0x55bee9bd6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.996+0000 7f9cc6645640 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55bee9bd3db0 0x55bee9bd6270 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.997+0000 7f9cc6645640 1 -- 172.21.15.178:0/1759325717 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9bd3db0 2024-09-21T09:04:16.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.997+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9bd2cb0 con 0x55bee9ad4920 2024-09-21T09:04:16.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.997+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1759325717 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9ad4920 2024-09-21T09:04:16.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.997+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9bd3050 con 0x55bee9ad4920 2024-09-21T09:04:16.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.997+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1759325717 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9ad4920 2024-09-21T09:04:16.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.997+0000 7f9cc8b51800 1 Processor -- start 2024-09-21T09:04:16.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.998+0000 7f9cc8b51800 1 -- start start 2024-09-21T09:04:16.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.998+0000 7f9cc8b51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9be53d0 0x55bee9be57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.998+0000 7f9cc8b51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bee9bbcbb0 con 0x55bee9be53d0 2024-09-21T09:04:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.998+0000 7f9cc6e46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9be53d0 0x55bee9be57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.998+0000 7f9cc6e46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9be53d0 0x55bee9be57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42524/0 (socket says 172.21.15.178:42524) 2024-09-21T09:04:16.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.998+0000 7f9cc6e46640 1 -- 172.21.15.178:0/125523420 learned_addr learned my addr 172.21.15.178:0/125523420 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.998+0000 7f9cc6e46640 1 -- 172.21.15.178:0/125523420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bee9be5d30 con 0x55bee9be53d0 2024-09-21T09:04:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.999+0000 7f9cc6e46640 1 --2- 172.21.15.178:0/125523420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9be53d0 0x55bee9be57f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x55bee9bbc3b0 tx=0x7f9cb800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.999+0000 7f9babfff640 1 -- 172.21.15.178:0/125523420 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb8007d00 con 0x55bee9be53d0 2024-09-21T09:04:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.999+0000 7f9babfff640 1 -- 172.21.15.178:0/125523420 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb801e020 con 0x55bee9be53d0 2024-09-21T09:04:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.999+0000 7f9cc8b51800 1 -- 172.21.15.178:0/125523420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bee9be5fc0 con 0x55bee9be53d0 2024-09-21T09:04:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.999+0000 7f9babfff640 1 -- 172.21.15.178:0/125523420 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb8019420 con 0x55bee9be53d0 2024-09-21T09:04:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:15.999+0000 7f9cc8b51800 1 -- 172.21.15.178:0/125523420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bee9be8ca0 con 0x55bee9be53d0 2024-09-21T09:04:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.000+0000 7f9babfff640 1 -- 172.21.15.178:0/125523420 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9cb8016040 con 0x55bee9be53d0 2024-09-21T09:04:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.000+0000 7f9babfff640 1 --2- 172.21.15.178:0/125523420 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9ba0036b40 0x7f9ba0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.000+0000 7f9babfff640 1 -- 172.21.15.178:0/125523420 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f9cb801f030 con 0x55bee9be53d0 2024-09-21T09:04:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.000+0000 7f9cc6645640 1 --2- 172.21.15.178:0/125523420 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9ba0036b40 0x7f9ba0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.000+0000 7f9cc8b51800 1 Processor -- start 2024-09-21T09:04:16.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.000+0000 7f9cc6645640 1 --2- 172.21.15.178:0/125523420 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9ba0036b40 0x7f9ba0039000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55bee9bbb700 tx=0x7f9cc001c830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.000+0000 7f9cc8b51800 1 -- start start 2024-09-21T09:04:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.000+0000 7f9cc8b51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9bf2070 0x55bee9bf2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.000+0000 7f9cc8b51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bee996c580 con 0x55bee9bf2070 2024-09-21T09:04:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.001+0000 7f9cc6e46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9bf2070 0x55bee9bf2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.001+0000 7f9cc6e46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9bf2070 0x55bee9bf2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42538/0 (socket says 172.21.15.178:42538) 2024-09-21T09:04:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.001+0000 7f9cc6e46640 1 -- 172.21.15.178:0/3127846788 learned_addr learned my addr 172.21.15.178:0/3127846788 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.001+0000 7f9cc6e46640 1 -- 172.21.15.178:0/3127846788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bee9bf2a40 con 0x55bee9bf2070 2024-09-21T09:04:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.001+0000 7f9cc6e46640 1 --2- 172.21.15.178:0/3127846788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9bf2070 0x55bee9bf2470 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9cb804cba0 tx=0x7f9cb80157e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a310b6f0b1cb01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.001+0000 7f9ba9ffb640 1 -- 172.21.15.178:0/3127846788 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb8045030 con 0x55bee9bf2070 2024-09-21T09:04:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.001+0000 7f9ba9ffb640 1 -- 172.21.15.178:0/3127846788 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb804a070 con 0x55bee9bf2070 2024-09-21T09:04:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.001+0000 7f9ba9ffb640 1 -- 172.21.15.178:0/3127846788 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb801d040 con 0x55bee9bf2070 2024-09-21T09:04:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.002+0000 7f9cc8b51800 1 -- 172.21.15.178:0/3127846788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9bf2070 msgr2=0x55bee9bf2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.002+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/3127846788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9bf2070 0x55bee9bf2470 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9cb804cba0 tx=0x7f9cb80157e0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.002+0000 7f9cc8b51800 1 -- 172.21.15.178:0/3127846788 shutdown_connections 2024-09-21T09:04:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.002+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/3127846788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9bf2070 0x55bee9bf2470 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.002+0000 7f9cc8b51800 1 -- 172.21.15.178:0/3127846788 >> 172.21.15.178:0/3127846788 conn(0x55bee9bee420 msgr2=0x55bee9bec520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.002+0000 7f9cc8b51800 1 -- 172.21.15.178:0/3127846788 shutdown_connections 2024-09-21T09:04:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.002+0000 7f9cc8b51800 1 -- 172.21.15.178:0/3127846788 wait complete. 2024-09-21T09:04:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.002+0000 7f9cc8b51800 1 Processor -- start 2024-09-21T09:04:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.002+0000 7f9cc8b51800 1 -- start start 2024-09-21T09:04:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.002+0000 7f9cc8b51800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9bf2070 0x55bee9bf9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.002+0000 7f9cc8b51800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bee9bf2e90 con 0x55bee9bf2070 2024-09-21T09:04:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.002+0000 7f9cc6e46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9bf2070 0x55bee9bf9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.002+0000 7f9cc6e46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9bf2070 0x55bee9bf9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42544/0 (socket says 172.21.15.178:42544) 2024-09-21T09:04:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.002+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 learned_addr learned my addr 172.21.15.178:0/1480389240 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.003+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bee9bf9890 con 0x55bee9bf2070 2024-09-21T09:04:16.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.003+0000 7f9cc6e46640 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9bf2070 0x55bee9bf9350 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80148c0 tx=0x7f9cb804cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.003+0000 7f9b97fff640 1 -- 172.21.15.178:0/1480389240 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb8045070 con 0x55bee9bf2070 2024-09-21T09:04:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.003+0000 7f9b97fff640 1 -- 172.21.15.178:0/1480389240 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb8015aa0 con 0x55bee9bf2070 2024-09-21T09:04:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.003+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bee9bf9b20 con 0x55bee9bf2070 2024-09-21T09:04:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.003+0000 7f9b97fff640 1 -- 172.21.15.178:0/1480389240 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb801d070 con 0x55bee9bf2070 2024-09-21T09:04:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.003+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bee9bfc7d0 con 0x55bee9bf2070 2024-09-21T09:04:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.004+0000 7f9b97fff640 1 -- 172.21.15.178:0/1480389240 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9cb804e070 con 0x55bee9bf2070 2024-09-21T09:04:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.004+0000 7f9b97fff640 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b90036b40 0x7f9b90039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.004+0000 7f9b97fff640 1 -- 172.21.15.178:0/1480389240 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f9cb8037bb0 con 0x55bee9bf2070 2024-09-21T09:04:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.004+0000 7f9cc6645640 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b90036b40 0x7f9b90039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.004+0000 7f9cc8b51800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.004+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55bee9c04db0 0x55bee9c07270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.004+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c079c0 con 0x55bee9c04db0 2024-09-21T09:04:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.004+0000 7f9cc5e44640 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55bee9c04db0 0x55bee9c07270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc6645640 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b90036b40 0x7f9b90039000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0019860 tx=0x7f9cc0043000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc5e44640 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55bee9c04db0 0x55bee9c07270 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc8b51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc8b51800 20 realm 2024-09-21T09:04:16.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc8b51800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c07df0 con 0x55bee9c04db0 2024-09-21T09:04:16.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc8b51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc8b51800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:04:16.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc8b51800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c086c0 con 0x55bee9c04db0 2024-09-21T09:04:16.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc8b51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc8b51800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.005+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c08a60 con 0x55bee9c04db0 2024-09-21T09:04:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.006+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.006+0000 7f9cc8b51800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.006+0000 7f9cc8b51800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.006+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55bee9c097c0 0x55bee9c0bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.006+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c0c0f0 con 0x55bee9c097c0 2024-09-21T09:04:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.006+0000 7f9cc6e46640 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55bee9c097c0 0x55bee9c0bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.006+0000 7f9cc6e46640 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55bee9c097c0 0x55bee9c0bbb0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.007+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.007+0000 7f9cc8b51800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:04:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.007+0000 7f9cc8b51800 20 searching for the correct realm 2024-09-21T09:04:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.007+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55bee9c0e130 0x55bee9c105f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.007+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c0e130 2024-09-21T09:04:16.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.007+0000 7f9cc6645640 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55bee9c0e130 0x55bee9c105f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.007+0000 7f9cc6645640 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55bee9c0e130 0x55bee9c105f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.007+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9c0e130 2024-09-21T09:04:16.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.007+0000 7f9cc6645640 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9cc000f300 0x7f9cc004b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.007+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x7f9cc000f300 2024-09-21T09:04:16.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.008+0000 7f9cc5e44640 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9cc000f300 0x7f9cc004b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.008+0000 7f9cc5e44640 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9cc000f300 0x7f9cc004b430 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.008+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb0051070 con 0x7f9cc000f300 2024-09-21T09:04:16.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.008+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c097c0 2024-09-21T09:04:16.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.008+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.008+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c04db0 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.009+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.009+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c04db0 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.009+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.009+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c097c0 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.009+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.009+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c097c0 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.009+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.009+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x7f9cc000f300 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.010+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb0051070 con 0x7f9cc000f300 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.010+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c0e130 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.010+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9c0e130 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.010+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c04db0 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.010+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.010+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c097c0 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.010+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.010+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c04db0 2024-09-21T09:04:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.011+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.011+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x7f9cc000f300 2024-09-21T09:04:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.011+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9cb0051070 con 0x7f9cc000f300 2024-09-21T09:04:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.011+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c0e130 2024-09-21T09:04:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.011+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9c0e130 2024-09-21T09:04:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.011+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c0e130 2024-09-21T09:04:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.011+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9c0e130 2024-09-21T09:04:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.011+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c097c0 2024-09-21T09:04:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.012+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.012+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c0e130 2024-09-21T09:04:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.012+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9c0e130 2024-09-21T09:04:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.012+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c0e130 2024-09-21T09:04:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.012+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9c0e130 2024-09-21T09:04:16.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.012+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c04db0 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.012+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.012+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c04db0 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.012+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.012+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c097c0 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.013+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.013+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c0e130 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.013+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9c0e130 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.013+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x7f9cc000f300 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.013+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb0051070 con 0x7f9cc000f300 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.013+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c04db0 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.013+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.013+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c097c0 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.014+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.014+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c0e130 2024-09-21T09:04:16.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.014+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9c0e130 2024-09-21T09:04:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.014+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x7f9cc000f300 2024-09-21T09:04:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.014+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb0051070 con 0x7f9cc000f300 2024-09-21T09:04:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.014+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x7f9cc000f300 2024-09-21T09:04:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.014+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb0051070 con 0x7f9cc000f300 2024-09-21T09:04:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.014+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c0e130 2024-09-21T09:04:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9c0e130 2024-09-21T09:04:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c097c0 2024-09-21T09:04:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x55bee9c04db0 2024-09-21T09:04:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c10cc0 con 0x7f9cc000f300 2024-09-21T09:04:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cb0051070 con 0x7f9cc000f300 2024-09-21T09:04:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc8b51800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:04:16.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc8b51800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc8b51800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc8b51800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc8b51800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc8b51800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc8b51800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.015+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c0cb30 con 0x55bee9c04db0 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c0cfb0 con 0x55bee9c04db0 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c0d490 con 0x55bee9c04db0 2024-09-21T09:04:16.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:04:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 20 zone default found 2024-09-21T09:04:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 4 Realm: () 2024-09-21T09:04:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:04:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:04:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:04:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 20 zonegroup default 2024-09-21T09:04:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c11140 con 0x55bee9c097c0 2024-09-21T09:04:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.016+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c13370 con 0x55bee9c0e130 2024-09-21T09:04:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.017+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9c0e130 2024-09-21T09:04:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.017+0000 7f9cc8b51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.017+0000 7f9cc8b51800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.017+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c13710 con 0x55bee9c0e130 2024-09-21T09:04:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.017+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9c0e130 2024-09-21T09:04:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.017+0000 7f9cc8b51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.017+0000 7f9cc8b51800 20 started sync module instance, tier type = 2024-09-21T09:04:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.017+0000 7f9cc8b51800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:04:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.017+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c127b0 con 0x7f9cc000f300 2024-09-21T09:04:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.018+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x7f9cc000f300 2024-09-21T09:04:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.018+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94278453898416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c127b0 con 0x7f9cc000f300 2024-09-21T09:04:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.018+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c140d0 con 0x55bee9c04db0 2024-09-21T09:04:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.019+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94278453898416] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x7f9cc000f300 2024-09-21T09:04:16.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.019+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.019+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94278453895936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c140d0 con 0x55bee9c04db0 2024-09-21T09:04:16.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.019+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c14bc0 con 0x55bee9c0e130 2024-09-21T09:04:16.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.021+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94278453895936] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.021+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9c0e130 2024-09-21T09:04:16.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.021+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94278453902368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c14040 con 0x55bee9c0e130 2024-09-21T09:04:16.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.021+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c15a80 con 0x7f9cc000f300 2024-09-21T09:04:16.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.022+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x7f9cc000f300 2024-09-21T09:04:16.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.022+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94278453909424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c16220 con 0x7f9cc000f300 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.022+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c16d40 con 0x55bee9c04db0 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.022+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94278453902368] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9c0e130 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.023+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94278453909424] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x7f9cc000f300 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.023+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.023+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94278453913616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c16d00 con 0x55bee9c04db0 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.023+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c175e0 con 0x55bee9c097c0 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.024+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.024+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94278453915952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c16d00 con 0x55bee9c097c0 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.024+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c18140 con 0x55bee9c097c0 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.024+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94278453913616] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.025+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94278453915952] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.025+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.025+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94278453917008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c14fb0 con 0x55bee9c097c0 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.025+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c18650 con 0x55bee9c097c0 2024-09-21T09:04:16.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.026+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94278453917008] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.026+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.026+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94278453920064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c18610 con 0x55bee9c097c0 2024-09-21T09:04:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.026+0000 7f9cc8b51800 20 add_watcher() i=0 2024-09-21T09:04:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.026+0000 7f9cc8b51800 20 add_watcher() i=1 2024-09-21T09:04:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.026+0000 7f9cc8b51800 20 add_watcher() i=2 2024-09-21T09:04:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.026+0000 7f9cc8b51800 20 add_watcher() i=3 2024-09-21T09:04:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.026+0000 7f9cc8b51800 20 add_watcher() i=4 2024-09-21T09:04:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.026+0000 7f9cc8b51800 20 add_watcher() i=5 2024-09-21T09:04:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.026+0000 7f9cc8b51800 20 add_watcher() i=6 2024-09-21T09:04:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.027+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94278453920064] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.027+0000 7f9cc8b51800 20 add_watcher() i=7 2024-09-21T09:04:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.027+0000 7f9cc8b51800 2 all 8 watchers are set, enabling cache 2024-09-21T09:04:16.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.027+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c1ba70 con 0x55bee9c04db0 2024-09-21T09:04:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.028+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.028+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94278453918800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c18f90 con 0x55bee9c04db0 2024-09-21T09:04:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.029+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94278453918800] v31'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.029+0000 7f9b7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.029+0000 7f9cc8b51800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:04:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.029+0000 7f9cc8b51800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:04:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.029+0000 7f9cc8b51800 5 note: GC not initialized 2024-09-21T09:04:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.029+0000 7f9af77fe640 20 reqs_thread_entry: start 2024-09-21T09:04:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.029+0000 7f9cc8b51800 20 init_complete bucket index max shards: 11 2024-09-21T09:04:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.029+0000 7f9cc8b51800 20 Filter name: none 2024-09-21T09:04:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.029+0000 7f9af57fa640 20 reqs_thread_entry: start 2024-09-21T09:04:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.029+0000 7f9cc8b51800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.029+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c4e970 con 0x55bee9c04db0 2024-09-21T09:04:16.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.030+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.030+0000 7f9cc8b51800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:04:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.030+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c4fec0 con 0x55bee9c097c0 2024-09-21T09:04:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.030+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.031+0000 7f9b7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.031+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94278453918800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c1b3d0 con 0x55bee9c04db0 2024-09-21T09:04:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.032+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94278453918800] v31'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.032+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94278453898416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c17c50 con 0x7f9cc000f300 2024-09-21T09:04:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.033+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94278453898416] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x7f9cc000f300 2024-09-21T09:04:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.033+0000 7f9cc8b51800 20 remove_watcher() i=0 2024-09-21T09:04:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.033+0000 7f9cc8b51800 2 removed watcher, disabling cache 2024-09-21T09:04:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.033+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94278453895936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c12cb0 con 0x55bee9c04db0 2024-09-21T09:04:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.034+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94278453895936] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.034+0000 7f9cc8b51800 20 remove_watcher() i=1 2024-09-21T09:04:16.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.034+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94278453902368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c12300 con 0x55bee9c0e130 2024-09-21T09:04:16.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.035+0000 7f9cc6645640 1 -- 172.21.15.178:0/1480389240 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94278453902368] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc0019050 con 0x55bee9c0e130 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.035+0000 7f9cc8b51800 20 remove_watcher() i=2 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.035+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94278453909424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c13c20 con 0x7f9cc000f300 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.036+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94278453909424] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x7f9cc000f300 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.036+0000 7f9cc8b51800 20 remove_watcher() i=3 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.036+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94278453913616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c13c20 con 0x55bee9c04db0 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.037+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94278453913616] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb0051070 con 0x55bee9c04db0 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.037+0000 7f9cc8b51800 20 remove_watcher() i=4 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.037+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94278453915952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c16810 con 0x55bee9c097c0 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.038+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94278453915952] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.039+0000 7f9cc8b51800 20 remove_watcher() i=5 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.039+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94278453917008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c13c20 con 0x55bee9c097c0 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.039+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94278453917008] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.039+0000 7f9cc8b51800 20 remove_watcher() i=6 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.040+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94278453920064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bee9c175c0 con 0x55bee9c097c0 2024-09-21T09:04:16.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.040+0000 7f9cc6e46640 1 -- 172.21.15.178:0/1480389240 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94278453920064] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cb80083e0 con 0x55bee9c097c0 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.040+0000 7f9cc8b51800 20 remove_watcher() i=7 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55bee9c097c0 msgr2=0x55bee9c0bbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55bee9c097c0 0x55bee9c0bbb0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55bee9c04db0 msgr2=0x55bee9c07270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55bee9c04db0 0x55bee9c07270 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9cc000f300 msgr2=0x7f9cc004b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9cc000f300 0x7f9cc004b430 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55bee9c0e130 msgr2=0x55bee9c105f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55bee9c0e130 0x55bee9c105f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b90036b40 msgr2=0x7f9b90039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b90036b40 0x7f9b90039000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0019860 tx=0x7f9cc0043000 comp rx=0 tx=0).stop 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc5e44640 1 -- 172.21.15.178:0/1480389240 reap_dead start 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9bf2070 msgr2=0x55bee9bf9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9bf2070 0x55bee9bf9350 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80148c0 tx=0x7f9cb804cb00 comp rx=0 tx=0).stop 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 shutdown_connections 2024-09-21T09:04:16.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1480389240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9bf2070 0x55bee9bf9350 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 >> 172.21.15.178:0/1480389240 conn(0x55bee9bee420 msgr2=0x55bee9bec4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 shutdown_connections 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1480389240 wait complete. 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/125523420 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9ba0036b40 msgr2=0x7f9ba0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/125523420 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9ba0036b40 0x7f9ba0039000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55bee9bbb700 tx=0x7f9cc001c830 comp rx=0 tx=0).stop 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/125523420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9be53d0 msgr2=0x55bee9be57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/125523420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9be53d0 0x55bee9be57f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x55bee9bbc3b0 tx=0x7f9cb800aec0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/125523420 shutdown_connections 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/125523420 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9ba0036b40 0x7f9ba0039000 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/125523420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9be53d0 0x55bee9be57f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/125523420 >> 172.21.15.178:0/125523420 conn(0x55bee9bda360 msgr2=0x55bee9bdcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/125523420 shutdown_connections 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.041+0000 7f9cc8b51800 1 -- 172.21.15.178:0/125523420 wait complete. 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55bee9bd3db0 msgr2=0x55bee9bd6270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55bee9bd3db0 0x55bee9bd6270 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55bee9ad4920 msgr2=0x55bee9bd16d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55bee9ad4920 0x55bee9bd16d0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9bac036b40 msgr2=0x7f9bac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9bac036b40 0x7f9bac039000 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0057000 tx=0x7f9cb0052000 comp rx=0 tx=0).stop 2024-09-21T09:04:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad04e0 msgr2=0x55bee9bbc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad04e0 0x55bee9bbc670 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0000f80 tx=0x7f9cc0001250 comp rx=0 tx=0).stop 2024-09-21T09:04:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 shutdown_connections 2024-09-21T09:04:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55bee9bd3db0 0x55bee9bd6270 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55bee9ad4920 0x55bee9bd16d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9bac036b40 0x7f9bac039000 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 --2- 172.21.15.178:0/1759325717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bee9ad04e0 0x55bee9bbc670 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 >> 172.21.15.178:0/1759325717 conn(0x55bee9acbdb0 msgr2=0x55bee9bba260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 shutdown_connections 2024-09-21T09:04:16.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.042+0000 7f9cc8b51800 1 -- 172.21.15.178:0/1759325717 wait complete. 2024-09-21T09:04:16.052 INFO:teuthology.orchestra.run.smithi178.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-09-21T09:04:16.052 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-21T09:04:16.052 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-21T09:04:16.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-21T09:04:16.053 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-21T09:04:16.098 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:04:16.099 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:04:16.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.097+0000 7f1c41142800 1 Processor -- start 2024-09-21T09:04:16.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.098+0000 7f1c41142800 1 -- start start 2024-09-21T09:04:16.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.098+0000 7f1c41142800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56110b0c5a10 0x56110b0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.098+0000 7f1c41142800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56110af80b30 con 0x56110b0c1710 2024-09-21T09:04:16.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.098+0000 7f1c41142800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x56110af62360 con 0x56110b0c5a10 2024-09-21T09:04:16.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.098+0000 7f1c37fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56110b0c5a10 0x56110b0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.098+0000 7f1c3ce90640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x56110b0c1710 0x56110b0c1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:56354/0 (socket says 172.21.15.178:56354) 2024-09-21T09:04:16.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.098+0000 7f1c3ce90640 1 -- 172.21.15.178:0/1907542826 learned_addr learned my addr 172.21.15.178:0/1907542826 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:04:16.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.098+0000 7f1c37fff640 1 -- 172.21.15.178:0/1907542826 >> v1:172.21.15.44:6789/0 conn(0x56110b0c1710 legacy=0x56110b0c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.098+0000 7f1c37fff640 1 -- 172.21.15.178:0/1907542826 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56110af88e00 con 0x56110b0c5a10 2024-09-21T09:04:16.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.100+0000 7f1c37fff640 1 --2- 172.21.15.178:0/1907542826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c5a10 0x56110b0c7e00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800a470 tx=0x7f1c28045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74d7145bd5cab83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.100+0000 7f1c377fe640 1 -- 172.21.15.178:0/1907542826 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c28053570 con 0x56110b0c5a10 2024-09-21T09:04:16.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.100+0000 7f1c377fe640 1 -- 172.21.15.178:0/1907542826 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c28058070 con 0x56110b0c5a10 2024-09-21T09:04:16.102 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.100+0000 7f1c377fe640 1 -- 172.21.15.178:0/1907542826 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c28053880 con 0x56110b0c5a10 2024-09-21T09:04:16.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.101+0000 7f1c41142800 1 -- 172.21.15.178:0/1907542826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c5a10 msgr2=0x56110b0c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.101+0000 7f1c41142800 1 --2- 172.21.15.178:0/1907542826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c5a10 0x56110b0c7e00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800a470 tx=0x7f1c28045a20 comp rx=0 tx=0).stop 2024-09-21T09:04:16.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.101+0000 7f1c41142800 1 -- 172.21.15.178:0/1907542826 shutdown_connections 2024-09-21T09:04:16.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.101+0000 7f1c41142800 1 --2- 172.21.15.178:0/1907542826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c5a10 0x56110b0c7e00 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.101+0000 7f1c41142800 1 -- 172.21.15.178:0/1907542826 >> 172.21.15.178:0/1907542826 conn(0x56110b0bcfe0 msgr2=0x56110b0bf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.101+0000 7f1c41142800 1 -- 172.21.15.178:0/1907542826 shutdown_connections 2024-09-21T09:04:16.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.101+0000 7f1c41142800 1 -- 172.21.15.178:0/1907542826 wait complete. 2024-09-21T09:04:16.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.115+0000 7f1c41142800 1 Processor -- start 2024-09-21T09:04:16.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.115+0000 7f1c41142800 1 -- start start 2024-09-21T09:04:16.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.115+0000 7f1c41142800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c1710 0x56110b1b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.115+0000 7f1c41142800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56110b00d360 con 0x56110b0c1710 2024-09-21T09:04:16.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.115+0000 7f1c3ce90640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c1710 0x56110b1b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.115+0000 7f1c3ce90640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c1710 0x56110b1b08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42560/0 (socket says 172.21.15.178:42560) 2024-09-21T09:04:16.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.115+0000 7f1c3ce90640 1 -- 172.21.15.178:0/277763195 learned_addr learned my addr 172.21.15.178:0/277763195 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.116+0000 7f1c3ce90640 1 -- 172.21.15.178:0/277763195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56110af5abc0 con 0x56110b0c1710 2024-09-21T09:04:16.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.116+0000 7f1c3ce90640 1 --2- 172.21.15.178:0/277763195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c1710 0x56110b1b08b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1c30001e10 tx=0x7f1c3000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0332cd1bedf16b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.116+0000 7f1b2ae05640 1 -- 172.21.15.178:0/277763195 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c30012020 con 0x56110b0c1710 2024-09-21T09:04:16.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.116+0000 7f1b2ae05640 1 -- 172.21.15.178:0/277763195 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c3000e5a0 con 0x56110b0c1710 2024-09-21T09:04:16.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.116+0000 7f1b2ae05640 1 -- 172.21.15.178:0/277763195 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c3000e8e0 con 0x56110b0c1710 2024-09-21T09:04:16.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.117+0000 7f1c41142800 1 -- 172.21.15.178:0/277763195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c1710 msgr2=0x56110b1b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.117+0000 7f1c41142800 1 --2- 172.21.15.178:0/277763195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c1710 0x56110b1b08b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1c30001e10 tx=0x7f1c3000b780 comp rx=0 tx=0).stop 2024-09-21T09:04:16.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.117+0000 7f1c41142800 1 -- 172.21.15.178:0/277763195 shutdown_connections 2024-09-21T09:04:16.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.117+0000 7f1c41142800 1 --2- 172.21.15.178:0/277763195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c1710 0x56110b1b08b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.117+0000 7f1c41142800 1 -- 172.21.15.178:0/277763195 >> 172.21.15.178:0/277763195 conn(0x56110b0bcfe0 msgr2=0x56110b1ac270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.117+0000 7f1c41142800 1 -- 172.21.15.178:0/277763195 shutdown_connections 2024-09-21T09:04:16.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.117+0000 7f1c41142800 1 -- 172.21.15.178:0/277763195 wait complete. 2024-09-21T09:04:16.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.117+0000 7f1c41142800 1 Processor -- start 2024-09-21T09:04:16.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.117+0000 7f1c41142800 1 -- start start 2024-09-21T09:04:16.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.117+0000 7f1c41142800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c1710 0x56110b1b8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.117+0000 7f1c41142800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56110b0c8640 con 0x56110b0c1710 2024-09-21T09:04:16.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.117+0000 7f1c3ce90640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c1710 0x56110b1b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.118+0000 7f1c3ce90640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c1710 0x56110b1b8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42572/0 (socket says 172.21.15.178:42572) 2024-09-21T09:04:16.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.118+0000 7f1c3ce90640 1 -- 172.21.15.178:0/3498310254 learned_addr learned my addr 172.21.15.178:0/3498310254 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.118+0000 7f1c3ce90640 1 -- 172.21.15.178:0/3498310254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56110af6efe0 con 0x56110b0c1710 2024-09-21T09:04:16.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.118+0000 7f1c3ce90640 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c1710 0x56110b1b8290 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000b7c0 tx=0x7f1c30000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.118+0000 7f1b29602640 1 -- 172.21.15.178:0/3498310254 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c30012030 con 0x56110b0c1710 2024-09-21T09:04:16.121 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.118+0000 7f1b29602640 1 -- 172.21.15.178:0/3498310254 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c30001470 con 0x56110b0c1710 2024-09-21T09:04:16.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.118+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56110b1b87d0 con 0x56110b0c1710 2024-09-21T09:04:16.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.118+0000 7f1b29602640 1 -- 172.21.15.178:0/3498310254 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c3001a8d0 con 0x56110b0c1710 2024-09-21T09:04:16.122 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.118+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56110b1b8cf0 con 0x56110b0c1710 2024-09-21T09:04:16.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.119+0000 7f1b29602640 1 -- 172.21.15.178:0/3498310254 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1c30015020 con 0x56110b0c1710 2024-09-21T09:04:16.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.119+0000 7f1b29602640 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b24036b90 0x7f1b24039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.120+0000 7f1b29602640 1 -- 172.21.15.178:0/3498310254 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f1c30020030 con 0x56110b0c1710 2024-09-21T09:04:16.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.120+0000 7f1c37fff640 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b24036b90 0x7f1b24039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.120+0000 7f1c41142800 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56110b0c5a10 0x56110b1bf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.120+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b1bf840 con 0x56110b0c5a10 2024-09-21T09:04:16.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.120+0000 7f1c3d691640 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56110b0c5a10 0x56110b1bf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.120+0000 7f1c37fff640 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b24036b90 0x7f1b24039050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1c28057000 tx=0x7f1c28052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.120+0000 7f1c3d691640 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56110b0c5a10 0x56110b1bf300 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.120+0000 7f1c3d691640 1 -- 172.21.15.178:0/3498310254 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c3800a4a0 con 0x56110b0c5a10 2024-09-21T09:04:16.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.120+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b1bc8d0 con 0x56110b0c5a10 2024-09-21T09:04:16.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.121+0000 7f1c3d691640 1 -- 172.21.15.178:0/3498310254 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c3800a4a0 con 0x56110b0c5a10 2024-09-21T09:04:16.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.121+0000 7f1c41142800 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56110b1c1b90 0x56110b1c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.121+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b1c4670 con 0x56110b1c1b90 2024-09-21T09:04:16.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.121+0000 7f1c3ce90640 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56110b1c1b90 0x56110b1c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.121+0000 7f1c3ce90640 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56110b1c1b90 0x56110b1c3f80 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.122+0000 7f1c3ce90640 1 -- 172.21.15.178:0/3498310254 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1c1b90 2024-09-21T09:04:16.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.122+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b1c0a30 con 0x56110b0c5a10 2024-09-21T09:04:16.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.122+0000 7f1c3d691640 1 -- 172.21.15.178:0/3498310254 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c3800a4a0 con 0x56110b0c5a10 2024-09-21T09:04:16.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.122+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b1c0f10 con 0x56110b0c5a10 2024-09-21T09:04:16.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.122+0000 7f1c3d691640 1 -- 172.21.15.178:0/3498310254 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1c3800a4a0 con 0x56110b0c5a10 2024-09-21T09:04:16.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.123+0000 7f1c41142800 1 Processor -- start 2024-09-21T09:04:16.126 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.123+0000 7f1c41142800 1 -- start start 2024-09-21T09:04:16.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.123+0000 7f1c41142800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b1d2ff0 0x56110b1d3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.123+0000 7f1c41142800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56110af5c580 con 0x56110b1d2ff0 2024-09-21T09:04:16.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.123+0000 7f1c3d691640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b1d2ff0 0x56110b1d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.123+0000 7f1c3d691640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b1d2ff0 0x56110b1d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42574/0 (socket says 172.21.15.178:42574) 2024-09-21T09:04:16.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.123+0000 7f1c3d691640 1 -- 172.21.15.178:0/2840307558 learned_addr learned my addr 172.21.15.178:0/2840307558 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.123+0000 7f1c3d691640 1 -- 172.21.15.178:0/2840307558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56110b1d3950 con 0x56110b1d2ff0 2024-09-21T09:04:16.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.124+0000 7f1c3d691640 1 --2- 172.21.15.178:0/2840307558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b1d2ff0 0x56110b1d3410 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x56110b1bfc40 tx=0x7f1c38018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.124+0000 7f1b227fc640 1 -- 172.21.15.178:0/2840307558 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c38014450 con 0x56110b1d2ff0 2024-09-21T09:04:16.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.124+0000 7f1b227fc640 1 -- 172.21.15.178:0/2840307558 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c38014610 con 0x56110b1d2ff0 2024-09-21T09:04:16.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.124+0000 7f1c41142800 1 -- 172.21.15.178:0/2840307558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56110b1d3be0 con 0x56110b1d2ff0 2024-09-21T09:04:16.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.124+0000 7f1b227fc640 1 -- 172.21.15.178:0/2840307558 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c38014930 con 0x56110b1d2ff0 2024-09-21T09:04:16.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.124+0000 7f1c41142800 1 -- 172.21.15.178:0/2840307558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56110b1d68c0 con 0x56110b1d2ff0 2024-09-21T09:04:16.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.125+0000 7f1b227fc640 1 -- 172.21.15.178:0/2840307558 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1c38011040 con 0x56110b1d2ff0 2024-09-21T09:04:16.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.125+0000 7f1b227fc640 1 --2- 172.21.15.178:0/2840307558 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b14036b40 0x7f1b14039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.125+0000 7f1b227fc640 1 -- 172.21.15.178:0/2840307558 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f1c3801e070 con 0x56110b1d2ff0 2024-09-21T09:04:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.125+0000 7f1c3ce90640 1 --2- 172.21.15.178:0/2840307558 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b14036b40 0x7f1b14039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.125+0000 7f1c41142800 1 Processor -- start 2024-09-21T09:04:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.125+0000 7f1c3ce90640 1 --2- 172.21.15.178:0/2840307558 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b14036b40 0x7f1b14039000 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x56110b1bfce0 tx=0x7f1c3004b030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.125+0000 7f1c41142800 1 -- start start 2024-09-21T09:04:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.125+0000 7f1c41142800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b037030 0x56110b037430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.126+0000 7f1c41142800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56110b1b1060 con 0x56110b037030 2024-09-21T09:04:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.126+0000 7f1c3d691640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b037030 0x56110b037430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.126+0000 7f1c3d691640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b037030 0x56110b037430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42578/0 (socket says 172.21.15.178:42578) 2024-09-21T09:04:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.126+0000 7f1c3d691640 1 -- 172.21.15.178:0/443113438 learned_addr learned my addr 172.21.15.178:0/443113438 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.126+0000 7f1c3d691640 1 -- 172.21.15.178:0/443113438 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56110b037a00 con 0x56110b037030 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.126+0000 7f1c3d691640 1 --2- 172.21.15.178:0/443113438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b037030 0x56110b037430 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1c3804cbd0 tx=0x7f1c3804ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2caae4a05f1159 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.126+0000 7f1b13fff640 1 -- 172.21.15.178:0/443113438 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c38043020 con 0x56110b037030 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.126+0000 7f1b13fff640 1 -- 172.21.15.178:0/443113438 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c38040150 con 0x56110b037030 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.126+0000 7f1b13fff640 1 -- 172.21.15.178:0/443113438 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c38016570 con 0x56110b037030 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.127+0000 7f1c41142800 1 -- 172.21.15.178:0/443113438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b037030 msgr2=0x56110b037430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.127+0000 7f1c41142800 1 --2- 172.21.15.178:0/443113438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b037030 0x56110b037430 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1c3804cbd0 tx=0x7f1c3804ce80 comp rx=0 tx=0).stop 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.127+0000 7f1c41142800 1 -- 172.21.15.178:0/443113438 shutdown_connections 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.127+0000 7f1c41142800 1 --2- 172.21.15.178:0/443113438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b037030 0x56110b037430 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.127+0000 7f1c41142800 1 -- 172.21.15.178:0/443113438 >> 172.21.15.178:0/443113438 conn(0x56110b1dc020 msgr2=0x56110b1da120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.127+0000 7f1c41142800 1 -- 172.21.15.178:0/443113438 shutdown_connections 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.127+0000 7f1c41142800 1 -- 172.21.15.178:0/443113438 wait complete. 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.127+0000 7f1c41142800 1 Processor -- start 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.127+0000 7f1c41142800 1 -- start start 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.127+0000 7f1c41142800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b037030 0x56110b1e9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.127+0000 7f1c41142800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56110b035d10 con 0x56110b037030 2024-09-21T09:04:16.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.128+0000 7f1c3d691640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b037030 0x56110b1e9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.128+0000 7f1c3d691640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b037030 0x56110b1e9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42590/0 (socket says 172.21.15.178:42590) 2024-09-21T09:04:16.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.128+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 learned_addr learned my addr 172.21.15.178:0/619529676 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.128+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56110b1e9780 con 0x56110b037030 2024-09-21T09:04:16.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.128+0000 7f1c3d691640 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b037030 0x56110b1e9240 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800aa40 tx=0x7f1c3804cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.128+0000 7f1b127fc640 1 -- 172.21.15.178:0/619529676 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c38011840 con 0x56110b037030 2024-09-21T09:04:16.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.128+0000 7f1b127fc640 1 -- 172.21.15.178:0/619529676 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c38014d30 con 0x56110b037030 2024-09-21T09:04:16.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.128+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56110b1e9a10 con 0x56110b037030 2024-09-21T09:04:16.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.128+0000 7f1b127fc640 1 -- 172.21.15.178:0/619529676 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c3804e240 con 0x56110b037030 2024-09-21T09:04:16.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.128+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56110b1ec6c0 con 0x56110b037030 2024-09-21T09:04:16.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.129+0000 7f1b127fc640 1 -- 172.21.15.178:0/619529676 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1c3804e3e0 con 0x56110b037030 2024-09-21T09:04:16.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.129+0000 7f1b127fc640 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b08036b40 0x7f1b08039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.129+0000 7f1b127fc640 1 -- 172.21.15.178:0/619529676 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f1c3800e040 con 0x56110b037030 2024-09-21T09:04:16.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.129+0000 7f1c3ce90640 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b08036b40 0x7f1b08039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.129+0000 7f1c41142800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.129+0000 7f1c41142800 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56110b1f4d40 0x56110b1f7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.129+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b1f7950 con 0x56110b1f4d40 2024-09-21T09:04:16.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.130+0000 7f1c37fff640 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56110b1f4d40 0x56110b1f7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.130+0000 7f1c3ce90640 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b08036b40 0x7f1b08039000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1c30000fd0 tx=0x7f1c30033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.130+0000 7f1c37fff640 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56110b1f4d40 0x56110b1f7200 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.130+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.130+0000 7f1c41142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.130+0000 7f1c41142800 20 realm 2024-09-21T09:04:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.130+0000 7f1c41142800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.130+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b1f7d80 con 0x56110b1f4d40 2024-09-21T09:04:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.130+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.130+0000 7f1c41142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.130+0000 7f1c41142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:04:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.130+0000 7f1c41142800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.130+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b1f8650 con 0x56110b1f4d40 2024-09-21T09:04:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.131+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.131+0000 7f1c41142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.131+0000 7f1c41142800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.131+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b1f89f0 con 0x56110b1f4d40 2024-09-21T09:04:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.131+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.131+0000 7f1c41142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.131+0000 7f1c41142800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.131+0000 7f1c41142800 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56110b1f9750 0x56110b1fbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.131+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b1fc080 con 0x56110b1f9750 2024-09-21T09:04:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.131+0000 7f1c3d691640 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56110b1f9750 0x56110b1fbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.131+0000 7f1c3d691640 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56110b1f9750 0x56110b1fbb40 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.132+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.132+0000 7f1c41142800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:04:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.132+0000 7f1c41142800 20 searching for the correct realm 2024-09-21T09:04:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.132+0000 7f1c41142800 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56110b1fe0c0 0x56110b200580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.132+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1fe0c0 2024-09-21T09:04:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.132+0000 7f1c3ce90640 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56110b1fe0c0 0x56110b200580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.132+0000 7f1c3ce90640 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56110b1fe0c0 0x56110b200580 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.132+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1fe0c0 2024-09-21T09:04:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.132+0000 7f1c3ce90640 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f1c30017050 0x7f1c3002d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.132+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x7f1c30017050 2024-09-21T09:04:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.132+0000 7f1c37fff640 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f1c30017050 0x7f1c3002d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.133+0000 7f1c37fff640 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f1c30017050 0x7f1c3002d3f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.133+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c28051070 con 0x7f1c30017050 2024-09-21T09:04:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.133+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f9750 2024-09-21T09:04:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.134+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.134+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f4d40 2024-09-21T09:04:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.134+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.134+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f4d40 2024-09-21T09:04:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.134+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.134+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f9750 2024-09-21T09:04:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.134+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.134+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f9750 2024-09-21T09:04:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.134+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.134+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x7f1c30017050 2024-09-21T09:04:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.135+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c28051070 con 0x7f1c30017050 2024-09-21T09:04:16.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.135+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1fe0c0 2024-09-21T09:04:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.135+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1fe0c0 2024-09-21T09:04:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.135+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f4d40 2024-09-21T09:04:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.135+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.135+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f9750 2024-09-21T09:04:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.136+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.136+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f4d40 2024-09-21T09:04:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.136+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.136+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x7f1c30017050 2024-09-21T09:04:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.136+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1c28051070 con 0x7f1c30017050 2024-09-21T09:04:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.136+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1fe0c0 2024-09-21T09:04:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.136+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1fe0c0 2024-09-21T09:04:16.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.136+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1fe0c0 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.136+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1fe0c0 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.136+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f9750 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.137+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.137+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1fe0c0 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.137+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1fe0c0 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.137+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1fe0c0 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.137+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1fe0c0 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.137+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f4d40 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.137+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.137+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f4d40 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.138+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.138+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f9750 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.138+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.138+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1fe0c0 2024-09-21T09:04:16.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.138+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1fe0c0 2024-09-21T09:04:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.138+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x7f1c30017050 2024-09-21T09:04:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.138+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c28051070 con 0x7f1c30017050 2024-09-21T09:04:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.138+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f4d40 2024-09-21T09:04:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.139+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.139+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f9750 2024-09-21T09:04:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.139+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.139+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1fe0c0 2024-09-21T09:04:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.139+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1fe0c0 2024-09-21T09:04:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.139+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x7f1c30017050 2024-09-21T09:04:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.139+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c28051070 con 0x7f1c30017050 2024-09-21T09:04:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.139+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x7f1c30017050 2024-09-21T09:04:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.140+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c28051070 con 0x7f1c30017050 2024-09-21T09:04:16.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.140+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1fe0c0 2024-09-21T09:04:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.140+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1fe0c0 2024-09-21T09:04:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.140+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f9750 2024-09-21T09:04:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.140+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.140+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x56110b1f4d40 2024-09-21T09:04:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.140+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56110b200c50 con 0x7f1c30017050 2024-09-21T09:04:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c28051070 con 0x7f1c30017050 2024-09-21T09:04:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:04:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:04:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:04:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:04:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:04:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:04:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b1fcac0 con 0x56110b1f4d40 2024-09-21T09:04:16.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b1fcf40 con 0x56110b1f4d40 2024-09-21T09:04:16.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:16.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b1fd420 con 0x56110b1f4d40 2024-09-21T09:04:16.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:04:16.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 zone default found 2024-09-21T09:04:16.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 4 Realm: () 2024-09-21T09:04:16.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:04:16.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:04:16.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:04:16.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 zonegroup default 2024-09-21T09:04:16.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.141+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b2010d0 con 0x56110b1f9750 2024-09-21T09:04:16.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.142+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.142+0000 7f1c41142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.142+0000 7f1c41142800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.142+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b203300 con 0x56110b1fe0c0 2024-09-21T09:04:16.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.142+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1fe0c0 2024-09-21T09:04:16.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.142+0000 7f1c41142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.142+0000 7f1c41142800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.142+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b2036a0 con 0x56110b1fe0c0 2024-09-21T09:04:16.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.142+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1fe0c0 2024-09-21T09:04:16.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.142+0000 7f1c41142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.142+0000 7f1c41142800 20 started sync module instance, tier type = 2024-09-21T09:04:16.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.142+0000 7f1c41142800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:04:16.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.142+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b202740 con 0x7f1c30017050 2024-09-21T09:04:16.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.143+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x7f1c30017050 2024-09-21T09:04:16.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.143+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94631201090704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b202740 con 0x7f1c30017050 2024-09-21T09:04:16.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.143+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b204060 con 0x56110b1f4d40 2024-09-21T09:04:16.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.144+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94631201090704] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x7f1c30017050 2024-09-21T09:04:16.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.145+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.145+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94631201088624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b204060 con 0x56110b1f4d40 2024-09-21T09:04:16.158 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.145+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b204a60 con 0x56110b1fe0c0 2024-09-21T09:04:16.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.146+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1fe0c0 2024-09-21T09:04:16.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.146+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94631201097072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b205300 con 0x56110b1fe0c0 2024-09-21T09:04:16.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.146+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b205da0 con 0x7f1c30017050 2024-09-21T09:04:16.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.146+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94631201088624] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.147+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94631201097072] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1fe0c0 2024-09-21T09:04:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.147+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x7f1c30017050 2024-09-21T09:04:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.147+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94631201099344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b203bb0 con 0x7f1c30017050 2024-09-21T09:04:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.147+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b206640 con 0x56110b1f4d40 2024-09-21T09:04:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.148+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.148+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94631201104192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b206560 con 0x56110b1f4d40 2024-09-21T09:04:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.148+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b207560 con 0x56110b1f9750 2024-09-21T09:04:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.148+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94631201099344] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x7f1c30017050 2024-09-21T09:04:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.149+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.149+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94631201108048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b207950 con 0x56110b1f9750 2024-09-21T09:04:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.149+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b208310 con 0x56110b1f9750 2024-09-21T09:04:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.150+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94631201104192] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.150+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94631201108048] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.151+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.151+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94631201101936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b207e60 con 0x56110b1f9750 2024-09-21T09:04:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.151+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b208820 con 0x56110b1f9750 2024-09-21T09:04:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.152+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94631201101936] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.152+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.152+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94631201106480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b208820 con 0x56110b1f9750 2024-09-21T09:04:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.152+0000 7f1c41142800 20 add_watcher() i=0 2024-09-21T09:04:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.152+0000 7f1c41142800 20 add_watcher() i=1 2024-09-21T09:04:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.152+0000 7f1c41142800 20 add_watcher() i=2 2024-09-21T09:04:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.152+0000 7f1c41142800 20 add_watcher() i=3 2024-09-21T09:04:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.152+0000 7f1c41142800 20 add_watcher() i=4 2024-09-21T09:04:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.152+0000 7f1c41142800 20 add_watcher() i=5 2024-09-21T09:04:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.152+0000 7f1c41142800 20 add_watcher() i=6 2024-09-21T09:04:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.153+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94631201106480] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.153+0000 7f1c41142800 20 add_watcher() i=7 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.153+0000 7f1c41142800 2 all 8 watchers are set, enabling cache 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.153+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b20bc50 con 0x56110b1f4d40 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.153+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.153+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94631201113408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b209100 con 0x56110b1f4d40 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.154+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94631201113408] v31'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.154+0000 7f1af2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.154+0000 7f1c41142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.154+0000 7f1c41142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.154+0000 7f1c41142800 5 note: GC not initialized 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.154+0000 7f1af1fe3640 20 reqs_thread_entry: start 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.154+0000 7f1c41142800 20 init_complete bucket index max shards: 11 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.155+0000 7f1c41142800 20 Filter name: none 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.155+0000 7f1a637fe640 20 reqs_thread_entry: start 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.155+0000 7f1c41142800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.155+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b23eb50 con 0x56110b1f4d40 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.155+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.155+0000 7f1c41142800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.155+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56110b2400a0 con 0x56110b1f9750 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.156+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.157+0000 7f1af2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.157+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94631201113408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b20b140 con 0x56110b1f4d40 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.158+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94631201113408] v31'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.158+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94631201090704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b208510 con 0x7f1c30017050 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.159+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94631201090704] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x7f1c30017050 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.159+0000 7f1c41142800 20 remove_watcher() i=0 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.159+0000 7f1c41142800 2 removed watcher, disabling cache 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.159+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94631201088624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b202c70 con 0x56110b1f4d40 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.160+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94631201088624] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.160+0000 7f1c41142800 20 remove_watcher() i=1 2024-09-21T09:04:16.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.160+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94631201097072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b202470 con 0x56110b1fe0c0 2024-09-21T09:04:16.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.161+0000 7f1c3ce90640 1 -- 172.21.15.178:0/619529676 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94631201097072] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c3002dcf0 con 0x56110b1fe0c0 2024-09-21T09:04:16.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.161+0000 7f1c41142800 20 remove_watcher() i=2 2024-09-21T09:04:16.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.161+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94631201099344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b202c70 con 0x7f1c30017050 2024-09-21T09:04:16.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.162+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94631201099344] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x7f1c30017050 2024-09-21T09:04:16.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.162+0000 7f1c41142800 20 remove_watcher() i=3 2024-09-21T09:04:16.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.162+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94631201104192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b204e50 con 0x56110b1f4d40 2024-09-21T09:04:16.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.163+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94631201104192] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c28051070 con 0x56110b1f4d40 2024-09-21T09:04:16.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.163+0000 7f1c41142800 20 remove_watcher() i=4 2024-09-21T09:04:16.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.163+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94631201108048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b204e50 con 0x56110b1f9750 2024-09-21T09:04:16.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.164+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94631201108048] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.164+0000 7f1c41142800 20 remove_watcher() i=5 2024-09-21T09:04:16.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.164+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94631201101936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b207050 con 0x56110b1f9750 2024-09-21T09:04:16.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.165+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94631201101936] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.165+0000 7f1c41142800 20 remove_watcher() i=6 2024-09-21T09:04:16.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.165+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94631201106480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56110b204e50 con 0x56110b1f9750 2024-09-21T09:04:16.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c3d691640 1 -- 172.21.15.178:0/619529676 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94631201106480] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c38045040 con 0x56110b1f9750 2024-09-21T09:04:16.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 20 remove_watcher() i=7 2024-09-21T09:04:16.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56110b1f9750 msgr2=0x56110b1fbb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56110b1f9750 0x56110b1fbb40 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56110b1f4d40 msgr2=0x56110b1f7200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56110b1f4d40 0x56110b1f7200 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f1c30017050 msgr2=0x7f1c3002d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f1c30017050 0x7f1c3002d3f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56110b1fe0c0 msgr2=0x56110b200580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56110b1fe0c0 0x56110b200580 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b08036b40 msgr2=0x7f1b08039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b08036b40 0x7f1b08039000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1c30000fd0 tx=0x7f1c30033000 comp rx=0 tx=0).stop 2024-09-21T09:04:16.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b037030 msgr2=0x56110b1e9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c37fff640 1 -- 172.21.15.178:0/619529676 reap_dead start 2024-09-21T09:04:16.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b037030 0x56110b1e9240 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800aa40 tx=0x7f1c3804cb60 comp rx=0 tx=0).stop 2024-09-21T09:04:16.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 shutdown_connections 2024-09-21T09:04:16.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 --2- 172.21.15.178:0/619529676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b037030 0x56110b1e9240 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 >> 172.21.15.178:0/619529676 conn(0x56110b1dc020 msgr2=0x56110b1da0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 shutdown_connections 2024-09-21T09:04:16.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.166+0000 7f1c41142800 1 -- 172.21.15.178:0/619529676 wait complete. 2024-09-21T09:04:16.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 -- 172.21.15.178:0/2840307558 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b14036b40 msgr2=0x7f1b14039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 --2- 172.21.15.178:0/2840307558 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b14036b40 0x7f1b14039000 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x56110b1bfce0 tx=0x7f1c3004b030 comp rx=0 tx=0).stop 2024-09-21T09:04:16.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 -- 172.21.15.178:0/2840307558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b1d2ff0 msgr2=0x56110b1d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 --2- 172.21.15.178:0/2840307558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b1d2ff0 0x56110b1d3410 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x56110b1bfc40 tx=0x7f1c38018830 comp rx=0 tx=0).stop 2024-09-21T09:04:16.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 -- 172.21.15.178:0/2840307558 shutdown_connections 2024-09-21T09:04:16.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 --2- 172.21.15.178:0/2840307558 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b14036b40 0x7f1b14039000 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 --2- 172.21.15.178:0/2840307558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b1d2ff0 0x56110b1d3410 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 -- 172.21.15.178:0/2840307558 >> 172.21.15.178:0/2840307558 conn(0x56110b1c7f80 msgr2=0x56110b1cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 -- 172.21.15.178:0/2840307558 shutdown_connections 2024-09-21T09:04:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 -- 172.21.15.178:0/2840307558 wait complete. 2024-09-21T09:04:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56110b1c1b90 msgr2=0x56110b1c3f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56110b1c1b90 0x56110b1c3f80 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56110b0c5a10 msgr2=0x56110b1bf300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56110b0c5a10 0x56110b1bf300 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b24036b90 msgr2=0x7f1b24039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b24036b90 0x7f1b24039050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1c28057000 tx=0x7f1c28052000 comp rx=0 tx=0).stop 2024-09-21T09:04:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c1710 msgr2=0x56110b1b8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c1710 0x56110b1b8290 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000b7c0 tx=0x7f1c30000ed0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 shutdown_connections 2024-09-21T09:04:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56110b1c1b90 0x56110b1c3f80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56110b0c5a10 0x56110b1bf300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1b24036b90 0x7f1b24039050 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 --2- 172.21.15.178:0/3498310254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56110b0c1710 0x56110b1b8290 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 >> 172.21.15.178:0/3498310254 conn(0x56110b0bcfe0 msgr2=0x56110b1aab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 shutdown_connections 2024-09-21T09:04:16.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.167+0000 7f1c41142800 1 -- 172.21.15.178:0/3498310254 wait complete. 2024-09-21T09:04:16.178 INFO:teuthology.orchestra.run.smithi178.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-21T09:04:16.178 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-21T09:04:16.178 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-21T09:04:16.178 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-21T09:04:16.179 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-21T09:04:16.224 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:04:16.224 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:04:16.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.223+0000 7fc863e87800 1 Processor -- start 2024-09-21T09:04:16.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.223+0000 7fc863e87800 1 -- start start 2024-09-21T09:04:16.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.223+0000 7fc863e87800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55ba64fbed20 0x55ba64fc1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.223+0000 7fc863e87800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ba64e77b30 con 0x55ba64f2c630 2024-09-21T09:04:16.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.223+0000 7fc863e87800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55ba64e59360 con 0x55ba64fbed20 2024-09-21T09:04:16.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.224+0000 7fc85bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55ba64fbed20 0x55ba64fc1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.224+0000 7fc85bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55ba64fbed20 0x55ba64fc1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42600/0 (socket says 172.21.15.178:42600) 2024-09-21T09:04:16.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.224+0000 7fc85bfff640 1 -- 172.21.15.178:0/2321326425 learned_addr learned my addr 172.21.15.178:0/2321326425 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.224+0000 7fc85bfff640 1 -- 172.21.15.178:0/2321326425 >> v1:172.21.15.44:6789/0 conn(0x55ba64f2c630 legacy=0x55ba64fbd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.224+0000 7fc85bfff640 1 -- 172.21.15.178:0/2321326425 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba64e7fe00 con 0x55ba64fbed20 2024-09-21T09:04:16.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.224+0000 7fc86117a640 1 -- 172.21.15.178:0/2321326425 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 845009549 0 0) 0x55ba64e77b30 con 0x55ba64f2c630 2024-09-21T09:04:16.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.226+0000 7fc85bfff640 1 --2- 172.21.15.178:0/2321326425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64fbed20 0x55ba64fc1110 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00a520 tx=0x7fc84c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21ec6b51c97c966 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.226+0000 7fc86117a640 1 -- 172.21.15.178:0/2321326425 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc84c055070 con 0x55ba64fbed20 2024-09-21T09:04:16.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.226+0000 7fc86117a640 1 -- 172.21.15.178:0/2321326425 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84c0515b0 con 0x55ba64fbed20 2024-09-21T09:04:16.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.226+0000 7fc86117a640 1 -- 172.21.15.178:0/2321326425 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc84c0518d0 con 0x55ba64fbed20 2024-09-21T09:04:16.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.227+0000 7fc863e87800 1 -- 172.21.15.178:0/2321326425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64fbed20 msgr2=0x55ba64fc1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.227+0000 7fc863e87800 1 --2- 172.21.15.178:0/2321326425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64fbed20 0x55ba64fc1110 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00a520 tx=0x7fc84c045ba0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.227+0000 7fc863e87800 1 -- 172.21.15.178:0/2321326425 shutdown_connections 2024-09-21T09:04:16.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.227+0000 7fc863e87800 1 --2- 172.21.15.178:0/2321326425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64fbed20 0x55ba64fc1110 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.227+0000 7fc863e87800 1 -- 172.21.15.178:0/2321326425 >> 172.21.15.178:0/2321326425 conn(0x55ba64fb2db0 msgr2=0x55ba64fb51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.227+0000 7fc863e87800 1 -- 172.21.15.178:0/2321326425 shutdown_connections 2024-09-21T09:04:16.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.227+0000 7fc863e87800 1 -- 172.21.15.178:0/2321326425 wait complete. 2024-09-21T09:04:16.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.241+0000 7fc863e87800 1 Processor -- start 2024-09-21T09:04:16.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.241+0000 7fc863e87800 1 -- start start 2024-09-21T09:04:16.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.241+0000 7fc863e87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64f2c630 0x55ba650a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.241+0000 7fc863e87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ba64f04360 con 0x55ba64f2c630 2024-09-21T09:04:16.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.241+0000 7fc86197b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64f2c630 0x55ba650a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.241+0000 7fc86197b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64f2c630 0x55ba650a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42606/0 (socket says 172.21.15.178:42606) 2024-09-21T09:04:16.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.241+0000 7fc86197b640 1 -- 172.21.15.178:0/4183061510 learned_addr learned my addr 172.21.15.178:0/4183061510 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.242+0000 7fc86197b640 1 -- 172.21.15.178:0/4183061510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba64e51bc0 con 0x55ba64f2c630 2024-09-21T09:04:16.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.242+0000 7fc86197b640 1 --2- 172.21.15.178:0/4183061510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64f2c630 0x55ba650a98d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc854001e30 tx=0x7fc85400b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b503fb055cc14f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.242+0000 7fc74fe07640 1 -- 172.21.15.178:0/4183061510 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc854016070 con 0x55ba64f2c630 2024-09-21T09:04:16.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.242+0000 7fc74fe07640 1 -- 172.21.15.178:0/4183061510 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85400d4b0 con 0x55ba64f2c630 2024-09-21T09:04:16.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.242+0000 7fc74fe07640 1 -- 172.21.15.178:0/4183061510 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc85400d810 con 0x55ba64f2c630 2024-09-21T09:04:16.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.243+0000 7fc863e87800 1 -- 172.21.15.178:0/4183061510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64f2c630 msgr2=0x55ba650a98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.243+0000 7fc863e87800 1 --2- 172.21.15.178:0/4183061510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64f2c630 0x55ba650a98d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc854001e30 tx=0x7fc85400b650 comp rx=0 tx=0).stop 2024-09-21T09:04:16.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.243+0000 7fc863e87800 1 -- 172.21.15.178:0/4183061510 shutdown_connections 2024-09-21T09:04:16.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.243+0000 7fc863e87800 1 --2- 172.21.15.178:0/4183061510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64f2c630 0x55ba650a98d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.243+0000 7fc863e87800 1 -- 172.21.15.178:0/4183061510 >> 172.21.15.178:0/4183061510 conn(0x55ba64fb2db0 msgr2=0x55ba650a5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.243+0000 7fc863e87800 1 -- 172.21.15.178:0/4183061510 shutdown_connections 2024-09-21T09:04:16.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.243+0000 7fc863e87800 1 -- 172.21.15.178:0/4183061510 wait complete. 2024-09-21T09:04:16.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.243+0000 7fc863e87800 1 Processor -- start 2024-09-21T09:04:16.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.244+0000 7fc863e87800 1 -- start start 2024-09-21T09:04:16.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.244+0000 7fc863e87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64f2c630 0x55ba650b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.244+0000 7fc863e87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ba64fc1920 con 0x55ba64f2c630 2024-09-21T09:04:16.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.244+0000 7fc86197b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64f2c630 0x55ba650b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.244+0000 7fc86197b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64f2c630 0x55ba650b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42618/0 (socket says 172.21.15.178:42618) 2024-09-21T09:04:16.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.244+0000 7fc86197b640 1 -- 172.21.15.178:0/179532377 learned_addr learned my addr 172.21.15.178:0/179532377 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.244+0000 7fc86197b640 1 -- 172.21.15.178:0/179532377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba64e65fe0 con 0x55ba64f2c630 2024-09-21T09:04:16.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.244+0000 7fc86197b640 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64f2c630 0x55ba650b1370 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc85400b690 tx=0x7fc854000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.245+0000 7fc74e604640 1 -- 172.21.15.178:0/179532377 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc854016030 con 0x55ba64f2c630 2024-09-21T09:04:16.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.245+0000 7fc74e604640 1 -- 172.21.15.178:0/179532377 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc854017040 con 0x55ba64f2c630 2024-09-21T09:04:16.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.245+0000 7fc74e604640 1 -- 172.21.15.178:0/179532377 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8540108b0 con 0x55ba64f2c630 2024-09-21T09:04:16.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.245+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba650b18b0 con 0x55ba64f2c630 2024-09-21T09:04:16.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.245+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba650b1dd0 con 0x55ba64f2c630 2024-09-21T09:04:16.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.245+0000 7fc74e604640 1 -- 172.21.15.178:0/179532377 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc854026020 con 0x55ba64f2c630 2024-09-21T09:04:16.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.246+0000 7fc74e604640 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc748036b90 0x7fc748039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.246+0000 7fc74e604640 1 -- 172.21.15.178:0/179532377 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fc854024020 con 0x55ba64f2c630 2024-09-21T09:04:16.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.246+0000 7fc85bfff640 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc748036b90 0x7fc748039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.246+0000 7fc863e87800 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ba64fbed20 0x55ba650b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.246+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650b8960 con 0x55ba64fbed20 2024-09-21T09:04:16.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.246+0000 7fc86217c640 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ba64fbed20 0x55ba650b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.246+0000 7fc85bfff640 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc748036b90 0x7fc748039050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc84c057000 tx=0x7fc84c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.246+0000 7fc86217c640 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ba64fbed20 0x55ba650b83e0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.247+0000 7fc86217c640 1 -- 172.21.15.178:0/179532377 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc85c00a4a0 con 0x55ba64fbed20 2024-09-21T09:04:16.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.247+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650b59b0 con 0x55ba64fbed20 2024-09-21T09:04:16.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.247+0000 7fc86217c640 1 -- 172.21.15.178:0/179532377 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc85c00a4a0 con 0x55ba64fbed20 2024-09-21T09:04:16.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.247+0000 7fc863e87800 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ba650bacb0 0x55ba650bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.247+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650bd790 con 0x55ba650bacb0 2024-09-21T09:04:16.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.247+0000 7fc86197b640 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ba650bacb0 0x55ba650bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.248+0000 7fc86197b640 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ba650bacb0 0x55ba650bd0a0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.248+0000 7fc86197b640 1 -- 172.21.15.178:0/179532377 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc854028930 con 0x55ba650bacb0 2024-09-21T09:04:16.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.248+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650b9b50 con 0x55ba64fbed20 2024-09-21T09:04:16.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.248+0000 7fc86217c640 1 -- 172.21.15.178:0/179532377 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc85c00a4a0 con 0x55ba64fbed20 2024-09-21T09:04:16.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.248+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650ba030 con 0x55ba64fbed20 2024-09-21T09:04:16.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.248+0000 7fc86217c640 1 -- 172.21.15.178:0/179532377 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc85c00a4a0 con 0x55ba64fbed20 2024-09-21T09:04:16.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.249+0000 7fc863e87800 1 Processor -- start 2024-09-21T09:04:16.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.249+0000 7fc863e87800 1 -- start start 2024-09-21T09:04:16.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.249+0000 7fc863e87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650cc110 0x55ba650cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.249+0000 7fc863e87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ba64e53580 con 0x55ba650cc110 2024-09-21T09:04:16.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.249+0000 7fc86217c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650cc110 0x55ba650cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.249+0000 7fc86217c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650cc110 0x55ba650cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42620/0 (socket says 172.21.15.178:42620) 2024-09-21T09:04:16.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.249+0000 7fc86217c640 1 -- 172.21.15.178:0/1647285911 learned_addr learned my addr 172.21.15.178:0/1647285911 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.249+0000 7fc86217c640 1 -- 172.21.15.178:0/1647285911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba650cca70 con 0x55ba650cc110 2024-09-21T09:04:16.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.250+0000 7fc86217c640 1 --2- 172.21.15.178:0/1647285911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650cc110 0x55ba650cc530 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55ba650b8d60 tx=0x7fc85c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.250+0000 7fc7477fe640 1 -- 172.21.15.178:0/1647285911 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc85c014450 con 0x55ba650cc110 2024-09-21T09:04:16.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.250+0000 7fc7477fe640 1 -- 172.21.15.178:0/1647285911 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85c014610 con 0x55ba650cc110 2024-09-21T09:04:16.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.250+0000 7fc863e87800 1 -- 172.21.15.178:0/1647285911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba650ccd00 con 0x55ba650cc110 2024-09-21T09:04:16.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.250+0000 7fc7477fe640 1 -- 172.21.15.178:0/1647285911 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc85c014930 con 0x55ba650cc110 2024-09-21T09:04:16.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.250+0000 7fc863e87800 1 -- 172.21.15.178:0/1647285911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba650cf9e0 con 0x55ba650cc110 2024-09-21T09:04:16.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.251+0000 7fc7477fe640 1 -- 172.21.15.178:0/1647285911 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc85c011040 con 0x55ba650cc110 2024-09-21T09:04:16.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.251+0000 7fc7477fe640 1 --2- 172.21.15.178:0/1647285911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc73c036b40 0x7fc73c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.251+0000 7fc7477fe640 1 -- 172.21.15.178:0/1647285911 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fc85c01e070 con 0x55ba650cc110 2024-09-21T09:04:16.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.251+0000 7fc86197b640 1 --2- 172.21.15.178:0/1647285911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc73c036b40 0x7fc73c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.251+0000 7fc863e87800 1 Processor -- start 2024-09-21T09:04:16.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.251+0000 7fc863e87800 1 -- start start 2024-09-21T09:04:16.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.251+0000 7fc86197b640 1 --2- 172.21.15.178:0/1647285911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc73c036b40 0x7fc73c039000 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55ba650b8e00 tx=0x7fc85400ff90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.251+0000 7fc863e87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650d8d70 0x55ba650d9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.251+0000 7fc863e87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ba650aa080 con 0x55ba650d8d70 2024-09-21T09:04:16.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.252+0000 7fc86217c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650d8d70 0x55ba650d9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.252+0000 7fc86217c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650d8d70 0x55ba650d9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42628/0 (socket says 172.21.15.178:42628) 2024-09-21T09:04:16.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.252+0000 7fc86217c640 1 -- 172.21.15.178:0/465650235 learned_addr learned my addr 172.21.15.178:0/465650235 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.252+0000 7fc86217c640 1 -- 172.21.15.178:0/465650235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba650d9690 con 0x55ba650d8d70 2024-09-21T09:04:16.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.252+0000 7fc86217c640 1 --2- 172.21.15.178:0/465650235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650d8d70 0x55ba650d9150 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc85c04cba0 tx=0x7fc85c02b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc44c7ddbe2b808b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.252+0000 7fc7457fa640 1 -- 172.21.15.178:0/465650235 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc85c028040 con 0x55ba650d8d70 2024-09-21T09:04:16.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.252+0000 7fc7457fa640 1 -- 172.21.15.178:0/465650235 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85c0400c0 con 0x55ba650d8d70 2024-09-21T09:04:16.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.252+0000 7fc7457fa640 1 -- 172.21.15.178:0/465650235 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc85c016980 con 0x55ba650d8d70 2024-09-21T09:04:16.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.253+0000 7fc863e87800 1 -- 172.21.15.178:0/465650235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650d8d70 msgr2=0x55ba650d9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.253+0000 7fc863e87800 1 --2- 172.21.15.178:0/465650235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650d8d70 0x55ba650d9150 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc85c04cba0 tx=0x7fc85c02b410 comp rx=0 tx=0).stop 2024-09-21T09:04:16.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.253+0000 7fc863e87800 1 -- 172.21.15.178:0/465650235 shutdown_connections 2024-09-21T09:04:16.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.253+0000 7fc863e87800 1 --2- 172.21.15.178:0/465650235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650d8d70 0x55ba650d9150 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.253+0000 7fc863e87800 1 -- 172.21.15.178:0/465650235 >> 172.21.15.178:0/465650235 conn(0x55ba650d5120 msgr2=0x55ba650d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.253+0000 7fc863e87800 1 -- 172.21.15.178:0/465650235 shutdown_connections 2024-09-21T09:04:16.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.253+0000 7fc863e87800 1 -- 172.21.15.178:0/465650235 wait complete. 2024-09-21T09:04:16.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.253+0000 7fc863e87800 1 Processor -- start 2024-09-21T09:04:16.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.253+0000 7fc863e87800 1 -- start start 2024-09-21T09:04:16.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.253+0000 7fc863e87800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650d8d70 0x55ba650e01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.253+0000 7fc863e87800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ba650d9d50 con 0x55ba650d8d70 2024-09-21T09:04:16.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.253+0000 7fc86217c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650d8d70 0x55ba650e01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.253+0000 7fc86217c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650d8d70 0x55ba650e01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42638/0 (socket says 172.21.15.178:42638) 2024-09-21T09:04:16.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.253+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 learned_addr learned my addr 172.21.15.178:0/673220198 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.254+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba650e0730 con 0x55ba650d8d70 2024-09-21T09:04:16.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.254+0000 7fc86217c640 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650d8d70 0x55ba650e01f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc85c04cfd0 tx=0x7fc85c04cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.254+0000 7fc7337fe640 1 -- 172.21.15.178:0/673220198 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc85c028040 con 0x55ba650d8d70 2024-09-21T09:04:16.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.254+0000 7fc7337fe640 1 -- 172.21.15.178:0/673220198 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85c031030 con 0x55ba650d8d70 2024-09-21T09:04:16.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.254+0000 7fc7337fe640 1 -- 172.21.15.178:0/673220198 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc85c016ab0 con 0x55ba650d8d70 2024-09-21T09:04:16.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.254+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba650e09c0 con 0x55ba650d8d70 2024-09-21T09:04:16.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.254+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba650e3670 con 0x55ba650d8d70 2024-09-21T09:04:16.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.255+0000 7fc7337fe640 1 -- 172.21.15.178:0/673220198 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc85c04e070 con 0x55ba650d8d70 2024-09-21T09:04:16.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.255+0000 7fc7337fe640 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc72c036aa0 0x7fc72c038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.255+0000 7fc7337fe640 1 -- 172.21.15.178:0/673220198 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fc85c00e040 con 0x55ba650d8d70 2024-09-21T09:04:16.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.255+0000 7fc86197b640 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc72c036aa0 0x7fc72c038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.255+0000 7fc863e87800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.255+0000 7fc863e87800 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ba650ebe30 0x55ba650ee2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.255+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650eea40 con 0x55ba650ebe30 2024-09-21T09:04:16.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.256+0000 7fc86197b640 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc72c036aa0 0x7fc72c038f60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc854028c40 tx=0x7fc854042000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.256+0000 7fc85bfff640 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ba650ebe30 0x55ba650ee2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.256+0000 7fc85bfff640 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ba650ebe30 0x55ba650ee2f0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.256+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.256+0000 7fc863e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.256+0000 7fc863e87800 20 realm 2024-09-21T09:04:16.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.256+0000 7fc863e87800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.256+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650eee70 con 0x55ba650ebe30 2024-09-21T09:04:16.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.256+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.256+0000 7fc863e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.256+0000 7fc863e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:04:16.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.256+0000 7fc863e87800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.256+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650ef740 con 0x55ba650ebe30 2024-09-21T09:04:16.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.257+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.257+0000 7fc863e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.257+0000 7fc863e87800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.257+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650efae0 con 0x55ba650ebe30 2024-09-21T09:04:16.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.257+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.257+0000 7fc863e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:16.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.257+0000 7fc863e87800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.257+0000 7fc863e87800 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ba650f0840 0x55ba650f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.257+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f3170 con 0x55ba650f0840 2024-09-21T09:04:16.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.257+0000 7fc86217c640 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ba650f0840 0x55ba650f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.258+0000 7fc86217c640 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ba650f0840 0x55ba650f2c30 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.258+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.258+0000 7fc863e87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:04:16.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.258+0000 7fc863e87800 20 searching for the correct realm 2024-09-21T09:04:16.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.258+0000 7fc863e87800 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ba650f51b0 0x55ba650f7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.258+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650f51b0 2024-09-21T09:04:16.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.258+0000 7fc86197b640 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ba650f51b0 0x55ba650f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.258+0000 7fc86197b640 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ba650f51b0 0x55ba650f7670 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.259+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc854028930 con 0x55ba650f51b0 2024-09-21T09:04:16.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.259+0000 7fc86197b640 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc854052040 0x7fc85400f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.259+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x7fc854052040 2024-09-21T09:04:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.259+0000 7fc85bfff640 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc854052040 0x7fc85400f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.259+0000 7fc85bfff640 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc854052040 0x7fc85400f3a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.259+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c057030 con 0x7fc854052040 2024-09-21T09:04:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.259+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650f0840 2024-09-21T09:04:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.260+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.260+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650ebe30 2024-09-21T09:04:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.260+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.260+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650ebe30 2024-09-21T09:04:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.260+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.260+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650f0840 2024-09-21T09:04:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.260+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.260+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650f0840 2024-09-21T09:04:16.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.261+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.261+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x7fc854052040 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.261+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c057030 con 0x7fc854052040 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.261+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650f51b0 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.261+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc854028930 con 0x55ba650f51b0 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.261+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650ebe30 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.261+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.261+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650f0840 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.262+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.262+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650ebe30 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.262+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.262+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x7fc854052040 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.262+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc84c057030 con 0x7fc854052040 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.262+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650f51b0 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.262+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc854028930 con 0x55ba650f51b0 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.262+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650f51b0 2024-09-21T09:04:16.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.263+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc854028930 con 0x55ba650f51b0 2024-09-21T09:04:16.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.263+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650f0840 2024-09-21T09:04:16.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.263+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.263+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650f51b0 2024-09-21T09:04:16.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.263+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc854028930 con 0x55ba650f51b0 2024-09-21T09:04:16.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.263+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f7d40 con 0x55ba650f51b0 2024-09-21T09:04:16.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.263+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc854028930 con 0x55ba650f51b0 2024-09-21T09:04:16.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.263+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc854061040 con 0x55ba650ebe30 2024-09-21T09:04:16.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.263+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.263+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc854061040 con 0x55ba650ebe30 2024-09-21T09:04:16.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.264+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.264+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc854061040 con 0x55ba650f0840 2024-09-21T09:04:16.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.264+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.264+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc854061040 con 0x55ba650f51b0 2024-09-21T09:04:16.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.264+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc854028930 con 0x55ba650f51b0 2024-09-21T09:04:16.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.264+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc854061040 con 0x7fc854052040 2024-09-21T09:04:16.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.264+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c057030 con 0x7fc854052040 2024-09-21T09:04:16.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.265+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc854061040 con 0x55ba650ebe30 2024-09-21T09:04:16.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.265+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.265+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc854061040 con 0x55ba650f0840 2024-09-21T09:04:16.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.265+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.265+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc854061040 con 0x55ba650f51b0 2024-09-21T09:04:16.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.265+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc854028930 con 0x55ba650f51b0 2024-09-21T09:04:16.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.265+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc854061040 con 0x7fc854052040 2024-09-21T09:04:16.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.265+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c057030 con 0x7fc854052040 2024-09-21T09:04:16.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.266+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc854061040 con 0x7fc854052040 2024-09-21T09:04:16.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.266+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c057030 con 0x7fc854052040 2024-09-21T09:04:16.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.266+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc854061040 con 0x55ba650f51b0 2024-09-21T09:04:16.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.266+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc854028930 con 0x55ba650f51b0 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.266+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc854061040 con 0x55ba650f0840 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.266+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.266+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc854061040 con 0x55ba650ebe30 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.266+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.266+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc854061040 con 0x7fc854052040 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c057030 con 0x7fc854052040 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f3bb0 con 0x55ba650ebe30 2024-09-21T09:04:16.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f4000 con 0x55ba650ebe30 2024-09-21T09:04:16.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:16.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f44e0 con 0x55ba650ebe30 2024-09-21T09:04:16.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:04:16.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 zone default found 2024-09-21T09:04:16.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 4 Realm: () 2024-09-21T09:04:16.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:04:16.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:04:16.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:04:16.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 zonegroup default 2024-09-21T09:04:16.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.267+0000 7fc863e87800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.268+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f81c0 con 0x55ba650f0840 2024-09-21T09:04:16.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.268+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.268+0000 7fc863e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.268+0000 7fc863e87800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.268+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650fa3f0 con 0x55ba650f51b0 2024-09-21T09:04:16.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.268+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc854028930 con 0x55ba650f51b0 2024-09-21T09:04:16.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.268+0000 7fc863e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.268+0000 7fc863e87800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.268+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba650fa790 con 0x55ba650f51b0 2024-09-21T09:04:16.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.268+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc854028930 con 0x55ba650f51b0 2024-09-21T09:04:16.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.268+0000 7fc863e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.268+0000 7fc863e87800 20 started sync module instance, tier type = 2024-09-21T09:04:16.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.268+0000 7fc863e87800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:04:16.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.268+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f9830 con 0x7fc854052040 2024-09-21T09:04:16.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.269+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x7fc854052040 2024-09-21T09:04:16.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.269+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94259047799840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f9830 con 0x7fc854052040 2024-09-21T09:04:16.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.269+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650fb150 con 0x55ba650ebe30 2024-09-21T09:04:16.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.270+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94259047799840] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x7fc854052040 2024-09-21T09:04:16.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.271+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.271+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94259047798112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650fb150 con 0x55ba650ebe30 2024-09-21T09:04:16.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.271+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650fbb50 con 0x55ba650f51b0 2024-09-21T09:04:16.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.272+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc854028930 con 0x55ba650f51b0 2024-09-21T09:04:16.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.272+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94259047798112] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.272+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94259047806560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650fc3f0 con 0x55ba650f51b0 2024-09-21T09:04:16.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.272+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650face0 con 0x7fc854052040 2024-09-21T09:04:16.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.273+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x7fc854052040 2024-09-21T09:04:16.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.273+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94259047806560] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc854028930 con 0x55ba650f51b0 2024-09-21T09:04:16.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.273+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94259047811424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650face0 con 0x7fc854052040 2024-09-21T09:04:16.286 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.273+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650fbf40 con 0x55ba650ebe30 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.274+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94259047811424] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x7fc854052040 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.274+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.274+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94259047812480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650fbf40 con 0x55ba650ebe30 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.274+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650fde70 con 0x55ba650f0840 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.275+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.275+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94259047815616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650fe6c0 con 0x55ba650f0840 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.275+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650ff0c0 con 0x55ba650f0840 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.275+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94259047812480] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.276+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94259047815616] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.276+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.276+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94259047814048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650fe270 con 0x55ba650f0840 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.276+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650ff750 con 0x55ba650f0840 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.277+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(58 notify.7 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.277+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94259047821984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650ffb70 con 0x55ba650f0840 2024-09-21T09:04:16.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.277+0000 7fc863e87800 20 add_watcher() i=0 2024-09-21T09:04:16.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.277+0000 7fc863e87800 20 add_watcher() i=1 2024-09-21T09:04:16.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.277+0000 7fc863e87800 20 add_watcher() i=2 2024-09-21T09:04:16.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.277+0000 7fc863e87800 20 add_watcher() i=3 2024-09-21T09:04:16.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.277+0000 7fc863e87800 20 add_watcher() i=4 2024-09-21T09:04:16.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.277+0000 7fc863e87800 20 add_watcher() i=5 2024-09-21T09:04:16.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.277+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94259047814048] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.277+0000 7fc863e87800 20 add_watcher() i=6 2024-09-21T09:04:16.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.278+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94259047821984] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.278+0000 7fc863e87800 20 add_watcher() i=7 2024-09-21T09:04:16.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.278+0000 7fc863e87800 2 all 8 watchers are set, enabling cache 2024-09-21T09:04:16.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.278+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba65102ba0 con 0x55ba650ebe30 2024-09-21T09:04:16.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.279+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.279+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94259047823040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650fff90 con 0x55ba650ebe30 2024-09-21T09:04:16.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.280+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94259047823040] v31'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.280+0000 7fc7137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.280+0000 7fc863e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:04:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.280+0000 7fc863e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:04:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.280+0000 7fc863e87800 5 note: GC not initialized 2024-09-21T09:04:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.280+0000 7fc7127fc640 20 reqs_thread_entry: start 2024-09-21T09:04:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.280+0000 7fc863e87800 20 init_complete bucket index max shards: 11 2024-09-21T09:04:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.280+0000 7fc863e87800 20 Filter name: none 2024-09-21T09:04:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.280+0000 7fc683fff640 20 reqs_thread_entry: start 2024-09-21T09:04:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.280+0000 7fc863e87800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.280+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba65135960 con 0x55ba650ebe30 2024-09-21T09:04:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.281+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.281+0000 7fc863e87800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:04:16.289 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.281+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ba65136eb0 con 0x55ba650f0840 2024-09-21T09:04:16.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.281+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.282+0000 7fc7137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:16.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.282+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94259047823040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650e9250 con 0x55ba650ebe30 2024-09-21T09:04:16.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.283+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94259047823040] v31'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.283+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94259047799840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650e9250 con 0x7fc854052040 2024-09-21T09:04:16.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.284+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94259047799840] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x7fc854052040 2024-09-21T09:04:16.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.284+0000 7fc863e87800 20 remove_watcher() i=0 2024-09-21T09:04:16.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.284+0000 7fc863e87800 2 removed watcher, disabling cache 2024-09-21T09:04:16.290 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.284+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94259047798112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f9c20 con 0x55ba650ebe30 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.285+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94259047798112] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.285+0000 7fc863e87800 20 remove_watcher() i=1 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.285+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94259047806560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f9c20 con 0x55ba650f51b0 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.287+0000 7fc86197b640 1 -- 172.21.15.178:0/673220198 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94259047806560] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc854028930 con 0x55ba650f51b0 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.287+0000 7fc863e87800 20 remove_watcher() i=2 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.287+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94259047811424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f9c20 con 0x7fc854052040 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.287+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94259047811424] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x7fc854052040 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.287+0000 7fc863e87800 20 remove_watcher() i=3 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.288+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94259047812480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f9c20 con 0x55ba650ebe30 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.289+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94259047812480] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c057030 con 0x55ba650ebe30 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.289+0000 7fc863e87800 20 remove_watcher() i=4 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.289+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94259047815616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f9c20 con 0x55ba650f0840 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.290+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94259047815616] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.290+0000 7fc863e87800 20 remove_watcher() i=5 2024-09-21T09:04:16.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.290+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94259047814048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650f9c20 con 0x55ba650f0840 2024-09-21T09:04:16.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.291+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94259047814048] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.291+0000 7fc863e87800 20 remove_watcher() i=6 2024-09-21T09:04:16.295 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.291+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94259047821984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ba650fd3a0 con 0x55ba650f0840 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc86217c640 1 -- 172.21.15.178:0/673220198 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94259047821984] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc85c02a070 con 0x55ba650f0840 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 20 remove_watcher() i=7 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ba650f0840 msgr2=0x55ba650f2c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ba650f0840 0x55ba650f2c30 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ba650ebe30 msgr2=0x55ba650ee2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ba650ebe30 0x55ba650ee2f0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc854052040 msgr2=0x7fc85400f3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc854052040 0x7fc85400f3a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ba650f51b0 msgr2=0x55ba650f7670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ba650f51b0 0x55ba650f7670 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc72c036aa0 msgr2=0x7fc72c038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc72c036aa0 0x7fc72c038f60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc854028c40 tx=0x7fc854042000 comp rx=0 tx=0).stop 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650d8d70 msgr2=0x55ba650e01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 --2- 172.21.15.178:0/673220198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650d8d70 0x55ba650e01f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc85c04cfd0 tx=0x7fc85c04cb30 comp rx=0 tx=0).stop 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc85bfff640 1 -- 172.21.15.178:0/673220198 reap_dead start 2024-09-21T09:04:16.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 shutdown_connections 2024-09-21T09:04:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 >> 172.21.15.178:0/673220198 conn(0x55ba650d5120 msgr2=0x55ba650da4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 shutdown_connections 2024-09-21T09:04:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/673220198 wait complete. 2024-09-21T09:04:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/1647285911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc73c036b40 msgr2=0x7fc73c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 --2- 172.21.15.178:0/1647285911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc73c036b40 0x7fc73c039000 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55ba650b8e00 tx=0x7fc85400ff90 comp rx=0 tx=0).stop 2024-09-21T09:04:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/1647285911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650cc110 msgr2=0x55ba650cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 --2- 172.21.15.178:0/1647285911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650cc110 0x55ba650cc530 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55ba650b8d60 tx=0x7fc85c018830 comp rx=0 tx=0).stop 2024-09-21T09:04:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/1647285911 shutdown_connections 2024-09-21T09:04:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 --2- 172.21.15.178:0/1647285911 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc73c036b40 0x7fc73c039000 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 --2- 172.21.15.178:0/1647285911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba650cc110 0x55ba650cc530 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/1647285911 >> 172.21.15.178:0/1647285911 conn(0x55ba650c10a0 msgr2=0x55ba650c3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/1647285911 shutdown_connections 2024-09-21T09:04:16.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.292+0000 7fc863e87800 1 -- 172.21.15.178:0/1647285911 wait complete. 2024-09-21T09:04:16.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ba650bacb0 msgr2=0x55ba650bd0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ba650bacb0 0x55ba650bd0a0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ba64fbed20 msgr2=0x55ba650b83e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ba64fbed20 0x55ba650b83e0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc748036b90 msgr2=0x7fc748039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc748036b90 0x7fc748039050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc84c057000 tx=0x7fc84c052000 comp rx=0 tx=0).stop 2024-09-21T09:04:16.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64f2c630 msgr2=0x55ba650b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64f2c630 0x55ba650b1370 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc85400b690 tx=0x7fc854000ed0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 shutdown_connections 2024-09-21T09:04:16.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ba650bacb0 0x55ba650bd0a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ba64fbed20 0x55ba650b83e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc748036b90 0x7fc748039050 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 --2- 172.21.15.178:0/179532377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ba64f2c630 0x55ba650b1370 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 >> 172.21.15.178:0/179532377 conn(0x55ba64fb2db0 msgr2=0x55ba650a3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 shutdown_connections 2024-09-21T09:04:16.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.293+0000 7fc863e87800 1 -- 172.21.15.178:0/179532377 wait complete. 2024-09-21T09:04:16.303 INFO:teuthology.orchestra.run.smithi178.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-21T09:00:00.000000Z","epoch":1726909200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-09-21T09:04:16.303 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-21T09:04:16.304 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-21T09:04:16.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-21T09:04:16.304 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-21T09:04:16.356 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:04:16.356 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:04:16.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.355+0000 7fc743720800 1 Processor -- start 2024-09-21T09:04:16.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.355+0000 7fc743720800 1 -- start start 2024-09-21T09:04:16.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.355+0000 7fc743720800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556af699d590 0x556af699d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.355+0000 7fc743720800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556af685db30 con 0x556af699ded0 2024-09-21T09:04:16.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.355+0000 7fc743720800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x556af683f360 con 0x556af699d590 2024-09-21T09:04:16.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.356+0000 7fc73f3b8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556af699d590 0x556af699d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.356+0000 7fc736bb7640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x556af699ded0 0x556af69a2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:56368/0 (socket says 172.21.15.178:56368) 2024-09-21T09:04:16.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.356+0000 7fc73f3b8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556af699d590 0x556af699d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42648/0 (socket says 172.21.15.178:42648) 2024-09-21T09:04:16.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.356+0000 7fc736bb7640 1 -- 172.21.15.178:0/3881141531 learned_addr learned my addr 172.21.15.178:0/3881141531 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:04:16.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.356+0000 7fc73f3b8640 1 -- 172.21.15.178:0/3881141531 >> v1:172.21.15.44:6789/0 conn(0x556af699ded0 legacy=0x556af69a2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.356+0000 7fc73f3b8640 1 -- 172.21.15.178:0/3881141531 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af6865e00 con 0x556af699d590 2024-09-21T09:04:16.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.358+0000 7fc73f3b8640 1 --2- 172.21.15.178:0/3881141531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af699d990 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc73000a470 tx=0x7fc730045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6e2dd1ed4c780a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.358+0000 7fc73ebb7640 1 -- 172.21.15.178:0/3881141531 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc730053570 con 0x556af699d590 2024-09-21T09:04:16.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.358+0000 7fc73ebb7640 1 -- 172.21.15.178:0/3881141531 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc730058070 con 0x556af699d590 2024-09-21T09:04:16.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.358+0000 7fc73ebb7640 1 -- 172.21.15.178:0/3881141531 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc730053880 con 0x556af699d590 2024-09-21T09:04:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.358+0000 7fc743720800 1 -- 172.21.15.178:0/3881141531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 msgr2=0x556af699d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.359+0000 7fc743720800 1 --2- 172.21.15.178:0/3881141531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af699d990 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc73000a470 tx=0x7fc730045a20 comp rx=0 tx=0).stop 2024-09-21T09:04:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.359+0000 7fc743720800 1 -- 172.21.15.178:0/3881141531 shutdown_connections 2024-09-21T09:04:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.359+0000 7fc743720800 1 --2- 172.21.15.178:0/3881141531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af699d990 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.359+0000 7fc743720800 1 -- 172.21.15.178:0/3881141531 >> 172.21.15.178:0/3881141531 conn(0x556af6998e20 msgr2=0x556af699b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.359+0000 7fc743720800 1 -- 172.21.15.178:0/3881141531 shutdown_connections 2024-09-21T09:04:16.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.359+0000 7fc743720800 1 -- 172.21.15.178:0/3881141531 wait complete. 2024-09-21T09:04:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.372+0000 7fc743720800 1 Processor -- start 2024-09-21T09:04:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.373+0000 7fc743720800 1 -- start start 2024-09-21T09:04:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.373+0000 7fc743720800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af6a8c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.373+0000 7fc743720800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556af68ea370 con 0x556af699d590 2024-09-21T09:04:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.373+0000 7fc73f3b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af6a8c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.373+0000 7fc73f3b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af6a8c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42664/0 (socket says 172.21.15.178:42664) 2024-09-21T09:04:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.373+0000 7fc73f3b8640 1 -- 172.21.15.178:0/3231037102 learned_addr learned my addr 172.21.15.178:0/3231037102 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.373+0000 7fc73f3b8640 1 -- 172.21.15.178:0/3231037102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af6837bc0 con 0x556af699d590 2024-09-21T09:04:16.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.373+0000 7fc73f3b8640 1 --2- 172.21.15.178:0/3231037102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af6a8c8a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc730025c20 tx=0x7fc730051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb6ecb712057566 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.374+0000 7fc62d60a640 1 -- 172.21.15.178:0/3231037102 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc73005c580 con 0x556af699d590 2024-09-21T09:04:16.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.374+0000 7fc62d60a640 1 -- 172.21.15.178:0/3231037102 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc730063030 con 0x556af699d590 2024-09-21T09:04:16.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.374+0000 7fc62d60a640 1 -- 172.21.15.178:0/3231037102 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc73005c850 con 0x556af699d590 2024-09-21T09:04:16.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.374+0000 7fc743720800 1 -- 172.21.15.178:0/3231037102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 msgr2=0x556af6a8c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.374+0000 7fc743720800 1 --2- 172.21.15.178:0/3231037102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af6a8c8a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc730025c20 tx=0x7fc730051000 comp rx=0 tx=0).stop 2024-09-21T09:04:16.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.374+0000 7fc743720800 1 -- 172.21.15.178:0/3231037102 shutdown_connections 2024-09-21T09:04:16.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.374+0000 7fc743720800 1 --2- 172.21.15.178:0/3231037102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af6a8c8a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.374+0000 7fc743720800 1 -- 172.21.15.178:0/3231037102 >> 172.21.15.178:0/3231037102 conn(0x556af6998e20 msgr2=0x556af6a88260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.374+0000 7fc743720800 1 -- 172.21.15.178:0/3231037102 shutdown_connections 2024-09-21T09:04:16.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.374+0000 7fc743720800 1 -- 172.21.15.178:0/3231037102 wait complete. 2024-09-21T09:04:16.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.375+0000 7fc743720800 1 Processor -- start 2024-09-21T09:04:16.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.375+0000 7fc743720800 1 -- start start 2024-09-21T09:04:16.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.375+0000 7fc743720800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af6912620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.375+0000 7fc743720800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556af69a45b0 con 0x556af699d590 2024-09-21T09:04:16.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.375+0000 7fc73f3b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af6912620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.375+0000 7fc73f3b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af6912620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42678/0 (socket says 172.21.15.178:42678) 2024-09-21T09:04:16.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.375+0000 7fc73f3b8640 1 -- 172.21.15.178:0/2607046173 learned_addr learned my addr 172.21.15.178:0/2607046173 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.376+0000 7fc73f3b8640 1 -- 172.21.15.178:0/2607046173 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af684bfe0 con 0x556af699d590 2024-09-21T09:04:16.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.376+0000 7fc73f3b8640 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af6912620 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x556af6a8d700 tx=0x7fc730002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.376+0000 7fc62be07640 1 -- 172.21.15.178:0/2607046173 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc730054ad0 con 0x556af699d590 2024-09-21T09:04:16.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.376+0000 7fc62be07640 1 -- 172.21.15.178:0/2607046173 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc730054c70 con 0x556af699d590 2024-09-21T09:04:16.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.376+0000 7fc62be07640 1 -- 172.21.15.178:0/2607046173 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc730068420 con 0x556af699d590 2024-09-21T09:04:16.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.376+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556af6a97f70 con 0x556af699d590 2024-09-21T09:04:16.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.376+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556af6a98490 con 0x556af699d590 2024-09-21T09:04:16.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.377+0000 7fc62be07640 1 -- 172.21.15.178:0/2607046173 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc7300685c0 con 0x556af699d590 2024-09-21T09:04:16.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.377+0000 7fc62be07640 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc624036b90 0x7fc624039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.377+0000 7fc62be07640 1 -- 172.21.15.178:0/2607046173 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fc730070030 con 0x556af699d590 2024-09-21T09:04:16.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.377+0000 7fc736bb7640 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc624036b90 0x7fc624039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.377+0000 7fc743720800 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556af699ded0 0x556af6a9c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.377+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6a9c8d0 con 0x556af699ded0 2024-09-21T09:04:16.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.377+0000 7fc73fbb9640 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556af699ded0 0x556af6a9c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.378+0000 7fc736bb7640 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc624036b90 0x7fc624039050 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc728000f60 tx=0x7fc7280012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.378+0000 7fc73fbb9640 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556af699ded0 0x556af6a9c2b0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.378+0000 7fc73fbb9640 1 -- 172.21.15.178:0/2607046173 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc73800a4a0 con 0x556af699ded0 2024-09-21T09:04:16.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.378+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6a99880 con 0x556af699ded0 2024-09-21T09:04:16.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.378+0000 7fc73fbb9640 1 -- 172.21.15.178:0/2607046173 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc73800a4a0 con 0x556af699ded0 2024-09-21T09:04:16.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.378+0000 7fc743720800 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556af6a9ec20 0x556af6aa1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.378+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6aa1700 con 0x556af6a9ec20 2024-09-21T09:04:16.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.379+0000 7fc73f3b8640 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556af6a9ec20 0x556af6aa1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.379+0000 7fc73f3b8640 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556af6a9ec20 0x556af6aa1010 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.379+0000 7fc73f3b8640 1 -- 172.21.15.178:0/2607046173 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc730051070 con 0x556af6a9ec20 2024-09-21T09:04:16.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.379+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6a9dac0 con 0x556af699ded0 2024-09-21T09:04:16.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.379+0000 7fc73fbb9640 1 -- 172.21.15.178:0/2607046173 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc73800a4a0 con 0x556af699ded0 2024-09-21T09:04:16.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.379+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6a9dfa0 con 0x556af699ded0 2024-09-21T09:04:16.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.380+0000 7fc73fbb9640 1 -- 172.21.15.178:0/2607046173 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc73800a4a0 con 0x556af699ded0 2024-09-21T09:04:16.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.380+0000 7fc743720800 1 Processor -- start 2024-09-21T09:04:16.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.380+0000 7fc743720800 1 -- start start 2024-09-21T09:04:16.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.380+0000 7fc743720800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6ab0080 0x556af6ab04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.380+0000 7fc743720800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556af6839580 con 0x556af6ab0080 2024-09-21T09:04:16.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.380+0000 7fc73fbb9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6ab0080 0x556af6ab04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.380+0000 7fc73fbb9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6ab0080 0x556af6ab04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42692/0 (socket says 172.21.15.178:42692) 2024-09-21T09:04:16.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.380+0000 7fc73fbb9640 1 -- 172.21.15.178:0/414278604 learned_addr learned my addr 172.21.15.178:0/414278604 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.381+0000 7fc73fbb9640 1 -- 172.21.15.178:0/414278604 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af6ab09e0 con 0x556af6ab0080 2024-09-21T09:04:16.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.381+0000 7fc73fbb9640 1 --2- 172.21.15.178:0/414278604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6ab0080 0x556af6ab04a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x556af6a9ccd0 tx=0x7fc738018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.381+0000 7fc629602640 1 -- 172.21.15.178:0/414278604 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc738014450 con 0x556af6ab0080 2024-09-21T09:04:16.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.381+0000 7fc629602640 1 -- 172.21.15.178:0/414278604 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc738014610 con 0x556af6ab0080 2024-09-21T09:04:16.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.381+0000 7fc629602640 1 -- 172.21.15.178:0/414278604 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc738014930 con 0x556af6ab0080 2024-09-21T09:04:16.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.381+0000 7fc743720800 1 -- 172.21.15.178:0/414278604 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556af6ab0c70 con 0x556af6ab0080 2024-09-21T09:04:16.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.381+0000 7fc743720800 1 -- 172.21.15.178:0/414278604 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556af6ab3950 con 0x556af6ab0080 2024-09-21T09:04:16.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.382+0000 7fc629602640 1 -- 172.21.15.178:0/414278604 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc738011040 con 0x556af6ab0080 2024-09-21T09:04:16.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.382+0000 7fc629602640 1 --2- 172.21.15.178:0/414278604 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc618036b40 0x7fc618039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.382+0000 7fc629602640 1 -- 172.21.15.178:0/414278604 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fc73801e070 con 0x556af6ab0080 2024-09-21T09:04:16.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.382+0000 7fc73f3b8640 1 --2- 172.21.15.178:0/414278604 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc618036b40 0x7fc618039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.382+0000 7fc743720800 1 Processor -- start 2024-09-21T09:04:16.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.382+0000 7fc73f3b8640 1 --2- 172.21.15.178:0/414278604 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc618036b40 0x7fc618039000 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x556af6a9cd70 tx=0x7fc730060ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.382+0000 7fc743720800 1 -- start start 2024-09-21T09:04:16.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.383+0000 7fc743720800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6abcd30 0x556af6abd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.383+0000 7fc743720800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556af6a8cff0 con 0x556af6abcd30 2024-09-21T09:04:16.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.383+0000 7fc73fbb9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6abcd30 0x556af6abd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.383+0000 7fc73fbb9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6abcd30 0x556af6abd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42694/0 (socket says 172.21.15.178:42694) 2024-09-21T09:04:16.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.383+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1021029851 learned_addr learned my addr 172.21.15.178:0/1021029851 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.383+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1021029851 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af6abd700 con 0x556af6abcd30 2024-09-21T09:04:16.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.383+0000 7fc73fbb9640 1 --2- 172.21.15.178:0/1021029851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6abcd30 0x556af6abd130 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc73804cbb0 tx=0x7fc73804ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27ad337719a3f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.383+0000 7fc622ffd640 1 -- 172.21.15.178:0/1021029851 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc738040150 con 0x556af6abcd30 2024-09-21T09:04:16.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.383+0000 7fc622ffd640 1 -- 172.21.15.178:0/1021029851 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc738016960 con 0x556af6abcd30 2024-09-21T09:04:16.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.383+0000 7fc622ffd640 1 -- 172.21.15.178:0/1021029851 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc738016440 con 0x556af6abcd30 2024-09-21T09:04:16.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.384+0000 7fc743720800 1 -- 172.21.15.178:0/1021029851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6abcd30 msgr2=0x556af6abd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.384+0000 7fc743720800 1 --2- 172.21.15.178:0/1021029851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6abcd30 0x556af6abd130 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc73804cbb0 tx=0x7fc73804ce60 comp rx=0 tx=0).stop 2024-09-21T09:04:16.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.384+0000 7fc743720800 1 -- 172.21.15.178:0/1021029851 shutdown_connections 2024-09-21T09:04:16.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.384+0000 7fc743720800 1 --2- 172.21.15.178:0/1021029851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6abcd30 0x556af6abd130 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.384+0000 7fc743720800 1 -- 172.21.15.178:0/1021029851 >> 172.21.15.178:0/1021029851 conn(0x556af6ab9090 msgr2=0x556af6ab7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.384+0000 7fc743720800 1 -- 172.21.15.178:0/1021029851 shutdown_connections 2024-09-21T09:04:16.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.384+0000 7fc743720800 1 -- 172.21.15.178:0/1021029851 wait complete. 2024-09-21T09:04:16.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.384+0000 7fc743720800 1 Processor -- start 2024-09-21T09:04:16.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.384+0000 7fc743720800 1 -- start start 2024-09-21T09:04:16.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.384+0000 7fc743720800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6abcd30 0x556af6a958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.384+0000 7fc743720800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556af6abdd70 con 0x556af6abcd30 2024-09-21T09:04:16.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.385+0000 7fc73fbb9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6abcd30 0x556af6a958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.385+0000 7fc73fbb9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6abcd30 0x556af6a958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42700/0 (socket says 172.21.15.178:42700) 2024-09-21T09:04:16.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.385+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 learned_addr learned my addr 172.21.15.178:0/1513882335 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.385+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af6a93f90 con 0x556af6abcd30 2024-09-21T09:04:16.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.385+0000 7fc73fbb9640 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6abcd30 0x556af6a958a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc73800aa20 tx=0x7fc73804cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.385+0000 7fc6217fa640 1 -- 172.21.15.178:0/1513882335 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc738011c00 con 0x556af6abcd30 2024-09-21T09:04:16.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.385+0000 7fc6217fa640 1 -- 172.21.15.178:0/1513882335 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc738031030 con 0x556af6abcd30 2024-09-21T09:04:16.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.385+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556af6a94220 con 0x556af6abcd30 2024-09-21T09:04:16.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.385+0000 7fc6217fa640 1 -- 172.21.15.178:0/1513882335 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc738014b20 con 0x556af6abcd30 2024-09-21T09:04:16.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.385+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556af6a946c0 con 0x556af6abcd30 2024-09-21T09:04:16.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.386+0000 7fc6217fa640 1 -- 172.21.15.178:0/1513882335 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc738014d10 con 0x556af6abcd30 2024-09-21T09:04:16.395 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.386+0000 7fc6217fa640 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc608036b40 0x7fc608039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.386+0000 7fc6217fa640 1 -- 172.21.15.178:0/1513882335 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fc73800e040 con 0x556af6abcd30 2024-09-21T09:04:16.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.386+0000 7fc73f3b8640 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc608036b40 0x7fc608039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.387+0000 7fc73f3b8640 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc608036b40 0x7fc608039000 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc73008f2d0 tx=0x7fc730094000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.387+0000 7fc743720800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.387+0000 7fc743720800 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556af6ad1ff0 0x556af6ad44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.387+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6ad4c00 con 0x556af6ad1ff0 2024-09-21T09:04:16.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.387+0000 7fc736bb7640 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556af6ad1ff0 0x556af6ad44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.387+0000 7fc736bb7640 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556af6ad1ff0 0x556af6ad44b0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.387+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc728009050 con 0x556af6ad1ff0 2024-09-21T09:04:16.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.387+0000 7fc743720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.387+0000 7fc743720800 20 realm 2024-09-21T09:04:16.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.387+0000 7fc743720800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.387+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6ad1440 con 0x556af6ad1ff0 2024-09-21T09:04:16.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.388+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc728009050 con 0x556af6ad1ff0 2024-09-21T09:04:16.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.388+0000 7fc743720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.388+0000 7fc743720800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:04:16.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.388+0000 7fc743720800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.388+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6ad56f0 con 0x556af6ad1ff0 2024-09-21T09:04:16.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.388+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc728009050 con 0x556af6ad1ff0 2024-09-21T09:04:16.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.388+0000 7fc743720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.388+0000 7fc743720800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.388+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6ad5fc0 con 0x556af6ad1ff0 2024-09-21T09:04:16.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.388+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc728009050 con 0x556af6ad1ff0 2024-09-21T09:04:16.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.388+0000 7fc743720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:16.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.388+0000 7fc743720800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.388+0000 7fc743720800 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556af6ad6900 0x556af6ad8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.388+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6ad9480 con 0x556af6ad6900 2024-09-21T09:04:16.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.389+0000 7fc73fbb9640 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556af6ad6900 0x556af6ad8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.389+0000 7fc73fbb9640 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556af6ad6900 0x556af6ad8cf0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.389+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.389+0000 7fc743720800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:04:16.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.389+0000 7fc743720800 20 searching for the correct realm 2024-09-21T09:04:16.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.389+0000 7fc743720800 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556af6adb450 0x556af6add910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.389+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556af6addfe0 con 0x556af6adb450 2024-09-21T09:04:16.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.390+0000 7fc73f3b8640 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556af6adb450 0x556af6add910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.390+0000 7fc73f3b8640 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556af6adb450 0x556af6add910 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.390+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73009a040 con 0x556af6adb450 2024-09-21T09:04:16.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.390+0000 7fc73f3b8640 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc73005c070 0x7fc7300688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.390+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x7fc73005c070 2024-09-21T09:04:16.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.390+0000 7fc736bb7640 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc73005c070 0x7fc7300688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.391+0000 7fc736bb7640 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc73005c070 0x7fc7300688b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.391+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc728009050 con 0x7fc73005c070 2024-09-21T09:04:16.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.391+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad6900 2024-09-21T09:04:16.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.391+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.391+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad1ff0 2024-09-21T09:04:16.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.391+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc728009050 con 0x556af6ad1ff0 2024-09-21T09:04:16.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.391+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad1ff0 2024-09-21T09:04:16.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.392+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc728029040 con 0x556af6ad1ff0 2024-09-21T09:04:16.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.392+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad6900 2024-09-21T09:04:16.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.392+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.392+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad6900 2024-09-21T09:04:16.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.392+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.392+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x7fc73005c070 2024-09-21T09:04:16.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.392+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc728029040 con 0x7fc73005c070 2024-09-21T09:04:16.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.392+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6adb450 2024-09-21T09:04:16.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.393+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73009a040 con 0x556af6adb450 2024-09-21T09:04:16.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.393+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad1ff0 2024-09-21T09:04:16.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.393+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc728029040 con 0x556af6ad1ff0 2024-09-21T09:04:16.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.393+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad6900 2024-09-21T09:04:16.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.393+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.393+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad1ff0 2024-09-21T09:04:16.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.394+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc728029040 con 0x556af6ad1ff0 2024-09-21T09:04:16.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.394+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x7fc73005c070 2024-09-21T09:04:16.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.394+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc728029040 con 0x7fc73005c070 2024-09-21T09:04:16.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.394+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6adb450 2024-09-21T09:04:16.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.394+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73009a040 con 0x556af6adb450 2024-09-21T09:04:16.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.394+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6adb450 2024-09-21T09:04:16.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.394+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73009a040 con 0x556af6adb450 2024-09-21T09:04:16.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.394+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad6900 2024-09-21T09:04:16.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.395+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.395+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6adb450 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.395+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73009a040 con 0x556af6adb450 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.395+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6adb450 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.395+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73009a040 con 0x556af6adb450 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.395+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad1ff0 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.395+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc728029040 con 0x556af6ad1ff0 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.395+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad1ff0 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.395+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc728029040 con 0x556af6ad1ff0 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.395+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad6900 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.396+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.396+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6adb450 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.396+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73009a040 con 0x556af6adb450 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.396+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x7fc73005c070 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.396+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc728029040 con 0x7fc73005c070 2024-09-21T09:04:16.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.396+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad1ff0 2024-09-21T09:04:16.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.396+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc728029040 con 0x556af6ad1ff0 2024-09-21T09:04:16.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.396+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad6900 2024-09-21T09:04:16.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.397+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.397+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6adb450 2024-09-21T09:04:16.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.397+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73009a040 con 0x556af6adb450 2024-09-21T09:04:16.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.397+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x7fc73005c070 2024-09-21T09:04:16.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.397+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc728029040 con 0x7fc73005c070 2024-09-21T09:04:16.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.397+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x7fc73005c070 2024-09-21T09:04:16.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.397+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc728029040 con 0x7fc73005c070 2024-09-21T09:04:16.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.397+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6adb450 2024-09-21T09:04:16.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.397+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73009a040 con 0x556af6adb450 2024-09-21T09:04:16.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.397+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad6900 2024-09-21T09:04:16.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.398+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.398+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x556af6ad1ff0 2024-09-21T09:04:16.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.398+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc728029040 con 0x556af6ad1ff0 2024-09-21T09:04:16.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.398+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc7300a9040 con 0x7fc73005c070 2024-09-21T09:04:16.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.398+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc728029040 con 0x7fc73005c070 2024-09-21T09:04:16.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.398+0000 7fc743720800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:04:16.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.398+0000 7fc743720800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:04:16.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.398+0000 7fc743720800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:04:16.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.398+0000 7fc743720800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:04:16.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.398+0000 7fc743720800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:04:16.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.398+0000 7fc743720800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:04:16.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.398+0000 7fc743720800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.398+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6ad9e70 con 0x556af6ad1ff0 2024-09-21T09:04:16.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc728029040 con 0x556af6ad1ff0 2024-09-21T09:04:16.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6ada710 con 0x556af6ad1ff0 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc72803d040 con 0x556af6ad1ff0 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6ad9ab0 con 0x556af6ad1ff0 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc72803d040 con 0x556af6ad1ff0 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 20 zone default found 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 4 Realm: () 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 20 zonegroup default 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6ade4c0 con 0x556af6ad6900 2024-09-21T09:04:16.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.399+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae0790 con 0x556af6adb450 2024-09-21T09:04:16.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.400+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc73009a040 con 0x556af6adb450 2024-09-21T09:04:16.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.400+0000 7fc743720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.400+0000 7fc743720800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.400+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae0b30 con 0x556af6adb450 2024-09-21T09:04:16.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.400+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc73009a040 con 0x556af6adb450 2024-09-21T09:04:16.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.400+0000 7fc743720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.400+0000 7fc743720800 20 started sync module instance, tier type = 2024-09-21T09:04:16.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.400+0000 7fc743720800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:04:16.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.400+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6adfc20 con 0x7fc73005c070 2024-09-21T09:04:16.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.401+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x7fc73005c070 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.401+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93917893493072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6adfc20 con 0x7fc73005c070 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.401+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae1540 con 0x556af6ad1ff0 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.402+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93917893493072] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x7fc73005c070 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.402+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x556af6ad1ff0 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.402+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93917893497456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6adfc20 con 0x556af6ad1ff0 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.402+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae1fe0 con 0x556af6adb450 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.403+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93917893497456] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x556af6ad1ff0 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.404+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73009a040 con 0x556af6adb450 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.404+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93917893490544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6adfb90 con 0x556af6adb450 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.404+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae2e50 con 0x7fc73005c070 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.405+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93917893490544] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73009a040 con 0x556af6adb450 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.405+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x7fc73005c070 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.405+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93917893503392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae3270 con 0x7fc73005c070 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.405+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae3c30 con 0x556af6ad1ff0 2024-09-21T09:04:16.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.406+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93917893503392] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x7fc73005c070 2024-09-21T09:04:16.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.406+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x556af6ad1ff0 2024-09-21T09:04:16.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.406+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93917893507424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae3270 con 0x556af6ad1ff0 2024-09-21T09:04:16.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.406+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae4640 con 0x556af6ad6900 2024-09-21T09:04:16.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.407+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93917893507424] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x556af6ad1ff0 2024-09-21T09:04:16.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.407+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.407+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93917893504448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae31e0 con 0x556af6ad6900 2024-09-21T09:04:16.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.407+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae5500 con 0x556af6ad6900 2024-09-21T09:04:16.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.408+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93917893504448] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.409+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.409+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93917893511648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae5500 con 0x556af6ad6900 2024-09-21T09:04:16.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.409+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae5ec0 con 0x556af6ad6900 2024-09-21T09:04:16.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.409+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93917893511648] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.410+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.410+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93917893513776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae5ec0 con 0x556af6ad6900 2024-09-21T09:04:16.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.410+0000 7fc743720800 20 add_watcher() i=0 2024-09-21T09:04:16.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.410+0000 7fc743720800 20 add_watcher() i=1 2024-09-21T09:04:16.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.410+0000 7fc743720800 20 add_watcher() i=2 2024-09-21T09:04:16.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.410+0000 7fc743720800 20 add_watcher() i=3 2024-09-21T09:04:16.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.410+0000 7fc743720800 20 add_watcher() i=4 2024-09-21T09:04:16.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.410+0000 7fc743720800 20 add_watcher() i=5 2024-09-21T09:04:16.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.410+0000 7fc743720800 20 add_watcher() i=6 2024-09-21T09:04:16.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.411+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93917893513776] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.411+0000 7fc743720800 20 add_watcher() i=7 2024-09-21T09:04:16.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.411+0000 7fc743720800 2 all 8 watchers are set, enabling cache 2024-09-21T09:04:16.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.411+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae92c0 con 0x556af6ad1ff0 2024-09-21T09:04:16.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.411+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc72803d040 con 0x556af6ad1ff0 2024-09-21T09:04:16.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.411+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93917893516256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae6810 con 0x556af6ad1ff0 2024-09-21T09:04:16.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.412+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93917893516256] v31'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x556af6ad1ff0 2024-09-21T09:04:16.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.412+0000 7fc5f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:16.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.412+0000 7fc743720800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:04:16.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.412+0000 7fc743720800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:04:16.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.412+0000 7fc743720800 5 note: GC not initialized 2024-09-21T09:04:16.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.412+0000 7fc5f4fe1640 20 reqs_thread_entry: start 2024-09-21T09:04:16.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.412+0000 7fc743720800 20 init_complete bucket index max shards: 11 2024-09-21T09:04:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.412+0000 7fc743720800 20 Filter name: none 2024-09-21T09:04:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc56e7fc640 20 reqs_thread_entry: start 2024-09-21T09:04:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-21T09:04:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6b1c7a0 con 0x556af6ad6900 2024-09-21T09:04:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-21T09:04:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-21T09:04:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-21T09:04:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6b1ade0 con 0x556af6ad1ff0 2024-09-21T09:04:16.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x556af6ad1ff0 2024-09-21T09:04:16.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-21T09:04:16.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-21T09:04:16.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-21T09:04:16.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-21T09:04:16.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.413+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6b1b6d0 con 0x556af6ad6900 2024-09-21T09:04:16.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.415+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v31'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.415+0000 7fc743720800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-21T09:04:16.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.415+0000 7fc743720800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-21T09:04:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.415+0000 7fc743720800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-21T09:04:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.415+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 93917893734944 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6b1fd90 con 0x556af6ad6900 2024-09-21T09:04:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.415+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== watch-notify(notify (1) cookie 93917893513776 notify 133143986205 ret 0) ==== 598+0+0 (crc 0 0 0) 0x556af6b1c1f0 con 0x556af6ad6900 2024-09-21T09:04:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.415+0000 7fc622ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986205 cookie 93917893513776 notifier 4728 bl.length()=556 2024-09-21T09:04:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.415+0000 7fc622ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-21T09:04:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.415+0000 7fc622ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-21T09:04:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.415+0000 7fc622ffd640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc604003ea0 con 0x556af6ad6900 2024-09-21T09:04:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.415+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(65 notify.7 [notify cookie 93917893734944 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.415+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.415+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== watch-notify(notify_complete (2) cookie 93917893734944 notify 133143986205 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556af6a94220 con 0x556af6ad6900 2024-09-21T09:04:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.415+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6b1b6d0 con 0x556af6ad1ff0 2024-09-21T09:04:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.416+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x556af6ad1ff0 2024-09-21T09:04:16.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.416+0000 7fc743720800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-21T09:04:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.416+0000 7fc743720800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-21T09:04:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.416+0000 7fc743720800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-21T09:04:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.417+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93917893734944 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556af6b1b640 con 0x556af6ad6900 2024-09-21T09:04:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.417+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== watch-notify(notify (1) cookie 93917893504448 notify 133143986206 ret 0) ==== 219+0+0 (crc 0 0 0) 0x556af6a94220 con 0x556af6ad6900 2024-09-21T09:04:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.417+0000 7fc6227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986206 cookie 93917893504448 notifier 4728 bl.length()=177 2024-09-21T09:04:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.417+0000 7fc6227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-21T09:04:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.417+0000 7fc6227fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-21T09:04:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.417+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(68 notify.5 [notify cookie 93917893734944 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.417+0000 7fc6227fc640 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc574003400 con 0x556af6ad6900 2024-09-21T09:04:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.417+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.417+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== watch-notify(notify_complete (2) cookie 93917893734944 notify 133143986206 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556af6a93f90 con 0x556af6ad6900 2024-09-21T09:04:16.430 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-21T09:04:16.414590Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:04:16.414578Z","tags":[],"group_ids":[]} 2024-09-21T09:04:16.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.418+0000 7fc5f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:16.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.418+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93917893516256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6b1a460 con 0x556af6ad1ff0 2024-09-21T09:04:16.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.419+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93917893516256] v31'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x556af6ad1ff0 2024-09-21T09:04:16.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.419+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93917893493072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6b1a460 con 0x7fc73005c070 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.420+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93917893493072] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x7fc73005c070 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.420+0000 7fc743720800 20 remove_watcher() i=0 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.420+0000 7fc743720800 2 removed watcher, disabling cache 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.420+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93917893497456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6b1a460 con 0x556af6ad1ff0 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.421+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93917893497456] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x556af6ad1ff0 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.421+0000 7fc743720800 20 remove_watcher() i=1 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.421+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93917893490544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6b1a460 con 0x556af6adb450 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.422+0000 7fc73f3b8640 1 -- 172.21.15.178:0/1513882335 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93917893490544] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73009a040 con 0x556af6adb450 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.422+0000 7fc743720800 20 remove_watcher() i=2 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.422+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93917893503392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6adf770 con 0x7fc73005c070 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.423+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93917893503392] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x7fc73005c070 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.423+0000 7fc743720800 20 remove_watcher() i=3 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.423+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93917893507424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae29a0 con 0x556af6ad1ff0 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.424+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93917893507424] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72803d040 con 0x556af6ad1ff0 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.424+0000 7fc743720800 20 remove_watcher() i=4 2024-09-21T09:04:16.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.424+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93917893504448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6adf770 con 0x556af6ad6900 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.425+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93917893504448] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.425+0000 7fc743720800 20 remove_watcher() i=5 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.425+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93917893511648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6adf770 con 0x556af6ad6900 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.426+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93917893511648] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.426+0000 7fc743720800 20 remove_watcher() i=6 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.426+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93917893513776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556af6ae49e0 con 0x556af6ad6900 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc73fbb9640 1 -- 172.21.15.178:0/1513882335 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93917893513776] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73802a070 con 0x556af6ad6900 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 20 remove_watcher() i=7 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556af6ad6900 msgr2=0x556af6ad8cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556af6ad6900 0x556af6ad8cf0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556af6ad1ff0 msgr2=0x556af6ad44b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556af6ad1ff0 0x556af6ad44b0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc73005c070 msgr2=0x7fc7300688b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fc73005c070 0x7fc7300688b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556af6adb450 msgr2=0x556af6add910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556af6adb450 0x556af6add910 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc608036b40 msgr2=0x7fc608039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc608036b40 0x7fc608039000 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc73008f2d0 tx=0x7fc730094000 comp rx=0 tx=0).stop 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6abcd30 msgr2=0x556af6a958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 1 --2- 172.21.15.178:0/1513882335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6abcd30 0x556af6a958a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc73800aa20 tx=0x7fc73804cb40 comp rx=0 tx=0).stop 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 reap_dead start 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc736bb7640 1 -- 172.21.15.178:0/1513882335 reap_dead start 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 shutdown_connections 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.427+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 >> 172.21.15.178:0/1513882335 conn(0x556af6ab9090 msgr2=0x556af6ab7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 shutdown_connections 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 -- 172.21.15.178:0/1513882335 wait complete. 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 -- 172.21.15.178:0/414278604 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc618036b40 msgr2=0x7fc618039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 --2- 172.21.15.178:0/414278604 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc618036b40 0x7fc618039000 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x556af6a9cd70 tx=0x7fc730060ee0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 -- 172.21.15.178:0/414278604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6ab0080 msgr2=0x556af6ab04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 --2- 172.21.15.178:0/414278604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6ab0080 0x556af6ab04a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x556af6a9ccd0 tx=0x7fc738018830 comp rx=0 tx=0).stop 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 -- 172.21.15.178:0/414278604 shutdown_connections 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 --2- 172.21.15.178:0/414278604 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc618036b40 0x7fc618039000 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 --2- 172.21.15.178:0/414278604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af6ab0080 0x556af6ab04a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 -- 172.21.15.178:0/414278604 >> 172.21.15.178:0/414278604 conn(0x556af6aa5010 msgr2=0x556af6aa7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 -- 172.21.15.178:0/414278604 shutdown_connections 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 -- 172.21.15.178:0/414278604 wait complete. 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556af6a9ec20 msgr2=0x556af6aa1010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556af6a9ec20 0x556af6aa1010 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556af699ded0 msgr2=0x556af6a9c2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556af699ded0 0x556af6a9c2b0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc624036b90 msgr2=0x7fc624039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc624036b90 0x7fc624039050 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc728000f60 tx=0x7fc7280012b0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 msgr2=0x556af6912620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af6912620 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x556af6a8d700 tx=0x7fc730002fb0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 shutdown_connections 2024-09-21T09:04:16.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556af6a9ec20 0x556af6aa1010 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556af699ded0 0x556af6a9c2b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fc624036b90 0x7fc624039050 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 --2- 172.21.15.178:0/2607046173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556af699d590 0x556af6912620 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.428+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 >> 172.21.15.178:0/2607046173 conn(0x556af6998e20 msgr2=0x556af6a86ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.429+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 shutdown_connections 2024-09-21T09:04:16.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.429+0000 7fc743720800 1 -- 172.21.15.178:0/2607046173 wait complete. 2024-09-21T09:04:16.440 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-21T09:04:16.414590Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:04:16.414578Z', 'tags': [], 'group_ids': []} 2024-09-21T09:04:16.452 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:04:16.457 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-21T09:04:16.457 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-21T09:04:16.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-21T09:04:16.457 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-21T09:04:16.504 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:04:16.504 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:04:16.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.503+0000 7f419c351800 1 Processor -- start 2024-09-21T09:04:16.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.503+0000 7f419c351800 1 -- start start 2024-09-21T09:04:16.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.503+0000 7f419c351800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5654288564e0 0x5654288568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.503+0000 7f419c351800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565428716b30 con 0x565428856e20 2024-09-21T09:04:16.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.503+0000 7f419c351800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5654286f8360 con 0x5654288564e0 2024-09-21T09:04:16.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.504+0000 7f4199e45640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5654288564e0 0x5654288568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.504+0000 7f4193fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x565428856e20 0x56542885b9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:56378/0 (socket says 172.21.15.178:56378) 2024-09-21T09:04:16.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.504+0000 7f4193fff640 1 -- 172.21.15.178:0/3565743740 learned_addr learned my addr 172.21.15.178:0/3565743740 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:04:16.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.504+0000 7f4199e45640 1 -- 172.21.15.178:0/3565743740 >> v1:172.21.15.44:6789/0 conn(0x565428856e20 legacy=0x56542885b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.504+0000 7f4199e45640 1 -- 172.21.15.178:0/3565743740 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56542871ee00 con 0x5654288564e0 2024-09-21T09:04:16.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.506+0000 7f4199e45640 1 --2- 172.21.15.178:0/3565743740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x5654288568e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f418c00a470 tx=0x7f418c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a39d87cce80f819 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.506+0000 7f4199644640 1 -- 172.21.15.178:0/3565743740 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c053570 con 0x5654288564e0 2024-09-21T09:04:16.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.506+0000 7f4199644640 1 -- 172.21.15.178:0/3565743740 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418c058070 con 0x5654288564e0 2024-09-21T09:04:16.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.506+0000 7f4199644640 1 -- 172.21.15.178:0/3565743740 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c053880 con 0x5654288564e0 2024-09-21T09:04:16.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.506+0000 7f419c351800 1 -- 172.21.15.178:0/3565743740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 msgr2=0x5654288568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.506+0000 7f419c351800 1 --2- 172.21.15.178:0/3565743740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x5654288568e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f418c00a470 tx=0x7f418c045a20 comp rx=0 tx=0).stop 2024-09-21T09:04:16.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.506+0000 7f419c351800 1 -- 172.21.15.178:0/3565743740 shutdown_connections 2024-09-21T09:04:16.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.506+0000 7f419c351800 1 --2- 172.21.15.178:0/3565743740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x5654288568e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.506+0000 7f419c351800 1 -- 172.21.15.178:0/3565743740 >> 172.21.15.178:0/3565743740 conn(0x565428851dd0 msgr2=0x5654288541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.506+0000 7f419c351800 1 -- 172.21.15.178:0/3565743740 shutdown_connections 2024-09-21T09:04:16.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.506+0000 7f419c351800 1 -- 172.21.15.178:0/3565743740 wait complete. 2024-09-21T09:04:16.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.520+0000 7f419c351800 1 Processor -- start 2024-09-21T09:04:16.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.520+0000 7f419c351800 1 -- start start 2024-09-21T09:04:16.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.520+0000 7f419c351800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x565428948ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.520+0000 7f419c351800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5654287a3360 con 0x5654288564e0 2024-09-21T09:04:16.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.521+0000 7f4199e45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x565428948ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.521+0000 7f4199e45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x565428948ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42716/0 (socket says 172.21.15.178:42716) 2024-09-21T09:04:16.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.521+0000 7f4199e45640 1 -- 172.21.15.178:0/2321933383 learned_addr learned my addr 172.21.15.178:0/2321933383 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.521+0000 7f4199e45640 1 -- 172.21.15.178:0/2321933383 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654286f0bc0 con 0x5654288564e0 2024-09-21T09:04:16.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.521+0000 7f4199e45640 1 --2- 172.21.15.178:0/2321933383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x565428948ab0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f418c025c20 tx=0x7f418c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bbeb4371b8f7bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.521+0000 7f4087e07640 1 -- 172.21.15.178:0/2321933383 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c05c580 con 0x5654288564e0 2024-09-21T09:04:16.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.521+0000 7f4087e07640 1 -- 172.21.15.178:0/2321933383 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418c063030 con 0x5654288564e0 2024-09-21T09:04:16.524 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.521+0000 7f4087e07640 1 -- 172.21.15.178:0/2321933383 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c05c850 con 0x5654288564e0 2024-09-21T09:04:16.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.522+0000 7f419c351800 1 -- 172.21.15.178:0/2321933383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 msgr2=0x565428948ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.522+0000 7f419c351800 1 --2- 172.21.15.178:0/2321933383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x565428948ab0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f418c025c20 tx=0x7f418c051000 comp rx=0 tx=0).stop 2024-09-21T09:04:16.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.522+0000 7f419c351800 1 -- 172.21.15.178:0/2321933383 shutdown_connections 2024-09-21T09:04:16.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.522+0000 7f419c351800 1 --2- 172.21.15.178:0/2321933383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x565428948ab0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.522+0000 7f419c351800 1 -- 172.21.15.178:0/2321933383 >> 172.21.15.178:0/2321933383 conn(0x565428851dd0 msgr2=0x565428940060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.522+0000 7f419c351800 1 -- 172.21.15.178:0/2321933383 shutdown_connections 2024-09-21T09:04:16.525 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.522+0000 7f419c351800 1 -- 172.21.15.178:0/2321933383 wait complete. 2024-09-21T09:04:16.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.523+0000 7f419c351800 1 Processor -- start 2024-09-21T09:04:16.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.523+0000 7f419c351800 1 -- start start 2024-09-21T09:04:16.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.523+0000 7f419c351800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x565428950430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.523+0000 7f419c351800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56542885d500 con 0x5654288564e0 2024-09-21T09:04:16.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.523+0000 7f4199e45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x565428950430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.523+0000 7f4199e45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x565428950430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42718/0 (socket says 172.21.15.178:42718) 2024-09-21T09:04:16.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.523+0000 7f4199e45640 1 -- 172.21.15.178:0/1544897213 learned_addr learned my addr 172.21.15.178:0/1544897213 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.523+0000 7f4199e45640 1 -- 172.21.15.178:0/1544897213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565428704fe0 con 0x5654288564e0 2024-09-21T09:04:16.526 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.524+0000 7f4199e45640 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x565428950430 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x565428949910 tx=0x7f418c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.524+0000 7f4086604640 1 -- 172.21.15.178:0/1544897213 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c054ad0 con 0x5654288564e0 2024-09-21T09:04:16.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.524+0000 7f4086604640 1 -- 172.21.15.178:0/1544897213 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418c054c70 con 0x5654288564e0 2024-09-21T09:04:16.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.524+0000 7f4086604640 1 -- 172.21.15.178:0/1544897213 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c068420 con 0x5654288564e0 2024-09-21T09:04:16.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.524+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565428950970 con 0x5654288564e0 2024-09-21T09:04:16.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.524+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565428950e90 con 0x5654288564e0 2024-09-21T09:04:16.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.525+0000 7f4086604640 1 -- 172.21.15.178:0/1544897213 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f418c0685c0 con 0x5654288564e0 2024-09-21T09:04:16.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.525+0000 7f4086604640 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4080036b40 0x7f4080039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.525+0000 7f4086604640 1 -- 172.21.15.178:0/1544897213 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f418c070030 con 0x5654288564e0 2024-09-21T09:04:16.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.525+0000 7f4193fff640 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4080036b40 0x7f4080039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.525+0000 7f419c351800 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x565428856e20 0x5654289574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.525+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565428957a20 con 0x565428856e20 2024-09-21T09:04:16.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.525+0000 7f419a646640 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x565428856e20 0x5654289574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.525+0000 7f4193fff640 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4080036b40 0x7f4080039000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4184000f60 tx=0x7f41840012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.525+0000 7f419a646640 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x565428856e20 0x5654289574a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.526+0000 7f419a646640 1 -- 172.21.15.178:0/1544897213 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f419400a4a0 con 0x565428856e20 2024-09-21T09:04:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.526+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565428954a70 con 0x565428856e20 2024-09-21T09:04:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.526+0000 7f419a646640 1 -- 172.21.15.178:0/1544897213 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f419400a4a0 con 0x565428856e20 2024-09-21T09:04:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.526+0000 7f419c351800 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x565428959d70 0x56542895c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.526+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56542895c800 con 0x565428959d70 2024-09-21T09:04:16.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.526+0000 7f4199e45640 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x565428959d70 0x56542895c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.527+0000 7f4199e45640 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x565428959d70 0x56542895c160 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.527+0000 7f4199e45640 1 -- 172.21.15.178:0/1544897213 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f418c051070 con 0x565428959d70 2024-09-21T09:04:16.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.527+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565428958c10 con 0x565428856e20 2024-09-21T09:04:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.527+0000 7f419a646640 1 -- 172.21.15.178:0/1544897213 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f419400a4a0 con 0x565428856e20 2024-09-21T09:04:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.527+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289590b0 con 0x565428856e20 2024-09-21T09:04:16.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.527+0000 7f419a646640 1 -- 172.21.15.178:0/1544897213 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f419400a4a0 con 0x565428856e20 2024-09-21T09:04:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.528+0000 7f419c351800 1 Processor -- start 2024-09-21T09:04:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.528+0000 7f419c351800 1 -- start start 2024-09-21T09:04:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.528+0000 7f419c351800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56542896b180 0x56542896b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.528+0000 7f419c351800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5654286f2580 con 0x56542896b180 2024-09-21T09:04:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.528+0000 7f419a646640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56542896b180 0x56542896b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.528+0000 7f419a646640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56542896b180 0x56542896b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42720/0 (socket says 172.21.15.178:42720) 2024-09-21T09:04:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.528+0000 7f419a646640 1 -- 172.21.15.178:0/1211620353 learned_addr learned my addr 172.21.15.178:0/1211620353 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.528+0000 7f419a646640 1 -- 172.21.15.178:0/1211620353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56542896bae0 con 0x56542896b180 2024-09-21T09:04:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.529+0000 7f419a646640 1 --2- 172.21.15.178:0/1211620353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56542896b180 0x56542896b5a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x565428957e20 tx=0x7f4194018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.529+0000 7f407f7fe640 1 -- 172.21.15.178:0/1211620353 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4194014450 con 0x56542896b180 2024-09-21T09:04:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.529+0000 7f407f7fe640 1 -- 172.21.15.178:0/1211620353 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41940145f0 con 0x56542896b180 2024-09-21T09:04:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.529+0000 7f419c351800 1 -- 172.21.15.178:0/1211620353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56542896bd70 con 0x56542896b180 2024-09-21T09:04:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.529+0000 7f407f7fe640 1 -- 172.21.15.178:0/1211620353 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4194014910 con 0x56542896b180 2024-09-21T09:04:16.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.529+0000 7f419c351800 1 -- 172.21.15.178:0/1211620353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56542896ea50 con 0x56542896b180 2024-09-21T09:04:16.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.530+0000 7f407f7fe640 1 -- 172.21.15.178:0/1211620353 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4194011040 con 0x56542896b180 2024-09-21T09:04:16.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.530+0000 7f407f7fe640 1 --2- 172.21.15.178:0/1211620353 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4074036b40 0x7f4074039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.530+0000 7f407f7fe640 1 -- 172.21.15.178:0/1211620353 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f419401e070 con 0x56542896b180 2024-09-21T09:04:16.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.530+0000 7f4199e45640 1 --2- 172.21.15.178:0/1211620353 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4074036b40 0x7f4074039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.530+0000 7f419c351800 1 Processor -- start 2024-09-21T09:04:16.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.530+0000 7f419c351800 1 -- start start 2024-09-21T09:04:16.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.530+0000 7f4199e45640 1 --2- 172.21.15.178:0/1211620353 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4074036b40 0x7f4074039000 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x565428957e90 tx=0x7f418c060ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.530+0000 7f419c351800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565428977e50 0x565428978250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.530+0000 7f419c351800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x565428949200 con 0x565428977e50 2024-09-21T09:04:16.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.531+0000 7f419a646640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565428977e50 0x565428978250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.531+0000 7f419a646640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565428977e50 0x565428978250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42734/0 (socket says 172.21.15.178:42734) 2024-09-21T09:04:16.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.531+0000 7f419a646640 1 -- 172.21.15.178:0/4021259899 learned_addr learned my addr 172.21.15.178:0/4021259899 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.531+0000 7f419a646640 1 -- 172.21.15.178:0/4021259899 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565428978820 con 0x565428977e50 2024-09-21T09:04:16.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.531+0000 7f419a646640 1 --2- 172.21.15.178:0/4021259899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565428977e50 0x565428978250 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f419404cd20 tx=0x7f419404cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e4d70b5034d71c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.531+0000 7f407d7fa640 1 -- 172.21.15.178:0/4021259899 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4194011540 con 0x565428977e50 2024-09-21T09:04:16.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.531+0000 7f407d7fa640 1 -- 172.21.15.178:0/4021259899 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4194046b10 con 0x565428977e50 2024-09-21T09:04:16.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.531+0000 7f407d7fa640 1 -- 172.21.15.178:0/4021259899 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4194046e10 con 0x565428977e50 2024-09-21T09:04:16.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.532+0000 7f419c351800 1 -- 172.21.15.178:0/4021259899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565428977e50 msgr2=0x565428978250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.532+0000 7f419c351800 1 --2- 172.21.15.178:0/4021259899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565428977e50 0x565428978250 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f419404cd20 tx=0x7f419404cf40 comp rx=0 tx=0).stop 2024-09-21T09:04:16.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.532+0000 7f419c351800 1 -- 172.21.15.178:0/4021259899 shutdown_connections 2024-09-21T09:04:16.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.532+0000 7f419c351800 1 --2- 172.21.15.178:0/4021259899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565428977e50 0x565428978250 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.532+0000 7f419c351800 1 -- 172.21.15.178:0/4021259899 >> 172.21.15.178:0/4021259899 conn(0x5654289741b0 msgr2=0x5654289722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.532+0000 7f419c351800 1 -- 172.21.15.178:0/4021259899 shutdown_connections 2024-09-21T09:04:16.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.532+0000 7f419c351800 1 -- 172.21.15.178:0/4021259899 wait complete. 2024-09-21T09:04:16.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.532+0000 7f419c351800 1 Processor -- start 2024-09-21T09:04:16.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.532+0000 7f419c351800 1 -- start start 2024-09-21T09:04:16.546 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.532+0000 7f419c351800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565428977e50 0x56542897f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.532+0000 7f419c351800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x565428978ed0 con 0x565428977e50 2024-09-21T09:04:16.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.532+0000 7f419a646640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565428977e50 0x56542897f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.532+0000 7f419a646640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565428977e50 0x56542897f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:42744/0 (socket says 172.21.15.178:42744) 2024-09-21T09:04:16.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.532+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 learned_addr learned my addr 172.21.15.178:0/2892758857 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:16.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.533+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56542897f870 con 0x565428977e50 2024-09-21T09:04:16.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.533+0000 7f419a646640 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565428977e50 0x56542897f330 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4194040540 tx=0x7f419404ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.533+0000 7f406b7fe640 1 -- 172.21.15.178:0/2892758857 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f419403b070 con 0x565428977e50 2024-09-21T09:04:16.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.533+0000 7f406b7fe640 1 -- 172.21.15.178:0/2892758857 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4194014df0 con 0x565428977e50 2024-09-21T09:04:16.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.533+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56542897fb00 con 0x565428977e50 2024-09-21T09:04:16.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.533+0000 7f406b7fe640 1 -- 172.21.15.178:0/2892758857 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4194046560 con 0x565428977e50 2024-09-21T09:04:16.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.533+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654289827b0 con 0x565428977e50 2024-09-21T09:04:16.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.534+0000 7f406b7fe640 1 -- 172.21.15.178:0/2892758857 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4194043070 con 0x565428977e50 2024-09-21T09:04:16.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.534+0000 7f406b7fe640 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4064036b40 0x7f4064039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.534+0000 7f406b7fe640 1 -- 172.21.15.178:0/2892758857 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f419400e040 con 0x565428977e50 2024-09-21T09:04:16.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.534+0000 7f4199e45640 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4064036b40 0x7f4064039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.534+0000 7f4199e45640 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4064036b40 0x7f4064039000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f418c025c20 tx=0x7f418c085000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.534+0000 7f419c351800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.534+0000 7f419c351800 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56542898ad90 0x56542898d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.534+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56542898d9a0 con 0x56542898ad90 2024-09-21T09:04:16.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.535+0000 7f4193fff640 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56542898ad90 0x56542898d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.535+0000 7f4193fff640 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56542898ad90 0x56542898d250 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.535+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4184009050 con 0x56542898ad90 2024-09-21T09:04:16.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.535+0000 7f419c351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.535+0000 7f419c351800 20 realm 2024-09-21T09:04:16.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.535+0000 7f419c351800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.535+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56542898a1e0 con 0x56542898ad90 2024-09-21T09:04:16.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.535+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4184009050 con 0x56542898ad90 2024-09-21T09:04:16.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.535+0000 7f419c351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.535+0000 7f419c351800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:04:16.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.535+0000 7f419c351800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.535+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56542898e490 con 0x56542898ad90 2024-09-21T09:04:16.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.536+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4184009050 con 0x56542898ad90 2024-09-21T09:04:16.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.536+0000 7f419c351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.536+0000 7f419c351800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.536+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56542898ed60 con 0x56542898ad90 2024-09-21T09:04:16.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.536+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4184009050 con 0x56542898ad90 2024-09-21T09:04:16.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.536+0000 7f419c351800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:16.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.536+0000 7f419c351800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.536+0000 7f419c351800 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56542898f6a0 0x565428991a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.536+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565428992220 con 0x56542898f6a0 2024-09-21T09:04:16.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.536+0000 7f419a646640 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56542898f6a0 0x565428991a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.537+0000 7f419a646640 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56542898f6a0 0x565428991a90 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.537+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.537+0000 7f419c351800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:04:16.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.537+0000 7f419c351800 20 searching for the correct realm 2024-09-21T09:04:16.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.537+0000 7f419c351800 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5654289941f0 0x5654289966b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.537+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x565428996d80 con 0x5654289941f0 2024-09-21T09:04:16.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.537+0000 7f4199e45640 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5654289941f0 0x5654289966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.537+0000 7f4199e45640 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5654289941f0 0x5654289966b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.538+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.538+0000 7f4199e45640 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f418c05c070 0x7f418c090430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:16.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.538+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x565428996d80 con 0x7f418c05c070 2024-09-21T09:04:16.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.538+0000 7f4193fff640 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f418c05c070 0x7f418c090430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:16.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.538+0000 7f4193fff640 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f418c05c070 0x7f418c090430 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:16.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.538+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184009050 con 0x7f418c05c070 2024-09-21T09:04:16.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.538+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x565428996d80 con 0x56542898f6a0 2024-09-21T09:04:16.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.539+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.539+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x565428996d80 con 0x56542898ad90 2024-09-21T09:04:16.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.539+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184009050 con 0x56542898ad90 2024-09-21T09:04:16.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.539+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x565428996d80 con 0x56542898ad90 2024-09-21T09:04:16.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.539+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184029040 con 0x56542898ad90 2024-09-21T09:04:16.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.539+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x565428996d80 con 0x56542898f6a0 2024-09-21T09:04:16.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.539+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.539+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x565428996d80 con 0x56542898f6a0 2024-09-21T09:04:16.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.540+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.540+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x565428996d80 con 0x7f418c05c070 2024-09-21T09:04:16.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.540+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184029040 con 0x7f418c05c070 2024-09-21T09:04:16.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.540+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x565428996d80 con 0x5654289941f0 2024-09-21T09:04:16.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.540+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.540+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x565428996d80 con 0x56542898ad90 2024-09-21T09:04:16.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.540+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184029040 con 0x56542898ad90 2024-09-21T09:04:16.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.540+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x565428996d80 con 0x56542898f6a0 2024-09-21T09:04:16.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.541+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.541+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x565428996d80 con 0x56542898ad90 2024-09-21T09:04:16.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.541+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184029040 con 0x56542898ad90 2024-09-21T09:04:16.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.541+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x565428996d80 con 0x7f418c05c070 2024-09-21T09:04:16.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.541+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4184029040 con 0x7f418c05c070 2024-09-21T09:04:16.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.541+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x565428996d80 con 0x5654289941f0 2024-09-21T09:04:16.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.541+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.541+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x5654289941f0 2024-09-21T09:04:16.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.542+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.542+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x56542898f6a0 2024-09-21T09:04:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.542+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.542+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x5654289941f0 2024-09-21T09:04:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.542+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.542+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x5654289941f0 2024-09-21T09:04:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.543+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.543+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x56542898ad90 2024-09-21T09:04:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.543+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4184029040 con 0x56542898ad90 2024-09-21T09:04:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.543+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x56542898ad90 2024-09-21T09:04:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.543+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4184029040 con 0x56542898ad90 2024-09-21T09:04:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.543+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x56542898f6a0 2024-09-21T09:04:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.544+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.544+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x5654289941f0 2024-09-21T09:04:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.544+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.544+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x7f418c05c070 2024-09-21T09:04:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.544+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184029040 con 0x7f418c05c070 2024-09-21T09:04:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.544+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x56542898ad90 2024-09-21T09:04:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.544+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184029040 con 0x56542898ad90 2024-09-21T09:04:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.544+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x56542898f6a0 2024-09-21T09:04:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.545+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.545+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x5654289941f0 2024-09-21T09:04:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.545+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.545+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x7f418c05c070 2024-09-21T09:04:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.545+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184029040 con 0x7f418c05c070 2024-09-21T09:04:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.545+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x7f418c05c070 2024-09-21T09:04:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.545+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184029040 con 0x7f418c05c070 2024-09-21T09:04:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.545+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x5654289941f0 2024-09-21T09:04:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x56542898f6a0 2024-09-21T09:04:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x56542898ad90 2024-09-21T09:04:16.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4184029040 con 0x56542898ad90 2024-09-21T09:04:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f418c0a9040 con 0x7f418c05c070 2024-09-21T09:04:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184029040 con 0x7f418c05c070 2024-09-21T09:04:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f419c351800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:04:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f419c351800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:04:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f419c351800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:04:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f419c351800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:04:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f419c351800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:04:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f419c351800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:04:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f419c351800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.546+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565428992c10 con 0x56542898ad90 2024-09-21T09:04:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4184029040 con 0x56542898ad90 2024-09-21T09:04:16.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289934b0 con 0x56542898ad90 2024-09-21T09:04:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565428992850 con 0x56542898ad90 2024-09-21T09:04:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:04:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 20 zone default found 2024-09-21T09:04:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 4 Realm: () 2024-09-21T09:04:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:04:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:04:16.567 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:04:16.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 20 zonegroup default 2024-09-21T09:04:16.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565428997290 con 0x56542898f6a0 2024-09-21T09:04:16.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.547+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565428999560 con 0x5654289941f0 2024-09-21T09:04:16.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.548+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.548+0000 7f419c351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.548+0000 7f419c351800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.548+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565428999900 con 0x5654289941f0 2024-09-21T09:04:16.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.548+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.568 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.548+0000 7f419c351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:16.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.548+0000 7f419c351800 20 started sync module instance, tier type = 2024-09-21T09:04:16.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.548+0000 7f419c351800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:04:16.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.548+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289989f0 con 0x7f418c05c070 2024-09-21T09:04:16.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.549+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.549+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94919458393888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289989f0 con 0x7f418c05c070 2024-09-21T09:04:16.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.549+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56542899a310 con 0x56542898ad90 2024-09-21T09:04:16.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.550+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94919458393888] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.551+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.551+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94919458398272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289989f0 con 0x56542898ad90 2024-09-21T09:04:16.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.551+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56542899ad60 con 0x5654289941f0 2024-09-21T09:04:16.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.552+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94919458398272] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.552+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.552+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94919458391360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565428998960 con 0x5654289941f0 2024-09-21T09:04:16.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.552+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56542899bc20 con 0x7f418c05c070 2024-09-21T09:04:16.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.553+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.553+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94919458404688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56542899c360 con 0x7f418c05c070 2024-09-21T09:04:16.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.553+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56542899ce80 con 0x56542898ad90 2024-09-21T09:04:16.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.553+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94919458391360] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.554+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.554+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94919458408784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56542899ce40 con 0x56542898ad90 2024-09-21T09:04:16.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.554+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56542899d890 con 0x56542898f6a0 2024-09-21T09:04:16.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.554+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94919458404688] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.555+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.555+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94919458411488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56542899dc80 con 0x56542898f6a0 2024-09-21T09:04:16.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.555+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56542899e6a0 con 0x56542898f6a0 2024-09-21T09:04:16.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.555+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94919458408784] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.556+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94919458411488] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.556+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.556+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94919458405808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56542899b150 con 0x56542898f6a0 2024-09-21T09:04:16.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.556+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56542899ec80 con 0x56542898f6a0 2024-09-21T09:04:16.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.557+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94919458405808] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.557+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.557+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94919458414992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56542899ec80 con 0x56542898f6a0 2024-09-21T09:04:16.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.557+0000 7f419c351800 20 add_watcher() i=0 2024-09-21T09:04:16.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.557+0000 7f419c351800 20 add_watcher() i=1 2024-09-21T09:04:16.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.557+0000 7f419c351800 20 add_watcher() i=2 2024-09-21T09:04:16.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.557+0000 7f419c351800 20 add_watcher() i=3 2024-09-21T09:04:16.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.557+0000 7f419c351800 20 add_watcher() i=4 2024-09-21T09:04:16.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.557+0000 7f419c351800 20 add_watcher() i=5 2024-09-21T09:04:16.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.557+0000 7f419c351800 20 add_watcher() i=6 2024-09-21T09:04:16.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.558+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94919458414992] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.558+0000 7f419c351800 20 add_watcher() i=7 2024-09-21T09:04:16.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.558+0000 7f419c351800 2 all 8 watchers are set, enabling cache 2024-09-21T09:04:16.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.558+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289a1f40 con 0x56542898ad90 2024-09-21T09:04:16.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.559+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.559+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94919458416960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56542899f210 con 0x56542898ad90 2024-09-21T09:04:16.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.560+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94919458416960] v31'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.560+0000 7f404b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:16.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.560+0000 7f419c351800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:04:16.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.560+0000 7f419c351800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:04:16.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.560+0000 7f419c351800 5 note: GC not initialized 2024-09-21T09:04:16.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.560+0000 7f404a7fc640 20 reqs_thread_entry: start 2024-09-21T09:04:16.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.560+0000 7f419c351800 20 init_complete bucket index max shards: 11 2024-09-21T09:04:16.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.561+0000 7f419c351800 20 Filter name: none 2024-09-21T09:04:16.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.561+0000 7f3fbbfff640 20 reqs_thread_entry: start 2024-09-21T09:04:16.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.561+0000 7f419c351800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-21T09:04:16.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.561+0000 7f419c351800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.561+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289d53e0 con 0x56542898f6a0 2024-09-21T09:04:16.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.561+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.561+0000 7f419c351800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T09:04:16.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.561+0000 7f419c351800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-21T09:04:16.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.561+0000 7f419c351800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-21T09:04:16.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.561+0000 7f419c351800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:04:16.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.561+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d9760 con 0x7f418c05c070 2024-09-21T09:04:16.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.563+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v31'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.563+0000 7f419c351800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-21T09:04:16.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.563+0000 7f419c351800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-21T09:04:16.581 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.563+0000 7f419c351800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-21T09:04:16.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.563+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94919458656848 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289da370 con 0x56542898f6a0 2024-09-21T09:04:16.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.563+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== watch-notify(notify (1) cookie 94919458411488 notify 133143986207 ret 0) ==== 424+0+0 (crc 0 0 0) 0x56542897fb00 con 0x56542898f6a0 2024-09-21T09:04:16.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.563+0000 7f407d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986207 cookie 94919458411488 notifier 4735 bl.length()=382 2024-09-21T09:04:16.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.563+0000 7f407d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-21T09:04:16.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.563+0000 7f407d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-21T09:04:16.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.563+0000 7f407d7fa640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f405c003ea0 con 0x56542898f6a0 2024-09-21T09:04:16.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.563+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(64 notify.5 [notify cookie 94919458656848 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.564+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== watch-notify(notify_complete (2) cookie 94919458656848 notify 133143986207 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56542897f870 con 0x56542898f6a0 2024-09-21T09:04:16.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.564+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.564+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289da2f0 con 0x56542898ad90 2024-09-21T09:04:16.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.564+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.564+0000 7f419c351800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 : miss 2024-09-21T09:04:16.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.564+0000 7f419c351800 20 rados->read ofs=0 len=0 2024-09-21T09:04:16.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.564+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 8.1b 8:d9f8a085:root::.bucket.meta.myfoo6%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289d7730 con 0x7f418c05c070 2024-09-21T09:04:16.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.565+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(67 .bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.565+0000 7f419c351800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T09:04:16.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.565+0000 7f419c351800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 info.flags=0x17 2024-09-21T09:04:16.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.565+0000 7f419c351800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 to cache LRU end 2024-09-21T09:04:16.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.565+0000 7f419c351800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:04:16.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.565+0000 7f419c351800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:04:16.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.565+0000 7f419c351800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 2024-09-21T09:04:16.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.565+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:68 8.1b 8:d9f8a085:root::.bucket.meta.myfoo6%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d7770 con 0x7f418c05c070 2024-09-21T09:04:16.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.566+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(68 .bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v31'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.566+0000 7f419c351800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 info.flags=0x17 2024-09-21T09:04:16.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.566+0000 7f419c351800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 to cache LRU end 2024-09-21T09:04:16.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.566+0000 7f419c351800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-21T09:04:16.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.566+0000 7f419c351800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9, ofs0, ns] 2024-09-21T09:04:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.566+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94919458645792 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289ddc80 con 0x7f418c05c070 2024-09-21T09:04:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.566+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== watch-notify(notify (1) cookie 94919458393888 notify 133143986198 ret 0) ==== 790+0+0 (crc 0 0 0) 0x5654289d7b20 con 0x7f418c05c070 2024-09-21T09:04:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.566+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(69 notify.0 [notify cookie 94919458645792 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.566+0000 7f407cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986198 cookie 94919458393888 notifier 4735 bl.length()=748 2024-09-21T09:04:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.566+0000 7f407cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 info.flags=0x17 2024-09-21T09:04:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.566+0000 7f407cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 to cache LRU end 2024-09-21T09:04:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.566+0000 7f407cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-21T09:04:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.566+0000 7f407cff9640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3fc4003530 con 0x7f418c05c070 2024-09-21T09:04:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.567+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== watch-notify(notify_complete (2) cookie 94919458645792 notify 133143986198 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5654289da450 con 0x7f418c05c070 2024-09-21T09:04:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.567+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(70 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.567+0000 7f419c351800 20 handle_bi_update(): bucket=:myfoo6[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9]): orig_sources= new_sources= 2024-09-21T09:04:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.567+0000 7f419c351800 20 handle_bi_update(): bucket=:myfoo6[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9]): potential sources added=[] removed=[] 2024-09-21T09:04:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.567+0000 7f419c351800 20 handle_bi_update(): bucket=:myfoo6[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9]): orig_dests= new_dests= 2024-09-21T09:04:16.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.567+0000 7f419c351800 20 handle_bi_update(): bucket=:myfoo6[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9]): potential dests added=[] removed=[] 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.567+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d6720 con 0x56542898ad90 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.568+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(71 bud.buckets [call] v31'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.568+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d6720 con 0x56542898ad90 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.569+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(72 bud.buckets [call] v31'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.569+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d6720 con 0x56542898ad90 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.570+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v31'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.570+0000 7f419c351800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.570+0000 7f419c351800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.570+0000 7f419c351800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.570+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94919458645792 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289ddc80 con 0x7f418c05c070 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.570+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== watch-notify(notify (1) cookie 94919458404688 notify 133143986199 ret 0) ==== 358+0+0 (crc 0 0 0) 0x5654289d93d0 con 0x7f418c05c070 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.570+0000 7f407cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986199 cookie 94919458404688 notifier 4735 bl.length()=316 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.570+0000 7f407cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.570+0000 7f407cff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-21T09:04:16.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.570+0000 7f407cff9640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3fc4003590 con 0x7f418c05c070 2024-09-21T09:04:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.570+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(74 notify.3 [notify cookie 94919458645792 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.571+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 21 ==== watch-notify(notify_complete (2) cookie 94919458645792 notify 133143986199 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5654289da450 con 0x7f418c05c070 2024-09-21T09:04:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.571+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 22 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.571+0000 7f419c351800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 : hit (requested=0x17, cached=0x17) 2024-09-21T09:04:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.571+0000 7f419c351800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 2024-09-21T09:04:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.571+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:76 8.1b 8:d9f8a085:root::.bucket.meta.myfoo6%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289e1b00 con 0x7f418c05c070 2024-09-21T09:04:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.572+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 23 ==== osd_op_reply(76 .bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v31'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.572+0000 7f419c351800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 info.flags=0x17 2024-09-21T09:04:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.572+0000 7f419c351800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 to cache LRU end 2024-09-21T09:04:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.572+0000 7f419c351800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-21T09:04:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.572+0000 7f419c351800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9, ofs0, ns] 2024-09-21T09:04:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.572+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94919458666416 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289dd090 con 0x7f418c05c070 2024-09-21T09:04:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.572+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 24 ==== watch-notify(notify (1) cookie 94919458393888 notify 133143986200 ret 0) ==== 790+0+0 (crc 0 0 0) 0x5654289da450 con 0x7f418c05c070 2024-09-21T09:04:16.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.572+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 25 ==== osd_op_reply(77 notify.0 [notify cookie 94919458666416 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.572+0000 7f407d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986200 cookie 94919458393888 notifier 4735 bl.length()=748 2024-09-21T09:04:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.572+0000 7f407d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 info.flags=0x17 2024-09-21T09:04:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.572+0000 7f407d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 to cache LRU end 2024-09-21T09:04:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.572+0000 7f407d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-21T09:04:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.572+0000 7f407d7fa640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f405c003ea0 con 0x7f418c05c070 2024-09-21T09:04:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.572+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 26 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.573+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 27 ==== watch-notify(notify_complete (2) cookie 94919458666416 notify 133143986200 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565428716b30 con 0x7f418c05c070 2024-09-21T09:04:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.573+0000 7f419c351800 20 handle_bi_update(): bucket=:myfoo6[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9]): orig_sources= new_sources= 2024-09-21T09:04:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.573+0000 7f419c351800 20 handle_bi_update(): bucket=:myfoo6[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9]): potential sources added=[] removed=[] 2024-09-21T09:04:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.573+0000 7f419c351800 20 handle_bi_update(): bucket=:myfoo6[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9]): orig_dests= new_dests= 2024-09-21T09:04:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.573+0000 7f419c351800 20 handle_bi_update(): bucket=:myfoo6[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9]): potential dests added=[] removed=[] 2024-09-21T09:04:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.573+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:79 4.12 4:4b65198a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289dbc60 con 0x56542898ad90 2024-09-21T09:04:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.573+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(79 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.573+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:80 4.1 4:8120de49:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289dbc60 con 0x7f418c05c070 2024-09-21T09:04:16.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.573+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 28 ==== osd_op_reply(80 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.573+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 4.28 4:15728d93:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289dbc60 con 0x56542898ad90 2024-09-21T09:04:16.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.574+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.574+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:82 4.1 4:82bf2666:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289dbc60 con 0x7f418c05c070 2024-09-21T09:04:16.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.574+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 29 ==== osd_op_reply(82 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.574+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:83 4.3 4:c0fa3be1:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289dbc60 con 0x56542898ad90 2024-09-21T09:04:16.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.574+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(83 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.574+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:84 4.f 4:f2568a7a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289dbc60 con 0x56542898ad90 2024-09-21T09:04:16.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.574+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(84 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.574+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:85 4.11 4:88d7175f:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289dbc60 con 0x56542898f6a0 2024-09-21T09:04:16.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.575+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(85 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.575+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 4.3b 4:dc8860e6:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289dbc60 con 0x5654289941f0 2024-09-21T09:04:16.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.575+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(86 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.575+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:87 4.31 4:8c4a327e:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289dc090 con 0x56542898ad90 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.576+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(87 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.576+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:88 4.18 4:18bc876d:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289dc090 con 0x7f418c05c070 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.576+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 30 ==== osd_op_reply(88 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9 [call out=378b] v0'0 uv6 ondisk = 0) ==== 194+0+378 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.576+0000 7f419c351800 10 cls_bucket_list_unordered: got thirteen 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.576+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 4.5 4:a367e9ee:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289dc090 con 0x5654289941f0 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.576+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(89 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.10 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.576+0000 7f419c351800 20 get_obj_state: octx=0x7f418400e510 obj=myfoo6:thirteen state=0x5654289e0888 s->prefetch_data=0 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.576+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:90 3.1a 3:58a12cc7:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289dc090 con 0x56542898ad90 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(90 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 10 manifest: total_size = 8 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 20 get_obj_state: setting s->obj_tag to 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.15260595732039258655 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-21T09:04:16.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-21T09:04:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-21T09:04:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-21T09:04:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-21T09:04:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-21T09:04:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 20 get_obj_state: octx=0x7f418400e510 obj=myfoo6:thirteen state=0x5654289e0888 s->prefetch_data=0 2024-09-21T09:04:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 : hit (requested=0x17, cached=0x17) 2024-09-21T09:04:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 2024-09-21T09:04:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 20 bucket index object: :.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9 2024-09-21T09:04:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.577+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:91 4.18 4:18bc876d:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289e5020 con 0x7f418c05c070 2024-09-21T09:04:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.578+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 31 ==== osd_op_reply(91 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9 [stat,call,call] v31'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.578+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:92 3.1a 3:58a12cc7:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289e5180 con 0x56542898ad90 2024-09-21T09:04:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.579+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(92 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v31'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.579+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 4.18 4:18bc876d:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289e46c0 con 0x7f418c05c070 2024-09-21T09:04:16.590 INFO:teuthology.orchestra.run.smithi178.stderr:1 objects processed in :myfoo6[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9]). Next marker thirteen 2024-09-21T09:04:16.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.579+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x7f418c05c070 2024-09-21T09:04:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.580+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 32 ==== osd_op_reply(93 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9 [stat,call,call] v31'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.580+0000 7f407d7fa640 20 handle_completion(): completion ok for obj=thirteen 2024-09-21T09:04:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.580+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 33 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v31'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.580+0000 7f419c351800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-21T09:04:16.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.580+0000 7f419c351800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-21T09:04:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.580+0000 7f419c351800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-21T09:04:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.580+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94919458662304 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x56542898f6a0 2024-09-21T09:04:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.581+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== watch-notify(notify (1) cookie 94919458411488 notify 133143986208 ret 0) ==== 598+0+0 (crc 0 0 0) 0x56542897f870 con 0x56542898f6a0 2024-09-21T09:04:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.581+0000 7f407cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986208 cookie 94919458411488 notifier 4735 bl.length()=556 2024-09-21T09:04:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.581+0000 7f407cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-21T09:04:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.581+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(95 notify.5 [notify cookie 94919458662304 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.581+0000 7f407cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-21T09:04:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.581+0000 7f407cff9640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3fc4003090 con 0x56542898f6a0 2024-09-21T09:04:16.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.581+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.581+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== watch-notify(notify_complete (2) cookie 94919458662304 notify 133143986208 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4194032070 con 0x56542898f6a0 2024-09-21T09:04:16.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.581+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x56542898ad90 2024-09-21T09:04:16.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.582+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v31'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.582+0000 7f419c351800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-21T09:04:16.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.582+0000 7f419c351800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-21T09:04:16.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.582+0000 7f419c351800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-21T09:04:16.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.582+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94919458679744 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x56542898f6a0 2024-09-21T09:04:16.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.582+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== watch-notify(notify (1) cookie 94919458411488 notify 133143986209 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f4194032070 con 0x56542898f6a0 2024-09-21T09:04:16.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.582+0000 7f407cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986209 cookie 94919458411488 notifier 4735 bl.length()=177 2024-09-21T09:04:16.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.582+0000 7f407cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-21T09:04:16.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.582+0000 7f407cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-21T09:04:16.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.582+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(98 notify.5 [notify cookie 94919458679744 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.582+0000 7f407cff9640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3fc4003090 con 0x56542898f6a0 2024-09-21T09:04:16.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.583+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.583+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== watch-notify(notify_complete (2) cookie 94919458679744 notify 133143986209 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565428978820 con 0x56542898f6a0 2024-09-21T09:04:16.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.583+0000 7f419c351800 10 removing user index: bar 2024-09-21T09:04:16.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.583+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x56542898f6a0 2024-09-21T09:04:16.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.584+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 31 ==== osd_op_reply(100 bar [delete] v31'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.584+0000 7f419c351800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-21T09:04:16.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.584+0000 7f419c351800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-21T09:04:16.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.584+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94919458634208 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x56542898f6a0 2024-09-21T09:04:16.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.584+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 32 ==== watch-notify(notify (1) cookie 94919458414992 notify 133143986210 ret 0) ==== 194+0+0 (crc 0 0 0) 0x565428978820 con 0x56542898f6a0 2024-09-21T09:04:16.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.584+0000 7f407cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986210 cookie 94919458414992 notifier 4735 bl.length()=152 2024-09-21T09:04:16.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.584+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 33 ==== osd_op_reply(101 notify.7 [notify cookie 94919458634208 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.584+0000 7f407cff9640 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3fc4003590 con 0x56542898f6a0 2024-09-21T09:04:16.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.584+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 34 ==== watch-notify(notify_complete (2) cookie 94919458634208 notify 133143986210 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56542896ea50 con 0x56542898f6a0 2024-09-21T09:04:16.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.584+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 35 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.597 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-21T09:04:16.414590Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:04:16.414578Z","tags":[],"group_ids":[]} 2024-09-21T09:04:16.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.585+0000 7f404b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:16.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.585+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94919458416960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x56542898ad90 2024-09-21T09:04:16.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.586+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94919458416960] v31'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.586+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94919458393888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x7f418c05c070 2024-09-21T09:04:16.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.588+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 34 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94919458393888] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.588+0000 7f419c351800 20 remove_watcher() i=0 2024-09-21T09:04:16.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.588+0000 7f419c351800 2 removed watcher, disabling cache 2024-09-21T09:04:16.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.588+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94919458398272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x56542898ad90 2024-09-21T09:04:16.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.589+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 35 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94919458398272] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.589+0000 7f419c351800 20 remove_watcher() i=1 2024-09-21T09:04:16.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.589+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94919458391360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x5654289941f0 2024-09-21T09:04:16.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.590+0000 7f4199e45640 1 -- 172.21.15.178:0/2892758857 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94919458391360] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418c051070 con 0x5654289941f0 2024-09-21T09:04:16.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.590+0000 7f419c351800 20 remove_watcher() i=2 2024-09-21T09:04:16.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.590+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94919458404688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x7f418c05c070 2024-09-21T09:04:16.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.591+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.2 v2:172.21.15.178:6816/3267136144 35 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94919458404688] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x7f418c05c070 2024-09-21T09:04:16.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.591+0000 7f419c351800 20 remove_watcher() i=3 2024-09-21T09:04:16.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.591+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94919458408784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x56542898ad90 2024-09-21T09:04:16.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.592+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 <== osd.1 v2:172.21.15.178:6800/627496675 36 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94919458408784] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403d040 con 0x56542898ad90 2024-09-21T09:04:16.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.592+0000 7f419c351800 20 remove_watcher() i=4 2024-09-21T09:04:16.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.592+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94919458411488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x56542898f6a0 2024-09-21T09:04:16.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.593+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 36 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94919458411488] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.593+0000 7f419c351800 20 remove_watcher() i=5 2024-09-21T09:04:16.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.593+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94919458405808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x56542898f6a0 2024-09-21T09:04:16.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.594+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 37 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94919458405808] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.594+0000 7f419c351800 20 remove_watcher() i=6 2024-09-21T09:04:16.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.594+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94919458414992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654289d60c0 con 0x56542898f6a0 2024-09-21T09:04:16.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419a646640 1 -- 172.21.15.178:0/2892758857 <== osd.0 v2:172.21.15.44:6800/2732047064 38 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94919458414992] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419402a070 con 0x56542898f6a0 2024-09-21T09:04:16.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 20 remove_watcher() i=7 2024-09-21T09:04:16.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56542898f6a0 msgr2=0x565428991a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56542898f6a0 0x565428991a90 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56542898ad90 msgr2=0x56542898d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56542898ad90 0x56542898d250 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f418c05c070 msgr2=0x7f418c090430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f418c05c070 0x7f418c090430 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5654289941f0 msgr2=0x5654289966b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5654289941f0 0x5654289966b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4064036b40 msgr2=0x7f4064039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4064036b40 0x7f4064039000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f418c025c20 tx=0x7f418c085000 comp rx=0 tx=0).stop 2024-09-21T09:04:16.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f4193fff640 1 -- 172.21.15.178:0/2892758857 reap_dead start 2024-09-21T09:04:16.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565428977e50 msgr2=0x56542897f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565428977e50 0x56542897f330 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4194040540 tx=0x7f419404ccb0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 shutdown_connections 2024-09-21T09:04:16.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 --2- 172.21.15.178:0/2892758857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565428977e50 0x56542897f330 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 >> 172.21.15.178:0/2892758857 conn(0x5654289741b0 msgr2=0x565428972280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 shutdown_connections 2024-09-21T09:04:16.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/2892758857 wait complete. 2024-09-21T09:04:16.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/1211620353 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4074036b40 msgr2=0x7f4074039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 --2- 172.21.15.178:0/1211620353 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4074036b40 0x7f4074039000 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x565428957e90 tx=0x7f418c060ee0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/1211620353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56542896b180 msgr2=0x56542896b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 --2- 172.21.15.178:0/1211620353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56542896b180 0x56542896b5a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x565428957e20 tx=0x7f4194018830 comp rx=0 tx=0).stop 2024-09-21T09:04:16.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/1211620353 shutdown_connections 2024-09-21T09:04:16.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 --2- 172.21.15.178:0/1211620353 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4074036b40 0x7f4074039000 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 --2- 172.21.15.178:0/1211620353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56542896b180 0x56542896b5a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/1211620353 >> 172.21.15.178:0/1211620353 conn(0x565428960110 msgr2=0x565428962c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/1211620353 shutdown_connections 2024-09-21T09:04:16.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.596+0000 7f419c351800 1 -- 172.21.15.178:0/1211620353 wait complete. 2024-09-21T09:04:16.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x565428959d70 msgr2=0x56542895c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x565428959d70 0x56542895c160 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x565428856e20 msgr2=0x5654289574a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x565428856e20 0x5654289574a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4080036b40 msgr2=0x7f4080039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4080036b40 0x7f4080039000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4184000f60 tx=0x7f41840012b0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 msgr2=0x565428950430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:16.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x565428950430 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x565428949910 tx=0x7f418c002fb0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 shutdown_connections 2024-09-21T09:04:16.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x565428959d70 0x56542895c160 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x565428856e20 0x5654289574a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4080036b40 0x7f4080039000 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 --2- 172.21.15.178:0/1544897213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5654288564e0 0x565428950430 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:16.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 >> 172.21.15.178:0/1544897213 conn(0x565428851dd0 msgr2=0x56542893e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:16.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 shutdown_connections 2024-09-21T09:04:16.607 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:16.597+0000 7f419c351800 1 -- 172.21.15.178:0/1544897213 wait complete. 2024-09-21T09:04:16.608 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-21T09:04:16.414590Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:04:16.414578Z', 'tags': [], 'group_ids': []} 2024-09-21T09:04:21.614 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:04:21.614 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-21T09:04:21.615 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-21T09:04:21.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-21T09:04:21.615 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-21T09:04:21.674 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:04:21.674 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:04:21.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.673+0000 7f9c6ff19800 1 Processor -- start 2024-09-21T09:04:21.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.674+0000 7f9c6ff19800 1 -- start start 2024-09-21T09:04:21.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.674+0000 7f9c6ff19800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5655107fe940 0x565510800d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.674+0000 7f9c6ff19800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5655106bab30 con 0x5655107fa500 2024-09-21T09:04:21.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.674+0000 7f9c6ff19800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x56551069c360 con 0x5655107fe940 2024-09-21T09:04:21.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.674+0000 7f9c6d20c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5655107fe940 0x565510800d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.674+0000 7f9c6da0d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5655107fa500 0x5655107fa900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:32806/0 (socket says 172.21.15.178:32806) 2024-09-21T09:04:21.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.674+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3078843569 learned_addr learned my addr 172.21.15.178:0/3078843569 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:04:21.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.675+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3078843569 >> v1:172.21.15.44:6789/0 conn(0x5655107fa500 legacy=0x5655107fa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.675+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3078843569 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655106c2e00 con 0x5655107fe940 2024-09-21T09:04:21.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.676+0000 7f9c6d20c640 1 --2- 172.21.15.178:0/3078843569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fe940 0x565510800d30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9c6400a470 tx=0x7f9c64045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f386b75657f16f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.677+0000 7f9c6ca0b640 1 -- 172.21.15.178:0/3078843569 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c64053570 con 0x5655107fe940 2024-09-21T09:04:21.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.677+0000 7f9c6ca0b640 1 -- 172.21.15.178:0/3078843569 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c64058070 con 0x5655107fe940 2024-09-21T09:04:21.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.677+0000 7f9c6ca0b640 1 -- 172.21.15.178:0/3078843569 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c64053880 con 0x5655107fe940 2024-09-21T09:04:21.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.677+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3078843569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fe940 msgr2=0x565510800d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.677+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3078843569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fe940 0x565510800d30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9c6400a470 tx=0x7f9c64045a20 comp rx=0 tx=0).stop 2024-09-21T09:04:21.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.677+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3078843569 shutdown_connections 2024-09-21T09:04:21.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.677+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3078843569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fe940 0x565510800d30 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.677+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3078843569 >> 172.21.15.178:0/3078843569 conn(0x5655107f5e30 msgr2=0x5655107f8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:21.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.677+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3078843569 shutdown_connections 2024-09-21T09:04:21.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.677+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3078843569 wait complete. 2024-09-21T09:04:21.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.693+0000 7f9c6ff19800 1 Processor -- start 2024-09-21T09:04:21.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.693+0000 7f9c6ff19800 1 -- start start 2024-09-21T09:04:21.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.693+0000 7f9c6ff19800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fa500 0x5655108e9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.693+0000 7f9c6ff19800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x565510747370 con 0x5655107fa500 2024-09-21T09:04:21.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.693+0000 7f9c6da0d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fa500 0x5655108e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.693+0000 7f9c6da0d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fa500 0x5655108e9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33704/0 (socket says 172.21.15.178:33704) 2024-09-21T09:04:21.695 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.693+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3453736067 learned_addr learned my addr 172.21.15.178:0/3453736067 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.694+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3453736067 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565510694bc0 con 0x5655107fa500 2024-09-21T09:04:21.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.694+0000 7f9c6da0d640 1 --2- 172.21.15.178:0/3453736067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fa500 0x5655108e9840 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9c600017a0 tx=0x7f9c60001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc21e37bf937a822 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.694+0000 7f9b5be07640 1 -- 172.21.15.178:0/3453736067 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c60016070 con 0x5655107fa500 2024-09-21T09:04:21.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.694+0000 7f9b5be07640 1 -- 172.21.15.178:0/3453736067 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c60004520 con 0x5655107fa500 2024-09-21T09:04:21.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.694+0000 7f9b5be07640 1 -- 172.21.15.178:0/3453736067 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c60004820 con 0x5655107fa500 2024-09-21T09:04:21.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.695+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3453736067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fa500 msgr2=0x5655108e9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.695+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3453736067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fa500 0x5655108e9840 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9c600017a0 tx=0x7f9c60001c60 comp rx=0 tx=0).stop 2024-09-21T09:04:21.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.695+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3453736067 shutdown_connections 2024-09-21T09:04:21.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.695+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3453736067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fa500 0x5655108e9840 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.695+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3453736067 >> 172.21.15.178:0/3453736067 conn(0x5655107f5e30 msgr2=0x5655108e5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:21.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.695+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3453736067 shutdown_connections 2024-09-21T09:04:21.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.695+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3453736067 wait complete. 2024-09-21T09:04:21.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.695+0000 7f9c6ff19800 1 Processor -- start 2024-09-21T09:04:21.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.695+0000 7f9c6ff19800 1 -- start start 2024-09-21T09:04:21.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.695+0000 7f9c6ff19800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fa500 0x5655108ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.695+0000 7f9c6ff19800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x565510801570 con 0x5655107fa500 2024-09-21T09:04:21.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.696+0000 7f9c6da0d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fa500 0x5655108ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.696+0000 7f9c6da0d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fa500 0x5655108ee840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33720/0 (socket says 172.21.15.178:33720) 2024-09-21T09:04:21.699 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.696+0000 7f9c6da0d640 1 -- 172.21.15.178:0/891905590 learned_addr learned my addr 172.21.15.178:0/891905590 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.699 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.696+0000 7f9c6da0d640 1 -- 172.21.15.178:0/891905590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655106a8fe0 con 0x5655107fa500 2024-09-21T09:04:21.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.696+0000 7f9c6da0d640 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fa500 0x5655108ee840 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9c60014040 tx=0x7f9c60001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.697+0000 7f9b5a604640 1 -- 172.21.15.178:0/891905590 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c60020070 con 0x5655107fa500 2024-09-21T09:04:21.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.697+0000 7f9b5a604640 1 -- 172.21.15.178:0/891905590 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c60011550 con 0x5655107fa500 2024-09-21T09:04:21.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.697+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5655108ecf30 con 0x5655107fa500 2024-09-21T09:04:21.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.697+0000 7f9b5a604640 1 -- 172.21.15.178:0/891905590 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c60016040 con 0x5655107fa500 2024-09-21T09:04:21.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.697+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5655108ed4b0 con 0x5655107fa500 2024-09-21T09:04:21.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.698+0000 7f9b5a604640 1 -- 172.21.15.178:0/891905590 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9c60023070 con 0x5655107fa500 2024-09-21T09:04:21.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.698+0000 7f9b5a604640 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b54036b90 0x7f9b54039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.698+0000 7f9b5a604640 1 -- 172.21.15.178:0/891905590 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f9c6004bf10 con 0x5655107fa500 2024-09-21T09:04:21.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.698+0000 7f9c6d20c640 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b54036b90 0x7f9b54039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.698+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5655107fe940 0x5655108fb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.698+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5655108fbc60 con 0x5655107fe940 2024-09-21T09:04:21.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.698+0000 7f9c6e20e640 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5655107fe940 0x5655108fb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.698+0000 7f9c6d20c640 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b54036b90 0x7f9b54039050 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c64057000 tx=0x7f9c64052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.698+0000 7f9c6e20e640 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5655107fe940 0x5655108fb720 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.699+0000 7f9c6e20e640 1 -- 172.21.15.178:0/891905590 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c680083e0 con 0x5655107fe940 2024-09-21T09:04:21.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.699+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5655108fc4b0 con 0x5655107fe940 2024-09-21T09:04:21.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.699+0000 7f9c6e20e640 1 -- 172.21.15.178:0/891905590 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c680083e0 con 0x5655107fe940 2024-09-21T09:04:21.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.699+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5655108fdee0 0x5655109002f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.699+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565510900a80 con 0x5655108fdee0 2024-09-21T09:04:21.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.699+0000 7f9c6da0d640 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5655108fdee0 0x5655109002f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.700+0000 7f9c6da0d640 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5655108fdee0 0x5655109002f0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.700+0000 7f9c6da0d640 1 -- 172.21.15.178:0/891905590 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9c6002c070 con 0x5655108fdee0 2024-09-21T09:04:21.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.700+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5655108fcd00 con 0x5655107fe940 2024-09-21T09:04:21.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.700+0000 7f9c6e20e640 1 -- 172.21.15.178:0/891905590 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c680083e0 con 0x5655107fe940 2024-09-21T09:04:21.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.700+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5655108fd0a0 con 0x5655107fe940 2024-09-21T09:04:21.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.701+0000 7f9c6e20e640 1 -- 172.21.15.178:0/891905590 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9c680083e0 con 0x5655107fe940 2024-09-21T09:04:21.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.701+0000 7f9c6ff19800 1 Processor -- start 2024-09-21T09:04:21.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.701+0000 7f9c6ff19800 1 -- start start 2024-09-21T09:04:21.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.701+0000 7f9c6ff19800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551090f440 0x56551090f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.701+0000 7f9c6ff19800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5655108eed80 con 0x56551090f440 2024-09-21T09:04:21.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.702+0000 7f9c6e20e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551090f440 0x56551090f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.702+0000 7f9c6e20e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551090f440 0x56551090f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33734/0 (socket says 172.21.15.178:33734) 2024-09-21T09:04:21.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.702+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3168473769 learned_addr learned my addr 172.21.15.178:0/3168473769 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.702+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3168473769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56551090fda0 con 0x56551090f440 2024-09-21T09:04:21.705 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.702+0000 7f9c6e20e640 1 --2- 172.21.15.178:0/3168473769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551090f440 0x56551090f860 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x5655108ee230 tx=0x7f9c6800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.702+0000 7f9b537fe640 1 -- 172.21.15.178:0/3168473769 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c68007d00 con 0x56551090f440 2024-09-21T09:04:21.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.702+0000 7f9b537fe640 1 -- 172.21.15.178:0/3168473769 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c6801e020 con 0x56551090f440 2024-09-21T09:04:21.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.702+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3168473769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565510910030 con 0x56551090f440 2024-09-21T09:04:21.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.702+0000 7f9b537fe640 1 -- 172.21.15.178:0/3168473769 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c68019420 con 0x56551090f440 2024-09-21T09:04:21.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.703+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3168473769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565510912d10 con 0x56551090f440 2024-09-21T09:04:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.703+0000 7f9b537fe640 1 -- 172.21.15.178:0/3168473769 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9c68016040 con 0x56551090f440 2024-09-21T09:04:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.704+0000 7f9b537fe640 1 --2- 172.21.15.178:0/3168473769 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b48036b40 0x7f9b48039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.704+0000 7f9b537fe640 1 -- 172.21.15.178:0/3168473769 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f9c6801f030 con 0x56551090f440 2024-09-21T09:04:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.704+0000 7f9c6da0d640 1 --2- 172.21.15.178:0/3168473769 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b48036b40 0x7f9b48039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.704+0000 7f9c6ff19800 1 Processor -- start 2024-09-21T09:04:21.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.704+0000 7f9c6ff19800 1 -- start start 2024-09-21T09:04:21.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.704+0000 7f9c6da0d640 1 --2- 172.21.15.178:0/3168473769 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b48036b40 0x7f9b48039000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x5655108ed9b0 tx=0x7f9c6004a280 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.704+0000 7f9c6ff19800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551091c090 0x56551091c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.704+0000 7f9c6ff19800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x565510696580 con 0x56551091c090 2024-09-21T09:04:21.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.705+0000 7f9c6e20e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551091c090 0x56551091c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.705+0000 7f9c6e20e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551091c090 0x56551091c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33750/0 (socket says 172.21.15.178:33750) 2024-09-21T09:04:21.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.705+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3870880142 learned_addr learned my addr 172.21.15.178:0/3870880142 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.705+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3870880142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56551091ca60 con 0x56551091c090 2024-09-21T09:04:21.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.705+0000 7f9c6e20e640 1 --2- 172.21.15.178:0/3870880142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551091c090 0x56551091c490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9c6804cf20 tx=0x7f9c68017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810793b3acc7dc48 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.705+0000 7f9b517fa640 1 -- 172.21.15.178:0/3870880142 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c6801d030 con 0x56551091c090 2024-09-21T09:04:21.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.705+0000 7f9b517fa640 1 -- 172.21.15.178:0/3870880142 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c68015d00 con 0x56551091c090 2024-09-21T09:04:21.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.705+0000 7f9b517fa640 1 -- 172.21.15.178:0/3870880142 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c680197f0 con 0x56551091c090 2024-09-21T09:04:21.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.706+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3870880142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551091c090 msgr2=0x56551091c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.706+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3870880142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551091c090 0x56551091c490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9c6804cf20 tx=0x7f9c68017fa0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.706+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3870880142 shutdown_connections 2024-09-21T09:04:21.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.706+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3870880142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551091c090 0x56551091c490 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.706+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3870880142 >> 172.21.15.178:0/3870880142 conn(0x5655109183f0 msgr2=0x5655109164f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:21.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.706+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3870880142 shutdown_connections 2024-09-21T09:04:21.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.706+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3870880142 wait complete. 2024-09-21T09:04:21.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.706+0000 7f9c6ff19800 1 Processor -- start 2024-09-21T09:04:21.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.706+0000 7f9c6ff19800 1 -- start start 2024-09-21T09:04:21.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.706+0000 7f9c6ff19800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551091c090 0x565510923320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.706+0000 7f9c6ff19800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56551091ce60 con 0x56551091c090 2024-09-21T09:04:21.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.706+0000 7f9c6e20e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551091c090 0x565510923320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.706+0000 7f9c6e20e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551091c090 0x565510923320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33758/0 (socket says 172.21.15.178:33758) 2024-09-21T09:04:21.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.706+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 learned_addr learned my addr 172.21.15.178:0/3928656822 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.707+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565510923860 con 0x56551091c090 2024-09-21T09:04:21.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.707+0000 7f9c6e20e640 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551091c090 0x565510923320 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9c68048010 tx=0x7f9c6804ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.707+0000 7f9b3f7fe640 1 -- 172.21.15.178:0/3928656822 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c6803b070 con 0x56551091c090 2024-09-21T09:04:21.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.707+0000 7f9b3f7fe640 1 -- 172.21.15.178:0/3928656822 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c68019b70 con 0x56551091c090 2024-09-21T09:04:21.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.707+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565510923af0 con 0x56551091c090 2024-09-21T09:04:21.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.707+0000 7f9b3f7fe640 1 -- 172.21.15.178:0/3928656822 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c680179a0 con 0x56551091c090 2024-09-21T09:04:21.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.707+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5655109267a0 con 0x56551091c090 2024-09-21T09:04:21.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.708+0000 7f9b3f7fe640 1 -- 172.21.15.178:0/3928656822 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9c680153e0 con 0x56551091c090 2024-09-21T09:04:21.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.708+0000 7f9b3f7fe640 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b38036af0 0x7f9b38038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.708+0000 7f9b3f7fe640 1 -- 172.21.15.178:0/3928656822 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f9c68037ba0 con 0x56551091c090 2024-09-21T09:04:21.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.708+0000 7f9c6da0d640 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b38036af0 0x7f9b38038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.709+0000 7f9c6da0d640 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b38036af0 0x7f9b38038fb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9c60011b70 tx=0x7f9c60031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.709+0000 7f9c6ff19800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.709+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56551092eea0 0x565510931360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.709+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565510931ab0 con 0x56551092eea0 2024-09-21T09:04:21.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.709+0000 7f9c6d20c640 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56551092eea0 0x565510931360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.709+0000 7f9c6d20c640 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56551092eea0 0x565510931360 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.710+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.710+0000 7f9c6ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.710+0000 7f9c6ff19800 20 realm 2024-09-21T09:04:21.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.710+0000 7f9c6ff19800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.710+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565510931ee0 con 0x56551092eea0 2024-09-21T09:04:21.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.710+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.710+0000 7f9c6ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.710+0000 7f9c6ff19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:04:21.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.710+0000 7f9c6ff19800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.710+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5655109327b0 con 0x56551092eea0 2024-09-21T09:04:21.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.710+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.710+0000 7f9c6ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.710+0000 7f9c6ff19800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.710+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565510932b50 con 0x56551092eea0 2024-09-21T09:04:21.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.711+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.711+0000 7f9c6ff19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:21.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.711+0000 7f9c6ff19800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.711+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5655109338b0 0x565510935ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.711+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5655109362b0 con 0x5655109338b0 2024-09-21T09:04:21.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.711+0000 7f9c6e20e640 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5655109338b0 0x565510935ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.711+0000 7f9c6e20e640 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5655109338b0 0x565510935ca0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.712+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.712+0000 7f9c6ff19800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:04:21.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.712+0000 7f9c6ff19800 20 searching for the correct realm 2024-09-21T09:04:21.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.712+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x565510938240 0x56551093a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.712+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x565510938240 2024-09-21T09:04:21.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.712+0000 7f9c6da0d640 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x565510938240 0x56551093a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.712+0000 7f9c6da0d640 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x565510938240 0x56551093a700 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.712+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.712+0000 7f9c6da0d640 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9c60025070 0x7f9c60043140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.712+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x7f9c60025070 2024-09-21T09:04:21.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.713+0000 7f9c6d20c640 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9c60025070 0x7f9c60043140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.713+0000 7f9c6d20c640 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9c60025070 0x7f9c60043140 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.713+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64051070 con 0x7f9c60025070 2024-09-21T09:04:21.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.713+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x5655109338b0 2024-09-21T09:04:21.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.714+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.714+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x56551092eea0 2024-09-21T09:04:21.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.714+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.714+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x56551092eea0 2024-09-21T09:04:21.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.714+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.714+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x5655109338b0 2024-09-21T09:04:21.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.714+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.715+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x5655109338b0 2024-09-21T09:04:21.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.715+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.715+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x7f9c60025070 2024-09-21T09:04:21.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.715+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64051070 con 0x7f9c60025070 2024-09-21T09:04:21.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.715+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x565510938240 2024-09-21T09:04:21.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.715+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.715+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x56551092eea0 2024-09-21T09:04:21.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.716+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.716+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x5655109338b0 2024-09-21T09:04:21.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.716+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.716+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x56551092eea0 2024-09-21T09:04:21.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.716+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.716+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x7f9c60025070 2024-09-21T09:04:21.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.716+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9c64051070 con 0x7f9c60025070 2024-09-21T09:04:21.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.716+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x565510938240 2024-09-21T09:04:21.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.717+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.717+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x565510938240 2024-09-21T09:04:21.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.717+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.717+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x5655109338b0 2024-09-21T09:04:21.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.717+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.717+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x565510938240 2024-09-21T09:04:21.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.717+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.717+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x565510938240 2024-09-21T09:04:21.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.718+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.718+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x56551092eea0 2024-09-21T09:04:21.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.718+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.718+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x56551092eea0 2024-09-21T09:04:21.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.718+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.718+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x5655109338b0 2024-09-21T09:04:21.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.718+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.719+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x565510938240 2024-09-21T09:04:21.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.719+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.719+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x7f9c60025070 2024-09-21T09:04:21.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.719+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64051070 con 0x7f9c60025070 2024-09-21T09:04:21.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.719+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x56551092eea0 2024-09-21T09:04:21.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.719+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.719+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x5655109338b0 2024-09-21T09:04:21.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.720+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.720+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x565510938240 2024-09-21T09:04:21.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.720+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.720+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x7f9c60025070 2024-09-21T09:04:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.720+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64051070 con 0x7f9c60025070 2024-09-21T09:04:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.720+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x7f9c60025070 2024-09-21T09:04:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.720+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64051070 con 0x7f9c60025070 2024-09-21T09:04:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.720+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x565510938240 2024-09-21T09:04:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x5655109338b0 2024-09-21T09:04:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x56551092eea0 2024-09-21T09:04:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56551093add0 con 0x7f9c60025070 2024-09-21T09:04:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c64051070 con 0x7f9c60025070 2024-09-21T09:04:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6ff19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:04:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6ff19800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:04:21.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6ff19800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:04:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6ff19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:04:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6ff19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:04:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6ff19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:04:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6ff19800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.721+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565510937790 con 0x56551092eea0 2024-09-21T09:04:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565510936740 con 0x56551092eea0 2024-09-21T09:04:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565510937100 con 0x56551092eea0 2024-09-21T09:04:21.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:04:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 20 zone default found 2024-09-21T09:04:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 4 Realm: () 2024-09-21T09:04:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:04:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:04:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:04:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 20 zonegroup default 2024-09-21T09:04:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.722+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56551093b700 con 0x5655109338b0 2024-09-21T09:04:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.723+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.723+0000 7f9c6ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.723+0000 7f9c6ff19800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.723+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56551093d980 con 0x565510938240 2024-09-21T09:04:21.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.723+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.723+0000 7f9c6ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.723+0000 7f9c6ff19800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.723+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56551093dd20 con 0x565510938240 2024-09-21T09:04:21.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.723+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.723+0000 7f9c6ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.723+0000 7f9c6ff19800 20 started sync module instance, tier type = 2024-09-21T09:04:21.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.723+0000 7f9c6ff19800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:04:21.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.723+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56551093cdc0 con 0x7f9c60025070 2024-09-21T09:04:21.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.724+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x7f9c60025070 2024-09-21T09:04:21.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.724+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94923350332144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56551093cdc0 con 0x7f9c60025070 2024-09-21T09:04:21.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.724+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56551093e6e0 con 0x56551092eea0 2024-09-21T09:04:21.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.725+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94923350332144] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x7f9c60025070 2024-09-21T09:04:21.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.726+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.726+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94923350336528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56551093cdc0 con 0x56551092eea0 2024-09-21T09:04:21.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.726+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56551093f160 con 0x565510938240 2024-09-21T09:04:21.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.727+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94923350336528] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.727+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.727+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94923350329616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56551093cd30 con 0x565510938240 2024-09-21T09:04:21.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.727+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510940020 con 0x7f9c60025070 2024-09-21T09:04:21.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.728+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x7f9c60025070 2024-09-21T09:04:21.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.728+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94923350342992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510940760 con 0x7f9c60025070 2024-09-21T09:04:21.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.728+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510941280 con 0x56551092eea0 2024-09-21T09:04:21.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.728+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94923350329616] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.729+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94923350342992] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x7f9c60025070 2024-09-21T09:04:21.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.730+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.730+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94923350347088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510941240 con 0x56551092eea0 2024-09-21T09:04:21.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.730+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510941b20 con 0x5655109338b0 2024-09-21T09:04:21.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.731+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.731+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94923350349424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510941f40 con 0x5655109338b0 2024-09-21T09:04:21.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.731+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510942790 con 0x5655109338b0 2024-09-21T09:04:21.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.731+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94923350347088] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.732+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94923350349424] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.732+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.732+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94923350350480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510942360 con 0x5655109338b0 2024-09-21T09:04:21.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.732+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510942bb0 con 0x5655109338b0 2024-09-21T09:04:21.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.733+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94923350350480] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.733+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.733+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94923350352016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510942a60 con 0x5655109338b0 2024-09-21T09:04:21.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.733+0000 7f9c6ff19800 20 add_watcher() i=0 2024-09-21T09:04:21.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.733+0000 7f9c6ff19800 20 add_watcher() i=1 2024-09-21T09:04:21.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.733+0000 7f9c6ff19800 20 add_watcher() i=2 2024-09-21T09:04:21.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.733+0000 7f9c6ff19800 20 add_watcher() i=3 2024-09-21T09:04:21.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.733+0000 7f9c6ff19800 20 add_watcher() i=4 2024-09-21T09:04:21.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.733+0000 7f9c6ff19800 20 add_watcher() i=5 2024-09-21T09:04:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.733+0000 7f9c6ff19800 20 add_watcher() i=6 2024-09-21T09:04:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.735+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94923350352016] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.735+0000 7f9c6ff19800 20 add_watcher() i=7 2024-09-21T09:04:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.735+0000 7f9c6ff19800 2 all 8 watchers are set, enabling cache 2024-09-21T09:04:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.735+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565510945fd0 con 0x56551092eea0 2024-09-21T09:04:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.735+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.735+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94923350353136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510943520 con 0x56551092eea0 2024-09-21T09:04:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.736+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94923350353136] v31'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.736+0000 7f9b1f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.736+0000 7f9c6ff19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:04:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.736+0000 7f9c6ff19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:04:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.736+0000 7f9c6ff19800 5 note: GC not initialized 2024-09-21T09:04:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.737+0000 7f9b1e7fc640 20 reqs_thread_entry: start 2024-09-21T09:04:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.737+0000 7f9c6ff19800 20 init_complete bucket index max shards: 11 2024-09-21T09:04:21.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.737+0000 7f9c6ff19800 20 Filter name: none 2024-09-21T09:04:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.737+0000 7f9a8ffff640 20 reqs_thread_entry: start 2024-09-21T09:04:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.737+0000 7f9c6ff19800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T09:04:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.737+0000 7f9c6ff19800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.737+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565510979470 con 0x5655109338b0 2024-09-21T09:04:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.738+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.738+0000 7f9c6ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.738+0000 7f9c6ff19800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-21T09:04:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.738+0000 7f9c6ff19800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T09:04:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.738+0000 7f9c6ff19800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-21T09:04:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.738+0000 7f9c6ff19800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.738+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565510977ab0 con 0x5655109338b0 2024-09-21T09:04:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.738+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.738+0000 7f9c6ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.738+0000 7f9c6ff19800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-21T09:04:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.738+0000 7f9c6ff19800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T09:04:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.738+0000 7f9c6ff19800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-21T09:04:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.738+0000 7f9c6ff19800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-21T09:04:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.738+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510978380 con 0x5655109338b0 2024-09-21T09:04:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.739+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v31'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.739+0000 7f9c6ff19800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-21T09:04:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.739+0000 7f9c6ff19800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T09:04:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.739+0000 7f9c6ff19800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-21T09:04:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.739+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94923350572752 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56551097ca60 con 0x5655109338b0 2024-09-21T09:04:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.739+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== watch-notify(notify (1) cookie 94923350349424 notify 133143986211 ret 0) ==== 598+0+0 (crc 0 0 0) 0x565510978ec0 con 0x5655109338b0 2024-09-21T09:04:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.739+0000 7f9b517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986211 cookie 94923350349424 notifier 4742 bl.length()=556 2024-09-21T09:04:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.739+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(65 notify.5 [notify cookie 94923350572752 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.739+0000 7f9b517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.739+0000 7f9b517fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.739+0000 7f9b517fa640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9b30003ea0 con 0x5655109338b0 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.740+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.740+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== watch-notify(notify_complete (2) cookie 94923350572752 notify 133143986211 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565510923860 con 0x5655109338b0 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.740+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510978330 con 0x5655109338b0 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.741+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.741+0000 7f9c6ff19800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.741+0000 7f9c6ff19800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.741+0000 7f9c6ff19800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.741+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94923350572672 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56551097cef0 con 0x565510938240 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.741+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== watch-notify(notify (1) cookie 94923350329616 notify 133143986182 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5655108ed4b0 con 0x565510938240 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.741+0000 7f9b517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 94923350329616 notifier 4742 bl.length()=177 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.741+0000 7f9b517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.741+0000 7f9b517fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T09:04:21.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.741+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(68 notify.2 [notify cookie 94923350572672 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.741+0000 7f9b517fa640 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9b30003ea0 con 0x565510938240 2024-09-21T09:04:21.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.742+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.742+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== watch-notify(notify_complete (2) cookie 94923350572672 notify 133143986182 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5655108ecf30 con 0x565510938240 2024-09-21T09:04:21.748 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-21T09:04:21.739243Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:04:21.739230Z","tags":[],"group_ids":[]} 2024-09-21T09:04:21.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.743+0000 7f9b1f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:21.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.743+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94923350353136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510977130 con 0x56551092eea0 2024-09-21T09:04:21.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.744+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94923350353136] v31'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.744+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94923350332144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510977130 con 0x7f9c60025070 2024-09-21T09:04:21.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.745+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94923350332144] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x7f9c60025070 2024-09-21T09:04:21.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.745+0000 7f9c6ff19800 20 remove_watcher() i=0 2024-09-21T09:04:21.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.745+0000 7f9c6ff19800 2 removed watcher, disabling cache 2024-09-21T09:04:21.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.745+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94923350336528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510977130 con 0x56551092eea0 2024-09-21T09:04:21.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.746+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94923350336528] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.746+0000 7f9c6ff19800 20 remove_watcher() i=1 2024-09-21T09:04:21.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.746+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94923350329616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510977130 con 0x565510938240 2024-09-21T09:04:21.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.747+0000 7f9c6da0d640 1 -- 172.21.15.178:0/3928656822 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94923350329616] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6002c070 con 0x565510938240 2024-09-21T09:04:21.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.747+0000 7f9c6ff19800 20 remove_watcher() i=2 2024-09-21T09:04:21.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.747+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94923350342992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510977130 con 0x7f9c60025070 2024-09-21T09:04:21.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.748+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94923350342992] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x7f9c60025070 2024-09-21T09:04:21.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.748+0000 7f9c6ff19800 20 remove_watcher() i=3 2024-09-21T09:04:21.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.748+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94923350347088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510977130 con 0x56551092eea0 2024-09-21T09:04:21.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.749+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94923350347088] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c64051070 con 0x56551092eea0 2024-09-21T09:04:21.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.749+0000 7f9c6ff19800 20 remove_watcher() i=4 2024-09-21T09:04:21.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.750+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94923350349424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510977130 con 0x5655109338b0 2024-09-21T09:04:21.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.751+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94923350349424] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.751+0000 7f9c6ff19800 20 remove_watcher() i=5 2024-09-21T09:04:21.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.751+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94923350350480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510977130 con 0x5655109338b0 2024-09-21T09:04:21.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.752+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94923350350480] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.752+0000 7f9c6ff19800 20 remove_watcher() i=6 2024-09-21T09:04:21.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.752+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94923350352016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565510941b00 con 0x5655109338b0 2024-09-21T09:04:21.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6e20e640 1 -- 172.21.15.178:0/3928656822 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94923350352016] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c6802a070 con 0x5655109338b0 2024-09-21T09:04:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 20 remove_watcher() i=7 2024-09-21T09:04:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5655109338b0 msgr2=0x565510935ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5655109338b0 0x565510935ca0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56551092eea0 msgr2=0x565510931360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56551092eea0 0x565510931360 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9c60025070 msgr2=0x7f9c60043140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9c60025070 0x7f9c60043140 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x565510938240 msgr2=0x56551093a700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x565510938240 0x56551093a700 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b38036af0 msgr2=0x7f9b38038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b38036af0 0x7f9b38038fb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9c60011b70 tx=0x7f9c60031000 comp rx=0 tx=0).stop 2024-09-21T09:04:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551091c090 msgr2=0x565510923320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3928656822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551091c090 0x565510923320 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9c68048010 tx=0x7f9c6804ce80 comp rx=0 tx=0).stop 2024-09-21T09:04:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 reap_dead start 2024-09-21T09:04:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6d20c640 1 -- 172.21.15.178:0/3928656822 reap_dead start 2024-09-21T09:04:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 shutdown_connections 2024-09-21T09:04:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 >> 172.21.15.178:0/3928656822 conn(0x5655109183f0 msgr2=0x5655109164c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 shutdown_connections 2024-09-21T09:04:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.753+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3928656822 wait complete. 2024-09-21T09:04:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3168473769 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b48036b40 msgr2=0x7f9b48039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3168473769 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b48036b40 0x7f9b48039000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x5655108ed9b0 tx=0x7f9c6004a280 comp rx=0 tx=0).stop 2024-09-21T09:04:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3168473769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551090f440 msgr2=0x56551090f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3168473769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551090f440 0x56551090f860 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x5655108ee230 tx=0x7f9c6800aec0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3168473769 shutdown_connections 2024-09-21T09:04:21.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3168473769 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b48036b40 0x7f9b48039000 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/3168473769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56551090f440 0x56551090f860 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3168473769 >> 172.21.15.178:0/3168473769 conn(0x5655109043d0 msgr2=0x565510906f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3168473769 shutdown_connections 2024-09-21T09:04:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 -- 172.21.15.178:0/3168473769 wait complete. 2024-09-21T09:04:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5655108fdee0 msgr2=0x5655109002f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5655108fdee0 0x5655109002f0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5655107fe940 msgr2=0x5655108fb720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5655107fe940 0x5655108fb720 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b54036b90 msgr2=0x7f9b54039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b54036b90 0x7f9b54039050 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c64057000 tx=0x7f9c64052000 comp rx=0 tx=0).stop 2024-09-21T09:04:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fa500 msgr2=0x5655108ee840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fa500 0x5655108ee840 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9c60014040 tx=0x7f9c60001250 comp rx=0 tx=0).stop 2024-09-21T09:04:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 shutdown_connections 2024-09-21T09:04:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5655108fdee0 0x5655109002f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5655107fe940 0x5655108fb720 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9b54036b90 0x7f9b54039050 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 --2- 172.21.15.178:0/891905590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5655107fa500 0x5655108ee840 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 >> 172.21.15.178:0/891905590 conn(0x5655107f5e30 msgr2=0x5655108e3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 shutdown_connections 2024-09-21T09:04:21.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.754+0000 7f9c6ff19800 1 -- 172.21.15.178:0/891905590 wait complete. 2024-09-21T09:04:21.765 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-21T09:04:21.739243Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:04:21.739230Z', 'tags': [], 'group_ids': []} 2024-09-21T09:04:21.779 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:04:21.783 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-21T09:04:21.783 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-21T09:04:21.783 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-21T09:04:21.784 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-21T09:04:21.829 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:04:21.829 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:04:21.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.828+0000 7fb08360f800 1 Processor -- start 2024-09-21T09:04:21.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.829+0000 7fb08360f800 1 -- start start 2024-09-21T09:04:21.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.829+0000 7fb08360f800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55615031ab00 0x55615031cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.829+0000 7fb08360f800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5561501dab30 con 0x55615031d4f0 2024-09-21T09:04:21.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.829+0000 7fb08360f800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5561501bc360 con 0x55615031ab00 2024-09-21T09:04:21.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.829+0000 7fb07ece7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55615031ab00 0x55615031cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.829+0000 7fb07ece7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55615031ab00 0x55615031cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33768/0 (socket says 172.21.15.178:33768) 2024-09-21T09:04:21.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.829+0000 7fb07e4e6640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55615031d4f0 0x55615031f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:32814/0 (socket says 172.21.15.178:32814) 2024-09-21T09:04:21.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.829+0000 7fb07ece7640 1 -- 172.21.15.178:0/1623867869 learned_addr learned my addr 172.21.15.178:0/1623867869 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.829+0000 7fb07ece7640 1 -- 172.21.15.178:0/1623867869 >> v1:172.21.15.44:6789/0 conn(0x55615031d4f0 legacy=0x55615031f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.829+0000 7fb07ece7640 1 -- 172.21.15.178:0/1623867869 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561501e2e00 con 0x55615031ab00 2024-09-21T09:04:21.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.831+0000 7fb07ece7640 1 --2- 172.21.15.178:0/1623867869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x55615031cef0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb078005fd0 tx=0x7fb078045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f67a4e47d848e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.831+0000 7fb07dce5640 1 -- 172.21.15.178:0/1623867869 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb07804e600 con 0x55615031ab00 2024-09-21T09:04:21.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.831+0000 7fb07dce5640 1 -- 172.21.15.178:0/1623867869 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb07804e7a0 con 0x55615031ab00 2024-09-21T09:04:21.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.831+0000 7fb07dce5640 1 -- 172.21.15.178:0/1623867869 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb07804eaa0 con 0x55615031ab00 2024-09-21T09:04:21.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.832+0000 7fb08360f800 1 -- 172.21.15.178:0/1623867869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 msgr2=0x55615031cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.832+0000 7fb08360f800 1 --2- 172.21.15.178:0/1623867869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x55615031cef0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb078005fd0 tx=0x7fb078045cf0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.832+0000 7fb08360f800 1 -- 172.21.15.178:0/1623867869 shutdown_connections 2024-09-21T09:04:21.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.832+0000 7fb08360f800 1 --2- 172.21.15.178:0/1623867869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x55615031cef0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.832+0000 7fb08360f800 1 -- 172.21.15.178:0/1623867869 >> 172.21.15.178:0/1623867869 conn(0x556150315550 msgr2=0x556150317970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:21.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.832+0000 7fb08360f800 1 -- 172.21.15.178:0/1623867869 shutdown_connections 2024-09-21T09:04:21.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.832+0000 7fb08360f800 1 -- 172.21.15.178:0/1623867869 wait complete. 2024-09-21T09:04:21.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.845+0000 7fb08360f800 1 Processor -- start 2024-09-21T09:04:21.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.845+0000 7fb08360f800 1 -- start start 2024-09-21T09:04:21.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.846+0000 7fb08360f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x55615031a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.846+0000 7fb08360f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556150267360 con 0x55615031ab00 2024-09-21T09:04:21.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.846+0000 7fb07ece7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x55615031a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.846+0000 7fb07ece7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x55615031a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33784/0 (socket says 172.21.15.178:33784) 2024-09-21T09:04:21.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.846+0000 7fb07ece7640 1 -- 172.21.15.178:0/3965750251 learned_addr learned my addr 172.21.15.178:0/3965750251 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.846+0000 7fb07ece7640 1 -- 172.21.15.178:0/3965750251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561501b4bc0 con 0x55615031ab00 2024-09-21T09:04:21.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.846+0000 7fb07ece7640 1 --2- 172.21.15.178:0/3965750251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x55615031a320 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb07800a4b0 tx=0x7fb078050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f68363b07e091fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.847+0000 7faf6ce09640 1 -- 172.21.15.178:0/3965750251 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb07804ea80 con 0x55615031ab00 2024-09-21T09:04:21.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.847+0000 7faf6ce09640 1 -- 172.21.15.178:0/3965750251 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb078066070 con 0x55615031ab00 2024-09-21T09:04:21.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.847+0000 7faf6ce09640 1 -- 172.21.15.178:0/3965750251 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb07804edc0 con 0x55615031ab00 2024-09-21T09:04:21.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.847+0000 7fb08360f800 1 -- 172.21.15.178:0/3965750251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 msgr2=0x55615031a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.847+0000 7fb08360f800 1 --2- 172.21.15.178:0/3965750251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x55615031a320 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb07800a4b0 tx=0x7fb078050000 comp rx=0 tx=0).stop 2024-09-21T09:04:21.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.847+0000 7fb08360f800 1 -- 172.21.15.178:0/3965750251 shutdown_connections 2024-09-21T09:04:21.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.847+0000 7fb08360f800 1 --2- 172.21.15.178:0/3965750251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x55615031a320 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.847+0000 7fb08360f800 1 -- 172.21.15.178:0/3965750251 >> 172.21.15.178:0/3965750251 conn(0x556150315550 msgr2=0x556150405180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:21.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.847+0000 7fb08360f800 1 -- 172.21.15.178:0/3965750251 shutdown_connections 2024-09-21T09:04:21.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.847+0000 7fb08360f800 1 -- 172.21.15.178:0/3965750251 wait complete. 2024-09-21T09:04:21.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.848+0000 7fb08360f800 1 Processor -- start 2024-09-21T09:04:21.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.848+0000 7fb08360f800 1 -- start start 2024-09-21T09:04:21.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.848+0000 7fb08360f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x556150412110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.848+0000 7fb08360f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556150321510 con 0x55615031ab00 2024-09-21T09:04:21.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.848+0000 7fb07ece7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x556150412110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.848+0000 7fb07ece7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x556150412110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33800/0 (socket says 172.21.15.178:33800) 2024-09-21T09:04:21.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.848+0000 7fb07ece7640 1 -- 172.21.15.178:0/4000013945 learned_addr learned my addr 172.21.15.178:0/4000013945 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.848+0000 7fb07ece7640 1 -- 172.21.15.178:0/4000013945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561501c8fe0 con 0x55615031ab00 2024-09-21T09:04:21.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.849+0000 7fb07ece7640 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x556150412110 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb07800a4b0 tx=0x7fb078003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.849+0000 7faf6b606640 1 -- 172.21.15.178:0/4000013945 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb078076470 con 0x55615031ab00 2024-09-21T09:04:21.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.849+0000 7faf6b606640 1 -- 172.21.15.178:0/4000013945 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb078071070 con 0x55615031ab00 2024-09-21T09:04:21.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.849+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556150412650 con 0x55615031ab00 2024-09-21T09:04:21.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.849+0000 7faf6b606640 1 -- 172.21.15.178:0/4000013945 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb078076740 con 0x55615031ab00 2024-09-21T09:04:21.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.849+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556150412b70 con 0x55615031ab00 2024-09-21T09:04:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.850+0000 7faf6b606640 1 -- 172.21.15.178:0/4000013945 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb07806d420 con 0x55615031ab00 2024-09-21T09:04:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.850+0000 7faf6b606640 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf64036b40 0x7faf64039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.850+0000 7faf6b606640 1 -- 172.21.15.178:0/4000013945 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fb078091530 con 0x55615031ab00 2024-09-21T09:04:21.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.850+0000 7fb07e4e6640 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf64036b40 0x7faf64039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.850+0000 7fb08360f800 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55615031d4f0 0x556150419180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.850+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556150419700 con 0x55615031d4f0 2024-09-21T09:04:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.850+0000 7fb07f4e8640 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55615031d4f0 0x556150419180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.850+0000 7fb07e4e6640 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf64036b40 0x7faf64039000 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb068000f60 tx=0x7fb068001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.850+0000 7fb07f4e8640 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55615031d4f0 0x556150419180 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.851+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4000013945 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0700083e0 con 0x55615031d4f0 2024-09-21T09:04:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.851+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556150416730 con 0x55615031d4f0 2024-09-21T09:04:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.851+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4000013945 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0700083e0 con 0x55615031d4f0 2024-09-21T09:04:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.851+0000 7fb08360f800 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55615041ba30 0x55615041de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.851+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55615041e510 con 0x55615041ba30 2024-09-21T09:04:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.851+0000 7fb07ece7640 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55615041ba30 0x55615041de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.852+0000 7fb07ece7640 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55615041ba30 0x55615041de20 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.852+0000 7fb07ece7640 1 -- 172.21.15.178:0/4000013945 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb078056b20 con 0x55615041ba30 2024-09-21T09:04:21.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.852+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55615041a8d0 con 0x55615031d4f0 2024-09-21T09:04:21.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.853+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4000013945 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0700083e0 con 0x55615031d4f0 2024-09-21T09:04:21.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.853+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55615041ad70 con 0x55615031d4f0 2024-09-21T09:04:21.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.853+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4000013945 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb0700083e0 con 0x55615031d4f0 2024-09-21T09:04:21.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.853+0000 7fb08360f800 1 Processor -- start 2024-09-21T09:04:21.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.853+0000 7fb08360f800 1 -- start start 2024-09-21T09:04:21.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.853+0000 7fb08360f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615042cee0 0x55615042d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.853+0000 7fb08360f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5561501b6580 con 0x55615042cee0 2024-09-21T09:04:21.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.854+0000 7fb07f4e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615042cee0 0x55615042d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.854+0000 7fb07f4e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615042cee0 0x55615042d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33810/0 (socket says 172.21.15.178:33810) 2024-09-21T09:04:21.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.854+0000 7fb07f4e8640 1 -- 172.21.15.178:0/2453293393 learned_addr learned my addr 172.21.15.178:0/2453293393 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.854+0000 7fb07f4e8640 1 -- 172.21.15.178:0/2453293393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55615042d840 con 0x55615042cee0 2024-09-21T09:04:21.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.854+0000 7fb07f4e8640 1 --2- 172.21.15.178:0/2453293393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615042cee0 0x55615042d300 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x556150413330 tx=0x7fb07000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.854+0000 7faf68e01640 1 -- 172.21.15.178:0/2453293393 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb070007d00 con 0x55615042cee0 2024-09-21T09:04:21.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.854+0000 7faf68e01640 1 -- 172.21.15.178:0/2453293393 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb07001e020 con 0x55615042cee0 2024-09-21T09:04:21.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.854+0000 7faf68e01640 1 -- 172.21.15.178:0/2453293393 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb070019420 con 0x55615042cee0 2024-09-21T09:04:21.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.854+0000 7fb08360f800 1 -- 172.21.15.178:0/2453293393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55615042dad0 con 0x55615042cee0 2024-09-21T09:04:21.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.854+0000 7fb08360f800 1 -- 172.21.15.178:0/2453293393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561504307b0 con 0x55615042cee0 2024-09-21T09:04:21.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.855+0000 7faf68e01640 1 -- 172.21.15.178:0/2453293393 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb070016040 con 0x55615042cee0 2024-09-21T09:04:21.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.856+0000 7faf68e01640 1 --2- 172.21.15.178:0/2453293393 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf58036b40 0x7faf58039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.856+0000 7faf68e01640 1 -- 172.21.15.178:0/2453293393 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fb07001f030 con 0x55615042cee0 2024-09-21T09:04:21.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.856+0000 7fb07ece7640 1 --2- 172.21.15.178:0/2453293393 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf58036b40 0x7faf58039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.856+0000 7fb08360f800 1 Processor -- start 2024-09-21T09:04:21.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.856+0000 7fb08360f800 1 -- start start 2024-09-21T09:04:21.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.856+0000 7fb07ece7640 1 --2- 172.21.15.178:0/2453293393 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf58036b40 0x7faf58039000 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x556150419ba0 tx=0x7fb07807f910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.856+0000 7fb08360f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556150439b30 0x556150439f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.856+0000 7fb08360f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55615040d6e0 con 0x556150439b30 2024-09-21T09:04:21.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.856+0000 7fb07f4e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556150439b30 0x556150439f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.856+0000 7fb07f4e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556150439b30 0x556150439f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33824/0 (socket says 172.21.15.178:33824) 2024-09-21T09:04:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.856+0000 7fb07f4e8640 1 -- 172.21.15.178:0/216161522 learned_addr learned my addr 172.21.15.178:0/216161522 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.857+0000 7fb07f4e8640 1 -- 172.21.15.178:0/216161522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55615043a500 con 0x556150439b30 2024-09-21T09:04:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.857+0000 7fb07f4e8640 1 --2- 172.21.15.178:0/216161522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556150439b30 0x556150439f30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb07004cf20 tx=0x7fb070017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fedb8065ffa3dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.857+0000 7faf627fc640 1 -- 172.21.15.178:0/216161522 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb07001d030 con 0x556150439b30 2024-09-21T09:04:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.857+0000 7faf627fc640 1 -- 172.21.15.178:0/216161522 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb070015d00 con 0x556150439b30 2024-09-21T09:04:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.857+0000 7faf627fc640 1 -- 172.21.15.178:0/216161522 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0700197f0 con 0x556150439b30 2024-09-21T09:04:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.858+0000 7fb08360f800 1 -- 172.21.15.178:0/216161522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556150439b30 msgr2=0x556150439f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.858+0000 7fb08360f800 1 --2- 172.21.15.178:0/216161522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556150439b30 0x556150439f30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb07004cf20 tx=0x7fb070017fa0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.858+0000 7fb08360f800 1 -- 172.21.15.178:0/216161522 shutdown_connections 2024-09-21T09:04:21.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.858+0000 7fb08360f800 1 --2- 172.21.15.178:0/216161522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556150439b30 0x556150439f30 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.858+0000 7fb08360f800 1 -- 172.21.15.178:0/216161522 >> 172.21.15.178:0/216161522 conn(0x556150435e90 msgr2=0x556150433f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.858+0000 7fb08360f800 1 -- 172.21.15.178:0/216161522 shutdown_connections 2024-09-21T09:04:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.858+0000 7fb08360f800 1 -- 172.21.15.178:0/216161522 wait complete. 2024-09-21T09:04:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.858+0000 7fb08360f800 1 Processor -- start 2024-09-21T09:04:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.858+0000 7fb08360f800 1 -- start start 2024-09-21T09:04:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.858+0000 7fb08360f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556150439b30 0x556150440f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.858+0000 7fb08360f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55615043aa80 con 0x556150439b30 2024-09-21T09:04:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.858+0000 7fb07f4e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556150439b30 0x556150440f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.858+0000 7fb07f4e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556150439b30 0x556150440f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33828/0 (socket says 172.21.15.178:33828) 2024-09-21T09:04:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.858+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 learned_addr learned my addr 172.21.15.178:0/4221454900 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.859+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561504414c0 con 0x556150439b30 2024-09-21T09:04:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.859+0000 7fb07f4e8640 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556150439b30 0x556150440f80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb070043040 tx=0x7fb07004ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.859+0000 7faf60ff9640 1 -- 172.21.15.178:0/4221454900 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb07003b070 con 0x556150439b30 2024-09-21T09:04:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.859+0000 7faf60ff9640 1 -- 172.21.15.178:0/4221454900 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb070019b70 con 0x556150439b30 2024-09-21T09:04:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.859+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556150441750 con 0x556150439b30 2024-09-21T09:04:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.859+0000 7faf60ff9640 1 -- 172.21.15.178:0/4221454900 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0700153e0 con 0x556150439b30 2024-09-21T09:04:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.859+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556150444400 con 0x556150439b30 2024-09-21T09:04:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.860+0000 7faf60ff9640 1 -- 172.21.15.178:0/4221454900 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb07004e070 con 0x556150439b30 2024-09-21T09:04:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.860+0000 7faf60ff9640 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf48036b40 0x7faf48039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.860+0000 7faf60ff9640 1 -- 172.21.15.178:0/4221454900 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fb070037bc0 con 0x556150439b30 2024-09-21T09:04:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.860+0000 7fb07ece7640 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf48036b40 0x7faf48039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.860+0000 7fb07ece7640 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf48036b40 0x7faf48039000 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb07804ec10 tx=0x7fb078092000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb08360f800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb08360f800 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55615044ca10 0x55615044eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55615044f620 con 0x55615044ca10 2024-09-21T09:04:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb07e4e6640 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55615044ca10 0x55615044eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb07e4e6640 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55615044ca10 0x55615044eed0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb06800f610 con 0x55615044ca10 2024-09-21T09:04:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb08360f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb08360f800 20 realm 2024-09-21T09:04:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb08360f800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55615044be60 con 0x55615044ca10 2024-09-21T09:04:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb06800f610 con 0x55615044ca10 2024-09-21T09:04:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb08360f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb08360f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:04:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb08360f800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.861+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556150450110 con 0x55615044ca10 2024-09-21T09:04:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.862+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb06800f610 con 0x55615044ca10 2024-09-21T09:04:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.862+0000 7fb08360f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.862+0000 7fb08360f800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.862+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561504509e0 con 0x55615044ca10 2024-09-21T09:04:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.862+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb06800f610 con 0x55615044ca10 2024-09-21T09:04:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.862+0000 7fb08360f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.862+0000 7fb08360f800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.862+0000 7fb08360f800 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556150451400 0x5561504537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.862+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556150453ee0 con 0x556150451400 2024-09-21T09:04:21.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.862+0000 7fb07f4e8640 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556150451400 0x5561504537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.863+0000 7fb07f4e8640 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556150451400 0x5561504537f0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.863+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.863+0000 7fb08360f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:04:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.863+0000 7fb08360f800 20 searching for the correct realm 2024-09-21T09:04:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.863+0000 7fb08360f800 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556150455eb0 0x556150458370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.863+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150455eb0 2024-09-21T09:04:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.863+0000 7fb07ece7640 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556150455eb0 0x556150458370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.863+0000 7fb07ece7640 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556150455eb0 0x556150458370 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.864+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb078056b20 con 0x556150455eb0 2024-09-21T09:04:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.864+0000 7fb07ece7640 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb07806d040 0x7fb0780778f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.864+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x7fb07806d040 2024-09-21T09:04:21.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.864+0000 7fb07e4e6640 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb07806d040 0x7fb0780778f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.864+0000 7fb07e4e6640 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb07806d040 0x7fb0780778f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.864+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06800f610 con 0x7fb07806d040 2024-09-21T09:04:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.864+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150451400 2024-09-21T09:04:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.865+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.865+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x55615044ca10 2024-09-21T09:04:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.865+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06800f610 con 0x55615044ca10 2024-09-21T09:04:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.865+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x55615044ca10 2024-09-21T09:04:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.865+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06802b040 con 0x55615044ca10 2024-09-21T09:04:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.865+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150451400 2024-09-21T09:04:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.866+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.866+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150451400 2024-09-21T09:04:21.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.866+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.866+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x7fb07806d040 2024-09-21T09:04:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.866+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06802b040 con 0x7fb07806d040 2024-09-21T09:04:21.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.866+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150455eb0 2024-09-21T09:04:21.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.866+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb078056b20 con 0x556150455eb0 2024-09-21T09:04:21.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.866+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x55615044ca10 2024-09-21T09:04:21.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.867+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06802b040 con 0x55615044ca10 2024-09-21T09:04:21.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.867+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150451400 2024-09-21T09:04:21.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.867+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.867+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x55615044ca10 2024-09-21T09:04:21.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.867+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06802b040 con 0x55615044ca10 2024-09-21T09:04:21.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.867+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x7fb07806d040 2024-09-21T09:04:21.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.867+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb06802b040 con 0x7fb07806d040 2024-09-21T09:04:21.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.867+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150455eb0 2024-09-21T09:04:21.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.868+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb078056b20 con 0x556150455eb0 2024-09-21T09:04:21.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.868+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150455eb0 2024-09-21T09:04:21.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.868+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb078056b20 con 0x556150455eb0 2024-09-21T09:04:21.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.868+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150451400 2024-09-21T09:04:21.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.868+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.868+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150455eb0 2024-09-21T09:04:21.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.868+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb078056b20 con 0x556150455eb0 2024-09-21T09:04:21.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.868+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150455eb0 2024-09-21T09:04:21.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.869+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb078056b20 con 0x556150455eb0 2024-09-21T09:04:21.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.869+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x55615044ca10 2024-09-21T09:04:21.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.869+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb06802b040 con 0x55615044ca10 2024-09-21T09:04:21.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.869+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x55615044ca10 2024-09-21T09:04:21.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.869+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb06802b040 con 0x55615044ca10 2024-09-21T09:04:21.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.869+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150451400 2024-09-21T09:04:21.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.869+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.869+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150455eb0 2024-09-21T09:04:21.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.870+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb078056b20 con 0x556150455eb0 2024-09-21T09:04:21.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.870+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x7fb07806d040 2024-09-21T09:04:21.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.870+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06802b040 con 0x7fb07806d040 2024-09-21T09:04:21.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.870+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x55615044ca10 2024-09-21T09:04:21.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.870+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06802b040 con 0x55615044ca10 2024-09-21T09:04:21.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.870+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150451400 2024-09-21T09:04:21.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.871+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.871+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150455eb0 2024-09-21T09:04:21.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.871+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb078056b20 con 0x556150455eb0 2024-09-21T09:04:21.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.871+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x7fb07806d040 2024-09-21T09:04:21.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.871+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06802b040 con 0x7fb07806d040 2024-09-21T09:04:21.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.871+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x7fb07806d040 2024-09-21T09:04:21.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.871+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06802b040 con 0x7fb07806d040 2024-09-21T09:04:21.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.871+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150455eb0 2024-09-21T09:04:21.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.871+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb078056b20 con 0x556150455eb0 2024-09-21T09:04:21.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.871+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x556150451400 2024-09-21T09:04:21.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x55615044ca10 2024-09-21T09:04:21.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb06802b040 con 0x55615044ca10 2024-09-21T09:04:21.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556150458a40 con 0x7fb07806d040 2024-09-21T09:04:21.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06802b040 con 0x7fb07806d040 2024-09-21T09:04:21.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb08360f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:04:21.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb08360f800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:04:21.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb08360f800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:04:21.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb08360f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:04:21.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb08360f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:04:21.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb08360f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:04:21.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb08360f800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561504548d0 con 0x55615044ca10 2024-09-21T09:04:21.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x55615044ca10 2024-09-21T09:04:21.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb08360f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb08360f800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.872+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556150454510 con 0x55615044ca10 2024-09-21T09:04:21.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb06803f040 con 0x55615044ca10 2024-09-21T09:04:21.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:21.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556150455270 con 0x55615044ca10 2024-09-21T09:04:21.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb06803f040 con 0x55615044ca10 2024-09-21T09:04:21.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:04:21.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 20 zone default found 2024-09-21T09:04:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 4 Realm: () 2024-09-21T09:04:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:04:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:04:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:04:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 20 zonegroup default 2024-09-21T09:04:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556150458ee0 con 0x556150451400 2024-09-21T09:04:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.873+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55615045b1b0 con 0x556150455eb0 2024-09-21T09:04:21.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.874+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb078056b20 con 0x556150455eb0 2024-09-21T09:04:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.874+0000 7fb08360f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.874+0000 7fb08360f800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.874+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55615045b550 con 0x556150455eb0 2024-09-21T09:04:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.874+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb078056b20 con 0x556150455eb0 2024-09-21T09:04:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.874+0000 7fb08360f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.874+0000 7fb08360f800 20 started sync module instance, tier type = 2024-09-21T09:04:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.874+0000 7fb08360f800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:04:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.874+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615045a5f0 con 0x7fb07806d040 2024-09-21T09:04:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.875+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x7fb07806d040 2024-09-21T09:04:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.875+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93876446931728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615045a5f0 con 0x7fb07806d040 2024-09-21T09:04:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.875+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615045bf50 con 0x55615044ca10 2024-09-21T09:04:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.876+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93876446931728] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x7fb07806d040 2024-09-21T09:04:21.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.876+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x55615044ca10 2024-09-21T09:04:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.876+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93876446935648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615045a5f0 con 0x55615044ca10 2024-09-21T09:04:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.877+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615045c9e0 con 0x556150455eb0 2024-09-21T09:04:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.878+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb078056b20 con 0x556150455eb0 2024-09-21T09:04:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.878+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93876446935648] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x55615044ca10 2024-09-21T09:04:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.878+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93876446929216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615045a560 con 0x556150455eb0 2024-09-21T09:04:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.878+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615045d8a0 con 0x7fb07806d040 2024-09-21T09:04:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.879+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93876446929216] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb078056b20 con 0x556150455eb0 2024-09-21T09:04:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.879+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x7fb07806d040 2024-09-21T09:04:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.879+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93876446942192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615045dcc0 con 0x7fb07806d040 2024-09-21T09:04:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.879+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615045e680 con 0x55615044ca10 2024-09-21T09:04:21.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.880+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93876446942192] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x7fb07806d040 2024-09-21T09:04:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.880+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x55615044ca10 2024-09-21T09:04:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.880+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93876446943728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615045e680 con 0x55615044ca10 2024-09-21T09:04:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.880+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615045ef70 con 0x556150451400 2024-09-21T09:04:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.881+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.881+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93876446946944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615045eaa0 con 0x556150451400 2024-09-21T09:04:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.881+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615045ff40 con 0x556150451400 2024-09-21T09:04:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.882+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93876446943728] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x55615044ca10 2024-09-21T09:04:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.883+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93876446946944] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.883+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.883+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93876446950240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615045e1d0 con 0x556150451400 2024-09-21T09:04:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.883+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556150460520 con 0x556150451400 2024-09-21T09:04:21.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.884+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93876446950240] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.884+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.884+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93876446951984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556150460520 con 0x556150451400 2024-09-21T09:04:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.884+0000 7fb08360f800 20 add_watcher() i=0 2024-09-21T09:04:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.884+0000 7fb08360f800 20 add_watcher() i=1 2024-09-21T09:04:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.884+0000 7fb08360f800 20 add_watcher() i=2 2024-09-21T09:04:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.884+0000 7fb08360f800 20 add_watcher() i=3 2024-09-21T09:04:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.884+0000 7fb08360f800 20 add_watcher() i=4 2024-09-21T09:04:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.884+0000 7fb08360f800 20 add_watcher() i=5 2024-09-21T09:04:21.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.884+0000 7fb08360f800 20 add_watcher() i=6 2024-09-21T09:04:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.885+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93876446951984] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.885+0000 7fb08360f800 20 add_watcher() i=7 2024-09-21T09:04:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.885+0000 7fb08360f800 2 all 8 watchers are set, enabling cache 2024-09-21T09:04:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.885+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561504637e0 con 0x55615044ca10 2024-09-21T09:04:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.885+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb06803f040 con 0x55615044ca10 2024-09-21T09:04:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.885+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93876446953952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556150460ab0 con 0x55615044ca10 2024-09-21T09:04:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.886+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93876446953952] v31'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x55615044ca10 2024-09-21T09:04:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.886+0000 7faf357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:21.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.887+0000 7fb08360f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:04:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.887+0000 7fb08360f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:04:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.887+0000 7fb08360f800 5 note: GC not initialized 2024-09-21T09:04:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.887+0000 7faeaffff640 20 reqs_thread_entry: start 2024-09-21T09:04:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.887+0000 7fb08360f800 20 init_complete bucket index max shards: 11 2024-09-21T09:04:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.887+0000 7fb08360f800 20 Filter name: none 2024-09-21T09:04:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.887+0000 7faeadffb640 20 reqs_thread_entry: start 2024-09-21T09:04:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.887+0000 7fb08360f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-21T09:04:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.887+0000 7fb08360f800 20 rados->read ofs=0 len=0 2024-09-21T09:04:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.887+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556150496c80 con 0x7fb07806d040 2024-09-21T09:04:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.887+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fb06803f040 con 0x7fb07806d040 2024-09-21T09:04:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.887+0000 7fb08360f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T09:04:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.888+0000 7fb08360f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-21T09:04:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.888+0000 7fb08360f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-21T09:04:21.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.888+0000 7fb08360f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:04:21.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.888+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55615049b010 con 0x556150451400 2024-09-21T09:04:21.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.889+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v31'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.906 INFO:teuthology.orchestra.run.smithi178.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-21T09:04:21.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.889+0000 7faf357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:21.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.889+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93876446953952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561504949f0 con 0x55615044ca10 2024-09-21T09:04:21.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.890+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93876446953952] v31'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x55615044ca10 2024-09-21T09:04:21.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.890+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93876446931728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561504949f0 con 0x7fb07806d040 2024-09-21T09:04:21.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.891+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93876446931728] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x7fb07806d040 2024-09-21T09:04:21.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.891+0000 7fb08360f800 20 remove_watcher() i=0 2024-09-21T09:04:21.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.891+0000 7fb08360f800 2 removed watcher, disabling cache 2024-09-21T09:04:21.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.891+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93876446935648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561504949f0 con 0x55615044ca10 2024-09-21T09:04:21.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.893+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93876446935648] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x55615044ca10 2024-09-21T09:04:21.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.893+0000 7fb08360f800 20 remove_watcher() i=1 2024-09-21T09:04:21.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.893+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93876446929216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561504949f0 con 0x556150455eb0 2024-09-21T09:04:21.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.894+0000 7fb07ece7640 1 -- 172.21.15.178:0/4221454900 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93876446929216] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb078056b20 con 0x556150455eb0 2024-09-21T09:04:21.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.894+0000 7fb08360f800 20 remove_watcher() i=2 2024-09-21T09:04:21.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.894+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93876446942192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561504949f0 con 0x7fb07806d040 2024-09-21T09:04:21.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.895+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93876446942192] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x7fb07806d040 2024-09-21T09:04:21.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.895+0000 7fb08360f800 20 remove_watcher() i=3 2024-09-21T09:04:21.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.895+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93876446943728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561504949f0 con 0x55615044ca10 2024-09-21T09:04:21.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.896+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93876446943728] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06803f040 con 0x55615044ca10 2024-09-21T09:04:21.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.896+0000 7fb08360f800 20 remove_watcher() i=4 2024-09-21T09:04:21.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.896+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93876446946944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561504949f0 con 0x556150451400 2024-09-21T09:04:21.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.897+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93876446946944] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.897+0000 7fb08360f800 20 remove_watcher() i=5 2024-09-21T09:04:21.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.897+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93876446950240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561504949f0 con 0x556150451400 2024-09-21T09:04:21.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.898+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93876446950240] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.898+0000 7fb08360f800 20 remove_watcher() i=6 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.898+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93876446951984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561504949f0 con 0x556150451400 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb07f4e8640 1 -- 172.21.15.178:0/4221454900 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93876446951984] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07002a070 con 0x556150451400 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 20 remove_watcher() i=7 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556150451400 msgr2=0x5561504537f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556150451400 0x5561504537f0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55615044ca10 msgr2=0x55615044eed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55615044ca10 0x55615044eed0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb07806d040 msgr2=0x7fb0780778f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb07806d040 0x7fb0780778f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556150455eb0 msgr2=0x556150458370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556150455eb0 0x556150458370 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf48036b40 msgr2=0x7faf48039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf48036b40 0x7faf48039000 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb07804ec10 tx=0x7fb078092000 comp rx=0 tx=0).stop 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556150439b30 msgr2=0x556150440f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb07e4e6640 1 -- 172.21.15.178:0/4221454900 reap_dead start 2024-09-21T09:04:21.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556150439b30 0x556150440f80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb070043040 tx=0x7fb07004ce80 comp rx=0 tx=0).stop 2024-09-21T09:04:21.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 shutdown_connections 2024-09-21T09:04:21.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 --2- 172.21.15.178:0/4221454900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556150439b30 0x556150440f80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 >> 172.21.15.178:0/4221454900 conn(0x556150435e90 msgr2=0x556150433f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:21.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.899+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 shutdown_connections 2024-09-21T09:04:21.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/4221454900 wait complete. 2024-09-21T09:04:21.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/2453293393 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf58036b40 msgr2=0x7faf58039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 --2- 172.21.15.178:0/2453293393 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf58036b40 0x7faf58039000 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x556150419ba0 tx=0x7fb07807f910 comp rx=0 tx=0).stop 2024-09-21T09:04:21.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/2453293393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615042cee0 msgr2=0x55615042d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 --2- 172.21.15.178:0/2453293393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615042cee0 0x55615042d300 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x556150413330 tx=0x7fb07000aec0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/2453293393 shutdown_connections 2024-09-21T09:04:21.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 --2- 172.21.15.178:0/2453293393 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf58036b40 0x7faf58039000 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 --2- 172.21.15.178:0/2453293393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615042cee0 0x55615042d300 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/2453293393 >> 172.21.15.178:0/2453293393 conn(0x556150421e70 msgr2=0x5561504249f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:21.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/2453293393 shutdown_connections 2024-09-21T09:04:21.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/2453293393 wait complete. 2024-09-21T09:04:21.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55615041ba30 msgr2=0x55615041de20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55615041ba30 0x55615041de20 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55615031d4f0 msgr2=0x556150419180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55615031d4f0 0x556150419180 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf64036b40 msgr2=0x7faf64039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf64036b40 0x7faf64039000 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb068000f60 tx=0x7fb068001370 comp rx=0 tx=0).stop 2024-09-21T09:04:21.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 msgr2=0x556150412110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x556150412110 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb07800a4b0 tx=0x7fb078003330 comp rx=0 tx=0).stop 2024-09-21T09:04:21.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 shutdown_connections 2024-09-21T09:04:21.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55615041ba30 0x55615041de20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55615031d4f0 0x556150419180 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7faf64036b40 0x7faf64039000 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 --2- 172.21.15.178:0/4000013945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55615031ab00 0x556150412110 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 >> 172.21.15.178:0/4000013945 conn(0x556150315550 msgr2=0x556150403a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:21.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 shutdown_connections 2024-09-21T09:04:21.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.900+0000 7fb08360f800 1 -- 172.21.15.178:0/4000013945 wait complete. 2024-09-21T09:04:21.911 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-21T09:04:21.916 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:04:21.916 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-21T09:04:21.919 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-21T09:04:21.920 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-21T09:04:21.920 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-21T09:04:21.920 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-21T09:04:21.920 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-21T09:04:21.965 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:04:21.965 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:04:21.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.964+0000 7f64aef22800 1 Processor -- start 2024-09-21T09:04:21.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.964+0000 7f64aef22800 1 -- start start 2024-09-21T09:04:21.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.964+0000 7f64aef22800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x564a2000c4e0 0x564a2000c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.964+0000 7f64aef22800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564a1feccb30 con 0x564a2000ce20 2024-09-21T09:04:21.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.964+0000 7f64aef22800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x564a1feae360 con 0x564a2000c4e0 2024-09-21T09:04:21.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.964+0000 7f64aacac640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x564a2000c4e0 0x564a2000c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.964+0000 7f64aacac640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x564a2000c4e0 0x564a2000c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33840/0 (socket says 172.21.15.178:33840) 2024-09-21T09:04:21.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.964+0000 7f64aacac640 1 -- 172.21.15.178:0/2504015905 learned_addr learned my addr 172.21.15.178:0/2504015905 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.965+0000 7f64aacac640 1 -- 172.21.15.178:0/2504015905 >> v1:172.21.15.44:6789/0 conn(0x564a2000ce20 legacy=0x564a200119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.965+0000 7f64aacac640 1 -- 172.21.15.178:0/2504015905 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a1fed4e00 con 0x564a2000c4e0 2024-09-21T09:04:21.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.966+0000 7f64aacac640 1 --2- 172.21.15.178:0/2504015905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a2000c8e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f649c00a520 tx=0x7f649c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771398e072e6d4c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.967+0000 7f64aa4ab640 1 -- 172.21.15.178:0/2504015905 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f649c055070 con 0x564a2000c4e0 2024-09-21T09:04:21.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.967+0000 7f64aa4ab640 1 -- 172.21.15.178:0/2504015905 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f649c0515b0 con 0x564a2000c4e0 2024-09-21T09:04:21.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.967+0000 7f64aa4ab640 1 -- 172.21.15.178:0/2504015905 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f649c0518d0 con 0x564a2000c4e0 2024-09-21T09:04:21.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.967+0000 7f64aef22800 1 -- 172.21.15.178:0/2504015905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 msgr2=0x564a2000c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.967+0000 7f64aef22800 1 --2- 172.21.15.178:0/2504015905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a2000c8e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f649c00a520 tx=0x7f649c045ba0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.967+0000 7f64aef22800 1 -- 172.21.15.178:0/2504015905 shutdown_connections 2024-09-21T09:04:21.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.967+0000 7f64aef22800 1 --2- 172.21.15.178:0/2504015905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a2000c8e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.967+0000 7f64aef22800 1 -- 172.21.15.178:0/2504015905 >> 172.21.15.178:0/2504015905 conn(0x564a20007db0 msgr2=0x564a2000a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:21.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.967+0000 7f64aef22800 1 -- 172.21.15.178:0/2504015905 shutdown_connections 2024-09-21T09:04:21.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.967+0000 7f64aef22800 1 -- 172.21.15.178:0/2504015905 wait complete. 2024-09-21T09:04:21.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.981+0000 7f64aef22800 1 Processor -- start 2024-09-21T09:04:21.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.981+0000 7f64aef22800 1 -- start start 2024-09-21T09:04:21.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.981+0000 7f64aef22800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a1ff815c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.981+0000 7f64aef22800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564a1ff59360 con 0x564a2000c4e0 2024-09-21T09:04:21.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.981+0000 7f64aacac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a1ff815c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.981+0000 7f64aacac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a1ff815c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33848/0 (socket says 172.21.15.178:33848) 2024-09-21T09:04:21.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.981+0000 7f64aacac640 1 -- 172.21.15.178:0/885185782 learned_addr learned my addr 172.21.15.178:0/885185782 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.981+0000 7f64aacac640 1 -- 172.21.15.178:0/885185782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a1fea6bc0 con 0x564a2000c4e0 2024-09-21T09:04:21.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.982+0000 7f64aacac640 1 --2- 172.21.15.178:0/885185782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a1ff815c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f649c025da0 tx=0x7f649c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae5693aeb2a5bc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.982+0000 7f6398e09640 1 -- 172.21.15.178:0/885185782 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f649c051950 con 0x564a2000c4e0 2024-09-21T09:04:21.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.982+0000 7f6398e09640 1 -- 172.21.15.178:0/885185782 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f649c051af0 con 0x564a2000c4e0 2024-09-21T09:04:21.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.982+0000 7f6398e09640 1 -- 172.21.15.178:0/885185782 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f649c051dd0 con 0x564a2000c4e0 2024-09-21T09:04:21.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.983+0000 7f64aef22800 1 -- 172.21.15.178:0/885185782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 msgr2=0x564a1ff815c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:21.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.983+0000 7f64aef22800 1 --2- 172.21.15.178:0/885185782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a1ff815c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f649c025da0 tx=0x7f649c051000 comp rx=0 tx=0).stop 2024-09-21T09:04:21.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.983+0000 7f64aef22800 1 -- 172.21.15.178:0/885185782 shutdown_connections 2024-09-21T09:04:21.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.983+0000 7f64aef22800 1 --2- 172.21.15.178:0/885185782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a1ff815c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:21.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.983+0000 7f64aef22800 1 -- 172.21.15.178:0/885185782 >> 172.21.15.178:0/885185782 conn(0x564a20007db0 msgr2=0x564a200f7150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:21.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.983+0000 7f64aef22800 1 -- 172.21.15.178:0/885185782 shutdown_connections 2024-09-21T09:04:21.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.983+0000 7f64aef22800 1 -- 172.21.15.178:0/885185782 wait complete. 2024-09-21T09:04:21.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.983+0000 7f64aef22800 1 Processor -- start 2024-09-21T09:04:21.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.983+0000 7f64aef22800 1 -- start start 2024-09-21T09:04:21.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.983+0000 7f64aef22800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a200fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.983+0000 7f64aef22800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564a20013500 con 0x564a2000c4e0 2024-09-21T09:04:21.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.983+0000 7f64aacac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a200fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.983+0000 7f64aacac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a200fcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33856/0 (socket says 172.21.15.178:33856) 2024-09-21T09:04:21.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.983+0000 7f64aacac640 1 -- 172.21.15.178:0/976072598 learned_addr learned my addr 172.21.15.178:0/976072598 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.984+0000 7f64aacac640 1 -- 172.21.15.178:0/976072598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a1febafe0 con 0x564a2000c4e0 2024-09-21T09:04:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.984+0000 7f64aacac640 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a200fcef0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f649c067040 tx=0x7f649c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.984+0000 7f6397606640 1 -- 172.21.15.178:0/976072598 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f649c073070 con 0x564a2000c4e0 2024-09-21T09:04:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.984+0000 7f6397606640 1 -- 172.21.15.178:0/976072598 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f649c05a450 con 0x564a2000c4e0 2024-09-21T09:04:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.984+0000 7f6397606640 1 -- 172.21.15.178:0/976072598 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f649c05a730 con 0x564a2000c4e0 2024-09-21T09:04:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.984+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a200fb5e0 con 0x564a2000c4e0 2024-09-21T09:04:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.984+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a200fbb60 con 0x564a2000c4e0 2024-09-21T09:04:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.985+0000 7f6397606640 1 -- 172.21.15.178:0/976072598 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f649c076070 con 0x564a2000c4e0 2024-09-21T09:04:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.985+0000 7f6397606640 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6390036b40 0x7f6390039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.985+0000 7f6397606640 1 -- 172.21.15.178:0/976072598 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f649c062070 con 0x564a2000c4e0 2024-09-21T09:04:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.985+0000 7f64a3fff640 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6390036b40 0x7f6390039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.986+0000 7f64aef22800 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564a2000ce20 0x564a2010d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.986+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2010da20 con 0x564a2000ce20 2024-09-21T09:04:21.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.986+0000 7f64ab4ad640 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564a2000ce20 0x564a2010d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.986+0000 7f64a3fff640 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6390036b40 0x7f6390039000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6494001e10 tx=0x7f6494001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.986+0000 7f64ab4ad640 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564a2000ce20 0x564a2010d4e0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.986+0000 7f64ab4ad640 1 -- 172.21.15.178:0/976072598 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64a400a4a0 con 0x564a2000ce20 2024-09-21T09:04:21.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.986+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2010e270 con 0x564a2000ce20 2024-09-21T09:04:21.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.986+0000 7f64ab4ad640 1 -- 172.21.15.178:0/976072598 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f64a400a4a0 con 0x564a2000ce20 2024-09-21T09:04:21.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.987+0000 7f64aef22800 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564a2010fca0 0x564a20112110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.987+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201128a0 con 0x564a2010fca0 2024-09-21T09:04:21.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.987+0000 7f64aacac640 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564a2010fca0 0x564a20112110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.987+0000 7f64aacac640 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564a2010fca0 0x564a20112110 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.987+0000 7f64aacac640 1 -- 172.21.15.178:0/976072598 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f649c07f070 con 0x564a2010fca0 2024-09-21T09:04:21.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.987+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2010eac0 con 0x564a2000ce20 2024-09-21T09:04:21.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.988+0000 7f64ab4ad640 1 -- 172.21.15.178:0/976072598 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f64a400a4a0 con 0x564a2000ce20 2024-09-21T09:04:21.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.988+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2010eea0 con 0x564a2000ce20 2024-09-21T09:04:21.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.988+0000 7f64ab4ad640 1 -- 172.21.15.178:0/976072598 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f64a400a4a0 con 0x564a2000ce20 2024-09-21T09:04:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.988+0000 7f64aef22800 1 Processor -- start 2024-09-21T09:04:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.988+0000 7f64aef22800 1 -- start start 2024-09-21T09:04:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.988+0000 7f64aef22800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a20121220 0x564a20121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.988+0000 7f64aef22800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564a200fd430 con 0x564a20121220 2024-09-21T09:04:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.989+0000 7f64ab4ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a20121220 0x564a20121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.989+0000 7f64ab4ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a20121220 0x564a20121640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33870/0 (socket says 172.21.15.178:33870) 2024-09-21T09:04:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.989+0000 7f64ab4ad640 1 -- 172.21.15.178:0/829621257 learned_addr learned my addr 172.21.15.178:0/829621257 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.989+0000 7f64ab4ad640 1 -- 172.21.15.178:0/829621257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a20121b80 con 0x564a20121220 2024-09-21T09:04:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.989+0000 7f64ab4ad640 1 --2- 172.21.15.178:0/829621257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a20121220 0x564a20121640 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x564a200fc560 tx=0x7f64a4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.990+0000 7f6394e01640 1 -- 172.21.15.178:0/829621257 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64a4014450 con 0x564a20121220 2024-09-21T09:04:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.990+0000 7f6394e01640 1 -- 172.21.15.178:0/829621257 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a4014610 con 0x564a20121220 2024-09-21T09:04:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.990+0000 7f64aef22800 1 -- 172.21.15.178:0/829621257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a20121e10 con 0x564a20121220 2024-09-21T09:04:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.990+0000 7f6394e01640 1 -- 172.21.15.178:0/829621257 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64a4014930 con 0x564a20121220 2024-09-21T09:04:21.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.990+0000 7f64aef22800 1 -- 172.21.15.178:0/829621257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a20124af0 con 0x564a20121220 2024-09-21T09:04:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.990+0000 7f6394e01640 1 -- 172.21.15.178:0/829621257 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f64a4011040 con 0x564a20121220 2024-09-21T09:04:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.991+0000 7f6394e01640 1 --2- 172.21.15.178:0/829621257 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6384036b40 0x7f6384039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.991+0000 7f6394e01640 1 -- 172.21.15.178:0/829621257 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f64a401e070 con 0x564a20121220 2024-09-21T09:04:21.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.991+0000 7f64aacac640 1 --2- 172.21.15.178:0/829621257 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6384036b40 0x7f6384039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.991+0000 7f64aef22800 1 Processor -- start 2024-09-21T09:04:21.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.991+0000 7f64aacac640 1 --2- 172.21.15.178:0/829621257 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6384036b40 0x7f6384039000 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x564a200fc0d0 tx=0x7f649c08f220 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.991+0000 7f64aef22800 1 -- start start 2024-09-21T09:04:21.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.991+0000 7f64aef22800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2012de80 0x564a2012e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:21.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.991+0000 7f64aef22800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564a1fea8580 con 0x564a2012de80 2024-09-21T09:04:21.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.991+0000 7f64ab4ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2012de80 0x564a2012e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:21.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.991+0000 7f64ab4ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2012de80 0x564a2012e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33878/0 (socket says 172.21.15.178:33878) 2024-09-21T09:04:21.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.991+0000 7f64ab4ad640 1 -- 172.21.15.178:0/3043643306 learned_addr learned my addr 172.21.15.178:0/3043643306 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:21.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.992+0000 7f64ab4ad640 1 -- 172.21.15.178:0/3043643306 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a2012e7c0 con 0x564a2012de80 2024-09-21T09:04:21.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.992+0000 7f64ab4ad640 1 --2- 172.21.15.178:0/3043643306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2012de80 0x564a2012e280 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f64a404cba0 tx=0x7f64a402b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3b208cd6bfec51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:21.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.992+0000 7f638e7fc640 1 -- 172.21.15.178:0/3043643306 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64a4028040 con 0x564a2012de80 2024-09-21T09:04:22.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.992+0000 7f638e7fc640 1 -- 172.21.15.178:0/3043643306 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a40400c0 con 0x564a2012de80 2024-09-21T09:04:22.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.992+0000 7f638e7fc640 1 -- 172.21.15.178:0/3043643306 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64a4016980 con 0x564a2012de80 2024-09-21T09:04:22.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.992+0000 7f64aef22800 1 -- 172.21.15.178:0/3043643306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2012de80 msgr2=0x564a2012e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.992+0000 7f64aef22800 1 --2- 172.21.15.178:0/3043643306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2012de80 0x564a2012e280 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f64a404cba0 tx=0x7f64a402b410 comp rx=0 tx=0).stop 2024-09-21T09:04:22.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.992+0000 7f64aef22800 1 -- 172.21.15.178:0/3043643306 shutdown_connections 2024-09-21T09:04:22.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.992+0000 7f64aef22800 1 --2- 172.21.15.178:0/3043643306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2012de80 0x564a2012e280 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.992+0000 7f64aef22800 1 -- 172.21.15.178:0/3043643306 >> 172.21.15.178:0/3043643306 conn(0x564a2012a230 msgr2=0x564a20128330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:22.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.993+0000 7f64aef22800 1 -- 172.21.15.178:0/3043643306 shutdown_connections 2024-09-21T09:04:22.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.993+0000 7f64aef22800 1 -- 172.21.15.178:0/3043643306 wait complete. 2024-09-21T09:04:22.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.993+0000 7f64aef22800 1 Processor -- start 2024-09-21T09:04:22.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.993+0000 7f64aef22800 1 -- start start 2024-09-21T09:04:22.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.993+0000 7f64aef22800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2012de80 0x564a201351a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.993+0000 7f64aef22800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564a2012ece0 con 0x564a2012de80 2024-09-21T09:04:22.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.993+0000 7f64ab4ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2012de80 0x564a201351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.993+0000 7f64ab4ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2012de80 0x564a201351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33888/0 (socket says 172.21.15.178:33888) 2024-09-21T09:04:22.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.993+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 learned_addr learned my addr 172.21.15.178:0/2788317688 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:22.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.993+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a201356e0 con 0x564a2012de80 2024-09-21T09:04:22.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.994+0000 7f64ab4ad640 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2012de80 0x564a201351a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f64a403f040 tx=0x7f64a404cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.994+0000 7f638cff9640 1 -- 172.21.15.178:0/2788317688 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64a4028040 con 0x564a2012de80 2024-09-21T09:04:22.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.994+0000 7f638cff9640 1 -- 172.21.15.178:0/2788317688 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a4031030 con 0x564a2012de80 2024-09-21T09:04:22.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.994+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a20135970 con 0x564a2012de80 2024-09-21T09:04:22.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.994+0000 7f638cff9640 1 -- 172.21.15.178:0/2788317688 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64a4016ab0 con 0x564a2012de80 2024-09-21T09:04:22.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.994+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a20138620 con 0x564a2012de80 2024-09-21T09:04:22.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.995+0000 7f638cff9640 1 -- 172.21.15.178:0/2788317688 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f64a404e070 con 0x564a2012de80 2024-09-21T09:04:22.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.995+0000 7f638cff9640 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6374036aa0 0x7f6374038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.995+0000 7f638cff9640 1 -- 172.21.15.178:0/2788317688 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f64a400e040 con 0x564a2012de80 2024-09-21T09:04:22.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.995+0000 7f64aacac640 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6374036aa0 0x7f6374038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.995+0000 7f64aacac640 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6374036aa0 0x7f6374038f60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x564a20112ca0 tx=0x7f649c091000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.995+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.995+0000 7f64aef22800 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564a20140e90 0x564a20143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.995+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a20143aa0 con 0x564a20140e90 2024-09-21T09:04:22.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.995+0000 7f64a3fff640 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564a20140e90 0x564a20143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.996+0000 7f64a3fff640 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564a20140e90 0x564a20143350 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.996+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f649400bdb0 con 0x564a20140e90 2024-09-21T09:04:22.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.996+0000 7f64aef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.996+0000 7f64aef22800 20 realm 2024-09-21T09:04:22.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.996+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.996+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201402e0 con 0x564a20140e90 2024-09-21T09:04:22.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.996+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f649400bdb0 con 0x564a20140e90 2024-09-21T09:04:22.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.996+0000 7f64aef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.996+0000 7f64aef22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:04:22.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.996+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.996+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a20144590 con 0x564a20140e90 2024-09-21T09:04:22.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.996+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f649400bdb0 con 0x564a20140e90 2024-09-21T09:04:22.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.997+0000 7f64aef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.997+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.997+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a20144e60 con 0x564a20140e90 2024-09-21T09:04:22.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.997+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f649400bdb0 con 0x564a20140e90 2024-09-21T09:04:22.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.997+0000 7f64aef22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:22.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.997+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.997+0000 7f64aef22800 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564a201457a0 0x564a20147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.997+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a20148360 con 0x564a201457a0 2024-09-21T09:04:22.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.997+0000 7f64ab4ad640 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564a201457a0 0x564a20147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.997+0000 7f64ab4ad640 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564a201457a0 0x564a20147bd0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.998+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.998+0000 7f64aef22800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:04:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.998+0000 7f64aef22800 20 searching for the correct realm 2024-09-21T09:04:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.998+0000 7f64aef22800 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564a2014a330 0x564a2014c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.998+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a2014a330 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.998+0000 7f64aacac640 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564a2014a330 0x564a2014c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.998+0000 7f64aacac640 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564a2014a330 0x564a2014c7f0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.998+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.998+0000 7f64aacac640 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f649c078070 0x7f649c08f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.998+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x7f649c078070 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.999+0000 7f64a3fff640 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f649c078070 0x7f649c08f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.999+0000 7f64a3fff640 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f649c078070 0x7f649c08f670 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.999+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649400bdb0 con 0x7f649c078070 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.999+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a201457a0 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.999+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:21.999+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a20140e90 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.000+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649400bdb0 con 0x564a20140e90 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.000+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a20140e90 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.000+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.000+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a201457a0 2024-09-21T09:04:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.000+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.000+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a201457a0 2024-09-21T09:04:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.000+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.000+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x7f649c078070 2024-09-21T09:04:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.001+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.001+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a2014a330 2024-09-21T09:04:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.001+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.001+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a20140e90 2024-09-21T09:04:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.001+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.001+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a201457a0 2024-09-21T09:04:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.001+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.002+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a20140e90 2024-09-21T09:04:22.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.002+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.002+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x7f649c078070 2024-09-21T09:04:22.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.002+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.002+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a2014a330 2024-09-21T09:04:22.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.002+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.002+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a2014a330 2024-09-21T09:04:22.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.002+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.002+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a201457a0 2024-09-21T09:04:22.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.003+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.003+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a2014a330 2024-09-21T09:04:22.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.003+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.003+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a2014a330 2024-09-21T09:04:22.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.003+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.003+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a20140e90 2024-09-21T09:04:22.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.003+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.003+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a20140e90 2024-09-21T09:04:22.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.004+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.004+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a201457a0 2024-09-21T09:04:22.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.004+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.004+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a2014a330 2024-09-21T09:04:22.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.004+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.004+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x7f649c078070 2024-09-21T09:04:22.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.004+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.004+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a20140e90 2024-09-21T09:04:22.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.005+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.005+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a201457a0 2024-09-21T09:04:22.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.005+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.005+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a2014a330 2024-09-21T09:04:22.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.005+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.005+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x7f649c078070 2024-09-21T09:04:22.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.005+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.005+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x7f649c078070 2024-09-21T09:04:22.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.005+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.005+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a2014a330 2024-09-21T09:04:22.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.006+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.006+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a201457a0 2024-09-21T09:04:22.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.006+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.006+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x564a20140e90 2024-09-21T09:04:22.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.006+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.006+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564a2014cec0 con 0x7f649c078070 2024-09-21T09:04:22.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.006+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.006+0000 7f64aef22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:04:22.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.006+0000 7f64aef22800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:04:22.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.006+0000 7f64aef22800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:04:22.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.006+0000 7f64aef22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:04:22.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.006+0000 7f64aef22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:04:22.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.006+0000 7f64aef22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:04:22.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a20148d50 con 0x564a20140e90 2024-09-21T09:04:22.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201495f0 con 0x564a20140e90 2024-09-21T09:04:22.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:22.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a20148990 con 0x564a20140e90 2024-09-21T09:04:22.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:04:22.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 20 zone default found 2024-09-21T09:04:22.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 4 Realm: () 2024-09-21T09:04:22.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:04:22.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:04:22.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:04:22.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 20 zonegroup default 2024-09-21T09:04:22.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.007+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2014d3b0 con 0x564a201457a0 2024-09-21T09:04:22.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.008+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.019 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.008+0000 7f64aef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.008+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.008+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2014f680 con 0x564a2014a330 2024-09-21T09:04:22.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.008+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.008+0000 7f64aef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.008+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.008+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2014fa20 con 0x564a2014a330 2024-09-21T09:04:22.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.008+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.008+0000 7f64aef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.008+0000 7f64aef22800 20 started sync module instance, tier type = 2024-09-21T09:04:22.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.008+0000 7f64aef22800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:04:22.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.008+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2014eb10 con 0x7f649c078070 2024-09-21T09:04:22.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.009+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.009+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94876365811776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2014eb10 con 0x7f649c078070 2024-09-21T09:04:22.020 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.009+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20150470 con 0x564a20140e90 2024-09-21T09:04:22.021 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.010+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94876365811776] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.011+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.011+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94876365815680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2014eb10 con 0x564a20140e90 2024-09-21T09:04:22.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.011+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20150f00 con 0x564a2014a330 2024-09-21T09:04:22.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.012+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.012+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94876365818320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201517a0 con 0x564a2014a330 2024-09-21T09:04:22.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.012+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94876365815680] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.012+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2014e690 con 0x7f649c078070 2024-09-21T09:04:22.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.013+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.013+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94876365818320] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.013+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94876365820656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201521e0 con 0x7f649c078070 2024-09-21T09:04:22.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.013+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20152ba0 con 0x564a20140e90 2024-09-21T09:04:22.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.014+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94876365820656] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.014+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.014+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94876365823760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20152ba0 con 0x564a20140e90 2024-09-21T09:04:22.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.014+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20153560 con 0x564a201457a0 2024-09-21T09:04:22.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.015+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.015+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94876365828272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20153db0 con 0x564a201457a0 2024-09-21T09:04:22.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.015+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201547f0 con 0x564a201457a0 2024-09-21T09:04:22.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.016+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94876365823760] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.017+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94876365828272] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.017+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.017+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94876365832896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20153960 con 0x564a201457a0 2024-09-21T09:04:22.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.017+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20154e80 con 0x564a201457a0 2024-09-21T09:04:22.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.018+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94876365832896] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.018+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.018+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94876365825776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20154e80 con 0x564a201457a0 2024-09-21T09:04:22.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.018+0000 7f64aef22800 20 add_watcher() i=0 2024-09-21T09:04:22.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.018+0000 7f64aef22800 20 add_watcher() i=1 2024-09-21T09:04:22.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.018+0000 7f64aef22800 20 add_watcher() i=2 2024-09-21T09:04:22.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.018+0000 7f64aef22800 20 add_watcher() i=3 2024-09-21T09:04:22.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.018+0000 7f64aef22800 20 add_watcher() i=4 2024-09-21T09:04:22.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.018+0000 7f64aef22800 20 add_watcher() i=5 2024-09-21T09:04:22.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.018+0000 7f64aef22800 20 add_watcher() i=6 2024-09-21T09:04:22.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.019+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94876365825776] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.019+0000 7f64aef22800 20 add_watcher() i=7 2024-09-21T09:04:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.019+0000 7f64aef22800 2 all 8 watchers are set, enabling cache 2024-09-21T09:04:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.019+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a20158120 con 0x564a20140e90 2024-09-21T09:04:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.019+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.019+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94876365835072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20155410 con 0x564a20140e90 2024-09-21T09:04:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.020+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94876365835072] v31'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.020+0000 7f63617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.020+0000 7f64aef22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:04:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.020+0000 7f64aef22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:04:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.020+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20160c20 con 0x564a20140e90 2024-09-21T09:04:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.022+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.022+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20161270 con 0x564a201457a0 2024-09-21T09:04:22.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.023+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.023+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20161270 con 0x564a2014a330 2024-09-21T09:04:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.024+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.024+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20161ae0 con 0x564a20140e90 2024-09-21T09:04:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.025+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'219 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.025+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2015ea30 con 0x7f649c078070 2024-09-21T09:04:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.026+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.026+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2015ea30 con 0x564a2014a330 2024-09-21T09:04:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.027+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'47 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.027+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162620 con 0x564a20140e90 2024-09-21T09:04:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.028+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.028+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162700 con 0x564a201457a0 2024-09-21T09:04:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.029+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.029+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162810 con 0x7f649c078070 2024-09-21T09:04:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.030+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.030+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162810 con 0x564a2014a330 2024-09-21T09:04:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.031+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.031+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x7f649c078070 2024-09-21T09:04:22.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.032+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.032+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a201457a0 2024-09-21T09:04:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.033+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.033+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x7f649c078070 2024-09-21T09:04:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.034+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.034+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a201457a0 2024-09-21T09:04:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.035+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.035+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a20140e90 2024-09-21T09:04:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.036+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'220 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.036+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a2014a330 2024-09-21T09:04:22.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.037+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'62 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.037+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x7f649c078070 2024-09-21T09:04:22.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.038+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.038+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a2014a330 2024-09-21T09:04:22.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.039+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.039+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a20140e90 2024-09-21T09:04:22.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.040+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.040+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a20140e90 2024-09-21T09:04:22.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.041+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'221 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.041+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a2014a330 2024-09-21T09:04:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.042+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'63 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.042+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x7f649c078070 2024-09-21T09:04:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.043+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.043+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a2014a330 2024-09-21T09:04:22.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.044+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.044+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a2014a330 2024-09-21T09:04:22.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.045+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.045+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a2014a330 2024-09-21T09:04:22.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.046+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.046+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a2014a330 2024-09-21T09:04:22.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.047+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'48 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.047+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a201457a0 2024-09-21T09:04:22.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.048+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.048+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a2014a330 2024-09-21T09:04:22.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.049+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.049+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a201457a0 2024-09-21T09:04:22.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.050+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.050+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a2014a330 2024-09-21T09:04:22.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.051+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'64 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.051+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x564a201457a0 2024-09-21T09:04:22.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.052+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.052+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20162cb0 con 0x7f649c078070 2024-09-21T09:04:22.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.053+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.053+0000 7f62dbfff640 20 reqs_thread_entry: start 2024-09-21T09:04:22.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.053+0000 7f64aef22800 20 init_complete bucket index max shards: 11 2024-09-21T09:04:22.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f64aef22800 20 Filter name: none 2024-09-21T09:04:22.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f62d9ffb640 20 reqs_thread_entry: start 2024-09-21T09:04:22.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f64aef22800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-21T09:04:22.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2018dc30 con 0x7f649c078070 2024-09-21T09:04:22.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f64aef22800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T09:04:22.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f64aef22800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-21T09:04:22.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f64aef22800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-21T09:04:22.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f64aef22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:04:22.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201904f0 con 0x564a20140e90 2024-09-21T09:04:22.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f64aef22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 : miss 2024-09-21T09:04:22.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.054+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:96 8.1b 8:d9f8a085:root::.bucket.meta.myfoo6%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201903e0 con 0x7f649c078070 2024-09-21T09:04:22.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.055+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(96 .bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.055+0000 7f64aef22800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T09:04:22.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.055+0000 7f64aef22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 info.flags=0x17 2024-09-21T09:04:22.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.055+0000 7f64aef22800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 to cache LRU end 2024-09-21T09:04:22.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.055+0000 7f64aef22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:04:22.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.055+0000 7f64aef22800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-21T09:04:22.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.055+0000 7f64aef22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 2024-09-21T09:04:22.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.055+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:97 4.12 4:4b65198a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2020d910 con 0x564a20140e90 2024-09-21T09:04:22.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.055+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(97 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.055+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:98 4.1 4:8120de49:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2020d910 con 0x7f649c078070 2024-09-21T09:04:22.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.056+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 21 ==== osd_op_reply(98 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.056+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:99 4.28 4:15728d93:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2020d910 con 0x564a20140e90 2024-09-21T09:04:22.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.056+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(99 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.056+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:100 4.1 4:82bf2666:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2020d910 con 0x7f649c078070 2024-09-21T09:04:22.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.056+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 22 ==== osd_op_reply(100 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.056+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:101 4.3 4:c0fa3be1:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2020d8d0 con 0x564a20140e90 2024-09-21T09:04:22.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.057+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(101 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.057+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:102 4.f 4:f2568a7a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2020d8d0 con 0x564a20140e90 2024-09-21T09:04:22.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.057+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(102 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.057+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:103 4.11 4:88d7175f:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2020d8d0 con 0x564a201457a0 2024-09-21T09:04:22.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.057+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(103 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.057+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:104 4.3b 4:dc8860e6:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2020d8d0 con 0x564a2014a330 2024-09-21T09:04:22.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.058+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(104 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.058+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:105 4.31 4:8c4a327e:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2020d8d0 con 0x564a20140e90 2024-09-21T09:04:22.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.058+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== osd_op_reply(105 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.058+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:106 4.18 4:18bc876d:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2020d8d0 con 0x7f649c078070 2024-09-21T09:04:22.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.058+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 23 ==== osd_op_reply(106 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9 [call out=345b] v0'0 uv8 ondisk = 0) ==== 194+0+345 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.058+0000 7f64aef22800 10 cls_bucket_list_unordered: got thirteen 2024-09-21T09:04:22.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.058+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:107 4.5 4:a367e9ee:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2020d8d0 con 0x564a2014a330 2024-09-21T09:04:22.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.059+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 27 ==== osd_op_reply(107 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.10 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.059+0000 7f64aef22800 20 get_obj_state: octx=0x564a2012e280 obj=myfoo6:thirteen state=0x564a2020b998 s->prefetch_data=0 2024-09-21T09:04:22.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.059+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:108 3.1a 3:58a12cc7:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2020c7c0 con 0x564a20140e90 2024-09-21T09:04:22.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.059+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(108 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.059+0000 7f64aef22800 10 manifest: total_size = 8 2024-09-21T09:04:22.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.059+0000 7f64aef22800 20 get_obj_state: setting s->obj_tag to _4ENyp29_DRRWQ1GEz3cQdImraJWRjQM 2024-09-21T09:04:22.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.059+0000 7f64aef22800 20 get_obj_state: octx=0x564a2012e280 obj=myfoo6:thirteen state=0x564a2020b998 s->prefetch_data=0 2024-09-21T09:04:22.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.059+0000 7f64aef22800 20 prepare_atomic_modification: state is not atomic. state=0x564a2020b998 2024-09-21T09:04:22.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.059+0000 7f64aef22800 20 bucket index object: :.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9 2024-09-21T09:04:22.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.059+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:109 4.18 4:18bc876d:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2020d050 con 0x7f649c078070 2024-09-21T09:04:22.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.060+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 24 ==== osd_op_reply(109 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9 [stat,call,call] v31'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.060+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:110 3.1a 3:58a12cc7:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2020d050 con 0x564a20140e90 2024-09-21T09:04:22.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.061+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 35 ==== osd_op_reply(110 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9_thirteen [call] v31'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:111 4.18 4:18bc876d:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20194ae0 con 0x7f649c078070 2024-09-21T09:04:22.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aef22800 20 list_objects_ordered: starting attempt 1 2024-09-21T09:04:22.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aef22800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-21T09:04:22.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:112 4.12 4:4b65198a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a20196400 con 0x564a20140e90 2024-09-21T09:04:22.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:113 4.1 4:8120de49:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a20198d00 con 0x7f649c078070 2024-09-21T09:04:22.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:114 4.28 4:15728d93:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a20196400 con 0x564a20140e90 2024-09-21T09:04:22.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:115 4.1 4:82bf2666:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2019dca0 con 0x7f649c078070 2024-09-21T09:04:22.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:116 4.3 4:c0fa3be1:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a20196400 con 0x564a20140e90 2024-09-21T09:04:22.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:117 4.f 4:f2568a7a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201a2f30 con 0x564a20140e90 2024-09-21T09:04:22.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:118 4.11 4:88d7175f:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201a5a30 con 0x564a201457a0 2024-09-21T09:04:22.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:119 4.3b 4:dc8860e6:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201a8890 con 0x564a2014a330 2024-09-21T09:04:22.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:120 4.31 4:8c4a327e:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201ab220 con 0x564a20140e90 2024-09-21T09:04:22.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:121 4.18 4:18bc876d:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201ae0a0 con 0x7f649c078070 2024-09-21T09:04:22.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:122 4.5 4:a367e9ee:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201b0b10 con 0x564a2014a330 2024-09-21T09:04:22.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 36 ==== osd_op_reply(112 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 37 ==== osd_op_reply(114 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 38 ==== osd_op_reply(116 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 28 ==== osd_op_reply(119 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(118 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 39 ==== osd_op_reply(117 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.062+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 40 ==== osd_op_reply(120 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 25 ==== osd_op_reply(113 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 29 ==== osd_op_reply(122 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.10 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 26 ==== osd_op_reply(115 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 27 ==== osd_op_reply(111 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9 [stat,call,call] v31'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f638dffb640 20 handle_completion(): completion ok for obj=thirteen 2024-09-21T09:04:22.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 28 ==== osd_op_reply(121 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-21T09:04:22.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-21T09:04:22.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-21T09:04:22.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-21T09:04:22.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9])"; uploads.size()=0; is_truncated=0 2024-09-21T09:04:22.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:123 4.12 4:4b65198a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201a8240 con 0x564a20140e90 2024-09-21T09:04:22.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:124 4.1 4:8120de49:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201acd30 con 0x7f649c078070 2024-09-21T09:04:22.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:125 4.28 4:15728d93:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201ad610 con 0x564a20140e90 2024-09-21T09:04:22.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:126 4.1 4:82bf2666:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201adaa0 con 0x7f649c078070 2024-09-21T09:04:22.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:127 4.3 4:c0fa3be1:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201ae0a0 con 0x564a20140e90 2024-09-21T09:04:22.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:128 4.f 4:f2568a7a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201a8240 con 0x564a20140e90 2024-09-21T09:04:22.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:129 4.11 4:88d7175f:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201ad610 con 0x564a201457a0 2024-09-21T09:04:22.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:130 4.3b 4:dc8860e6:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201ae0a0 con 0x564a2014a330 2024-09-21T09:04:22.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:131 4.31 4:8c4a327e:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201a8240 con 0x564a20140e90 2024-09-21T09:04:22.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.063+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:132 4.18 4:18bc876d:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201a8240 con 0x7f649c078070 2024-09-21T09:04:22.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.064+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:133 4.5 4:a367e9ee:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201a8240 con 0x564a2014a330 2024-09-21T09:04:22.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.064+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 29 ==== osd_op_reply(124 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.064+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(129 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.064+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 30 ==== osd_op_reply(130 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.064+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 30 ==== osd_op_reply(132 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.064+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 31 ==== osd_op_reply(126 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.064+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 41 ==== osd_op_reply(123 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.064+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 42 ==== osd_op_reply(125 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.064+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 43 ==== osd_op_reply(127 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.064+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 44 ==== osd_op_reply(128 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.064+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 45 ==== osd_op_reply(131 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.064+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 31 ==== osd_op_reply(133 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.10 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f649c07f070 con 0x564a2014a330 2024-09-21T09:04:22.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.064+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201adaa0 con 0x564a20140e90 2024-09-21T09:04:22.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.065+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 46 ==== osd_op_reply(134 bud.buckets [call] v31'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.065+0000 7f64aef22800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-21T09:04:22.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.065+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.065+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201adaa0 con 0x564a20140e90 2024-09-21T09:04:22.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.065+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 47 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.065+0000 7f64aef22800 20 rados_obj.operate() r=0 bl.length=166 2024-09-21T09:04:22.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.065+0000 7f64aef22800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-21T09:04:22.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.065+0000 7f64aef22800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-21T09:04:22.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.066+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201ada80 con 0x564a20140e90 2024-09-21T09:04:22.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.066+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 48 ==== osd_op_reply(136 myfoo6 [call,call,delete] v31'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.066+0000 7f64aef22800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-21T09:04:22.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.066+0000 7f64aef22800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-21T09:04:22.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.066+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94876366199424 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201a5f30 con 0x7f649c078070 2024-09-21T09:04:22.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.067+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 32 ==== watch-notify(notify (1) cookie 94876365820656 notify 133143986202 ret 0) ==== 192+0+0 (crc 0 0 0) 0x564a2018f900 con 0x7f649c078070 2024-09-21T09:04:22.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.067+0000 7f638e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986202 cookie 94876365820656 notifier 4756 bl.length()=150 2024-09-21T09:04:22.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.067+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 33 ==== osd_op_reply(137 notify.3 [notify cookie 94876366199424 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.067+0000 7f638e7fc640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f6370003d60 con 0x7f649c078070 2024-09-21T09:04:22.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.067+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 34 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.067+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 35 ==== watch-notify(notify_complete (2) cookie 94876366199424 notify 133143986202 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564a2015e2c0 con 0x7f649c078070 2024-09-21T09:04:22.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.067+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:139 8.1b 8:d9f8a085:root::.bucket.meta.myfoo6%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201ada80 con 0x7f649c078070 2024-09-21T09:04:22.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.068+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 36 ==== osd_op_reply(139 .bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 [call,call,delete] v31'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.068+0000 7f64aef22800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 from cache 2024-09-21T09:04:22.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.068+0000 7f64aef22800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9, ofs0, ns] 2024-09-21T09:04:22.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.068+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94876366590160 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201ada80 con 0x7f649c078070 2024-09-21T09:04:22.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.068+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 37 ==== watch-notify(notify (1) cookie 94876365811776 notify 133143986203 ret 0) ==== 249+0+0 (crc 0 0 0) 0x564a2015e2c0 con 0x7f649c078070 2024-09-21T09:04:22.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.068+0000 7f638e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986203 cookie 94876365811776 notifier 4756 bl.length()=207 2024-09-21T09:04:22.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.068+0000 7f638e7fc640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f6370003d60 con 0x7f649c078070 2024-09-21T09:04:22.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.068+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 38 ==== osd_op_reply(140 notify.0 [notify cookie 94876366590160 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.069+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 39 ==== watch-notify(notify_complete (2) cookie 94876366590160 notify 133143986203 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564a20160710 con 0x7f649c078070 2024-09-21T09:04:22.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.069+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 40 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.069+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:142 4.12 4:4b65198a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201ada80 con 0x564a20140e90 2024-09-21T09:04:22.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.069+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:143 4.1 4:8120de49:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201a5f30 con 0x7f649c078070 2024-09-21T09:04:22.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.069+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:144 4.28 4:15728d93:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201a6780 con 0x564a20140e90 2024-09-21T09:04:22.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.069+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:145 4.1 4:82bf2666:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201a6ba0 con 0x7f649c078070 2024-09-21T09:04:22.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.069+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:146 4.3 4:c0fa3be1:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20195d50 con 0x564a20140e90 2024-09-21T09:04:22.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.069+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:147 4.f 4:f2568a7a:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201ada80 con 0x564a20140e90 2024-09-21T09:04:22.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.069+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:148 4.11 4:88d7175f:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201a6780 con 0x564a201457a0 2024-09-21T09:04:22.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.069+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:149 4.3b 4:dc8860e6:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20195d50 con 0x564a2014a330 2024-09-21T09:04:22.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.069+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:150 4.31 4:8c4a327e:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201ada80 con 0x564a20140e90 2024-09-21T09:04:22.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.069+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:151 4.18 4:18bc876d:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201a5f30 con 0x7f649c078070 2024-09-21T09:04:22.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.069+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:152 4.5 4:a367e9ee:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201a6780 con 0x564a2014a330 2024-09-21T09:04:22.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.071+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 32 ==== osd_op_reply(149 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.7 [delete] v31'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f649c0b1040 con 0x564a2014a330 2024-09-21T09:04:22.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.071+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 41 ==== osd_op_reply(151 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.9 [delete] v31'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.071+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(148 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.6 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.071+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 49 ==== osd_op_reply(146 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.4 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.071+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 50 ==== osd_op_reply(144 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.2 [delete] v31'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.071+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 42 ==== osd_op_reply(143 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.1 [delete] v31'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.071+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 51 ==== osd_op_reply(142 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.0 [delete] v31'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.071+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 43 ==== osd_op_reply(145 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.3 [delete] v31'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.071+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 33 ==== osd_op_reply(152 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.10 [delete] v31'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f649c0b1040 con 0x564a2014a330 2024-09-21T09:04:22.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.071+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 52 ==== osd_op_reply(147 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.5 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.072+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 53 ==== osd_op_reply(150 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9.8 [delete] v31'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.072+0000 7f64aef22800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 : miss 2024-09-21T09:04:22.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.072+0000 7f64aef22800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.072+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:153 6.f 6:f16605cb:::pubsub..bucket.myfoo6%2f5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a201ada80 con 0x7f649c078070 2024-09-21T09:04:22.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.072+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 44 ==== osd_op_reply(153 pubsub..bucket.myfoo6/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.072+0000 7f64aef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.072+0000 7f64aef22800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 info.flags=0x0 2024-09-21T09:04:22.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.072+0000 7f64aef22800 10 adding default.rgw.log++pubsub..bucket.myfoo6/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 to cache LRU end 2024-09-21T09:04:22.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.072+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:154 6.f 6:f16605cb:::pubsub..bucket.myfoo6%2f5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201ada80 con 0x7f649c078070 2024-09-21T09:04:22.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.073+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 45 ==== osd_op_reply(154 pubsub..bucket.myfoo6/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.9 [delete] v31'33 uv27 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.073+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201ada80 con 0x564a20140e90 2024-09-21T09:04:22.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.074+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 54 ==== osd_op_reply(155 bud.buckets [call] v31'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.074+0000 7f64aef22800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-21T09:04:22.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.074+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201ada80 con 0x564a20140e90 2024-09-21T09:04:22.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.075+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 55 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v31'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.075+0000 7f64aef22800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-21T09:04:22.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.075+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94876366590160 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a20190350 con 0x564a201457a0 2024-09-21T09:04:22.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.075+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== watch-notify(notify (1) cookie 94876365828272 notify 133143986212 ret 0) ==== 212+0+0 (crc 0 0 0) 0x564a2015f060 con 0x564a201457a0 2024-09-21T09:04:22.089 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.075+0000 7f638e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986212 cookie 94876365828272 notifier 4756 bl.length()=170 2024-09-21T09:04:22.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.075+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(157 notify.5 [notify cookie 94876366590160 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.075+0000 7f638e7fc640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f6370003d60 con 0x564a201457a0 2024-09-21T09:04:22.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.075+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.075+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 31 ==== watch-notify(notify_complete (2) cookie 94876366590160 notify 133143986212 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564a20135970 con 0x564a201457a0 2024-09-21T09:04:22.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.075+0000 7f64aef22800 10 removing email index: 2024-09-21T09:04:22.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.075+0000 7f64aef22800 10 removing user buckets index 2024-09-21T09:04:22.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.075+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201ada80 con 0x564a20140e90 2024-09-21T09:04:22.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.076+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 56 ==== osd_op_reply(159 bud.buckets [delete] v31'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.076+0000 7f64aef22800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-21T09:04:22.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.076+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94876366590160 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a20190350 con 0x564a201457a0 2024-09-21T09:04:22.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.077+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 32 ==== watch-notify(notify (1) cookie 94876365832896 notify 133143986213 ret 0) ==== 202+0+0 (crc 0 0 0) 0x564a20135970 con 0x564a201457a0 2024-09-21T09:04:22.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.077+0000 7f638dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986213 cookie 94876365832896 notifier 4756 bl.length()=160 2024-09-21T09:04:22.090 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.077+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 33 ==== osd_op_reply(160 notify.6 [notify cookie 94876366590160 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.077+0000 7f638dffb640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f62e00032c0 con 0x564a201457a0 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.077+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 34 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.077+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 35 ==== watch-notify(notify_complete (2) cookie 94876366590160 notify 133143986213 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564a201356e0 con 0x564a201457a0 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.077+0000 7f64aef22800 10 removing user index: bud 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.077+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a201ada80 con 0x7f649c078070 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.078+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 46 ==== osd_op_reply(162 bud [call,call,delete] v31'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.078+0000 7f64aef22800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.078+0000 7f64aef22800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.078+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94876366590160 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a2018deb0 con 0x564a201457a0 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.079+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 36 ==== watch-notify(notify (1) cookie 94876365828272 notify 133143986214 ret 0) ==== 194+0+0 (crc 0 0 0) 0x564a201356e0 con 0x564a201457a0 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.079+0000 7f638dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986214 cookie 94876365828272 notifier 4756 bl.length()=152 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.079+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 37 ==== osd_op_reply(163 notify.5 [notify cookie 94876366590160 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.079+0000 7f638dffb640 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f62e00032c0 con 0x564a201457a0 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.079+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 38 ==== watch-notify(notify_complete (2) cookie 94876366590160 notify 133143986214 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564a2012e7c0 con 0x564a201457a0 2024-09-21T09:04:22.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.079+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 39 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.080+0000 7f63617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:22.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.080+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94876365835072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20190350 con 0x564a20140e90 2024-09-21T09:04:22.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.081+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 57 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94876365835072] v31'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.081+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94876365811776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a20190350 con 0x7f649c078070 2024-09-21T09:04:22.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.081+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 47 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94876365811776] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.082+0000 7f64aef22800 20 remove_watcher() i=0 2024-09-21T09:04:22.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.082+0000 7f64aef22800 2 removed watcher, disabling cache 2024-09-21T09:04:22.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.082+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94876365815680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2014f040 con 0x564a20140e90 2024-09-21T09:04:22.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.083+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 58 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94876365815680] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.083+0000 7f64aef22800 20 remove_watcher() i=1 2024-09-21T09:04:22.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.083+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94876365818320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2014f040 con 0x564a2014a330 2024-09-21T09:04:22.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.084+0000 7f64aacac640 1 -- 172.21.15.178:0/2788317688 <== osd.3 v2:172.21.15.178:6808/24558189 34 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94876365818320] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649c0b1040 con 0x564a2014a330 2024-09-21T09:04:22.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.084+0000 7f64aef22800 20 remove_watcher() i=2 2024-09-21T09:04:22.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.084+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94876365820656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2014ff80 con 0x7f649c078070 2024-09-21T09:04:22.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.085+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.2 v2:172.21.15.178:6816/3267136144 48 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94876365820656] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649402a040 con 0x7f649c078070 2024-09-21T09:04:22.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.085+0000 7f64aef22800 20 remove_watcher() i=3 2024-09-21T09:04:22.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.085+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94876365823760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2014ff80 con 0x564a20140e90 2024-09-21T09:04:22.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.086+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 <== osd.1 v2:172.21.15.178:6800/627496675 59 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94876365823760] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f649402a040 con 0x564a20140e90 2024-09-21T09:04:22.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.086+0000 7f64aef22800 20 remove_watcher() i=4 2024-09-21T09:04:22.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.086+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94876365828272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2014ff80 con 0x564a201457a0 2024-09-21T09:04:22.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.087+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 40 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94876365828272] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.087+0000 7f64aef22800 20 remove_watcher() i=5 2024-09-21T09:04:22.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.087+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94876365832896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2014ff80 con 0x564a201457a0 2024-09-21T09:04:22.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.088+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 41 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94876365832896] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.088+0000 7f64aef22800 20 remove_watcher() i=6 2024-09-21T09:04:22.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.088+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94876365825776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564a2014ff80 con 0x564a201457a0 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64ab4ad640 1 -- 172.21.15.178:0/2788317688 <== osd.0 v2:172.21.15.44:6800/2732047064 42 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94876365825776] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a402a070 con 0x564a201457a0 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 20 remove_watcher() i=7 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564a201457a0 msgr2=0x564a20147bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564a201457a0 0x564a20147bd0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564a20140e90 msgr2=0x564a20143350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564a20140e90 0x564a20143350 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f649c078070 msgr2=0x7f649c08f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f649c078070 0x7f649c08f670 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564a2014a330 msgr2=0x564a2014c7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564a2014a330 0x564a2014c7f0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6374036aa0 msgr2=0x7f6374038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6374036aa0 0x7f6374038f60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x564a20112ca0 tx=0x7f649c091000 comp rx=0 tx=0).stop 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2012de80 msgr2=0x564a201351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64a3fff640 1 -- 172.21.15.178:0/2788317688 reap_dead start 2024-09-21T09:04:22.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2012de80 0x564a201351a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f64a403f040 tx=0x7f64a404cb30 comp rx=0 tx=0).stop 2024-09-21T09:04:22.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 shutdown_connections 2024-09-21T09:04:22.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 --2- 172.21.15.178:0/2788317688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2012de80 0x564a201351a0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.089+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 >> 172.21.15.178:0/2788317688 conn(0x564a2012a230 msgr2=0x564a20128300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:22.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 shutdown_connections 2024-09-21T09:04:22.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 -- 172.21.15.178:0/2788317688 wait complete. 2024-09-21T09:04:22.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 -- 172.21.15.178:0/829621257 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6384036b40 msgr2=0x7f6384039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 --2- 172.21.15.178:0/829621257 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6384036b40 0x7f6384039000 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x564a200fc0d0 tx=0x7f649c08f220 comp rx=0 tx=0).stop 2024-09-21T09:04:22.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 -- 172.21.15.178:0/829621257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a20121220 msgr2=0x564a20121640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 --2- 172.21.15.178:0/829621257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a20121220 0x564a20121640 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x564a200fc560 tx=0x7f64a4018830 comp rx=0 tx=0).stop 2024-09-21T09:04:22.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 -- 172.21.15.178:0/829621257 shutdown_connections 2024-09-21T09:04:22.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 --2- 172.21.15.178:0/829621257 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6384036b40 0x7f6384039000 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 --2- 172.21.15.178:0/829621257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a20121220 0x564a20121640 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 -- 172.21.15.178:0/829621257 >> 172.21.15.178:0/829621257 conn(0x564a201161b0 msgr2=0x564a20118d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 -- 172.21.15.178:0/829621257 shutdown_connections 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 -- 172.21.15.178:0/829621257 wait complete. 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564a2010fca0 msgr2=0x564a20112110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564a2010fca0 0x564a20112110 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564a2000ce20 msgr2=0x564a2010d4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564a2000ce20 0x564a2010d4e0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6390036b40 msgr2=0x7f6390039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6390036b40 0x7f6390039000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6494001e10 tx=0x7f6494001390 comp rx=0 tx=0).stop 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 msgr2=0x564a200fcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a200fcef0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f649c067040 tx=0x7f649c002fb0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 shutdown_connections 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564a2010fca0 0x564a20112110 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564a2000ce20 0x564a2010d4e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6390036b40 0x7f6390039000 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 --2- 172.21.15.178:0/976072598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a2000c4e0 0x564a200fcef0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.099 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.090+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 >> 172.21.15.178:0/976072598 conn(0x564a20007db0 msgr2=0x564a200f59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:22.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.091+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 shutdown_connections 2024-09-21T09:04:22.100 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.091+0000 7f64aef22800 1 -- 172.21.15.178:0/976072598 wait complete. 2024-09-21T09:04:22.102 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-21T09:04:22.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-21T09:04:22.102 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-21T09:04:22.147 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:04:22.148 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:04:22.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.147+0000 7f5ed160e800 1 Processor -- start 2024-09-21T09:04:22.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.147+0000 7f5ed160e800 1 -- start start 2024-09-21T09:04:22.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.147+0000 7f5ed160e800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x562d83357e10 0x562d833e7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.147+0000 7f5ed160e800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d832a3b30 con 0x562d833e7740 2024-09-21T09:04:22.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.147+0000 7f5ed160e800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x562d83285360 con 0x562d83357e10 2024-09-21T09:04:22.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.147+0000 7f5eccdc6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x562d83357e10 0x562d833e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.147+0000 7f5eccdc6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x562d83357e10 0x562d833e7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33900/0 (socket says 172.21.15.178:33900) 2024-09-21T09:04:22.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.147+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3794605368 learned_addr learned my addr 172.21.15.178:0/3794605368 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:22.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.147+0000 7f5ec7fff640 1 --1- 172.21.15.178:0/3794605368 >> v1:172.21.15.44:6789/0 conn(0x562d833e7740 0x562d833e9b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:32828/0 (socket says 172.21.15.178:32828) 2024-09-21T09:04:22.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.148+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3794605368 >> v1:172.21.15.44:6789/0 conn(0x562d833e7740 legacy=0x562d833e9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.148+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3794605368 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d832abe00 con 0x562d83357e10 2024-09-21T09:04:22.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.150+0000 7f5eccdc6640 1 --2- 172.21.15.178:0/3794605368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d833e7200 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000a520 tx=0x7f5ec0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e3fc7c561e1946 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.150+0000 7f5ec77fe640 1 -- 172.21.15.178:0/3794605368 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ec0055070 con 0x562d83357e10 2024-09-21T09:04:22.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.150+0000 7f5ec77fe640 1 -- 172.21.15.178:0/3794605368 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec00515b0 con 0x562d83357e10 2024-09-21T09:04:22.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.150+0000 7f5ec77fe640 1 -- 172.21.15.178:0/3794605368 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ec00518d0 con 0x562d83357e10 2024-09-21T09:04:22.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.150+0000 7f5ed160e800 1 -- 172.21.15.178:0/3794605368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 msgr2=0x562d833e7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.150+0000 7f5ed160e800 1 --2- 172.21.15.178:0/3794605368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d833e7200 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000a520 tx=0x7f5ec0045ba0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.150+0000 7f5ed160e800 1 -- 172.21.15.178:0/3794605368 shutdown_connections 2024-09-21T09:04:22.152 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.150+0000 7f5ed160e800 1 --2- 172.21.15.178:0/3794605368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d833e7200 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.150+0000 7f5ed160e800 1 -- 172.21.15.178:0/3794605368 >> 172.21.15.178:0/3794605368 conn(0x562d833dedd0 msgr2=0x562d833e11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:22.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.150+0000 7f5ed160e800 1 -- 172.21.15.178:0/3794605368 shutdown_connections 2024-09-21T09:04:22.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.150+0000 7f5ed160e800 1 -- 172.21.15.178:0/3794605368 wait complete. 2024-09-21T09:04:22.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.164+0000 7f5ed160e800 1 Processor -- start 2024-09-21T09:04:22.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.164+0000 7f5ed160e800 1 -- start start 2024-09-21T09:04:22.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.164+0000 7f5ed160e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d834d3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.164+0000 7f5ed160e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562d83330360 con 0x562d83357e10 2024-09-21T09:04:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.164+0000 7f5eccdc6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d834d3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.164+0000 7f5eccdc6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d834d3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33916/0 (socket says 172.21.15.178:33916) 2024-09-21T09:04:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.164+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3534328694 learned_addr learned my addr 172.21.15.178:0/3534328694 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.165+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3534328694 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d8327dbc0 con 0x562d83357e10 2024-09-21T09:04:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.165+0000 7f5eccdc6640 1 --2- 172.21.15.178:0/3534328694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d834d3880 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0025da0 tx=0x7f5ec0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736955e5c369451d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.165+0000 7f5dbae05640 1 -- 172.21.15.178:0/3534328694 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ec0051950 con 0x562d83357e10 2024-09-21T09:04:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.165+0000 7f5dbae05640 1 -- 172.21.15.178:0/3534328694 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec0051af0 con 0x562d83357e10 2024-09-21T09:04:22.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.165+0000 7f5dbae05640 1 -- 172.21.15.178:0/3534328694 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ec0051dd0 con 0x562d83357e10 2024-09-21T09:04:22.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.166+0000 7f5ed160e800 1 -- 172.21.15.178:0/3534328694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 msgr2=0x562d834d3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.166+0000 7f5ed160e800 1 --2- 172.21.15.178:0/3534328694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d834d3880 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0025da0 tx=0x7f5ec0051000 comp rx=0 tx=0).stop 2024-09-21T09:04:22.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.166+0000 7f5ed160e800 1 -- 172.21.15.178:0/3534328694 shutdown_connections 2024-09-21T09:04:22.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.166+0000 7f5ed160e800 1 --2- 172.21.15.178:0/3534328694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d834d3880 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.166+0000 7f5ed160e800 1 -- 172.21.15.178:0/3534328694 >> 172.21.15.178:0/3534328694 conn(0x562d833dedd0 msgr2=0x562d834cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:22.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.166+0000 7f5ed160e800 1 -- 172.21.15.178:0/3534328694 shutdown_connections 2024-09-21T09:04:22.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.166+0000 7f5ed160e800 1 -- 172.21.15.178:0/3534328694 wait complete. 2024-09-21T09:04:22.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.166+0000 7f5ed160e800 1 Processor -- start 2024-09-21T09:04:22.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.166+0000 7f5ed160e800 1 -- start start 2024-09-21T09:04:22.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.166+0000 7f5ed160e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d834db1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.166+0000 7f5ed160e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562d833eb610 con 0x562d83357e10 2024-09-21T09:04:22.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.167+0000 7f5eccdc6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d834db1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.167+0000 7f5eccdc6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d834db1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33926/0 (socket says 172.21.15.178:33926) 2024-09-21T09:04:22.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.167+0000 7f5eccdc6640 1 -- 172.21.15.178:0/2884941363 learned_addr learned my addr 172.21.15.178:0/2884941363 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:22.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.167+0000 7f5eccdc6640 1 -- 172.21.15.178:0/2884941363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d83291fe0 con 0x562d83357e10 2024-09-21T09:04:22.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.167+0000 7f5eccdc6640 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d834db1b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0067040 tx=0x7f5ec0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.167+0000 7f5db9602640 1 -- 172.21.15.178:0/2884941363 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ec0073070 con 0x562d83357e10 2024-09-21T09:04:22.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.167+0000 7f5db9602640 1 -- 172.21.15.178:0/2884941363 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec005a450 con 0x562d83357e10 2024-09-21T09:04:22.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.167+0000 7f5db9602640 1 -- 172.21.15.178:0/2884941363 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ec005a730 con 0x562d83357e10 2024-09-21T09:04:22.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.167+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d834db6f0 con 0x562d83357e10 2024-09-21T09:04:22.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.167+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d834dbc70 con 0x562d83357e10 2024-09-21T09:04:22.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.168+0000 7f5db9602640 1 -- 172.21.15.178:0/2884941363 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5ec0076070 con 0x562d83357e10 2024-09-21T09:04:22.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.168+0000 7f5db9602640 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5db4036b40 0x7f5db4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.168+0000 7f5db9602640 1 -- 172.21.15.178:0/2884941363 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f5ec0062070 con 0x562d83357e10 2024-09-21T09:04:22.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.168+0000 7f5ec7fff640 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5db4036b40 0x7f5db4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.168+0000 7f5ed160e800 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562d833e7740 0x562d834e2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.169+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d834e27a0 con 0x562d833e7740 2024-09-21T09:04:22.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.169+0000 7f5ecd5c7640 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562d833e7740 0x562d834e2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.169+0000 7f5ec7fff640 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5db4036b40 0x7f5db4039000 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8000f60 tx=0x7f5eb8001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.169+0000 7f5ecd5c7640 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562d833e7740 0x562d834e2220 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.169+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/2884941363 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ec800a4a0 con 0x562d833e7740 2024-09-21T09:04:22.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.169+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d834df7f0 con 0x562d833e7740 2024-09-21T09:04:22.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.169+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/2884941363 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5ec800a4a0 con 0x562d833e7740 2024-09-21T09:04:22.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.169+0000 7f5ed160e800 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562d834e4ad0 0x562d834e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.169+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d834e7560 con 0x562d834e4ad0 2024-09-21T09:04:22.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.170+0000 7f5eccdc6640 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562d834e4ad0 0x562d834e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.170+0000 7f5eccdc6640 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562d834e4ad0 0x562d834e6ec0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.170+0000 7f5eccdc6640 1 -- 172.21.15.178:0/2884941363 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5ec0075030 con 0x562d834e4ad0 2024-09-21T09:04:22.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.170+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d834e3970 con 0x562d833e7740 2024-09-21T09:04:22.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.171+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/2884941363 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5ec800a4a0 con 0x562d833e7740 2024-09-21T09:04:22.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.171+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d834e3e50 con 0x562d833e7740 2024-09-21T09:04:22.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.171+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/2884941363 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5ec800a4a0 con 0x562d833e7740 2024-09-21T09:04:22.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.171+0000 7f5ed160e800 1 Processor -- start 2024-09-21T09:04:22.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.171+0000 7f5ed160e800 1 -- start start 2024-09-21T09:04:22.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.171+0000 7f5ed160e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d833e4bb0 0x562d833e3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.171+0000 7f5ed160e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562d8327f580 con 0x562d833e4bb0 2024-09-21T09:04:22.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.172+0000 7f5ecd5c7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d833e4bb0 0x562d833e3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.172+0000 7f5ecd5c7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d833e4bb0 0x562d833e3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33942/0 (socket says 172.21.15.178:33942) 2024-09-21T09:04:22.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.172+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/2860958038 learned_addr learned my addr 172.21.15.178:0/2860958038 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:22.175 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.172+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/2860958038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d833e4fd0 con 0x562d833e4bb0 2024-09-21T09:04:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.172+0000 7f5ecd5c7640 1 --2- 172.21.15.178:0/2860958038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d833e4bb0 0x562d833e3200 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x562d834dc260 tx=0x7f5ec80188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.172+0000 7f5db27fc640 1 -- 172.21.15.178:0/2860958038 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ec8014450 con 0x562d833e4bb0 2024-09-21T09:04:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.172+0000 7f5db27fc640 1 -- 172.21.15.178:0/2860958038 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec80145f0 con 0x562d833e4bb0 2024-09-21T09:04:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.172+0000 7f5ed160e800 1 -- 172.21.15.178:0/2860958038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d833e3800 con 0x562d833e4bb0 2024-09-21T09:04:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.172+0000 7f5db27fc640 1 -- 172.21.15.178:0/2860958038 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ec80148d0 con 0x562d833e4bb0 2024-09-21T09:04:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.172+0000 7f5ed160e800 1 -- 172.21.15.178:0/2860958038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d833e3d00 con 0x562d833e4bb0 2024-09-21T09:04:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.173+0000 7f5db27fc640 1 -- 172.21.15.178:0/2860958038 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5ec8011040 con 0x562d833e4bb0 2024-09-21T09:04:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.173+0000 7f5db27fc640 1 --2- 172.21.15.178:0/2860958038 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5da4036b40 0x7f5da4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.173+0000 7f5db27fc640 1 -- 172.21.15.178:0/2860958038 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f5ec801e070 con 0x562d833e4bb0 2024-09-21T09:04:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.173+0000 7f5eccdc6640 1 --2- 172.21.15.178:0/2860958038 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5da4036b40 0x7f5da4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.180 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.174+0000 7f5ed160e800 1 Processor -- start 2024-09-21T09:04:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.174+0000 7f5ed160e800 1 -- start start 2024-09-21T09:04:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.174+0000 7f5eccdc6640 1 --2- 172.21.15.178:0/2860958038 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5da4036b40 0x7f5da4039000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x562d834e2bf0 tx=0x7f5ec006f7a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.174+0000 7f5ed160e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83504d50 0x562d83505150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.174+0000 7f5ed160e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562d834d3f70 con 0x562d83504d50 2024-09-21T09:04:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.174+0000 7f5ecd5c7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83504d50 0x562d83505150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.174+0000 7f5ecd5c7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83504d50 0x562d83505150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33948/0 (socket says 172.21.15.178:33948) 2024-09-21T09:04:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.174+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/1766614867 learned_addr learned my addr 172.21.15.178:0/1766614867 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.174+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/1766614867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d83505720 con 0x562d83504d50 2024-09-21T09:04:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.175+0000 7f5ecd5c7640 1 --2- 172.21.15.178:0/1766614867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83504d50 0x562d83505150 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5ec804cb80 tx=0x7f5ec803bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5def5735a0d13e90 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.175+0000 7f5da3fff640 1 -- 172.21.15.178:0/1766614867 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ec80168f0 con 0x562d83504d50 2024-09-21T09:04:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.175+0000 7f5da3fff640 1 -- 172.21.15.178:0/1766614867 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec8013c80 con 0x562d83504d50 2024-09-21T09:04:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.175+0000 7f5da3fff640 1 -- 172.21.15.178:0/1766614867 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ec8014a70 con 0x562d83504d50 2024-09-21T09:04:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.175+0000 7f5ed160e800 1 -- 172.21.15.178:0/1766614867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83504d50 msgr2=0x562d83505150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.181 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.175+0000 7f5ed160e800 1 --2- 172.21.15.178:0/1766614867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83504d50 0x562d83505150 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5ec804cb80 tx=0x7f5ec803bf60 comp rx=0 tx=0).stop 2024-09-21T09:04:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.175+0000 7f5ed160e800 1 -- 172.21.15.178:0/1766614867 shutdown_connections 2024-09-21T09:04:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.175+0000 7f5ed160e800 1 --2- 172.21.15.178:0/1766614867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83504d50 0x562d83505150 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.175+0000 7f5ed160e800 1 -- 172.21.15.178:0/1766614867 >> 172.21.15.178:0/1766614867 conn(0x562d83501100 msgr2=0x562d834ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.175+0000 7f5ed160e800 1 -- 172.21.15.178:0/1766614867 shutdown_connections 2024-09-21T09:04:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.175+0000 7f5ed160e800 1 -- 172.21.15.178:0/1766614867 wait complete. 2024-09-21T09:04:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.175+0000 7f5ed160e800 1 Processor -- start 2024-09-21T09:04:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.176+0000 7f5ed160e800 1 -- start start 2024-09-21T09:04:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.176+0000 7f5ed160e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83504d50 0x562d8350c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.176+0000 7f5ed160e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562d83505cf0 con 0x562d83504d50 2024-09-21T09:04:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.176+0000 7f5ecd5c7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83504d50 0x562d8350c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.176+0000 7f5ecd5c7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83504d50 0x562d8350c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33960/0 (socket says 172.21.15.178:33960) 2024-09-21T09:04:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.176+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 learned_addr learned my addr 172.21.15.178:0/3140506360 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:04:22.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.176+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d8350c6c0 con 0x562d83504d50 2024-09-21T09:04:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.176+0000 7f5ecd5c7640 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83504d50 0x562d8350c180 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5ec803e040 tx=0x7f5ec804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.176+0000 7f5da27fc640 1 -- 172.21.15.178:0/3140506360 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ec8044030 con 0x562d83504d50 2024-09-21T09:04:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.176+0000 7f5da27fc640 1 -- 172.21.15.178:0/3140506360 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec8013e30 con 0x562d83504d50 2024-09-21T09:04:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.177+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d8350c950 con 0x562d83504d50 2024-09-21T09:04:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.177+0000 7f5da27fc640 1 -- 172.21.15.178:0/3140506360 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ec8022a80 con 0x562d83504d50 2024-09-21T09:04:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.177+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d8350f600 con 0x562d83504d50 2024-09-21T09:04:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.177+0000 7f5da27fc640 1 -- 172.21.15.178:0/3140506360 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5ec8022c20 con 0x562d83504d50 2024-09-21T09:04:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.177+0000 7f5da27fc640 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5d98036b40 0x7f5d98039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.178+0000 7f5da27fc640 1 -- 172.21.15.178:0/3140506360 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f5ec8045070 con 0x562d83504d50 2024-09-21T09:04:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.178+0000 7f5eccdc6640 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5d98036b40 0x7f5d98039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.178+0000 7f5eccdc6640 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5d98036b40 0x7f5d98039000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5ec006fab0 tx=0x7f5ec0083000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.178+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.178+0000 7f5ed160e800 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562d83517e30 0x562d8351a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.178+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d8351aa40 con 0x562d83517e30 2024-09-21T09:04:22.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.178+0000 7f5ec7fff640 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562d83517e30 0x562d8351a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ec7fff640 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562d83517e30 0x562d8351a2f0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5eb800f610 con 0x562d83517e30 2024-09-21T09:04:22.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ed160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ed160e800 20 realm 2024-09-21T09:04:22.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83517280 con 0x562d83517e30 2024-09-21T09:04:22.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5eb800f610 con 0x562d83517e30 2024-09-21T09:04:22.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ed160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ed160e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:04:22.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d8351b530 con 0x562d83517e30 2024-09-21T09:04:22.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5eb800f610 con 0x562d83517e30 2024-09-21T09:04:22.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ed160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d8351be00 con 0x562d83517e30 2024-09-21T09:04:22.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5eb800f610 con 0x562d83517e30 2024-09-21T09:04:22.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ed160e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:22.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.179+0000 7f5ed160e800 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562d8351c820 0x562d8351ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.180+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d8351f300 con 0x562d8351c820 2024-09-21T09:04:22.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.180+0000 7f5ecd5c7640 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562d8351c820 0x562d8351ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.180+0000 7f5ecd5c7640 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562d8351c820 0x562d8351ec10 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.180+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.180+0000 7f5ed160e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:04:22.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.180+0000 7f5ed160e800 20 searching for the correct realm 2024-09-21T09:04:22.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.180+0000 7f5ed160e800 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562d835212d0 0x562d83523790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.180+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d835212d0 2024-09-21T09:04:22.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.180+0000 7f5eccdc6640 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562d835212d0 0x562d83523790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.181+0000 7f5eccdc6640 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562d835212d0 0x562d83523790 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.181+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec009f070 con 0x562d835212d0 2024-09-21T09:04:22.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.181+0000 7f5eccdc6640 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5ec0078070 0x7f5ec00813a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:04:22.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.181+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x7f5ec0078070 2024-09-21T09:04:22.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.181+0000 7f5ec7fff640 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5ec0078070 0x7f5ec00813a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:04:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.181+0000 7f5ec7fff640 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5ec0078070 0x7f5ec00813a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:04:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.182+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb800f610 con 0x7f5ec0078070 2024-09-21T09:04:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.182+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d8351c820 2024-09-21T09:04:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.182+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.182+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d83517e30 2024-09-21T09:04:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.182+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb800f610 con 0x562d83517e30 2024-09-21T09:04:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.182+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d83517e30 2024-09-21T09:04:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.182+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb802b040 con 0x562d83517e30 2024-09-21T09:04:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.182+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d8351c820 2024-09-21T09:04:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.183+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.183+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d8351c820 2024-09-21T09:04:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.183+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.183+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x7f5ec0078070 2024-09-21T09:04:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.183+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb802b040 con 0x7f5ec0078070 2024-09-21T09:04:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.183+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d835212d0 2024-09-21T09:04:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.183+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec009f070 con 0x562d835212d0 2024-09-21T09:04:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.183+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d83517e30 2024-09-21T09:04:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.184+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb802b040 con 0x562d83517e30 2024-09-21T09:04:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.184+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d8351c820 2024-09-21T09:04:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.184+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.184+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d83517e30 2024-09-21T09:04:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.184+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb802b040 con 0x562d83517e30 2024-09-21T09:04:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.184+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x7f5ec0078070 2024-09-21T09:04:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.184+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5eb802b040 con 0x7f5ec0078070 2024-09-21T09:04:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.184+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d835212d0 2024-09-21T09:04:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.184+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec009f070 con 0x562d835212d0 2024-09-21T09:04:22.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.184+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d835212d0 2024-09-21T09:04:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.185+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec009f070 con 0x562d835212d0 2024-09-21T09:04:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.185+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d8351c820 2024-09-21T09:04:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.185+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.185+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d835212d0 2024-09-21T09:04:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.185+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec009f070 con 0x562d835212d0 2024-09-21T09:04:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.185+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d835212d0 2024-09-21T09:04:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.185+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.185+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d83517e30 2024-09-21T09:04:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.186+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5eb802b040 con 0x562d83517e30 2024-09-21T09:04:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.186+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d83517e30 2024-09-21T09:04:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.186+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5eb802b040 con 0x562d83517e30 2024-09-21T09:04:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.186+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d8351c820 2024-09-21T09:04:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.186+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.186+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d835212d0 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.187+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.187+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x7f5ec0078070 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.187+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb802b040 con 0x7f5ec0078070 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.187+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d83517e30 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.187+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb802b040 con 0x562d83517e30 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.187+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d8351c820 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.187+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.187+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d835212d0 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.188+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.188+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x7f5ec0078070 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.188+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb802b040 con 0x7f5ec0078070 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.188+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x7f5ec0078070 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.188+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb802b040 con 0x7f5ec0078070 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.188+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d835212d0 2024-09-21T09:04:22.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.188+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.188+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d8351c820 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x562d83517e30 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5eb802b040 con 0x562d83517e30 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562d83523e60 con 0x7f5ec0078070 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb802b040 con 0x7f5ec0078070 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ed160e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ed160e800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ed160e800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ed160e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ed160e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ed160e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d8351fcf0 con 0x562d83517e30 2024-09-21T09:04:22.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ed160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83520590 con 0x562d83517e30 2024-09-21T09:04:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ed160e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:04:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.189+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d8351f930 con 0x562d83517e30 2024-09-21T09:04:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:04:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 20 zone default found 2024-09-21T09:04:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 4 Realm: () 2024-09-21T09:04:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:04:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:04:22.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 20 zonegroup default 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83524320 con 0x562d8351c820 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835265f0 con 0x562d835212d0 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.190+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83526990 con 0x562d835212d0 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.191+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.191+0000 7f5ed160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.191+0000 7f5ed160e800 20 started sync module instance, tier type = 2024-09-21T09:04:22.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.191+0000 7f5ed160e800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:04:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.191+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83525a80 con 0x7f5ec0078070 2024-09-21T09:04:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.192+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.192+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94753476730832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83525a80 con 0x7f5ec0078070 2024-09-21T09:04:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.192+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d835273c0 con 0x562d83517e30 2024-09-21T09:04:22.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.193+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94753476730832] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.193+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.193+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94753476735216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83525a80 con 0x562d83517e30 2024-09-21T09:04:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.193+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83527e10 con 0x562d835212d0 2024-09-21T09:04:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.194+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94753476735216] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.194+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.194+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94753476728272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d835259f0 con 0x562d835212d0 2024-09-21T09:04:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.194+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83528cd0 con 0x7f5ec0078070 2024-09-21T09:04:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.196+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.196+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94753476741632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83529430 con 0x7f5ec0078070 2024-09-21T09:04:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.196+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83529f50 con 0x562d83517e30 2024-09-21T09:04:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.196+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94753476728272] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.197+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94753476741632] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.197+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.197+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94753476745760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83529f10 con 0x562d83517e30 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.197+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d8352a7f0 con 0x562d8351c820 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.198+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.198+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94753476748096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83529f10 con 0x562d8351c820 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.198+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94753476745760] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.198+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d8352b720 con 0x562d8351c820 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.199+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94753476748096] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.199+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.199+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94753476751888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d8352ab90 con 0x562d8351c820 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.199+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d8352bd00 con 0x562d8351c820 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.200+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94753476751888] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.200+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.200+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94753476739584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d8352bd00 con 0x562d8351c820 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.200+0000 7f5ed160e800 20 add_watcher() i=0 2024-09-21T09:04:22.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.200+0000 7f5ed160e800 20 add_watcher() i=1 2024-09-21T09:04:22.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.200+0000 7f5ed160e800 20 add_watcher() i=2 2024-09-21T09:04:22.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.200+0000 7f5ed160e800 20 add_watcher() i=3 2024-09-21T09:04:22.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.200+0000 7f5ed160e800 20 add_watcher() i=4 2024-09-21T09:04:22.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.200+0000 7f5ed160e800 20 add_watcher() i=5 2024-09-21T09:04:22.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.200+0000 7f5ed160e800 20 add_watcher() i=6 2024-09-21T09:04:22.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.201+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94753476739584] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.201+0000 7f5ed160e800 20 add_watcher() i=7 2024-09-21T09:04:22.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.201+0000 7f5ed160e800 2 all 8 watchers are set, enabling cache 2024-09-21T09:04:22.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.201+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d8352efc0 con 0x562d83517e30 2024-09-21T09:04:22.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.201+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.201+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94753476753856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d8352c290 con 0x562d83517e30 2024-09-21T09:04:22.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.202+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94753476753856] v31'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.202+0000 7f5d82fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:22.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.202+0000 7f5ed160e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:04:22.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.202+0000 7f5ed160e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:04:22.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.203+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d8352e930 con 0x562d83517e30 2024-09-21T09:04:22.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.204+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.204+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d835381e0 con 0x562d8351c820 2024-09-21T09:04:22.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.205+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.205+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d835381e0 con 0x562d835212d0 2024-09-21T09:04:22.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.206+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.206+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83538ca0 con 0x562d83517e30 2024-09-21T09:04:22.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.207+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'224 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.207+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83537820 con 0x7f5ec0078070 2024-09-21T09:04:22.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.208+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.208+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d835377e0 con 0x562d835212d0 2024-09-21T09:04:22.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.209+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'49 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.209+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539590 con 0x562d83517e30 2024-09-21T09:04:22.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.210+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.210+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539590 con 0x562d8351c820 2024-09-21T09:04:22.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.211+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.211+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539620 con 0x7f5ec0078070 2024-09-21T09:04:22.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.212+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.212+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539620 con 0x562d835212d0 2024-09-21T09:04:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.213+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.213+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d835396b0 con 0x7f5ec0078070 2024-09-21T09:04:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.214+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.214+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d835396b0 con 0x562d8351c820 2024-09-21T09:04:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.216+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.216+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x7f5ec0078070 2024-09-21T09:04:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.217+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.217+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d8351c820 2024-09-21T09:04:22.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.218+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.218+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d83517e30 2024-09-21T09:04:22.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.219+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'225 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.219+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d835212d0 2024-09-21T09:04:22.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.221+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'65 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.221+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x7f5ec0078070 2024-09-21T09:04:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.222+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.222+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d835212d0 2024-09-21T09:04:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.223+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.223+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d83517e30 2024-09-21T09:04:22.225 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.224+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.224+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d83517e30 2024-09-21T09:04:22.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.225+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'226 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.225+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d835212d0 2024-09-21T09:04:22.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.226+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'66 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.226+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x7f5ec0078070 2024-09-21T09:04:22.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.227+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.228 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.227+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d835212d0 2024-09-21T09:04:22.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.228+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.229 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.228+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d835212d0 2024-09-21T09:04:22.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.229+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.230 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.229+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d835212d0 2024-09-21T09:04:22.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.230+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.230+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d835212d0 2024-09-21T09:04:22.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.231+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'50 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.232 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.231+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d8351c820 2024-09-21T09:04:22.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.232+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.233 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.232+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d835212d0 2024-09-21T09:04:22.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.233+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.234 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.233+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d8351c820 2024-09-21T09:04:22.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.234+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.234+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d835212d0 2024-09-21T09:04:22.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.235+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'67 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.235+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x562d8351c820 2024-09-21T09:04:22.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.236+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.236+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83539bb0 con 0x7f5ec0078070 2024-09-21T09:04:22.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.237+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.237+0000 7f5d81fe3640 20 reqs_thread_entry: start 2024-09-21T09:04:22.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.237+0000 7f5ed160e800 20 init_complete bucket index max shards: 11 2024-09-21T09:04:22.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.237+0000 7f5ed160e800 20 Filter name: none 2024-09-21T09:04:22.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.237+0000 7f5cf37fe640 20 reqs_thread_entry: start 2024-09-21T09:04:22.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.237+0000 7f5ed160e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T09:04:22.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.237+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.237+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835648a0 con 0x562d8351c820 2024-09-21T09:04:22.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.238+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.238+0000 7f5ed160e800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T09:04:22.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.238+0000 7f5ed160e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-21T09:04:22.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.238+0000 7f5ed160e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T09:04:22.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.238+0000 7f5ed160e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:04:22.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.238+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83567270 con 0x562d8351c820 2024-09-21T09:04:22.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.238+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.238+0000 7f5ed160e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10 : miss 2024-09-21T09:04:22.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.238+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.238+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:96 8.13 8:ce41120f:root::.bucket.meta.myfoo7%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835670f0 con 0x562d8351c820 2024-09-21T09:04:22.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.239+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv10 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.241 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.239+0000 7f5ed160e800 20 rados_obj.operate() r=0 bl.length=382 2024-09-21T09:04:22.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.239+0000 7f5ed160e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10 info.flags=0x17 2024-09-21T09:04:22.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.239+0000 7f5ed160e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10 to cache LRU end 2024-09-21T09:04:22.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.239+0000 7f5ed160e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:04:22.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.239+0000 7f5ed160e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:04:22.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.239+0000 7f5ed160e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10 2024-09-21T09:04:22.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.239+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:97 4.1b 4:d9b120f8:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835e4640 con 0x7f5ec0078070 2024-09-21T09:04:22.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.239+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(97 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.239+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:98 4.3d 4:bd764754:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835e4640 con 0x562d835212d0 2024-09-21T09:04:22.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.240+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(98 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.1 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.240+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:99 4.30 4:0eaec862:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835e4640 con 0x562d835212d0 2024-09-21T09:04:22.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.240+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 27 ==== osd_op_reply(99 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.2 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.240+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:100 4.12 4:4a7c4994:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835e4640 con 0x562d83517e30 2024-09-21T09:04:22.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.240+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(100 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.240+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:101 4.2e 4:76466727:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835e4640 con 0x562d835212d0 2024-09-21T09:04:22.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.241+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 28 ==== osd_op_reply(101 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.241+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:102 4.1a 4:586f9d6b:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835e45c0 con 0x7f5ec0078070 2024-09-21T09:04:22.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.241+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(102 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.5 [call out=378b] v0'0 uv5 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.241+0000 7f5ed160e800 10 cls_bucket_list_unordered: got fourteen 2024-09-21T09:04:22.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.241+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:103 4.26 4:66e8de2c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835e4600 con 0x562d8351c820 2024-09-21T09:04:22.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.242+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(103 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.242+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:104 4.22 4:46307be9:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835e4600 con 0x562d83517e30 2024-09-21T09:04:22.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.242+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(104 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.242+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:105 4.1b 4:d8aebb33:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835e4600 con 0x7f5ec0078070 2024-09-21T09:04:22.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.242+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 21 ==== osd_op_reply(105 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.242+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:106 4.17 4:e8ad44c7:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835e4600 con 0x562d8351c820 2024-09-21T09:04:22.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.243+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(106 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.243+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:107 4.30 4:0f917e2f:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835e4600 con 0x562d835212d0 2024-09-21T09:04:22.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.243+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 29 ==== osd_op_reply(107 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.10 [call out=85b] v0'0 uv8 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.243+0000 7f5ed160e800 20 get_obj_state: octx=0x562d83505150 obj=myfoo7:fourteen state=0x562d835e26e8 s->prefetch_data=0 2024-09-21T09:04:22.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.243+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:108 3.36 3:6f9a85a0:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835e3510 con 0x7f5ec0078070 2024-09-21T09:04:22.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.243+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 22 ==== osd_op_reply(108 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.243+0000 7f5ed160e800 10 manifest: total_size = 8 2024-09-21T09:04:22.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.243+0000 7f5ed160e800 20 get_obj_state: setting s->obj_tag to 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10611542129829590958 2024-09-21T09:04:22.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.243+0000 7f5ed160e800 20 get_obj_state: octx=0x562d83505150 obj=myfoo7:fourteen state=0x562d835e26e8 s->prefetch_data=0 2024-09-21T09:04:22.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.243+0000 7f5ed160e800 20 prepare_atomic_modification: state is not atomic. state=0x562d835e26e8 2024-09-21T09:04:22.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.243+0000 7f5ed160e800 20 bucket index object: :.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.5 2024-09-21T09:04:22.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.243+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:109 4.1a 4:586f9d6b:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d835e3da0 con 0x7f5ec0078070 2024-09-21T09:04:22.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.245+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 23 ==== osd_op_reply(109 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.5 [stat,call,call] v31'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.245+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:110 3.36 3:6f9a85a0:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d835e3da0 con 0x7f5ec0078070 2024-09-21T09:04:22.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 24 ==== osd_op_reply(110 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10_fourteen [call] v31'4 uv4 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:111 4.1a 4:586f9d6b:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d8356bca0 con 0x7f5ec0078070 2024-09-21T09:04:22.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ed160e800 20 list_objects_ordered: starting attempt 1 2024-09-21T09:04:22.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ed160e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-21T09:04:22.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:112 4.1b 4:d9b120f8:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d8356bca0 con 0x7f5ec0078070 2024-09-21T09:04:22.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:113 4.3d 4:bd764754:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d8356ff00 con 0x562d835212d0 2024-09-21T09:04:22.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:114 4.30 4:0eaec862:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d8356bca0 con 0x562d835212d0 2024-09-21T09:04:22.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:115 4.12 4:4a7c4994:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83574d30 con 0x562d83517e30 2024-09-21T09:04:22.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:116 4.2e 4:76466727:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d8356bca0 con 0x562d835212d0 2024-09-21T09:04:22.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 30 ==== osd_op_reply(113 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.1 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:117 4.1a 4:586f9d6b:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83579b90 con 0x7f5ec0078070 2024-09-21T09:04:22.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:118 4.26 4:66e8de2c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d8357a4e0 con 0x562d8351c820 2024-09-21T09:04:22.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 31 ==== osd_op_reply(114 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.2 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(115 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 32 ==== osd_op_reply(116 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:119 4.22 4:46307be9:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83570390 con 0x562d83517e30 2024-09-21T09:04:22.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:120 4.1b 4:d8aebb33:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83572c60 con 0x7f5ec0078070 2024-09-21T09:04:22.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:121 4.17 4:e8ad44c7:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d835746c0 con 0x562d8351c820 2024-09-21T09:04:22.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.246+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:122 4.30 4:0f917e2f:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d8357d960 con 0x562d835212d0 2024-09-21T09:04:22.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 25 ==== osd_op_reply(112 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(118 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(119 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== osd_op_reply(121 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec802a070 con 0x562d8351c820 2024-09-21T09:04:22.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 33 ==== osd_op_reply(122 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.10 [call out=85b] v0'0 uv8 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 26 ==== osd_op_reply(120 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 27 ==== osd_op_reply(111 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.5 [stat,call,call] v31'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5da3fff640 20 handle_completion(): completion ok for obj=fourteen 2024-09-21T09:04:22.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 28 ==== osd_op_reply(117 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ed160e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-21T09:04:22.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ed160e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-21T09:04:22.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ed160e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-21T09:04:22.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ed160e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ed160e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10])"; uploads.size()=0; is_truncated=0 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:123 4.1b 4:d9b120f8:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d8357a030 con 0x7f5ec0078070 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:124 4.3d 4:bd764754:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83574100 con 0x562d835212d0 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:125 4.30 4:0eaec862:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83571780 con 0x562d835212d0 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:126 4.12 4:4a7c4994:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83572ba0 con 0x562d83517e30 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:127 4.2e 4:76466727:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83574100 con 0x562d835212d0 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:128 4.1a 4:586f9d6b:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83571780 con 0x7f5ec0078070 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.247+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:129 4.26 4:66e8de2c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83574100 con 0x562d8351c820 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:130 4.22 4:46307be9:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83571780 con 0x562d83517e30 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:131 4.1b 4:d8aebb33:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83579230 con 0x7f5ec0078070 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 29 ==== osd_op_reply(123 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 34 ==== osd_op_reply(125 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.2 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 35 ==== osd_op_reply(124 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.1 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:132 4.17 4:e8ad44c7:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83574100 con 0x562d8351c820 2024-09-21T09:04:22.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 36 ==== osd_op_reply(127 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:133 4.30 4:0f917e2f:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83574ae0 con 0x562d835212d0 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 30 ==== osd_op_reply(128 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(126 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 31 ==== osd_op_reply(129 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== osd_op_reply(130 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 32 ==== osd_op_reply(132 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 37 ==== osd_op_reply(133 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.10 [call out=85b] v0'0 uv8 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 31 ==== osd_op_reply(131 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.248+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83571780 con 0x562d8351c820 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.249+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 33 ==== osd_op_reply(134 fud.buckets [call] v31'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.249+0000 7f5ed160e800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.249+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.249+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83574ae0 con 0x7f5ec0078070 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.250+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 32 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv46 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.250+0000 7f5ed160e800 20 rados_obj.operate() r=0 bl.length=168 2024-09-21T09:04:22.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.250+0000 7f5ed160e800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-21T09:04:22.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.250+0000 7f5ed160e800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-21T09:04:22.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.250+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83571780 con 0x7f5ec0078070 2024-09-21T09:04:22.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.252+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 33 ==== osd_op_reply(136 myfoo7 [call,call,delete] v31'47 uv47 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.252+0000 7f5ed160e800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-21T09:04:22.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.252+0000 7f5ed160e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-21T09:04:22.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.252+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94753477074960 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83571780 con 0x7f5ec0078070 2024-09-21T09:04:22.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.252+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 34 ==== watch-notify(notify (1) cookie 94753476741632 notify 133143986204 ret 0) ==== 192+0+0 (crc 0 0 0) 0x562d83539880 con 0x7f5ec0078070 2024-09-21T09:04:22.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.252+0000 7f5da37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986204 cookie 94753476741632 notifier 4763 bl.length()=150 2024-09-21T09:04:22.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.252+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 35 ==== osd_op_reply(137 notify.3 [notify cookie 94753477074960 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.253+0000 7f5da37fe640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5d000032c0 con 0x7f5ec0078070 2024-09-21T09:04:22.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.253+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 36 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.253+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 37 ==== watch-notify(notify_complete (2) cookie 94753477074960 notify 133143986204 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d8352e2a0 con 0x7f5ec0078070 2024-09-21T09:04:22.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.253+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:139 8.13 8:ce41120f:root::.bucket.meta.myfoo7%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83571780 con 0x562d8351c820 2024-09-21T09:04:22.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.254+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 34 ==== osd_op_reply(139 .bucket.meta.myfoo7:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10 [call,call,delete] v31'11 uv11 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.254+0000 7f5ed160e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10 from cache 2024-09-21T09:04:22.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.254+0000 7f5ed160e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10, ofs0, ns] 2024-09-21T09:04:22.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.254+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94753477074960 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83574aa0 con 0x562d83517e30 2024-09-21T09:04:22.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.254+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== watch-notify(notify (1) cookie 94753476735216 notify 133143986197 ret 0) ==== 250+0+0 (crc 0 0 0) 0x562d8352e2a0 con 0x562d83517e30 2024-09-21T09:04:22.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.254+0000 7f5da37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986197 cookie 94753476735216 notifier 4763 bl.length()=208 2024-09-21T09:04:22.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.254+0000 7f5da37fe640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5d000032c0 con 0x562d83517e30 2024-09-21T09:04:22.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.254+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 35 ==== osd_op_reply(140 notify.1 [notify cookie 94753477074960 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.255+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 36 ==== watch-notify(notify_complete (2) cookie 94753477074960 notify 133143986197 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d8352ecd0 con 0x562d83517e30 2024-09-21T09:04:22.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.255+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 37 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.255+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:142 4.1b 4:d9b120f8:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83574aa0 con 0x7f5ec0078070 2024-09-21T09:04:22.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.255+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:143 4.3d 4:bd764754:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83565400 con 0x562d835212d0 2024-09-21T09:04:22.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.255+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:144 4.30 4:0eaec862:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83565c50 con 0x562d835212d0 2024-09-21T09:04:22.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.255+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:145 4.12 4:4a7c4994:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83566030 con 0x562d83517e30 2024-09-21T09:04:22.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.255+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:146 4.2e 4:76466727:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83565400 con 0x562d835212d0 2024-09-21T09:04:22.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.255+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:147 4.1a 4:586f9d6b:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83565c50 con 0x7f5ec0078070 2024-09-21T09:04:22.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.255+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:148 4.26 4:66e8de2c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83565400 con 0x562d8351c820 2024-09-21T09:04:22.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.255+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:149 4.22 4:46307be9:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83565400 con 0x562d83517e30 2024-09-21T09:04:22.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.255+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:150 4.1b 4:d8aebb33:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83566030 con 0x7f5ec0078070 2024-09-21T09:04:22.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.255+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:151 4.17 4:e8ad44c7:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83574aa0 con 0x562d8351c820 2024-09-21T09:04:22.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.255+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:152 4.30 4:0f917e2f:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d835735a0 con 0x562d835212d0 2024-09-21T09:04:22.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.256+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 35 ==== osd_op_reply(151 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.9 [delete] v31'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.256+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 38 ==== osd_op_reply(142 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.0 [delete] v31'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 38 ==== osd_op_reply(145 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.3 [delete] v31'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 38 ==== osd_op_reply(143 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.1 [delete] v31'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 39 ==== osd_op_reply(147 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.5 [delete] v31'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 36 ==== osd_op_reply(148 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.6 [delete] v31'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 39 ==== osd_op_reply(144 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.2 [delete] v31'9 uv9 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 40 ==== osd_op_reply(146 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.4 [delete] v31'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 39 ==== osd_op_reply(149 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.7 [delete] v31'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 40 ==== osd_op_reply(150 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.8 [delete] v31'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 41 ==== osd_op_reply(152 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10.10 [delete] v31'10 uv10 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5ed160e800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10 : miss 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5ed160e800 20 rados->read ofs=0 len=0 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:153 6.1e 6:79f1ffe7:::pubsub..bucket.myfoo7%2f5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83570370 con 0x562d835212d0 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 42 ==== osd_op_reply(153 pubsub..bucket.myfoo7/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5ed160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5ed160e800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10 info.flags=0x0 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5ed160e800 10 adding default.rgw.log++pubsub..bucket.myfoo7/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10 to cache LRU end 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.257+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:154 6.1e 6:79f1ffe7:::pubsub..bucket.myfoo7%2f5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83570370 con 0x562d835212d0 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.258+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 43 ==== osd_op_reply(154 pubsub..bucket.myfoo7/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.10 [delete] v31'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.258+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83570370 con 0x562d8351c820 2024-09-21T09:04:22.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.260+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 37 ==== osd_op_reply(155 fud.buckets [call] v31'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.260+0000 7f5ed160e800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-21T09:04:22.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.260+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83570370 con 0x562d8351c820 2024-09-21T09:04:22.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.261+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 38 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v31'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.261+0000 7f5ed160e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T09:04:22.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.261+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94753477074960 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83570370 con 0x562d835212d0 2024-09-21T09:04:22.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.261+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 44 ==== watch-notify(notify (1) cookie 94753476728272 notify 133143986183 ret 0) ==== 212+0+0 (crc 0 0 0) 0x562d835396b0 con 0x562d835212d0 2024-09-21T09:04:22.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.261+0000 7f5da37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 94753476728272 notifier 4763 bl.length()=170 2024-09-21T09:04:22.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.261+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 45 ==== osd_op_reply(157 notify.2 [notify cookie 94753477074960 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.261+0000 7f5da37fe640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5d000032a0 con 0x562d835212d0 2024-09-21T09:04:22.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.261+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 46 ==== watch-notify(notify_complete (2) cookie 94753477074960 notify 133143986183 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d8350f600 con 0x562d835212d0 2024-09-21T09:04:22.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.261+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 47 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.261+0000 7f5ed160e800 10 removing email index: 2024-09-21T09:04:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.261+0000 7f5ed160e800 10 removing user buckets index 2024-09-21T09:04:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.261+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83570320 con 0x562d8351c820 2024-09-21T09:04:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.262+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 39 ==== osd_op_reply(159 fud.buckets [delete] v31'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.262+0000 7f5ed160e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-21T09:04:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.262+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94753477074960 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83570320 con 0x562d8351c820 2024-09-21T09:04:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.263+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 40 ==== watch-notify(notify (1) cookie 94753476751888 notify 133143986215 ret 0) ==== 202+0+0 (crc 0 0 0) 0x562d83566610 con 0x562d8351c820 2024-09-21T09:04:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.263+0000 7f5da3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986215 cookie 94753476751888 notifier 4763 bl.length()=160 2024-09-21T09:04:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.263+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 41 ==== osd_op_reply(160 notify.6 [notify cookie 94753477074960 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.263+0000 7f5da3fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5d90003d60 con 0x562d8351c820 2024-09-21T09:04:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.263+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 42 ==== watch-notify(notify_complete (2) cookie 94753477074960 notify 133143986215 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d8350c950 con 0x562d8351c820 2024-09-21T09:04:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.263+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 43 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.263+0000 7f5ed160e800 10 removing user index: fud 2024-09-21T09:04:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.263+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83570320 con 0x562d8351c820 2024-09-21T09:04:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.265+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 44 ==== osd_op_reply(162 fud [call,call,delete] v31'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.265+0000 7f5ed160e800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-21T09:04:22.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.265+0000 7f5ed160e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-21T09:04:22.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.265+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94753477074960 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562d83570320 con 0x562d8351c820 2024-09-21T09:04:22.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.265+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 45 ==== watch-notify(notify (1) cookie 94753476748096 notify 133143986216 ret 0) ==== 194+0+0 (crc 0 0 0) 0x562d8350c950 con 0x562d8351c820 2024-09-21T09:04:22.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.265+0000 7f5da3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986216 cookie 94753476748096 notifier 4763 bl.length()=152 2024-09-21T09:04:22.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.265+0000 7f5da3fff640 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5d90003d60 con 0x562d8351c820 2024-09-21T09:04:22.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.265+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 46 ==== osd_op_reply(163 notify.5 [notify cookie 94753477074960 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.265+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 47 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.265+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 48 ==== watch-notify(notify_complete (2) cookie 94753477074960 notify 133143986216 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d8350c6c0 con 0x562d8351c820 2024-09-21T09:04:22.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.266+0000 7f5d82fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:04:22.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.266+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94753476753856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83533ba0 con 0x562d83517e30 2024-09-21T09:04:22.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.267+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 40 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94753476753856] v31'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.267+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94753476730832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83533ba0 con 0x7f5ec0078070 2024-09-21T09:04:22.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.268+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 41 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94753476730832] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.268+0000 7f5ed160e800 20 remove_watcher() i=0 2024-09-21T09:04:22.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.268+0000 7f5ed160e800 2 removed watcher, disabling cache 2024-09-21T09:04:22.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.268+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94753476735216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83533ba0 con 0x562d83517e30 2024-09-21T09:04:22.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.269+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 41 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94753476735216] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.269+0000 7f5ed160e800 20 remove_watcher() i=1 2024-09-21T09:04:22.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.269+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94753476728272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83533ba0 con 0x562d835212d0 2024-09-21T09:04:22.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.270+0000 7f5eccdc6640 1 -- 172.21.15.178:0/3140506360 <== osd.3 v2:172.21.15.178:6808/24558189 48 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94753476728272] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec00b3040 con 0x562d835212d0 2024-09-21T09:04:22.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.270+0000 7f5ed160e800 20 remove_watcher() i=2 2024-09-21T09:04:22.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.270+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94753476741632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83533ba0 con 0x7f5ec0078070 2024-09-21T09:04:22.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.271+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.2 v2:172.21.15.178:6816/3267136144 42 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94753476741632] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x7f5ec0078070 2024-09-21T09:04:22.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.271+0000 7f5ed160e800 20 remove_watcher() i=3 2024-09-21T09:04:22.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.271+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94753476745760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83533ba0 con 0x562d83517e30 2024-09-21T09:04:22.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.272+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 <== osd.1 v2:172.21.15.178:6800/627496675 42 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94753476745760] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb803f040 con 0x562d83517e30 2024-09-21T09:04:22.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.272+0000 7f5ed160e800 20 remove_watcher() i=4 2024-09-21T09:04:22.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.272+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94753476748096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83533ba0 con 0x562d8351c820 2024-09-21T09:04:22.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.273+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 49 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94753476748096] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.273+0000 7f5ed160e800 20 remove_watcher() i=5 2024-09-21T09:04:22.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.273+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94753476751888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83533ba0 con 0x562d8351c820 2024-09-21T09:04:22.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.274+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 50 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94753476751888] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.274+0000 7f5ed160e800 20 remove_watcher() i=6 2024-09-21T09:04:22.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.274+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94753476739584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562d83533ba0 con 0x562d8351c820 2024-09-21T09:04:22.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.275+0000 7f5ecd5c7640 1 -- 172.21.15.178:0/3140506360 <== osd.0 v2:172.21.15.44:6800/2732047064 51 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94753476739584] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ec8078060 con 0x562d8351c820 2024-09-21T09:04:22.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.275+0000 7f5ed160e800 20 remove_watcher() i=7 2024-09-21T09:04:22.279 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562d8351c820 msgr2=0x562d8351ec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562d8351c820 0x562d8351ec10 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562d83517e30 msgr2=0x562d8351a2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562d83517e30 0x562d8351a2f0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5ec0078070 msgr2=0x7f5ec00813a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5ec0078070 0x7f5ec00813a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562d835212d0 msgr2=0x562d83523790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562d835212d0 0x562d83523790 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5d98036b40 msgr2=0x7f5d98039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5d98036b40 0x7f5d98039000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5ec006fab0 tx=0x7f5ec0083000 comp rx=0 tx=0).stop 2024-09-21T09:04:22.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83504d50 msgr2=0x562d8350c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ec7fff640 1 -- 172.21.15.178:0/3140506360 reap_dead start 2024-09-21T09:04:22.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83504d50 0x562d8350c180 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5ec803e040 tx=0x7f5ec804cb10 comp rx=0 tx=0).stop 2024-09-21T09:04:22.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 shutdown_connections 2024-09-21T09:04:22.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 --2- 172.21.15.178:0/3140506360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83504d50 0x562d8350c180 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 >> 172.21.15.178:0/3140506360 conn(0x562d83501100 msgr2=0x562d83506460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 shutdown_connections 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/3140506360 wait complete. 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/2860958038 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5da4036b40 msgr2=0x7f5da4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 --2- 172.21.15.178:0/2860958038 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5da4036b40 0x7f5da4039000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x562d834e2bf0 tx=0x7f5ec006f7a0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/2860958038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d833e4bb0 msgr2=0x562d833e3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 --2- 172.21.15.178:0/2860958038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d833e4bb0 0x562d833e3200 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x562d834dc260 tx=0x7f5ec80188f0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/2860958038 shutdown_connections 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 --2- 172.21.15.178:0/2860958038 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5da4036b40 0x7f5da4039000 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 --2- 172.21.15.178:0/2860958038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d833e4bb0 0x562d833e3200 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/2860958038 >> 172.21.15.178:0/2860958038 conn(0x562d834eae40 msgr2=0x562d834ed9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/2860958038 shutdown_connections 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.276+0000 7f5ed160e800 1 -- 172.21.15.178:0/2860958038 wait complete. 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562d834e4ad0 msgr2=0x562d834e6ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562d834e4ad0 0x562d834e6ec0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562d833e7740 msgr2=0x562d834e2220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562d833e7740 0x562d834e2220 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5db4036b40 msgr2=0x7f5db4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5db4036b40 0x7f5db4039000 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8000f60 tx=0x7f5eb8001370 comp rx=0 tx=0).stop 2024-09-21T09:04:22.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 msgr2=0x562d834db1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:04:22.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d834db1b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0067040 tx=0x7f5ec0002fb0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 shutdown_connections 2024-09-21T09:04:22.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562d834e4ad0 0x562d834e6ec0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562d833e7740 0x562d834e2220 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5db4036b40 0x7f5db4039000 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 --2- 172.21.15.178:0/2884941363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562d83357e10 0x562d834db1b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:04:22.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 >> 172.21.15.178:0/2884941363 conn(0x562d833dedd0 msgr2=0x562d834cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:04:22.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 shutdown_connections 2024-09-21T09:04:22.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:04:22.277+0000 7f5ed160e800 1 -- 172.21.15.178:0/2884941363 wait complete. 2024-09-21T09:05:02.288 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-21T09:05:02.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-21T09:05:02.289 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-21T09:05:02.340 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:02.340 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:02.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.340+0000 7f01b3810800 1 Processor -- start 2024-09-21T09:05:02.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.340+0000 7f01b3810800 1 -- start start 2024-09-21T09:05:02.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.340+0000 7f01b3810800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5564bc935990 0x5564bc937d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.340+0000 7f01b3810800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5564bc7f1b30 con 0x5564bc931550 2024-09-21T09:05:02.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.340+0000 7f01b3810800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5564bc7d3360 con 0x5564bc935990 2024-09-21T09:05:02.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.340+0000 7f01a66c0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5564bc935990 0x5564bc937d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.340+0000 7f01a66c0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5564bc935990 0x5564bc937d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:59998/0 (socket says 172.21.15.178:59998) 2024-09-21T09:05:02.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.340+0000 7f01a66c0640 1 -- 172.21.15.178:0/1649576936 learned_addr learned my addr 172.21.15.178:0/1649576936 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.341+0000 7f01a66c0640 1 -- 172.21.15.178:0/1649576936 >> v1:172.21.15.44:6789/0 conn(0x5564bc931550 legacy=0x5564bc931950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.341+0000 7f01a66c0640 1 -- 172.21.15.178:0/1649576936 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564bc7f9e00 con 0x5564bc935990 2024-09-21T09:05:02.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.342+0000 7f01a66c0640 1 --2- 172.21.15.178:0/1649576936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc935990 0x5564bc937d80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f019800a6b0 tx=0x7f0198047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eba5ed760686406 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.343+0000 7f01ae6c0640 1 -- 172.21.15.178:0/1649576936 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019800a200 con 0x5564bc935990 2024-09-21T09:05:02.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.343+0000 7f01ae6c0640 1 -- 172.21.15.178:0/1649576936 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019800a3a0 con 0x5564bc935990 2024-09-21T09:05:02.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.343+0000 7f01ae6c0640 1 -- 172.21.15.178:0/1649576936 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0198008700 con 0x5564bc935990 2024-09-21T09:05:02.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.343+0000 7f01b3810800 1 -- 172.21.15.178:0/1649576936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc935990 msgr2=0x5564bc937d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.343+0000 7f01b3810800 1 --2- 172.21.15.178:0/1649576936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc935990 0x5564bc937d80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f019800a6b0 tx=0x7f0198047e30 comp rx=0 tx=0).stop 2024-09-21T09:05:02.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.343+0000 7f01b3810800 1 -- 172.21.15.178:0/1649576936 shutdown_connections 2024-09-21T09:05:02.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.343+0000 7f01b3810800 1 --2- 172.21.15.178:0/1649576936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc935990 0x5564bc937d80 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.343+0000 7f01b3810800 1 -- 172.21.15.178:0/1649576936 >> 172.21.15.178:0/1649576936 conn(0x5564bc92cde0 msgr2=0x5564bc92f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.343+0000 7f01b3810800 1 -- 172.21.15.178:0/1649576936 shutdown_connections 2024-09-21T09:05:02.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.343+0000 7f01b3810800 1 -- 172.21.15.178:0/1649576936 wait complete. 2024-09-21T09:05:02.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.359+0000 7f01b3810800 1 Processor -- start 2024-09-21T09:05:02.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.359+0000 7f01b3810800 1 -- start start 2024-09-21T09:05:02.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.359+0000 7f01b3810800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc931550 0x5564bca1f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.359+0000 7f01b3810800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5564bc87e330 con 0x5564bc931550 2024-09-21T09:05:02.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.360+0000 7f01aeec1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc931550 0x5564bca1f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.360+0000 7f01aeec1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc931550 0x5564bca1f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60004/0 (socket says 172.21.15.178:60004) 2024-09-21T09:05:02.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.360+0000 7f01aeec1640 1 -- 172.21.15.178:0/3507487621 learned_addr learned my addr 172.21.15.178:0/3507487621 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.360+0000 7f01aeec1640 1 -- 172.21.15.178:0/3507487621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564bc7cbbc0 con 0x5564bc931550 2024-09-21T09:05:02.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.360+0000 7f01aeec1640 1 --2- 172.21.15.178:0/3507487621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc931550 0x5564bca1f600 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f01a0001d50 tx=0x7f01a000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937484773f7c646 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.360+0000 7f009ce09640 1 -- 172.21.15.178:0/3507487621 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a000f400 con 0x5564bc931550 2024-09-21T09:05:02.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.360+0000 7f009ce09640 1 -- 172.21.15.178:0/3507487621 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a000f5a0 con 0x5564bc931550 2024-09-21T09:05:02.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.360+0000 7f009ce09640 1 -- 172.21.15.178:0/3507487621 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a000f7d0 con 0x5564bc931550 2024-09-21T09:05:02.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.361+0000 7f01b3810800 1 -- 172.21.15.178:0/3507487621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc931550 msgr2=0x5564bca1f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.361+0000 7f01b3810800 1 --2- 172.21.15.178:0/3507487621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc931550 0x5564bca1f600 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f01a0001d50 tx=0x7f01a000b5b0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.361+0000 7f01b3810800 1 -- 172.21.15.178:0/3507487621 shutdown_connections 2024-09-21T09:05:02.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.361+0000 7f01b3810800 1 --2- 172.21.15.178:0/3507487621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc931550 0x5564bca1f600 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.361+0000 7f01b3810800 1 -- 172.21.15.178:0/3507487621 >> 172.21.15.178:0/3507487621 conn(0x5564bc92cde0 msgr2=0x5564bca1afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.361+0000 7f01b3810800 1 -- 172.21.15.178:0/3507487621 shutdown_connections 2024-09-21T09:05:02.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.361+0000 7f01b3810800 1 -- 172.21.15.178:0/3507487621 wait complete. 2024-09-21T09:05:02.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.362+0000 7f01b3810800 1 Processor -- start 2024-09-21T09:05:02.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.362+0000 7f01b3810800 1 -- start start 2024-09-21T09:05:02.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.362+0000 7f01b3810800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc935990 0x5564bca272b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.362+0000 7f01b3810800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5564bc938560 con 0x5564bc935990 2024-09-21T09:05:02.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.362+0000 7f01aeec1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc935990 0x5564bca272b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.362+0000 7f01aeec1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc935990 0x5564bca272b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60010/0 (socket says 172.21.15.178:60010) 2024-09-21T09:05:02.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.362+0000 7f01aeec1640 1 -- 172.21.15.178:0/1345861847 learned_addr learned my addr 172.21.15.178:0/1345861847 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.362+0000 7f01aeec1640 1 -- 172.21.15.178:0/1345861847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564bc7dffe0 con 0x5564bc935990 2024-09-21T09:05:02.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.363+0000 7f01aeec1640 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc935990 0x5564bca272b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x5564bca20460 tx=0x7f01a0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.363+0000 7f009b606640 1 -- 172.21.15.178:0/1345861847 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a001a690 con 0x5564bc935990 2024-09-21T09:05:02.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.363+0000 7f009b606640 1 -- 172.21.15.178:0/1345861847 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a001a830 con 0x5564bc935990 2024-09-21T09:05:02.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.363+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564bca277f0 con 0x5564bc935990 2024-09-21T09:05:02.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.363+0000 7f009b606640 1 -- 172.21.15.178:0/1345861847 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a001ab50 con 0x5564bc935990 2024-09-21T09:05:02.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.363+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564bca27d70 con 0x5564bc935990 2024-09-21T09:05:02.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.364+0000 7f009b606640 1 -- 172.21.15.178:0/1345861847 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f01a0017070 con 0x5564bc935990 2024-09-21T09:05:02.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.364+0000 7f009b606640 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0094036b90 0x7f0094039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.364+0000 7f009b606640 1 -- 172.21.15.178:0/1345861847 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f01a0015020 con 0x5564bc935990 2024-09-21T09:05:02.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.364+0000 7f01a66c0640 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0094036b90 0x7f0094039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.364+0000 7f01b3810800 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5564bca2c310 0x5564bca2e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.364+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca2ec40 con 0x5564bca2c310 2024-09-21T09:05:02.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.364+0000 7f01af6c2640 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5564bca2c310 0x5564bca2e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.365+0000 7f01a66c0640 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0094036b90 0x7f0094039050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0198058000 tx=0x7f0198053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.365+0000 7f01af6c2640 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5564bca2c310 0x5564bca2e700 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.365+0000 7f01af6c2640 1 -- 172.21.15.178:0/1345861847 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a800a4a0 con 0x5564bca2c310 2024-09-21T09:05:02.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.365+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca2b8f0 con 0x5564bca2c310 2024-09-21T09:05:02.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.365+0000 7f01af6c2640 1 -- 172.21.15.178:0/1345861847 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01a800a4a0 con 0x5564bca2c310 2024-09-21T09:05:02.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.365+0000 7f01b3810800 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5564bca30f50 0x5564bca33340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.365+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca339e0 con 0x5564bca30f50 2024-09-21T09:05:02.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.366+0000 7f01aeec1640 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5564bca30f50 0x5564bca33340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.366+0000 7f01aeec1640 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5564bca30f50 0x5564bca33340 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.366+0000 7f01aeec1640 1 -- 172.21.15.178:0/1345861847 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca30f50 2024-09-21T09:05:02.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.367+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca2fdf0 con 0x5564bca2c310 2024-09-21T09:05:02.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.367+0000 7f01af6c2640 1 -- 172.21.15.178:0/1345861847 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01a800a4a0 con 0x5564bca2c310 2024-09-21T09:05:02.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.367+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca302d0 con 0x5564bca2c310 2024-09-21T09:05:02.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.367+0000 7f01af6c2640 1 -- 172.21.15.178:0/1345861847 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f01a800a4a0 con 0x5564bca2c310 2024-09-21T09:05:02.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.368+0000 7f01b3810800 1 Processor -- start 2024-09-21T09:05:02.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.368+0000 7f01b3810800 1 -- start start 2024-09-21T09:05:02.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.368+0000 7f01b3810800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca42330 0x5564bca42750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.368+0000 7f01b3810800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5564bc7cd580 con 0x5564bca42330 2024-09-21T09:05:02.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.368+0000 7f01af6c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca42330 0x5564bca42750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.368+0000 7f01af6c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca42330 0x5564bca42750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60024/0 (socket says 172.21.15.178:60024) 2024-09-21T09:05:02.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.368+0000 7f01af6c2640 1 -- 172.21.15.178:0/1216179810 learned_addr learned my addr 172.21.15.178:0/1216179810 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.368+0000 7f01af6c2640 1 -- 172.21.15.178:0/1216179810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564bca42c90 con 0x5564bca42330 2024-09-21T09:05:02.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.368+0000 7f01af6c2640 1 --2- 172.21.15.178:0/1216179810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca42330 0x5564bca42750 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x5564bca28360 tx=0x7f01a80188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.369+0000 7f0098e01640 1 -- 172.21.15.178:0/1216179810 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a8014450 con 0x5564bca42330 2024-09-21T09:05:02.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.369+0000 7f0098e01640 1 -- 172.21.15.178:0/1216179810 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a80145f0 con 0x5564bca42330 2024-09-21T09:05:02.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.369+0000 7f01b3810800 1 -- 172.21.15.178:0/1216179810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564bca42f20 con 0x5564bca42330 2024-09-21T09:05:02.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.369+0000 7f0098e01640 1 -- 172.21.15.178:0/1216179810 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80148d0 con 0x5564bca42330 2024-09-21T09:05:02.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.369+0000 7f01b3810800 1 -- 172.21.15.178:0/1216179810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564bca45c00 con 0x5564bca42330 2024-09-21T09:05:02.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.370+0000 7f0098e01640 1 -- 172.21.15.178:0/1216179810 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f01a8011040 con 0x5564bca42330 2024-09-21T09:05:02.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.370+0000 7f0098e01640 1 --2- 172.21.15.178:0/1216179810 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0088036b40 0x7f0088039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.370+0000 7f0098e01640 1 -- 172.21.15.178:0/1216179810 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f01a801e070 con 0x5564bca42330 2024-09-21T09:05:02.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.370+0000 7f01aeec1640 1 --2- 172.21.15.178:0/1216179810 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0088036b40 0x7f0088039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.370+0000 7f01b3810800 1 Processor -- start 2024-09-21T09:05:02.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.370+0000 7f01b3810800 1 -- start start 2024-09-21T09:05:02.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.370+0000 7f01aeec1640 1 --2- 172.21.15.178:0/1216179810 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0088036b40 0x7f0088039000 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x5564bca2f070 tx=0x7f01a004b090 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.370+0000 7f01b3810800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca53410 0x5564bca53810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.370+0000 7f01b3810800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5564bca1fdb0 con 0x5564bca53410 2024-09-21T09:05:02.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.371+0000 7f01af6c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca53410 0x5564bca53810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.371+0000 7f01af6c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca53410 0x5564bca53810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60038/0 (socket says 172.21.15.178:60038) 2024-09-21T09:05:02.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.371+0000 7f01af6c2640 1 -- 172.21.15.178:0/3231151958 learned_addr learned my addr 172.21.15.178:0/3231151958 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.371+0000 7f01af6c2640 1 -- 172.21.15.178:0/3231151958 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564bca53de0 con 0x5564bca53410 2024-09-21T09:05:02.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.371+0000 7f01af6c2640 1 --2- 172.21.15.178:0/3231151958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca53410 0x5564bca53810 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f01a804cb80 tx=0x7f01a803bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab76a7c7484d752 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.371+0000 7f00927fc640 1 -- 172.21.15.178:0/3231151958 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80168f0 con 0x5564bca53410 2024-09-21T09:05:02.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.372+0000 7f00927fc640 1 -- 172.21.15.178:0/3231151958 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a8013c80 con 0x5564bca53410 2024-09-21T09:05:02.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.372+0000 7f00927fc640 1 -- 172.21.15.178:0/3231151958 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a8014a70 con 0x5564bca53410 2024-09-21T09:05:02.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.372+0000 7f01b3810800 1 -- 172.21.15.178:0/3231151958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca53410 msgr2=0x5564bca53810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.372+0000 7f01b3810800 1 --2- 172.21.15.178:0/3231151958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca53410 0x5564bca53810 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f01a804cb80 tx=0x7f01a803bf60 comp rx=0 tx=0).stop 2024-09-21T09:05:02.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.372+0000 7f01b3810800 1 -- 172.21.15.178:0/3231151958 shutdown_connections 2024-09-21T09:05:02.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.372+0000 7f01b3810800 1 --2- 172.21.15.178:0/3231151958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca53410 0x5564bca53810 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.372+0000 7f01b3810800 1 -- 172.21.15.178:0/3231151958 >> 172.21.15.178:0/3231151958 conn(0x5564bca4b360 msgr2=0x5564bca49460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.372+0000 7f01b3810800 1 -- 172.21.15.178:0/3231151958 shutdown_connections 2024-09-21T09:05:02.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.372+0000 7f01b3810800 1 -- 172.21.15.178:0/3231151958 wait complete. 2024-09-21T09:05:02.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.373+0000 7f01b3810800 1 Processor -- start 2024-09-21T09:05:02.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.373+0000 7f01b3810800 1 -- start start 2024-09-21T09:05:02.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.373+0000 7f01b3810800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca53410 0x5564bca5a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.373+0000 7f01b3810800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5564bca54450 con 0x5564bca53410 2024-09-21T09:05:02.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.373+0000 7f01af6c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca53410 0x5564bca5a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.373+0000 7f01af6c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca53410 0x5564bca5a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60046/0 (socket says 172.21.15.178:60046) 2024-09-21T09:05:02.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.373+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 learned_addr learned my addr 172.21.15.178:0/3702862508 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.373+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564bca5adc0 con 0x5564bca53410 2024-09-21T09:05:02.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.374+0000 7f01af6c2640 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca53410 0x5564bca5a880 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f01a804cb80 tx=0x7f01a804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.374+0000 7f0090ff9640 1 -- 172.21.15.178:0/3702862508 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a8044030 con 0x5564bca53410 2024-09-21T09:05:02.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.374+0000 7f0090ff9640 1 -- 172.21.15.178:0/3702862508 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a8031070 con 0x5564bca53410 2024-09-21T09:05:02.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.374+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564bca5b050 con 0x5564bca53410 2024-09-21T09:05:02.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.374+0000 7f0090ff9640 1 -- 172.21.15.178:0/3702862508 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a8013e30 con 0x5564bca53410 2024-09-21T09:05:02.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.374+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564bca5dd00 con 0x5564bca53410 2024-09-21T09:05:02.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.375+0000 7f0090ff9640 1 -- 172.21.15.178:0/3702862508 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f01a8022a80 con 0x5564bca53410 2024-09-21T09:05:02.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.375+0000 7f0090ff9640 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0078036b90 0x7f0078039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.375+0000 7f0090ff9640 1 -- 172.21.15.178:0/3702862508 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f01a800e040 con 0x5564bca53410 2024-09-21T09:05:02.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.375+0000 7f01aeec1640 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0078036b90 0x7f0078039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.375+0000 7f01aeec1640 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0078036b90 0x7f0078039050 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f01a004b420 tx=0x7f01a0035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.376+0000 7f01b3810800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.376+0000 7f01b3810800 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5564bca664a0 0x5564bca68960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.376+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca690b0 con 0x5564bca664a0 2024-09-21T09:05:02.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.376+0000 7f01a66c0640 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5564bca664a0 0x5564bca68960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.376+0000 7f01a66c0640 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5564bca664a0 0x5564bca68960 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.376+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.376+0000 7f01b3810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.376+0000 7f01b3810800 20 realm 2024-09-21T09:05:02.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.376+0000 7f01b3810800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.376+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca694e0 con 0x5564bca664a0 2024-09-21T09:05:02.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.377+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.377+0000 7f01b3810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.377+0000 7f01b3810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:02.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.377+0000 7f01b3810800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.377+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca69db0 con 0x5564bca664a0 2024-09-21T09:05:02.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.377+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.377+0000 7f01b3810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.377+0000 7f01b3810800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.377+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca6a150 con 0x5564bca664a0 2024-09-21T09:05:02.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.377+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.377+0000 7f01b3810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:02.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.377+0000 7f01b3810800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.377+0000 7f01b3810800 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5564bca6aeb0 0x5564bca6d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.377+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca6d8b0 con 0x5564bca6aeb0 2024-09-21T09:05:02.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.378+0000 7f01af6c2640 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5564bca6aeb0 0x5564bca6d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.378+0000 7f01af6c2640 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5564bca6aeb0 0x5564bca6d2a0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.378+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.378+0000 7f01b3810800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:02.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.378+0000 7f01b3810800 20 searching for the correct realm 2024-09-21T09:05:02.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.378+0000 7f01b3810800 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5564bca6f840 0x5564bca71d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.378+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6f840 2024-09-21T09:05:02.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.378+0000 7f01aeec1640 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5564bca6f840 0x5564bca71d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.379+0000 7f01aeec1640 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5564bca6f840 0x5564bca71d00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.379+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca6f840 2024-09-21T09:05:02.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.379+0000 7f01aeec1640 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x5564bc931550 0x7f01a000eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.379+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bc931550 2024-09-21T09:05:02.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.379+0000 7f01a66c0640 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x5564bc931550 0x7f01a000eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.379+0000 7f01a66c0640 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x5564bc931550 0x7f01a000eaa0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.380+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019804f760 con 0x5564bc931550 2024-09-21T09:05:02.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.380+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6aeb0 2024-09-21T09:05:02.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.380+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.380+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca664a0 2024-09-21T09:05:02.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.380+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.380+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca664a0 2024-09-21T09:05:02.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.381+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.381+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6aeb0 2024-09-21T09:05:02.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.381+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.381+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6aeb0 2024-09-21T09:05:02.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.381+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.381+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bc931550 2024-09-21T09:05:02.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.382+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019804f760 con 0x5564bc931550 2024-09-21T09:05:02.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.382+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6f840 2024-09-21T09:05:02.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.382+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca6f840 2024-09-21T09:05:02.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.382+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca664a0 2024-09-21T09:05:02.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.382+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.382+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6aeb0 2024-09-21T09:05:02.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.383+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.383+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca664a0 2024-09-21T09:05:02.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.383+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.383+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bc931550 2024-09-21T09:05:02.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.384+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f019804f760 con 0x5564bc931550 2024-09-21T09:05:02.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.384+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6f840 2024-09-21T09:05:02.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.384+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca6f840 2024-09-21T09:05:02.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.384+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6f840 2024-09-21T09:05:02.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.384+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca6f840 2024-09-21T09:05:02.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.384+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6aeb0 2024-09-21T09:05:02.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.384+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.384+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6f840 2024-09-21T09:05:02.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.385+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca6f840 2024-09-21T09:05:02.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.385+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6f840 2024-09-21T09:05:02.397 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.385+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca6f840 2024-09-21T09:05:02.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.385+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca664a0 2024-09-21T09:05:02.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.385+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.385+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca664a0 2024-09-21T09:05:02.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.385+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.385+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6aeb0 2024-09-21T09:05:02.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.386+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.386+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6f840 2024-09-21T09:05:02.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.386+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca6f840 2024-09-21T09:05:02.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.386+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bc931550 2024-09-21T09:05:02.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.386+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019804f760 con 0x5564bc931550 2024-09-21T09:05:02.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.386+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca664a0 2024-09-21T09:05:02.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.387+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.398 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.387+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6aeb0 2024-09-21T09:05:02.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.387+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.387+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6f840 2024-09-21T09:05:02.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.387+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca6f840 2024-09-21T09:05:02.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.387+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bc931550 2024-09-21T09:05:02.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.387+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019804f760 con 0x5564bc931550 2024-09-21T09:05:02.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.387+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bc931550 2024-09-21T09:05:02.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.388+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019804f760 con 0x5564bc931550 2024-09-21T09:05:02.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.388+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6f840 2024-09-21T09:05:02.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.388+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca6f840 2024-09-21T09:05:02.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.388+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca6aeb0 2024-09-21T09:05:02.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.388+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.388+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bca664a0 2024-09-21T09:05:02.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564bca723d0 con 0x5564bc931550 2024-09-21T09:05:02.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019804f760 con 0x5564bc931550 2024-09-21T09:05:02.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01b3810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:02.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01b3810800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:02.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01b3810800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:02.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01b3810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:02.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01b3810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:02.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01b3810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:02.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01b3810800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca6ed90 con 0x5564bca664a0 2024-09-21T09:05:02.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01b3810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01b3810800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.389+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca6e600 con 0x5564bca664a0 2024-09-21T09:05:02.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:02.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca6dd40 con 0x5564bca664a0 2024-09-21T09:05:02.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:02.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 20 zone default found 2024-09-21T09:05:02.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 4 Realm: () 2024-09-21T09:05:02.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:02.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:02.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:02.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 20 zonegroup default 2024-09-21T09:05:02.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca72d00 con 0x5564bca6aeb0 2024-09-21T09:05:02.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.390+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca74f30 con 0x5564bca6f840 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.391+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca6f840 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.391+0000 7f01b3810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.391+0000 7f01b3810800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.391+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca752d0 con 0x5564bca6f840 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.391+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca6f840 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.391+0000 7f01b3810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.391+0000 7f01b3810800 20 started sync module instance, tier type = 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.391+0000 7f01b3810800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.391+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca74370 con 0x5564bc931550 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.392+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bc931550 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.392+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93891150170272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca74370 con 0x5564bc931550 2024-09-21T09:05:02.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.392+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca75cf0 con 0x5564bca664a0 2024-09-21T09:05:02.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.393+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93891150170272] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bc931550 2024-09-21T09:05:02.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.394+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.394+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93891150174176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca74370 con 0x5564bca664a0 2024-09-21T09:05:02.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.394+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca76790 con 0x5564bca6f840 2024-09-21T09:05:02.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.395+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93891150174176] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.395+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca6f840 2024-09-21T09:05:02.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.395+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93891150167744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca742e0 con 0x5564bca6f840 2024-09-21T09:05:02.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.395+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca77650 con 0x5564bc931550 2024-09-21T09:05:02.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.396+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bc931550 2024-09-21T09:05:02.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.396+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93891150167744] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca6f840 2024-09-21T09:05:02.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.396+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93891150180768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca77a70 con 0x5564bc931550 2024-09-21T09:05:02.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.396+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca78340 con 0x5564bca664a0 2024-09-21T09:05:02.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.397+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93891150180768] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bc931550 2024-09-21T09:05:02.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.397+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.397+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93891150181824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca77e90 con 0x5564bca664a0 2024-09-21T09:05:02.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.397+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca78db0 con 0x5564bca6aeb0 2024-09-21T09:05:02.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.399+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93891150181824] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.399+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.399+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93891150186656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca77e90 con 0x5564bca6aeb0 2024-09-21T09:05:02.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.399+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca79800 con 0x5564bca6aeb0 2024-09-21T09:05:02.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.400+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(56 notify.6 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.400+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93891150189328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca79c80 con 0x5564bca6aeb0 2024-09-21T09:05:02.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.400+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca7a7a0 con 0x5564bca6aeb0 2024-09-21T09:05:02.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.400+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93891150186656] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.401+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93891150189328] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.401+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.401+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93891150190384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca779e0 con 0x5564bca6aeb0 2024-09-21T09:05:02.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.401+0000 7f01b3810800 20 add_watcher() i=0 2024-09-21T09:05:02.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.401+0000 7f01b3810800 20 add_watcher() i=1 2024-09-21T09:05:02.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.401+0000 7f01b3810800 20 add_watcher() i=2 2024-09-21T09:05:02.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.401+0000 7f01b3810800 20 add_watcher() i=3 2024-09-21T09:05:02.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.401+0000 7f01b3810800 20 add_watcher() i=4 2024-09-21T09:05:02.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.401+0000 7f01b3810800 20 add_watcher() i=5 2024-09-21T09:05:02.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.401+0000 7f01b3810800 20 add_watcher() i=6 2024-09-21T09:05:02.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.402+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93891150190384] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.402+0000 7f01b3810800 20 add_watcher() i=7 2024-09-21T09:05:02.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.402+0000 7f01b3810800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:02.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.402+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bca7d790 con 0x5564bca664a0 2024-09-21T09:05:02.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.402+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.402+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93891150193264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca7ac10 con 0x5564bca664a0 2024-09-21T09:05:02.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.403+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93891150193264] v31'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.403+0000 7f00657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:02.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.404+0000 7f01b3810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:02.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.404+0000 7f01b3810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:02.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.404+0000 7f01b3810800 5 note: GC not initialized 2024-09-21T09:05:02.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.404+0000 7effdffff640 20 reqs_thread_entry: start 2024-09-21T09:05:02.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.404+0000 7f01b3810800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:02.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.404+0000 7f01b3810800 20 Filter name: none 2024-09-21T09:05:02.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.404+0000 7effddffb640 20 reqs_thread_entry: start 2024-09-21T09:05:02.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.404+0000 7f01b3810800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:05:02.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.404+0000 7f01b3810800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.404+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564bcab0a80 con 0x5564bca664a0 2024-09-21T09:05:02.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.405+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.405+0000 7f01b3810800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:05:02.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.405+0000 7f01b3810800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:05:02.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.405+0000 7f01b3810800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:05:02.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.405+0000 7f01b3810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:05:02.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.405+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bcab0560 con 0x5564bca6aeb0 2024-09-21T09:05:02.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.406+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 usage.10 [call] v31'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.406+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bcab0560 con 0x5564bca6aeb0 2024-09-21T09:05:02.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.408+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(64 usage.10 [call] v31'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.408+0000 7f00657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:02.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.408+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93891150193264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bcab0560 con 0x5564bca664a0 2024-09-21T09:05:02.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.409+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93891150193264] v31'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.409+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93891150170272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bcab0560 con 0x5564bc931550 2024-09-21T09:05:02.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.410+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93891150170272] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bc931550 2024-09-21T09:05:02.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.410+0000 7f01b3810800 20 remove_watcher() i=0 2024-09-21T09:05:02.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.410+0000 7f01b3810800 2 removed watcher, disabling cache 2024-09-21T09:05:02.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.410+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93891150174176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bcab0560 con 0x5564bca664a0 2024-09-21T09:05:02.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.412+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93891150174176] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.412+0000 7f01b3810800 20 remove_watcher() i=1 2024-09-21T09:05:02.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.412+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93891150167744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bcab0560 con 0x5564bca6f840 2024-09-21T09:05:02.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.413+0000 7f01aeec1640 1 -- 172.21.15.178:0/3702862508 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93891150167744] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a002e070 con 0x5564bca6f840 2024-09-21T09:05:02.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.413+0000 7f01b3810800 20 remove_watcher() i=2 2024-09-21T09:05:02.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.413+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93891150180768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca757e0 con 0x5564bc931550 2024-09-21T09:05:02.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.414+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93891150180768] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bc931550 2024-09-21T09:05:02.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.414+0000 7f01b3810800 20 remove_watcher() i=3 2024-09-21T09:05:02.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.414+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93891150181824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca73ec0 con 0x5564bca664a0 2024-09-21T09:05:02.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.415+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93891150181824] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019804f760 con 0x5564bca664a0 2024-09-21T09:05:02.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.415+0000 7f01b3810800 20 remove_watcher() i=4 2024-09-21T09:05:02.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.415+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93891150186656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca757e0 con 0x5564bca6aeb0 2024-09-21T09:05:02.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.417+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93891150186656] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.417+0000 7f01b3810800 20 remove_watcher() i=5 2024-09-21T09:05:02.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.417+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93891150189328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca73ec0 con 0x5564bca6aeb0 2024-09-21T09:05:02.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.418+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93891150189328] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.418+0000 7f01b3810800 20 remove_watcher() i=6 2024-09-21T09:05:02.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.418+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93891150190384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564bca757e0 con 0x5564bca6aeb0 2024-09-21T09:05:02.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01af6c2640 1 -- 172.21.15.178:0/3702862508 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93891150190384] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a802a070 con 0x5564bca6aeb0 2024-09-21T09:05:02.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 20 remove_watcher() i=7 2024-09-21T09:05:02.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5564bca6aeb0 msgr2=0x5564bca6d2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5564bca6aeb0 0x5564bca6d2a0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5564bca664a0 msgr2=0x5564bca68960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5564bca664a0 0x5564bca68960 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x5564bc931550 msgr2=0x7f01a000eaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x5564bc931550 0x7f01a000eaa0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5564bca6f840 msgr2=0x5564bca71d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5564bca6f840 0x5564bca71d00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0078036b90 msgr2=0x7f0078039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0078036b90 0x7f0078039050 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f01a004b420 tx=0x7f01a0035000 comp rx=0 tx=0).stop 2024-09-21T09:05:02.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca53410 msgr2=0x5564bca5a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca53410 0x5564bca5a880 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f01a804cb80 tx=0x7f01a804cb10 comp rx=0 tx=0).stop 2024-09-21T09:05:02.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01a66c0640 1 -- 172.21.15.178:0/3702862508 reap_dead start 2024-09-21T09:05:02.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 shutdown_connections 2024-09-21T09:05:02.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 --2- 172.21.15.178:0/3702862508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca53410 0x5564bca5a880 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 >> 172.21.15.178:0/3702862508 conn(0x5564bca4b360 msgr2=0x5564bca49430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 shutdown_connections 2024-09-21T09:05:02.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.419+0000 7f01b3810800 1 -- 172.21.15.178:0/3702862508 wait complete. 2024-09-21T09:05:02.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 -- 172.21.15.178:0/1216179810 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0088036b40 msgr2=0x7f0088039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 --2- 172.21.15.178:0/1216179810 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0088036b40 0x7f0088039000 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x5564bca2f070 tx=0x7f01a004b090 comp rx=0 tx=0).stop 2024-09-21T09:05:02.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 -- 172.21.15.178:0/1216179810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca42330 msgr2=0x5564bca42750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 --2- 172.21.15.178:0/1216179810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca42330 0x5564bca42750 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x5564bca28360 tx=0x7f01a80188f0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 -- 172.21.15.178:0/1216179810 shutdown_connections 2024-09-21T09:05:02.424 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 --2- 172.21.15.178:0/1216179810 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0088036b40 0x7f0088039000 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 --2- 172.21.15.178:0/1216179810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bca42330 0x5564bca42750 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 -- 172.21.15.178:0/1216179810 >> 172.21.15.178:0/1216179810 conn(0x5564bca372c0 msgr2=0x5564bca39e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 -- 172.21.15.178:0/1216179810 shutdown_connections 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 -- 172.21.15.178:0/1216179810 wait complete. 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5564bca30f50 msgr2=0x5564bca33340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5564bca30f50 0x5564bca33340 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5564bca2c310 msgr2=0x5564bca2e700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5564bca2c310 0x5564bca2e700 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0094036b90 msgr2=0x7f0094039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0094036b90 0x7f0094039050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0198058000 tx=0x7f0198053000 comp rx=0 tx=0).stop 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc935990 msgr2=0x5564bca272b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc935990 0x5564bca272b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x5564bca20460 tx=0x7f01a0000ed0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 shutdown_connections 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5564bca30f50 0x5564bca33340 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5564bca2c310 0x5564bca2e700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0094036b90 0x7f0094039050 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 --2- 172.21.15.178:0/1345861847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564bc935990 0x5564bca272b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 >> 172.21.15.178:0/1345861847 conn(0x5564bc92cde0 msgr2=0x5564bca19830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 shutdown_connections 2024-09-21T09:05:02.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.420+0000 7f01b3810800 1 -- 172.21.15.178:0/1345861847 wait complete. 2024-09-21T09:05:02.431 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-21T09:05:02.431 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-21T09:05:02.431 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-21T09:05:02.476 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:02.476 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:02.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.475+0000 7f6fcf430800 1 Processor -- start 2024-09-21T09:05:02.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.475+0000 7f6fcf430800 1 -- start start 2024-09-21T09:05:02.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.475+0000 7f6fcf430800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x555a71b0bd20 0x555a71b0e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.475+0000 7f6fcf430800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a719c4b30 con 0x555a71a78dd0 2024-09-21T09:05:02.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.475+0000 7f6fcf430800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x555a719a6360 con 0x555a71b0bd20 2024-09-21T09:05:02.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.475+0000 7f6fc3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x555a71b0bd20 0x555a71b0e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.475+0000 7f6fc3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x555a71b0bd20 0x555a71b0e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60058/0 (socket says 172.21.15.178:60058) 2024-09-21T09:05:02.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.475+0000 7f6fc3fff640 1 -- 172.21.15.178:0/3475031990 learned_addr learned my addr 172.21.15.178:0/3475031990 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.476+0000 7f6fc3fff640 1 -- 172.21.15.178:0/3475031990 >> v1:172.21.15.44:6789/0 conn(0x555a71a78dd0 legacy=0x555a71b0a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.476+0000 7f6fc3fff640 1 -- 172.21.15.178:0/3475031990 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a719cce00 con 0x555a71b0bd20 2024-09-21T09:05:02.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.477+0000 7f6fc3fff640 1 --2- 172.21.15.178:0/3475031990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71b0bd20 0x555a71b0e110 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400a520 tx=0x7f6fb4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7422f3d5750e972 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.478+0000 7f6fc9fd5640 1 -- 172.21.15.178:0/3475031990 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fb4055070 con 0x555a71b0bd20 2024-09-21T09:05:02.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.478+0000 7f6fc9fd5640 1 -- 172.21.15.178:0/3475031990 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb40515b0 con 0x555a71b0bd20 2024-09-21T09:05:02.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.478+0000 7f6fc9fd5640 1 -- 172.21.15.178:0/3475031990 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fb40518d0 con 0x555a71b0bd20 2024-09-21T09:05:02.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.478+0000 7f6fcf430800 1 -- 172.21.15.178:0/3475031990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71b0bd20 msgr2=0x555a71b0e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.478+0000 7f6fcf430800 1 --2- 172.21.15.178:0/3475031990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71b0bd20 0x555a71b0e110 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400a520 tx=0x7f6fb4045ba0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.478+0000 7f6fcf430800 1 -- 172.21.15.178:0/3475031990 shutdown_connections 2024-09-21T09:05:02.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.478+0000 7f6fcf430800 1 --2- 172.21.15.178:0/3475031990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71b0bd20 0x555a71b0e110 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.478+0000 7f6fcf430800 1 -- 172.21.15.178:0/3475031990 >> 172.21.15.178:0/3475031990 conn(0x555a71affdf0 msgr2=0x555a71b02210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.478+0000 7f6fcf430800 1 -- 172.21.15.178:0/3475031990 shutdown_connections 2024-09-21T09:05:02.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.478+0000 7f6fcf430800 1 -- 172.21.15.178:0/3475031990 wait complete. 2024-09-21T09:05:02.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.492+0000 7f6fcf430800 1 Processor -- start 2024-09-21T09:05:02.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.492+0000 7f6fcf430800 1 -- start start 2024-09-21T09:05:02.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.492+0000 7f6fcf430800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71a78dd0 0x555a71bf6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.492+0000 7f6fcf430800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555a71a51330 con 0x555a71a78dd0 2024-09-21T09:05:02.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.492+0000 7f6fca7d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71a78dd0 0x555a71bf6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.492+0000 7f6fca7d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71a78dd0 0x555a71bf6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60074/0 (socket says 172.21.15.178:60074) 2024-09-21T09:05:02.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.492+0000 7f6fca7d6640 1 -- 172.21.15.178:0/3048516674 learned_addr learned my addr 172.21.15.178:0/3048516674 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.493+0000 7f6fca7d6640 1 -- 172.21.15.178:0/3048516674 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7199ebc0 con 0x555a71a78dd0 2024-09-21T09:05:02.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.493+0000 7f6fca7d6640 1 --2- 172.21.15.178:0/3048516674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71a78dd0 0x555a71bf6a50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc001d00 tx=0x7f6fbc00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd061f36c5db222 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.493+0000 7f6eb8608640 1 -- 172.21.15.178:0/3048516674 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fbc00f400 con 0x555a71a78dd0 2024-09-21T09:05:02.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.493+0000 7f6eb8608640 1 -- 172.21.15.178:0/3048516674 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fbc001e50 con 0x555a71a78dd0 2024-09-21T09:05:02.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.493+0000 7f6eb8608640 1 -- 172.21.15.178:0/3048516674 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fbc00f600 con 0x555a71a78dd0 2024-09-21T09:05:02.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.494+0000 7f6fcf430800 1 -- 172.21.15.178:0/3048516674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71a78dd0 msgr2=0x555a71bf6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.494+0000 7f6fcf430800 1 --2- 172.21.15.178:0/3048516674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71a78dd0 0x555a71bf6a50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc001d00 tx=0x7f6fbc00b5b0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.494+0000 7f6fcf430800 1 -- 172.21.15.178:0/3048516674 shutdown_connections 2024-09-21T09:05:02.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.494+0000 7f6fcf430800 1 --2- 172.21.15.178:0/3048516674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71a78dd0 0x555a71bf6a50 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.494+0000 7f6fcf430800 1 -- 172.21.15.178:0/3048516674 >> 172.21.15.178:0/3048516674 conn(0x555a71affdf0 msgr2=0x555a71bf2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.494+0000 7f6fcf430800 1 -- 172.21.15.178:0/3048516674 shutdown_connections 2024-09-21T09:05:02.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.494+0000 7f6fcf430800 1 -- 172.21.15.178:0/3048516674 wait complete. 2024-09-21T09:05:02.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.494+0000 7f6fcf430800 1 Processor -- start 2024-09-21T09:05:02.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.494+0000 7f6fcf430800 1 -- start start 2024-09-21T09:05:02.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.494+0000 7f6fcf430800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71a78dd0 0x555a71bfe430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.494+0000 7f6fcf430800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555a71b0e8f0 con 0x555a71a78dd0 2024-09-21T09:05:02.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.494+0000 7f6fca7d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71a78dd0 0x555a71bfe430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.494+0000 7f6fca7d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71a78dd0 0x555a71bfe430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60088/0 (socket says 172.21.15.178:60088) 2024-09-21T09:05:02.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.494+0000 7f6fca7d6640 1 -- 172.21.15.178:0/254794334 learned_addr learned my addr 172.21.15.178:0/254794334 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.495+0000 7f6fca7d6640 1 -- 172.21.15.178:0/254794334 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a719b2fe0 con 0x555a71a78dd0 2024-09-21T09:05:02.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.495+0000 7f6fca7d6640 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71a78dd0 0x555a71bfe430 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc002000 tx=0x7f6fbc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.495+0000 7f6eb6e05640 1 -- 172.21.15.178:0/254794334 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fbc01a5b0 con 0x555a71a78dd0 2024-09-21T09:05:02.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.495+0000 7f6eb6e05640 1 -- 172.21.15.178:0/254794334 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fbc01a750 con 0x555a71a78dd0 2024-09-21T09:05:02.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.495+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a71bfe970 con 0x555a71a78dd0 2024-09-21T09:05:02.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.495+0000 7f6eb6e05640 1 -- 172.21.15.178:0/254794334 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fbc01aa70 con 0x555a71a78dd0 2024-09-21T09:05:02.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.495+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a71bfeef0 con 0x555a71a78dd0 2024-09-21T09:05:02.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.496+0000 7f6eb6e05640 1 -- 172.21.15.178:0/254794334 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6fbc017070 con 0x555a71a78dd0 2024-09-21T09:05:02.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.496+0000 7f6eb6e05640 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6eb0036b40 0x7f6eb0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.496+0000 7f6eb6e05640 1 -- 172.21.15.178:0/254794334 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f6fbc015020 con 0x555a71a78dd0 2024-09-21T09:05:02.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.496+0000 7f6fc3fff640 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6eb0036b40 0x7f6eb0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.496+0000 7f6fcf430800 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555a71b0bd20 0x555a71c054a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.501 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.496+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c05a70 con 0x555a71b0bd20 2024-09-21T09:05:02.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.496+0000 7f6fcafd7640 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555a71b0bd20 0x555a71c054a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.497+0000 7f6fc3fff640 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6eb0036b40 0x7f6eb0039000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4057000 tx=0x7f6fb4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.497+0000 7f6fcafd7640 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555a71b0bd20 0x555a71c054a0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.497+0000 7f6fcafd7640 1 -- 172.21.15.178:0/254794334 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fc400a4a0 con 0x555a71b0bd20 2024-09-21T09:05:02.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.497+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c02a70 con 0x555a71b0bd20 2024-09-21T09:05:02.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.497+0000 7f6fcafd7640 1 -- 172.21.15.178:0/254794334 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6fc400a4a0 con 0x555a71b0bd20 2024-09-21T09:05:02.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.497+0000 7f6fcf430800 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555a71c07dc0 0x555a71c0a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.497+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c0a8a0 con 0x555a71c07dc0 2024-09-21T09:05:02.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.497+0000 7f6fca7d6640 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555a71c07dc0 0x555a71c0a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.498+0000 7f6fca7d6640 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555a71c07dc0 0x555a71c0a1b0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.498+0000 7f6fca7d6640 1 -- 172.21.15.178:0/254794334 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c07dc0 2024-09-21T09:05:02.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.498+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c06c60 con 0x555a71b0bd20 2024-09-21T09:05:02.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.498+0000 7f6fcafd7640 1 -- 172.21.15.178:0/254794334 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6fc400a4a0 con 0x555a71b0bd20 2024-09-21T09:05:02.502 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.498+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c07140 con 0x555a71b0bd20 2024-09-21T09:05:02.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.499+0000 7f6fcafd7640 1 -- 172.21.15.178:0/254794334 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6fc400a4a0 con 0x555a71b0bd20 2024-09-21T09:05:02.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.499+0000 7f6fcf430800 1 Processor -- start 2024-09-21T09:05:02.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.499+0000 7f6fcf430800 1 -- start start 2024-09-21T09:05:02.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.499+0000 7f6fcf430800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c19220 0x555a71c19640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.499+0000 7f6fcf430800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555a719a0580 con 0x555a71c19220 2024-09-21T09:05:02.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.499+0000 7f6fcafd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c19220 0x555a71c19640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.500+0000 7f6fcafd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c19220 0x555a71c19640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60102/0 (socket says 172.21.15.178:60102) 2024-09-21T09:05:02.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.500+0000 7f6fcafd7640 1 -- 172.21.15.178:0/4240662196 learned_addr learned my addr 172.21.15.178:0/4240662196 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.500+0000 7f6fcafd7640 1 -- 172.21.15.178:0/4240662196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a71c19b80 con 0x555a71c19220 2024-09-21T09:05:02.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.500+0000 7f6fcafd7640 1 --2- 172.21.15.178:0/4240662196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c19220 0x555a71c19640 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x555a71c05e70 tx=0x7f6fc4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.500+0000 7f6eaffff640 1 -- 172.21.15.178:0/4240662196 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fc4014450 con 0x555a71c19220 2024-09-21T09:05:02.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.500+0000 7f6eaffff640 1 -- 172.21.15.178:0/4240662196 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc4014610 con 0x555a71c19220 2024-09-21T09:05:02.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.500+0000 7f6fcf430800 1 -- 172.21.15.178:0/4240662196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a71c19e10 con 0x555a71c19220 2024-09-21T09:05:02.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.500+0000 7f6eaffff640 1 -- 172.21.15.178:0/4240662196 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fc4014930 con 0x555a71c19220 2024-09-21T09:05:02.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.500+0000 7f6fcf430800 1 -- 172.21.15.178:0/4240662196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a71c1caf0 con 0x555a71c19220 2024-09-21T09:05:02.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.501+0000 7f6eaffff640 1 -- 172.21.15.178:0/4240662196 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6fc4011040 con 0x555a71c19220 2024-09-21T09:05:02.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.501+0000 7f6eaffff640 1 --2- 172.21.15.178:0/4240662196 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ea4036b40 0x7f6ea4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.501+0000 7f6eaffff640 1 -- 172.21.15.178:0/4240662196 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f6fc401e070 con 0x555a71c19220 2024-09-21T09:05:02.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.501+0000 7f6fca7d6640 1 --2- 172.21.15.178:0/4240662196 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ea4036b40 0x7f6ea4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.502+0000 7f6fcf430800 1 Processor -- start 2024-09-21T09:05:02.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.502+0000 7f6fca7d6640 1 --2- 172.21.15.178:0/4240662196 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ea4036b40 0x7f6ea4039000 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x555a71c05f10 tx=0x7f6fbc04b100 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.502+0000 7f6fcf430800 1 -- start start 2024-09-21T09:05:02.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.502+0000 7f6fcf430800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c25ea0 0x555a71c262a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.502+0000 7f6fcf430800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555a71bf7200 con 0x555a71c25ea0 2024-09-21T09:05:02.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.502+0000 7f6fcafd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c25ea0 0x555a71c262a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.502+0000 7f6fcafd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c25ea0 0x555a71c262a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60114/0 (socket says 172.21.15.178:60114) 2024-09-21T09:05:02.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.502+0000 7f6fcafd7640 1 -- 172.21.15.178:0/4094082783 learned_addr learned my addr 172.21.15.178:0/4094082783 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.502+0000 7f6fcafd7640 1 -- 172.21.15.178:0/4094082783 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a71c26870 con 0x555a71c25ea0 2024-09-21T09:05:02.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.503+0000 7f6fcafd7640 1 --2- 172.21.15.178:0/4094082783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c25ea0 0x555a71c262a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6fc404cbd0 tx=0x7f6fc404ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e190d3a253e2e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.503+0000 7f6eadffb640 1 -- 172.21.15.178:0/4094082783 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fc4043020 con 0x555a71c25ea0 2024-09-21T09:05:02.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.503+0000 7f6eadffb640 1 -- 172.21.15.178:0/4094082783 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc4040150 con 0x555a71c25ea0 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.503+0000 7f6eadffb640 1 -- 172.21.15.178:0/4094082783 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fc4016570 con 0x555a71c25ea0 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.503+0000 7f6fcf430800 1 -- 172.21.15.178:0/4094082783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c25ea0 msgr2=0x555a71c262a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.503+0000 7f6fcf430800 1 --2- 172.21.15.178:0/4094082783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c25ea0 0x555a71c262a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6fc404cbd0 tx=0x7f6fc404ce80 comp rx=0 tx=0).stop 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.503+0000 7f6fcf430800 1 -- 172.21.15.178:0/4094082783 shutdown_connections 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.503+0000 7f6fcf430800 1 --2- 172.21.15.178:0/4094082783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c25ea0 0x555a71c262a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.503+0000 7f6fcf430800 1 -- 172.21.15.178:0/4094082783 >> 172.21.15.178:0/4094082783 conn(0x555a71c22250 msgr2=0x555a71c20350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.503+0000 7f6fcf430800 1 -- 172.21.15.178:0/4094082783 shutdown_connections 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.503+0000 7f6fcf430800 1 -- 172.21.15.178:0/4094082783 wait complete. 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.503+0000 7f6fcf430800 1 Processor -- start 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.504+0000 7f6fcf430800 1 -- start start 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.504+0000 7f6fcf430800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c25ea0 0x555a71c2d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.504+0000 7f6fcf430800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555a71c26e40 con 0x555a71c25ea0 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.504+0000 7f6fcafd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c25ea0 0x555a71c2d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.504+0000 7f6fcafd7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c25ea0 0x555a71c2d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60120/0 (socket says 172.21.15.178:60120) 2024-09-21T09:05:02.509 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.504+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 learned_addr learned my addr 172.21.15.178:0/2260475761 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.504+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a71c2d7d0 con 0x555a71c25ea0 2024-09-21T09:05:02.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.504+0000 7f6fcafd7640 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c25ea0 0x555a71c2d290 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400aa40 tx=0x7f6fc404cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.504+0000 7f6e9bfff640 1 -- 172.21.15.178:0/2260475761 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fc4011c00 con 0x555a71c25ea0 2024-09-21T09:05:02.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.504+0000 7f6e9bfff640 1 -- 172.21.15.178:0/2260475761 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc4014d30 con 0x555a71c25ea0 2024-09-21T09:05:02.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.504+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a71c2da60 con 0x555a71c25ea0 2024-09-21T09:05:02.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.504+0000 7f6e9bfff640 1 -- 172.21.15.178:0/2260475761 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fc404e220 con 0x555a71c25ea0 2024-09-21T09:05:02.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.505+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a71c30710 con 0x555a71c25ea0 2024-09-21T09:05:02.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.505+0000 7f6e9bfff640 1 -- 172.21.15.178:0/2260475761 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6fc404e3c0 con 0x555a71c25ea0 2024-09-21T09:05:02.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.506+0000 7f6e9bfff640 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6e94036b90 0x7f6e94039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.506+0000 7f6fca7d6640 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6e94036b90 0x7f6e94039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.506+0000 7f6e9bfff640 1 -- 172.21.15.178:0/2260475761 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f6fc400e040 con 0x555a71c25ea0 2024-09-21T09:05:02.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.506+0000 7f6fcf430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.506+0000 7f6fcf430800 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555a71c38f20 0x555a71c3b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.506+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c3bb10 con 0x555a71c38f20 2024-09-21T09:05:02.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.506+0000 7f6fc3fff640 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555a71c38f20 0x555a71c3b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.506+0000 7f6fca7d6640 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6e94036b90 0x7f6e94039050 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00e520 tx=0x7f6fbc035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.506+0000 7f6fc3fff640 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555a71c38f20 0x555a71c3b3c0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.507+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.507+0000 7f6fcf430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.507+0000 7f6fcf430800 20 realm 2024-09-21T09:05:02.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.507+0000 7f6fcf430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.507+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c3bf40 con 0x555a71c38f20 2024-09-21T09:05:02.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.507+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.507+0000 7f6fcf430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.507+0000 7f6fcf430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:02.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.507+0000 7f6fcf430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.507+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c3c7e0 con 0x555a71c38f20 2024-09-21T09:05:02.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.507+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.507+0000 7f6fcf430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.507+0000 7f6fcf430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.507+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c3cb80 con 0x555a71c38f20 2024-09-21T09:05:02.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.508+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.508+0000 7f6fcf430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:02.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.508+0000 7f6fcf430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.508+0000 7f6fcf430800 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555a71c3d8e0 0x555a71c3fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.508+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c40210 con 0x555a71c3d8e0 2024-09-21T09:05:02.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.508+0000 7f6fcafd7640 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555a71c3d8e0 0x555a71c3fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.508+0000 7f6fcafd7640 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555a71c3d8e0 0x555a71c3fcd0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.508+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.508+0000 7f6fcf430800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:02.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.508+0000 7f6fcf430800 20 searching for the correct realm 2024-09-21T09:05:02.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.508+0000 7f6fcf430800 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x555a71c42270 0x555a71c44730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.508+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c42270 2024-09-21T09:05:02.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.509+0000 7f6fca7d6640 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x555a71c42270 0x555a71c44730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.509+0000 7f6fca7d6640 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x555a71c42270 0x555a71c44730 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.509+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c42270 2024-09-21T09:05:02.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.509+0000 7f6fca7d6640 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6fbc03fb80 0x7f6fbc00e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.509+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x7f6fbc03fb80 2024-09-21T09:05:02.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.509+0000 7f6fc3fff640 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6fbc03fb80 0x7f6fbc00e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.510+0000 7f6fc3fff640 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6fbc03fb80 0x7f6fbc00e590 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.510+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb4057030 con 0x7f6fbc03fb80 2024-09-21T09:05:02.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.510+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c3d8e0 2024-09-21T09:05:02.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.510+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.510+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c38f20 2024-09-21T09:05:02.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.510+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.510+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c38f20 2024-09-21T09:05:02.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.511+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.511+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c3d8e0 2024-09-21T09:05:02.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.511+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.511+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c3d8e0 2024-09-21T09:05:02.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.511+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.511+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x7f6fbc03fb80 2024-09-21T09:05:02.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.511+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb4057030 con 0x7f6fbc03fb80 2024-09-21T09:05:02.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.511+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c42270 2024-09-21T09:05:02.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.512+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c42270 2024-09-21T09:05:02.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.512+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c38f20 2024-09-21T09:05:02.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.512+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.512+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c3d8e0 2024-09-21T09:05:02.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.512+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.512+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c38f20 2024-09-21T09:05:02.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.512+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.512+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x7f6fbc03fb80 2024-09-21T09:05:02.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.513+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6fb4057030 con 0x7f6fbc03fb80 2024-09-21T09:05:02.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.513+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c42270 2024-09-21T09:05:02.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.513+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c42270 2024-09-21T09:05:02.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.513+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c42270 2024-09-21T09:05:02.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.513+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c42270 2024-09-21T09:05:02.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.513+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c3d8e0 2024-09-21T09:05:02.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.514+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.514+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c42270 2024-09-21T09:05:02.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.514+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c42270 2024-09-21T09:05:02.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.514+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c42270 2024-09-21T09:05:02.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.514+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c42270 2024-09-21T09:05:02.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.514+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c38f20 2024-09-21T09:05:02.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.514+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.514+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c38f20 2024-09-21T09:05:02.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.515+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.515+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c3d8e0 2024-09-21T09:05:02.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.515+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.515+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c42270 2024-09-21T09:05:02.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.515+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c42270 2024-09-21T09:05:02.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.515+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x7f6fbc03fb80 2024-09-21T09:05:02.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.515+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb4057030 con 0x7f6fbc03fb80 2024-09-21T09:05:02.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.515+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c38f20 2024-09-21T09:05:02.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.516+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.523 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.516+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c3d8e0 2024-09-21T09:05:02.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.516+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.516+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c42270 2024-09-21T09:05:02.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.516+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c42270 2024-09-21T09:05:02.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.516+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x7f6fbc03fb80 2024-09-21T09:05:02.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.517+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb4057030 con 0x7f6fbc03fb80 2024-09-21T09:05:02.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.517+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x7f6fbc03fb80 2024-09-21T09:05:02.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.517+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb4057030 con 0x7f6fbc03fb80 2024-09-21T09:05:02.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.517+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c42270 2024-09-21T09:05:02.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.517+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c42270 2024-09-21T09:05:02.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.517+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c3d8e0 2024-09-21T09:05:02.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.517+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.517+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x555a71c38f20 2024-09-21T09:05:02.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555a71c44e00 con 0x7f6fbc03fb80 2024-09-21T09:05:02.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb4057030 con 0x7f6fbc03fb80 2024-09-21T09:05:02.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fcf430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:02.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fcf430800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:02.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fcf430800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:02.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fcf430800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:02.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fcf430800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:02.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fcf430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:02.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fcf430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c40cf0 con 0x555a71c38f20 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fcf430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fcf430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c41170 con 0x555a71c38f20 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fcf430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fcf430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.518+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c41650 con 0x555a71c38f20 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 20 zone default found 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 4 Realm: () 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:02.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 20 zonegroup default 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c45280 con 0x555a71c3d8e0 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c474b0 con 0x555a71c42270 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c42270 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.519+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c47850 con 0x555a71c42270 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.520+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c42270 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.520+0000 7f6fcf430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.520+0000 7f6fcf430800 20 started sync module instance, tier type = 2024-09-21T09:05:02.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.520+0000 7f6fcf430800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.520+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c468f0 con 0x7f6fbc03fb80 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.521+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x7f6fbc03fb80 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.521+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93846944116240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c468f0 con 0x7f6fbc03fb80 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.521+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c48210 con 0x555a71c38f20 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.522+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93846944116240] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x7f6fbc03fb80 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.522+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.522+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93846944114208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c48210 con 0x555a71c38f20 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.522+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c48c10 con 0x555a71c42270 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.523+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c42270 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.523+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93846944122656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c494b0 con 0x555a71c42270 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.524+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c49f50 con 0x7f6fbc03fb80 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.524+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93846944114208] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.525+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x7f6fbc03fb80 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.525+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93846944127520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c4a340 con 0x7f6fbc03fb80 2024-09-21T09:05:02.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.525+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c4ad40 con 0x555a71c38f20 2024-09-21T09:05:02.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.525+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93846944122656] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c42270 2024-09-21T09:05:02.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.526+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93846944127520] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x7f6fbc03fb80 2024-09-21T09:05:02.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.526+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.526+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93846944120160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c4a850 con 0x555a71c38f20 2024-09-21T09:05:02.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.526+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c4b5e0 con 0x555a71c3d8e0 2024-09-21T09:05:02.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.527+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93846944120160] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.527+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.527+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93846944133424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c4a850 con 0x555a71c3d8e0 2024-09-21T09:05:02.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.527+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c4bfa0 con 0x555a71c3d8e0 2024-09-21T09:05:02.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.528+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(56 notify.6 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.528+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93846944135920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c4c400 con 0x555a71c3d8e0 2024-09-21T09:05:02.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.528+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c4cf20 con 0x555a71c3d8e0 2024-09-21T09:05:02.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.529+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93846944133424] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.529+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93846944135920] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.529+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.529+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93846944139760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c4bf10 con 0x555a71c3d8e0 2024-09-21T09:05:02.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.529+0000 7f6fcf430800 20 add_watcher() i=0 2024-09-21T09:05:02.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.529+0000 7f6fcf430800 20 add_watcher() i=1 2024-09-21T09:05:02.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.529+0000 7f6fcf430800 20 add_watcher() i=2 2024-09-21T09:05:02.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.529+0000 7f6fcf430800 20 add_watcher() i=3 2024-09-21T09:05:02.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.529+0000 7f6fcf430800 20 add_watcher() i=4 2024-09-21T09:05:02.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.529+0000 7f6fcf430800 20 add_watcher() i=5 2024-09-21T09:05:02.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.529+0000 7f6fcf430800 20 add_watcher() i=6 2024-09-21T09:05:02.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.530+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93846944139760] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.530+0000 7f6fcf430800 20 add_watcher() i=7 2024-09-21T09:05:02.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.530+0000 7f6fcf430800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:02.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.530+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c4ff10 con 0x555a71c38f20 2024-09-21T09:05:02.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.531+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.531+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93846944124928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c4d390 con 0x555a71c38f20 2024-09-21T09:05:02.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.532+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93846944124928] v31'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.532+0000 7f6e80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:02.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.532+0000 7f6fcf430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:02.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.532+0000 7f6fcf430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:02.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.532+0000 7f6fcf430800 5 note: GC not initialized 2024-09-21T09:05:02.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.532+0000 7f6dfb7fe640 20 reqs_thread_entry: start 2024-09-21T09:05:02.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.532+0000 7f6fcf430800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:02.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.532+0000 7f6fcf430800 20 Filter name: none 2024-09-21T09:05:02.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.532+0000 7f6df97fa640 20 reqs_thread_entry: start 2024-09-21T09:05:02.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.533+0000 7f6fcf430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.533+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c82d40 con 0x555a71c38f20 2024-09-21T09:05:02.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.533+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.533+0000 7f6fcf430800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:05:02.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.533+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555a71c84290 con 0x555a71c3d8e0 2024-09-21T09:05:02.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.534+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.534+0000 7f6e80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:02.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.534+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93846944124928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c4cee0 con 0x555a71c38f20 2024-09-21T09:05:02.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.535+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93846944124928] v31'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.540 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.535+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93846944116240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c49000 con 0x7f6fbc03fb80 2024-09-21T09:05:02.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.536+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93846944116240] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x7f6fbc03fb80 2024-09-21T09:05:02.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.536+0000 7f6fcf430800 20 remove_watcher() i=0 2024-09-21T09:05:02.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.536+0000 7f6fcf430800 2 removed watcher, disabling cache 2024-09-21T09:05:02.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.536+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93846944114208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c46df0 con 0x555a71c38f20 2024-09-21T09:05:02.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.537+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93846944114208] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.537+0000 7f6fcf430800 20 remove_watcher() i=1 2024-09-21T09:05:02.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.537+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93846944122656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c46620 con 0x555a71c42270 2024-09-21T09:05:02.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.538+0000 7f6fca7d6640 1 -- 172.21.15.178:0/2260475761 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93846944122656] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fbc02e070 con 0x555a71c42270 2024-09-21T09:05:02.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.539+0000 7f6fcf430800 20 remove_watcher() i=2 2024-09-21T09:05:02.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.539+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93846944127520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c46df0 con 0x7f6fbc03fb80 2024-09-21T09:05:02.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.539+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93846944127520] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x7f6fbc03fb80 2024-09-21T09:05:02.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.539+0000 7f6fcf430800 20 remove_watcher() i=3 2024-09-21T09:05:02.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.539+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93846944120160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c49a20 con 0x555a71c38f20 2024-09-21T09:05:02.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.541+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93846944120160] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb4057030 con 0x555a71c38f20 2024-09-21T09:05:02.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.541+0000 7f6fcf430800 20 remove_watcher() i=4 2024-09-21T09:05:02.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.541+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93846944133424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c47d60 con 0x555a71c3d8e0 2024-09-21T09:05:02.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.542+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93846944133424] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.542+0000 7f6fcf430800 20 remove_watcher() i=5 2024-09-21T09:05:02.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.542+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93846944135920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c47d60 con 0x555a71c3d8e0 2024-09-21T09:05:02.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.543+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93846944135920] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.544 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.543+0000 7f6fcf430800 20 remove_watcher() i=6 2024-09-21T09:05:02.545 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.543+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93846944139760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555a71c4baf0 con 0x555a71c3d8e0 2024-09-21T09:05:02.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcafd7640 1 -- 172.21.15.178:0/2260475761 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93846944139760] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fc4045040 con 0x555a71c3d8e0 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 20 remove_watcher() i=7 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555a71c3d8e0 msgr2=0x555a71c3fcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555a71c3d8e0 0x555a71c3fcd0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555a71c38f20 msgr2=0x555a71c3b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555a71c38f20 0x555a71c3b3c0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6fbc03fb80 msgr2=0x7f6fbc00e590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6fbc03fb80 0x7f6fbc00e590 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x555a71c42270 msgr2=0x555a71c44730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x555a71c42270 0x555a71c44730 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6e94036b90 msgr2=0x7f6e94039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6e94036b90 0x7f6e94039050 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00e520 tx=0x7f6fbc035000 comp rx=0 tx=0).stop 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c25ea0 msgr2=0x555a71c2d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 --2- 172.21.15.178:0/2260475761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c25ea0 0x555a71c2d290 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400aa40 tx=0x7f6fc404cb60 comp rx=0 tx=0).stop 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 reap_dead start 2024-09-21T09:05:02.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fc3fff640 1 -- 172.21.15.178:0/2260475761 reap_dead start 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 shutdown_connections 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 >> 172.21.15.178:0/2260475761 conn(0x555a71c22250 msgr2=0x555a71c275b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 shutdown_connections 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 -- 172.21.15.178:0/2260475761 wait complete. 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 -- 172.21.15.178:0/4240662196 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ea4036b40 msgr2=0x7f6ea4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 --2- 172.21.15.178:0/4240662196 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ea4036b40 0x7f6ea4039000 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x555a71c05f10 tx=0x7f6fbc04b100 comp rx=0 tx=0).stop 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 -- 172.21.15.178:0/4240662196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c19220 msgr2=0x555a71c19640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 --2- 172.21.15.178:0/4240662196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c19220 0x555a71c19640 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x555a71c05e70 tx=0x7f6fc4018830 comp rx=0 tx=0).stop 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 -- 172.21.15.178:0/4240662196 shutdown_connections 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 --2- 172.21.15.178:0/4240662196 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ea4036b40 0x7f6ea4039000 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 --2- 172.21.15.178:0/4240662196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71c19220 0x555a71c19640 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.544+0000 7f6fcf430800 1 -- 172.21.15.178:0/4240662196 >> 172.21.15.178:0/4240662196 conn(0x555a71c0e1b0 msgr2=0x555a71c10d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 -- 172.21.15.178:0/4240662196 shutdown_connections 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 -- 172.21.15.178:0/4240662196 wait complete. 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555a71c07dc0 msgr2=0x555a71c0a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555a71c07dc0 0x555a71c0a1b0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555a71b0bd20 msgr2=0x555a71c054a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555a71b0bd20 0x555a71c054a0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6eb0036b40 msgr2=0x7f6eb0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6eb0036b40 0x7f6eb0039000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4057000 tx=0x7f6fb4052000 comp rx=0 tx=0).stop 2024-09-21T09:05:02.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71a78dd0 msgr2=0x555a71bfe430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71a78dd0 0x555a71bfe430 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc002000 tx=0x7f6fbc000bc0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 shutdown_connections 2024-09-21T09:05:02.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x555a71c07dc0 0x555a71c0a1b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x555a71b0bd20 0x555a71c054a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6eb0036b40 0x7f6eb0039000 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 --2- 172.21.15.178:0/254794334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a71a78dd0 0x555a71bfe430 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 >> 172.21.15.178:0/254794334 conn(0x555a71affdf0 msgr2=0x555a71bf0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 shutdown_connections 2024-09-21T09:05:02.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.545+0000 7f6fcf430800 1 -- 172.21.15.178:0/254794334 wait complete. 2024-09-21T09:05:02.555 INFO:teuthology.orchestra.run.smithi178.stdout:{"entries":[],"summary":[]} 2024-09-21T09:05:02.555 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-21T09:05:02.555 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-21T09:05:02.556 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-21T09:05:02.556 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-21T09:05:02.600 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:02.600 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:02.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.600+0000 7f096a324800 1 Processor -- start 2024-09-21T09:05:02.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.600+0000 7f096a324800 1 -- start start 2024-09-21T09:05:02.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.600+0000 7f096a324800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x564c11daaa20 0x564c11dace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.600+0000 7f096a324800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564c11c65b30 con 0x564c11da4940 2024-09-21T09:05:02.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.600+0000 7f096a324800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x564c11c47360 con 0x564c11daaa20 2024-09-21T09:05:02.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.600+0000 7f095ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x564c11daaa20 0x564c11dace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.600+0000 7f095ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x564c11daaa20 0x564c11dace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60122/0 (socket says 172.21.15.178:60122) 2024-09-21T09:05:02.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.600+0000 7f095ffff640 1 -- 172.21.15.178:0/2142659997 learned_addr learned my addr 172.21.15.178:0/2142659997 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.600+0000 7f0966016640 1 --1- 172.21.15.178:0/2142659997 >> v1:172.21.15.44:6789/0 conn(0x564c11da4940 0x564c11da4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40424/0 (socket says 172.21.15.178:40424) 2024-09-21T09:05:02.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.600+0000 7f095ffff640 1 -- 172.21.15.178:0/2142659997 >> v1:172.21.15.44:6789/0 conn(0x564c11da4940 legacy=0x564c11da4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.600+0000 7f095ffff640 1 -- 172.21.15.178:0/2142659997 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c11c6de00 con 0x564c11daaa20 2024-09-21T09:05:02.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.602+0000 7f095ffff640 1 --2- 172.21.15.178:0/2142659997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11daaa20 0x564c11dace10 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f095000a520 tx=0x7f0950045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b94e4f84a35c7b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.602+0000 7f0965815640 1 -- 172.21.15.178:0/2142659997 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0950055070 con 0x564c11daaa20 2024-09-21T09:05:02.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.602+0000 7f0965815640 1 -- 172.21.15.178:0/2142659997 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09500515b0 con 0x564c11daaa20 2024-09-21T09:05:02.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.602+0000 7f0965815640 1 -- 172.21.15.178:0/2142659997 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09500518d0 con 0x564c11daaa20 2024-09-21T09:05:02.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.603+0000 7f096a324800 1 -- 172.21.15.178:0/2142659997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11daaa20 msgr2=0x564c11dace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.603+0000 7f096a324800 1 --2- 172.21.15.178:0/2142659997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11daaa20 0x564c11dace10 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f095000a520 tx=0x7f0950045ba0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.603+0000 7f096a324800 1 -- 172.21.15.178:0/2142659997 shutdown_connections 2024-09-21T09:05:02.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.603+0000 7f096a324800 1 --2- 172.21.15.178:0/2142659997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11daaa20 0x564c11dace10 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.603+0000 7f096a324800 1 -- 172.21.15.178:0/2142659997 >> 172.21.15.178:0/2142659997 conn(0x564c11da0550 msgr2=0x564c11da2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.603+0000 7f096a324800 1 -- 172.21.15.178:0/2142659997 shutdown_connections 2024-09-21T09:05:02.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.603+0000 7f096a324800 1 -- 172.21.15.178:0/2142659997 wait complete. 2024-09-21T09:05:02.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.617+0000 7f096a324800 1 Processor -- start 2024-09-21T09:05:02.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.617+0000 7f096a324800 1 -- start start 2024-09-21T09:05:02.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.617+0000 7f096a324800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11da4940 0x564c11e95860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.617+0000 7f096a324800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564c11cf2360 con 0x564c11da4940 2024-09-21T09:05:02.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.617+0000 7f0966016640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11da4940 0x564c11e95860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.617+0000 7f0966016640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11da4940 0x564c11e95860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60134/0 (socket says 172.21.15.178:60134) 2024-09-21T09:05:02.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.617+0000 7f0966016640 1 -- 172.21.15.178:0/2262404305 learned_addr learned my addr 172.21.15.178:0/2262404305 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.617+0000 7f0966016640 1 -- 172.21.15.178:0/2262404305 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c11c3fbc0 con 0x564c11da4940 2024-09-21T09:05:02.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.618+0000 7f0966016640 1 --2- 172.21.15.178:0/2262404305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11da4940 0x564c11e95860 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f095800b230 tx=0x7f095800b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54629634d78a865 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.618+0000 7f0854608640 1 -- 172.21.15.178:0/2262404305 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f095800e5c0 con 0x564c11da4940 2024-09-21T09:05:02.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.618+0000 7f0854608640 1 -- 172.21.15.178:0/2262404305 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0958006070 con 0x564c11da4940 2024-09-21T09:05:02.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.618+0000 7f0854608640 1 -- 172.21.15.178:0/2262404305 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f095800e890 con 0x564c11da4940 2024-09-21T09:05:02.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.619+0000 7f096a324800 1 -- 172.21.15.178:0/2262404305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11da4940 msgr2=0x564c11e95860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.619+0000 7f096a324800 1 --2- 172.21.15.178:0/2262404305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11da4940 0x564c11e95860 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f095800b230 tx=0x7f095800b6f0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.619+0000 7f096a324800 1 -- 172.21.15.178:0/2262404305 shutdown_connections 2024-09-21T09:05:02.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.619+0000 7f096a324800 1 --2- 172.21.15.178:0/2262404305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11da4940 0x564c11e95860 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.619+0000 7f096a324800 1 -- 172.21.15.178:0/2262404305 >> 172.21.15.178:0/2262404305 conn(0x564c11da0550 msgr2=0x564c11e91220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.619+0000 7f096a324800 1 -- 172.21.15.178:0/2262404305 shutdown_connections 2024-09-21T09:05:02.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.619+0000 7f096a324800 1 -- 172.21.15.178:0/2262404305 wait complete. 2024-09-21T09:05:02.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.619+0000 7f096a324800 1 Processor -- start 2024-09-21T09:05:02.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.619+0000 7f096a324800 1 -- start start 2024-09-21T09:05:02.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.619+0000 7f096a324800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11da4940 0x564c11da7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.619+0000 7f096a324800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564c11dad650 con 0x564c11da4940 2024-09-21T09:05:02.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.619+0000 7f0966016640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11da4940 0x564c11da7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.619+0000 7f0966016640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11da4940 0x564c11da7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60146/0 (socket says 172.21.15.178:60146) 2024-09-21T09:05:02.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.619+0000 7f0966016640 1 -- 172.21.15.178:0/507838472 learned_addr learned my addr 172.21.15.178:0/507838472 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.620+0000 7f0966016640 1 -- 172.21.15.178:0/507838472 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c11c53fe0 con 0x564c11da4940 2024-09-21T09:05:02.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.620+0000 7f0966016640 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11da4940 0x564c11da7320 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0958000fd0 tx=0x7f0958000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.620+0000 7f0852e05640 1 -- 172.21.15.178:0/507838472 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f095800f8d0 con 0x564c11da4940 2024-09-21T09:05:02.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.620+0000 7f0852e05640 1 -- 172.21.15.178:0/507838472 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f095800fa90 con 0x564c11da4940 2024-09-21T09:05:02.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.620+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c11da5a10 con 0x564c11da4940 2024-09-21T09:05:02.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.620+0000 7f0852e05640 1 -- 172.21.15.178:0/507838472 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f095800fdb0 con 0x564c11da4940 2024-09-21T09:05:02.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.620+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c11da5f30 con 0x564c11da4940 2024-09-21T09:05:02.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.621+0000 7f0852e05640 1 -- 172.21.15.178:0/507838472 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0958017070 con 0x564c11da4940 2024-09-21T09:05:02.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.621+0000 7f0852e05640 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f084c036b90 0x7f084c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.621+0000 7f0852e05640 1 -- 172.21.15.178:0/507838472 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f0958015020 con 0x564c11da4940 2024-09-21T09:05:02.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.621+0000 7f095ffff640 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f084c036b90 0x7f084c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.621+0000 7f096a324800 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564c11daaa20 0x564c11ea6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.621+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11ea6b70 con 0x564c11daaa20 2024-09-21T09:05:02.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.621+0000 7f0966817640 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564c11daaa20 0x564c11ea6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.622+0000 7f095ffff640 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f084c036b90 0x7f084c039050 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0950057000 tx=0x7f0950052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.622+0000 7f0966817640 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564c11daaa20 0x564c11ea6630 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.622+0000 7f0966817640 1 -- 172.21.15.178:0/507838472 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f096000a4a0 con 0x564c11daaa20 2024-09-21T09:05:02.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.622+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11ea6f10 con 0x564c11daaa20 2024-09-21T09:05:02.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.622+0000 7f0966817640 1 -- 172.21.15.178:0/507838472 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f096000a4a0 con 0x564c11daaa20 2024-09-21T09:05:02.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.622+0000 7f096a324800 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564c11ea8d20 0x564c11eab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.622+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11eab800 con 0x564c11ea8d20 2024-09-21T09:05:02.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.623+0000 7f0966016640 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564c11ea8d20 0x564c11eab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.623+0000 7f0966016640 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564c11ea8d20 0x564c11eab110 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.623+0000 7f0966016640 1 -- 172.21.15.178:0/507838472 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f095802e070 con 0x564c11ea8d20 2024-09-21T09:05:02.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.623+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11ea7bc0 con 0x564c11daaa20 2024-09-21T09:05:02.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.624+0000 7f0966817640 1 -- 172.21.15.178:0/507838472 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f096000a4a0 con 0x564c11daaa20 2024-09-21T09:05:02.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.624+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11ea80a0 con 0x564c11daaa20 2024-09-21T09:05:02.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.624+0000 7f0966817640 1 -- 172.21.15.178:0/507838472 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f096000a4a0 con 0x564c11daaa20 2024-09-21T09:05:02.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.624+0000 7f096a324800 1 Processor -- start 2024-09-21T09:05:02.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.624+0000 7f096a324800 1 -- start start 2024-09-21T09:05:02.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.624+0000 7f096a324800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11eba180 0x564c11eba5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.624+0000 7f096a324800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564c11c41580 con 0x564c11eba180 2024-09-21T09:05:02.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.625+0000 7f0966817640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11eba180 0x564c11eba5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.625+0000 7f0966817640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11eba180 0x564c11eba5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60148/0 (socket says 172.21.15.178:60148) 2024-09-21T09:05:02.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.625+0000 7f0966817640 1 -- 172.21.15.178:0/3656177116 learned_addr learned my addr 172.21.15.178:0/3656177116 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.625+0000 7f0966817640 1 -- 172.21.15.178:0/3656177116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c11ebaae0 con 0x564c11eba180 2024-09-21T09:05:02.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.625+0000 7f0966817640 1 --2- 172.21.15.178:0/3656177116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11eba180 0x564c11eba5a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x564c11da7880 tx=0x7f0960018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.625+0000 7f084bfff640 1 -- 172.21.15.178:0/3656177116 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0960014450 con 0x564c11eba180 2024-09-21T09:05:02.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.625+0000 7f084bfff640 1 -- 172.21.15.178:0/3656177116 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0960014610 con 0x564c11eba180 2024-09-21T09:05:02.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.625+0000 7f084bfff640 1 -- 172.21.15.178:0/3656177116 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0960014930 con 0x564c11eba180 2024-09-21T09:05:02.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.625+0000 7f096a324800 1 -- 172.21.15.178:0/3656177116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c11ebad70 con 0x564c11eba180 2024-09-21T09:05:02.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.625+0000 7f096a324800 1 -- 172.21.15.178:0/3656177116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c11ebda50 con 0x564c11eba180 2024-09-21T09:05:02.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.626+0000 7f084bfff640 1 -- 172.21.15.178:0/3656177116 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0960011040 con 0x564c11eba180 2024-09-21T09:05:02.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.626+0000 7f084bfff640 1 --2- 172.21.15.178:0/3656177116 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0840036b40 0x7f0840039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.626+0000 7f084bfff640 1 -- 172.21.15.178:0/3656177116 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f096001e070 con 0x564c11eba180 2024-09-21T09:05:02.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.626+0000 7f0966016640 1 --2- 172.21.15.178:0/3656177116 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0840036b40 0x7f0840039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.627+0000 7f096a324800 1 Processor -- start 2024-09-21T09:05:02.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.627+0000 7f0966016640 1 --2- 172.21.15.178:0/3656177116 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0840036b40 0x7f0840039000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x564c11da6390 tx=0x7f095804b630 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.627+0000 7f096a324800 1 -- start start 2024-09-21T09:05:02.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.627+0000 7f096a324800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11ec6e30 0x564c11ec7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.627+0000 7f096a324800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564c11e96010 con 0x564c11ec6e30 2024-09-21T09:05:02.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.627+0000 7f0966817640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11ec6e30 0x564c11ec7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.627+0000 7f0966817640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11ec6e30 0x564c11ec7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60158/0 (socket says 172.21.15.178:60158) 2024-09-21T09:05:02.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.627+0000 7f0966817640 1 -- 172.21.15.178:0/914030967 learned_addr learned my addr 172.21.15.178:0/914030967 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.627+0000 7f0966817640 1 -- 172.21.15.178:0/914030967 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c11ec7800 con 0x564c11ec6e30 2024-09-21T09:05:02.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.627+0000 7f0966817640 1 --2- 172.21.15.178:0/914030967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11ec6e30 0x564c11ec7230 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f096004cba0 tx=0x7f096002b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c329bbc0c539d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.627+0000 7f0849ffb640 1 -- 172.21.15.178:0/914030967 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0960028040 con 0x564c11ec6e30 2024-09-21T09:05:02.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.628+0000 7f0849ffb640 1 -- 172.21.15.178:0/914030967 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09600400c0 con 0x564c11ec6e30 2024-09-21T09:05:02.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.628+0000 7f0849ffb640 1 -- 172.21.15.178:0/914030967 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0960016980 con 0x564c11ec6e30 2024-09-21T09:05:02.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.628+0000 7f096a324800 1 -- 172.21.15.178:0/914030967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11ec6e30 msgr2=0x564c11ec7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.628+0000 7f096a324800 1 --2- 172.21.15.178:0/914030967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11ec6e30 0x564c11ec7230 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f096004cba0 tx=0x7f096002b410 comp rx=0 tx=0).stop 2024-09-21T09:05:02.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.628+0000 7f096a324800 1 -- 172.21.15.178:0/914030967 shutdown_connections 2024-09-21T09:05:02.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.628+0000 7f096a324800 1 --2- 172.21.15.178:0/914030967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11ec6e30 0x564c11ec7230 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.628+0000 7f096a324800 1 -- 172.21.15.178:0/914030967 >> 172.21.15.178:0/914030967 conn(0x564c11ec3190 msgr2=0x564c11ec1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.628+0000 7f096a324800 1 -- 172.21.15.178:0/914030967 shutdown_connections 2024-09-21T09:05:02.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.628+0000 7f096a324800 1 -- 172.21.15.178:0/914030967 wait complete. 2024-09-21T09:05:02.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.628+0000 7f096a324800 1 Processor -- start 2024-09-21T09:05:02.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.628+0000 7f096a324800 1 -- start start 2024-09-21T09:05:02.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.628+0000 7f096a324800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11ec6e30 0x564c11ece2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.628+0000 7f096a324800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564c11ec7e70 con 0x564c11ec6e30 2024-09-21T09:05:02.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.629+0000 7f0966817640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11ec6e30 0x564c11ece2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.629+0000 7f0966817640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11ec6e30 0x564c11ece2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60162/0 (socket says 172.21.15.178:60162) 2024-09-21T09:05:02.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.629+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 learned_addr learned my addr 172.21.15.178:0/2888368496 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.629+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c11ece7e0 con 0x564c11ec6e30 2024-09-21T09:05:02.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.629+0000 7f0966817640 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11ec6e30 0x564c11ece2a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f096003f040 tx=0x7f096004cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.629+0000 7f0837fff640 1 -- 172.21.15.178:0/2888368496 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0960028040 con 0x564c11ec6e30 2024-09-21T09:05:02.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.629+0000 7f0837fff640 1 -- 172.21.15.178:0/2888368496 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0960031030 con 0x564c11ec6e30 2024-09-21T09:05:02.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.629+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c11ecea70 con 0x564c11ec6e30 2024-09-21T09:05:02.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.629+0000 7f0837fff640 1 -- 172.21.15.178:0/2888368496 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0960016ab0 con 0x564c11ec6e30 2024-09-21T09:05:02.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.629+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c11ed1720 con 0x564c11ec6e30 2024-09-21T09:05:02.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.630+0000 7f0837fff640 1 -- 172.21.15.178:0/2888368496 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f096004e070 con 0x564c11ec6e30 2024-09-21T09:05:02.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.630+0000 7f0837fff640 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0830036aa0 0x7f0830038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.630+0000 7f0837fff640 1 -- 172.21.15.178:0/2888368496 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f096000e040 con 0x564c11ec6e30 2024-09-21T09:05:02.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.630+0000 7f0966016640 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0830036aa0 0x7f0830038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.631+0000 7f0966016640 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0830036aa0 0x7f0830038f60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f095801dfd0 tx=0x7f0958035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.631+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.631+0000 7f096a324800 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564c11ed9ec0 0x564c11edc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.631+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11edcad0 con 0x564c11ed9ec0 2024-09-21T09:05:02.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.631+0000 7f095ffff640 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564c11ed9ec0 0x564c11edc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.631+0000 7f095ffff640 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564c11ed9ec0 0x564c11edc380 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f096a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f096a324800 20 realm 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11edcf00 con 0x564c11ed9ec0 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f096a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f096a324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11edd7d0 con 0x564c11ed9ec0 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f096a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11eddb70 con 0x564c11ed9ec0 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f096a324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:02.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.632+0000 7f096a324800 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564c11ede8d0 0x564c11ee0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.633+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee12d0 con 0x564c11ede8d0 2024-09-21T09:05:02.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.633+0000 7f0966817640 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564c11ede8d0 0x564c11ee0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.633+0000 7f0966817640 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564c11ede8d0 0x564c11ee0cc0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.633+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.633+0000 7f096a324800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:02.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.633+0000 7f096a324800 20 searching for the correct realm 2024-09-21T09:05:02.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.633+0000 7f096a324800 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564c11ee3260 0x564c11ee5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.633+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ee3260 2024-09-21T09:05:02.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.634+0000 7f0966016640 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564c11ee3260 0x564c11ee5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.634+0000 7f0966016640 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564c11ee3260 0x564c11ee5720 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.634+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.634+0000 7f0966016640 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f095800f070 0x7f0958019860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.642 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.634+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x7f095800f070 2024-09-21T09:05:02.642 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.634+0000 7f095ffff640 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f095800f070 0x7f0958019860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.642 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.634+0000 7f095ffff640 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f095800f070 0x7f0958019860 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.635+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.635+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ede8d0 2024-09-21T09:05:02.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.635+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.635+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ed9ec0 2024-09-21T09:05:02.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.635+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.635+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ed9ec0 2024-09-21T09:05:02.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.635+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.635+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ede8d0 2024-09-21T09:05:02.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.636+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.636+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ede8d0 2024-09-21T09:05:02.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.636+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.636+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x7f095800f070 2024-09-21T09:05:02.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.636+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.636+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ee3260 2024-09-21T09:05:02.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.636+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.636+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ed9ec0 2024-09-21T09:05:02.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.637+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.637+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ede8d0 2024-09-21T09:05:02.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.637+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.637+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ed9ec0 2024-09-21T09:05:02.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.637+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.637+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x7f095800f070 2024-09-21T09:05:02.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.637+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.637+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ee3260 2024-09-21T09:05:02.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.638+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.638+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ee3260 2024-09-21T09:05:02.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.638+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.638+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ede8d0 2024-09-21T09:05:02.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.638+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.638+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ee3260 2024-09-21T09:05:02.652 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.639+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.639+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ee3260 2024-09-21T09:05:02.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.639+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.639+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ed9ec0 2024-09-21T09:05:02.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.639+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.639+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ed9ec0 2024-09-21T09:05:02.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.639+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.639+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ede8d0 2024-09-21T09:05:02.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.640+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.640+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ee3260 2024-09-21T09:05:02.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.640+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.640+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x7f095800f070 2024-09-21T09:05:02.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.640+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.640+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ed9ec0 2024-09-21T09:05:02.653 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.640+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.640+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ede8d0 2024-09-21T09:05:02.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.641+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.641+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ee3260 2024-09-21T09:05:02.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.641+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.641+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x7f095800f070 2024-09-21T09:05:02.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.641+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.641+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x7f095800f070 2024-09-21T09:05:02.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.641+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.641+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ee3260 2024-09-21T09:05:02.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ede8d0 2024-09-21T09:05:02.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x564c11ed9ec0 2024-09-21T09:05:02.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee5df0 con 0x7f095800f070 2024-09-21T09:05:02.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f096a324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:02.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f096a324800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:02.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f096a324800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:02.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f096a324800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:02.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f096a324800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:02.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f096a324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:02.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.642+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee1b20 con 0x564c11ed9ec0 2024-09-21T09:05:02.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.655 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee1f10 con 0x564c11ed9ec0 2024-09-21T09:05:02.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:02.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee6270 con 0x564c11ed9ec0 2024-09-21T09:05:02.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:02.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 20 zone default found 2024-09-21T09:05:02.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 4 Realm: () 2024-09-21T09:05:02.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:02.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:02.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:02.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 20 zonegroup default 2024-09-21T09:05:02.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.643+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee6300 con 0x564c11ede8d0 2024-09-21T09:05:02.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.644+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.644+0000 7f096a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.644+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.644+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee85d0 con 0x564c11ee3260 2024-09-21T09:05:02.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.644+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.644+0000 7f096a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.644+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.644+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee8970 con 0x564c11ee3260 2024-09-21T09:05:02.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.644+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.644+0000 7f096a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.644+0000 7f096a324800 20 started sync module instance, tier type = 2024-09-21T09:05:02.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.644+0000 7f096a324800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:02.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.644+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee7a60 con 0x7f095800f070 2024-09-21T09:05:02.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.645+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.645+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94884718346112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee7a60 con 0x7f095800f070 2024-09-21T09:05:02.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.645+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee9380 con 0x564c11ed9ec0 2024-09-21T09:05:02.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.646+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94884718346112] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.647+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.647+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94884718343600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee9380 con 0x564c11ed9ec0 2024-09-21T09:05:02.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.647+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11ee9e50 con 0x564c11ee3260 2024-09-21T09:05:02.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.648+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94884718343600] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.648+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.648+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94884718352704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11eea1f0 con 0x564c11ee3260 2024-09-21T09:05:02.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.648+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11eeac20 con 0x7f095800f070 2024-09-21T09:05:02.661 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.649+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.649+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94884718356272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11eeb4f0 con 0x7f095800f070 2024-09-21T09:05:02.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.649+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11eebfe0 con 0x564c11ed9ec0 2024-09-21T09:05:02.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.649+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94884718352704] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.650+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94884718356272] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.650+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.650+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94884718361264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11eeaff0 con 0x564c11ed9ec0 2024-09-21T09:05:02.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.650+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11eec880 con 0x564c11ede8d0 2024-09-21T09:05:02.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.651+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.651+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94884718363600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11eeaff0 con 0x564c11ede8d0 2024-09-21T09:05:02.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.651+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11eed7b0 con 0x564c11ede8d0 2024-09-21T09:05:02.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.651+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94884718361264] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.662 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.652+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94884718363600] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.652+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.652+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94884718367392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11eecc20 con 0x564c11ede8d0 2024-09-21T09:05:02.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.652+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11eedd90 con 0x564c11ede8d0 2024-09-21T09:05:02.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.653+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94884718367392] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.654+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.654+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94884718350032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11eedd90 con 0x564c11ede8d0 2024-09-21T09:05:02.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.654+0000 7f096a324800 20 add_watcher() i=0 2024-09-21T09:05:02.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.654+0000 7f096a324800 20 add_watcher() i=1 2024-09-21T09:05:02.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.654+0000 7f096a324800 20 add_watcher() i=2 2024-09-21T09:05:02.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.654+0000 7f096a324800 20 add_watcher() i=3 2024-09-21T09:05:02.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.654+0000 7f096a324800 20 add_watcher() i=4 2024-09-21T09:05:02.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.654+0000 7f096a324800 20 add_watcher() i=5 2024-09-21T09:05:02.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.654+0000 7f096a324800 20 add_watcher() i=6 2024-09-21T09:05:02.663 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.654+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94884718350032] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.654+0000 7f096a324800 20 add_watcher() i=7 2024-09-21T09:05:02.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.654+0000 7f096a324800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:02.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.654+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11ef1060 con 0x564c11ed9ec0 2024-09-21T09:05:02.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.655+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.655+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94884718369360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11eee320 con 0x564c11ed9ec0 2024-09-21T09:05:02.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.656+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94884718369360] v31'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.656+0000 7f081cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:02.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.656+0000 7f096a324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:02.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.656+0000 7f096a324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:02.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.656+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11ef0910 con 0x564c11ed9ec0 2024-09-21T09:05:02.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.657+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.657+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efa1e0 con 0x564c11ede8d0 2024-09-21T09:05:02.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.658+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.664 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.658+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efa1e0 con 0x564c11ee3260 2024-09-21T09:05:02.665 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.659+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.665 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.659+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efac80 con 0x564c11ed9ec0 2024-09-21T09:05:02.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.660+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'233 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.660+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11ef9790 con 0x7f095800f070 2024-09-21T09:05:02.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.662+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.662+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11ef9790 con 0x564c11ee3260 2024-09-21T09:05:02.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.662+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'51 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.663+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbac0 con 0x564c11ed9ec0 2024-09-21T09:05:02.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.664+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.666 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.664+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbac0 con 0x564c11ede8d0 2024-09-21T09:05:02.667 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.665+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.667 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.665+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbac0 con 0x7f095800f070 2024-09-21T09:05:02.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.666+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.668 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.666+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbb50 con 0x564c11ee3260 2024-09-21T09:05:02.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.667+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.669 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.667+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbbe0 con 0x7f095800f070 2024-09-21T09:05:02.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.668+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.670 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.668+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbbe0 con 0x564c11ede8d0 2024-09-21T09:05:02.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.669+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.669+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbbe0 con 0x7f095800f070 2024-09-21T09:05:02.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.670+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.672 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.670+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbbe0 con 0x564c11ede8d0 2024-09-21T09:05:02.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.671+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.673 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.671+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc40 con 0x564c11ed9ec0 2024-09-21T09:05:02.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.672+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'234 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.672+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc40 con 0x564c11ee3260 2024-09-21T09:05:02.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.673+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'68 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.674+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbbe0 con 0x7f095800f070 2024-09-21T09:05:02.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.674+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.674+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbbe0 con 0x564c11ee3260 2024-09-21T09:05:02.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.675+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.675+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc00 con 0x564c11ed9ec0 2024-09-21T09:05:02.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.677+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.677+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc00 con 0x564c11ed9ec0 2024-09-21T09:05:02.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.678+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'235 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.678+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc00 con 0x564c11ee3260 2024-09-21T09:05:02.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.679+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'69 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.681 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.679+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc00 con 0x7f095800f070 2024-09-21T09:05:02.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.680+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.680+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc00 con 0x564c11ee3260 2024-09-21T09:05:02.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.681+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.681+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc00 con 0x564c11ee3260 2024-09-21T09:05:02.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.682+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.682+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc00 con 0x564c11ee3260 2024-09-21T09:05:02.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.683+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.683+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc00 con 0x564c11ee3260 2024-09-21T09:05:02.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.684+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'52 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.684+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc00 con 0x564c11ede8d0 2024-09-21T09:05:02.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.685+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.685+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc00 con 0x564c11ee3260 2024-09-21T09:05:02.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.686+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.688 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.686+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc00 con 0x564c11ede8d0 2024-09-21T09:05:02.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.687+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.687+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc00 con 0x564c11ee3260 2024-09-21T09:05:02.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.688+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'70 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.688+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc00 con 0x564c11ede8d0 2024-09-21T09:05:02.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.689+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.689+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11efbc00 con 0x7f095800f070 2024-09-21T09:05:02.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.691+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.691+0000 7f07977fe640 20 reqs_thread_entry: start 2024-09-21T09:05:02.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.691+0000 7f096a324800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:02.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.691+0000 7f096a324800 20 Filter name: none 2024-09-21T09:05:02.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.692+0000 7f07957fa640 20 reqs_thread_entry: start 2024-09-21T09:05:02.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.692+0000 7f096a324800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T09:05:02.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.692+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.692+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f26cd0 con 0x564c11ed9ec0 2024-09-21T09:05:02.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.692+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.692+0000 7f096a324800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T09:05:02.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.692+0000 7f096a324800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T09:05:02.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.692+0000 7f096a324800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T09:05:02.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.692+0000 7f096a324800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:05:02.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.692+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f26c50 con 0x7f095800f070 2024-09-21T09:05:02.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.692+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv45 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.692+0000 7f096a324800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7 : miss 2024-09-21T09:05:02.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.692+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.692+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:96 8.14 8:299fa332:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f29260 con 0x564c11ee3260 2024-09-21T09:05:02.696 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.693+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(96 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.693+0000 7f096a324800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T09:05:02.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.693+0000 7f096a324800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7 info.flags=0x17 2024-09-21T09:05:02.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.693+0000 7f096a324800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7 to cache LRU end 2024-09-21T09:05:02.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.693+0000 7f096a324800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:05:02.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.693+0000 7f096a324800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T09:05:02.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.693+0000 7f096a324800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7 2024-09-21T09:05:02.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.693+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:97 4.16 4:6b838263:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa6990 con 0x564c11ee3260 2024-09-21T09:05:02.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.693+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 27 ==== osd_op_reply(97 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.693+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:98 4.3d 4:bdbf0ad0:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa69d0 con 0x564c11ee3260 2024-09-21T09:05:02.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.694+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 28 ==== osd_op_reply(98 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.694+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:99 4.5 4:a10aa42b:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa69d0 con 0x564c11ee3260 2024-09-21T09:05:02.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.694+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 29 ==== osd_op_reply(99 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.694+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:100 4.2e 4:77dddb9c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa69d0 con 0x564c11ee3260 2024-09-21T09:05:02.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.694+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 30 ==== osd_op_reply(100 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.698 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.694+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:101 4.38 4:1f451489:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa69d0 con 0x564c11ed9ec0 2024-09-21T09:05:02.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.695+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(101 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.4 [call out=425b] v0'0 uv9 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.695+0000 7f096a324800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-21T09:05:02.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.695+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:102 4.3a 4:5e3052e7:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa69d0 con 0x564c11ee3260 2024-09-21T09:05:02.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.695+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 31 ==== osd_op_reply(102 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.695+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:103 4.2d 4:b4ea3ef7:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa6950 con 0x564c11ede8d0 2024-09-21T09:05:02.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.695+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(103 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.695+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:104 4.15 4:ab7133ef:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa6950 con 0x564c11ee3260 2024-09-21T09:05:02.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.696+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 32 ==== osd_op_reply(104 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095802e070 con 0x564c11ee3260 2024-09-21T09:05:02.700 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.696+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:105 4.6 4:63c7e65c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa6950 con 0x564c11ee3260 2024-09-21T09:05:02.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.696+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 33 ==== osd_op_reply(105 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.696+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:106 4.23 4:c7a8708b:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa6950 con 0x564c11ede8d0 2024-09-21T09:05:02.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.696+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(106 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.697+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:107 4.18 4:19947123:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa6930 con 0x7f095800f070 2024-09-21T09:05:02.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.697+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(107 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.697+0000 7f096a324800 20 get_obj_state: octx=0x7f0950051c20 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x564c11fa4a18 s->prefetch_data=0 2024-09-21T09:05:02.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.697+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:108 3.3b 3:dc05cbfe:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa5900 con 0x564c11ee3260 2024-09-21T09:05:02.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.697+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 34 ==== osd_op_reply(108 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.697+0000 7f096a324800 10 manifest: total_size = 6 2024-09-21T09:05:02.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.697+0000 7f096a324800 20 get_obj_state: setting s->obj_tag to 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.3371818162070172181 2024-09-21T09:05:02.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.697+0000 7f096a324800 20 get_obj_state: octx=0x7f0950051c20 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x564c11fa4a18 s->prefetch_data=0 2024-09-21T09:05:02.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.697+0000 7f096a324800 20 prepare_atomic_modification: state is not atomic. state=0x564c11fa4a18 2024-09-21T09:05:02.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.697+0000 7f096a324800 20 bucket index object: :.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.4 2024-09-21T09:05:02.701 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.697+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:109 4.38 4:1f451489:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa6390 con 0x564c11ed9ec0 2024-09-21T09:05:02.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.698+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(109 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.4 [stat,call,call] v31'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.702 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.698+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:110 3.3b 3:dc05cbfe:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa6390 con 0x564c11ee3260 2024-09-21T09:05:02.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 35 ==== osd_op_reply(110 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7_15f6f8dc036519d7fe15b39338f6e5db [call] v31'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:111 4.38 4:1f451489:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f2e060 con 0x564c11ed9ec0 2024-09-21T09:05:02.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f096a324800 20 list_objects_ordered: starting attempt 1 2024-09-21T09:05:02.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f096a324800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-21T09:05:02.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:112 4.16 4:6b838263:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f2e060 con 0x564c11ee3260 2024-09-21T09:05:02.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:113 4.3d 4:bdbf0ad0:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f32330 con 0x564c11ee3260 2024-09-21T09:05:02.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:114 4.5 4:a10aa42b:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f34c50 con 0x564c11ee3260 2024-09-21T09:05:02.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:115 4.2e 4:77dddb9c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f2e060 con 0x564c11ee3260 2024-09-21T09:05:02.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:116 4.38 4:1f451489:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f39a70 con 0x564c11ed9ec0 2024-09-21T09:05:02.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:117 4.3a 4:5e3052e7:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f3c6e0 con 0x564c11ee3260 2024-09-21T09:05:02.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:118 4.2d 4:b4ea3ef7:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f3f1e0 con 0x564c11ede8d0 2024-09-21T09:05:02.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:119 4.15 4:ab7133ef:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f41ff0 con 0x564c11ee3260 2024-09-21T09:05:02.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:120 4.6 4:63c7e65c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f44e70 con 0x564c11ee3260 2024-09-21T09:05:02.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:121 4.23 4:c7a8708b:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f47ca0 con 0x564c11ede8d0 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:122 4.18 4:19947123:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x7f095800f070 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 36 ==== osd_op_reply(112 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 37 ==== osd_op_reply(113 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.700+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 38 ==== osd_op_reply(114 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 21 ==== osd_op_reply(122 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 39 ==== osd_op_reply(115 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(118 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 40 ==== osd_op_reply(117 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 41 ==== osd_op_reply(119 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(121 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 42 ==== osd_op_reply(120 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(111 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.4 [stat,call,call] v31'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f0849ffb640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(116 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.4 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f096a324800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-21T09:05:02.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f096a324800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-21T09:05:02.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f096a324800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-21T09:05:02.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f096a324800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-21T09:05:02.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f096a324800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7])"; uploads.size()=0; is_truncated=0 2024-09-21T09:05:02.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:123 4.16 4:6b838263:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f47ca0 con 0x564c11ee3260 2024-09-21T09:05:02.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:124 4.3d 4:bdbf0ad0:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f41ff0 con 0x564c11ee3260 2024-09-21T09:05:02.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:125 4.5 4:a10aa42b:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ee3260 2024-09-21T09:05:02.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:126 4.2e 4:77dddb9c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f47ca0 con 0x564c11ee3260 2024-09-21T09:05:02.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.701+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:127 4.38 4:1f451489:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f41ff0 con 0x564c11ed9ec0 2024-09-21T09:05:02.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:128 4.3a 4:5e3052e7:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f47ca0 con 0x564c11ee3260 2024-09-21T09:05:02.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:129 4.2d 4:b4ea3ef7:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ede8d0 2024-09-21T09:05:02.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:130 4.15 4:ab7133ef:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f41b60 con 0x564c11ee3260 2024-09-21T09:05:02.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:131 4.6 4:63c7e65c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f47ca0 con 0x564c11ee3260 2024-09-21T09:05:02.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:132 4.23 4:c7a8708b:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ede8d0 2024-09-21T09:05:02.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:133 4.18 4:19947123:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f41b60 con 0x7f095800f070 2024-09-21T09:05:02.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== osd_op_reply(127 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.4 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(129 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(132 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 43 ==== osd_op_reply(123 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 44 ==== osd_op_reply(124 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 45 ==== osd_op_reply(125 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 46 ==== osd_op_reply(126 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 22 ==== osd_op_reply(133 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 47 ==== osd_op_reply(128 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 48 ==== osd_op_reply(130 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 49 ==== osd_op_reply(131 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.702+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x7f095800f070 2024-09-21T09:05:02.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.703+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 23 ==== osd_op_reply(134 foo.buckets [call] v31'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.703+0000 7f096a324800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T09:05:02.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.703+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.704+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x7f095800f070 2024-09-21T09:05:02.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.704+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 24 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv42 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.704+0000 7f096a324800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T09:05:02.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.704+0000 7f096a324800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T09:05:02.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.704+0000 7f096a324800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T09:05:02.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.704+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x7f095800f070 2024-09-21T09:05:02.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.705+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 25 ==== osd_op_reply(136 myfoo [call,call,delete] v31'49 uv49 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.705+0000 7f096a324800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-21T09:05:02.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.705+0000 7f096a324800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T09:05:02.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.705+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94884718714800 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa6390 con 0x564c11ede8d0 2024-09-21T09:05:02.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.706+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== watch-notify(notify (1) cookie 94884718367392 notify 133143986217 ret 0) ==== 191+0+0 (crc 0 0 0) 0x564c11efc190 con 0x564c11ede8d0 2024-09-21T09:05:02.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.706+0000 7f08497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986217 cookie 94884718367392 notifier 4784 bl.length()=149 2024-09-21T09:05:02.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.706+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 31 ==== osd_op_reply(137 notify.6 [notify cookie 94884718714800 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.706+0000 7f08497fa640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f079c0032c0 con 0x564c11ede8d0 2024-09-21T09:05:02.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.706+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 32 ==== watch-notify(notify_complete (2) cookie 94884718714800 notify 133143986217 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564c11ecea70 con 0x564c11ede8d0 2024-09-21T09:05:02.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.706+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 33 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.706+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:139 8.14 8:299fa332:root::.bucket.meta.myfoo%3a5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11fa6390 con 0x564c11ee3260 2024-09-21T09:05:02.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.707+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 50 ==== osd_op_reply(139 .bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7 [call,call,delete] v31'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.707+0000 7f096a324800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7 from cache 2024-09-21T09:05:02.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.707+0000 7f096a324800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7, ofs0, ns] 2024-09-21T09:05:02.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.707+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 94884718714752 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ede8d0 2024-09-21T09:05:02.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 34 ==== watch-notify(notify (1) cookie 94884718363600 notify 133143986218 ret 0) ==== 248+0+0 (crc 0 0 0) 0x564c11ecea70 con 0x564c11ede8d0 2024-09-21T09:05:02.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f08497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986218 cookie 94884718363600 notifier 4784 bl.length()=206 2024-09-21T09:05:02.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 35 ==== osd_op_reply(140 notify.5 [notify cookie 94884718714752 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f08497fa640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f079c0032c0 con 0x564c11ede8d0 2024-09-21T09:05:02.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 36 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 37 ==== watch-notify(notify_complete (2) cookie 94884718714752 notify 133143986218 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564c11ece7e0 con 0x564c11ede8d0 2024-09-21T09:05:02.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:142 4.16 4:6b838263:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ee3260 2024-09-21T09:05:02.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:143 4.3d 4:bdbf0ad0:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f28ad0 con 0x564c11ee3260 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:144 4.5 4:a10aa42b:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f446e0 con 0x564c11ee3260 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:145 4.2e 4:77dddb9c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ee3260 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:146 4.38 4:1f451489:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f446e0 con 0x564c11ed9ec0 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:147 4.3a 4:5e3052e7:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ee3260 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:148 4.2d 4:b4ea3ef7:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f44ac0 con 0x564c11ede8d0 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:149 4.15 4:ab7133ef:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f27790 con 0x564c11ee3260 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:150 4.6 4:63c7e65c:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ee3260 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:151 4.23 4:c7a8708b:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f42510 con 0x564c11ede8d0 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.708+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:152 4.18 4:19947123:::.dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f27790 con 0x7f095800f070 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.709+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 51 ==== osd_op_reply(142 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.0 [delete] v31'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.710+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 52 ==== osd_op_reply(145 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.3 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.710+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 53 ==== osd_op_reply(144 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.2 [delete] v31'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.710+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 38 ==== osd_op_reply(151 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.9 [delete] v31'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.710+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 54 ==== osd_op_reply(143 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.1 [delete] v31'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.710+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 55 ==== osd_op_reply(150 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.8 [delete] v31'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.710+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 39 ==== osd_op_reply(148 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.6 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.710+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 56 ==== osd_op_reply(147 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.5 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.710+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(146 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.4 [delete] v31'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.710+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 57 ==== osd_op_reply(149 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.7 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.710+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 26 ==== osd_op_reply(152 .dir.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7.10 [delete] v31'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.710+0000 7f096a324800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7 : miss 2024-09-21T09:05:02.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.710+0000 7f096a324800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.710+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:153 6.19 6:9d4d3722:::pubsub..bucket.myfoo%2f5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f42510 con 0x564c11ed9ec0 2024-09-21T09:05:02.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.711+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 35 ==== osd_op_reply(153 pubsub..bucket.myfoo/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.711+0000 7f096a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.711+0000 7f096a324800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7 info.flags=0x0 2024-09-21T09:05:02.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.711+0000 7f096a324800 10 adding default.rgw.log++pubsub..bucket.myfoo/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7 to cache LRU end 2024-09-21T09:05:02.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.711+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:154 6.19 6:9d4d3722:::pubsub..bucket.myfoo%2f5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f446e0 con 0x564c11ed9ec0 2024-09-21T09:05:02.718 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.712+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 36 ==== osd_op_reply(154 pubsub..bucket.myfoo/5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.7 [delete] v31'35 uv27 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.712+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x7f095800f070 2024-09-21T09:05:02.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.713+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 27 ==== osd_op_reply(155 foo.buckets [call] v31'50 uv50 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.713+0000 7f096a324800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-21T09:05:02.719 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.713+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ede8d0 2024-09-21T09:05:02.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.714+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 40 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v31'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.714+0000 7f096a324800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-21T09:05:02.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.714+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94884718748528 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x7f095800f070 2024-09-21T09:05:02.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.714+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 28 ==== watch-notify(notify (1) cookie 94884718356272 notify 133143986205 ret 0) ==== 212+0+0 (crc 0 0 0) 0x564c11ef9b30 con 0x7f095800f070 2024-09-21T09:05:02.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.714+0000 7f08497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986205 cookie 94884718356272 notifier 4784 bl.length()=170 2024-09-21T09:05:02.722 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.714+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 29 ==== osd_op_reply(157 notify.3 [notify cookie 94884718748528 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.714+0000 7f08497fa640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f079c0032c0 con 0x7f095800f070 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.715+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 30 ==== watch-notify(notify_complete (2) cookie 94884718748528 notify 133143986205 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564c11ef9110 con 0x7f095800f070 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.715+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 31 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.715+0000 7f096a324800 10 removing email index: foo@foo.com 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.715+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ed9ec0 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.716+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 37 ==== osd_op_reply(159 foo@foo.com [delete] v31'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.716+0000 7f096a324800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.716+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94884718748528 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x7f095800f070 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.716+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 32 ==== watch-notify(notify (1) cookie 94884718356272 notify 133143986206 ret 0) ==== 204+0+0 (crc 0 0 0) 0x564c11ef9110 con 0x7f095800f070 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.716+0000 7f0849ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986206 cookie 94884718356272 notifier 4784 bl.length()=162 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.716+0000 7f0849ffb640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f082c003d60 con 0x7f095800f070 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.716+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 33 ==== osd_op_reply(160 notify.3 [notify cookie 94884718748528 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.716+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 34 ==== watch-notify(notify_complete (2) cookie 94884718748528 notify 133143986206 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564c11ef0760 con 0x7f095800f070 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.717+0000 7f096a324800 10 removing user buckets index 2024-09-21T09:05:02.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.717+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 35 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.717+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x7f095800f070 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.718+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 36 ==== osd_op_reply(162 foo.buckets [delete] v31'51 uv51 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.718+0000 7f096a324800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.718+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94884718748528 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ede8d0 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.718+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 41 ==== watch-notify(notify (1) cookie 94884718363600 notify 133143986219 ret 0) ==== 202+0+0 (crc 0 0 0) 0x564c11ece7e0 con 0x564c11ede8d0 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.718+0000 7f08497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986219 cookie 94884718363600 notifier 4784 bl.length()=160 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.718+0000 7f08497fa640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f079c0032a0 con 0x564c11ede8d0 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.718+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 42 ==== osd_op_reply(163 notify.5 [notify cookie 94884718748528 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.719+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 43 ==== watch-notify(notify_complete (2) cookie 94884718748528 notify 133143986219 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564c11ec7800 con 0x564c11ede8d0 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.719+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 44 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.719+0000 7f096a324800 10 removing user index: foo 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.719+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ed9ec0 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.720+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 38 ==== osd_op_reply(165 foo [call,call,delete] v31'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.720+0000 7f096a324800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-21T09:05:02.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.720+0000 7f096a324800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T09:05:02.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.720+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94884718748528 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ed9ec0 2024-09-21T09:05:02.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.720+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 39 ==== watch-notify(notify (1) cookie 94884718361264 notify 133143986198 ret 0) ==== 194+0+0 (crc 0 0 0) 0x564c11ef0760 con 0x564c11ed9ec0 2024-09-21T09:05:02.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.720+0000 7f0849ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986198 cookie 94884718361264 notifier 4784 bl.length()=152 2024-09-21T09:05:02.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.720+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 40 ==== osd_op_reply(166 notify.4 [notify cookie 94884718748528 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.720+0000 7f0849ffb640 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f082c003d60 con 0x564c11ed9ec0 2024-09-21T09:05:02.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.720+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 41 ==== watch-notify(notify_complete (2) cookie 94884718748528 notify 133143986198 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564c11ef0590 con 0x564c11ed9ec0 2024-09-21T09:05:02.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.720+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 42 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.721+0000 7f081cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:02.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.721+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94884718369360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ed9ec0 2024-09-21T09:05:02.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.722+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 43 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94884718369360] v31'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.722+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94884718346112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x7f095800f070 2024-09-21T09:05:02.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.723+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 37 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94884718346112] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.723+0000 7f096a324800 20 remove_watcher() i=0 2024-09-21T09:05:02.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.723+0000 7f096a324800 2 removed watcher, disabling cache 2024-09-21T09:05:02.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.723+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94884718343600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ed9ec0 2024-09-21T09:05:02.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.724+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 44 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94884718343600] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.724+0000 7f096a324800 20 remove_watcher() i=1 2024-09-21T09:05:02.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.724+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94884718352704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ee3260 2024-09-21T09:05:02.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.725+0000 7f0966016640 1 -- 172.21.15.178:0/2888368496 <== osd.3 v2:172.21.15.178:6808/24558189 58 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94884718352704] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095806a060 con 0x564c11ee3260 2024-09-21T09:05:02.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.725+0000 7f096a324800 20 remove_watcher() i=2 2024-09-21T09:05:02.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.725+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94884718356272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x7f095800f070 2024-09-21T09:05:02.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.726+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.2 v2:172.21.15.178:6816/3267136144 38 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94884718356272] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x7f095800f070 2024-09-21T09:05:02.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.726+0000 7f096a324800 20 remove_watcher() i=3 2024-09-21T09:05:02.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.726+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94884718361264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ed9ec0 2024-09-21T09:05:02.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.727+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 <== osd.1 v2:172.21.15.178:6800/627496675 45 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94884718361264] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0950057030 con 0x564c11ed9ec0 2024-09-21T09:05:02.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.727+0000 7f096a324800 20 remove_watcher() i=4 2024-09-21T09:05:02.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.727+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94884718363600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ede8d0 2024-09-21T09:05:02.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.728+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 45 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94884718363600] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.728+0000 7f096a324800 20 remove_watcher() i=5 2024-09-21T09:05:02.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.728+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94884718367392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ede8d0 2024-09-21T09:05:02.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.729+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 46 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94884718367392] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.729+0000 7f096a324800 20 remove_watcher() i=6 2024-09-21T09:05:02.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.729+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94884718350032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564c11f4aad0 con 0x564c11ede8d0 2024-09-21T09:05:02.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.730+0000 7f0966817640 1 -- 172.21.15.178:0/2888368496 <== osd.0 v2:172.21.15.44:6800/2732047064 47 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94884718350032] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096002a070 con 0x564c11ede8d0 2024-09-21T09:05:02.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.730+0000 7f096a324800 20 remove_watcher() i=7 2024-09-21T09:05:02.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564c11ede8d0 msgr2=0x564c11ee0cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564c11ede8d0 0x564c11ee0cc0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564c11ed9ec0 msgr2=0x564c11edc380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.734 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564c11ed9ec0 0x564c11edc380 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f095800f070 msgr2=0x7f0958019860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f095800f070 0x7f0958019860 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564c11ee3260 msgr2=0x564c11ee5720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x564c11ee3260 0x564c11ee5720 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0830036aa0 msgr2=0x7f0830038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0830036aa0 0x7f0830038f60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f095801dfd0 tx=0x7f0958035000 comp rx=0 tx=0).stop 2024-09-21T09:05:02.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f095ffff640 1 -- 172.21.15.178:0/2888368496 reap_dead start 2024-09-21T09:05:02.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11ec6e30 msgr2=0x564c11ece2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11ec6e30 0x564c11ece2a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f096003f040 tx=0x7f096004cb30 comp rx=0 tx=0).stop 2024-09-21T09:05:02.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 shutdown_connections 2024-09-21T09:05:02.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 --2- 172.21.15.178:0/2888368496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11ec6e30 0x564c11ece2a0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 >> 172.21.15.178:0/2888368496 conn(0x564c11ec3190 msgr2=0x564c11ec1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 shutdown_connections 2024-09-21T09:05:02.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/2888368496 wait complete. 2024-09-21T09:05:02.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/3656177116 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0840036b40 msgr2=0x7f0840039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 --2- 172.21.15.178:0/3656177116 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0840036b40 0x7f0840039000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x564c11da6390 tx=0x7f095804b630 comp rx=0 tx=0).stop 2024-09-21T09:05:02.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/3656177116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11eba180 msgr2=0x564c11eba5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 --2- 172.21.15.178:0/3656177116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11eba180 0x564c11eba5a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x564c11da7880 tx=0x7f0960018830 comp rx=0 tx=0).stop 2024-09-21T09:05:02.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/3656177116 shutdown_connections 2024-09-21T09:05:02.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 --2- 172.21.15.178:0/3656177116 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0840036b40 0x7f0840039000 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 --2- 172.21.15.178:0/3656177116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11eba180 0x564c11eba5a0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/3656177116 >> 172.21.15.178:0/3656177116 conn(0x564c11eaf110 msgr2=0x564c11eb1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/3656177116 shutdown_connections 2024-09-21T09:05:02.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.731+0000 7f096a324800 1 -- 172.21.15.178:0/3656177116 wait complete. 2024-09-21T09:05:02.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564c11ea8d20 msgr2=0x564c11eab110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564c11ea8d20 0x564c11eab110 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564c11daaa20 msgr2=0x564c11ea6630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564c11daaa20 0x564c11ea6630 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f084c036b90 msgr2=0x7f084c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f084c036b90 0x7f084c039050 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0950057000 tx=0x7f0950052000 comp rx=0 tx=0).stop 2024-09-21T09:05:02.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11da4940 msgr2=0x564c11da7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11da4940 0x564c11da7320 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0958000fd0 tx=0x7f0958000ed0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 shutdown_connections 2024-09-21T09:05:02.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x564c11ea8d20 0x564c11eab110 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x564c11daaa20 0x564c11ea6630 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f084c036b90 0x7f084c039050 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 --2- 172.21.15.178:0/507838472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c11da4940 0x564c11da7320 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 >> 172.21.15.178:0/507838472 conn(0x564c11da0550 msgr2=0x564c11e8fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 shutdown_connections 2024-09-21T09:05:02.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.732+0000 7f096a324800 1 -- 172.21.15.178:0/507838472 wait complete. 2024-09-21T09:05:02.742 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T09:05:02.742 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T09:05:02.742 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T09:05:02.785 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:02.786 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:02.787 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.784+0000 7f9ede32c800 1 Processor -- start 2024-09-21T09:05:02.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.785+0000 7f9ede32c800 1 -- start start 2024-09-21T09:05:02.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.785+0000 7f9ede32c800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x558772958610 0x5587729e9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.785+0000 7f9ede32c800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5587728a3b30 con 0x5587729e9bb0 2024-09-21T09:05:02.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.785+0000 7f9ede32c800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x558772885360 con 0x558772958610 2024-09-21T09:05:02.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.785+0000 7f9eda0b7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x558772958610 0x5587729e9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.785+0000 7f9eda0b7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x558772958610 0x5587729e9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60178/0 (socket says 172.21.15.178:60178) 2024-09-21T09:05:02.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.785+0000 7f9eda0b7640 1 -- 172.21.15.178:0/278920206 learned_addr learned my addr 172.21.15.178:0/278920206 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.785+0000 7f9ed98b6640 1 --1- 172.21.15.178:0/278920206 >> v1:172.21.15.44:6789/0 conn(0x5587729e9bb0 0x5587729ebfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40426/0 (socket says 172.21.15.178:40426) 2024-09-21T09:05:02.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.785+0000 7f9eda0b7640 1 -- 172.21.15.178:0/278920206 >> v1:172.21.15.44:6789/0 conn(0x5587729e9bb0 legacy=0x5587729ebfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.785+0000 7f9eda0b7640 1 -- 172.21.15.178:0/278920206 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587728abe00 con 0x558772958610 2024-09-21T09:05:02.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.787+0000 7f9eda0b7640 1 --2- 172.21.15.178:0/278920206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x5587729e9670 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc005fd0 tx=0x7f9ecc045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7610d698beb01494 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.787+0000 7f9ed90b5640 1 -- 172.21.15.178:0/278920206 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ecc04e600 con 0x558772958610 2024-09-21T09:05:02.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.787+0000 7f9ed90b5640 1 -- 172.21.15.178:0/278920206 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ecc04e7a0 con 0x558772958610 2024-09-21T09:05:02.789 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.787+0000 7f9ed90b5640 1 -- 172.21.15.178:0/278920206 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ecc04eaa0 con 0x558772958610 2024-09-21T09:05:02.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.788+0000 7f9ede32c800 1 -- 172.21.15.178:0/278920206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 msgr2=0x5587729e9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.788+0000 7f9ede32c800 1 --2- 172.21.15.178:0/278920206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x5587729e9670 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc005fd0 tx=0x7f9ecc045cf0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.788+0000 7f9ede32c800 1 -- 172.21.15.178:0/278920206 shutdown_connections 2024-09-21T09:05:02.790 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.788+0000 7f9ede32c800 1 --2- 172.21.15.178:0/278920206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x5587729e9670 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.788+0000 7f9ede32c800 1 -- 172.21.15.178:0/278920206 >> 172.21.15.178:0/278920206 conn(0x5587729dede0 msgr2=0x5587729e1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.788+0000 7f9ede32c800 1 -- 172.21.15.178:0/278920206 shutdown_connections 2024-09-21T09:05:02.791 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.788+0000 7f9ede32c800 1 -- 172.21.15.178:0/278920206 wait complete. 2024-09-21T09:05:02.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.802+0000 7f9ede32c800 1 Processor -- start 2024-09-21T09:05:02.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.802+0000 7f9ede32c800 1 -- start start 2024-09-21T09:05:02.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.802+0000 7f9ede32c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x558772ad5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.802+0000 7f9ede32c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558772930330 con 0x558772958610 2024-09-21T09:05:02.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.802+0000 7f9eda0b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x558772ad5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.802+0000 7f9eda0b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x558772ad5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60188/0 (socket says 172.21.15.178:60188) 2024-09-21T09:05:02.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.802+0000 7f9eda0b7640 1 -- 172.21.15.178:0/3361417109 learned_addr learned my addr 172.21.15.178:0/3361417109 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.802+0000 7f9eda0b7640 1 -- 172.21.15.178:0/3361417109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55877287dbc0 con 0x558772958610 2024-09-21T09:05:02.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.803+0000 7f9eda0b7640 1 --2- 172.21.15.178:0/3361417109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x558772ad5a80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc045d30 tx=0x7f9ecc050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76715ffc4112551 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.803+0000 7f9dc8608640 1 -- 172.21.15.178:0/3361417109 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ecc04eb40 con 0x558772958610 2024-09-21T09:05:02.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.803+0000 7f9dc8608640 1 -- 172.21.15.178:0/3361417109 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ecc05c040 con 0x558772958610 2024-09-21T09:05:02.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.803+0000 7f9dc8608640 1 -- 172.21.15.178:0/3361417109 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ecc04ee10 con 0x558772958610 2024-09-21T09:05:02.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.803+0000 7f9ede32c800 1 -- 172.21.15.178:0/3361417109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 msgr2=0x558772ad5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.803+0000 7f9ede32c800 1 --2- 172.21.15.178:0/3361417109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x558772ad5a80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc045d30 tx=0x7f9ecc050000 comp rx=0 tx=0).stop 2024-09-21T09:05:02.809 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.804+0000 7f9ede32c800 1 -- 172.21.15.178:0/3361417109 shutdown_connections 2024-09-21T09:05:02.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.804+0000 7f9ede32c800 1 --2- 172.21.15.178:0/3361417109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x558772ad5a80 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.804+0000 7f9ede32c800 1 -- 172.21.15.178:0/3361417109 >> 172.21.15.178:0/3361417109 conn(0x5587729dede0 msgr2=0x558772ad1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.804+0000 7f9ede32c800 1 -- 172.21.15.178:0/3361417109 shutdown_connections 2024-09-21T09:05:02.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.804+0000 7f9ede32c800 1 -- 172.21.15.178:0/3361417109 wait complete. 2024-09-21T09:05:02.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.804+0000 7f9ede32c800 1 Processor -- start 2024-09-21T09:05:02.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.804+0000 7f9ede32c800 1 -- start start 2024-09-21T09:05:02.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.804+0000 7f9ede32c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x558772add3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.804+0000 7f9ede32c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5587729ed990 con 0x558772958610 2024-09-21T09:05:02.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.804+0000 7f9eda0b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x558772add3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.804+0000 7f9eda0b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x558772add3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60196/0 (socket says 172.21.15.178:60196) 2024-09-21T09:05:02.810 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.804+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1903520978 learned_addr learned my addr 172.21.15.178:0/1903520978 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.805+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1903520978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558772891fe0 con 0x558772958610 2024-09-21T09:05:02.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.805+0000 7f9eda0b7640 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x558772add3f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc045d30 tx=0x7f9ecc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.805+0000 7f9dc6e05640 1 -- 172.21.15.178:0/1903520978 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ecc061420 con 0x558772958610 2024-09-21T09:05:02.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.805+0000 7f9dc6e05640 1 -- 172.21.15.178:0/1903520978 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ecc070070 con 0x558772958610 2024-09-21T09:05:02.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.805+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558772add930 con 0x558772958610 2024-09-21T09:05:02.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.805+0000 7f9dc6e05640 1 -- 172.21.15.178:0/1903520978 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ecc0616f0 con 0x558772958610 2024-09-21T09:05:02.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.805+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558772adddd0 con 0x558772958610 2024-09-21T09:05:02.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.806+0000 7f9dc6e05640 1 -- 172.21.15.178:0/1903520978 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9ecc0618e0 con 0x558772958610 2024-09-21T09:05:02.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.806+0000 7f9dc6e05640 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9dc0036b40 0x7f9dc0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.806+0000 7f9dc6e05640 1 -- 172.21.15.178:0/1903520978 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f9ecc066070 con 0x558772958610 2024-09-21T09:05:02.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.806+0000 7f9ed98b6640 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9dc0036b40 0x7f9dc0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.806+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5587729e9bb0 0x558772ae4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.806+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772ae4920 con 0x5587729e9bb0 2024-09-21T09:05:02.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.806+0000 7f9eda8b8640 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5587729e9bb0 0x558772ae4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.806+0000 7f9ed98b6640 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9dc0036b40 0x7f9dc0039000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0000f60 tx=0x7f9ed0001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.807+0000 7f9eda8b8640 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5587729e9bb0 0x558772ae4350 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.807+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1903520978 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ed40083e0 con 0x5587729e9bb0 2024-09-21T09:05:02.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.807+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772ae1a10 con 0x5587729e9bb0 2024-09-21T09:05:02.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.807+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1903520978 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ed40083e0 con 0x5587729e9bb0 2024-09-21T09:05:02.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.807+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558772ae6c50 0x558772ae9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.807+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772ae9730 con 0x558772ae6c50 2024-09-21T09:05:02.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.807+0000 7f9eda0b7640 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558772ae6c50 0x558772ae9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.808+0000 7f9eda0b7640 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558772ae6c50 0x558772ae9040 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.808+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1903520978 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9ecc07c070 con 0x558772ae6c50 2024-09-21T09:05:02.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.808+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772ae5af0 con 0x5587729e9bb0 2024-09-21T09:05:02.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.808+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1903520978 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ed40083e0 con 0x5587729e9bb0 2024-09-21T09:05:02.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.808+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772ae5f90 con 0x5587729e9bb0 2024-09-21T09:05:02.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.809+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1903520978 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9ed40083e0 con 0x5587729e9bb0 2024-09-21T09:05:02.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.809+0000 7f9ede32c800 1 Processor -- start 2024-09-21T09:05:02.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.809+0000 7f9ede32c800 1 -- start start 2024-09-21T09:05:02.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.809+0000 7f9ede32c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772af8100 0x558772af8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.809+0000 7f9ede32c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55877287f580 con 0x558772af8100 2024-09-21T09:05:02.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.809+0000 7f9eda8b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772af8100 0x558772af8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.810+0000 7f9eda8b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772af8100 0x558772af8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60204/0 (socket says 172.21.15.178:60204) 2024-09-21T09:05:02.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.810+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1331179568 learned_addr learned my addr 172.21.15.178:0/1331179568 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.810+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1331179568 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558772af8a60 con 0x558772af8100 2024-09-21T09:05:02.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.810+0000 7f9eda8b8640 1 --2- 172.21.15.178:0/1331179568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772af8100 0x558772af8520 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x558772ade4a0 tx=0x7f9ed400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.810+0000 7f9dbffff640 1 -- 172.21.15.178:0/1331179568 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed4007d00 con 0x558772af8100 2024-09-21T09:05:02.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.810+0000 7f9dbffff640 1 -- 172.21.15.178:0/1331179568 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed401e020 con 0x558772af8100 2024-09-21T09:05:02.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.810+0000 7f9ede32c800 1 -- 172.21.15.178:0/1331179568 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558772af8cf0 con 0x558772af8100 2024-09-21T09:05:02.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.810+0000 7f9dbffff640 1 -- 172.21.15.178:0/1331179568 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed4019420 con 0x558772af8100 2024-09-21T09:05:02.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.810+0000 7f9ede32c800 1 -- 172.21.15.178:0/1331179568 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558772afb9d0 con 0x558772af8100 2024-09-21T09:05:02.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.811+0000 7f9dbffff640 1 -- 172.21.15.178:0/1331179568 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9ed4016040 con 0x558772af8100 2024-09-21T09:05:02.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.811+0000 7f9dbffff640 1 --2- 172.21.15.178:0/1331179568 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9db4036b40 0x7f9db4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.811+0000 7f9dbffff640 1 -- 172.21.15.178:0/1331179568 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f9ed401f030 con 0x558772af8100 2024-09-21T09:05:02.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.811+0000 7f9eda0b7640 1 --2- 172.21.15.178:0/1331179568 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9db4036b40 0x7f9db4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.811+0000 7f9ede32c800 1 Processor -- start 2024-09-21T09:05:02.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.812+0000 7f9ede32c800 1 -- start start 2024-09-21T09:05:02.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.812+0000 7f9eda0b7640 1 --2- 172.21.15.178:0/1331179568 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9db4036b40 0x7f9db4039000 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x558772ae4dc0 tx=0x7f9ecc046130 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.812+0000 7f9ede32c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772b04d50 0x558772b05150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.812+0000 7f9ede32c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558772ad6170 con 0x558772b04d50 2024-09-21T09:05:02.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.812+0000 7f9eda8b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772b04d50 0x558772b05150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.812+0000 7f9eda8b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772b04d50 0x558772b05150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60216/0 (socket says 172.21.15.178:60216) 2024-09-21T09:05:02.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.812+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1813449469 learned_addr learned my addr 172.21.15.178:0/1813449469 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.812+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1813449469 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558772b05720 con 0x558772b04d50 2024-09-21T09:05:02.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.812+0000 7f9eda8b8640 1 --2- 172.21.15.178:0/1813449469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772b04d50 0x558772b05150 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9ed404cf20 tx=0x7f9ed4017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100ae0ba3427481 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.813+0000 7f9dbdffb640 1 -- 172.21.15.178:0/1813449469 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed401d030 con 0x558772b04d50 2024-09-21T09:05:02.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.813+0000 7f9dbdffb640 1 -- 172.21.15.178:0/1813449469 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed4015d00 con 0x558772b04d50 2024-09-21T09:05:02.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.813+0000 7f9dbdffb640 1 -- 172.21.15.178:0/1813449469 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed40197f0 con 0x558772b04d50 2024-09-21T09:05:02.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.813+0000 7f9ede32c800 1 -- 172.21.15.178:0/1813449469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772b04d50 msgr2=0x558772b05150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.813+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1813449469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772b04d50 0x558772b05150 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9ed404cf20 tx=0x7f9ed4017fa0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.813+0000 7f9ede32c800 1 -- 172.21.15.178:0/1813449469 shutdown_connections 2024-09-21T09:05:02.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.813+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1813449469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772b04d50 0x558772b05150 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.813+0000 7f9ede32c800 1 -- 172.21.15.178:0/1813449469 >> 172.21.15.178:0/1813449469 conn(0x558772b010b0 msgr2=0x558772aff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.813+0000 7f9ede32c800 1 -- 172.21.15.178:0/1813449469 shutdown_connections 2024-09-21T09:05:02.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.813+0000 7f9ede32c800 1 -- 172.21.15.178:0/1813449469 wait complete. 2024-09-21T09:05:02.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.813+0000 7f9ede32c800 1 Processor -- start 2024-09-21T09:05:02.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.813+0000 7f9ede32c800 1 -- start start 2024-09-21T09:05:02.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.813+0000 7f9ede32c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772b04d50 0x558772b0c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.813+0000 7f9ede32c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558772b05ca0 con 0x558772b04d50 2024-09-21T09:05:02.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.814+0000 7f9eda8b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772b04d50 0x558772b0c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.814+0000 7f9eda8b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772b04d50 0x558772b0c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60230/0 (socket says 172.21.15.178:60230) 2024-09-21T09:05:02.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.814+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 learned_addr learned my addr 172.21.15.178:0/1615130396 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.814+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558772b0c6e0 con 0x558772b04d50 2024-09-21T09:05:02.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.814+0000 7f9eda8b8640 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772b04d50 0x558772b0c1a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4048010 tx=0x7f9ed404ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.814+0000 7f9dabfff640 1 -- 172.21.15.178:0/1615130396 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed403b070 con 0x558772b04d50 2024-09-21T09:05:02.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.814+0000 7f9dabfff640 1 -- 172.21.15.178:0/1615130396 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed4019b70 con 0x558772b04d50 2024-09-21T09:05:02.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.814+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558772b0c970 con 0x558772b04d50 2024-09-21T09:05:02.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.814+0000 7f9dabfff640 1 -- 172.21.15.178:0/1615130396 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed40179a0 con 0x558772b04d50 2024-09-21T09:05:02.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.814+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558772b0f620 con 0x558772b04d50 2024-09-21T09:05:02.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.815+0000 7f9dabfff640 1 -- 172.21.15.178:0/1615130396 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9ed40153e0 con 0x558772b04d50 2024-09-21T09:05:02.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.815+0000 7f9dabfff640 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9da4036af0 0x7f9da4038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.815+0000 7f9dabfff640 1 -- 172.21.15.178:0/1615130396 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f9ed4037ba0 con 0x558772b04d50 2024-09-21T09:05:02.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.815+0000 7f9eda0b7640 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9da4036af0 0x7f9da4038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.815+0000 7f9ede32c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558772b17be0 0x558772b1a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772b1a7f0 con 0x558772b17be0 2024-09-21T09:05:02.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9ed98b6640 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558772b17be0 0x558772b1a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9eda0b7640 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9da4036af0 0x7f9da4038fb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc06cfd0 tx=0x7f9ecc081000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9ed98b6640 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558772b17be0 0x558772b1a0a0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ed000f610 con 0x558772b17be0 2024-09-21T09:05:02.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9ede32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9ede32c800 20 realm 2024-09-21T09:05:02.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9ede32c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772b17030 con 0x558772b17be0 2024-09-21T09:05:02.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ed000f610 con 0x558772b17be0 2024-09-21T09:05:02.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9ede32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9ede32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:02.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9ede32c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.816+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772b1b2d0 con 0x558772b17be0 2024-09-21T09:05:02.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.817+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ed000f610 con 0x558772b17be0 2024-09-21T09:05:02.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.817+0000 7f9ede32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.817+0000 7f9ede32c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.817+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772b1bba0 con 0x558772b17be0 2024-09-21T09:05:02.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.817+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ed000f610 con 0x558772b17be0 2024-09-21T09:05:02.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.817+0000 7f9ede32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:02.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.817+0000 7f9ede32c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.817+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558772b1c450 0x558772b1e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.817+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772b1efc0 con 0x558772b1c450 2024-09-21T09:05:02.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.817+0000 7f9eda8b8640 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558772b1c450 0x558772b1e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.817+0000 7f9eda8b8640 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558772b1c450 0x558772b1e860 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.818+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.818+0000 7f9ede32c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:02.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.818+0000 7f9ede32c800 20 searching for the correct realm 2024-09-21T09:05:02.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.818+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558772b210c0 0x558772b23580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.818+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b210c0 2024-09-21T09:05:02.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.818+0000 7f9eda0b7640 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558772b210c0 0x558772b23580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.818+0000 7f9eda0b7640 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558772b210c0 0x558772b23580 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.818+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ecc0a4040 con 0x558772b210c0 2024-09-21T09:05:02.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.818+0000 7f9eda0b7640 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9ecc06c3f0 0x7f9ecc0090d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.818+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.819+0000 7f9ed98b6640 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9ecc06c3f0 0x7f9ecc0090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.819+0000 7f9ed98b6640 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9ecc06c3f0 0x7f9ecc0090d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.819+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed000f610 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.819+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b1c450 2024-09-21T09:05:02.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.820+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.820+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b17be0 2024-09-21T09:05:02.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.820+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed000f610 con 0x558772b17be0 2024-09-21T09:05:02.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.820+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b17be0 2024-09-21T09:05:02.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.820+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed002b040 con 0x558772b17be0 2024-09-21T09:05:02.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.820+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b1c450 2024-09-21T09:05:02.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.821+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.821+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b1c450 2024-09-21T09:05:02.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.821+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.821+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.821+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed002b040 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.821+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b210c0 2024-09-21T09:05:02.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.822+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ecc0a4040 con 0x558772b210c0 2024-09-21T09:05:02.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.822+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b17be0 2024-09-21T09:05:02.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.822+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed002b040 con 0x558772b17be0 2024-09-21T09:05:02.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.822+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b1c450 2024-09-21T09:05:02.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.822+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.822+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b17be0 2024-09-21T09:05:02.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.822+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed002b040 con 0x558772b17be0 2024-09-21T09:05:02.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.822+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.823+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9ed002b040 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.823+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b210c0 2024-09-21T09:05:02.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.823+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ecc0a4040 con 0x558772b210c0 2024-09-21T09:05:02.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.823+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b210c0 2024-09-21T09:05:02.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.823+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ecc0a4040 con 0x558772b210c0 2024-09-21T09:05:02.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.823+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b1c450 2024-09-21T09:05:02.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.823+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.823+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b210c0 2024-09-21T09:05:02.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.824+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ecc0a4040 con 0x558772b210c0 2024-09-21T09:05:02.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.824+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b210c0 2024-09-21T09:05:02.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.824+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ecc0a4040 con 0x558772b210c0 2024-09-21T09:05:02.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.824+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b17be0 2024-09-21T09:05:02.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.824+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9ed002b040 con 0x558772b17be0 2024-09-21T09:05:02.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.824+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b17be0 2024-09-21T09:05:02.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.824+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9ed002b040 con 0x558772b17be0 2024-09-21T09:05:02.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.824+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b1c450 2024-09-21T09:05:02.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.825+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.825+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b210c0 2024-09-21T09:05:02.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.825+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ecc0a4040 con 0x558772b210c0 2024-09-21T09:05:02.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.825+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.825+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed002b040 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.825+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b17be0 2024-09-21T09:05:02.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.825+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed002b040 con 0x558772b17be0 2024-09-21T09:05:02.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.825+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b1c450 2024-09-21T09:05:02.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.826+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.826+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b210c0 2024-09-21T09:05:02.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.826+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ecc0a4040 con 0x558772b210c0 2024-09-21T09:05:02.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.826+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.826+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed002b040 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.826+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.826+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed002b040 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.826+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b210c0 2024-09-21T09:05:02.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ecc0a4040 con 0x558772b210c0 2024-09-21T09:05:02.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b1c450 2024-09-21T09:05:02.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x558772b17be0 2024-09-21T09:05:02.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9ed002b040 con 0x558772b17be0 2024-09-21T09:05:02.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558772b23c50 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ed002b040 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9ede32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:02.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9ede32c800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:02.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9ede32c800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:02.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9ede32c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:02.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9ede32c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:02.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9ede32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:02.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9ede32c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.827+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772b1faf0 con 0x558772b17be0 2024-09-21T09:05:02.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x558772b17be0 2024-09-21T09:05:02.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772b1ff70 con 0x558772b17be0 2024-09-21T09:05:02.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ed003f040 con 0x558772b17be0 2024-09-21T09:05:02.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:02.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772b20450 con 0x558772b17be0 2024-09-21T09:05:02.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9ed003f040 con 0x558772b17be0 2024-09-21T09:05:02.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:02.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 20 zone default found 2024-09-21T09:05:02.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 4 Realm: () 2024-09-21T09:05:02.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:02.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:02.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:02.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 20 zonegroup default 2024-09-21T09:05:02.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772b240d0 con 0x558772b1c450 2024-09-21T09:05:02.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.828+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772b26300 con 0x558772b210c0 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.829+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ecc0a4040 con 0x558772b210c0 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.829+0000 7f9ede32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.829+0000 7f9ede32c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.829+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772b266a0 con 0x558772b210c0 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.829+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ecc0a4040 con 0x558772b210c0 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.829+0000 7f9ede32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.829+0000 7f9ede32c800 20 started sync module instance, tier type = 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.829+0000 7f9ede32c800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.829+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b25740 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.830+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.830+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94040233237600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b25740 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.830+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b27060 con 0x558772b17be0 2024-09-21T09:05:02.847 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.831+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94040233237600] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.831+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x558772b17be0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.831+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94040233235568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b27060 con 0x558772b17be0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.831+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b27a60 con 0x558772b210c0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.833+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ecc0a4040 con 0x558772b210c0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.833+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94040233244016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b28300 con 0x558772b210c0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.833+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b28da0 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.833+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94040233235568] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x558772b17be0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.834+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94040233244016] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ecc0a4040 con 0x558772b210c0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.834+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.834+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94040233246288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b26bb0 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.834+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b29640 con 0x558772b17be0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.835+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94040233246288] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.835+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x558772b17be0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.835+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94040233248880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b295f0 con 0x558772b17be0 2024-09-21T09:05:02.848 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.835+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b2a050 con 0x558772b1c450 2024-09-21T09:05:02.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.836+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94040233248880] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x558772b17be0 2024-09-21T09:05:02.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.836+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.836+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94040233251136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b2a050 con 0x558772b1c450 2024-09-21T09:05:02.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.836+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b2aa50 con 0x558772b1c450 2024-09-21T09:05:02.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.837+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94040233251136] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.837+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.837+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94040233256288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b2ac30 con 0x558772b1c450 2024-09-21T09:05:02.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.837+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b2b4c0 con 0x558772b1c450 2024-09-21T09:05:02.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.838+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(58 notify.7 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.838+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94040233256288] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.838+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94040233258032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b2b050 con 0x558772b1c450 2024-09-21T09:05:02.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.838+0000 7f9ede32c800 20 add_watcher() i=0 2024-09-21T09:05:02.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.838+0000 7f9ede32c800 20 add_watcher() i=1 2024-09-21T09:05:02.849 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.838+0000 7f9ede32c800 20 add_watcher() i=2 2024-09-21T09:05:02.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.838+0000 7f9ede32c800 20 add_watcher() i=3 2024-09-21T09:05:02.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.838+0000 7f9ede32c800 20 add_watcher() i=4 2024-09-21T09:05:02.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.838+0000 7f9ede32c800 20 add_watcher() i=5 2024-09-21T09:05:02.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.838+0000 7f9ede32c800 20 add_watcher() i=6 2024-09-21T09:05:02.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.839+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94040233258032] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.839+0000 7f9ede32c800 20 add_watcher() i=7 2024-09-21T09:05:02.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.839+0000 7f9ede32c800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:02.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.839+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772b2e910 con 0x558772b17be0 2024-09-21T09:05:02.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.840+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9ed003f040 con 0x558772b17be0 2024-09-21T09:05:02.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.840+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94040233253856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b2be00 con 0x558772b17be0 2024-09-21T09:05:02.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.841+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94040233253856] v31'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x558772b17be0 2024-09-21T09:05:02.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.841+0000 7f9d90fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:02.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.841+0000 7f9ede32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:02.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.841+0000 7f9ede32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:02.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.841+0000 7f9ede32c800 5 note: GC not initialized 2024-09-21T09:05:02.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.841+0000 7f9d0b7fe640 20 reqs_thread_entry: start 2024-09-21T09:05:02.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.841+0000 7f9ede32c800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:02.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.841+0000 7f9ede32c800 20 Filter name: none 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.841+0000 7f9d097fa640 20 reqs_thread_entry: start 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.842+0000 7f9ede32c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.842+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558772b617c0 con 0x558772b17be0 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.842+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x558772b17be0 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.842+0000 7f9ede32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:could not fetch user info: no user info saved 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.843+0000 7f9d90fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.843+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94040233253856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b61780 con 0x558772b17be0 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.843+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94040233253856] v31'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x558772b17be0 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.843+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94040233237600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b5f5f0 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.844+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94040233237600] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.844+0000 7f9ede32c800 20 remove_watcher() i=0 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.844+0000 7f9ede32c800 2 removed watcher, disabling cache 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.844+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94040233235568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b5f5f0 con 0x558772b17be0 2024-09-21T09:05:02.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.846+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94040233235568] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x558772b17be0 2024-09-21T09:05:02.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.846+0000 7f9ede32c800 20 remove_watcher() i=1 2024-09-21T09:05:02.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.846+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94040233244016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b5f5f0 con 0x558772b210c0 2024-09-21T09:05:02.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.847+0000 7f9eda0b7640 1 -- 172.21.15.178:0/1615130396 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94040233244016] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ecc0a4040 con 0x558772b210c0 2024-09-21T09:05:02.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.847+0000 7f9ede32c800 20 remove_watcher() i=2 2024-09-21T09:05:02.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.847+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94040233246288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b5f5f0 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.848+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94040233246288] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x7f9ecc06c3f0 2024-09-21T09:05:02.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.848+0000 7f9ede32c800 20 remove_watcher() i=3 2024-09-21T09:05:02.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.848+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94040233248880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b5f5f0 con 0x558772b17be0 2024-09-21T09:05:02.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.849+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94040233248880] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed003f040 con 0x558772b17be0 2024-09-21T09:05:02.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.849+0000 7f9ede32c800 20 remove_watcher() i=4 2024-09-21T09:05:02.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.849+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94040233251136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b5f5f0 con 0x558772b1c450 2024-09-21T09:05:02.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.850+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94040233251136] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.850+0000 7f9ede32c800 20 remove_watcher() i=5 2024-09-21T09:05:02.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.850+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94040233256288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b5f5f0 con 0x558772b1c450 2024-09-21T09:05:02.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.851+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94040233256288] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.851+0000 7f9ede32c800 20 remove_watcher() i=6 2024-09-21T09:05:02.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.851+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94040233258032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558772b5f5f0 con 0x558772b1c450 2024-09-21T09:05:02.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.852+0000 7f9eda8b8640 1 -- 172.21.15.178:0/1615130396 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94040233258032] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ed402a070 con 0x558772b1c450 2024-09-21T09:05:02.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.852+0000 7f9ede32c800 20 remove_watcher() i=7 2024-09-21T09:05:02.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.852+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558772b1c450 msgr2=0x558772b1e860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.852+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558772b1c450 0x558772b1e860 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.852+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558772b17be0 msgr2=0x558772b1a0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.852+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x558772b17be0 0x558772b1a0a0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.852+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9ecc06c3f0 msgr2=0x7f9ecc0090d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.852+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f9ecc06c3f0 0x7f9ecc0090d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.852+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558772b210c0 msgr2=0x558772b23580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.852+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x558772b210c0 0x558772b23580 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9da4036af0 msgr2=0x7f9da4038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9da4036af0 0x7f9da4038fb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc06cfd0 tx=0x7f9ecc081000 comp rx=0 tx=0).stop 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ed98b6640 1 -- 172.21.15.178:0/1615130396 reap_dead start 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772b04d50 msgr2=0x558772b0c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772b04d50 0x558772b0c1a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4048010 tx=0x7f9ed404ce80 comp rx=0 tx=0).stop 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 shutdown_connections 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1615130396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772b04d50 0x558772b0c1a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 >> 172.21.15.178:0/1615130396 conn(0x558772b010b0 msgr2=0x558772aff180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 shutdown_connections 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1615130396 wait complete. 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1331179568 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9db4036b40 msgr2=0x7f9db4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1331179568 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9db4036b40 0x7f9db4039000 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x558772ae4dc0 tx=0x7f9ecc046130 comp rx=0 tx=0).stop 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1331179568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772af8100 msgr2=0x558772af8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1331179568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772af8100 0x558772af8520 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x558772ade4a0 tx=0x7f9ed400aec0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1331179568 shutdown_connections 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1331179568 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9db4036b40 0x7f9db4039000 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1331179568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772af8100 0x558772af8520 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1331179568 >> 172.21.15.178:0/1331179568 conn(0x558772aed090 msgr2=0x558772aefc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1331179568 shutdown_connections 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1331179568 wait complete. 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558772ae6c50 msgr2=0x558772ae9040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558772ae6c50 0x558772ae9040 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5587729e9bb0 msgr2=0x558772ae4350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5587729e9bb0 0x558772ae4350 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.853+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9dc0036b40 msgr2=0x7f9dc0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.854+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9dc0036b40 0x7f9dc0039000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0000f60 tx=0x7f9ed0001370 comp rx=0 tx=0).stop 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.854+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 msgr2=0x558772add3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.854+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x558772add3f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc045d30 tx=0x7f9ecc003330 comp rx=0 tx=0).stop 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.854+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 shutdown_connections 2024-09-21T09:05:02.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.854+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x558772ae6c50 0x558772ae9040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.854+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5587729e9bb0 0x558772ae4350 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.854+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9dc0036b40 0x7f9dc0039000 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.854+0000 7f9ede32c800 1 --2- 172.21.15.178:0/1903520978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558772958610 0x558772add3f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.854+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 >> 172.21.15.178:0/1903520978 conn(0x5587729dede0 msgr2=0x558772acfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.854+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 shutdown_connections 2024-09-21T09:05:02.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.854+0000 7f9ede32c800 1 -- 172.21.15.178:0/1903520978 wait complete. 2024-09-21T09:05:02.863 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T09:05:02.864 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-21T09:05:02.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-21T09:05:02.864 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-21T09:05:02.907 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:02.907 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:02.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.906+0000 7f05bee40800 1 Processor -- start 2024-09-21T09:05:02.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.906+0000 7f05bee40800 1 -- start start 2024-09-21T09:05:02.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.906+0000 7f05bee40800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5630d89299f0 0x5630d892bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.906+0000 7f05bee40800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5630d87e4b30 con 0x5630d8898ee0 2024-09-21T09:05:02.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.906+0000 7f05bee40800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5630d87c6360 con 0x5630d89299f0 2024-09-21T09:05:02.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.907+0000 7f05bc133640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5630d89299f0 0x5630d892bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.907+0000 7f05bc133640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5630d89299f0 0x5630d892bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60246/0 (socket says 172.21.15.178:60246) 2024-09-21T09:05:02.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.907+0000 7f05bc934640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5630d8898ee0 0x5630d89282d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40440/0 (socket says 172.21.15.178:40440) 2024-09-21T09:05:02.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.907+0000 7f05bc133640 1 -- 172.21.15.178:0/1165745947 learned_addr learned my addr 172.21.15.178:0/1165745947 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.907+0000 7f05bc133640 1 -- 172.21.15.178:0/1165745947 >> v1:172.21.15.44:6789/0 conn(0x5630d8898ee0 legacy=0x5630d89282d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.907+0000 7f05bc133640 1 -- 172.21.15.178:0/1165745947 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d87ece00 con 0x5630d89299f0 2024-09-21T09:05:02.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.909+0000 7f05bc133640 1 --2- 172.21.15.178:0/1165745947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d89299f0 0x5630d892bde0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f05a400a520 tx=0x7f05a4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22748d839a1da4c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.909+0000 7f05bb932640 1 -- 172.21.15.178:0/1165745947 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a4055070 con 0x5630d89299f0 2024-09-21T09:05:02.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.909+0000 7f05bb932640 1 -- 172.21.15.178:0/1165745947 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a40515b0 con 0x5630d89299f0 2024-09-21T09:05:02.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.909+0000 7f05bb932640 1 -- 172.21.15.178:0/1165745947 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a40518d0 con 0x5630d89299f0 2024-09-21T09:05:02.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.909+0000 7f05bee40800 1 -- 172.21.15.178:0/1165745947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d89299f0 msgr2=0x5630d892bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.909+0000 7f05bee40800 1 --2- 172.21.15.178:0/1165745947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d89299f0 0x5630d892bde0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f05a400a520 tx=0x7f05a4045ba0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.909+0000 7f05bee40800 1 -- 172.21.15.178:0/1165745947 shutdown_connections 2024-09-21T09:05:02.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.909+0000 7f05bee40800 1 --2- 172.21.15.178:0/1165745947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d89299f0 0x5630d892bde0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.909+0000 7f05bee40800 1 -- 172.21.15.178:0/1165745947 >> 172.21.15.178:0/1165745947 conn(0x5630d891fe80 msgr2=0x5630d89222a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.909+0000 7f05bee40800 1 -- 172.21.15.178:0/1165745947 shutdown_connections 2024-09-21T09:05:02.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.909+0000 7f05bee40800 1 -- 172.21.15.178:0/1165745947 wait complete. 2024-09-21T09:05:02.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.923+0000 7f05bee40800 1 Processor -- start 2024-09-21T09:05:02.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.923+0000 7f05bee40800 1 -- start start 2024-09-21T09:05:02.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.923+0000 7f05bee40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8898ee0 0x5630d8a14900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.923+0000 7f05bee40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5630d8871330 con 0x5630d8898ee0 2024-09-21T09:05:02.926 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.924+0000 7f05bc934640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8898ee0 0x5630d8a14900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.926 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.924+0000 7f05bc934640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8898ee0 0x5630d8a14900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60260/0 (socket says 172.21.15.178:60260) 2024-09-21T09:05:02.926 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.924+0000 7f05bc934640 1 -- 172.21.15.178:0/2367520238 learned_addr learned my addr 172.21.15.178:0/2367520238 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.926 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.924+0000 7f05bc934640 1 -- 172.21.15.178:0/2367520238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d87bebc0 con 0x5630d8898ee0 2024-09-21T09:05:02.928 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.924+0000 7f05bc934640 1 --2- 172.21.15.178:0/2367520238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8898ee0 0x5630d8a14900 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f05ac001650 tx=0x7f05ac001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8997fb728b9c9f47 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.928 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.924+0000 7f04aae0d640 1 -- 172.21.15.178:0/2367520238 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac013420 con 0x5630d8898ee0 2024-09-21T09:05:02.928 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.924+0000 7f04aae0d640 1 -- 172.21.15.178:0/2367520238 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac0135c0 con 0x5630d8898ee0 2024-09-21T09:05:02.928 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.924+0000 7f04aae0d640 1 -- 172.21.15.178:0/2367520238 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac0138c0 con 0x5630d8898ee0 2024-09-21T09:05:02.928 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.925+0000 7f05bee40800 1 -- 172.21.15.178:0/2367520238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8898ee0 msgr2=0x5630d8a14900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.925+0000 7f05bee40800 1 --2- 172.21.15.178:0/2367520238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8898ee0 0x5630d8a14900 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f05ac001650 tx=0x7f05ac001b10 comp rx=0 tx=0).stop 2024-09-21T09:05:02.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.925+0000 7f05bee40800 1 -- 172.21.15.178:0/2367520238 shutdown_connections 2024-09-21T09:05:02.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.925+0000 7f05bee40800 1 --2- 172.21.15.178:0/2367520238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8898ee0 0x5630d8a14900 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.925+0000 7f05bee40800 1 -- 172.21.15.178:0/2367520238 >> 172.21.15.178:0/2367520238 conn(0x5630d891fe80 msgr2=0x5630d8a102c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.925+0000 7f05bee40800 1 -- 172.21.15.178:0/2367520238 shutdown_connections 2024-09-21T09:05:02.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.925+0000 7f05bee40800 1 -- 172.21.15.178:0/2367520238 wait complete. 2024-09-21T09:05:02.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.925+0000 7f05bee40800 1 Processor -- start 2024-09-21T09:05:02.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.925+0000 7f05bee40800 1 -- start start 2024-09-21T09:05:02.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.925+0000 7f05bee40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8898ee0 0x5630d8a1c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.925+0000 7f05bee40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5630d892c6e0 con 0x5630d8898ee0 2024-09-21T09:05:02.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.926+0000 7f05bc934640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8898ee0 0x5630d8a1c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.926+0000 7f05bc934640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8898ee0 0x5630d8a1c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60274/0 (socket says 172.21.15.178:60274) 2024-09-21T09:05:02.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.926+0000 7f05bc934640 1 -- 172.21.15.178:0/1987696280 learned_addr learned my addr 172.21.15.178:0/1987696280 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.926+0000 7f05bc934640 1 -- 172.21.15.178:0/1987696280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d87d2fe0 con 0x5630d8898ee0 2024-09-21T09:05:02.930 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.926+0000 7f05bc934640 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8898ee0 0x5630d8a1c310 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x5630d8a15760 tx=0x7f05ac001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.930 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.926+0000 7f04a960a640 1 -- 172.21.15.178:0/1987696280 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac022020 con 0x5630d8898ee0 2024-09-21T09:05:02.930 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.926+0000 7f04a960a640 1 -- 172.21.15.178:0/1987696280 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac006830 con 0x5630d8898ee0 2024-09-21T09:05:02.930 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.926+0000 7f05bee40800 1 -- 172.21.15.178:0/1987696280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630d8a1c850 con 0x5630d8898ee0 2024-09-21T09:05:02.930 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.926+0000 7f04a960a640 1 -- 172.21.15.178:0/1987696280 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac004b30 con 0x5630d8898ee0 2024-09-21T09:05:02.930 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.926+0000 7f05bee40800 1 -- 172.21.15.178:0/1987696280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630d8a1cd70 con 0x5630d8898ee0 2024-09-21T09:05:02.934 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.927+0000 7f05bee40800 1 Processor -- start 2024-09-21T09:05:02.934 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.927+0000 7f05bee40800 1 -- start start 2024-09-21T09:05:02.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.927+0000 7f04a960a640 1 -- 172.21.15.178:0/1987696280 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f05ac025020 con 0x5630d8898ee0 2024-09-21T09:05:02.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.927+0000 7f05bee40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8925d50 0x5630d89242a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.927+0000 7f05bee40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5630d87c0580 con 0x5630d8925d50 2024-09-21T09:05:02.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.927+0000 7f04a960a640 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f04a4036b40 0x7f04a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.927+0000 7f05bd135640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8925d50 0x5630d89242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.927+0000 7f04a960a640 1 -- 172.21.15.178:0/1987696280 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f05ac018030 con 0x5630d8898ee0 2024-09-21T09:05:02.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.927+0000 7f05bd135640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8925d50 0x5630d89242a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60282/0 (socket says 172.21.15.178:60282) 2024-09-21T09:05:02.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.927+0000 7f05bc934640 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f04a4036b40 0x7f04a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.927+0000 7f05bd135640 1 -- 172.21.15.178:0/1115007361 learned_addr learned my addr 172.21.15.178:0/1115007361 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.928+0000 7f05bd135640 1 -- 172.21.15.178:0/1115007361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d89247e0 con 0x5630d8925d50 2024-09-21T09:05:02.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.928+0000 7f05bc934640 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f04a4036b40 0x7f04a4039000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f05ac01e560 tx=0x7f05ac034040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.928+0000 7f05bd135640 1 --2- 172.21.15.178:0/1115007361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8925d50 0x5630d89242a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f05b400a400 tx=0x7f05b400a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac92941ae4665b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.928+0000 7f04a2ffd640 1 -- 172.21.15.178:0/1115007361 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b40087e0 con 0x5630d8925d50 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.928+0000 7f04a2ffd640 1 -- 172.21.15.178:0/1115007361 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b40089a0 con 0x5630d8925d50 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.928+0000 7f04a2ffd640 1 -- 172.21.15.178:0/1115007361 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b4008d00 con 0x5630d8925d50 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.928+0000 7f05bee40800 1 -- 172.21.15.178:0/1115007361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8925d50 msgr2=0x5630d89242a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.928+0000 7f05bee40800 1 --2- 172.21.15.178:0/1115007361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8925d50 0x5630d89242a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f05b400a400 tx=0x7f05b400a8c0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.928+0000 7f05bee40800 1 -- 172.21.15.178:0/1115007361 shutdown_connections 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.928+0000 7f05bee40800 1 --2- 172.21.15.178:0/1115007361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8925d50 0x5630d89242a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.928+0000 7f05bee40800 1 -- 172.21.15.178:0/1115007361 >> 172.21.15.178:0/1115007361 conn(0x5630d89299f0 msgr2=0x5630d8a24830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.929+0000 7f05bee40800 1 -- 172.21.15.178:0/1115007361 shutdown_connections 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.929+0000 7f05bee40800 1 -- 172.21.15.178:0/1115007361 wait complete. 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.929+0000 7f05bee40800 1 Processor -- start 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.929+0000 7f05bee40800 1 -- start start 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.929+0000 7f05bee40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8925d50 0x5630d8a327d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.929+0000 7f05bee40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5630d8924ad0 con 0x5630d8925d50 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.929+0000 7f05bd135640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8925d50 0x5630d8a327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.929+0000 7f05bd135640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8925d50 0x5630d8a327d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60288/0 (socket says 172.21.15.178:60288) 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.929+0000 7f05bd135640 1 -- 172.21.15.178:0/2032765472 learned_addr learned my addr 172.21.15.178:0/2032765472 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.929+0000 7f05bd135640 1 -- 172.21.15.178:0/2032765472 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d8a32d10 con 0x5630d8925d50 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.930+0000 7f05bd135640 1 --2- 172.21.15.178:0/2032765472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8925d50 0x5630d8a327d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f05b400c010 tx=0x7f05b4002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.930+0000 7f04a17fa640 1 -- 172.21.15.178:0/2032765472 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b4022020 con 0x5630d8925d50 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.930+0000 7f04a17fa640 1 -- 172.21.15.178:0/2032765472 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b4019040 con 0x5630d8925d50 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.930+0000 7f05bee40800 1 -- 172.21.15.178:0/2032765472 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630d8a32fa0 con 0x5630d8925d50 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.930+0000 7f04a17fa640 1 -- 172.21.15.178:0/2032765472 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b4013a70 con 0x5630d8925d50 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.930+0000 7f05bee40800 1 -- 172.21.15.178:0/2032765472 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630d8a35c50 con 0x5630d8925d50 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.931+0000 7f04a17fa640 1 -- 172.21.15.178:0/2032765472 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f05b4025020 con 0x5630d8925d50 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.931+0000 7f04a17fa640 1 --2- 172.21.15.178:0/2032765472 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0494036b40 0x7f0494039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.931+0000 7f04a17fa640 1 -- 172.21.15.178:0/2032765472 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f05b404c6c0 con 0x5630d8925d50 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.931+0000 7f05bc133640 1 --2- 172.21.15.178:0/2032765472 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0494036b40 0x7f0494039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.931+0000 7f05bee40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.931+0000 7f05bee40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:02.937 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.932+0000 7f05bc133640 1 --2- 172.21.15.178:0/2032765472 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0494036b40 0x7f0494039000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f05a4057000 tx=0x7f05a4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.932+0000 7f05bee40800 1 Processor -- start 2024-09-21T09:05:02.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.932+0000 7f05bee40800 1 -- start start 2024-09-21T09:05:02.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.932+0000 7f05bee40800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8a4c750 0x5630d8a4cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.932+0000 7f05bee40800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5630d8a150b0 con 0x5630d8a4c750 2024-09-21T09:05:02.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.932+0000 7f05bc934640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8a4c750 0x5630d8a4cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.932+0000 7f05bc934640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8a4c750 0x5630d8a4cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60298/0 (socket says 172.21.15.178:60298) 2024-09-21T09:05:02.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.932+0000 7f05bc934640 1 -- 172.21.15.178:0/227290220 learned_addr learned my addr 172.21.15.178:0/227290220 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:02.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.932+0000 7f05bc934640 1 -- 172.21.15.178:0/227290220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d8a4d140 con 0x5630d8a4c750 2024-09-21T09:05:02.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.933+0000 7f05bc934640 1 --2- 172.21.15.178:0/227290220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8a4c750 0x5630d8a4cb70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0046b0 tx=0x7f05ac01e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.933+0000 7f0481fe3640 1 -- 172.21.15.178:0/227290220 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac026700 con 0x5630d8a4c750 2024-09-21T09:05:02.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.933+0000 7f0481fe3640 1 -- 172.21.15.178:0/227290220 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac0268a0 con 0x5630d8a4c750 2024-09-21T09:05:02.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.933+0000 7f05bee40800 1 -- 172.21.15.178:0/227290220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630d8a4fd90 con 0x5630d8a4c750 2024-09-21T09:05:02.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.933+0000 7f0481fe3640 1 -- 172.21.15.178:0/227290220 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac026bc0 con 0x5630d8a4c750 2024-09-21T09:05:02.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.933+0000 7f05bee40800 1 -- 172.21.15.178:0/227290220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630d8a50170 con 0x5630d8a4c750 2024-09-21T09:05:02.942 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.933+0000 7f0481fe3640 1 -- 172.21.15.178:0/227290220 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f05ac039070 con 0x5630d8a4c750 2024-09-21T09:05:02.942 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.934+0000 7f0481fe3640 1 --2- 172.21.15.178:0/227290220 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f03f4036b40 0x7f03f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.942 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.934+0000 7f0481fe3640 1 -- 172.21.15.178:0/227290220 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f05ac043070 con 0x5630d8a4c750 2024-09-21T09:05:02.942 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.934+0000 7f05bc133640 1 --2- 172.21.15.178:0/227290220 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f03f4036b40 0x7f03f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.942 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.934+0000 7f047b7fe640 20 reqs_thread_entry: start 2024-09-21T09:05:02.942 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.934+0000 7f05bc133640 1 --2- 172.21.15.178:0/227290220 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f03f4036b40 0x7f03f4039000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f05a4045be0 tx=0x7f05a4005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.942 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.934+0000 7f05bee40800 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5630d8a5a1b0 0x5630d8a5c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.942 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.934+0000 7f05bee40800 1 -- 172.21.15.178:0/1987696280 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5630d8a5ccd0 con 0x5630d8a5a1b0 2024-09-21T09:05:02.942 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.934+0000 7f05bd135640 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5630d8a5a1b0 0x5630d8a5c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.942 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.934+0000 7f05bd135640 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5630d8a5a1b0 0x5630d8a5c600 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.935+0000 7f05bd135640 1 -- 172.21.15.178:0/1987696280 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05b401ecc0 con 0x5630d8a5a1b0 2024-09-21T09:05:02.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.935+0000 7f05bee40800 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5630d8a5eaa0 0x5630d8a60e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:02.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.935+0000 7f05bee40800 1 -- 172.21.15.178:0/1987696280 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:2 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5630d8a61530 con 0x5630d8a5eaa0 2024-09-21T09:05:02.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.935+0000 7f05bc934640 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5630d8a5eaa0 0x5630d8a60e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:02.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.935+0000 7f05bc934640 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5630d8a5eaa0 0x5630d8a60e90 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:02.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.936+0000 7f05bc934640 1 -- 172.21.15.178:0/1987696280 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(2 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f05ac01b070 con 0x5630d8a5eaa0 2024-09-21T09:05:02.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.936+0000 7f05bee40800 1 -- 172.21.15.178:0/2032765472 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0494036b40 msgr2=0x7f0494039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.936+0000 7f05bee40800 1 --2- 172.21.15.178:0/2032765472 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0494036b40 0x7f0494039000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f05a4057000 tx=0x7f05a4052000 comp rx=0 tx=0).stop 2024-09-21T09:05:02.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.936+0000 7f05bee40800 1 -- 172.21.15.178:0/2032765472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8925d50 msgr2=0x5630d8a327d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.936+0000 7f05bee40800 1 --2- 172.21.15.178:0/2032765472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8925d50 0x5630d8a327d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f05b400c010 tx=0x7f05b4002ff0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.936+0000 7f05bee40800 1 -- 172.21.15.178:0/2032765472 shutdown_connections 2024-09-21T09:05:02.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.936+0000 7f05bee40800 1 --2- 172.21.15.178:0/2032765472 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0494036b40 0x7f0494039000 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.936+0000 7f05bee40800 1 --2- 172.21.15.178:0/2032765472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8925d50 0x5630d8a327d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.936+0000 7f05bee40800 1 -- 172.21.15.178:0/2032765472 >> 172.21.15.178:0/2032765472 conn(0x5630d89299f0 msgr2=0x5630d8a27760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/2032765472 shutdown_connections 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/2032765472 wait complete. 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/227290220 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f03f4036b40 msgr2=0x7f03f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 --2- 172.21.15.178:0/227290220 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f03f4036b40 0x7f03f4039000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f05a4045be0 tx=0x7f05a4005ac0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/227290220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8a4c750 msgr2=0x5630d8a4cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 --2- 172.21.15.178:0/227290220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8a4c750 0x5630d8a4cb70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0046b0 tx=0x7f05ac01e4f0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/227290220 shutdown_connections 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 --2- 172.21.15.178:0/227290220 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f03f4036b40 0x7f03f4039000 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 --2- 172.21.15.178:0/227290220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8a4c750 0x5630d8a4cb70 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/227290220 >> 172.21.15.178:0/227290220 conn(0x5630d8a41680 msgr2=0x5630d8a43f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/227290220 shutdown_connections 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/227290220 wait complete. 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/1987696280 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5630d8a5eaa0 msgr2=0x5630d8a60e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5630d8a5eaa0 0x5630d8a60e90 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.945 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/1987696280 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5630d8a5a1b0 msgr2=0x5630d8a5c600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.945 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5630d8a5a1b0 0x5630d8a5c600 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.945 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/1987696280 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f04a4036b40 msgr2=0x7f04a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.945 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f04a4036b40 0x7f04a4039000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f05ac01e560 tx=0x7f05ac034040 comp rx=0 tx=0).stop 2024-09-21T09:05:02.945 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/1987696280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8898ee0 msgr2=0x5630d8a1c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:02.945 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8898ee0 0x5630d8a1c310 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x5630d8a15760 tx=0x7f05ac001250 comp rx=0 tx=0).stop 2024-09-21T09:05:02.945 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/1987696280 shutdown_connections 2024-09-21T09:05:02.945 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5630d8a5eaa0 0x5630d8a60e90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.945 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5630d8a5a1b0 0x5630d8a5c600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.945 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f04a4036b40 0x7f04a4039000 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 --2- 172.21.15.178:0/1987696280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630d8898ee0 0x5630d8a1c310 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:02.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/1987696280 >> 172.21.15.178:0/1987696280 conn(0x5630d891fe80 msgr2=0x5630d8a0eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:02.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/1987696280 shutdown_connections 2024-09-21T09:05:02.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:02.937+0000 7f05bee40800 1 -- 172.21.15.178:0/1987696280 wait complete. 2024-09-21T09:05:02.948 INFO:teuthology.orchestra.run.smithi178.stdout:{"id":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-21T09:05:02.948 DEBUG:tasks.util.rgw: json result: {'id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-21T09:05:02.948 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-21T09:05:02.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-21T09:05:02.948 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-21T09:05:03.030 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:03.030 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:03.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.029+0000 7f172d523800 1 Processor -- start 2024-09-21T09:05:03.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.029+0000 7f172d523800 1 -- start start 2024-09-21T09:05:03.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.029+0000 7f172d523800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5572b97bdd10 0x5572b97c0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.029+0000 7f172d523800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5572b9676b30 con 0x5572b972adc0 2024-09-21T09:05:03.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.029+0000 7f172d523800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5572b9658360 con 0x5572b97bdd10 2024-09-21T09:05:03.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.030+0000 7f1723fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5572b97bdd10 0x5572b97c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.030+0000 7f1723fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5572b97bdd10 0x5572b97c0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60310/0 (socket says 172.21.15.178:60310) 2024-09-21T09:05:03.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.030+0000 7f1723fff640 1 -- 172.21.15.178:0/2120990292 learned_addr learned my addr 172.21.15.178:0/2120990292 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.030+0000 7f172924e640 1 --1- 172.21.15.178:0/2120990292 >> v1:172.21.15.44:6789/0 conn(0x5572b972adc0 0x5572b97bc5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40444/0 (socket says 172.21.15.178:40444) 2024-09-21T09:05:03.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.030+0000 7f1723fff640 1 -- 172.21.15.178:0/2120990292 >> v1:172.21.15.44:6789/0 conn(0x5572b972adc0 legacy=0x5572b97bc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.030+0000 7f1723fff640 1 -- 172.21.15.178:0/2120990292 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b967ee00 con 0x5572b97bdd10 2024-09-21T09:05:03.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.032+0000 7f1723fff640 1 --2- 172.21.15.178:0/2120990292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b97bdd10 0x5572b97c0100 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f171400a520 tx=0x7f1714045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdfb29acf12b9fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.032+0000 7f1728a4d640 1 -- 172.21.15.178:0/2120990292 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1714055070 con 0x5572b97bdd10 2024-09-21T09:05:03.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.032+0000 7f1728a4d640 1 -- 172.21.15.178:0/2120990292 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17140515b0 con 0x5572b97bdd10 2024-09-21T09:05:03.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.032+0000 7f1728a4d640 1 -- 172.21.15.178:0/2120990292 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17140518d0 con 0x5572b97bdd10 2024-09-21T09:05:03.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.033+0000 7f172d523800 1 -- 172.21.15.178:0/2120990292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b97bdd10 msgr2=0x5572b97c0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.033+0000 7f172d523800 1 --2- 172.21.15.178:0/2120990292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b97bdd10 0x5572b97c0100 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f171400a520 tx=0x7f1714045ba0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.033+0000 7f172d523800 1 -- 172.21.15.178:0/2120990292 shutdown_connections 2024-09-21T09:05:03.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.033+0000 7f172d523800 1 --2- 172.21.15.178:0/2120990292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b97bdd10 0x5572b97c0100 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.033+0000 7f172d523800 1 -- 172.21.15.178:0/2120990292 >> 172.21.15.178:0/2120990292 conn(0x5572b97b1de0 msgr2=0x5572b97b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.033+0000 7f172d523800 1 -- 172.21.15.178:0/2120990292 shutdown_connections 2024-09-21T09:05:03.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.033+0000 7f172d523800 1 -- 172.21.15.178:0/2120990292 wait complete. 2024-09-21T09:05:03.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.046+0000 7f172d523800 1 Processor -- start 2024-09-21T09:05:03.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.046+0000 7f172d523800 1 -- start start 2024-09-21T09:05:03.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.046+0000 7f172d523800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b972adc0 0x5572b98a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.046+0000 7f172d523800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5572b9703320 con 0x5572b972adc0 2024-09-21T09:05:03.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.047+0000 7f172924e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b972adc0 0x5572b98a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.047+0000 7f172924e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b972adc0 0x5572b98a8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60316/0 (socket says 172.21.15.178:60316) 2024-09-21T09:05:03.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.047+0000 7f172924e640 1 -- 172.21.15.178:0/3586212555 learned_addr learned my addr 172.21.15.178:0/3586212555 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.047+0000 7f172924e640 1 -- 172.21.15.178:0/3586212555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b9650bc0 con 0x5572b972adc0 2024-09-21T09:05:03.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.047+0000 7f172924e640 1 --2- 172.21.15.178:0/3586212555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b972adc0 0x5572b98a8a40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f171c00b230 tx=0x7f171c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6253f93a64d065de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.047+0000 7f1617606640 1 -- 172.21.15.178:0/3586212555 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f171c00e5c0 con 0x5572b972adc0 2024-09-21T09:05:03.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.047+0000 7f1617606640 1 -- 172.21.15.178:0/3586212555 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171c006070 con 0x5572b972adc0 2024-09-21T09:05:03.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.047+0000 7f1617606640 1 -- 172.21.15.178:0/3586212555 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f171c00e890 con 0x5572b972adc0 2024-09-21T09:05:03.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.048+0000 7f172d523800 1 -- 172.21.15.178:0/3586212555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b972adc0 msgr2=0x5572b98a8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.048+0000 7f172d523800 1 --2- 172.21.15.178:0/3586212555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b972adc0 0x5572b98a8a40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f171c00b230 tx=0x7f171c00b6f0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.048+0000 7f172d523800 1 -- 172.21.15.178:0/3586212555 shutdown_connections 2024-09-21T09:05:03.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.048+0000 7f172d523800 1 --2- 172.21.15.178:0/3586212555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b972adc0 0x5572b98a8a40 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.048+0000 7f172d523800 1 -- 172.21.15.178:0/3586212555 >> 172.21.15.178:0/3586212555 conn(0x5572b97b1de0 msgr2=0x5572b98a4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.048+0000 7f172d523800 1 -- 172.21.15.178:0/3586212555 shutdown_connections 2024-09-21T09:05:03.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.048+0000 7f172d523800 1 -- 172.21.15.178:0/3586212555 wait complete. 2024-09-21T09:05:03.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.048+0000 7f172d523800 1 Processor -- start 2024-09-21T09:05:03.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.049+0000 7f172d523800 1 -- start start 2024-09-21T09:05:03.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.049+0000 7f172d523800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b97bdd10 0x5572b98b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.049+0000 7f172d523800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5572b97c08e0 con 0x5572b97bdd10 2024-09-21T09:05:03.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.049+0000 7f172924e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b97bdd10 0x5572b98b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.049+0000 7f172924e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b97bdd10 0x5572b98b0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60330/0 (socket says 172.21.15.178:60330) 2024-09-21T09:05:03.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.049+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 learned_addr learned my addr 172.21.15.178:0/28742892 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.049+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b9664fe0 con 0x5572b97bdd10 2024-09-21T09:05:03.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.049+0000 7f172924e640 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b97bdd10 0x5572b98b0680 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f171c000c00 tx=0x7f171c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.049+0000 7f1615e03640 1 -- 172.21.15.178:0/28742892 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f171c01a7c0 con 0x5572b97bdd10 2024-09-21T09:05:03.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.049+0000 7f1615e03640 1 -- 172.21.15.178:0/28742892 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171c01a960 con 0x5572b97bdd10 2024-09-21T09:05:03.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.049+0000 7f1615e03640 1 -- 172.21.15.178:0/28742892 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f171c01ac60 con 0x5572b97bdd10 2024-09-21T09:05:03.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.049+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572b98b0bc0 con 0x5572b97bdd10 2024-09-21T09:05:03.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.050+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b98b10e0 con 0x5572b97bdd10 2024-09-21T09:05:03.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.050+0000 7f172d523800 1 Processor -- start 2024-09-21T09:05:03.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.050+0000 7f172d523800 1 -- start start 2024-09-21T09:05:03.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.050+0000 7f1615e03640 1 -- 172.21.15.178:0/28742892 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f171c017070 con 0x5572b97bdd10 2024-09-21T09:05:03.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.050+0000 7f172d523800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98bd810 0x5572b98bdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.050+0000 7f172d523800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5572b9652580 con 0x5572b98bd810 2024-09-21T09:05:03.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.050+0000 7f1615e03640 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1610036b90 0x7f1610039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.051+0000 7f1729a4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98bd810 0x5572b98bdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.051+0000 7f1729a4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98bd810 0x5572b98bdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60336/0 (socket says 172.21.15.178:60336) 2024-09-21T09:05:03.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.051+0000 7f1729a4f640 1 -- 172.21.15.178:0/890930243 learned_addr learned my addr 172.21.15.178:0/890930243 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.051+0000 7f1615e03640 1 -- 172.21.15.178:0/28742892 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f171c015020 con 0x5572b97bdd10 2024-09-21T09:05:03.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.051+0000 7f172924e640 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1610036b90 0x7f1610039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.051+0000 7f1729a4f640 1 -- 172.21.15.178:0/890930243 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b98be150 con 0x5572b98bd810 2024-09-21T09:05:03.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.051+0000 7f172924e640 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1610036b90 0x7f1610039050 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f171c0015b0 tx=0x7f171c0014c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.051+0000 7f1729a4f640 1 --2- 172.21.15.178:0/890930243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98bd810 0x5572b98bdc10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f172400a430 tx=0x7f172400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd895f9295b7ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.051+0000 7f160f7fe640 1 -- 172.21.15.178:0/890930243 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1724015070 con 0x5572b98bd810 2024-09-21T09:05:03.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.051+0000 7f160f7fe640 1 -- 172.21.15.178:0/890930243 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1724001670 con 0x5572b98bd810 2024-09-21T09:05:03.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.051+0000 7f160f7fe640 1 -- 172.21.15.178:0/890930243 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1724001990 con 0x5572b98bd810 2024-09-21T09:05:03.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.052+0000 7f172d523800 1 -- 172.21.15.178:0/890930243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98bd810 msgr2=0x5572b98bdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.052+0000 7f172d523800 1 --2- 172.21.15.178:0/890930243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98bd810 0x5572b98bdc10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f172400a430 tx=0x7f172400a8f0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.052+0000 7f172d523800 1 -- 172.21.15.178:0/890930243 shutdown_connections 2024-09-21T09:05:03.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.052+0000 7f172d523800 1 --2- 172.21.15.178:0/890930243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98bd810 0x5572b98bdc10 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.052+0000 7f172d523800 1 -- 172.21.15.178:0/890930243 >> 172.21.15.178:0/890930243 conn(0x5572b98b8b80 msgr2=0x5572b98bbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.052+0000 7f172d523800 1 -- 172.21.15.178:0/890930243 shutdown_connections 2024-09-21T09:05:03.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.052+0000 7f172d523800 1 -- 172.21.15.178:0/890930243 wait complete. 2024-09-21T09:05:03.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.052+0000 7f172d523800 1 Processor -- start 2024-09-21T09:05:03.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.052+0000 7f172d523800 1 -- start start 2024-09-21T09:05:03.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.052+0000 7f172d523800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98bd810 0x5572b98c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.052+0000 7f172d523800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5572b98beb00 con 0x5572b98bd810 2024-09-21T09:05:03.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.052+0000 7f1729a4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98bd810 0x5572b98c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.052+0000 7f1729a4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98bd810 0x5572b98c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60342/0 (socket says 172.21.15.178:60342) 2024-09-21T09:05:03.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.052+0000 7f1729a4f640 1 -- 172.21.15.178:0/1204076802 learned_addr learned my addr 172.21.15.178:0/1204076802 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.053+0000 7f1729a4f640 1 -- 172.21.15.178:0/1204076802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b98c52d0 con 0x5572b98bd810 2024-09-21T09:05:03.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.053+0000 7f1729a4f640 1 --2- 172.21.15.178:0/1204076802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98bd810 0x5572b98c4d90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1724013040 tx=0x7f1724003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.053+0000 7f160dffb640 1 -- 172.21.15.178:0/1204076802 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1724020020 con 0x5572b98bd810 2024-09-21T09:05:03.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.053+0000 7f160dffb640 1 -- 172.21.15.178:0/1204076802 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17240108e0 con 0x5572b98bd810 2024-09-21T09:05:03.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.053+0000 7f160dffb640 1 -- 172.21.15.178:0/1204076802 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1724015040 con 0x5572b98bd810 2024-09-21T09:05:03.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.053+0000 7f172d523800 1 -- 172.21.15.178:0/1204076802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572b98c5560 con 0x5572b98bd810 2024-09-21T09:05:03.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.053+0000 7f172d523800 1 -- 172.21.15.178:0/1204076802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b98c8210 con 0x5572b98bd810 2024-09-21T09:05:03.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.054+0000 7f160dffb640 1 -- 172.21.15.178:0/1204076802 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1724023020 con 0x5572b98bd810 2024-09-21T09:05:03.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.054+0000 7f160dffb640 1 --2- 172.21.15.178:0/1204076802 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1604036b40 0x7f1604039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.054+0000 7f160dffb640 1 -- 172.21.15.178:0/1204076802 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f172404c280 con 0x5572b98bd810 2024-09-21T09:05:03.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.055+0000 7f1723fff640 1 --2- 172.21.15.178:0/1204076802 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1604036b40 0x7f1604039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.055+0000 7f172d523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:03.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.055+0000 7f172d523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:03.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.055+0000 7f172d523800 1 Processor -- start 2024-09-21T09:05:03.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.055+0000 7f1723fff640 1 --2- 172.21.15.178:0/1204076802 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1604036b40 0x7f1604039000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1714057000 tx=0x7f1714052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.055+0000 7f172d523800 1 -- start start 2024-09-21T09:05:03.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.055+0000 7f172d523800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98ded20 0x5572b98df140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.055+0000 7f172d523800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5572b98a91f0 con 0x5572b98ded20 2024-09-21T09:05:03.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.056+0000 7f172924e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98ded20 0x5572b98df140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.056+0000 7f172924e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98ded20 0x5572b98df140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60344/0 (socket says 172.21.15.178:60344) 2024-09-21T09:05:03.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.056+0000 7f172924e640 1 -- 172.21.15.178:0/883828215 learned_addr learned my addr 172.21.15.178:0/883828215 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.056+0000 7f172924e640 1 -- 172.21.15.178:0/883828215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b98df710 con 0x5572b98ded20 2024-09-21T09:05:03.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.056+0000 7f172924e640 1 --2- 172.21.15.178:0/883828215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98ded20 0x5572b98df140 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f171c048e70 tx=0x7f171c04b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.056+0000 7f15edfe3640 1 -- 172.21.15.178:0/883828215 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f171c0470c0 con 0x5572b98ded20 2024-09-21T09:05:03.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.056+0000 7f15edfe3640 1 -- 172.21.15.178:0/883828215 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171c04c8e0 con 0x5572b98ded20 2024-09-21T09:05:03.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.056+0000 7f172d523800 1 -- 172.21.15.178:0/883828215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572b98e2360 con 0x5572b98ded20 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.056+0000 7f15edfe3640 1 -- 172.21.15.178:0/883828215 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f171c04cbc0 con 0x5572b98ded20 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.056+0000 7f172d523800 1 -- 172.21.15.178:0/883828215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b98e2740 con 0x5572b98ded20 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.057+0000 7f15edfe3640 1 -- 172.21.15.178:0/883828215 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f171c04cd60 con 0x5572b98ded20 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.057+0000 7f15edfe3640 1 --2- 172.21.15.178:0/883828215 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f156c036b40 0x7f156c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.057+0000 7f15edfe3640 1 -- 172.21.15.178:0/883828215 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f171c046bf0 con 0x5572b98ded20 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.057+0000 7f1723fff640 1 --2- 172.21.15.178:0/883828215 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f156c036b40 0x7f156c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.058+0000 7f15677fe640 20 reqs_thread_entry: start 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.058+0000 7f1723fff640 1 --2- 172.21.15.178:0/883828215 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f156c036b40 0x7f156c039000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1714045be0 tx=0x7f1714005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.058+0000 7f172d523800 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5572b98ec780 0x5572b98eeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.058+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572b98ef1d0 con 0x5572b98ec780 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.058+0000 7f1729a4f640 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5572b98ec780 0x5572b98eeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.058+0000 7f1729a4f640 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5572b98ec780 0x5572b98eeb70 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.058+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f172400e070 con 0x5572b98ec780 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.058+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572b98efa90 con 0x5572b98ec780 2024-09-21T09:05:03.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.059+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f172400e070 con 0x5572b98ec780 2024-09-21T09:05:03.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.059+0000 7f172d523800 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5572b98f13a0 0x5572b98f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.059+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572b98f3f00 con 0x5572b98f13a0 2024-09-21T09:05:03.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.059+0000 7f172924e640 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5572b98f13a0 0x5572b98f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.059+0000 7f172924e640 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5572b98f13a0 0x5572b98f3810 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.059+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f171c05b040 con 0x5572b98f13a0 2024-09-21T09:05:03.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.060+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572b9901040 con 0x5572b98ec780 2024-09-21T09:05:03.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.060+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f172400e070 con 0x5572b98ec780 2024-09-21T09:05:03.072 INFO:teuthology.orchestra.run.smithi178.stderr:NOTICE: set zone's realm_id= 2024-09-21T09:05:03.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.060+0000 7f172d523800 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5572b98f8400 0x5572b98fb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.060+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f8400 2024-09-21T09:05:03.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.060+0000 7f1723fff640 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5572b98f8400 0x5572b98fb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.060+0000 7f1723fff640 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5572b98f8400 0x5572b98fb330 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.061+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(5 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714057030 con 0x5572b98f8400 2024-09-21T09:05:03.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.061+0000 7f1723fff640 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f1714077040 0x7f1714077420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.061+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x7f1714077040 2024-09-21T09:05:03.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.061+0000 7f1729a4f640 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f1714077040 0x7f1714077420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.061+0000 7f1729a4f640 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f1714077040 0x7f1714077420 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.061+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172400e070 con 0x7f1714077040 2024-09-21T09:05:03.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.061+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f13a0 2024-09-21T09:05:03.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.061+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171c05b040 con 0x5572b98f13a0 2024-09-21T09:05:03.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.061+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98ec780 2024-09-21T09:05:03.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.062+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172400e070 con 0x5572b98ec780 2024-09-21T09:05:03.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.062+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98ec780 2024-09-21T09:05:03.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.062+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172400e070 con 0x5572b98ec780 2024-09-21T09:05:03.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.062+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f13a0 2024-09-21T09:05:03.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.062+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171c05b040 con 0x5572b98f13a0 2024-09-21T09:05:03.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.062+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f13a0 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.062+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171c05b040 con 0x5572b98f13a0 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.062+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x7f1714077040 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.063+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172400e070 con 0x7f1714077040 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.063+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f8400 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.063+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714057030 con 0x5572b98f8400 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.063+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98ec780 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.063+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172400e070 con 0x5572b98ec780 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.063+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f13a0 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.063+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171c05b040 con 0x5572b98f13a0 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.063+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98ec780 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.064+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172400e070 con 0x5572b98ec780 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.064+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x7f1714077040 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.064+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(17 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f172400e070 con 0x7f1714077040 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.064+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f8400 2024-09-21T09:05:03.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.064+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714057030 con 0x5572b98f8400 2024-09-21T09:05:03.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.064+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f8400 2024-09-21T09:05:03.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.064+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714057030 con 0x5572b98f8400 2024-09-21T09:05:03.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.064+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f13a0 2024-09-21T09:05:03.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.065+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(20 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f171c05b040 con 0x5572b98f13a0 2024-09-21T09:05:03.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.065+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f8400 2024-09-21T09:05:03.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.065+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714057030 con 0x5572b98f8400 2024-09-21T09:05:03.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.065+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f8400 2024-09-21T09:05:03.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.065+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714057030 con 0x5572b98f8400 2024-09-21T09:05:03.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.065+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98ec780 2024-09-21T09:05:03.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.065+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(23 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f172400e070 con 0x5572b98ec780 2024-09-21T09:05:03.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.065+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98ec780 2024-09-21T09:05:03.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.065+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f172400e070 con 0x5572b98ec780 2024-09-21T09:05:03.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.065+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f13a0 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.066+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(25 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171c05b040 con 0x5572b98f13a0 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.066+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f8400 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.066+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714057030 con 0x5572b98f8400 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.066+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x7f1714077040 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.066+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172400e070 con 0x7f1714077040 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.066+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98ec780 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.066+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172400e070 con 0x5572b98ec780 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.066+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f13a0 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.067+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171c05b040 con 0x5572b98f13a0 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.067+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f8400 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.067+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714057030 con 0x5572b98f8400 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.067+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x7f1714077040 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.067+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172400e070 con 0x7f1714077040 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.067+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x7f1714077040 2024-09-21T09:05:03.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.067+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172400e070 con 0x7f1714077040 2024-09-21T09:05:03.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.067+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f8400 2024-09-21T09:05:03.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.068+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714057030 con 0x5572b98f8400 2024-09-21T09:05:03.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.068+0000 7f1723fff640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98f13a0 2024-09-21T09:05:03.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.068+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171c05b040 con 0x5572b98f13a0 2024-09-21T09:05:03.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.068+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x5572b98ec780 2024-09-21T09:05:03.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.068+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(35 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f172400e070 con 0x5572b98ec780 2024-09-21T09:05:03.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.068+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572b98faeb0 con 0x7f1714077040 2024-09-21T09:05:03.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.068+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(36 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172400e070 con 0x7f1714077040 2024-09-21T09:05:03.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.068+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572b98fef10 con 0x5572b98ec780 2024-09-21T09:05:03.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.069+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f172400e070 con 0x5572b98ec780 2024-09-21T09:05:03.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.069+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:38 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572b98f06b0 con 0x5572b98f13a0 2024-09-21T09:05:03.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.069+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(38 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f171c05b040 con 0x5572b98f13a0 2024-09-21T09:05:03.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.069+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:39 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572b98fa740 con 0x5572b98f13a0 2024-09-21T09:05:03.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.070+0000 7f172924e640 1 -- 172.21.15.178:0/28742892 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(39 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [create,call,writefull 0~1155] v31'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f171c05b040 con 0x5572b98f13a0 2024-09-21T09:05:03.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.070+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572b98fc4e0 con 0x5572b98ec780 2024-09-21T09:05:03.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.072+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v31'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f172400e070 con 0x5572b98ec780 2024-09-21T09:05:03.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.072+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572b98f9a00 con 0x5572b98ec780 2024-09-21T09:05:03.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.073+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v31'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f172400e070 con 0x5572b98ec780 2024-09-21T09:05:03.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.073+0000 7f172d523800 1 -- 172.21.15.178:0/1204076802 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1604036b40 msgr2=0x7f1604039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.073+0000 7f172d523800 1 --2- 172.21.15.178:0/1204076802 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1604036b40 0x7f1604039000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1714057000 tx=0x7f1714052000 comp rx=0 tx=0).stop 2024-09-21T09:05:03.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.073+0000 7f172d523800 1 -- 172.21.15.178:0/1204076802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98bd810 msgr2=0x5572b98c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.073+0000 7f172d523800 1 --2- 172.21.15.178:0/1204076802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98bd810 0x5572b98c4d90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1724013040 tx=0x7f1724003370 comp rx=0 tx=0).stop 2024-09-21T09:05:03.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.073+0000 7f172d523800 1 -- 172.21.15.178:0/1204076802 shutdown_connections 2024-09-21T09:05:03.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.073+0000 7f172d523800 1 --2- 172.21.15.178:0/1204076802 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1604036b40 0x7f1604039000 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.073+0000 7f172d523800 1 --2- 172.21.15.178:0/1204076802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98bd810 0x5572b98c4d90 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.073+0000 7f172d523800 1 -- 172.21.15.178:0/1204076802 >> 172.21.15.178:0/1204076802 conn(0x5572b98b8b80 msgr2=0x5572b98b7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/1204076802 shutdown_connections 2024-09-21T09:05:03.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/1204076802 wait complete. 2024-09-21T09:05:03.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/883828215 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f156c036b40 msgr2=0x7f156c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 --2- 172.21.15.178:0/883828215 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f156c036b40 0x7f156c039000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1714045be0 tx=0x7f1714005ac0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/883828215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98ded20 msgr2=0x5572b98df140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 --2- 172.21.15.178:0/883828215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98ded20 0x5572b98df140 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f171c048e70 tx=0x7f171c04b510 comp rx=0 tx=0).stop 2024-09-21T09:05:03.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/883828215 shutdown_connections 2024-09-21T09:05:03.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 --2- 172.21.15.178:0/883828215 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f156c036b40 0x7f156c039000 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 --2- 172.21.15.178:0/883828215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b98ded20 0x5572b98df140 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/883828215 >> 172.21.15.178:0/883828215 conn(0x5572b98d3c50 msgr2=0x5572b98d6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/883828215 shutdown_connections 2024-09-21T09:05:03.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/883828215 wait complete. 2024-09-21T09:05:03.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5572b98f13a0 msgr2=0x5572b98f3810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5572b98f13a0 0x5572b98f3810 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5572b98ec780 msgr2=0x5572b98eeb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5572b98ec780 0x5572b98eeb70 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f1714077040 msgr2=0x7f1714077420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f1714077040 0x7f1714077420 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5572b98f8400 msgr2=0x5572b98fb330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5572b98f8400 0x5572b98fb330 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1610036b90 msgr2=0x7f1610039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1610036b90 0x7f1610039050 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f171c0015b0 tx=0x7f171c0014c0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b97bdd10 msgr2=0x5572b98b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f1729a4f640 1 -- 172.21.15.178:0/28742892 reap_dead start 2024-09-21T09:05:03.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b97bdd10 0x5572b98b0680 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f171c000c00 tx=0x7f171c000ed0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 shutdown_connections 2024-09-21T09:05:03.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 --2- 172.21.15.178:0/28742892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b97bdd10 0x5572b98b0680 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.074+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 >> 172.21.15.178:0/28742892 conn(0x5572b97b1de0 msgr2=0x5572b98a2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.075+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 shutdown_connections 2024-09-21T09:05:03.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.075+0000 7f172d523800 1 -- 172.21.15.178:0/28742892 wait complete. 2024-09-21T09:05:03.085 INFO:teuthology.orchestra.run.smithi178.stdout:{"id":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-21T09:05:03.085 DEBUG:tasks.util.rgw: json result: {'id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-21T09:05:03.085 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-21T09:05:03.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-21T09:05:03.086 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-21T09:05:03.167 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:03.167 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:03.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.166+0000 7f9581c0e800 1 Processor -- start 2024-09-21T09:05:03.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.166+0000 7f9581c0e800 1 -- start start 2024-09-21T09:05:03.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.167+0000 7f9581c0e800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x561cbf855540 0x561cbf855940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.167+0000 7f9581c0e800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561cbf715b30 con 0x561cbf855e80 2024-09-21T09:05:03.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.167+0000 7f9581c0e800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x561cbf6f7360 con 0x561cbf855540 2024-09-21T09:05:03.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.167+0000 7f957d2f7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x561cbf855540 0x561cbf855940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.167+0000 7f957d2f7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x561cbf855540 0x561cbf855940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60356/0 (socket says 172.21.15.178:60356) 2024-09-21T09:05:03.169 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.167+0000 7f957d2f7640 1 -- 172.21.15.178:0/2229066198 learned_addr learned my addr 172.21.15.178:0/2229066198 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.167+0000 7f957d2f7640 1 -- 172.21.15.178:0/2229066198 >> v1:172.21.15.44:6789/0 conn(0x561cbf855e80 legacy=0x561cbf85aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.170 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.167+0000 7f957d2f7640 1 -- 172.21.15.178:0/2229066198 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbf71de00 con 0x561cbf855540 2024-09-21T09:05:03.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.169+0000 7f957d2f7640 1 --2- 172.21.15.178:0/2229066198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf855940 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f957000a520 tx=0x7f9570045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4128659884fed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.169+0000 7f956ffff640 1 -- 172.21.15.178:0/2229066198 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9570055070 con 0x561cbf855540 2024-09-21T09:05:03.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.169+0000 7f956ffff640 1 -- 172.21.15.178:0/2229066198 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95700515b0 con 0x561cbf855540 2024-09-21T09:05:03.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.169+0000 7f956ffff640 1 -- 172.21.15.178:0/2229066198 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95700518d0 con 0x561cbf855540 2024-09-21T09:05:03.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.170+0000 7f9581c0e800 1 -- 172.21.15.178:0/2229066198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 msgr2=0x561cbf855940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.170+0000 7f9581c0e800 1 --2- 172.21.15.178:0/2229066198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf855940 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f957000a520 tx=0x7f9570045ba0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.170+0000 7f9581c0e800 1 -- 172.21.15.178:0/2229066198 shutdown_connections 2024-09-21T09:05:03.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.170+0000 7f9581c0e800 1 --2- 172.21.15.178:0/2229066198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf855940 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.170+0000 7f9581c0e800 1 -- 172.21.15.178:0/2229066198 >> 172.21.15.178:0/2229066198 conn(0x561cbf850dd0 msgr2=0x561cbf8531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.170+0000 7f9581c0e800 1 -- 172.21.15.178:0/2229066198 shutdown_connections 2024-09-21T09:05:03.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.170+0000 7f9581c0e800 1 -- 172.21.15.178:0/2229066198 wait complete. 2024-09-21T09:05:03.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.184+0000 7f9581c0e800 1 Processor -- start 2024-09-21T09:05:03.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.184+0000 7f9581c0e800 1 -- start start 2024-09-21T09:05:03.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.184+0000 7f9581c0e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf944780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.184+0000 7f9581c0e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561cbf7a2320 con 0x561cbf855540 2024-09-21T09:05:03.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.184+0000 7f957d2f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf944780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.184+0000 7f957d2f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf944780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60364/0 (socket says 172.21.15.178:60364) 2024-09-21T09:05:03.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.184+0000 7f957d2f7640 1 -- 172.21.15.178:0/858495024 learned_addr learned my addr 172.21.15.178:0/858495024 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.185+0000 7f957d2f7640 1 -- 172.21.15.178:0/858495024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbf6efbc0 con 0x561cbf855540 2024-09-21T09:05:03.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.185+0000 7f957d2f7640 1 --2- 172.21.15.178:0/858495024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf944780 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9570025da0 tx=0x7f9570051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aefd7ea64d2bcc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.185+0000 7f946b606640 1 -- 172.21.15.178:0/858495024 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9570051950 con 0x561cbf855540 2024-09-21T09:05:03.193 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.185+0000 7f946b606640 1 -- 172.21.15.178:0/858495024 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9570051af0 con 0x561cbf855540 2024-09-21T09:05:03.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.185+0000 7f946b606640 1 -- 172.21.15.178:0/858495024 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9570051dd0 con 0x561cbf855540 2024-09-21T09:05:03.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.186+0000 7f9581c0e800 1 -- 172.21.15.178:0/858495024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 msgr2=0x561cbf944780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.186+0000 7f9581c0e800 1 --2- 172.21.15.178:0/858495024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf944780 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9570025da0 tx=0x7f9570051000 comp rx=0 tx=0).stop 2024-09-21T09:05:03.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.186+0000 7f9581c0e800 1 -- 172.21.15.178:0/858495024 shutdown_connections 2024-09-21T09:05:03.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.186+0000 7f9581c0e800 1 --2- 172.21.15.178:0/858495024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf944780 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.186+0000 7f9581c0e800 1 -- 172.21.15.178:0/858495024 >> 172.21.15.178:0/858495024 conn(0x561cbf850dd0 msgr2=0x561cbf940140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.186+0000 7f9581c0e800 1 -- 172.21.15.178:0/858495024 shutdown_connections 2024-09-21T09:05:03.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.186+0000 7f9581c0e800 1 -- 172.21.15.178:0/858495024 wait complete. 2024-09-21T09:05:03.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.186+0000 7f9581c0e800 1 Processor -- start 2024-09-21T09:05:03.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.186+0000 7f9581c0e800 1 -- start start 2024-09-21T09:05:03.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.186+0000 7f9581c0e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf7ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.186+0000 7f9581c0e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561cbf85c560 con 0x561cbf855540 2024-09-21T09:05:03.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.187+0000 7f957d2f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf7ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.187+0000 7f957d2f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf7ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60374/0 (socket says 172.21.15.178:60374) 2024-09-21T09:05:03.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.187+0000 7f957d2f7640 1 -- 172.21.15.178:0/1505691292 learned_addr learned my addr 172.21.15.178:0/1505691292 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.187+0000 7f957d2f7640 1 -- 172.21.15.178:0/1505691292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbf703fe0 con 0x561cbf855540 2024-09-21T09:05:03.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.187+0000 7f957d2f7640 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf7ca5d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9570067040 tx=0x7f9570002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.187+0000 7f9469e03640 1 -- 172.21.15.178:0/1505691292 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9570073070 con 0x561cbf855540 2024-09-21T09:05:03.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.187+0000 7f9469e03640 1 -- 172.21.15.178:0/1505691292 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957005a450 con 0x561cbf855540 2024-09-21T09:05:03.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.187+0000 7f9581c0e800 1 -- 172.21.15.178:0/1505691292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cbf94fd00 con 0x561cbf855540 2024-09-21T09:05:03.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.187+0000 7f9469e03640 1 -- 172.21.15.178:0/1505691292 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f957005a730 con 0x561cbf855540 2024-09-21T09:05:03.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.187+0000 7f9581c0e800 1 -- 172.21.15.178:0/1505691292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cbf950280 con 0x561cbf855540 2024-09-21T09:05:03.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.188+0000 7f9581c0e800 1 Processor -- start 2024-09-21T09:05:03.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.188+0000 7f9581c0e800 1 -- start start 2024-09-21T09:05:03.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.188+0000 7f9581c0e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf959eb0 0x561cbf95a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.188+0000 7f9581c0e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561cbf6f1580 con 0x561cbf959eb0 2024-09-21T09:05:03.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.188+0000 7f9469e03640 1 -- 172.21.15.178:0/1505691292 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9570076070 con 0x561cbf855540 2024-09-21T09:05:03.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.188+0000 7f957daf8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf959eb0 0x561cbf95a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.188+0000 7f957daf8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf959eb0 0x561cbf95a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60384/0 (socket says 172.21.15.178:60384) 2024-09-21T09:05:03.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.188+0000 7f957daf8640 1 -- 172.21.15.178:0/1039029954 learned_addr learned my addr 172.21.15.178:0/1039029954 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.188+0000 7f9469e03640 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9464036b40 0x7f9464039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.188+0000 7f9469e03640 1 -- 172.21.15.178:0/1505691292 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f9570062070 con 0x561cbf855540 2024-09-21T09:05:03.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.188+0000 7f957d2f7640 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9464036b40 0x7f9464039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.189+0000 7f957daf8640 1 -- 172.21.15.178:0/1039029954 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbf95a7f0 con 0x561cbf959eb0 2024-09-21T09:05:03.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.189+0000 7f957daf8640 1 --2- 172.21.15.178:0/1039029954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf959eb0 0x561cbf95a2b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f957800a430 tx=0x7f957800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb977189f90b5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.189+0000 7f957d2f7640 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9464036b40 0x7f9464039000 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9570050e90 tx=0x7f957006ee90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.189+0000 7f94637fe640 1 -- 172.21.15.178:0/1039029954 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9578015070 con 0x561cbf959eb0 2024-09-21T09:05:03.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.189+0000 7f94637fe640 1 -- 172.21.15.178:0/1039029954 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9578001670 con 0x561cbf959eb0 2024-09-21T09:05:03.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.189+0000 7f94637fe640 1 -- 172.21.15.178:0/1039029954 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9578001990 con 0x561cbf959eb0 2024-09-21T09:05:03.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.189+0000 7f9581c0e800 1 -- 172.21.15.178:0/1039029954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf959eb0 msgr2=0x561cbf95a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.189+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1039029954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf959eb0 0x561cbf95a2b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f957800a430 tx=0x7f957800a8f0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.190+0000 7f9581c0e800 1 -- 172.21.15.178:0/1039029954 shutdown_connections 2024-09-21T09:05:03.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.190+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1039029954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf959eb0 0x561cbf95a2b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.190+0000 7f9581c0e800 1 -- 172.21.15.178:0/1039029954 >> 172.21.15.178:0/1039029954 conn(0x561cbf855e80 msgr2=0x561cbf955630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.190+0000 7f9581c0e800 1 -- 172.21.15.178:0/1039029954 shutdown_connections 2024-09-21T09:05:03.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.190+0000 7f9581c0e800 1 -- 172.21.15.178:0/1039029954 wait complete. 2024-09-21T09:05:03.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.190+0000 7f9581c0e800 1 Processor -- start 2024-09-21T09:05:03.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.190+0000 7f9581c0e800 1 -- start start 2024-09-21T09:05:03.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.190+0000 7f9581c0e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf959eb0 0x561cbf9613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.190+0000 7f9581c0e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561cbf95b1a0 con 0x561cbf959eb0 2024-09-21T09:05:03.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.190+0000 7f957daf8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf959eb0 0x561cbf9613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.190+0000 7f957daf8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf959eb0 0x561cbf9613c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60392/0 (socket says 172.21.15.178:60392) 2024-09-21T09:05:03.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.190+0000 7f957daf8640 1 -- 172.21.15.178:0/4022716414 learned_addr learned my addr 172.21.15.178:0/4022716414 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.191+0000 7f957daf8640 1 -- 172.21.15.178:0/4022716414 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbf961900 con 0x561cbf959eb0 2024-09-21T09:05:03.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.191+0000 7f957daf8640 1 --2- 172.21.15.178:0/4022716414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf959eb0 0x561cbf9613c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9578013040 tx=0x7f9578003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.191+0000 7f9461ffb640 1 -- 172.21.15.178:0/4022716414 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9578020020 con 0x561cbf959eb0 2024-09-21T09:05:03.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.191+0000 7f9461ffb640 1 -- 172.21.15.178:0/4022716414 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95780108e0 con 0x561cbf959eb0 2024-09-21T09:05:03.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.191+0000 7f9461ffb640 1 -- 172.21.15.178:0/4022716414 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9578015040 con 0x561cbf959eb0 2024-09-21T09:05:03.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.191+0000 7f9581c0e800 1 -- 172.21.15.178:0/4022716414 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cbf961b90 con 0x561cbf959eb0 2024-09-21T09:05:03.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.191+0000 7f9581c0e800 1 -- 172.21.15.178:0/4022716414 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cbf964840 con 0x561cbf959eb0 2024-09-21T09:05:03.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.192+0000 7f9461ffb640 1 -- 172.21.15.178:0/4022716414 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9578023020 con 0x561cbf959eb0 2024-09-21T09:05:03.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.192+0000 7f9461ffb640 1 --2- 172.21.15.178:0/4022716414 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9454036b40 0x7f9454039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.192+0000 7f9461ffb640 1 -- 172.21.15.178:0/4022716414 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f957804c300 con 0x561cbf959eb0 2024-09-21T09:05:03.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.192+0000 7f957caf6640 1 --2- 172.21.15.178:0/4022716414 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9454036b40 0x7f9454039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.192+0000 7f9581c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:03.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.192+0000 7f9581c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:03.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.193+0000 7f957caf6640 1 --2- 172.21.15.178:0/4022716414 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9454036b40 0x7f9454039000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x561cbf9561d0 tx=0x7f9574001310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.193+0000 7f9581c0e800 1 Processor -- start 2024-09-21T09:05:03.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.193+0000 7f9581c0e800 1 -- start start 2024-09-21T09:05:03.204 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.193+0000 7f9581c0e800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf97b410 0x561cbf97b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.193+0000 7f9581c0e800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561cbf944e70 con 0x561cbf97b410 2024-09-21T09:05:03.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.193+0000 7f957d2f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf97b410 0x561cbf97b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.193+0000 7f957d2f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf97b410 0x561cbf97b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60408/0 (socket says 172.21.15.178:60408) 2024-09-21T09:05:03.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.193+0000 7f957d2f7640 1 -- 172.21.15.178:0/1644196889 learned_addr learned my addr 172.21.15.178:0/1644196889 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.194+0000 7f957d2f7640 1 -- 172.21.15.178:0/1644196889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbf97be00 con 0x561cbf97b410 2024-09-21T09:05:03.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.194+0000 7f957d2f7640 1 --2- 172.21.15.178:0/1644196889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf97b410 0x561cbf97b830 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9570051840 tx=0x7f957008f220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.194+0000 7f9442fdd640 1 -- 172.21.15.178:0/1644196889 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f957007d040 con 0x561cbf97b410 2024-09-21T09:05:03.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.194+0000 7f9442fdd640 1 -- 172.21.15.178:0/1644196889 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9570094070 con 0x561cbf97b410 2024-09-21T09:05:03.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.194+0000 7f9581c0e800 1 -- 172.21.15.178:0/1644196889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cbf97ea50 con 0x561cbf97b410 2024-09-21T09:05:03.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.194+0000 7f9442fdd640 1 -- 172.21.15.178:0/1644196889 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9570064730 con 0x561cbf97b410 2024-09-21T09:05:03.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.194+0000 7f9581c0e800 1 -- 172.21.15.178:0/1644196889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cbf97ee30 con 0x561cbf97b410 2024-09-21T09:05:03.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.195+0000 7f9442fdd640 1 -- 172.21.15.178:0/1644196889 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f957008c040 con 0x561cbf97b410 2024-09-21T09:05:03.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.195+0000 7f9442fdd640 1 --2- 172.21.15.178:0/1644196889 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f93b4036b90 0x7f93b4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.195+0000 7f9442fdd640 1 -- 172.21.15.178:0/1644196889 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f95700920e0 con 0x561cbf97b410 2024-09-21T09:05:03.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.195+0000 7f957caf6640 1 --2- 172.21.15.178:0/1644196889 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f93b4036b90 0x7f93b4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.196+0000 7f9440fd9640 20 reqs_thread_entry: start 2024-09-21T09:05:03.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.196+0000 7f957caf6640 1 --2- 172.21.15.178:0/1644196889 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f93b4036b90 0x7f93b4039050 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9574003f10 tx=0x7f9574006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.196+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cbf988e70 0x561cbf98b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.196+0000 7f9581c0e800 1 -- 172.21.15.178:0/1505691292 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cbf98b900 con 0x561cbf988e70 2024-09-21T09:05:03.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.196+0000 7f957daf8640 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cbf988e70 0x561cbf98b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.196+0000 7f957daf8640 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cbf988e70 0x561cbf98b280 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.196+0000 7f957daf8640 1 -- 172.21.15.178:0/1505691292 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f957800e070 con 0x561cbf988e70 2024-09-21T09:05:03.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.196+0000 7f9581c0e800 1 -- 172.21.15.178:0/1505691292 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cbf98c1e0 con 0x561cbf988e70 2024-09-21T09:05:03.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.197+0000 7f957daf8640 1 -- 172.21.15.178:0/1505691292 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f957800e070 con 0x561cbf988e70 2024-09-21T09:05:03.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.197+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cbf98daf0 0x561cbf98ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.197+0000 7f9581c0e800 1 -- 172.21.15.178:0/1505691292 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561cbf990650 con 0x561cbf98daf0 2024-09-21T09:05:03.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.197+0000 7f957d2f7640 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cbf98daf0 0x561cbf98ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.197+0000 7f957d2f7640 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cbf98daf0 0x561cbf98ff60 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.197+0000 7f957d2f7640 1 -- 172.21.15.178:0/1505691292 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f957007f070 con 0x561cbf98daf0 2024-09-21T09:05:03.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.198+0000 7f9581c0e800 1 -- 172.21.15.178:0/4022716414 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9454036b40 msgr2=0x7f9454039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.198+0000 7f9581c0e800 1 --2- 172.21.15.178:0/4022716414 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9454036b40 0x7f9454039000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x561cbf9561d0 tx=0x7f9574001310 comp rx=0 tx=0).stop 2024-09-21T09:05:03.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.198+0000 7f9581c0e800 1 -- 172.21.15.178:0/4022716414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf959eb0 msgr2=0x561cbf9613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.198+0000 7f9581c0e800 1 --2- 172.21.15.178:0/4022716414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf959eb0 0x561cbf9613c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9578013040 tx=0x7f9578003370 comp rx=0 tx=0).stop 2024-09-21T09:05:03.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.198+0000 7f9581c0e800 1 -- 172.21.15.178:0/4022716414 shutdown_connections 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.198+0000 7f9581c0e800 1 --2- 172.21.15.178:0/4022716414 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9454036b40 0x7f9454039000 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.198+0000 7f9581c0e800 1 --2- 172.21.15.178:0/4022716414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf959eb0 0x561cbf9613c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.198+0000 7f9581c0e800 1 -- 172.21.15.178:0/4022716414 >> 172.21.15.178:0/4022716414 conn(0x561cbf855e80 msgr2=0x561cbf955200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.198+0000 7f9581c0e800 1 -- 172.21.15.178:0/4022716414 shutdown_connections 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.198+0000 7f9581c0e800 1 -- 172.21.15.178:0/4022716414 wait complete. 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 -- 172.21.15.178:0/1644196889 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f93b4036b90 msgr2=0x7f93b4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1644196889 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f93b4036b90 0x7f93b4039050 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9574003f10 tx=0x7f9574006000 comp rx=0 tx=0).stop 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 -- 172.21.15.178:0/1644196889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf97b410 msgr2=0x561cbf97b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1644196889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf97b410 0x561cbf97b830 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9570051840 tx=0x7f957008f220 comp rx=0 tx=0).stop 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 -- 172.21.15.178:0/1644196889 shutdown_connections 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1644196889 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f93b4036b90 0x7f93b4039050 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1644196889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf97b410 0x561cbf97b830 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 -- 172.21.15.178:0/1644196889 >> 172.21.15.178:0/1644196889 conn(0x561cbf970320 msgr2=0x561cbf972c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 -- 172.21.15.178:0/1644196889 shutdown_connections 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 -- 172.21.15.178:0/1644196889 wait complete. 2024-09-21T09:05:03.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 -- 172.21.15.178:0/1505691292 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cbf98daf0 msgr2=0x561cbf98ff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cbf98daf0 0x561cbf98ff60 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 -- 172.21.15.178:0/1505691292 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cbf988e70 msgr2=0x561cbf98b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cbf988e70 0x561cbf98b280 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 -- 172.21.15.178:0/1505691292 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9464036b40 msgr2=0x7f9464039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9464036b40 0x7f9464039000 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9570050e90 tx=0x7f957006ee90 comp rx=0 tx=0).stop 2024-09-21T09:05:03.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 -- 172.21.15.178:0/1505691292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 msgr2=0x561cbf7ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf7ca5d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9570067040 tx=0x7f9570002fb0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 -- 172.21.15.178:0/1505691292 shutdown_connections 2024-09-21T09:05:03.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561cbf98daf0 0x561cbf98ff60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561cbf988e70 0x561cbf98b280 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f9464036b40 0x7f9464039000 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 --2- 172.21.15.178:0/1505691292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561cbf855540 0x561cbf7ca5d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 -- 172.21.15.178:0/1505691292 >> 172.21.15.178:0/1505691292 conn(0x561cbf850dd0 msgr2=0x561cbf93e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 -- 172.21.15.178:0/1505691292 shutdown_connections 2024-09-21T09:05:03.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.199+0000 7f9581c0e800 1 -- 172.21.15.178:0/1505691292 wait complete. 2024-09-21T09:05:03.210 INFO:teuthology.orchestra.run.smithi178.stdout:{"id":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-21T09:05:03.211 DEBUG:tasks.util.rgw: json result: {'id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-21T09:05:03.211 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-21T09:05:03.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-21T09:05:03.211 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-21T09:05:03.296 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:03.297 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:03.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.296+0000 7f2757830800 1 Processor -- start 2024-09-21T09:05:03.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.296+0000 7f2757830800 1 -- start start 2024-09-21T09:05:03.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.296+0000 7f2757830800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x559cfd03e990 0x559cfd040d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.296+0000 7f2757830800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559cfcefab30 con 0x559cfd03a550 2024-09-21T09:05:03.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.296+0000 7f2757830800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x559cfcedc360 con 0x559cfd03e990 2024-09-21T09:05:03.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.296+0000 7f2752323640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x559cfd03e990 0x559cfd040d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.296+0000 7f2752323640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x559cfd03e990 0x559cfd040d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60412/0 (socket says 172.21.15.178:60412) 2024-09-21T09:05:03.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.296+0000 7f2752b24640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x559cfd03a550 0x559cfd03a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40462/0 (socket says 172.21.15.178:40462) 2024-09-21T09:05:03.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.296+0000 7f2752323640 1 -- 172.21.15.178:0/565363144 learned_addr learned my addr 172.21.15.178:0/565363144 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.296+0000 7f2752323640 1 -- 172.21.15.178:0/565363144 >> v1:172.21.15.44:6789/0 conn(0x559cfd03a550 legacy=0x559cfd03a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.299 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.296+0000 7f2752323640 1 -- 172.21.15.178:0/565363144 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cfcf02e00 con 0x559cfd03e990 2024-09-21T09:05:03.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.298+0000 7f2752323640 1 --2- 172.21.15.178:0/565363144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03e990 0x559cfd040d80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f274800a520 tx=0x7f2748045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a230a249451cf7a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.298+0000 7f2751b22640 1 -- 172.21.15.178:0/565363144 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2748055070 con 0x559cfd03e990 2024-09-21T09:05:03.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.298+0000 7f2751b22640 1 -- 172.21.15.178:0/565363144 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27480515b0 con 0x559cfd03e990 2024-09-21T09:05:03.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.298+0000 7f2751b22640 1 -- 172.21.15.178:0/565363144 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27480518d0 con 0x559cfd03e990 2024-09-21T09:05:03.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.299+0000 7f2757830800 1 -- 172.21.15.178:0/565363144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03e990 msgr2=0x559cfd040d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.299+0000 7f2757830800 1 --2- 172.21.15.178:0/565363144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03e990 0x559cfd040d80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f274800a520 tx=0x7f2748045ba0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.299+0000 7f2757830800 1 -- 172.21.15.178:0/565363144 shutdown_connections 2024-09-21T09:05:03.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.299+0000 7f2757830800 1 --2- 172.21.15.178:0/565363144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03e990 0x559cfd040d80 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.299+0000 7f2757830800 1 -- 172.21.15.178:0/565363144 >> 172.21.15.178:0/565363144 conn(0x559cfd035e40 msgr2=0x559cfd038260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.299+0000 7f2757830800 1 -- 172.21.15.178:0/565363144 shutdown_connections 2024-09-21T09:05:03.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.299+0000 7f2757830800 1 -- 172.21.15.178:0/565363144 wait complete. 2024-09-21T09:05:03.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.313+0000 7f2757830800 1 Processor -- start 2024-09-21T09:05:03.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.313+0000 7f2757830800 1 -- start start 2024-09-21T09:05:03.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.313+0000 7f2757830800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03a550 0x559cfd128760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.313+0000 7f2757830800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559cfcf87350 con 0x559cfd03a550 2024-09-21T09:05:03.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.313+0000 7f2752b24640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03a550 0x559cfd128760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.313+0000 7f2752b24640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03a550 0x559cfd128760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60420/0 (socket says 172.21.15.178:60420) 2024-09-21T09:05:03.315 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.313+0000 7f2752b24640 1 -- 172.21.15.178:0/1720757937 learned_addr learned my addr 172.21.15.178:0/1720757937 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.314+0000 7f2752b24640 1 -- 172.21.15.178:0/1720757937 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cfced4bc0 con 0x559cfd03a550 2024-09-21T09:05:03.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.314+0000 7f2752b24640 1 --2- 172.21.15.178:0/1720757937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03a550 0x559cfd128760 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f274400b230 tx=0x7f274400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3154796a7cc807b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.314+0000 7f2640e09640 1 -- 172.21.15.178:0/1720757937 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f274400e5c0 con 0x559cfd03a550 2024-09-21T09:05:03.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.314+0000 7f2640e09640 1 -- 172.21.15.178:0/1720757937 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2744006070 con 0x559cfd03a550 2024-09-21T09:05:03.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.314+0000 7f2640e09640 1 -- 172.21.15.178:0/1720757937 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f274400e890 con 0x559cfd03a550 2024-09-21T09:05:03.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.315+0000 7f2757830800 1 -- 172.21.15.178:0/1720757937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03a550 msgr2=0x559cfd128760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.315+0000 7f2757830800 1 --2- 172.21.15.178:0/1720757937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03a550 0x559cfd128760 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f274400b230 tx=0x7f274400b6f0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.315+0000 7f2757830800 1 -- 172.21.15.178:0/1720757937 shutdown_connections 2024-09-21T09:05:03.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.315+0000 7f2757830800 1 --2- 172.21.15.178:0/1720757937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03a550 0x559cfd128760 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.315+0000 7f2757830800 1 -- 172.21.15.178:0/1720757937 >> 172.21.15.178:0/1720757937 conn(0x559cfd035e40 msgr2=0x559cfd124120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.315+0000 7f2757830800 1 -- 172.21.15.178:0/1720757937 shutdown_connections 2024-09-21T09:05:03.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.315+0000 7f2757830800 1 -- 172.21.15.178:0/1720757937 wait complete. 2024-09-21T09:05:03.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.315+0000 7f2757830800 1 Processor -- start 2024-09-21T09:05:03.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.315+0000 7f2757830800 1 -- start start 2024-09-21T09:05:03.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.315+0000 7f2757830800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03a550 0x559cfd130160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.315+0000 7f2757830800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559cfd0415c0 con 0x559cfd03a550 2024-09-21T09:05:03.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.315+0000 7f2752b24640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03a550 0x559cfd130160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.315+0000 7f2752b24640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03a550 0x559cfd130160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60434/0 (socket says 172.21.15.178:60434) 2024-09-21T09:05:03.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.315+0000 7f2752b24640 1 -- 172.21.15.178:0/4070201026 learned_addr learned my addr 172.21.15.178:0/4070201026 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.316+0000 7f2752b24640 1 -- 172.21.15.178:0/4070201026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cfcee8fe0 con 0x559cfd03a550 2024-09-21T09:05:03.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.316+0000 7f2752b24640 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03a550 0x559cfd130160 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2744000c00 tx=0x7f2744000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.316+0000 7f263f606640 1 -- 172.21.15.178:0/4070201026 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f274400f8d0 con 0x559cfd03a550 2024-09-21T09:05:03.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.316+0000 7f263f606640 1 -- 172.21.15.178:0/4070201026 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274400fa90 con 0x559cfd03a550 2024-09-21T09:05:03.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.316+0000 7f2757830800 1 -- 172.21.15.178:0/4070201026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cfd1306a0 con 0x559cfd03a550 2024-09-21T09:05:03.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.316+0000 7f263f606640 1 -- 172.21.15.178:0/4070201026 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f274400fdb0 con 0x559cfd03a550 2024-09-21T09:05:03.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.316+0000 7f2757830800 1 -- 172.21.15.178:0/4070201026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cfd130bc0 con 0x559cfd03a550 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.317+0000 7f2757830800 1 Processor -- start 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.317+0000 7f2757830800 1 -- start start 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.317+0000 7f2757830800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd13cf00 0x559cfd13d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.317+0000 7f2757830800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559cfced6580 con 0x559cfd13cf00 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.317+0000 7f263f606640 1 -- 172.21.15.178:0/4070201026 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2744017070 con 0x559cfd03a550 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.317+0000 7f2753325640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd13cf00 0x559cfd13d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.317+0000 7f263f606640 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2638036b40 0x7f2638039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.317+0000 7f2753325640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd13cf00 0x559cfd13d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60444/0 (socket says 172.21.15.178:60444) 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.317+0000 7f2753325640 1 -- 172.21.15.178:0/2824381191 learned_addr learned my addr 172.21.15.178:0/2824381191 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.317+0000 7f263f606640 1 -- 172.21.15.178:0/4070201026 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f2744015020 con 0x559cfd03a550 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.317+0000 7f2752b24640 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2638036b40 0x7f2638039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.317+0000 7f2753325640 1 -- 172.21.15.178:0/2824381191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cfd13d840 con 0x559cfd13cf00 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.318+0000 7f2753325640 1 --2- 172.21.15.178:0/2824381191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd13cf00 0x559cfd13d300 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f274c00a430 tx=0x7f274c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f77cf40c7b4d96 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.318+0000 7f2752b24640 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2638036b40 0x7f2638039000 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f274401d5c0 tx=0x7f2744035040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.318+0000 7f263d602640 1 -- 172.21.15.178:0/2824381191 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f274c015070 con 0x559cfd13cf00 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.318+0000 7f263d602640 1 -- 172.21.15.178:0/2824381191 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c001670 con 0x559cfd13cf00 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.318+0000 7f263d602640 1 -- 172.21.15.178:0/2824381191 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f274c001990 con 0x559cfd13cf00 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.318+0000 7f2757830800 1 -- 172.21.15.178:0/2824381191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd13cf00 msgr2=0x559cfd13d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.318+0000 7f2757830800 1 --2- 172.21.15.178:0/2824381191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd13cf00 0x559cfd13d300 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f274c00a430 tx=0x7f274c00a8f0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.318+0000 7f2757830800 1 -- 172.21.15.178:0/2824381191 shutdown_connections 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.318+0000 7f2757830800 1 --2- 172.21.15.178:0/2824381191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd13cf00 0x559cfd13d300 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.318+0000 7f2757830800 1 -- 172.21.15.178:0/2824381191 >> 172.21.15.178:0/2824381191 conn(0x559cfd03e990 msgr2=0x559cfd138680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.318+0000 7f2757830800 1 -- 172.21.15.178:0/2824381191 shutdown_connections 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.318+0000 7f2757830800 1 -- 172.21.15.178:0/2824381191 wait complete. 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.319+0000 7f2757830800 1 Processor -- start 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.319+0000 7f2757830800 1 -- start start 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.319+0000 7f2757830800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd13cf00 0x559cfd1444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.319+0000 7f2757830800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559cfd13e1f0 con 0x559cfd13cf00 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.319+0000 7f2753325640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd13cf00 0x559cfd1444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.319+0000 7f2753325640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd13cf00 0x559cfd1444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60452/0 (socket says 172.21.15.178:60452) 2024-09-21T09:05:03.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.319+0000 7f2753325640 1 -- 172.21.15.178:0/4143914484 learned_addr learned my addr 172.21.15.178:0/4143914484 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.320+0000 7f2753325640 1 -- 172.21.15.178:0/4143914484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cfd1449e0 con 0x559cfd13cf00 2024-09-21T09:05:03.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.320+0000 7f2753325640 1 --2- 172.21.15.178:0/4143914484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd13cf00 0x559cfd1444a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f274c013040 tx=0x7f274c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.320+0000 7f26377fe640 1 -- 172.21.15.178:0/4143914484 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f274c020020 con 0x559cfd13cf00 2024-09-21T09:05:03.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.320+0000 7f26377fe640 1 -- 172.21.15.178:0/4143914484 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c0108e0 con 0x559cfd13cf00 2024-09-21T09:05:03.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.320+0000 7f26377fe640 1 -- 172.21.15.178:0/4143914484 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f274c015040 con 0x559cfd13cf00 2024-09-21T09:05:03.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.320+0000 7f2757830800 1 -- 172.21.15.178:0/4143914484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cfd144c70 con 0x559cfd13cf00 2024-09-21T09:05:03.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.320+0000 7f2757830800 1 -- 172.21.15.178:0/4143914484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cfd147920 con 0x559cfd13cf00 2024-09-21T09:05:03.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.321+0000 7f26377fe640 1 -- 172.21.15.178:0/4143914484 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f274c023020 con 0x559cfd13cf00 2024-09-21T09:05:03.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.321+0000 7f26377fe640 1 --2- 172.21.15.178:0/4143914484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f262c036b40 0x7f262c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.321+0000 7f26377fe640 1 -- 172.21.15.178:0/4143914484 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f274c04c340 con 0x559cfd13cf00 2024-09-21T09:05:03.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.321+0000 7f2752323640 1 --2- 172.21.15.178:0/4143914484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f262c036b40 0x7f262c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.321+0000 7f2757830800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:03.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.321+0000 7f2757830800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:03.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.322+0000 7f2752323640 1 --2- 172.21.15.178:0/4143914484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f262c036b40 0x7f262c039000 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2748057000 tx=0x7f2748052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.322+0000 7f2757830800 1 Processor -- start 2024-09-21T09:05:03.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.322+0000 7f2757830800 1 -- start start 2024-09-21T09:05:03.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.322+0000 7f2757830800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd15e430 0x559cfd15e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.322+0000 7f2757830800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559cfd128f10 con 0x559cfd15e430 2024-09-21T09:05:03.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.322+0000 7f2752b24640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd15e430 0x559cfd15e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.322+0000 7f2752b24640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd15e430 0x559cfd15e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60462/0 (socket says 172.21.15.178:60462) 2024-09-21T09:05:03.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.322+0000 7f2752b24640 1 -- 172.21.15.178:0/1116318533 learned_addr learned my addr 172.21.15.178:0/1116318533 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.322+0000 7f2752b24640 1 -- 172.21.15.178:0/1116318533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cfd15ee20 con 0x559cfd15e430 2024-09-21T09:05:03.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.323+0000 7f2752b24640 1 --2- 172.21.15.178:0/1116318533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd15e430 0x559cfd15e850 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2744001600 tx=0x7f2744017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.323+0000 7f2617fe7640 1 -- 172.21.15.178:0/1116318533 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2744017540 con 0x559cfd15e430 2024-09-21T09:05:03.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.323+0000 7f2617fe7640 1 -- 172.21.15.178:0/1116318533 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2744019860 con 0x559cfd15e430 2024-09-21T09:05:03.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.323+0000 7f2617fe7640 1 -- 172.21.15.178:0/1116318533 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f274404c900 con 0x559cfd15e430 2024-09-21T09:05:03.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.323+0000 7f2757830800 1 -- 172.21.15.178:0/1116318533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cfd161a70 con 0x559cfd15e430 2024-09-21T09:05:03.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.323+0000 7f2757830800 1 -- 172.21.15.178:0/1116318533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cfd161e50 con 0x559cfd15e430 2024-09-21T09:05:03.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.324+0000 7f2617fe7640 1 -- 172.21.15.178:0/1116318533 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f274404b080 con 0x559cfd15e430 2024-09-21T09:05:03.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.324+0000 7f2617fe7640 1 --2- 172.21.15.178:0/1116318533 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2590036b40 0x7f2590039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.324+0000 7f2617fe7640 1 -- 172.21.15.178:0/1116318533 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f274404ac00 con 0x559cfd15e430 2024-09-21T09:05:03.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.324+0000 7f2752323640 1 --2- 172.21.15.178:0/1116318533 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2590036b40 0x7f2590039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.324+0000 7f2615fe3640 20 reqs_thread_entry: start 2024-09-21T09:05:03.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.324+0000 7f2757830800 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559cfd16be30 0x559cfd16e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.324+0000 7f2752323640 1 --2- 172.21.15.178:0/1116318533 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2590036b40 0x7f2590039000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2748045be0 tx=0x7f2748005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.324+0000 7f2757830800 1 -- 172.21.15.178:0/4070201026 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cfd16e9a0 con 0x559cfd16be30 2024-09-21T09:05:03.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.324+0000 7f2753325640 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559cfd16be30 0x559cfd16e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.325+0000 7f2753325640 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559cfd16be30 0x559cfd16e2d0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.325+0000 7f2753325640 1 -- 172.21.15.178:0/4070201026 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f274c00e070 con 0x559cfd16be30 2024-09-21T09:05:03.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.325+0000 7f2757830800 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559cfd1707c0 0x559cfd172bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.325+0000 7f2757830800 1 -- 172.21.15.178:0/4070201026 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:2 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cfd173200 con 0x559cfd1707c0 2024-09-21T09:05:03.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.325+0000 7f2752b24640 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559cfd1707c0 0x559cfd172bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.326+0000 7f2752b24640 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559cfd1707c0 0x559cfd172bb0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.326+0000 7f2752b24640 1 -- 172.21.15.178:0/4070201026 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(2 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f2744039030 con 0x559cfd1707c0 2024-09-21T09:05:03.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.326+0000 7f2757830800 1 -- 172.21.15.178:0/4070201026 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cfd16fe60 con 0x559cfd1707c0 2024-09-21T09:05:03.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.327+0000 7f2752b24640 1 -- 172.21.15.178:0/4070201026 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [stat,call,call,writefull 0~993] v31'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f2744039030 con 0x559cfd1707c0 2024-09-21T09:05:03.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.328+0000 7f2757830800 1 -- 172.21.15.178:0/4143914484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f262c036b40 msgr2=0x7f262c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.328+0000 7f2757830800 1 --2- 172.21.15.178:0/4143914484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f262c036b40 0x7f262c039000 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2748057000 tx=0x7f2748052000 comp rx=0 tx=0).stop 2024-09-21T09:05:03.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.328+0000 7f2757830800 1 -- 172.21.15.178:0/4143914484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd13cf00 msgr2=0x559cfd1444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.328+0000 7f2757830800 1 --2- 172.21.15.178:0/4143914484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd13cf00 0x559cfd1444a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f274c013040 tx=0x7f274c003370 comp rx=0 tx=0).stop 2024-09-21T09:05:03.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.328+0000 7f2757830800 1 -- 172.21.15.178:0/4143914484 shutdown_connections 2024-09-21T09:05:03.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.328+0000 7f2757830800 1 --2- 172.21.15.178:0/4143914484 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f262c036b40 0x7f262c039000 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.328+0000 7f2757830800 1 --2- 172.21.15.178:0/4143914484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd13cf00 0x559cfd1444a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.328+0000 7f2757830800 1 -- 172.21.15.178:0/4143914484 >> 172.21.15.178:0/4143914484 conn(0x559cfd03e990 msgr2=0x559cfd138250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.328+0000 7f2757830800 1 -- 172.21.15.178:0/4143914484 shutdown_connections 2024-09-21T09:05:03.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.328+0000 7f2757830800 1 -- 172.21.15.178:0/4143914484 wait complete. 2024-09-21T09:05:03.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 -- 172.21.15.178:0/1116318533 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2590036b40 msgr2=0x7f2590039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 --2- 172.21.15.178:0/1116318533 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2590036b40 0x7f2590039000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2748045be0 tx=0x7f2748005ac0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 -- 172.21.15.178:0/1116318533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd15e430 msgr2=0x559cfd15e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 --2- 172.21.15.178:0/1116318533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd15e430 0x559cfd15e850 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2744001600 tx=0x7f2744017d50 comp rx=0 tx=0).stop 2024-09-21T09:05:03.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 -- 172.21.15.178:0/1116318533 shutdown_connections 2024-09-21T09:05:03.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 --2- 172.21.15.178:0/1116318533 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2590036b40 0x7f2590039000 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 --2- 172.21.15.178:0/1116318533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd15e430 0x559cfd15e850 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 -- 172.21.15.178:0/1116318533 >> 172.21.15.178:0/1116318533 conn(0x559cfd153360 msgr2=0x559cfd155c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 -- 172.21.15.178:0/1116318533 shutdown_connections 2024-09-21T09:05:03.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 -- 172.21.15.178:0/1116318533 wait complete. 2024-09-21T09:05:03.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 -- 172.21.15.178:0/4070201026 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559cfd1707c0 msgr2=0x559cfd172bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559cfd1707c0 0x559cfd172bb0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 -- 172.21.15.178:0/4070201026 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559cfd16be30 msgr2=0x559cfd16e2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559cfd16be30 0x559cfd16e2d0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 -- 172.21.15.178:0/4070201026 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2638036b40 msgr2=0x7f2638039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2638036b40 0x7f2638039000 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f274401d5c0 tx=0x7f2744035040 comp rx=0 tx=0).stop 2024-09-21T09:05:03.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 -- 172.21.15.178:0/4070201026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03a550 msgr2=0x559cfd130160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03a550 0x559cfd130160 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2744000c00 tx=0x7f2744000ed0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 -- 172.21.15.178:0/4070201026 shutdown_connections 2024-09-21T09:05:03.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559cfd1707c0 0x559cfd172bb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559cfd16be30 0x559cfd16e2d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2638036b40 0x7f2638039000 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 --2- 172.21.15.178:0/4070201026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cfd03a550 0x559cfd130160 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 -- 172.21.15.178:0/4070201026 >> 172.21.15.178:0/4070201026 conn(0x559cfd035e40 msgr2=0x559cfd122a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 -- 172.21.15.178:0/4070201026 shutdown_connections 2024-09-21T09:05:03.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.329+0000 7f2757830800 1 -- 172.21.15.178:0/4070201026 wait complete. 2024-09-21T09:05:03.339 INFO:teuthology.orchestra.run.smithi178.stdout:{"id":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-21T09:05:03.339 DEBUG:tasks.util.rgw: json result: {'id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-21T09:05:03.340 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-21T09:05:03.340 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-21T09:05:03.340 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-21T09:05:03.381 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:03.381 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:03.382 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.380+0000 7f3190e13800 1 Processor -- start 2024-09-21T09:05:03.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.380+0000 7f3190e13800 1 -- start start 2024-09-21T09:05:03.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.380+0000 7f3190e13800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55cfdf784e00 0x55cfdf8141b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.380+0000 7f3190e13800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cfdf6d0b30 con 0x55cfdf8146f0 2024-09-21T09:05:03.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.380+0000 7f3190e13800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55cfdf6b2360 con 0x55cfdf784e00 2024-09-21T09:05:03.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.381+0000 7f318c467640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55cfdf784e00 0x55cfdf8141b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.381+0000 7f318c467640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55cfdf784e00 0x55cfdf8141b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60464/0 (socket says 172.21.15.178:60464) 2024-09-21T09:05:03.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.381+0000 7f318c467640 1 -- 172.21.15.178:0/1685299577 learned_addr learned my addr 172.21.15.178:0/1685299577 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.381+0000 7f318c467640 1 -- 172.21.15.178:0/1685299577 >> v1:172.21.15.44:6789/0 conn(0x55cfdf8146f0 legacy=0x55cfdf816ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.383 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.381+0000 7f318c467640 1 -- 172.21.15.178:0/1685299577 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdf6d8e00 con 0x55cfdf784e00 2024-09-21T09:05:03.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.383+0000 7f318c467640 1 --2- 172.21.15.178:0/1685299577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf8141b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f317c00a520 tx=0x7f317c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf23661bfd7f3d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.383+0000 7f318bc66640 1 -- 172.21.15.178:0/1685299577 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f317c055070 con 0x55cfdf784e00 2024-09-21T09:05:03.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.383+0000 7f318bc66640 1 -- 172.21.15.178:0/1685299577 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317c0515b0 con 0x55cfdf784e00 2024-09-21T09:05:03.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.383+0000 7f318bc66640 1 -- 172.21.15.178:0/1685299577 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f317c0518d0 con 0x55cfdf784e00 2024-09-21T09:05:03.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.383+0000 7f3190e13800 1 -- 172.21.15.178:0/1685299577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 msgr2=0x55cfdf8141b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.383+0000 7f3190e13800 1 --2- 172.21.15.178:0/1685299577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf8141b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f317c00a520 tx=0x7f317c045ba0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.383+0000 7f3190e13800 1 -- 172.21.15.178:0/1685299577 shutdown_connections 2024-09-21T09:05:03.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.383+0000 7f3190e13800 1 --2- 172.21.15.178:0/1685299577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf8141b0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.383+0000 7f3190e13800 1 -- 172.21.15.178:0/1685299577 >> 172.21.15.178:0/1685299577 conn(0x55cfdf80bde0 msgr2=0x55cfdf80e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.383+0000 7f3190e13800 1 -- 172.21.15.178:0/1685299577 shutdown_connections 2024-09-21T09:05:03.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.384+0000 7f3190e13800 1 -- 172.21.15.178:0/1685299577 wait complete. 2024-09-21T09:05:03.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.397+0000 7f3190e13800 1 Processor -- start 2024-09-21T09:05:03.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.397+0000 7f3190e13800 1 -- start start 2024-09-21T09:05:03.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.397+0000 7f3190e13800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf900850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.399 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.397+0000 7f3190e13800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cfdf75d320 con 0x55cfdf784e00 2024-09-21T09:05:03.406 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.398+0000 7f318c467640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf900850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.406 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.398+0000 7f318c467640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf900850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60478/0 (socket says 172.21.15.178:60478) 2024-09-21T09:05:03.406 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.398+0000 7f318c467640 1 -- 172.21.15.178:0/1256279988 learned_addr learned my addr 172.21.15.178:0/1256279988 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.406 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.398+0000 7f318c467640 1 -- 172.21.15.178:0/1256279988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdf6aabc0 con 0x55cfdf784e00 2024-09-21T09:05:03.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.398+0000 7f318c467640 1 --2- 172.21.15.178:0/1256279988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf900850 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f317c025da0 tx=0x7f317c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fe9130cde26ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.399+0000 7f307a60c640 1 -- 172.21.15.178:0/1256279988 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f317c051950 con 0x55cfdf784e00 2024-09-21T09:05:03.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.399+0000 7f307a60c640 1 -- 172.21.15.178:0/1256279988 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317c051af0 con 0x55cfdf784e00 2024-09-21T09:05:03.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.399+0000 7f307a60c640 1 -- 172.21.15.178:0/1256279988 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f317c051dd0 con 0x55cfdf784e00 2024-09-21T09:05:03.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.399+0000 7f3190e13800 1 -- 172.21.15.178:0/1256279988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 msgr2=0x55cfdf900850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.399+0000 7f3190e13800 1 --2- 172.21.15.178:0/1256279988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf900850 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f317c025da0 tx=0x7f317c051000 comp rx=0 tx=0).stop 2024-09-21T09:05:03.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.399+0000 7f3190e13800 1 -- 172.21.15.178:0/1256279988 shutdown_connections 2024-09-21T09:05:03.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.399+0000 7f3190e13800 1 --2- 172.21.15.178:0/1256279988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf900850 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.399+0000 7f3190e13800 1 -- 172.21.15.178:0/1256279988 >> 172.21.15.178:0/1256279988 conn(0x55cfdf80bde0 msgr2=0x55cfdf8fc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.399+0000 7f3190e13800 1 -- 172.21.15.178:0/1256279988 shutdown_connections 2024-09-21T09:05:03.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.399+0000 7f3190e13800 1 -- 172.21.15.178:0/1256279988 wait complete. 2024-09-21T09:05:03.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.400+0000 7f3190e13800 1 Processor -- start 2024-09-21T09:05:03.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.400+0000 7f3190e13800 1 -- start start 2024-09-21T09:05:03.407 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.400+0000 7f3190e13800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf908090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.400+0000 7f3190e13800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cfdf8185f0 con 0x55cfdf784e00 2024-09-21T09:05:03.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.400+0000 7f318c467640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf908090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.400+0000 7f318c467640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf908090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60480/0 (socket says 172.21.15.178:60480) 2024-09-21T09:05:03.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.400+0000 7f318c467640 1 -- 172.21.15.178:0/3363561864 learned_addr learned my addr 172.21.15.178:0/3363561864 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.400+0000 7f318c467640 1 -- 172.21.15.178:0/3363561864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdf6befe0 con 0x55cfdf784e00 2024-09-21T09:05:03.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.401+0000 7f318c467640 1 --2- 172.21.15.178:0/3363561864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf908090 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f317c067040 tx=0x7f317c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.401+0000 7f3078e09640 1 -- 172.21.15.178:0/3363561864 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f317c073070 con 0x55cfdf784e00 2024-09-21T09:05:03.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.401+0000 7f3078e09640 1 -- 172.21.15.178:0/3363561864 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317c05a450 con 0x55cfdf784e00 2024-09-21T09:05:03.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.401+0000 7f3078e09640 1 -- 172.21.15.178:0/3363561864 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f317c05a730 con 0x55cfdf784e00 2024-09-21T09:05:03.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.401+0000 7f3190e13800 1 -- 172.21.15.178:0/3363561864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfdf9085d0 con 0x55cfdf784e00 2024-09-21T09:05:03.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.401+0000 7f3190e13800 1 -- 172.21.15.178:0/3363561864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfdf908b50 con 0x55cfdf784e00 2024-09-21T09:05:03.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.401+0000 7f3190e13800 1 Processor -- start 2024-09-21T09:05:03.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.402+0000 7f3190e13800 1 -- start start 2024-09-21T09:05:03.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.402+0000 7f3190e13800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf914ea0 0x55cfdf9152a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.402+0000 7f3190e13800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cfdf6ac580 con 0x55cfdf914ea0 2024-09-21T09:05:03.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.402+0000 7f3078e09640 1 -- 172.21.15.178:0/3363561864 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f317c076070 con 0x55cfdf784e00 2024-09-21T09:05:03.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.402+0000 7f318cc68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf914ea0 0x55cfdf9152a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.402+0000 7f318cc68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf914ea0 0x55cfdf9152a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60492/0 (socket says 172.21.15.178:60492) 2024-09-21T09:05:03.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.402+0000 7f318cc68640 1 -- 172.21.15.178:0/1048124075 learned_addr learned my addr 172.21.15.178:0/1048124075 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.402+0000 7f3078e09640 1 --2- 172.21.15.178:0/3363561864 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3074036b40 0x7f3074039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.402+0000 7f3078e09640 1 -- 172.21.15.178:0/3363561864 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f317c062070 con 0x55cfdf784e00 2024-09-21T09:05:03.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.402+0000 7f318c467640 1 --2- 172.21.15.178:0/3363561864 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3074036b40 0x7f3074039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.402+0000 7f318cc68640 1 -- 172.21.15.178:0/1048124075 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdf9157e0 con 0x55cfdf914ea0 2024-09-21T09:05:03.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.402+0000 7f318cc68640 1 --2- 172.21.15.178:0/1048124075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf914ea0 0x55cfdf9152a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f318400a430 tx=0x7f318400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a28395c44fb5722 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.402+0000 7f318c467640 1 --2- 172.21.15.178:0/3363561864 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3074036b40 0x7f3074039000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f317c06ffd0 tx=0x7f317c06ee90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.402+0000 7f30727fc640 1 -- 172.21.15.178:0/1048124075 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3184015070 con 0x55cfdf914ea0 2024-09-21T09:05:03.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.403+0000 7f30727fc640 1 -- 172.21.15.178:0/1048124075 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3184001670 con 0x55cfdf914ea0 2024-09-21T09:05:03.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.403+0000 7f30727fc640 1 -- 172.21.15.178:0/1048124075 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3184001990 con 0x55cfdf914ea0 2024-09-21T09:05:03.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.403+0000 7f3190e13800 1 -- 172.21.15.178:0/1048124075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf914ea0 msgr2=0x55cfdf9152a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.403+0000 7f3190e13800 1 --2- 172.21.15.178:0/1048124075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf914ea0 0x55cfdf9152a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f318400a430 tx=0x7f318400a8f0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.403+0000 7f3190e13800 1 -- 172.21.15.178:0/1048124075 shutdown_connections 2024-09-21T09:05:03.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.403+0000 7f3190e13800 1 --2- 172.21.15.178:0/1048124075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf914ea0 0x55cfdf9152a0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.403+0000 7f3190e13800 1 -- 172.21.15.178:0/1048124075 >> 172.21.15.178:0/1048124075 conn(0x55cfdf8146f0 msgr2=0x55cfdf910620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.403+0000 7f3190e13800 1 -- 172.21.15.178:0/1048124075 shutdown_connections 2024-09-21T09:05:03.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.403+0000 7f3190e13800 1 -- 172.21.15.178:0/1048124075 wait complete. 2024-09-21T09:05:03.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.403+0000 7f3190e13800 1 Processor -- start 2024-09-21T09:05:03.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.403+0000 7f3190e13800 1 -- start start 2024-09-21T09:05:03.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.403+0000 7f3190e13800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf914ea0 0x55cfdf91c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.403+0000 7f3190e13800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cfdf916190 con 0x55cfdf914ea0 2024-09-21T09:05:03.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.404+0000 7f318cc68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf914ea0 0x55cfdf91c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.404+0000 7f318cc68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf914ea0 0x55cfdf91c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60504/0 (socket says 172.21.15.178:60504) 2024-09-21T09:05:03.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.404+0000 7f318cc68640 1 -- 172.21.15.178:0/2269173695 learned_addr learned my addr 172.21.15.178:0/2269173695 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.404+0000 7f318cc68640 1 -- 172.21.15.178:0/2269173695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdf91c8f0 con 0x55cfdf914ea0 2024-09-21T09:05:03.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.404+0000 7f318cc68640 1 --2- 172.21.15.178:0/2269173695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf914ea0 0x55cfdf91c3b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3184013040 tx=0x7f3184003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.404+0000 7f3070ff9640 1 -- 172.21.15.178:0/2269173695 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3184020020 con 0x55cfdf914ea0 2024-09-21T09:05:03.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.404+0000 7f3070ff9640 1 -- 172.21.15.178:0/2269173695 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31840108e0 con 0x55cfdf914ea0 2024-09-21T09:05:03.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.404+0000 7f3190e13800 1 -- 172.21.15.178:0/2269173695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfdf91cb80 con 0x55cfdf914ea0 2024-09-21T09:05:03.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.404+0000 7f3070ff9640 1 -- 172.21.15.178:0/2269173695 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3184015040 con 0x55cfdf914ea0 2024-09-21T09:05:03.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.404+0000 7f3190e13800 1 -- 172.21.15.178:0/2269173695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfdf91f830 con 0x55cfdf914ea0 2024-09-21T09:05:03.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.405+0000 7f3070ff9640 1 -- 172.21.15.178:0/2269173695 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3184023020 con 0x55cfdf914ea0 2024-09-21T09:05:03.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.406+0000 7f3070ff9640 1 --2- 172.21.15.178:0/2269173695 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3064036b40 0x7f3064039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.406+0000 7f3070ff9640 1 -- 172.21.15.178:0/2269173695 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f318404c280 con 0x55cfdf914ea0 2024-09-21T09:05:03.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.406+0000 7f3183c66640 1 --2- 172.21.15.178:0/2269173695 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3064036b40 0x7f3064039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.406+0000 7f3190e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:03.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.406+0000 7f3190e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.406+0000 7f3183c66640 1 --2- 172.21.15.178:0/2269173695 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3064036b40 0x7f3064039000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55cfdf9111c0 tx=0x7f3174001310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.406+0000 7f3190e13800 1 Processor -- start 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.406+0000 7f3190e13800 1 -- start start 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.406+0000 7f3190e13800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf811c00 0x55cfdf8101b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.406+0000 7f3190e13800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cfdf900f40 con 0x55cfdf811c00 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.407+0000 7f318c467640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf811c00 0x55cfdf8101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.407+0000 7f318c467640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf811c00 0x55cfdf8101b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60508/0 (socket says 172.21.15.178:60508) 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.407+0000 7f318c467640 1 -- 172.21.15.178:0/504171068 learned_addr learned my addr 172.21.15.178:0/504171068 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.407+0000 7f318c467640 1 -- 172.21.15.178:0/504171068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdf8106f0 con 0x55cfdf811c00 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.407+0000 7f318c467640 1 --2- 172.21.15.178:0/504171068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf811c00 0x55cfdf8101b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f317c08f290 tx=0x7f317c06f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.407+0000 7f30517e2640 1 -- 172.21.15.178:0/504171068 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f317c07d040 con 0x55cfdf811c00 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.407+0000 7f30517e2640 1 -- 172.21.15.178:0/504171068 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317c094070 con 0x55cfdf811c00 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.407+0000 7f30517e2640 1 -- 172.21.15.178:0/504171068 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f317c06e3c0 con 0x55cfdf811c00 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.407+0000 7f3190e13800 1 -- 172.21.15.178:0/504171068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfdf8109e0 con 0x55cfdf811c00 2024-09-21T09:05:03.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.407+0000 7f3190e13800 1 -- 172.21.15.178:0/504171068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfdf810ee0 con 0x55cfdf811c00 2024-09-21T09:05:03.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.408+0000 7f30517e2640 1 -- 172.21.15.178:0/504171068 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f317c08c040 con 0x55cfdf811c00 2024-09-21T09:05:03.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.408+0000 7f30517e2640 1 --2- 172.21.15.178:0/504171068 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2fc4036b40 0x7f2fc4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.408+0000 7f30517e2640 1 -- 172.21.15.178:0/504171068 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f317c09ac20 con 0x55cfdf811c00 2024-09-21T09:05:03.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.408+0000 7f3183c66640 1 --2- 172.21.15.178:0/504171068 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2fc4036b40 0x7f2fc4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.408+0000 7f304affd640 20 reqs_thread_entry: start 2024-09-21T09:05:03.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.409+0000 7f3190e13800 1 --2- 172.21.15.178:0/3363561864 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cfdf9460e0 0x55cfdf9484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.409+0000 7f3183c66640 1 --2- 172.21.15.178:0/504171068 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2fc4036b40 0x7f2fc4039000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3174003f10 tx=0x7f3174006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.409+0000 7f3190e13800 1 -- 172.21.15.178:0/3363561864 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cfdf948aa0 con 0x55cfdf9460e0 2024-09-21T09:05:03.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.409+0000 7f318cc68640 1 --2- 172.21.15.178:0/3363561864 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cfdf9460e0 0x55cfdf9484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.409+0000 7f318cc68640 1 --2- 172.21.15.178:0/3363561864 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cfdf9460e0 0x55cfdf9484d0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.409+0000 7f318cc68640 1 -- 172.21.15.178:0/3363561864 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f318400e070 con 0x55cfdf9460e0 2024-09-21T09:05:03.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.409+0000 7f3190e13800 1 -- 172.21.15.178:0/3363561864 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cfdf9493b0 con 0x55cfdf9460e0 2024-09-21T09:05:03.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.409+0000 7f318cc68640 1 -- 172.21.15.178:0/3363561864 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f318400e070 con 0x55cfdf9460e0 2024-09-21T09:05:03.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.410+0000 7f3190e13800 1 -- 172.21.15.178:0/3363561864 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cfdf94a760 con 0x55cfdf9460e0 2024-09-21T09:05:03.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.410+0000 7f318cc68640 1 -- 172.21.15.178:0/3363561864 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f318400e070 con 0x55cfdf9460e0 2024-09-21T09:05:03.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.410+0000 7f3190e13800 1 -- 172.21.15.178:0/2269173695 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3064036b40 msgr2=0x7f3064039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 --2- 172.21.15.178:0/2269173695 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3064036b40 0x7f3064039000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55cfdf9111c0 tx=0x7f3174001310 comp rx=0 tx=0).stop 2024-09-21T09:05:03.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/2269173695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf914ea0 msgr2=0x55cfdf91c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 --2- 172.21.15.178:0/2269173695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf914ea0 0x55cfdf91c3b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3184013040 tx=0x7f3184003370 comp rx=0 tx=0).stop 2024-09-21T09:05:03.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/2269173695 shutdown_connections 2024-09-21T09:05:03.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 --2- 172.21.15.178:0/2269173695 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3064036b40 0x7f3064039000 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 --2- 172.21.15.178:0/2269173695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf914ea0 0x55cfdf91c3b0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/2269173695 >> 172.21.15.178:0/2269173695 conn(0x55cfdf8146f0 msgr2=0x55cfdf9101f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/2269173695 shutdown_connections 2024-09-21T09:05:03.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/2269173695 wait complete. 2024-09-21T09:05:03.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/504171068 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2fc4036b40 msgr2=0x7f2fc4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 --2- 172.21.15.178:0/504171068 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2fc4036b40 0x7f2fc4039000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3174003f10 tx=0x7f3174006000 comp rx=0 tx=0).stop 2024-09-21T09:05:03.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/504171068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf811c00 msgr2=0x55cfdf8101b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 --2- 172.21.15.178:0/504171068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf811c00 0x55cfdf8101b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f317c08f290 tx=0x7f317c06f720 comp rx=0 tx=0).stop 2024-09-21T09:05:03.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/504171068 shutdown_connections 2024-09-21T09:05:03.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 --2- 172.21.15.178:0/504171068 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2fc4036b40 0x7f2fc4039000 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 --2- 172.21.15.178:0/504171068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf811c00 0x55cfdf8101b0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/504171068 >> 172.21.15.178:0/504171068 conn(0x55cfdf92b320 msgr2=0x55cfdf92dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/504171068 shutdown_connections 2024-09-21T09:05:03.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/504171068 wait complete. 2024-09-21T09:05:03.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/3363561864 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cfdf9460e0 msgr2=0x55cfdf9484d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 --2- 172.21.15.178:0/3363561864 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cfdf9460e0 0x55cfdf9484d0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/3363561864 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3074036b40 msgr2=0x7f3074039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 --2- 172.21.15.178:0/3363561864 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3074036b40 0x7f3074039000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f317c06ffd0 tx=0x7f317c06ee90 comp rx=0 tx=0).stop 2024-09-21T09:05:03.421 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/3363561864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 msgr2=0x55cfdf908090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.421 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 --2- 172.21.15.178:0/3363561864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf908090 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f317c067040 tx=0x7f317c002fb0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.421 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/3363561864 shutdown_connections 2024-09-21T09:05:03.421 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 --2- 172.21.15.178:0/3363561864 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55cfdf9460e0 0x55cfdf9484d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.421 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 --2- 172.21.15.178:0/3363561864 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f3074036b40 0x7f3074039000 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.421 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 --2- 172.21.15.178:0/3363561864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cfdf784e00 0x55cfdf908090 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.421 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.411+0000 7f3190e13800 1 -- 172.21.15.178:0/3363561864 >> 172.21.15.178:0/3363561864 conn(0x55cfdf80bde0 msgr2=0x55cfdf8faac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.421 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.412+0000 7f3190e13800 1 -- 172.21.15.178:0/3363561864 shutdown_connections 2024-09-21T09:05:03.421 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.412+0000 7f3190e13800 1 -- 172.21.15.178:0/3363561864 wait complete. 2024-09-21T09:05:03.422 INFO:teuthology.orchestra.run.smithi178.stdout:{"id":"68ad48f1-b3da-4499-bba2-41066e92d255","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee","zones":[{"id":"5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-21T09:05:03.422 DEBUG:tasks.util.rgw: json result: {'id': '68ad48f1-b3da-4499-bba2-41066e92d255', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee', 'zones': [{'id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-21T09:05:03.425 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-21T09:05:03.441 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-21T09:05:03.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-21T09:05:03.442 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-21T09:05:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:03.517 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:03.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.516+0000 7f55cceb7800 1 Processor -- start 2024-09-21T09:05:03.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.516+0000 7f55cceb7800 1 -- start start 2024-09-21T09:05:03.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.516+0000 7f55cceb7800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55d472f65ba0 0x55d472f65fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.516+0000 7f55cceb7800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d472e25b30 con 0x55d472f664e0 2024-09-21T09:05:03.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.516+0000 7f55cceb7800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55d472e07360 con 0x55d472f65ba0 2024-09-21T09:05:03.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.516+0000 7f55ca9ab640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55d472f65ba0 0x55d472f65fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.516+0000 7f55ca1aa640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55d472f664e0 0x55d472f6a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40492/0 (socket says 172.21.15.178:40492) 2024-09-21T09:05:03.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.516+0000 7f55ca1aa640 1 -- 172.21.15.178:0/4062311749 learned_addr learned my addr 172.21.15.178:0/4062311749 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:05:03.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.517+0000 7f55ca9ab640 1 -- 172.21.15.178:0/4062311749 >> v1:172.21.15.44:6789/0 conn(0x55d472f664e0 legacy=0x55d472f6a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.519 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.517+0000 7f55ca9ab640 1 -- 172.21.15.178:0/4062311749 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d472e2de00 con 0x55d472f65ba0 2024-09-21T09:05:03.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.518+0000 7f55ca9ab640 1 --2- 172.21.15.178:0/4062311749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d472f65fa0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00a470 tx=0x7f55bc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854e9ff044945fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.519+0000 7f55c99a9640 1 -- 172.21.15.178:0/4062311749 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55bc053570 con 0x55d472f65ba0 2024-09-21T09:05:03.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.519+0000 7f55c99a9640 1 -- 172.21.15.178:0/4062311749 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55bc058070 con 0x55d472f65ba0 2024-09-21T09:05:03.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.519+0000 7f55c99a9640 1 -- 172.21.15.178:0/4062311749 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55bc053880 con 0x55d472f65ba0 2024-09-21T09:05:03.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.519+0000 7f55cceb7800 1 -- 172.21.15.178:0/4062311749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 msgr2=0x55d472f65fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.521 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.519+0000 7f55cceb7800 1 --2- 172.21.15.178:0/4062311749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d472f65fa0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00a470 tx=0x7f55bc045a20 comp rx=0 tx=0).stop 2024-09-21T09:05:03.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.519+0000 7f55cceb7800 1 -- 172.21.15.178:0/4062311749 shutdown_connections 2024-09-21T09:05:03.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.519+0000 7f55cceb7800 1 --2- 172.21.15.178:0/4062311749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d472f65fa0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.519+0000 7f55cceb7800 1 -- 172.21.15.178:0/4062311749 >> 172.21.15.178:0/4062311749 conn(0x55d472f60580 msgr2=0x55d472f629a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.519+0000 7f55cceb7800 1 -- 172.21.15.178:0/4062311749 shutdown_connections 2024-09-21T09:05:03.522 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.519+0000 7f55cceb7800 1 -- 172.21.15.178:0/4062311749 wait complete. 2024-09-21T09:05:03.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.533+0000 7f55cceb7800 1 Processor -- start 2024-09-21T09:05:03.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.533+0000 7f55cceb7800 1 -- start start 2024-09-21T09:05:03.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.533+0000 7f55cceb7800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d473055a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.533+0000 7f55cceb7800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d472eb2450 con 0x55d472f65ba0 2024-09-21T09:05:03.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.533+0000 7f55ca9ab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d473055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.533+0000 7f55ca9ab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d473055a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60522/0 (socket says 172.21.15.178:60522) 2024-09-21T09:05:03.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.533+0000 7f55ca9ab640 1 -- 172.21.15.178:0/3587536145 learned_addr learned my addr 172.21.15.178:0/3587536145 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.536 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.534+0000 7f55ca9ab640 1 -- 172.21.15.178:0/3587536145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d472dffbc0 con 0x55d472f65ba0 2024-09-21T09:05:03.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.534+0000 7f55ca9ab640 1 --2- 172.21.15.178:0/3587536145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d473055a40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f55bc025c20 tx=0x7f55bc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f31f9d0d77d3de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.534+0000 7f54b8e09640 1 -- 172.21.15.178:0/3587536145 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55bc05c580 con 0x55d472f65ba0 2024-09-21T09:05:03.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.534+0000 7f54b8e09640 1 -- 172.21.15.178:0/3587536145 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55bc063030 con 0x55d472f65ba0 2024-09-21T09:05:03.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.534+0000 7f54b8e09640 1 -- 172.21.15.178:0/3587536145 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55bc05c850 con 0x55d472f65ba0 2024-09-21T09:05:03.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.535+0000 7f55cceb7800 1 -- 172.21.15.178:0/3587536145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 msgr2=0x55d473055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.535+0000 7f55cceb7800 1 --2- 172.21.15.178:0/3587536145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d473055a40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f55bc025c20 tx=0x7f55bc051000 comp rx=0 tx=0).stop 2024-09-21T09:05:03.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.535+0000 7f55cceb7800 1 -- 172.21.15.178:0/3587536145 shutdown_connections 2024-09-21T09:05:03.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.535+0000 7f55cceb7800 1 --2- 172.21.15.178:0/3587536145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d473055a40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.535+0000 7f55cceb7800 1 -- 172.21.15.178:0/3587536145 >> 172.21.15.178:0/3587536145 conn(0x55d472f60580 msgr2=0x55d473053e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.535+0000 7f55cceb7800 1 -- 172.21.15.178:0/3587536145 shutdown_connections 2024-09-21T09:05:03.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.535+0000 7f55cceb7800 1 -- 172.21.15.178:0/3587536145 wait complete. 2024-09-21T09:05:03.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.535+0000 7f55cceb7800 1 Processor -- start 2024-09-21T09:05:03.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.535+0000 7f55cceb7800 1 -- start start 2024-09-21T09:05:03.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.535+0000 7f55cceb7800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d47305d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.535+0000 7f55cceb7800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d472f6c530 con 0x55d472f65ba0 2024-09-21T09:05:03.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.536+0000 7f55ca9ab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d47305d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.536+0000 7f55ca9ab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d47305d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60534/0 (socket says 172.21.15.178:60534) 2024-09-21T09:05:03.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.536+0000 7f55ca9ab640 1 -- 172.21.15.178:0/2660072216 learned_addr learned my addr 172.21.15.178:0/2660072216 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.539 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.536+0000 7f55ca9ab640 1 -- 172.21.15.178:0/2660072216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d472e13fe0 con 0x55d472f65ba0 2024-09-21T09:05:03.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.536+0000 7f55ca9ab640 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d47305d390 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x55d4730568a0 tx=0x7f55bc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.536+0000 7f54b7606640 1 -- 172.21.15.178:0/2660072216 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55bc054ad0 con 0x55d472f65ba0 2024-09-21T09:05:03.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.536+0000 7f54b7606640 1 -- 172.21.15.178:0/2660072216 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55bc054c70 con 0x55d472f65ba0 2024-09-21T09:05:03.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.536+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d47305d8d0 con 0x55d472f65ba0 2024-09-21T09:05:03.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.536+0000 7f54b7606640 1 -- 172.21.15.178:0/2660072216 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55bc068420 con 0x55d472f65ba0 2024-09-21T09:05:03.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.536+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d47305ddf0 con 0x55d472f65ba0 2024-09-21T09:05:03.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.537+0000 7f54b7606640 1 -- 172.21.15.178:0/2660072216 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f55bc0685c0 con 0x55d472f65ba0 2024-09-21T09:05:03.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.537+0000 7f54b7606640 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f54b0036b40 0x7f54b0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.537+0000 7f54b7606640 1 -- 172.21.15.178:0/2660072216 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f55bc070030 con 0x55d472f65ba0 2024-09-21T09:05:03.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.537+0000 7f55ca1aa640 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f54b0036b40 0x7f54b0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.537+0000 7f55cceb7800 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d472f664e0 0x55d473064400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.537+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4730649d0 con 0x55d472f664e0 2024-09-21T09:05:03.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.538+0000 7f55cb1ac640 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d472f664e0 0x55d473064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.538+0000 7f55ca1aa640 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f54b0036b40 0x7f54b0039000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f55c0000f60 tx=0x7f55c00012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.538+0000 7f55cb1ac640 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d472f664e0 0x55d473064400 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.538+0000 7f55cb1ac640 1 -- 172.21.15.178:0/2660072216 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55c400a4a0 con 0x55d472f664e0 2024-09-21T09:05:03.542 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.538+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4730619d0 con 0x55d472f664e0 2024-09-21T09:05:03.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.538+0000 7f55cb1ac640 1 -- 172.21.15.178:0/2660072216 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55c400a4a0 con 0x55d472f664e0 2024-09-21T09:05:03.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.538+0000 7f55cceb7800 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d473066d30 0x55d473069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.538+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d473069810 con 0x55d473066d30 2024-09-21T09:05:03.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.539+0000 7f55ca9ab640 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d473066d30 0x55d473069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.539+0000 7f55ca9ab640 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d473066d30 0x55d473069120 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.539+0000 7f55ca9ab640 1 -- 172.21.15.178:0/2660072216 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f55bc051070 con 0x55d473066d30 2024-09-21T09:05:03.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.539+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d473065bd0 con 0x55d472f664e0 2024-09-21T09:05:03.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.540+0000 7f55cb1ac640 1 -- 172.21.15.178:0/2660072216 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55c400a4a0 con 0x55d472f664e0 2024-09-21T09:05:03.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.540+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d473066070 con 0x55d472f664e0 2024-09-21T09:05:03.543 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.540+0000 7f55cb1ac640 1 -- 172.21.15.178:0/2660072216 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f55c400a4a0 con 0x55d472f664e0 2024-09-21T09:05:03.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.540+0000 7f55cceb7800 1 Processor -- start 2024-09-21T09:05:03.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.540+0000 7f55cceb7800 1 -- start start 2024-09-21T09:05:03.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.540+0000 7f55cceb7800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473078150 0x55d473078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.540+0000 7f55cceb7800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d472e01580 con 0x55d473078150 2024-09-21T09:05:03.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.541+0000 7f55cb1ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473078150 0x55d473078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.541+0000 7f55cb1ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473078150 0x55d473078570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60544/0 (socket says 172.21.15.178:60544) 2024-09-21T09:05:03.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.541+0000 7f55cb1ac640 1 -- 172.21.15.178:0/1230613760 learned_addr learned my addr 172.21.15.178:0/1230613760 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.541+0000 7f55cb1ac640 1 -- 172.21.15.178:0/1230613760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d473078ab0 con 0x55d473078150 2024-09-21T09:05:03.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.541+0000 7f55cb1ac640 1 --2- 172.21.15.178:0/1230613760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473078150 0x55d473078570 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x55d473064d90 tx=0x7f55c4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.541+0000 7f54b4e01640 1 -- 172.21.15.178:0/1230613760 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c4014450 con 0x55d473078150 2024-09-21T09:05:03.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.541+0000 7f54b4e01640 1 -- 172.21.15.178:0/1230613760 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c4014610 con 0x55d473078150 2024-09-21T09:05:03.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.541+0000 7f55cceb7800 1 -- 172.21.15.178:0/1230613760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d473078d40 con 0x55d473078150 2024-09-21T09:05:03.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.541+0000 7f54b4e01640 1 -- 172.21.15.178:0/1230613760 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c4014930 con 0x55d473078150 2024-09-21T09:05:03.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.541+0000 7f55cceb7800 1 -- 172.21.15.178:0/1230613760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d47307ba20 con 0x55d473078150 2024-09-21T09:05:03.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.542+0000 7f54b4e01640 1 -- 172.21.15.178:0/1230613760 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f55c4011040 con 0x55d473078150 2024-09-21T09:05:03.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.542+0000 7f54b4e01640 1 --2- 172.21.15.178:0/1230613760 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f54a4036b40 0x7f54a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.542+0000 7f54b4e01640 1 -- 172.21.15.178:0/1230613760 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f55c401e070 con 0x55d473078150 2024-09-21T09:05:03.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.542+0000 7f55ca9ab640 1 --2- 172.21.15.178:0/1230613760 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f54a4036b40 0x7f54a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.543+0000 7f55cceb7800 1 Processor -- start 2024-09-21T09:05:03.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.543+0000 7f55ca9ab640 1 --2- 172.21.15.178:0/1230613760 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f54a4036b40 0x7f54a4039000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55d473064e80 tx=0x7f55bc060ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.543+0000 7f55cceb7800 1 -- start start 2024-09-21T09:05:03.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.543+0000 7f55cceb7800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473084e20 0x55d473085220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.543+0000 7f55cceb7800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d473056190 con 0x55d473084e20 2024-09-21T09:05:03.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.543+0000 7f55cb1ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473084e20 0x55d473085220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.543+0000 7f55cb1ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473084e20 0x55d473085220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60554/0 (socket says 172.21.15.178:60554) 2024-09-21T09:05:03.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.543+0000 7f55cb1ac640 1 -- 172.21.15.178:0/1089271509 learned_addr learned my addr 172.21.15.178:0/1089271509 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.543+0000 7f55cb1ac640 1 -- 172.21.15.178:0/1089271509 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4730857f0 con 0x55d473084e20 2024-09-21T09:05:03.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.543+0000 7f55cb1ac640 1 --2- 172.21.15.178:0/1089271509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473084e20 0x55d473085220 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f55c404cb40 tx=0x7f55c4011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b9aec044196964 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.544+0000 7f54ae7fc640 1 -- 172.21.15.178:0/1089271509 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c4013c90 con 0x55d473084e20 2024-09-21T09:05:03.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.544+0000 7f54ae7fc640 1 -- 172.21.15.178:0/1089271509 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c4013e30 con 0x55d473084e20 2024-09-21T09:05:03.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.544+0000 7f54ae7fc640 1 -- 172.21.15.178:0/1089271509 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c4014c00 con 0x55d473084e20 2024-09-21T09:05:03.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.544+0000 7f55cceb7800 1 -- 172.21.15.178:0/1089271509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473084e20 msgr2=0x55d473085220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.544+0000 7f55cceb7800 1 --2- 172.21.15.178:0/1089271509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473084e20 0x55d473085220 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f55c404cb40 tx=0x7f55c4011d00 comp rx=0 tx=0).stop 2024-09-21T09:05:03.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.544+0000 7f55cceb7800 1 -- 172.21.15.178:0/1089271509 shutdown_connections 2024-09-21T09:05:03.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.544+0000 7f55cceb7800 1 --2- 172.21.15.178:0/1089271509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473084e20 0x55d473085220 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.544+0000 7f55cceb7800 1 -- 172.21.15.178:0/1089271509 >> 172.21.15.178:0/1089271509 conn(0x55d473081180 msgr2=0x55d47307f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.544+0000 7f55cceb7800 1 -- 172.21.15.178:0/1089271509 shutdown_connections 2024-09-21T09:05:03.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.544+0000 7f55cceb7800 1 -- 172.21.15.178:0/1089271509 wait complete. 2024-09-21T09:05:03.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.544+0000 7f55cceb7800 1 Processor -- start 2024-09-21T09:05:03.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.544+0000 7f55cceb7800 1 -- start start 2024-09-21T09:05:03.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.545+0000 7f55cceb7800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473084e20 0x55d47308c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.545+0000 7f55cceb7800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d473085ea0 con 0x55d473084e20 2024-09-21T09:05:03.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.545+0000 7f55cb1ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473084e20 0x55d47308c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.545+0000 7f55cb1ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473084e20 0x55d47308c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60570/0 (socket says 172.21.15.178:60570) 2024-09-21T09:05:03.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.545+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 learned_addr learned my addr 172.21.15.178:0/9887865 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.545+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d47308c840 con 0x55d473084e20 2024-09-21T09:05:03.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.545+0000 7f55cb1ac640 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473084e20 0x55d47308c300 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f55c404ba10 tx=0x7f55c404cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.545+0000 7f54acff9640 1 -- 172.21.15.178:0/9887865 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c4013c90 con 0x55d473084e20 2024-09-21T09:05:03.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.545+0000 7f54acff9640 1 -- 172.21.15.178:0/9887865 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c402b350 con 0x55d473084e20 2024-09-21T09:05:03.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.545+0000 7f54acff9640 1 -- 172.21.15.178:0/9887865 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c402b670 con 0x55d473084e20 2024-09-21T09:05:03.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.546+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d47308cad0 con 0x55d473084e20 2024-09-21T09:05:03.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.546+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d47308f780 con 0x55d473084e20 2024-09-21T09:05:03.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.546+0000 7f54acff9640 1 -- 172.21.15.178:0/9887865 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f55c403f020 con 0x55d473084e20 2024-09-21T09:05:03.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.547+0000 7f54acff9640 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5494036b40 0x7f5494039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.547+0000 7f54acff9640 1 -- 172.21.15.178:0/9887865 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f55c403d020 con 0x55d473084e20 2024-09-21T09:05:03.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.547+0000 7f55ca9ab640 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5494036b40 0x7f5494039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.547+0000 7f55ca9ab640 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5494036b40 0x7f5494039000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f55bc025c20 tx=0x7f55bc085000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.547+0000 7f55cceb7800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.547+0000 7f55cceb7800 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d473097f50 0x55d47309a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.547+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d47309ab60 con 0x55d473097f50 2024-09-21T09:05:03.559 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.547+0000 7f55ca1aa640 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d473097f50 0x55d47309a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55ca1aa640 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d473097f50 0x55d47309a410 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55c0009050 con 0x55d473097f50 2024-09-21T09:05:03.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55cceb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55cceb7800 20 realm 2024-09-21T09:05:03.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55cceb7800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4730973a0 con 0x55d473097f50 2024-09-21T09:05:03.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55c0009050 con 0x55d473097f50 2024-09-21T09:05:03.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55cceb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55cceb7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:03.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55cceb7800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d47309b650 con 0x55d473097f50 2024-09-21T09:05:03.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55c0009050 con 0x55d473097f50 2024-09-21T09:05:03.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55cceb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.560 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55cceb7800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.548+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d47309bf20 con 0x55d473097f50 2024-09-21T09:05:03.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.549+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55c0009050 con 0x55d473097f50 2024-09-21T09:05:03.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.549+0000 7f55cceb7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:03.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.549+0000 7f55cceb7800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.549+0000 7f55cceb7800 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d47309c860 0x55d47309ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.549+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d47309f3e0 con 0x55d47309c860 2024-09-21T09:05:03.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.549+0000 7f55cb1ac640 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d47309c860 0x55d47309ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.549+0000 7f55cb1ac640 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d47309c860 0x55d47309ec50 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.550+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.550+0000 7f55cceb7800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:03.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.550+0000 7f55cceb7800 20 searching for the correct realm 2024-09-21T09:05:03.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.550+0000 7f55cceb7800 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d4730a13b0 0x55d4730a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.561 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.550+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a3f40 con 0x55d4730a13b0 2024-09-21T09:05:03.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.550+0000 7f55ca9ab640 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d4730a13b0 0x55d4730a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.550+0000 7f55ca9ab640 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d4730a13b0 0x55d4730a3870 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.550+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.550+0000 7f55ca9ab640 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f55bc05c070 0x7f55bc090430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.550+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a3f40 con 0x7f55bc05c070 2024-09-21T09:05:03.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.550+0000 7f55ca1aa640 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f55bc05c070 0x7f55bc090430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.551+0000 7f55ca1aa640 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f55bc05c070 0x7f55bc090430 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.551+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0009050 con 0x7f55bc05c070 2024-09-21T09:05:03.562 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.551+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a3f40 con 0x55d47309c860 2024-09-21T09:05:03.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.551+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.551+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a3f40 con 0x55d473097f50 2024-09-21T09:05:03.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.552+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0009050 con 0x55d473097f50 2024-09-21T09:05:03.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.552+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a3f40 con 0x55d473097f50 2024-09-21T09:05:03.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.552+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0029040 con 0x55d473097f50 2024-09-21T09:05:03.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.552+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a3f40 con 0x55d47309c860 2024-09-21T09:05:03.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.552+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.552+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a3f40 con 0x55d47309c860 2024-09-21T09:05:03.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.552+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.552+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a3f40 con 0x7f55bc05c070 2024-09-21T09:05:03.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.553+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0029040 con 0x7f55bc05c070 2024-09-21T09:05:03.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.553+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a3f40 con 0x55d4730a13b0 2024-09-21T09:05:03.563 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.553+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.553+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a3f40 con 0x55d473097f50 2024-09-21T09:05:03.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.553+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0029040 con 0x55d473097f50 2024-09-21T09:05:03.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.553+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a3f40 con 0x55d47309c860 2024-09-21T09:05:03.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.554+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.554+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a3f40 con 0x55d473097f50 2024-09-21T09:05:03.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.554+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0029040 con 0x55d473097f50 2024-09-21T09:05:03.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.554+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a3f40 con 0x7f55bc05c070 2024-09-21T09:05:03.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.554+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f55c0029040 con 0x7f55bc05c070 2024-09-21T09:05:03.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.554+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a3f40 con 0x55d4730a13b0 2024-09-21T09:05:03.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.554+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.554+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x55d4730a13b0 2024-09-21T09:05:03.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.555+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.555+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x55d47309c860 2024-09-21T09:05:03.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.555+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.555+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x55d4730a13b0 2024-09-21T09:05:03.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.555+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.555+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x55d4730a13b0 2024-09-21T09:05:03.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.555+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.555+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x55d473097f50 2024-09-21T09:05:03.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.555+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f55c0029040 con 0x55d473097f50 2024-09-21T09:05:03.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.556+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x55d473097f50 2024-09-21T09:05:03.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.556+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f55c0029040 con 0x55d473097f50 2024-09-21T09:05:03.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.556+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x55d47309c860 2024-09-21T09:05:03.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.556+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.556+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x55d4730a13b0 2024-09-21T09:05:03.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.556+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.565 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.556+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x7f55bc05c070 2024-09-21T09:05:03.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.557+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0029040 con 0x7f55bc05c070 2024-09-21T09:05:03.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.557+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x55d473097f50 2024-09-21T09:05:03.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.557+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0029040 con 0x55d473097f50 2024-09-21T09:05:03.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.557+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x55d47309c860 2024-09-21T09:05:03.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.557+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.557+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x55d4730a13b0 2024-09-21T09:05:03.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.557+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.566 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.557+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x7f55bc05c070 2024-09-21T09:05:03.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.558+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0029040 con 0x7f55bc05c070 2024-09-21T09:05:03.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.558+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x7f55bc05c070 2024-09-21T09:05:03.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.558+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0029040 con 0x7f55bc05c070 2024-09-21T09:05:03.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.558+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x55d4730a13b0 2024-09-21T09:05:03.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.558+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.558+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x55d47309c860 2024-09-21T09:05:03.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x55d473097f50 2024-09-21T09:05:03.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f55c0029040 con 0x55d473097f50 2024-09-21T09:05:03.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55bc0a9040 con 0x7f55bc05c070 2024-09-21T09:05:03.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0029040 con 0x7f55bc05c070 2024-09-21T09:05:03.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55cceb7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:03.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55cceb7800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:03.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55cceb7800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:03.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55cceb7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:03.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55cceb7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:03.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55cceb7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:03.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55cceb7800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d47309fdd0 con 0x55d473097f50 2024-09-21T09:05:03.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55c0029040 con 0x55d473097f50 2024-09-21T09:05:03.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55cceb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55cceb7800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.559+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a0670 con 0x55d473097f50 2024-09-21T09:05:03.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cceb7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:03.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cceb7800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d47309fa10 con 0x55d473097f50 2024-09-21T09:05:03.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cceb7800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:03.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cceb7800 20 zone default found 2024-09-21T09:05:03.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cceb7800 4 Realm: () 2024-09-21T09:05:03.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cceb7800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:03.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cceb7800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:03.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cceb7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:03.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cceb7800 20 zonegroup default 2024-09-21T09:05:03.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cceb7800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a4430 con 0x55d47309c860 2024-09-21T09:05:03.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cceb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.560+0000 7f55cceb7800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.561+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a6700 con 0x55d4730a13b0 2024-09-21T09:05:03.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.561+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.561+0000 7f55cceb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.561+0000 7f55cceb7800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.561+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a6aa0 con 0x55d4730a13b0 2024-09-21T09:05:03.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.561+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.561+0000 7f55cceb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.561+0000 7f55cceb7800 20 started sync module instance, tier type = 2024-09-21T09:05:03.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.561+0000 7f55cceb7800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:03.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.561+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a5b90 con 0x7f55bc05c070 2024-09-21T09:05:03.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.562+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x7f55bc05c070 2024-09-21T09:05:03.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.562+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94370951487680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a5b90 con 0x7f55bc05c070 2024-09-21T09:05:03.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.562+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a74b0 con 0x55d473097f50 2024-09-21T09:05:03.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.563+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94370951487680] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x7f55bc05c070 2024-09-21T09:05:03.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.564+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.564+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94370951492064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a5b90 con 0x55d473097f50 2024-09-21T09:05:03.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.564+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a7f00 con 0x55d4730a13b0 2024-09-21T09:05:03.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.565+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94370951492064] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.565+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.565+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94370951485152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a5b00 con 0x55d4730a13b0 2024-09-21T09:05:03.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.565+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a8dc0 con 0x7f55bc05c070 2024-09-21T09:05:03.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.566+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x7f55bc05c070 2024-09-21T09:05:03.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.566+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94370951498480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a9500 con 0x7f55bc05c070 2024-09-21T09:05:03.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.566+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730aa020 con 0x55d473097f50 2024-09-21T09:05:03.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.566+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94370951485152] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.567+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.576 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.567+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94370951502576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a9fe0 con 0x55d473097f50 2024-09-21T09:05:03.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.567+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730aaa30 con 0x55d47309c860 2024-09-21T09:05:03.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.567+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94370951498480] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x7f55bc05c070 2024-09-21T09:05:03.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.568+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94370951502576] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.568+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.568+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94370951496432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730a8f50 con 0x55d47309c860 2024-09-21T09:05:03.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.568+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730ab2d0 con 0x55d47309c860 2024-09-21T09:05:03.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.569+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(56 notify.6 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.569+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94370951507408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730ab760 con 0x55d47309c860 2024-09-21T09:05:03.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.569+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730ac260 con 0x55d47309c860 2024-09-21T09:05:03.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.570+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94370951496432] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.571+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94370951507408] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.571+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.571+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94370951508464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730aa580 con 0x55d47309c860 2024-09-21T09:05:03.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.571+0000 7f55cceb7800 20 add_watcher() i=0 2024-09-21T09:05:03.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.571+0000 7f55cceb7800 20 add_watcher() i=1 2024-09-21T09:05:03.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.571+0000 7f55cceb7800 20 add_watcher() i=2 2024-09-21T09:05:03.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.571+0000 7f55cceb7800 20 add_watcher() i=3 2024-09-21T09:05:03.582 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.571+0000 7f55cceb7800 20 add_watcher() i=4 2024-09-21T09:05:03.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.571+0000 7f55cceb7800 20 add_watcher() i=5 2024-09-21T09:05:03.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.571+0000 7f55cceb7800 20 add_watcher() i=6 2024-09-21T09:05:03.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.571+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94370951508464] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.572+0000 7f55cceb7800 20 add_watcher() i=7 2024-09-21T09:05:03.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.572+0000 7f55cceb7800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:03.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.572+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4730af250 con 0x55d473097f50 2024-09-21T09:05:03.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.572+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.572+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94370951511376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730ac6d0 con 0x55d473097f50 2024-09-21T09:05:03.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.573+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94370951511376] v31'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.573+0000 7f54817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:03.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.573+0000 7f55cceb7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:03.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.573+0000 7f55cceb7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:03.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.573+0000 7f55cceb7800 5 note: GC not initialized 2024-09-21T09:05:03.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f53fbfff640 20 reqs_thread_entry: start 2024-09-21T09:05:03.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f55cceb7800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:03.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f55cceb7800 20 Filter name: none 2024-09-21T09:05:03.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f53f9ffb640 20 reqs_thread_entry: start 2024-09-21T09:05:03.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f55cceb7800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T09:05:03.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f55cceb7800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e2620 con 0x55d47309c860 2024-09-21T09:05:03.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f55cceb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f55cceb7800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-21T09:05:03.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f55cceb7800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:03.584 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f55cceb7800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f55cceb7800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e0c60 con 0x55d473097f50 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.574+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.575+0000 7f55cceb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.575+0000 7f55cceb7800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.575+0000 7f55cceb7800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.575+0000 7f55cceb7800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.575+0000 7f55cceb7800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.575+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e1660 con 0x55d47309c860 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.576+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v31'7 uv7 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.576+0000 7f55cceb7800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.576+0000 7f55cceb7800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.576+0000 7f55cceb7800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.576+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94370951729280 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e60c0 con 0x55d473097f50 2024-09-21T09:05:03.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.576+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== watch-notify(notify (1) cookie 94370951502576 notify 133143986199 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55d472e25b30 con 0x55d473097f50 2024-09-21T09:05:03.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.576+0000 7f54ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986199 cookie 94370951502576 notifier 4833 bl.length()=649 2024-09-21T09:05:03.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.576+0000 7f54ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:03.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.576+0000 7f54ae7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:03.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.576+0000 7f54ae7fc640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5490003ea0 con 0x55d473097f50 2024-09-21T09:05:03.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.576+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.4 [notify cookie 94370951729280 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.576+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.577+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== watch-notify(notify_complete (2) cookie 94370951729280 notify 133143986199 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f55c003e590 con 0x55d473097f50 2024-09-21T09:05:03.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.577+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e1080 con 0x55d473097f50 2024-09-21T09:05:03.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.578+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v31'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.578+0000 7f55cceb7800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-21T09:05:03.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.578+0000 7f55cceb7800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-21T09:05:03.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.578+0000 7f55cceb7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-21T09:05:03.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.578+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94370951729280 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e60c0 con 0x55d4730a13b0 2024-09-21T09:05:03.586 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.578+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== watch-notify(notify (1) cookie 94370951485152 notify 133143986184 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f55bc0a3040 con 0x55d4730a13b0 2024-09-21T09:05:03.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.578+0000 7f54adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 94370951485152 notifier 4833 bl.length()=177 2024-09-21T09:05:03.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.578+0000 7f54adffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-21T09:05:03.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.578+0000 7f54adffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-21T09:05:03.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.578+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(68 notify.2 [notify cookie 94370951729280 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.578+0000 7f54adffb640 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5400003400 con 0x55d4730a13b0 2024-09-21T09:05:03.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.578+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.578+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== watch-notify(notify_complete (2) cookie 94370951729280 notify 133143986184 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f55bc083040 con 0x55d4730a13b0 2024-09-21T09:05:03.587 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T09:05:03.575855Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:05:03.575846Z","tags":[],"group_ids":[]} 2024-09-21T09:05:03.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.579+0000 7f54817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:03.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.579+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94370951511376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e02e0 con 0x55d473097f50 2024-09-21T09:05:03.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.580+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94370951511376] v31'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.580+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94370951487680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e02e0 con 0x7f55bc05c070 2024-09-21T09:05:03.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.581+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94370951487680] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x7f55bc05c070 2024-09-21T09:05:03.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.581+0000 7f55cceb7800 20 remove_watcher() i=0 2024-09-21T09:05:03.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.581+0000 7f55cceb7800 2 removed watcher, disabling cache 2024-09-21T09:05:03.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.581+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94370951492064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e02e0 con 0x55d473097f50 2024-09-21T09:05:03.590 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.582+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94370951492064] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.582+0000 7f55cceb7800 20 remove_watcher() i=1 2024-09-21T09:05:03.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.582+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94370951485152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e02e0 con 0x55d4730a13b0 2024-09-21T09:05:03.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.584+0000 7f55ca9ab640 1 -- 172.21.15.178:0/9887865 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94370951485152] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55bc051070 con 0x55d4730a13b0 2024-09-21T09:05:03.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.584+0000 7f55cceb7800 20 remove_watcher() i=2 2024-09-21T09:05:03.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.584+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94370951498480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e02e0 con 0x7f55bc05c070 2024-09-21T09:05:03.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.585+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94370951498480] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x7f55bc05c070 2024-09-21T09:05:03.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.585+0000 7f55cceb7800 20 remove_watcher() i=3 2024-09-21T09:05:03.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.585+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94370951502576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e02e0 con 0x55d473097f50 2024-09-21T09:05:03.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.586+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94370951502576] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c003d040 con 0x55d473097f50 2024-09-21T09:05:03.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.586+0000 7f55cceb7800 20 remove_watcher() i=4 2024-09-21T09:05:03.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.586+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94370951496432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e02e0 con 0x55d47309c860 2024-09-21T09:05:03.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.587+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94370951496432] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.587+0000 7f55cceb7800 20 remove_watcher() i=5 2024-09-21T09:05:03.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.587+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94370951507408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e02e0 con 0x55d47309c860 2024-09-21T09:05:03.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.588+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94370951507408] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.588+0000 7f55cceb7800 20 remove_watcher() i=6 2024-09-21T09:05:03.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.588+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94370951508464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4730e02e0 con 0x55d47309c860 2024-09-21T09:05:03.594 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cb1ac640 1 -- 172.21.15.178:0/9887865 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94370951508464] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c402a070 con 0x55d47309c860 2024-09-21T09:05:03.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 20 remove_watcher() i=7 2024-09-21T09:05:03.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d47309c860 msgr2=0x55d47309ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d47309c860 0x55d47309ec50 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d473097f50 msgr2=0x55d47309a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d473097f50 0x55d47309a410 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f55bc05c070 msgr2=0x7f55bc090430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f55bc05c070 0x7f55bc090430 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d4730a13b0 msgr2=0x55d4730a3870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55d4730a13b0 0x55d4730a3870 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5494036b40 msgr2=0x7f5494039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5494036b40 0x7f5494039000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f55bc025c20 tx=0x7f55bc085000 comp rx=0 tx=0).stop 2024-09-21T09:05:03.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473084e20 msgr2=0x55d47308c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55ca1aa640 1 -- 172.21.15.178:0/9887865 reap_dead start 2024-09-21T09:05:03.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473084e20 0x55d47308c300 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f55c404ba10 tx=0x7f55c404cad0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 shutdown_connections 2024-09-21T09:05:03.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 --2- 172.21.15.178:0/9887865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473084e20 0x55d47308c300 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 >> 172.21.15.178:0/9887865 conn(0x55d473081180 msgr2=0x55d47307f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 shutdown_connections 2024-09-21T09:05:03.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.589+0000 7f55cceb7800 1 -- 172.21.15.178:0/9887865 wait complete. 2024-09-21T09:05:03.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 -- 172.21.15.178:0/1230613760 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f54a4036b40 msgr2=0x7f54a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 --2- 172.21.15.178:0/1230613760 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f54a4036b40 0x7f54a4039000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55d473064e80 tx=0x7f55bc060ee0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 -- 172.21.15.178:0/1230613760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473078150 msgr2=0x55d473078570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 --2- 172.21.15.178:0/1230613760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473078150 0x55d473078570 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x55d473064d90 tx=0x7f55c4018830 comp rx=0 tx=0).stop 2024-09-21T09:05:03.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 -- 172.21.15.178:0/1230613760 shutdown_connections 2024-09-21T09:05:03.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 --2- 172.21.15.178:0/1230613760 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f54a4036b40 0x7f54a4039000 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 --2- 172.21.15.178:0/1230613760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d473078150 0x55d473078570 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 -- 172.21.15.178:0/1230613760 >> 172.21.15.178:0/1230613760 conn(0x55d47306d0e0 msgr2=0x55d47306fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 -- 172.21.15.178:0/1230613760 shutdown_connections 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 -- 172.21.15.178:0/1230613760 wait complete. 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d473066d30 msgr2=0x55d473069120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d473066d30 0x55d473069120 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d472f664e0 msgr2=0x55d473064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d472f664e0 0x55d473064400 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f54b0036b40 msgr2=0x7f54b0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f54b0036b40 0x7f54b0039000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f55c0000f60 tx=0x7f55c00012b0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 msgr2=0x55d47305d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d47305d390 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x55d4730568a0 tx=0x7f55bc002fb0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 shutdown_connections 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55d473066d30 0x55d473069120 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55d472f664e0 0x55d473064400 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f54b0036b40 0x7f54b0039000 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 --2- 172.21.15.178:0/2660072216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d472f65ba0 0x55d47305d390 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 >> 172.21.15.178:0/2660072216 conn(0x55d472f60580 msgr2=0x55d47304f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 shutdown_connections 2024-09-21T09:05:03.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.590+0000 7f55cceb7800 1 -- 172.21.15.178:0/2660072216 wait complete. 2024-09-21T09:05:03.601 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:03.601 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:03.601 ERROR:root:0 2024-09-21T09:05:03.602 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:03.607 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000582ef15403111f54-0066ee8c3f-4231-default', 'HostId': '4231-default-default'} 2024-09-21T09:05:03.607 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-21T09:05:03.617 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:03.618 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-21T09:05:03.629 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-21T09:05:03.629 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-21T09:05:03.643 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-21T09:05:03.644 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-21T09:05:03.652 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-21T09:05:03.652 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:03.655 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:03.655 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-21T09:05:03.659 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:03.660 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T09:05:03.660 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T09:05:03.660 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-21T09:05:03.706 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:03.706 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:03.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.705+0000 7fe4cdb30800 1 Processor -- start 2024-09-21T09:05:03.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.705+0000 7fe4cdb30800 1 -- start start 2024-09-21T09:05:03.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.705+0000 7fe4cdb30800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56411affe4e0 0x56411affe8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.706+0000 7fe4cdb30800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56411aebeb30 con 0x56411affee20 2024-09-21T09:05:03.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.706+0000 7fe4cdb30800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x56411aea0360 con 0x56411affe4e0 2024-09-21T09:05:03.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.706+0000 7fe4c985c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56411affe4e0 0x56411affe8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.706+0000 7fe4c985c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x56411affe4e0 0x56411affe8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60572/0 (socket says 172.21.15.178:60572) 2024-09-21T09:05:03.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.706+0000 7fe4c985c640 1 -- 172.21.15.178:0/1570674257 learned_addr learned my addr 172.21.15.178:0/1570674257 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.706+0000 7fe4c985c640 1 -- 172.21.15.178:0/1570674257 >> v1:172.21.15.44:6789/0 conn(0x56411affee20 legacy=0x56411b0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.708 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.706+0000 7fe4c985c640 1 -- 172.21.15.178:0/1570674257 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411aec6e00 con 0x56411affe4e0 2024-09-21T09:05:03.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.708+0000 7fe4c985c640 1 --2- 172.21.15.178:0/1570674257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411affe8e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00a6b0 tx=0x7fe4bc047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382aa9c1113391b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.708+0000 7fe4c905b640 1 -- 172.21.15.178:0/1570674257 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4bc00a200 con 0x56411affe4e0 2024-09-21T09:05:03.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.708+0000 7fe4c905b640 1 -- 172.21.15.178:0/1570674257 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc00a3a0 con 0x56411affe4e0 2024-09-21T09:05:03.710 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.708+0000 7fe4c905b640 1 -- 172.21.15.178:0/1570674257 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4bc008700 con 0x56411affe4e0 2024-09-21T09:05:03.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.709+0000 7fe4cdb30800 1 -- 172.21.15.178:0/1570674257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 msgr2=0x56411affe8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.709+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/1570674257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411affe8e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00a6b0 tx=0x7fe4bc047e30 comp rx=0 tx=0).stop 2024-09-21T09:05:03.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.709+0000 7fe4cdb30800 1 -- 172.21.15.178:0/1570674257 shutdown_connections 2024-09-21T09:05:03.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.709+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/1570674257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411affe8e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.709+0000 7fe4cdb30800 1 -- 172.21.15.178:0/1570674257 >> 172.21.15.178:0/1570674257 conn(0x56411aff9dd0 msgr2=0x56411affc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.709+0000 7fe4cdb30800 1 -- 172.21.15.178:0/1570674257 shutdown_connections 2024-09-21T09:05:03.711 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.709+0000 7fe4cdb30800 1 -- 172.21.15.178:0/1570674257 wait complete. 2024-09-21T09:05:03.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.722+0000 7fe4cdb30800 1 Processor -- start 2024-09-21T09:05:03.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.722+0000 7fe4cdb30800 1 -- start start 2024-09-21T09:05:03.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.722+0000 7fe4cdb30800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411b0f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.722+0000 7fe4cdb30800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56411af4b360 con 0x56411affe4e0 2024-09-21T09:05:03.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.723+0000 7fe4c985c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411b0f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.723+0000 7fe4c985c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411b0f0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60588/0 (socket says 172.21.15.178:60588) 2024-09-21T09:05:03.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.723+0000 7fe4c985c640 1 -- 172.21.15.178:0/3110907355 learned_addr learned my addr 172.21.15.178:0/3110907355 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.723+0000 7fe4c985c640 1 -- 172.21.15.178:0/3110907355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411ae98bc0 con 0x56411affe4e0 2024-09-21T09:05:03.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.723+0000 7fe4c985c640 1 --2- 172.21.15.178:0/3110907355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411b0f0ab0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc048360 tx=0x7fe4bc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bc2aab883de53f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.723+0000 7fe3b7e07640 1 -- 172.21.15.178:0/3110907355 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4bc064070 con 0x56411affe4e0 2024-09-21T09:05:03.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.723+0000 7fe3b7e07640 1 -- 172.21.15.178:0/3110907355 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc04f4c0 con 0x56411affe4e0 2024-09-21T09:05:03.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.723+0000 7fe3b7e07640 1 -- 172.21.15.178:0/3110907355 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4bc00a200 con 0x56411affe4e0 2024-09-21T09:05:03.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.724+0000 7fe4cdb30800 1 -- 172.21.15.178:0/3110907355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 msgr2=0x56411b0f0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.724+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/3110907355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411b0f0ab0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc048360 tx=0x7fe4bc051000 comp rx=0 tx=0).stop 2024-09-21T09:05:03.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.724+0000 7fe4cdb30800 1 -- 172.21.15.178:0/3110907355 shutdown_connections 2024-09-21T09:05:03.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.724+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/3110907355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411b0f0ab0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.724+0000 7fe4cdb30800 1 -- 172.21.15.178:0/3110907355 >> 172.21.15.178:0/3110907355 conn(0x56411aff9dd0 msgr2=0x56411b0e8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.727 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.724+0000 7fe4cdb30800 1 -- 172.21.15.178:0/3110907355 shutdown_connections 2024-09-21T09:05:03.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.724+0000 7fe4cdb30800 1 -- 172.21.15.178:0/3110907355 wait complete. 2024-09-21T09:05:03.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.724+0000 7fe4cdb30800 1 Processor -- start 2024-09-21T09:05:03.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.724+0000 7fe4cdb30800 1 -- start start 2024-09-21T09:05:03.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.725+0000 7fe4cdb30800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411b0f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.725+0000 7fe4cdb30800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56411b0054a0 con 0x56411affe4e0 2024-09-21T09:05:03.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.725+0000 7fe4c985c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411b0f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.725+0000 7fe4c985c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411b0f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60602/0 (socket says 172.21.15.178:60602) 2024-09-21T09:05:03.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.725+0000 7fe4c985c640 1 -- 172.21.15.178:0/2108861307 learned_addr learned my addr 172.21.15.178:0/2108861307 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.725+0000 7fe4c985c640 1 -- 172.21.15.178:0/2108861307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411aeacfe0 con 0x56411affe4e0 2024-09-21T09:05:03.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.725+0000 7fe4c985c640 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411b0f8480 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc000c00 tx=0x7fe4bc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.726+0000 7fe3b6604640 1 -- 172.21.15.178:0/2108861307 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4bc06c030 con 0x56411affe4e0 2024-09-21T09:05:03.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.726+0000 7fe3b6604640 1 -- 172.21.15.178:0/2108861307 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc04f930 con 0x56411affe4e0 2024-09-21T09:05:03.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.726+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56411b0f89c0 con 0x56411affe4e0 2024-09-21T09:05:03.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.726+0000 7fe3b6604640 1 -- 172.21.15.178:0/2108861307 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4bc064040 con 0x56411affe4e0 2024-09-21T09:05:03.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.726+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56411b0f8e80 con 0x56411affe4e0 2024-09-21T09:05:03.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.726+0000 7fe3b6604640 1 -- 172.21.15.178:0/2108861307 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe4bc06f070 con 0x56411affe4e0 2024-09-21T09:05:03.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.727+0000 7fe3b6604640 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe3b0036b40 0x7fe3b0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.727+0000 7fe3b6604640 1 -- 172.21.15.178:0/2108861307 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe4bc06d070 con 0x56411affe4e0 2024-09-21T09:05:03.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.727+0000 7fe4c105b640 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe3b0036b40 0x7fe3b0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.727+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56411affee20 0x56411b0ff420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.727+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b0ffa40 con 0x56411affee20 2024-09-21T09:05:03.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.727+0000 7fe4ca05d640 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56411affee20 0x56411b0ff420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.727+0000 7fe4c105b640 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe3b0036b40 0x7fe3b0039000 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4001e10 tx=0x7fe4b4001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.727+0000 7fe4ca05d640 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56411affee20 0x56411b0ff420 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.727+0000 7fe4ca05d640 1 -- 172.21.15.178:0/2108861307 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4c400a4a0 con 0x56411affee20 2024-09-21T09:05:03.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.728+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b100300 con 0x56411affee20 2024-09-21T09:05:03.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.728+0000 7fe4ca05d640 1 -- 172.21.15.178:0/2108861307 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4c400a4a0 con 0x56411affee20 2024-09-21T09:05:03.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.728+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56411b101c10 0x56411b1040a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.728+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b104830 con 0x56411b101c10 2024-09-21T09:05:03.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.728+0000 7fe4c985c640 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56411b101c10 0x56411b1040a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.728+0000 7fe4c985c640 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56411b101c10 0x56411b1040a0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.729+0000 7fe4c985c640 1 -- 172.21.15.178:0/2108861307 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b101c10 2024-09-21T09:05:03.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.729+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b100b50 con 0x56411affee20 2024-09-21T09:05:03.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.729+0000 7fe4ca05d640 1 -- 172.21.15.178:0/2108861307 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4c400a4a0 con 0x56411affee20 2024-09-21T09:05:03.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.729+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b100f30 con 0x56411affee20 2024-09-21T09:05:03.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.729+0000 7fe4ca05d640 1 -- 172.21.15.178:0/2108861307 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe4c400a4a0 con 0x56411affee20 2024-09-21T09:05:03.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.729+0000 7fe4cdb30800 1 Processor -- start 2024-09-21T09:05:03.733 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.730+0000 7fe4cdb30800 1 -- start start 2024-09-21T09:05:03.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.730+0000 7fe4cdb30800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b1131f0 0x56411b113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.730+0000 7fe4cdb30800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56411ae9a580 con 0x56411b1131f0 2024-09-21T09:05:03.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.730+0000 7fe4ca05d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b1131f0 0x56411b113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.730+0000 7fe4ca05d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b1131f0 0x56411b113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60604/0 (socket says 172.21.15.178:60604) 2024-09-21T09:05:03.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.730+0000 7fe4ca05d640 1 -- 172.21.15.178:0/1684315791 learned_addr learned my addr 172.21.15.178:0/1684315791 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.730+0000 7fe4ca05d640 1 -- 172.21.15.178:0/1684315791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411b113b50 con 0x56411b1131f0 2024-09-21T09:05:03.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.730+0000 7fe4ca05d640 1 --2- 172.21.15.178:0/1684315791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b1131f0 0x56411b113610 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x56411b0f9530 tx=0x7fe4c40188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.731+0000 7fe3af7fe640 1 -- 172.21.15.178:0/1684315791 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4c4014450 con 0x56411b1131f0 2024-09-21T09:05:03.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.731+0000 7fe3af7fe640 1 -- 172.21.15.178:0/1684315791 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c40145f0 con 0x56411b1131f0 2024-09-21T09:05:03.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.731+0000 7fe4cdb30800 1 -- 172.21.15.178:0/1684315791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56411b113de0 con 0x56411b1131f0 2024-09-21T09:05:03.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.731+0000 7fe3af7fe640 1 -- 172.21.15.178:0/1684315791 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4c40148d0 con 0x56411b1131f0 2024-09-21T09:05:03.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.731+0000 7fe4cdb30800 1 -- 172.21.15.178:0/1684315791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56411b116ac0 con 0x56411b1131f0 2024-09-21T09:05:03.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.731+0000 7fe3af7fe640 1 -- 172.21.15.178:0/1684315791 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe4c4011040 con 0x56411b1131f0 2024-09-21T09:05:03.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.732+0000 7fe3af7fe640 1 --2- 172.21.15.178:0/1684315791 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe3a4036b40 0x7fe3a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.732+0000 7fe3af7fe640 1 -- 172.21.15.178:0/1684315791 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe4c401e070 con 0x56411b1131f0 2024-09-21T09:05:03.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.732+0000 7fe4c985c640 1 --2- 172.21.15.178:0/1684315791 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe3a4036b40 0x7fe3a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.732+0000 7fe4cdb30800 1 Processor -- start 2024-09-21T09:05:03.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.732+0000 7fe4cdb30800 1 -- start start 2024-09-21T09:05:03.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.732+0000 7fe4c985c640 1 --2- 172.21.15.178:0/1684315791 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe3a4036b40 0x7fe3a4039000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x56411b0fcbc0 tx=0x7fe4bc04fee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.732+0000 7fe4cdb30800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b11fe40 0x56411b120240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.732+0000 7fe4cdb30800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56411b0f1200 con 0x56411b11fe40 2024-09-21T09:05:03.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.732+0000 7fe4ca05d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b11fe40 0x56411b120240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.732+0000 7fe4ca05d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b11fe40 0x56411b120240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60612/0 (socket says 172.21.15.178:60612) 2024-09-21T09:05:03.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.732+0000 7fe4ca05d640 1 -- 172.21.15.178:0/3586128650 learned_addr learned my addr 172.21.15.178:0/3586128650 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.733+0000 7fe4ca05d640 1 -- 172.21.15.178:0/3586128650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411b120810 con 0x56411b11fe40 2024-09-21T09:05:03.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.733+0000 7fe4ca05d640 1 --2- 172.21.15.178:0/3586128650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b11fe40 0x56411b120240 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe4c404cb80 tx=0x7fe4c403bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3ff659c58e572e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.733+0000 7fe3ad7fa640 1 -- 172.21.15.178:0/3586128650 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4c40168f0 con 0x56411b11fe40 2024-09-21T09:05:03.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.733+0000 7fe3ad7fa640 1 -- 172.21.15.178:0/3586128650 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c4013c80 con 0x56411b11fe40 2024-09-21T09:05:03.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.733+0000 7fe3ad7fa640 1 -- 172.21.15.178:0/3586128650 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4c4014a70 con 0x56411b11fe40 2024-09-21T09:05:03.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.733+0000 7fe4cdb30800 1 -- 172.21.15.178:0/3586128650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b11fe40 msgr2=0x56411b120240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.733+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/3586128650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b11fe40 0x56411b120240 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe4c404cb80 tx=0x7fe4c403bf60 comp rx=0 tx=0).stop 2024-09-21T09:05:03.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.733+0000 7fe4cdb30800 1 -- 172.21.15.178:0/3586128650 shutdown_connections 2024-09-21T09:05:03.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.733+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/3586128650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b11fe40 0x56411b120240 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.733+0000 7fe4cdb30800 1 -- 172.21.15.178:0/3586128650 >> 172.21.15.178:0/3586128650 conn(0x56411b11c240 msgr2=0x56411b11a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.733+0000 7fe4cdb30800 1 -- 172.21.15.178:0/3586128650 shutdown_connections 2024-09-21T09:05:03.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.733+0000 7fe4cdb30800 1 -- 172.21.15.178:0/3586128650 wait complete. 2024-09-21T09:05:03.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.734+0000 7fe4cdb30800 1 Processor -- start 2024-09-21T09:05:03.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.734+0000 7fe4cdb30800 1 -- start start 2024-09-21T09:05:03.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.734+0000 7fe4cdb30800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b11fe40 0x56411b127290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.734+0000 7fe4cdb30800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56411b120e70 con 0x56411b11fe40 2024-09-21T09:05:03.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.734+0000 7fe4ca05d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b11fe40 0x56411b127290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.734+0000 7fe4ca05d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b11fe40 0x56411b127290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60616/0 (socket says 172.21.15.178:60616) 2024-09-21T09:05:03.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.734+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 learned_addr learned my addr 172.21.15.178:0/987920485 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.734+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411b1277d0 con 0x56411b11fe40 2024-09-21T09:05:03.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.735+0000 7fe4ca05d640 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b11fe40 0x56411b127290 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe4c403e040 tx=0x7fe4c404cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.735+0000 7fe39b7fe640 1 -- 172.21.15.178:0/987920485 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4c4044030 con 0x56411b11fe40 2024-09-21T09:05:03.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.735+0000 7fe39b7fe640 1 -- 172.21.15.178:0/987920485 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c4013e30 con 0x56411b11fe40 2024-09-21T09:05:03.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.735+0000 7fe39b7fe640 1 -- 172.21.15.178:0/987920485 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4c4022bb0 con 0x56411b11fe40 2024-09-21T09:05:03.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.735+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56411b127a60 con 0x56411b11fe40 2024-09-21T09:05:03.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.735+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56411b12a710 con 0x56411b11fe40 2024-09-21T09:05:03.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.736+0000 7fe39b7fe640 1 -- 172.21.15.178:0/987920485 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe4c40133b0 con 0x56411b11fe40 2024-09-21T09:05:03.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.736+0000 7fe39b7fe640 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe394036b40 0x7fe394039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.736+0000 7fe39b7fe640 1 -- 172.21.15.178:0/987920485 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe4c4045070 con 0x56411b11fe40 2024-09-21T09:05:03.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.736+0000 7fe4c985c640 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe394036b40 0x7fe394039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.736+0000 7fe4c985c640 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe394036b40 0x7fe394039000 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0577e0 tx=0x7fe4bc08a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.736+0000 7fe4cdb30800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.736+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56411b132f40 0x56411b135400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.736+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b135b50 con 0x56411b132f40 2024-09-21T09:05:03.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.737+0000 7fe4c105b640 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56411b132f40 0x56411b135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.737+0000 7fe4c105b640 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56411b132f40 0x56411b135400 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.737+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b400bdb0 con 0x56411b132f40 2024-09-21T09:05:03.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.737+0000 7fe4cdb30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.737+0000 7fe4cdb30800 20 realm 2024-09-21T09:05:03.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.737+0000 7fe4cdb30800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.737+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b132390 con 0x56411b132f40 2024-09-21T09:05:03.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.737+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b400bdb0 con 0x56411b132f40 2024-09-21T09:05:03.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.737+0000 7fe4cdb30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.737+0000 7fe4cdb30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:03.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.737+0000 7fe4cdb30800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.737+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b136640 con 0x56411b132f40 2024-09-21T09:05:03.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.738+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b400bdb0 con 0x56411b132f40 2024-09-21T09:05:03.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.738+0000 7fe4cdb30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.738+0000 7fe4cdb30800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.738+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b136f10 con 0x56411b132f40 2024-09-21T09:05:03.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.738+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4b400bdb0 con 0x56411b132f40 2024-09-21T09:05:03.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.738+0000 7fe4cdb30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:03.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.738+0000 7fe4cdb30800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.738+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56411b137850 0x56411b139c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.738+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b13a410 con 0x56411b137850 2024-09-21T09:05:03.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.738+0000 7fe4ca05d640 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56411b137850 0x56411b139c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.738+0000 7fe4ca05d640 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56411b137850 0x56411b139c80 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.739+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.739+0000 7fe4cdb30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.739+0000 7fe4cdb30800 20 searching for the correct realm 2024-09-21T09:05:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.739+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56411b13c3e0 0x56411b13e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.739+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b13c3e0 2024-09-21T09:05:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.739+0000 7fe4c985c640 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56411b13c3e0 0x56411b13e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.739+0000 7fe4c985c640 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56411b13c3e0 0x56411b13e8a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.739+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b13c3e0 2024-09-21T09:05:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.739+0000 7fe4c985c640 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe4bc0a1040 0x7fe4bc071410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.739+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x7fe4bc0a1040 2024-09-21T09:05:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.740+0000 7fe4c105b640 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe4bc0a1040 0x7fe4bc071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.740+0000 7fe4c105b640 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe4bc0a1040 0x7fe4bc071410 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.740+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b400bdb0 con 0x7fe4bc0a1040 2024-09-21T09:05:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.740+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b137850 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.740+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.740+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b132f40 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.741+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b400bdb0 con 0x56411b132f40 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.741+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b132f40 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.741+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.741+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b137850 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.741+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.741+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b137850 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.741+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.741+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x7fe4bc0a1040 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.742+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b402a040 con 0x7fe4bc0a1040 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.742+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b13c3e0 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.742+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b13c3e0 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.742+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b132f40 2024-09-21T09:05:03.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.742+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.742+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b137850 2024-09-21T09:05:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.742+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.742+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b132f40 2024-09-21T09:05:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.743+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.743+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x7fe4bc0a1040 2024-09-21T09:05:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.743+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe4b402a040 con 0x7fe4bc0a1040 2024-09-21T09:05:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.743+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b13c3e0 2024-09-21T09:05:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.743+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b13c3e0 2024-09-21T09:05:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.743+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b13c3e0 2024-09-21T09:05:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.743+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b13c3e0 2024-09-21T09:05:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.743+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b137850 2024-09-21T09:05:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.744+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.744+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b13c3e0 2024-09-21T09:05:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.744+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b13c3e0 2024-09-21T09:05:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.744+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b13c3e0 2024-09-21T09:05:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.744+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b13c3e0 2024-09-21T09:05:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.744+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b132f40 2024-09-21T09:05:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.744+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.744+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b132f40 2024-09-21T09:05:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.745+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.745+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b137850 2024-09-21T09:05:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.745+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.745+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b13c3e0 2024-09-21T09:05:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.745+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b13c3e0 2024-09-21T09:05:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.745+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x7fe4bc0a1040 2024-09-21T09:05:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.746+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b402a040 con 0x7fe4bc0a1040 2024-09-21T09:05:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.746+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b132f40 2024-09-21T09:05:03.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.746+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.746+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b137850 2024-09-21T09:05:03.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.746+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.746+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b13c3e0 2024-09-21T09:05:03.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.746+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b13c3e0 2024-09-21T09:05:03.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.746+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x7fe4bc0a1040 2024-09-21T09:05:03.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.747+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b402a040 con 0x7fe4bc0a1040 2024-09-21T09:05:03.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.747+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x7fe4bc0a1040 2024-09-21T09:05:03.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.747+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b402a040 con 0x7fe4bc0a1040 2024-09-21T09:05:03.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.747+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b13c3e0 2024-09-21T09:05:03.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.747+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b13c3e0 2024-09-21T09:05:03.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.747+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b137850 2024-09-21T09:05:03.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.747+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.747+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x56411b132f40 2024-09-21T09:05:03.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56411b13ef70 con 0x7fe4bc0a1040 2024-09-21T09:05:03.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b402a040 con 0x7fe4bc0a1040 2024-09-21T09:05:03.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4cdb30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:03.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4cdb30800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:03.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4cdb30800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:03.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4cdb30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:03.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4cdb30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:03.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4cdb30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:03.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4cdb30800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b13add0 con 0x56411b132f40 2024-09-21T09:05:03.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4cdb30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4cdb30800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b13b670 con 0x56411b132f40 2024-09-21T09:05:03.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4cdb30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:03.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4cdb30800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.748+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b13aa10 con 0x56411b132f40 2024-09-21T09:05:03.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:03.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 20 zone default found 2024-09-21T09:05:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 4 Realm: () 2024-09-21T09:05:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 20 zonegroup default 2024-09-21T09:05:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b13f460 con 0x56411b137850 2024-09-21T09:05:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b141730 con 0x56411b13c3e0 2024-09-21T09:05:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b13c3e0 2024-09-21T09:05:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.749+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b141ad0 con 0x56411b13c3e0 2024-09-21T09:05:03.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.750+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b13c3e0 2024-09-21T09:05:03.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.750+0000 7fe4cdb30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.750+0000 7fe4cdb30800 20 started sync module instance, tier type = 2024-09-21T09:05:03.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.750+0000 7fe4cdb30800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:03.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.750+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b140bc0 con 0x7fe4bc0a1040 2024-09-21T09:05:03.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.751+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x7fe4bc0a1040 2024-09-21T09:05:03.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.751+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94837627162896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b140bc0 con 0x7fe4bc0a1040 2024-09-21T09:05:03.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.751+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b1424d0 con 0x56411b132f40 2024-09-21T09:05:03.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.752+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94837627162896] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x7fe4bc0a1040 2024-09-21T09:05:03.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.752+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.752+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94837627166688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b140bc0 con 0x56411b132f40 2024-09-21T09:05:03.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.752+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b142f40 con 0x56411b13c3e0 2024-09-21T09:05:03.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.753+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b13c3e0 2024-09-21T09:05:03.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.753+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94837627166688] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.753+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94837627169328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b143810 con 0x56411b13c3e0 2024-09-21T09:05:03.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.753+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b140750 con 0x7fe4bc0a1040 2024-09-21T09:05:03.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.754+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94837627169328] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b13c3e0 2024-09-21T09:05:03.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.754+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x7fe4bc0a1040 2024-09-21T09:05:03.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.754+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94837627171680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b144280 con 0x7fe4bc0a1040 2024-09-21T09:05:03.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.754+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b144c40 con 0x56411b132f40 2024-09-21T09:05:03.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.755+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94837627171680] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x7fe4bc0a1040 2024-09-21T09:05:03.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.756+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.756+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94837627174832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b144c40 con 0x56411b132f40 2024-09-21T09:05:03.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.756+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b145600 con 0x56411b137850 2024-09-21T09:05:03.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.757+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.757+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94837627179344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b145ea0 con 0x56411b137850 2024-09-21T09:05:03.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.757+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b146920 con 0x56411b137850 2024-09-21T09:05:03.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.757+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94837627174832] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.758+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94837627179344] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.758+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.758+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94837627184144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b1459a0 con 0x56411b137850 2024-09-21T09:05:03.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.758+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b1471f0 con 0x56411b137850 2024-09-21T09:05:03.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.759+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(58 notify.7 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.759+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94837627184144] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.759+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94837627186496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b1459a0 con 0x56411b137850 2024-09-21T09:05:03.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.759+0000 7fe4cdb30800 20 add_watcher() i=0 2024-09-21T09:05:03.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.759+0000 7fe4cdb30800 20 add_watcher() i=1 2024-09-21T09:05:03.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.759+0000 7fe4cdb30800 20 add_watcher() i=2 2024-09-21T09:05:03.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.759+0000 7fe4cdb30800 20 add_watcher() i=3 2024-09-21T09:05:03.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.759+0000 7fe4cdb30800 20 add_watcher() i=4 2024-09-21T09:05:03.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.759+0000 7fe4cdb30800 20 add_watcher() i=5 2024-09-21T09:05:03.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.759+0000 7fe4cdb30800 20 add_watcher() i=6 2024-09-21T09:05:03.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.760+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94837627186496] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.760+0000 7fe4cdb30800 20 add_watcher() i=7 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.760+0000 7fe4cdb30800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.760+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b144820 con 0x56411b132f40 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.760+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.760+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94837627187552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b144820 con 0x56411b132f40 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.762+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94837627187552] v31'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.762+0000 7fe37b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.762+0000 7fe4cdb30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.762+0000 7fe4cdb30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.762+0000 7fe4cdb30800 5 note: GC not initialized 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.762+0000 7fe37a7fc640 20 reqs_thread_entry: start 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.762+0000 7fe4cdb30800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.762+0000 7fe4cdb30800 20 Filter name: none 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.762+0000 7fe2ebfff640 20 reqs_thread_entry: start 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.762+0000 7fe4cdb30800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T09:05:03.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.762+0000 7fe4cdb30800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.762+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b17d710 con 0x56411b137850 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.763+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.763+0000 7fe4cdb30800 20 rados_obj.operate() r=0 bl.length=473 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.763+0000 7fe4cdb30800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.763+0000 7fe4cdb30800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.763+0000 7fe4cdb30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.763+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b184070 con 0x56411b137850 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.764+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v31'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.764+0000 7fe4cdb30800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.764+0000 7fe4cdb30800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.764+0000 7fe4cdb30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.764+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94837627435568 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56411b17f6d0 con 0x56411b132f40 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.765+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== watch-notify(notify (1) cookie 94837627174832 notify 133143986201 ret 0) ==== 678+0+0 (crc 0 0 0) 0x56411aebeb30 con 0x56411b132f40 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.765+0000 7fe3ad7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986201 cookie 94837627174832 notifier 4840 bl.length()=636 2024-09-21T09:05:03.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.765+0000 7fe3ad7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:03.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.765+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 notify.4 [notify cookie 94837627435568 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.765+0000 7fe3ad7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:03.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.765+0000 7fe3ad7fa640 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe38c003ea0 con 0x56411b132f40 2024-09-21T09:05:03.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.765+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.765+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== watch-notify(notify_complete (2) cookie 94837627435568 notify 133143986201 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe4b402e520 con 0x56411b132f40 2024-09-21T09:05:03.775 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T09:05:03.575855Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:05:03.575846Z","tags":[],"group_ids":[]} 2024-09-21T09:05:03.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.766+0000 7fe37b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:03.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.766+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94837627187552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b17b430 con 0x56411b132f40 2024-09-21T09:05:03.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.767+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94837627187552] v31'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.767+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94837627162896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b17b430 con 0x7fe4bc0a1040 2024-09-21T09:05:03.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.768+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94837627162896] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x7fe4bc0a1040 2024-09-21T09:05:03.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.768+0000 7fe4cdb30800 20 remove_watcher() i=0 2024-09-21T09:05:03.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.768+0000 7fe4cdb30800 2 removed watcher, disabling cache 2024-09-21T09:05:03.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.768+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94837627166688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b17b430 con 0x56411b132f40 2024-09-21T09:05:03.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.769+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94837627166688] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.769+0000 7fe4cdb30800 20 remove_watcher() i=1 2024-09-21T09:05:03.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.769+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94837627169328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b17b430 con 0x56411b13c3e0 2024-09-21T09:05:03.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.770+0000 7fe4c985c640 1 -- 172.21.15.178:0/987920485 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94837627169328] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc0703b0 con 0x56411b13c3e0 2024-09-21T09:05:03.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.770+0000 7fe4cdb30800 20 remove_watcher() i=2 2024-09-21T09:05:03.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.770+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94837627171680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b141fe0 con 0x7fe4bc0a1040 2024-09-21T09:05:03.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.771+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94837627171680] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x7fe4bc0a1040 2024-09-21T09:05:03.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.771+0000 7fe4cdb30800 20 remove_watcher() i=3 2024-09-21T09:05:03.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.771+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94837627174832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b142a30 con 0x56411b132f40 2024-09-21T09:05:03.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.772+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94837627174832] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b402a040 con 0x56411b132f40 2024-09-21T09:05:03.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.772+0000 7fe4cdb30800 20 remove_watcher() i=4 2024-09-21T09:05:03.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.772+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94837627179344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b143360 con 0x56411b137850 2024-09-21T09:05:03.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.773+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94837627179344] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.773+0000 7fe4cdb30800 20 remove_watcher() i=5 2024-09-21T09:05:03.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.773+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94837627184144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b141fe0 con 0x56411b137850 2024-09-21T09:05:03.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.774+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94837627184144] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.774+0000 7fe4cdb30800 20 remove_watcher() i=6 2024-09-21T09:05:03.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.774+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94837627186496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56411b143fb0 con 0x56411b137850 2024-09-21T09:05:03.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.775+0000 7fe4ca05d640 1 -- 172.21.15.178:0/987920485 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94837627186496] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c402a070 con 0x56411b137850 2024-09-21T09:05:03.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.775+0000 7fe4cdb30800 20 remove_watcher() i=7 2024-09-21T09:05:03.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56411b137850 msgr2=0x56411b139c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56411b137850 0x56411b139c80 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56411b132f40 msgr2=0x56411b135400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56411b132f40 0x56411b135400 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe4bc0a1040 msgr2=0x7fe4bc071410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fe4bc0a1040 0x7fe4bc071410 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56411b13c3e0 msgr2=0x56411b13e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56411b13c3e0 0x56411b13e8a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe394036b40 msgr2=0x7fe394039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe394036b40 0x7fe394039000 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0577e0 tx=0x7fe4bc08a000 comp rx=0 tx=0).stop 2024-09-21T09:05:03.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b11fe40 msgr2=0x56411b127290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/987920485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b11fe40 0x56411b127290 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe4c403e040 tx=0x7fe4c404cb10 comp rx=0 tx=0).stop 2024-09-21T09:05:03.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 reap_dead start 2024-09-21T09:05:03.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4c105b640 1 -- 172.21.15.178:0/987920485 reap_dead start 2024-09-21T09:05:03.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 shutdown_connections 2024-09-21T09:05:03.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 >> 172.21.15.178:0/987920485 conn(0x56411b11c240 msgr2=0x56411b11a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 shutdown_connections 2024-09-21T09:05:03.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/987920485 wait complete. 2024-09-21T09:05:03.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/1684315791 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe3a4036b40 msgr2=0x7fe3a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/1684315791 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe3a4036b40 0x7fe3a4039000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x56411b0fcbc0 tx=0x7fe4bc04fee0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/1684315791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b1131f0 msgr2=0x56411b113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/1684315791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b1131f0 0x56411b113610 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x56411b0f9530 tx=0x7fe4c40188f0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/1684315791 shutdown_connections 2024-09-21T09:05:03.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/1684315791 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe3a4036b40 0x7fe3a4039000 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/1684315791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411b1131f0 0x56411b113610 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/1684315791 >> 172.21.15.178:0/1684315791 conn(0x56411b108180 msgr2=0x56411b10ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/1684315791 shutdown_connections 2024-09-21T09:05:03.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.776+0000 7fe4cdb30800 1 -- 172.21.15.178:0/1684315791 wait complete. 2024-09-21T09:05:03.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56411b101c10 msgr2=0x56411b1040a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56411b101c10 0x56411b1040a0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56411affee20 msgr2=0x56411b0ff420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56411affee20 0x56411b0ff420 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe3b0036b40 msgr2=0x7fe3b0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe3b0036b40 0x7fe3b0039000 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4001e10 tx=0x7fe4b4001390 comp rx=0 tx=0).stop 2024-09-21T09:05:03.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 msgr2=0x56411b0f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411b0f8480 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc000c00 tx=0x7fe4bc002fb0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 shutdown_connections 2024-09-21T09:05:03.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x56411b101c10 0x56411b1040a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x56411affee20 0x56411b0ff420 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fe3b0036b40 0x7fe3b0039000 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 --2- 172.21.15.178:0/2108861307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56411affe4e0 0x56411b0f8480 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 >> 172.21.15.178:0/2108861307 conn(0x56411aff9dd0 msgr2=0x56411b0e68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 shutdown_connections 2024-09-21T09:05:03.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.777+0000 7fe4cdb30800 1 -- 172.21.15.178:0/2108861307 wait complete. 2024-09-21T09:05:03.787 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:03.787 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:03.787 ERROR:root:0 2024-09-21T09:05:03.788 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-21T09:05:03.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-21T09:05:03.788 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-21T09:05:03.840 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:03.841 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:03.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.840+0000 7f54d412c800 1 Processor -- start 2024-09-21T09:05:03.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.840+0000 7f54d412c800 1 -- start start 2024-09-21T09:05:03.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.840+0000 7f54d412c800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x563125a0e640 0x563125a9f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.840+0000 7f54d412c800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563125959b30 con 0x563125a9fb90 2024-09-21T09:05:03.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.840+0000 7f54d412c800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x56312593b360 con 0x563125a0e640 2024-09-21T09:05:03.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.840+0000 7f54cfeb7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x563125a0e640 0x563125a9f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.840+0000 7f54cfeb7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x563125a0e640 0x563125a9f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60620/0 (socket says 172.21.15.178:60620) 2024-09-21T09:05:03.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.840+0000 7f54cfeb7640 1 -- 172.21.15.178:0/127627831 learned_addr learned my addr 172.21.15.178:0/127627831 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.841+0000 7f54cfeb7640 1 -- 172.21.15.178:0/127627831 >> v1:172.21.15.44:6789/0 conn(0x563125a9fb90 legacy=0x563125aa1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.841+0000 7f54cfeb7640 1 -- 172.21.15.178:0/127627831 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563125961e00 con 0x563125a0e640 2024-09-21T09:05:03.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.842+0000 7f54cfeb7640 1 --2- 172.21.15.178:0/127627831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125a9f650 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f54c000a520 tx=0x7f54c0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6eb2e5bd8d826e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.843+0000 7f54cf6b6640 1 -- 172.21.15.178:0/127627831 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c0055070 con 0x563125a0e640 2024-09-21T09:05:03.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.843+0000 7f54cf6b6640 1 -- 172.21.15.178:0/127627831 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c00515b0 con 0x563125a0e640 2024-09-21T09:05:03.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.843+0000 7f54cf6b6640 1 -- 172.21.15.178:0/127627831 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c00518d0 con 0x563125a0e640 2024-09-21T09:05:03.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.843+0000 7f54d412c800 1 -- 172.21.15.178:0/127627831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 msgr2=0x563125a9f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.843+0000 7f54d412c800 1 --2- 172.21.15.178:0/127627831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125a9f650 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f54c000a520 tx=0x7f54c0045ba0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.843+0000 7f54d412c800 1 -- 172.21.15.178:0/127627831 shutdown_connections 2024-09-21T09:05:03.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.843+0000 7f54d412c800 1 --2- 172.21.15.178:0/127627831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125a9f650 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.843+0000 7f54d412c800 1 -- 172.21.15.178:0/127627831 >> 172.21.15.178:0/127627831 conn(0x563125a94de0 msgr2=0x563125a97200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.843+0000 7f54d412c800 1 -- 172.21.15.178:0/127627831 shutdown_connections 2024-09-21T09:05:03.846 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.843+0000 7f54d412c800 1 -- 172.21.15.178:0/127627831 wait complete. 2024-09-21T09:05:03.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.857+0000 7f54d412c800 1 Processor -- start 2024-09-21T09:05:03.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.857+0000 7f54d412c800 1 -- start start 2024-09-21T09:05:03.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.857+0000 7f54d412c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125b8baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.857+0000 7f54d412c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5631259e6450 con 0x563125a0e640 2024-09-21T09:05:03.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.857+0000 7f54cfeb7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125b8baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.857+0000 7f54cfeb7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125b8baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60632/0 (socket says 172.21.15.178:60632) 2024-09-21T09:05:03.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.857+0000 7f54cfeb7640 1 -- 172.21.15.178:0/3882124368 learned_addr learned my addr 172.21.15.178:0/3882124368 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.858+0000 7f54cfeb7640 1 -- 172.21.15.178:0/3882124368 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563125933bc0 con 0x563125a0e640 2024-09-21T09:05:03.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.858+0000 7f54cfeb7640 1 --2- 172.21.15.178:0/3882124368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125b8baf0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f54c0025da0 tx=0x7f54c0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e25d60713a1ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.858+0000 7f53bde0b640 1 -- 172.21.15.178:0/3882124368 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c0051950 con 0x563125a0e640 2024-09-21T09:05:03.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.858+0000 7f53bde0b640 1 -- 172.21.15.178:0/3882124368 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c0051af0 con 0x563125a0e640 2024-09-21T09:05:03.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.858+0000 7f53bde0b640 1 -- 172.21.15.178:0/3882124368 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c0051dd0 con 0x563125a0e640 2024-09-21T09:05:03.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.859+0000 7f54d412c800 1 -- 172.21.15.178:0/3882124368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 msgr2=0x563125b8baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.859+0000 7f54d412c800 1 --2- 172.21.15.178:0/3882124368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125b8baf0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f54c0025da0 tx=0x7f54c0051000 comp rx=0 tx=0).stop 2024-09-21T09:05:03.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.859+0000 7f54d412c800 1 -- 172.21.15.178:0/3882124368 shutdown_connections 2024-09-21T09:05:03.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.859+0000 7f54d412c800 1 --2- 172.21.15.178:0/3882124368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125b8baf0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.859+0000 7f54d412c800 1 -- 172.21.15.178:0/3882124368 >> 172.21.15.178:0/3882124368 conn(0x563125a94de0 msgr2=0x563125b874b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.859+0000 7f54d412c800 1 -- 172.21.15.178:0/3882124368 shutdown_connections 2024-09-21T09:05:03.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.859+0000 7f54d412c800 1 -- 172.21.15.178:0/3882124368 wait complete. 2024-09-21T09:05:03.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.859+0000 7f54d412c800 1 Processor -- start 2024-09-21T09:05:03.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.859+0000 7f54d412c800 1 -- start start 2024-09-21T09:05:03.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.859+0000 7f54d412c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125b93320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.859+0000 7f54d412c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563125aa3940 con 0x563125a0e640 2024-09-21T09:05:03.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.860+0000 7f54cfeb7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125b93320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.860+0000 7f54cfeb7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125b93320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60638/0 (socket says 172.21.15.178:60638) 2024-09-21T09:05:03.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.860+0000 7f54cfeb7640 1 -- 172.21.15.178:0/1801711214 learned_addr learned my addr 172.21.15.178:0/1801711214 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.860+0000 7f54cfeb7640 1 -- 172.21.15.178:0/1801711214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563125947fe0 con 0x563125a0e640 2024-09-21T09:05:03.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.860+0000 7f54cfeb7640 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125b93320 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f54c0067040 tx=0x7f54c0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.860+0000 7f53b7fff640 1 -- 172.21.15.178:0/1801711214 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c0073070 con 0x563125a0e640 2024-09-21T09:05:03.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.860+0000 7f53b7fff640 1 -- 172.21.15.178:0/1801711214 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c005a450 con 0x563125a0e640 2024-09-21T09:05:03.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.860+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563125b93860 con 0x563125a0e640 2024-09-21T09:05:03.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.860+0000 7f53b7fff640 1 -- 172.21.15.178:0/1801711214 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c005a730 con 0x563125a0e640 2024-09-21T09:05:03.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.860+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563125b93de0 con 0x563125a0e640 2024-09-21T09:05:03.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.861+0000 7f53b7fff640 1 -- 172.21.15.178:0/1801711214 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f54c0076070 con 0x563125a0e640 2024-09-21T09:05:03.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.861+0000 7f53b7fff640 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f53b8036b40 0x7f53b8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.861+0000 7f53b7fff640 1 -- 172.21.15.178:0/1801711214 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f54c0062070 con 0x563125a0e640 2024-09-21T09:05:03.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.861+0000 7f54c7fff640 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f53b8036b40 0x7f53b8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.862+0000 7f54d412c800 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563125a9fb90 0x563125b9a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.862+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125b9a910 con 0x563125a9fb90 2024-09-21T09:05:03.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.862+0000 7f54d06b8640 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563125a9fb90 0x563125b9a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.862+0000 7f54c7fff640 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f53b8036b40 0x7f53b8039000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f54b8001e10 tx=0x7f54b8001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.862+0000 7f54d06b8640 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563125a9fb90 0x563125b9a390 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.862+0000 7f54d06b8640 1 -- 172.21.15.178:0/1801711214 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54c800a4a0 con 0x563125a9fb90 2024-09-21T09:05:03.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.862+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125b9b1d0 con 0x563125a9fb90 2024-09-21T09:05:03.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.862+0000 7f54d06b8640 1 -- 172.21.15.178:0/1801711214 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54c800a4a0 con 0x563125a9fb90 2024-09-21T09:05:03.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.863+0000 7f54d412c800 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563125b9cae0 0x563125b9ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.863+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125b9f700 con 0x563125b9cae0 2024-09-21T09:05:03.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.863+0000 7f54cfeb7640 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563125b9cae0 0x563125b9ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.863+0000 7f54cfeb7640 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563125b9cae0 0x563125b9ef70 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.863+0000 7f54cfeb7640 1 -- 172.21.15.178:0/1801711214 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f54c007f070 con 0x563125b9cae0 2024-09-21T09:05:03.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.863+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125b9ba20 con 0x563125a9fb90 2024-09-21T09:05:03.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.864+0000 7f54d06b8640 1 -- 172.21.15.178:0/1801711214 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54c800a4a0 con 0x563125a9fb90 2024-09-21T09:05:03.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.864+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125b9be00 con 0x563125a9fb90 2024-09-21T09:05:03.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.864+0000 7f54d06b8640 1 -- 172.21.15.178:0/1801711214 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f54c800a4a0 con 0x563125a9fb90 2024-09-21T09:05:03.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.864+0000 7f54d412c800 1 Processor -- start 2024-09-21T09:05:03.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.864+0000 7f54d412c800 1 -- start start 2024-09-21T09:05:03.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.864+0000 7f54d412c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bae0c0 0x563125bae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.864+0000 7f54d412c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563125935580 con 0x563125bae0c0 2024-09-21T09:05:03.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.865+0000 7f54d06b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bae0c0 0x563125bae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.865+0000 7f54d06b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bae0c0 0x563125bae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60648/0 (socket says 172.21.15.178:60648) 2024-09-21T09:05:03.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.865+0000 7f54d06b8640 1 -- 172.21.15.178:0/193399145 learned_addr learned my addr 172.21.15.178:0/193399145 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.865+0000 7f54d06b8640 1 -- 172.21.15.178:0/193399145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563125baea20 con 0x563125bae0c0 2024-09-21T09:05:03.869 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.865+0000 7f54d06b8640 1 --2- 172.21.15.178:0/193399145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bae0c0 0x563125bae4e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x563125b943d0 tx=0x7f54c80188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.865+0000 7f53b57fa640 1 -- 172.21.15.178:0/193399145 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c8014450 con 0x563125bae0c0 2024-09-21T09:05:03.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.866+0000 7f54d412c800 1 -- 172.21.15.178:0/193399145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563125baecb0 con 0x563125bae0c0 2024-09-21T09:05:03.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.866+0000 7f53b57fa640 1 -- 172.21.15.178:0/193399145 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c80145f0 con 0x563125bae0c0 2024-09-21T09:05:03.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.866+0000 7f53b57fa640 1 -- 172.21.15.178:0/193399145 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c80148d0 con 0x563125bae0c0 2024-09-21T09:05:03.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.866+0000 7f54d412c800 1 -- 172.21.15.178:0/193399145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563125bb1990 con 0x563125bae0c0 2024-09-21T09:05:03.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.866+0000 7f53b57fa640 1 -- 172.21.15.178:0/193399145 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f54c8011040 con 0x563125bae0c0 2024-09-21T09:05:03.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.866+0000 7f53b57fa640 1 --2- 172.21.15.178:0/193399145 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f53a8036b40 0x7f53a8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.867+0000 7f53b57fa640 1 -- 172.21.15.178:0/193399145 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f54c801e070 con 0x563125bae0c0 2024-09-21T09:05:03.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.867+0000 7f54cfeb7640 1 --2- 172.21.15.178:0/193399145 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f53a8036b40 0x7f53a8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.867+0000 7f54d412c800 1 Processor -- start 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.867+0000 7f54d412c800 1 -- start start 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.867+0000 7f54cfeb7640 1 --2- 172.21.15.178:0/193399145 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f53a8036b40 0x7f53a8039000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x563125b97a60 tx=0x7f54c008f220 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.867+0000 7f54d412c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bbad40 0x563125bbb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.867+0000 7f54d412c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563125b8c1e0 con 0x563125bbad40 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.867+0000 7f54d06b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bbad40 0x563125bbb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.867+0000 7f54d06b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bbad40 0x563125bbb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60660/0 (socket says 172.21.15.178:60660) 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.867+0000 7f54d06b8640 1 -- 172.21.15.178:0/1629421057 learned_addr learned my addr 172.21.15.178:0/1629421057 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.867+0000 7f54d06b8640 1 -- 172.21.15.178:0/1629421057 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563125bbb680 con 0x563125bbad40 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.868+0000 7f54d06b8640 1 --2- 172.21.15.178:0/1629421057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bbad40 0x563125bbb140 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f54c804cb90 tx=0x7f54c8011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170812c549f0d6de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.868+0000 7f53aeffd640 1 -- 172.21.15.178:0/1629421057 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c8044070 con 0x563125bbad40 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.868+0000 7f53aeffd640 1 -- 172.21.15.178:0/1629421057 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c8013c90 con 0x563125bbad40 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.868+0000 7f53aeffd640 1 -- 172.21.15.178:0/1629421057 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c802ba60 con 0x563125bbad40 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.868+0000 7f54d412c800 1 -- 172.21.15.178:0/1629421057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bbad40 msgr2=0x563125bbb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.868+0000 7f54d412c800 1 --2- 172.21.15.178:0/1629421057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bbad40 0x563125bbb140 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f54c804cb90 tx=0x7f54c8011700 comp rx=0 tx=0).stop 2024-09-21T09:05:03.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.868+0000 7f54d412c800 1 -- 172.21.15.178:0/1629421057 shutdown_connections 2024-09-21T09:05:03.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.868+0000 7f54d412c800 1 --2- 172.21.15.178:0/1629421057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bbad40 0x563125bbb140 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.868+0000 7f54d412c800 1 -- 172.21.15.178:0/1629421057 >> 172.21.15.178:0/1629421057 conn(0x563125bb70f0 msgr2=0x563125bb51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.868+0000 7f54d412c800 1 -- 172.21.15.178:0/1629421057 shutdown_connections 2024-09-21T09:05:03.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.868+0000 7f54d412c800 1 -- 172.21.15.178:0/1629421057 wait complete. 2024-09-21T09:05:03.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.869+0000 7f54d412c800 1 Processor -- start 2024-09-21T09:05:03.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.869+0000 7f54d412c800 1 -- start start 2024-09-21T09:05:03.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.869+0000 7f54d412c800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bbad40 0x563125bc2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.869+0000 7f54d412c800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563125bbbd20 con 0x563125bbad40 2024-09-21T09:05:03.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.869+0000 7f54d06b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bbad40 0x563125bc2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.869+0000 7f54d06b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bbad40 0x563125bc2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60668/0 (socket says 172.21.15.178:60668) 2024-09-21T09:05:03.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.869+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 learned_addr learned my addr 172.21.15.178:0/2121348757 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.869+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563125bc26c0 con 0x563125bbad40 2024-09-21T09:05:03.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.869+0000 7f54d06b8640 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bbad40 0x563125bc2180 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f54c8016ad0 tx=0x7f54c804cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.869+0000 7f53ad7fa640 1 -- 172.21.15.178:0/2121348757 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c804e2e0 con 0x563125bbad40 2024-09-21T09:05:03.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.870+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563125bc2950 con 0x563125bbad40 2024-09-21T09:05:03.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.870+0000 7f53ad7fa640 1 -- 172.21.15.178:0/2121348757 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c804e480 con 0x563125bbad40 2024-09-21T09:05:03.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.870+0000 7f53ad7fa640 1 -- 172.21.15.178:0/2121348757 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c802b4a0 con 0x563125bbad40 2024-09-21T09:05:03.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.870+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563125bc5600 con 0x563125bbad40 2024-09-21T09:05:03.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.870+0000 7f53ad7fa640 1 -- 172.21.15.178:0/2121348757 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f54c803e020 con 0x563125bbad40 2024-09-21T09:05:03.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.870+0000 7f53ad7fa640 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5398036b40 0x7f5398039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.871+0000 7f53ad7fa640 1 -- 172.21.15.178:0/2121348757 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f54c803c020 con 0x563125bbad40 2024-09-21T09:05:03.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.871+0000 7f54cfeb7640 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5398036b40 0x7f5398039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.871+0000 7f54cfeb7640 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5398036b40 0x7f5398039000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x563125b9fb00 tx=0x7f54c0091000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.871+0000 7f54d412c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.871+0000 7f54d412c800 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563125bcdea0 0x563125bd0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.871+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125bd0ab0 con 0x563125bcdea0 2024-09-21T09:05:03.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.871+0000 7f54c7fff640 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563125bcdea0 0x563125bd0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54c7fff640 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563125bcdea0 0x563125bd0360 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54b800bdb0 con 0x563125bcdea0 2024-09-21T09:05:03.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54d412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54d412c800 20 realm 2024-09-21T09:05:03.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54d412c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125bcd2f0 con 0x563125bcdea0 2024-09-21T09:05:03.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54b800bdb0 con 0x563125bcdea0 2024-09-21T09:05:03.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54d412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54d412c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:03.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54d412c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125bd15a0 con 0x563125bcdea0 2024-09-21T09:05:03.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54b800bdb0 con 0x563125bcdea0 2024-09-21T09:05:03.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54d412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54d412c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125bd1e70 con 0x563125bcdea0 2024-09-21T09:05:03.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54b800bdb0 con 0x563125bcdea0 2024-09-21T09:05:03.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54d412c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:03.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54d412c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.872+0000 7f54d412c800 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563125bd27b0 0x563125bd4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.873+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd27b0 2024-09-21T09:05:03.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.873+0000 7f54d06b8640 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563125bd27b0 0x563125bd4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.873+0000 7f54d06b8640 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563125bd27b0 0x563125bd4be0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.874+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.874+0000 7f54d412c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:03.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.874+0000 7f54d412c800 20 searching for the correct realm 2024-09-21T09:05:03.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.874+0000 7f54d412c800 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563125bd7340 0x563125bd9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.874+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd9ed0 con 0x563125bd7340 2024-09-21T09:05:03.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.874+0000 7f54cfeb7640 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563125bd7340 0x563125bd9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.874+0000 7f54cfeb7640 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563125bd7340 0x563125bd9800 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.874+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.874+0000 7f54cfeb7640 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f54c0078070 0x7f54c008f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.874+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd9ed0 con 0x7f54c0078070 2024-09-21T09:05:03.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.874+0000 7f54c7fff640 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f54c0078070 0x7f54c008f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.875+0000 7f54c7fff640 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f54c0078070 0x7f54c008f670 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.875+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b800bdb0 con 0x7f54c0078070 2024-09-21T09:05:03.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.875+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd9ed0 con 0x563125bd27b0 2024-09-21T09:05:03.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.875+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.875+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bcdea0 2024-09-21T09:05:03.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.875+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b800bdb0 con 0x563125bcdea0 2024-09-21T09:05:03.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.875+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bcdea0 2024-09-21T09:05:03.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.876+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.876+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd27b0 2024-09-21T09:05:03.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.876+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.876+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd27b0 2024-09-21T09:05:03.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.876+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.876+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x7f54c0078070 2024-09-21T09:05:03.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.876+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b802a040 con 0x7f54c0078070 2024-09-21T09:05:03.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.876+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd7340 2024-09-21T09:05:03.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.877+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.877+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bcdea0 2024-09-21T09:05:03.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.877+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.877+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd27b0 2024-09-21T09:05:03.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.877+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.877+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bcdea0 2024-09-21T09:05:03.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.877+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.877+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x7f54c0078070 2024-09-21T09:05:03.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.878+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f54b802a040 con 0x7f54c0078070 2024-09-21T09:05:03.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.878+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd7340 2024-09-21T09:05:03.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.878+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.878+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd7340 2024-09-21T09:05:03.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.878+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.878+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd27b0 2024-09-21T09:05:03.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.878+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.878+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd7340 2024-09-21T09:05:03.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.879+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.879+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd7340 2024-09-21T09:05:03.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.879+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.879+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bcdea0 2024-09-21T09:05:03.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.879+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.879+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bcdea0 2024-09-21T09:05:03.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.879+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.879+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd27b0 2024-09-21T09:05:03.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.880+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.880+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd7340 2024-09-21T09:05:03.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.880+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.880+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x7f54c0078070 2024-09-21T09:05:03.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.880+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b802a040 con 0x7f54c0078070 2024-09-21T09:05:03.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.880+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bcdea0 2024-09-21T09:05:03.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.880+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.880+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd27b0 2024-09-21T09:05:03.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.881+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.881+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd7340 2024-09-21T09:05:03.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.881+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.881+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x7f54c0078070 2024-09-21T09:05:03.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.881+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b802a040 con 0x7f54c0078070 2024-09-21T09:05:03.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.881+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x7f54c0078070 2024-09-21T09:05:03.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.881+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b802a040 con 0x7f54c0078070 2024-09-21T09:05:03.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.881+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd7340 2024-09-21T09:05:03.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bd27b0 2024-09-21T09:05:03.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x563125bcdea0 2024-09-21T09:05:03.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5370 con 0x7f54c0078070 2024-09-21T09:05:03.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b802a040 con 0x7f54c0078070 2024-09-21T09:05:03.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54d412c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:03.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54d412c800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:03.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54d412c800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:03.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54d412c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:03.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54d412c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:03.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54d412c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:03.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54d412c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.882+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125bd5c30 con 0x563125bcdea0 2024-09-21T09:05:03.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125bd6020 con 0x563125bcdea0 2024-09-21T09:05:03.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:03.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125bd6440 con 0x563125bcdea0 2024-09-21T09:05:03.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:03.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 20 zone default found 2024-09-21T09:05:03.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 4 Realm: () 2024-09-21T09:05:03.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:03.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:03.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:03.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 20 zonegroup default 2024-09-21T09:05:03.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125bda350 con 0x563125bd27b0 2024-09-21T09:05:03.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.883+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125bdc100 con 0x563125bd7340 2024-09-21T09:05:03.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.884+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.884+0000 7f54d412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.884+0000 7f54d412c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.884+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125bdc570 con 0x563125bd7340 2024-09-21T09:05:03.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.884+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.884+0000 7f54d412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.884+0000 7f54d412c800 20 started sync module instance, tier type = 2024-09-21T09:05:03.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.884+0000 7f54d412c800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:03.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.884+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125bdb570 con 0x7f54c0078070 2024-09-21T09:05:03.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.885+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x7f54c0078070 2024-09-21T09:05:03.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.885+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94769086577264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125bdb570 con 0x7f54c0078070 2024-09-21T09:05:03.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.885+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125bdd0a0 con 0x563125bcdea0 2024-09-21T09:05:03.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.886+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94769086577264] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x7f54c0078070 2024-09-21T09:05:03.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.886+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.886+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94769086581616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125bdb570 con 0x563125bcdea0 2024-09-21T09:05:03.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.886+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125bddb30 con 0x563125bd7340 2024-09-21T09:05:03.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.887+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94769086581616] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.888+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.888+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94769086574784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125bdb4e0 con 0x563125bd7340 2024-09-21T09:05:03.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.888+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125bdea20 con 0x7f54c0078070 2024-09-21T09:05:03.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.889+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94769086574784] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.889+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x7f54c0078070 2024-09-21T09:05:03.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.889+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94769086588272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125bdee40 con 0x7f54c0078070 2024-09-21T09:05:03.900 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.889+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125bdf800 con 0x563125bcdea0 2024-09-21T09:05:03.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.890+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94769086588272] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x7f54c0078070 2024-09-21T09:05:03.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.890+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.890+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94769086589808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125bdf800 con 0x563125bcdea0 2024-09-21T09:05:03.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.890+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125be01c0 con 0x563125bd27b0 2024-09-21T09:05:03.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.891+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.891+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94769086594320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125be0130 con 0x563125bd27b0 2024-09-21T09:05:03.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.891+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125be1190 con 0x563125bd27b0 2024-09-21T09:05:03.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.891+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94769086589808] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.892+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(56 notify.6 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.892+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94769086598272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125be1150 con 0x563125bd27b0 2024-09-21T09:05:03.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.892+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125be1ba0 con 0x563125bd27b0 2024-09-21T09:05:03.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.892+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94769086594320] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.893+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94769086598272] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.893+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.893+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94769086591824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125be1b60 con 0x563125bd27b0 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.893+0000 7f54d412c800 20 add_watcher() i=0 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.893+0000 7f54d412c800 20 add_watcher() i=1 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.893+0000 7f54d412c800 20 add_watcher() i=2 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.893+0000 7f54d412c800 20 add_watcher() i=3 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.893+0000 7f54d412c800 20 add_watcher() i=4 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.893+0000 7f54d412c800 20 add_watcher() i=5 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.893+0000 7f54d412c800 20 add_watcher() i=6 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.894+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94769086591824] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.894+0000 7f54d412c800 20 add_watcher() i=7 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.894+0000 7f54d412c800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.894+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125be0560 con 0x563125bcdea0 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.895+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.895+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94769086600848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125be0560 con 0x563125bcdea0 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.896+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94769086600848] v31'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.896+0000 7f5385fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.896+0000 7f54d412c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.896+0000 7f54d412c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.896+0000 7f54d412c800 5 note: GC not initialized 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.896+0000 7f5384fe1640 20 reqs_thread_entry: start 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.896+0000 7f54d412c800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.896+0000 7f54d412c800 20 Filter name: none 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.897+0000 7f52fe7fc640 20 reqs_thread_entry: start 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.897+0000 7f54d412c800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.897+0000 7f54d412c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.897+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125c17f10 con 0x563125bd27b0 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.897+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.897+0000 7f54d412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.897+0000 7f54d412c800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.897+0000 7f54d412c800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-21T09:05:03.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.897+0000 7f54d412c800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-21T09:05:03.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.897+0000 7f54d412c800 20 rados->read ofs=0 len=0 2024-09-21T09:05:03.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.897+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125c16550 con 0x563125bd7340 2024-09-21T09:05:03.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.898+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.898+0000 7f54d412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:03.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.898+0000 7f54d412c800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-21T09:05:03.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.898+0000 7f54d412c800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-21T09:05:03.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.898+0000 7f54d412c800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-21T09:05:03.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.898+0000 7f54d412c800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-21T09:05:03.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.898+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125c17040 con 0x563125bd27b0 2024-09-21T09:05:03.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.899+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v31'9 uv9 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.899+0000 7f54d412c800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-21T09:05:03.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.899+0000 7f54d412c800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-21T09:05:03.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.899+0000 7f54d412c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-21T09:05:03.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.899+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94769086820352 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125c1b9b0 con 0x7f54c0078070 2024-09-21T09:05:03.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.899+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== watch-notify(notify (1) cookie 94769086577264 notify 133143986209 ret 0) ==== 575+0+0 (crc 0 0 0) 0x563125959b30 con 0x7f54c0078070 2024-09-21T09:05:03.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.899+0000 7f53aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986209 cookie 94769086577264 notifier 4847 bl.length()=533 2024-09-21T09:05:03.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.899+0000 7f53aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-21T09:05:03.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.899+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(65 notify.0 [notify cookie 94769086820352 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54b802a040 con 0x7f54c0078070 2024-09-21T09:05:03.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.899+0000 7f53aeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-21T09:05:03.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.899+0000 7f53aeffd640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5394003ea0 con 0x7f54c0078070 2024-09-21T09:05:03.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.899+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x7f54c0078070 2024-09-21T09:05:03.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.899+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== watch-notify(notify_complete (2) cookie 94769086820352 notify 133143986209 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f54b802e520 con 0x7f54c0078070 2024-09-21T09:05:03.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.900+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125c17000 con 0x563125bd7340 2024-09-21T09:05:03.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.900+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v31'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.900+0000 7f54d412c800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-21T09:05:03.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.900+0000 7f54d412c800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-21T09:05:03.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.900+0000 7f54d412c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-21T09:05:03.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.900+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94769086829792 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563125c1bfc0 con 0x563125bcdea0 2024-09-21T09:05:03.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.901+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== watch-notify(notify (1) cookie 94769086581616 notify 133143986202 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7f54b802e520 con 0x563125bcdea0 2024-09-21T09:05:03.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.901+0000 7f53aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986202 cookie 94769086581616 notifier 4847 bl.length()=176 2024-09-21T09:05:03.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.901+0000 7f53aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-21T09:05:03.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.901+0000 7f53aeffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-21T09:05:03.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.901+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(68 notify.1 [notify cookie 94769086829792 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.901+0000 7f53aeffd640 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5394003ea0 con 0x563125bcdea0 2024-09-21T09:05:03.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.901+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify_complete (2) cookie 94769086829792 notify 133143986202 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f54b802e890 con 0x563125bcdea0 2024-09-21T09:05:03.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.901+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.911 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-21T09:05:03.898911Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:05:03.898900Z","tags":[],"group_ids":[]} 2024-09-21T09:05:03.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.902+0000 7f5385fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:03.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.902+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94769086600848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125c15c30 con 0x563125bcdea0 2024-09-21T09:05:03.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.903+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94769086600848] v31'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.903+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94769086577264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125c15c30 con 0x7f54c0078070 2024-09-21T09:05:03.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.904+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94769086577264] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x7f54c0078070 2024-09-21T09:05:03.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.904+0000 7f54d412c800 20 remove_watcher() i=0 2024-09-21T09:05:03.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.904+0000 7f54d412c800 2 removed watcher, disabling cache 2024-09-21T09:05:03.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.904+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94769086581616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125c15c30 con 0x563125bcdea0 2024-09-21T09:05:03.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.905+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94769086581616] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.905+0000 7f54d412c800 20 remove_watcher() i=1 2024-09-21T09:05:03.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.905+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94769086574784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125c15c30 con 0x563125bd7340 2024-09-21T09:05:03.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.906+0000 7f54cfeb7640 1 -- 172.21.15.178:0/2121348757 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94769086574784] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c007f070 con 0x563125bd7340 2024-09-21T09:05:03.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.906+0000 7f54d412c800 20 remove_watcher() i=2 2024-09-21T09:05:03.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.906+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94769086588272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125c15c30 con 0x7f54c0078070 2024-09-21T09:05:03.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.907+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94769086588272] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x7f54c0078070 2024-09-21T09:05:03.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.907+0000 7f54d412c800 20 remove_watcher() i=3 2024-09-21T09:05:03.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.907+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94769086589808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125c15c30 con 0x563125bcdea0 2024-09-21T09:05:03.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.908+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94769086589808] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b802a040 con 0x563125bcdea0 2024-09-21T09:05:03.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.908+0000 7f54d412c800 20 remove_watcher() i=4 2024-09-21T09:05:03.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.908+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94769086594320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125c15c30 con 0x563125bd27b0 2024-09-21T09:05:03.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.909+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94769086594320] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.909+0000 7f54d412c800 20 remove_watcher() i=5 2024-09-21T09:05:03.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.909+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94769086598272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125c15c30 con 0x563125bd27b0 2024-09-21T09:05:03.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.910+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94769086598272] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.910+0000 7f54d412c800 20 remove_watcher() i=6 2024-09-21T09:05:03.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.910+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94769086591824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563125c15c30 con 0x563125bd27b0 2024-09-21T09:05:03.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d06b8640 1 -- 172.21.15.178:0/2121348757 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94769086591824] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54c802a070 con 0x563125bd27b0 2024-09-21T09:05:03.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 20 remove_watcher() i=7 2024-09-21T09:05:03.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563125bd27b0 msgr2=0x563125bd4be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563125bd27b0 0x563125bd4be0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563125bcdea0 msgr2=0x563125bd0360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563125bcdea0 0x563125bd0360 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f54c0078070 msgr2=0x7f54c008f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f54c0078070 0x7f54c008f670 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563125bd7340 msgr2=0x563125bd9800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x563125bd7340 0x563125bd9800 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5398036b40 msgr2=0x7f5398039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5398036b40 0x7f5398039000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x563125b9fb00 tx=0x7f54c0091000 comp rx=0 tx=0).stop 2024-09-21T09:05:03.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bbad40 msgr2=0x563125bc2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 1 --2- 172.21.15.178:0/2121348757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bbad40 0x563125bc2180 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f54c8016ad0 tx=0x7f54c804cb20 comp rx=0 tx=0).stop 2024-09-21T09:05:03.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54c7fff640 1 -- 172.21.15.178:0/2121348757 reap_dead start 2024-09-21T09:05:03.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 shutdown_connections 2024-09-21T09:05:03.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.911+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 >> 172.21.15.178:0/2121348757 conn(0x563125bb70f0 msgr2=0x563125bbc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 shutdown_connections 2024-09-21T09:05:03.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/2121348757 wait complete. 2024-09-21T09:05:03.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/193399145 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f53a8036b40 msgr2=0x7f53a8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 --2- 172.21.15.178:0/193399145 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f53a8036b40 0x7f53a8039000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x563125b97a60 tx=0x7f54c008f220 comp rx=0 tx=0).stop 2024-09-21T09:05:03.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/193399145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bae0c0 msgr2=0x563125bae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 --2- 172.21.15.178:0/193399145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bae0c0 0x563125bae4e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x563125b943d0 tx=0x7f54c80188f0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/193399145 shutdown_connections 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 --2- 172.21.15.178:0/193399145 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f53a8036b40 0x7f53a8039000 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 --2- 172.21.15.178:0/193399145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125bae0c0 0x563125bae4e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/193399145 >> 172.21.15.178:0/193399145 conn(0x563125ba3050 msgr2=0x563125ba5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/193399145 shutdown_connections 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/193399145 wait complete. 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563125b9cae0 msgr2=0x563125b9ef70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563125b9cae0 0x563125b9ef70 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563125a9fb90 msgr2=0x563125b9a390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563125a9fb90 0x563125b9a390 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f53b8036b40 msgr2=0x7f53b8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f53b8036b40 0x7f53b8039000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f54b8001e10 tx=0x7f54b8001390 comp rx=0 tx=0).stop 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 msgr2=0x563125b93320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125b93320 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f54c0067040 tx=0x7f54c0002fb0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 shutdown_connections 2024-09-21T09:05:03.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x563125b9cae0 0x563125b9ef70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x563125a9fb90 0x563125b9a390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f53b8036b40 0x7f53b8039000 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 --2- 172.21.15.178:0/1801711214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563125a0e640 0x563125b93320 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 >> 172.21.15.178:0/1801711214 conn(0x563125a94de0 msgr2=0x563125b85d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.912+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 shutdown_connections 2024-09-21T09:05:03.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.913+0000 7f54d412c800 1 -- 172.21.15.178:0/1801711214 wait complete. 2024-09-21T09:05:03.923 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-21T09:05:03.898911Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.898900Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:03.923 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-21T09:05:03.898911Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.898900Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:03.923 ERROR:root:0 2024-09-21T09:05:03.924 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:03.928 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:03.928 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-21T09:05:03.929 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-21T09:05:03.929 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-21T09:05:03.972 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:03.972 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:03.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.971+0000 7f194440f800 1 Processor -- start 2024-09-21T09:05:03.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.972+0000 7f194440f800 1 -- start start 2024-09-21T09:05:03.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.972+0000 7f194440f800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x562332440550 0x562332440950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.972+0000 7f194440f800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562332300b30 con 0x562332440e90 2024-09-21T09:05:03.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.972+0000 7f194440f800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5623322e2360 con 0x562332440550 2024-09-21T09:05:03.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.972+0000 7f1941f03640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x562332440550 0x562332440950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.972+0000 7f1939702640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x562332440e90 0x562332445a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40520/0 (socket says 172.21.15.178:40520) 2024-09-21T09:05:03.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.972+0000 7f1939702640 1 -- 172.21.15.178:0/1641296407 learned_addr learned my addr 172.21.15.178:0/1641296407 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:05:03.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.972+0000 7f1941f03640 1 -- 172.21.15.178:0/1641296407 >> v1:172.21.15.44:6789/0 conn(0x562332440e90 legacy=0x562332445a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.972+0000 7f1941f03640 1 -- 172.21.15.178:0/1641296407 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562332308e00 con 0x562332440550 2024-09-21T09:05:03.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.974+0000 7f1941f03640 1 --2- 172.21.15.178:0/1641296407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332440950 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f193400a470 tx=0x7f1934045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac906f7bcad593a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.974+0000 7f1941702640 1 -- 172.21.15.178:0/1641296407 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1934053570 con 0x562332440550 2024-09-21T09:05:03.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.974+0000 7f1941702640 1 -- 172.21.15.178:0/1641296407 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1934058070 con 0x562332440550 2024-09-21T09:05:03.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.974+0000 7f1941702640 1 -- 172.21.15.178:0/1641296407 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1934053880 con 0x562332440550 2024-09-21T09:05:03.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.975+0000 7f194440f800 1 -- 172.21.15.178:0/1641296407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 msgr2=0x562332440950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.975+0000 7f194440f800 1 --2- 172.21.15.178:0/1641296407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332440950 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f193400a470 tx=0x7f1934045a20 comp rx=0 tx=0).stop 2024-09-21T09:05:03.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.975+0000 7f194440f800 1 -- 172.21.15.178:0/1641296407 shutdown_connections 2024-09-21T09:05:03.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.975+0000 7f194440f800 1 --2- 172.21.15.178:0/1641296407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332440950 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.975+0000 7f194440f800 1 -- 172.21.15.178:0/1641296407 >> 172.21.15.178:0/1641296407 conn(0x56233243bde0 msgr2=0x56233243e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.975+0000 7f194440f800 1 -- 172.21.15.178:0/1641296407 shutdown_connections 2024-09-21T09:05:03.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.975+0000 7f194440f800 1 -- 172.21.15.178:0/1641296407 wait complete. 2024-09-21T09:05:03.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.988+0000 7f194440f800 1 Processor -- start 2024-09-21T09:05:03.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.989+0000 7f194440f800 1 -- start start 2024-09-21T09:05:03.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.989+0000 7f194440f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332530890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.989+0000 7f194440f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56233238d330 con 0x562332440550 2024-09-21T09:05:03.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.989+0000 7f1941f03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332530890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.989+0000 7f1941f03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332530890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60696/0 (socket says 172.21.15.178:60696) 2024-09-21T09:05:03.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.989+0000 7f1941f03640 1 -- 172.21.15.178:0/2447160984 learned_addr learned my addr 172.21.15.178:0/2447160984 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.989+0000 7f1941f03640 1 -- 172.21.15.178:0/2447160984 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623322dabc0 con 0x562332440550 2024-09-21T09:05:03.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.989+0000 7f1941f03640 1 --2- 172.21.15.178:0/2447160984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332530890 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1934025c20 tx=0x7f1934051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bf68335da7d4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.990+0000 7f182fe07640 1 -- 172.21.15.178:0/2447160984 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f193405c580 con 0x562332440550 2024-09-21T09:05:03.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.990+0000 7f182fe07640 1 -- 172.21.15.178:0/2447160984 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1934063030 con 0x562332440550 2024-09-21T09:05:03.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.990+0000 7f182fe07640 1 -- 172.21.15.178:0/2447160984 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f193405c850 con 0x562332440550 2024-09-21T09:05:03.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.990+0000 7f194440f800 1 -- 172.21.15.178:0/2447160984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 msgr2=0x562332530890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:03.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.990+0000 7f194440f800 1 --2- 172.21.15.178:0/2447160984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332530890 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1934025c20 tx=0x7f1934051000 comp rx=0 tx=0).stop 2024-09-21T09:05:03.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.990+0000 7f194440f800 1 -- 172.21.15.178:0/2447160984 shutdown_connections 2024-09-21T09:05:03.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.990+0000 7f194440f800 1 --2- 172.21.15.178:0/2447160984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332530890 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:03.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.990+0000 7f194440f800 1 -- 172.21.15.178:0/2447160984 >> 172.21.15.178:0/2447160984 conn(0x56233243bde0 msgr2=0x56233252ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:03.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.990+0000 7f194440f800 1 -- 172.21.15.178:0/2447160984 shutdown_connections 2024-09-21T09:05:03.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.990+0000 7f194440f800 1 -- 172.21.15.178:0/2447160984 wait complete. 2024-09-21T09:05:03.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.991+0000 7f194440f800 1 Processor -- start 2024-09-21T09:05:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.991+0000 7f194440f800 1 -- start start 2024-09-21T09:05:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.991+0000 7f194440f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332538170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.991+0000 7f194440f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562332447570 con 0x562332440550 2024-09-21T09:05:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.991+0000 7f1941f03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332538170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.991+0000 7f1941f03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332538170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60706/0 (socket says 172.21.15.178:60706) 2024-09-21T09:05:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.991+0000 7f1941f03640 1 -- 172.21.15.178:0/2721342630 learned_addr learned my addr 172.21.15.178:0/2721342630 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.991+0000 7f1941f03640 1 -- 172.21.15.178:0/2721342630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623322eefe0 con 0x562332440550 2024-09-21T09:05:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.992+0000 7f1941f03640 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332538170 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f193400a330 tx=0x7f1934002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.992+0000 7f182e604640 1 -- 172.21.15.178:0/2721342630 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f193406c030 con 0x562332440550 2024-09-21T09:05:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.992+0000 7f182e604640 1 -- 172.21.15.178:0/2721342630 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f193405c580 con 0x562332440550 2024-09-21T09:05:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.992+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623325386b0 con 0x562332440550 2024-09-21T09:05:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.992+0000 7f182e604640 1 -- 172.21.15.178:0/2721342630 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f193405c860 con 0x562332440550 2024-09-21T09:05:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.992+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562332538c30 con 0x562332440550 2024-09-21T09:05:03.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.993+0000 7f182e604640 1 -- 172.21.15.178:0/2721342630 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1934053440 con 0x562332440550 2024-09-21T09:05:03.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.993+0000 7f182e604640 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1828036b40 0x7f1828039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.993+0000 7f182e604640 1 -- 172.21.15.178:0/2721342630 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f1934070020 con 0x562332440550 2024-09-21T09:05:03.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.993+0000 7f1939702640 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1828036b40 0x7f1828039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.993+0000 7f194440f800 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562332440e90 0x56233253f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:03.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.993+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56233253f720 con 0x562332440e90 2024-09-21T09:05:03.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.993+0000 7f1942704640 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562332440e90 0x56233253f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:03.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.993+0000 7f1939702640 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1828036b40 0x7f1828039000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f192c000f60 tx=0x7f192c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.993+0000 7f1942704640 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562332440e90 0x56233253f1e0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:03.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.994+0000 7f1942704640 1 -- 172.21.15.178:0/2721342630 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f193c00a4a0 con 0x562332440e90 2024-09-21T09:05:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.994+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56233253c7b0 con 0x562332440e90 2024-09-21T09:05:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.994+0000 7f1942704640 1 -- 172.21.15.178:0/2721342630 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f193c00a4a0 con 0x562332440e90 2024-09-21T09:05:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.994+0000 7f194440f800 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562332541a70 0x562332543e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.994+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562332544500 con 0x562332541a70 2024-09-21T09:05:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.994+0000 7f1941f03640 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562332541a70 0x562332543e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.995+0000 7f1941f03640 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562332541a70 0x562332543e60 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.995+0000 7f1941f03640 1 -- 172.21.15.178:0/2721342630 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f193407b070 con 0x562332541a70 2024-09-21T09:05:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.995+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562332540910 con 0x562332440e90 2024-09-21T09:05:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.995+0000 7f1942704640 1 -- 172.21.15.178:0/2721342630 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f193c00a4a0 con 0x562332440e90 2024-09-21T09:05:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.995+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562332540df0 con 0x562332440e90 2024-09-21T09:05:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.996+0000 7f1942704640 1 -- 172.21.15.178:0/2721342630 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f193c00a4a0 con 0x562332440e90 2024-09-21T09:05:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.996+0000 7f194440f800 1 Processor -- start 2024-09-21T09:05:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.996+0000 7f194440f800 1 -- start start 2024-09-21T09:05:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.996+0000 7f194440f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332552ec0 0x5623325532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.996+0000 7f194440f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5623322dc580 con 0x562332552ec0 2024-09-21T09:05:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.996+0000 7f1942704640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332552ec0 0x5623325532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.996+0000 7f1942704640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332552ec0 0x5623325532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60722/0 (socket says 172.21.15.178:60722) 2024-09-21T09:05:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.996+0000 7f1942704640 1 -- 172.21.15.178:0/3076421844 learned_addr learned my addr 172.21.15.178:0/3076421844 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.997+0000 7f1942704640 1 -- 172.21.15.178:0/3076421844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562332553820 con 0x562332552ec0 2024-09-21T09:05:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.997+0000 7f1942704640 1 --2- 172.21.15.178:0/3076421844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332552ec0 0x5623325532e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x562332539390 tx=0x7f193c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.997+0000 7f18277fe640 1 -- 172.21.15.178:0/3076421844 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f193c014450 con 0x562332552ec0 2024-09-21T09:05:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.997+0000 7f18277fe640 1 -- 172.21.15.178:0/3076421844 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f193c0145f0 con 0x562332552ec0 2024-09-21T09:05:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.997+0000 7f18277fe640 1 -- 172.21.15.178:0/3076421844 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f193c0148d0 con 0x562332552ec0 2024-09-21T09:05:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.997+0000 7f194440f800 1 -- 172.21.15.178:0/3076421844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562332553ab0 con 0x562332552ec0 2024-09-21T09:05:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.997+0000 7f194440f800 1 -- 172.21.15.178:0/3076421844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562332556790 con 0x562332552ec0 2024-09-21T09:05:04.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.998+0000 7f18277fe640 1 -- 172.21.15.178:0/3076421844 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f193c011040 con 0x562332552ec0 2024-09-21T09:05:04.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.998+0000 7f18277fe640 1 --2- 172.21.15.178:0/3076421844 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f181c036b90 0x7f181c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.998+0000 7f18277fe640 1 -- 172.21.15.178:0/3076421844 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f193c01e070 con 0x562332552ec0 2024-09-21T09:05:04.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.998+0000 7f1941f03640 1 --2- 172.21.15.178:0/3076421844 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f181c036b90 0x7f181c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.998+0000 7f194440f800 1 Processor -- start 2024-09-21T09:05:04.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.998+0000 7f194440f800 1 -- start start 2024-09-21T09:05:04.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.998+0000 7f1941f03640 1 --2- 172.21.15.178:0/3076421844 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f181c036b90 0x7f181c039050 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x56233253fb90 tx=0x7f1934008310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.999+0000 7f194440f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56233255fb10 0x56233255ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.999+0000 7f194440f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562332530fe0 con 0x56233255fb10 2024-09-21T09:05:04.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.999+0000 7f1942704640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56233255fb10 0x56233255ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.999+0000 7f1942704640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56233255fb10 0x56233255ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60736/0 (socket says 172.21.15.178:60736) 2024-09-21T09:05:04.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.999+0000 7f1942704640 1 -- 172.21.15.178:0/1237368027 learned_addr learned my addr 172.21.15.178:0/1237368027 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.999+0000 7f1942704640 1 -- 172.21.15.178:0/1237368027 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623325604e0 con 0x56233255fb10 2024-09-21T09:05:04.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.999+0000 7f1942704640 1 --2- 172.21.15.178:0/1237368027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56233255fb10 0x56233255ff10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f193c04cbb0 tx=0x7f193c011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7595476ae0b426c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.999+0000 7f18257fa640 1 -- 172.21.15.178:0/1237368027 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f193c013dc0 con 0x56233255fb10 2024-09-21T09:05:04.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.999+0000 7f18257fa640 1 -- 172.21.15.178:0/1237368027 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f193c014a70 con 0x56233255fb10 2024-09-21T09:05:04.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:03.999+0000 7f18257fa640 1 -- 172.21.15.178:0/1237368027 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f193c014d50 con 0x56233255fb10 2024-09-21T09:05:04.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.000+0000 7f194440f800 1 -- 172.21.15.178:0/1237368027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56233255fb10 msgr2=0x56233255ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.000+0000 7f194440f800 1 --2- 172.21.15.178:0/1237368027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56233255fb10 0x56233255ff10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f193c04cbb0 tx=0x7f193c011970 comp rx=0 tx=0).stop 2024-09-21T09:05:04.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.000+0000 7f194440f800 1 -- 172.21.15.178:0/1237368027 shutdown_connections 2024-09-21T09:05:04.009 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.000+0000 7f194440f800 1 --2- 172.21.15.178:0/1237368027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56233255fb10 0x56233255ff10 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.000+0000 7f194440f800 1 -- 172.21.15.178:0/1237368027 >> 172.21.15.178:0/1237368027 conn(0x56233255bec0 msgr2=0x562332559fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.000+0000 7f194440f800 1 -- 172.21.15.178:0/1237368027 shutdown_connections 2024-09-21T09:05:04.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.000+0000 7f194440f800 1 -- 172.21.15.178:0/1237368027 wait complete. 2024-09-21T09:05:04.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.000+0000 7f194440f800 1 Processor -- start 2024-09-21T09:05:04.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.000+0000 7f194440f800 1 -- start start 2024-09-21T09:05:04.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.000+0000 7f194440f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56233255fb10 0x562332566fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.000+0000 7f194440f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562332560ab0 con 0x56233255fb10 2024-09-21T09:05:04.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.001+0000 7f1942704640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56233255fb10 0x562332566fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.001+0000 7f1942704640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56233255fb10 0x562332566fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60738/0 (socket says 172.21.15.178:60738) 2024-09-21T09:05:04.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.001+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 learned_addr learned my addr 172.21.15.178:0/2441029775 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.001+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562332567510 con 0x56233255fb10 2024-09-21T09:05:04.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.001+0000 7f1942704640 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56233255fb10 0x562332566fd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f193c011be0 tx=0x7f193c04cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.001+0000 7f18137fe640 1 -- 172.21.15.178:0/2441029775 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f193c044030 con 0x56233255fb10 2024-09-21T09:05:04.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.001+0000 7f18137fe640 1 -- 172.21.15.178:0/2441029775 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f193c022a80 con 0x56233255fb10 2024-09-21T09:05:04.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.001+0000 7f18137fe640 1 -- 172.21.15.178:0/2441029775 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f193c016440 con 0x56233255fb10 2024-09-21T09:05:04.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.001+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623325677a0 con 0x56233255fb10 2024-09-21T09:05:04.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.001+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56233256a450 con 0x56233255fb10 2024-09-21T09:05:04.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.002+0000 7f18137fe640 1 -- 172.21.15.178:0/2441029775 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f193c04e0d0 con 0x56233255fb10 2024-09-21T09:05:04.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.002+0000 7f18137fe640 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f180c036b40 0x7f180c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.002+0000 7f18137fe640 1 -- 172.21.15.178:0/2441029775 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f193c045070 con 0x56233255fb10 2024-09-21T09:05:04.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.002+0000 7f1941f03640 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f180c036b40 0x7f180c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.003+0000 7f1941f03640 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f180c036b40 0x7f180c039000 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f193405ce90 tx=0x7f1934086000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.003+0000 7f194440f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.003+0000 7f194440f800 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562332572ca0 0x562332575160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.003+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5623325758b0 con 0x562332572ca0 2024-09-21T09:05:04.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.003+0000 7f1939702640 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562332572ca0 0x562332575160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.003+0000 7f1939702640 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562332572ca0 0x562332575160 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f192c009050 con 0x562332572ca0 2024-09-21T09:05:04.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 20 realm 2024-09-21T09:05:04.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5623325720f0 con 0x562332572ca0 2024-09-21T09:05:04.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f192c009050 con 0x562332572ca0 2024-09-21T09:05:04.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:04.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5623325763a0 con 0x562332572ca0 2024-09-21T09:05:04.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f192c009050 con 0x562332572ca0 2024-09-21T09:05:04.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562332576c70 con 0x562332572ca0 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f192c009050 con 0x562332572ca0 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5623325775b0 0x5623325799a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.004+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56233257a130 con 0x5623325775b0 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.005+0000 7f1942704640 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5623325775b0 0x5623325799a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.005+0000 7f1942704640 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5623325775b0 0x5623325799a0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.005+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.005+0000 7f194440f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.005+0000 7f194440f800 20 searching for the correct realm 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.005+0000 7f194440f800 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56233257c100 0x56233257e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.005+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x56233257c100 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.005+0000 7f1941f03640 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56233257c100 0x56233257e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.006+0000 7f1941f03640 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56233257c100 0x56233257e5c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.006+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.006+0000 7f1941f03640 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f193405c070 0x7f1934053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.006+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x7f193405c070 2024-09-21T09:05:04.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.006+0000 7f1939702640 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f193405c070 0x7f1934053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.006+0000 7f1939702640 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f193405c070 0x7f1934053730 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.006+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f192c009050 con 0x7f193405c070 2024-09-21T09:05:04.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.007+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x5623325775b0 2024-09-21T09:05:04.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.007+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.007+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x562332572ca0 2024-09-21T09:05:04.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.007+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f192c009050 con 0x562332572ca0 2024-09-21T09:05:04.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.007+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x562332572ca0 2024-09-21T09:05:04.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.007+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f192c029040 con 0x562332572ca0 2024-09-21T09:05:04.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.007+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x5623325775b0 2024-09-21T09:05:04.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.008+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.008+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x5623325775b0 2024-09-21T09:05:04.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.008+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.008+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x7f193405c070 2024-09-21T09:05:04.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.008+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f192c029040 con 0x7f193405c070 2024-09-21T09:05:04.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.008+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x56233257c100 2024-09-21T09:05:04.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.008+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.008+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x562332572ca0 2024-09-21T09:05:04.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.008+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f192c029040 con 0x562332572ca0 2024-09-21T09:05:04.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.009+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x5623325775b0 2024-09-21T09:05:04.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.009+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.009+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x562332572ca0 2024-09-21T09:05:04.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.009+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f192c029040 con 0x562332572ca0 2024-09-21T09:05:04.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.009+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x7f193405c070 2024-09-21T09:05:04.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.009+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f192c029040 con 0x7f193405c070 2024-09-21T09:05:04.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.009+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x56233257c100 2024-09-21T09:05:04.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.009+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.009+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x56233257c100 2024-09-21T09:05:04.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.010+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.010+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x5623325775b0 2024-09-21T09:05:04.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.010+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.010+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x56233257c100 2024-09-21T09:05:04.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.010+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.010+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x56233257c100 2024-09-21T09:05:04.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.010+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.010+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x562332572ca0 2024-09-21T09:05:04.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.011+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f192c029040 con 0x562332572ca0 2024-09-21T09:05:04.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.011+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x562332572ca0 2024-09-21T09:05:04.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.011+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f192c029040 con 0x562332572ca0 2024-09-21T09:05:04.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.011+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x5623325775b0 2024-09-21T09:05:04.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.011+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.011+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x56233257c100 2024-09-21T09:05:04.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.011+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.012+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x7f193405c070 2024-09-21T09:05:04.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.012+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f192c029040 con 0x7f193405c070 2024-09-21T09:05:04.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.012+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x562332572ca0 2024-09-21T09:05:04.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.012+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f192c029040 con 0x562332572ca0 2024-09-21T09:05:04.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.012+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x5623325775b0 2024-09-21T09:05:04.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.012+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.012+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x56233257c100 2024-09-21T09:05:04.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.013+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.013+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x7f193405c070 2024-09-21T09:05:04.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.013+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f192c029040 con 0x7f193405c070 2024-09-21T09:05:04.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.013+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x7f193405c070 2024-09-21T09:05:04.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.013+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f192c029040 con 0x7f193405c070 2024-09-21T09:05:04.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.013+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x56233257c100 2024-09-21T09:05:04.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.013+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.013+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x5623325775b0 2024-09-21T09:05:04.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x562332572ca0 2024-09-21T09:05:04.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f192c029040 con 0x562332572ca0 2024-09-21T09:05:04.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56233257ec90 con 0x7f193405c070 2024-09-21T09:05:04.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f192c029040 con 0x7f193405c070 2024-09-21T09:05:04.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f194440f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:04.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f194440f800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:04.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f194440f800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:04.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f194440f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:04.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f194440f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:04.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f194440f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:04.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f194440f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56233257ab20 con 0x562332572ca0 2024-09-21T09:05:04.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f192c029040 con 0x562332572ca0 2024-09-21T09:05:04.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f194440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f194440f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.014+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56233257b3c0 con 0x562332572ca0 2024-09-21T09:05:04.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:04.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56233257a760 con 0x562332572ca0 2024-09-21T09:05:04.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:04.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 20 zone default found 2024-09-21T09:05:04.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 4 Realm: () 2024-09-21T09:05:04.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 20 zonegroup default 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56233257f180 con 0x5623325775b0 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562332581450 con 0x56233257c100 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.015+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.016+0000 7f194440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.016+0000 7f194440f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.016+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5623325817f0 con 0x56233257c100 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.016+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.016+0000 7f194440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.016+0000 7f194440f800 20 started sync module instance, tier type = 2024-09-21T09:05:04.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.016+0000 7f194440f800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:04.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.016+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5623325808e0 con 0x7f193405c070 2024-09-21T09:05:04.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.017+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.017+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94709168475696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5623325808e0 con 0x7f193405c070 2024-09-21T09:05:04.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.017+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332582200 con 0x562332572ca0 2024-09-21T09:05:04.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.018+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94709168475696] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.018+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.018+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94709168473136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332582200 con 0x562332572ca0 2024-09-21T09:05:04.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.018+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332582c60 con 0x56233257c100 2024-09-21T09:05:04.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.019+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94709168473136] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.020+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.020+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94709168479568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332582170 con 0x56233257c100 2024-09-21T09:05:04.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.020+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332583b20 con 0x7f193405c070 2024-09-21T09:05:04.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.021+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.021+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94709168486544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5623325843c0 con 0x7f193405c070 2024-09-21T09:05:04.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.021+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332584e90 con 0x562332572ca0 2024-09-21T09:05:04.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.021+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94709168479568] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.022+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94709168486544] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.022+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.022+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94709168490880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332583ec0 con 0x562332572ca0 2024-09-21T09:05:04.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.022+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332585730 con 0x5623325775b0 2024-09-21T09:05:04.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.023+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.023+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94709168493184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332583ec0 con 0x5623325775b0 2024-09-21T09:05:04.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.023+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332586640 con 0x5623325775b0 2024-09-21T09:05:04.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.023+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94709168490880] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.025+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(56 notify.6 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.025+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94709168484432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332586600 con 0x5623325775b0 2024-09-21T09:05:04.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.025+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5623325870c0 con 0x5623325775b0 2024-09-21T09:05:04.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.025+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94709168493184] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.026+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94709168484432] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.026+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.026+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94709168495312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332586190 con 0x5623325775b0 2024-09-21T09:05:04.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.026+0000 7f194440f800 20 add_watcher() i=0 2024-09-21T09:05:04.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.026+0000 7f194440f800 20 add_watcher() i=1 2024-09-21T09:05:04.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.026+0000 7f194440f800 20 add_watcher() i=2 2024-09-21T09:05:04.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.026+0000 7f194440f800 20 add_watcher() i=3 2024-09-21T09:05:04.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.026+0000 7f194440f800 20 add_watcher() i=4 2024-09-21T09:05:04.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.026+0000 7f194440f800 20 add_watcher() i=5 2024-09-21T09:05:04.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.026+0000 7f194440f800 20 add_watcher() i=6 2024-09-21T09:05:04.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.027+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94709168495312] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.027+0000 7f194440f800 20 add_watcher() i=7 2024-09-21T09:05:04.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.027+0000 7f194440f800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:04.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.027+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56233258a1c0 con 0x562332572ca0 2024-09-21T09:05:04.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.027+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.027+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94709168499664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332587640 con 0x562332572ca0 2024-09-21T09:05:04.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.028+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94709168499664] v31'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.028+0000 7f17f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:04.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.028+0000 7f194440f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:04.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.028+0000 7f194440f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:04.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.028+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332592ac0 con 0x562332572ca0 2024-09-21T09:05:04.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.029+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.029+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332593190 con 0x5623325775b0 2024-09-21T09:05:04.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.030+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.030+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332593190 con 0x56233257c100 2024-09-21T09:05:04.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.031+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.031+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332593c70 con 0x562332572ca0 2024-09-21T09:05:04.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.032+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'246 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.032+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56233258e710 con 0x7f193405c070 2024-09-21T09:05:04.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.033+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.033+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56233258e710 con 0x56233257c100 2024-09-21T09:05:04.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.034+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'53 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.034+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594600 con 0x562332572ca0 2024-09-21T09:05:04.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.035+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.035+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5623325945c0 con 0x5623325775b0 2024-09-21T09:05:04.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.036+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.036+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5623325945c0 con 0x7f193405c070 2024-09-21T09:05:04.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.037+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.037+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5623325945c0 con 0x56233257c100 2024-09-21T09:05:04.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.038+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.038+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b50 con 0x7f193405c070 2024-09-21T09:05:04.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.039+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.039+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b30 con 0x5623325775b0 2024-09-21T09:05:04.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.040+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'35 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.040+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x7f193405c070 2024-09-21T09:05:04.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.041+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.042+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x5623325775b0 2024-09-21T09:05:04.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.043+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.043+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x562332572ca0 2024-09-21T09:05:04.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.044+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'247 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.044+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x56233257c100 2024-09-21T09:05:04.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.045+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'71 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.045+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x7f193405c070 2024-09-21T09:05:04.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.046+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.046+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x56233257c100 2024-09-21T09:05:04.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.047+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.047+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x562332572ca0 2024-09-21T09:05:04.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.048+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.048+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x562332572ca0 2024-09-21T09:05:04.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.049+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'248 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.049+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x56233257c100 2024-09-21T09:05:04.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.050+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'72 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.050+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x7f193405c070 2024-09-21T09:05:04.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.051+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.051+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x56233257c100 2024-09-21T09:05:04.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.052+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.052+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x56233257c100 2024-09-21T09:05:04.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.053+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.053+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x56233257c100 2024-09-21T09:05:04.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.054+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.054+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x56233257c100 2024-09-21T09:05:04.056 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.055+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.055+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x5623325775b0 2024-09-21T09:05:04.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.056+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.058 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.056+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x56233257c100 2024-09-21T09:05:04.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.057+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.059 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.057+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x5623325775b0 2024-09-21T09:05:04.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.058+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.060 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.058+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x56233257c100 2024-09-21T09:05:04.061 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.060+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'73 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.060+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x5623325775b0 2024-09-21T09:05:04.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.061+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.062 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.061+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332594b00 con 0x7f193405c070 2024-09-21T09:05:04.063 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.062+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.062+0000 7f17f27fc640 20 reqs_thread_entry: start 2024-09-21T09:05:04.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.062+0000 7f194440f800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:04.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.062+0000 7f194440f800 20 Filter name: none 2024-09-21T09:05:04.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.062+0000 7f1763fff640 20 reqs_thread_entry: start 2024-09-21T09:05:04.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.062+0000 7f194440f800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-21T09:05:04.064 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.062+0000 7f194440f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.062+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5623325bfac0 con 0x5623325775b0 2024-09-21T09:05:04.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.063+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.065 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.063+0000 7f194440f800 20 rados_obj.operate() r=0 bl.length=349 2024-09-21T09:05:04.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.063+0000 7f194440f800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-21T09:05:04.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.063+0000 7f194440f800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-21T09:05:04.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.063+0000 7f194440f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:05:04.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.063+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5623325c2380 con 0x5623325775b0 2024-09-21T09:05:04.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.063+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.063+0000 7f194440f800 10 removing key index: system_akey 2024-09-21T09:05:04.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.063+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5623325c0360 con 0x56233257c100 2024-09-21T09:05:04.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.064+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(96 system_akey [delete] v31'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.064+0000 7f194440f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-21T09:05:04.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.064+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94709168737984 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5623325c27a0 con 0x562332572ca0 2024-09-21T09:05:04.067 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.065+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== watch-notify(notify (1) cookie 94709168473136 notify 133143986203 ret 0) ==== 203+0+0 (crc 0 0 0) 0x562332592a80 con 0x562332572ca0 2024-09-21T09:05:04.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.065+0000 7f18257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986203 cookie 94709168473136 notifier 4854 bl.length()=161 2024-09-21T09:05:04.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.065+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(97 notify.1 [notify cookie 94709168737984 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.065+0000 7f18257fa640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f1804003d60 con 0x562332572ca0 2024-09-21T09:05:04.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.065+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.065+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== watch-notify(notify_complete (2) cookie 94709168737984 notify 133143986203 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56233258e090 con 0x562332572ca0 2024-09-21T09:05:04.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.065+0000 7f194440f800 10 removing email index: 2024-09-21T09:05:04.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.065+0000 7f194440f800 10 removing user buckets index 2024-09-21T09:05:04.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.065+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5623325c0360 con 0x5623325775b0 2024-09-21T09:05:04.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.066+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(99 system_user.buckets [delete] v31'10 uv9 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.066+0000 7f194440f800 10 removing user index: system_user 2024-09-21T09:05:04.069 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.066+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5623325c4410 con 0x5623325775b0 2024-09-21T09:05:04.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.067+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(100 system_user [call,call,delete] v31'11 uv11 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.067+0000 7f194440f800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-21T09:05:04.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.067+0000 7f194440f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-21T09:05:04.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.067+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94709168750432 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5623325c4380 con 0x7f193405c070 2024-09-21T09:05:04.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.067+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== watch-notify(notify (1) cookie 94709168475696 notify 133143986210 ret 0) ==== 202+0+0 (crc 0 0 0) 0x56233258e090 con 0x7f193405c070 2024-09-21T09:05:04.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.067+0000 7f18257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986210 cookie 94709168475696 notifier 4854 bl.length()=160 2024-09-21T09:05:04.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.067+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(101 notify.0 [notify cookie 94709168750432 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.067+0000 7f18257fa640 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f1804003d60 con 0x7f193405c070 2024-09-21T09:05:04.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.068+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 21 ==== watch-notify(notify_complete (2) cookie 94709168750432 notify 133143986210 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562332592660 con 0x7f193405c070 2024-09-21T09:05:04.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.068+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 22 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.069+0000 7f17f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:04.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.069+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94709168499664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56233258d4e0 con 0x562332572ca0 2024-09-21T09:05:04.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.070+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94709168499664] v31'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.070+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94709168475696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332586bd0 con 0x7f193405c070 2024-09-21T09:05:04.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.071+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94709168475696] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.071+0000 7f194440f800 20 remove_watcher() i=0 2024-09-21T09:05:04.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.071+0000 7f194440f800 2 removed watcher, disabling cache 2024-09-21T09:05:04.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.071+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94709168473136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332580e30 con 0x562332572ca0 2024-09-21T09:05:04.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.072+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94709168473136] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.072+0000 7f194440f800 20 remove_watcher() i=1 2024-09-21T09:05:04.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.072+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94709168479568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332580430 con 0x56233257c100 2024-09-21T09:05:04.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.073+0000 7f1941f03640 1 -- 172.21.15.178:0/2441029775 <== osd.3 v2:172.21.15.178:6808/24558189 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94709168479568] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1934099070 con 0x56233257c100 2024-09-21T09:05:04.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.073+0000 7f194440f800 20 remove_watcher() i=2 2024-09-21T09:05:04.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.073+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94709168486544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332580430 con 0x7f193405c070 2024-09-21T09:05:04.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.074+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.2 v2:172.21.15.178:6816/3267136144 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94709168486544] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x7f193405c070 2024-09-21T09:05:04.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.074+0000 7f194440f800 20 remove_watcher() i=3 2024-09-21T09:05:04.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.074+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94709168490880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332580430 con 0x562332572ca0 2024-09-21T09:05:04.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.075+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94709168490880] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f192c03d040 con 0x562332572ca0 2024-09-21T09:05:04.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.075+0000 7f194440f800 20 remove_watcher() i=4 2024-09-21T09:05:04.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.075+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94709168493184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332584980 con 0x5623325775b0 2024-09-21T09:05:04.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.076+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94709168493184] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.076+0000 7f194440f800 20 remove_watcher() i=5 2024-09-21T09:05:04.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.076+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94709168484432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332580430 con 0x5623325775b0 2024-09-21T09:05:04.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.077+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94709168484432] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.077+0000 7f194440f800 20 remove_watcher() i=6 2024-09-21T09:05:04.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.077+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94709168495312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562332583050 con 0x5623325775b0 2024-09-21T09:05:04.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.078+0000 7f1942704640 1 -- 172.21.15.178:0/2441029775 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94709168495312] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f193c02a070 con 0x5623325775b0 2024-09-21T09:05:04.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.078+0000 7f194440f800 20 remove_watcher() i=7 2024-09-21T09:05:04.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5623325775b0 msgr2=0x5623325799a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5623325775b0 0x5623325799a0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562332572ca0 msgr2=0x562332575160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562332572ca0 0x562332575160 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f193405c070 msgr2=0x7f1934053730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f193405c070 0x7f1934053730 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56233257c100 msgr2=0x56233257e5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x56233257c100 0x56233257e5c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f180c036b40 msgr2=0x7f180c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f180c036b40 0x7f180c039000 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f193405ce90 tx=0x7f1934086000 comp rx=0 tx=0).stop 2024-09-21T09:05:04.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56233255fb10 msgr2=0x562332566fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56233255fb10 0x562332566fd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f193c011be0 tx=0x7f193c04cb10 comp rx=0 tx=0).stop 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f1939702640 1 -- 172.21.15.178:0/2441029775 reap_dead start 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 shutdown_connections 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 --2- 172.21.15.178:0/2441029775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56233255fb10 0x562332566fd0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 >> 172.21.15.178:0/2441029775 conn(0x56233255bec0 msgr2=0x562332561220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 shutdown_connections 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/2441029775 wait complete. 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/3076421844 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f181c036b90 msgr2=0x7f181c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 --2- 172.21.15.178:0/3076421844 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f181c036b90 0x7f181c039050 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x56233253fb90 tx=0x7f1934008310 comp rx=0 tx=0).stop 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/3076421844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332552ec0 msgr2=0x5623325532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 --2- 172.21.15.178:0/3076421844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332552ec0 0x5623325532e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x562332539390 tx=0x7f193c0188f0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/3076421844 shutdown_connections 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 --2- 172.21.15.178:0/3076421844 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f181c036b90 0x7f181c039050 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 --2- 172.21.15.178:0/3076421844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332552ec0 0x5623325532e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/3076421844 >> 172.21.15.178:0/3076421844 conn(0x562332547e50 msgr2=0x56233254a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.084 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/3076421844 shutdown_connections 2024-09-21T09:05:04.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.079+0000 7f194440f800 1 -- 172.21.15.178:0/3076421844 wait complete. 2024-09-21T09:05:04.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562332541a70 msgr2=0x562332543e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562332541a70 0x562332543e60 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562332440e90 msgr2=0x56233253f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562332440e90 0x56233253f1e0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1828036b40 msgr2=0x7f1828039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1828036b40 0x7f1828039000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f192c000f60 tx=0x7f192c0012b0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 msgr2=0x562332538170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332538170 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f193400a330 tx=0x7f1934002fb0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 shutdown_connections 2024-09-21T09:05:04.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562332541a70 0x562332543e60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562332440e90 0x56233253f1e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f1828036b40 0x7f1828039000 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.085 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 --2- 172.21.15.178:0/2721342630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562332440550 0x562332538170 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 >> 172.21.15.178:0/2721342630 conn(0x56233243bde0 msgr2=0x56233252a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 shutdown_connections 2024-09-21T09:05:04.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.080+0000 7f194440f800 1 -- 172.21.15.178:0/2721342630 wait complete. 2024-09-21T09:05:04.090 ERROR:root:None 2024-09-21T09:05:04.090 ERROR:root:0 2024-09-21T09:05:04.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-21T09:05:04.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-21T09:05:04.090 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-21T09:05:04.144 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:04.144 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:04.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.143+0000 7f3080230800 1 Processor -- start 2024-09-21T09:05:04.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.143+0000 7f3080230800 1 -- start start 2024-09-21T09:05:04.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.143+0000 7f3080230800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5583b4ccba50 0x5583b4ccde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.143+0000 7f3080230800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5583b4b86b30 con 0x5583b4cc5970 2024-09-21T09:05:04.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.143+0000 7f3080230800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5583b4b68360 con 0x5583b4ccba50 2024-09-21T09:05:04.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.143+0000 7f307ad5f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5583b4ccba50 0x5583b4ccde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.143+0000 7f307ad5f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5583b4ccba50 0x5583b4ccde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60742/0 (socket says 172.21.15.178:60742) 2024-09-21T09:05:04.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.143+0000 7f307b560640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5583b4cc5970 0x5583b4cc5d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40534/0 (socket says 172.21.15.178:40534) 2024-09-21T09:05:04.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.143+0000 7f307ad5f640 1 -- 172.21.15.178:0/1542050234 learned_addr learned my addr 172.21.15.178:0/1542050234 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.144+0000 7f307ad5f640 1 -- 172.21.15.178:0/1542050234 >> v1:172.21.15.44:6789/0 conn(0x5583b4cc5970 legacy=0x5583b4cc5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.144+0000 7f307ad5f640 1 -- 172.21.15.178:0/1542050234 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b4b8ee00 con 0x5583b4ccba50 2024-09-21T09:05:04.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.145+0000 7f307ad5f640 1 --2- 172.21.15.178:0/1542050234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4ccba50 0x5583b4ccde40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f307000a520 tx=0x7f3070045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba17ac3867fb7de8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.145+0000 7f307a55e640 1 -- 172.21.15.178:0/1542050234 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3070055070 con 0x5583b4ccba50 2024-09-21T09:05:04.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.145+0000 7f307a55e640 1 -- 172.21.15.178:0/1542050234 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30700515b0 con 0x5583b4ccba50 2024-09-21T09:05:04.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.145+0000 7f307a55e640 1 -- 172.21.15.178:0/1542050234 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30700518d0 con 0x5583b4ccba50 2024-09-21T09:05:04.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.146+0000 7f3080230800 1 -- 172.21.15.178:0/1542050234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4ccba50 msgr2=0x5583b4ccde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.146+0000 7f3080230800 1 --2- 172.21.15.178:0/1542050234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4ccba50 0x5583b4ccde40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f307000a520 tx=0x7f3070045ba0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.146+0000 7f3080230800 1 -- 172.21.15.178:0/1542050234 shutdown_connections 2024-09-21T09:05:04.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.146+0000 7f3080230800 1 --2- 172.21.15.178:0/1542050234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4ccba50 0x5583b4ccde40 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.146+0000 7f3080230800 1 -- 172.21.15.178:0/1542050234 >> 172.21.15.178:0/1542050234 conn(0x5583b4cc1580 msgr2=0x5583b4cc39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.146+0000 7f3080230800 1 -- 172.21.15.178:0/1542050234 shutdown_connections 2024-09-21T09:05:04.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.146+0000 7f3080230800 1 -- 172.21.15.178:0/1542050234 wait complete. 2024-09-21T09:05:04.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.160+0000 7f3080230800 1 Processor -- start 2024-09-21T09:05:04.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.160+0000 7f3080230800 1 -- start start 2024-09-21T09:05:04.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.160+0000 7f3080230800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4cc5970 0x5583b4db68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.161 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.160+0000 7f3080230800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5583b4c13450 con 0x5583b4cc5970 2024-09-21T09:05:04.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.160+0000 7f307b560640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4cc5970 0x5583b4db68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.160+0000 7f307b560640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4cc5970 0x5583b4db68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60748/0 (socket says 172.21.15.178:60748) 2024-09-21T09:05:04.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.160+0000 7f307b560640 1 -- 172.21.15.178:0/836656283 learned_addr learned my addr 172.21.15.178:0/836656283 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.160+0000 7f307b560640 1 -- 172.21.15.178:0/836656283 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b4b60bc0 con 0x5583b4cc5970 2024-09-21T09:05:04.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.161+0000 7f307b560640 1 --2- 172.21.15.178:0/836656283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4cc5970 0x5583b4db68f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f306c001e40 tx=0x7f306c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788472e59d166ab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.161+0000 7f2f6960a640 1 -- 172.21.15.178:0/836656283 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f306c00e5c0 con 0x5583b4cc5970 2024-09-21T09:05:04.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.161+0000 7f2f6960a640 1 -- 172.21.15.178:0/836656283 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306c006070 con 0x5583b4cc5970 2024-09-21T09:05:04.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.161+0000 7f2f6960a640 1 -- 172.21.15.178:0/836656283 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f306c00e910 con 0x5583b4cc5970 2024-09-21T09:05:04.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.161+0000 7f3080230800 1 -- 172.21.15.178:0/836656283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4cc5970 msgr2=0x5583b4db68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.161+0000 7f3080230800 1 --2- 172.21.15.178:0/836656283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4cc5970 0x5583b4db68f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f306c001e40 tx=0x7f306c001e70 comp rx=0 tx=0).stop 2024-09-21T09:05:04.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.161+0000 7f3080230800 1 -- 172.21.15.178:0/836656283 shutdown_connections 2024-09-21T09:05:04.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.161+0000 7f3080230800 1 --2- 172.21.15.178:0/836656283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4cc5970 0x5583b4db68f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.161+0000 7f3080230800 1 -- 172.21.15.178:0/836656283 >> 172.21.15.178:0/836656283 conn(0x5583b4cc1580 msgr2=0x5583b4db22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.162+0000 7f3080230800 1 -- 172.21.15.178:0/836656283 shutdown_connections 2024-09-21T09:05:04.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.162+0000 7f3080230800 1 -- 172.21.15.178:0/836656283 wait complete. 2024-09-21T09:05:04.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.162+0000 7f3080230800 1 Processor -- start 2024-09-21T09:05:04.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.162+0000 7f3080230800 1 -- start start 2024-09-21T09:05:04.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.162+0000 7f3080230800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4cc5970 0x5583b4cc8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.162+0000 7f3080230800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5583b4cce680 con 0x5583b4cc5970 2024-09-21T09:05:04.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.162+0000 7f307b560640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4cc5970 0x5583b4cc8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.162+0000 7f307b560640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4cc5970 0x5583b4cc8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60758/0 (socket says 172.21.15.178:60758) 2024-09-21T09:05:04.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.162+0000 7f307b560640 1 -- 172.21.15.178:0/774899329 learned_addr learned my addr 172.21.15.178:0/774899329 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.162+0000 7f307b560640 1 -- 172.21.15.178:0/774899329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b4b74fe0 con 0x5583b4cc5970 2024-09-21T09:05:04.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.163+0000 7f307b560640 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4cc5970 0x5583b4cc8330 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f306c000f60 tx=0x7f306c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.163+0000 7f2f67e07640 1 -- 172.21.15.178:0/774899329 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f306c00f8d0 con 0x5583b4cc5970 2024-09-21T09:05:04.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.163+0000 7f2f67e07640 1 -- 172.21.15.178:0/774899329 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306c00fa70 con 0x5583b4cc5970 2024-09-21T09:05:04.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.163+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583b4cc6a20 con 0x5583b4cc5970 2024-09-21T09:05:04.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.163+0000 7f2f67e07640 1 -- 172.21.15.178:0/774899329 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f306c00fd90 con 0x5583b4cc5970 2024-09-21T09:05:04.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.163+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b4cc6f40 con 0x5583b4cc5970 2024-09-21T09:05:04.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.164+0000 7f2f67e07640 1 -- 172.21.15.178:0/774899329 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f306c017070 con 0x5583b4cc5970 2024-09-21T09:05:04.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.164+0000 7f2f67e07640 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f60036af0 0x7f2f60038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.164+0000 7f2f67e07640 1 -- 172.21.15.178:0/774899329 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f306c015020 con 0x5583b4cc5970 2024-09-21T09:05:04.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.164+0000 7f307ad5f640 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f60036af0 0x7f2f60038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.164+0000 7f3080230800 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5583b4ccba50 0x5583b4dc76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.164+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4dc7c20 con 0x5583b4ccba50 2024-09-21T09:05:04.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.164+0000 7f307bd61640 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5583b4ccba50 0x5583b4dc76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.164+0000 7f307ad5f640 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f60036af0 0x7f2f60038fb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3070057000 tx=0x7f3070052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.171 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.164+0000 7f307bd61640 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5583b4ccba50 0x5583b4dc76e0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.165+0000 7f307bd61640 1 -- 172.21.15.178:0/774899329 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f307400a4a0 con 0x5583b4ccba50 2024-09-21T09:05:04.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.165+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4dc8470 con 0x5583b4ccba50 2024-09-21T09:05:04.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.165+0000 7f307bd61640 1 -- 172.21.15.178:0/774899329 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f307400a4a0 con 0x5583b4ccba50 2024-09-21T09:05:04.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.165+0000 7f3080230800 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5583b4dc9ea0 0x5583b4dcc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.165+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4dccaa0 con 0x5583b4dc9ea0 2024-09-21T09:05:04.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.165+0000 7f307b560640 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5583b4dc9ea0 0x5583b4dcc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.166+0000 7f307b560640 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5583b4dc9ea0 0x5583b4dcc310 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.166+0000 7f307b560640 1 -- 172.21.15.178:0/774899329 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4dc9ea0 2024-09-21T09:05:04.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.166+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4dc8cc0 con 0x5583b4ccba50 2024-09-21T09:05:04.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.166+0000 7f307bd61640 1 -- 172.21.15.178:0/774899329 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f307400a4a0 con 0x5583b4ccba50 2024-09-21T09:05:04.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.166+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4dc90e0 con 0x5583b4ccba50 2024-09-21T09:05:04.172 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.167+0000 7f307bd61640 1 -- 172.21.15.178:0/774899329 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f307400a4a0 con 0x5583b4ccba50 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.167+0000 7f3080230800 1 Processor -- start 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.167+0000 7f3080230800 1 -- start start 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.167+0000 7f3080230800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4ddb420 0x5583b4ddb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.167+0000 7f3080230800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5583b4cc8870 con 0x5583b4ddb420 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.167+0000 7f307bd61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4ddb420 0x5583b4ddb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.167+0000 7f307bd61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4ddb420 0x5583b4ddb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60770/0 (socket says 172.21.15.178:60770) 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.167+0000 7f307bd61640 1 -- 172.21.15.178:0/3439639234 learned_addr learned my addr 172.21.15.178:0/3439639234 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.168+0000 7f307bd61640 1 -- 172.21.15.178:0/3439639234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b4ddbd80 con 0x5583b4ddb420 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.168+0000 7f307bd61640 1 --2- 172.21.15.178:0/3439639234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4ddb420 0x5583b4ddb840 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x5583b4cc8070 tx=0x7f3074012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.168+0000 7f2f65602640 1 -- 172.21.15.178:0/3439639234 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3074014450 con 0x5583b4ddb420 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.168+0000 7f2f65602640 1 -- 172.21.15.178:0/3439639234 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3074014610 con 0x5583b4ddb420 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.168+0000 7f3080230800 1 -- 172.21.15.178:0/3439639234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583b4ddc010 con 0x5583b4ddb420 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.168+0000 7f2f65602640 1 -- 172.21.15.178:0/3439639234 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3074014930 con 0x5583b4ddb420 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.168+0000 7f3080230800 1 -- 172.21.15.178:0/3439639234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b4ddecf0 con 0x5583b4ddb420 2024-09-21T09:05:04.173 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.169+0000 7f2f65602640 1 -- 172.21.15.178:0/3439639234 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3074011040 con 0x5583b4ddb420 2024-09-21T09:05:04.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.169+0000 7f2f65602640 1 --2- 172.21.15.178:0/3439639234 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f54036b40 0x7f2f54039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.169+0000 7f2f65602640 1 -- 172.21.15.178:0/3439639234 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f307401e070 con 0x5583b4ddb420 2024-09-21T09:05:04.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.169+0000 7f307b560640 1 --2- 172.21.15.178:0/3439639234 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f54036b40 0x7f2f54039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.169+0000 7f3080230800 1 Processor -- start 2024-09-21T09:05:04.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.169+0000 7f3080230800 1 -- start start 2024-09-21T09:05:04.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.169+0000 7f307b560640 1 --2- 172.21.15.178:0/3439639234 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f54036b40 0x7f2f54039000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5583b4cc74b0 tx=0x7f306c04b760 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.169+0000 7f3080230800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4de80f0 0x5583b4de84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.169+0000 7f3080230800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5583b4b62580 con 0x5583b4de80f0 2024-09-21T09:05:04.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.170+0000 7f307bd61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4de80f0 0x5583b4de84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.170+0000 7f307bd61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4de80f0 0x5583b4de84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60776/0 (socket says 172.21.15.178:60776) 2024-09-21T09:05:04.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.170+0000 7f307bd61640 1 -- 172.21.15.178:0/2951568790 learned_addr learned my addr 172.21.15.178:0/2951568790 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.170+0000 7f307bd61640 1 -- 172.21.15.178:0/2951568790 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b4de8ac0 con 0x5583b4de80f0 2024-09-21T09:05:04.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.170+0000 7f307bd61640 1 --2- 172.21.15.178:0/2951568790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4de80f0 0x5583b4de84f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f307404cd40 tx=0x7f3074011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f86b15a29b10610 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.170+0000 7f2f5effd640 1 -- 172.21.15.178:0/2951568790 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3074011c50 con 0x5583b4de80f0 2024-09-21T09:05:04.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.170+0000 7f2f5effd640 1 -- 172.21.15.178:0/2951568790 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3074011df0 con 0x5583b4de80f0 2024-09-21T09:05:04.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.170+0000 7f2f5effd640 1 -- 172.21.15.178:0/2951568790 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3074046b30 con 0x5583b4de80f0 2024-09-21T09:05:04.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.171+0000 7f3080230800 1 -- 172.21.15.178:0/2951568790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4de80f0 msgr2=0x5583b4de84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.171+0000 7f3080230800 1 --2- 172.21.15.178:0/2951568790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4de80f0 0x5583b4de84f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f307404cd40 tx=0x7f3074011700 comp rx=0 tx=0).stop 2024-09-21T09:05:04.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.171+0000 7f3080230800 1 -- 172.21.15.178:0/2951568790 shutdown_connections 2024-09-21T09:05:04.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.171+0000 7f3080230800 1 --2- 172.21.15.178:0/2951568790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4de80f0 0x5583b4de84f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.171+0000 7f3080230800 1 -- 172.21.15.178:0/2951568790 >> 172.21.15.178:0/2951568790 conn(0x5583b4de4450 msgr2=0x5583b4de2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.171+0000 7f3080230800 1 -- 172.21.15.178:0/2951568790 shutdown_connections 2024-09-21T09:05:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.171+0000 7f3080230800 1 -- 172.21.15.178:0/2951568790 wait complete. 2024-09-21T09:05:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.171+0000 7f3080230800 1 Processor -- start 2024-09-21T09:05:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.171+0000 7f3080230800 1 -- start start 2024-09-21T09:05:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.171+0000 7f3080230800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4de80f0 0x5583b4def460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.171+0000 7f3080230800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5583b4de8ff0 con 0x5583b4de80f0 2024-09-21T09:05:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.172+0000 7f307bd61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4de80f0 0x5583b4def460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.172+0000 7f307bd61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4de80f0 0x5583b4def460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60792/0 (socket says 172.21.15.178:60792) 2024-09-21T09:05:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.172+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 learned_addr learned my addr 172.21.15.178:0/1464535164 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.172+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b4def9a0 con 0x5583b4de80f0 2024-09-21T09:05:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.172+0000 7f307bd61640 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4de80f0 0x5583b4def460 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f307404cca0 tx=0x7f307404ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.172+0000 7f2f5d7fa640 1 -- 172.21.15.178:0/1464535164 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3074011c50 con 0x5583b4de80f0 2024-09-21T09:05:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.172+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583b4defc30 con 0x5583b4de80f0 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.172+0000 7f2f5d7fa640 1 -- 172.21.15.178:0/1464535164 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3074022a80 con 0x5583b4de80f0 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.172+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b4df28e0 con 0x5583b4de80f0 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.172+0000 7f2f5d7fa640 1 -- 172.21.15.178:0/1464535164 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3074011a20 con 0x5583b4de80f0 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.173+0000 7f2f5d7fa640 1 -- 172.21.15.178:0/1464535164 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f307404ea40 con 0x5583b4de80f0 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.173+0000 7f2f5d7fa640 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f44036b40 0x7f2f44039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.173+0000 7f2f5d7fa640 1 -- 172.21.15.178:0/1464535164 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f307400e040 con 0x5583b4de80f0 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.173+0000 7f307b560640 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f44036b40 0x7f2f44039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.174+0000 7f307b560640 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f44036b40 0x7f2f44039000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f306c024410 tx=0x7f306c04d000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.174+0000 7f3080230800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.174+0000 7f3080230800 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5583b4dfb120 0x5583b4dfd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.174+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4dfdd30 con 0x5583b4dfb120 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.174+0000 7f307ad5f640 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5583b4dfb120 0x5583b4dfd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.174+0000 7f307ad5f640 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5583b4dfb120 0x5583b4dfd5e0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.184 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 20 realm 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4dfe100 con 0x5583b4dfb120 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4dfe9a0 con 0x5583b4dfb120 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4dfed40 con 0x5583b4dfb120 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:04.185 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5583b4dffaa0 0x5583b4e01e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.175+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e02460 con 0x5583b4dffaa0 2024-09-21T09:05:04.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.176+0000 7f307bd61640 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5583b4dffaa0 0x5583b4e01e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.176+0000 7f307bd61640 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5583b4dffaa0 0x5583b4e01e90 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.176+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.176+0000 7f3080230800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:04.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.176+0000 7f3080230800 20 searching for the correct realm 2024-09-21T09:05:04.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.176+0000 7f3080230800 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5583b4e04460 0x5583b4e06920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.176+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4e04460 2024-09-21T09:05:04.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.176+0000 7f307b560640 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5583b4e04460 0x5583b4e06920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.177+0000 7f307b560640 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5583b4e04460 0x5583b4e06920 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.177+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.177+0000 7f307b560640 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f306c00f070 0x7f306c01d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.177+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x7f306c00f070 2024-09-21T09:05:04.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.177+0000 7f307ad5f640 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f306c00f070 0x7f306c01d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.177+0000 7f307ad5f640 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f306c00f070 0x7f306c01d5f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.178+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3070057030 con 0x7f306c00f070 2024-09-21T09:05:04.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.178+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dffaa0 2024-09-21T09:05:04.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.178+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.178+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dfb120 2024-09-21T09:05:04.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.178+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.178+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dfb120 2024-09-21T09:05:04.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.178+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.178+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dffaa0 2024-09-21T09:05:04.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.179+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.179+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dffaa0 2024-09-21T09:05:04.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.179+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.179+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x7f306c00f070 2024-09-21T09:05:04.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.179+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3070057030 con 0x7f306c00f070 2024-09-21T09:05:04.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.179+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4e04460 2024-09-21T09:05:04.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.179+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.179+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dfb120 2024-09-21T09:05:04.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.180+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.180+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dffaa0 2024-09-21T09:05:04.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.180+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.180+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dfb120 2024-09-21T09:05:04.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.180+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.180+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x7f306c00f070 2024-09-21T09:05:04.188 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.180+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3070057030 con 0x7f306c00f070 2024-09-21T09:05:04.189 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.180+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4e04460 2024-09-21T09:05:04.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.181+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.181+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4e04460 2024-09-21T09:05:04.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.181+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.181+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dffaa0 2024-09-21T09:05:04.196 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.181+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.181+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4e04460 2024-09-21T09:05:04.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.181+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.181+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4e04460 2024-09-21T09:05:04.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.182+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.182+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dfb120 2024-09-21T09:05:04.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.182+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.182+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dfb120 2024-09-21T09:05:04.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.182+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.182+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dffaa0 2024-09-21T09:05:04.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.182+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.182+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4e04460 2024-09-21T09:05:04.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.183+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.197 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.183+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x7f306c00f070 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.183+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3070057030 con 0x7f306c00f070 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.183+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dfb120 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.183+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.183+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dffaa0 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.184+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.184+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4e04460 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.184+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.184+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x7f306c00f070 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.184+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3070057030 con 0x7f306c00f070 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.184+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x7f306c00f070 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.184+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3070057030 con 0x7f306c00f070 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.184+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4e04460 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.184+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.184+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dffaa0 2024-09-21T09:05:04.198 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x5583b4dfb120 2024-09-21T09:05:04.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e06ff0 con 0x7f306c00f070 2024-09-21T09:05:04.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3070057030 con 0x7f306c00f070 2024-09-21T09:05:04.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f3080230800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:04.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f3080230800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:04.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f3080230800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:04.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f3080230800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:04.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f3080230800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:04.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f3080230800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:04.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f3080230800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e039b0 con 0x5583b4dfb120 2024-09-21T09:05:04.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.199 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f3080230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f3080230800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.185+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e03220 con 0x5583b4dfb120 2024-09-21T09:05:04.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:04.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e02960 con 0x5583b4dfb120 2024-09-21T09:05:04.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:04.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 20 zone default found 2024-09-21T09:05:04.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 4 Realm: () 2024-09-21T09:05:04.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:04.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:04.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:04.200 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 20 zonegroup default 2024-09-21T09:05:04.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e07920 con 0x5583b4dffaa0 2024-09-21T09:05:04.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.186+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e09b50 con 0x5583b4e04460 2024-09-21T09:05:04.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.187+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.187+0000 7f3080230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.187+0000 7f3080230800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.187+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e09ef0 con 0x5583b4e04460 2024-09-21T09:05:04.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.187+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.201 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.187+0000 7f3080230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.187+0000 7f3080230800 20 started sync module instance, tier type = 2024-09-21T09:05:04.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.187+0000 7f3080230800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:04.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.187+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e08fe0 con 0x7f306c00f070 2024-09-21T09:05:04.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.188+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3070057030 con 0x7f306c00f070 2024-09-21T09:05:04.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.188+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94024163693872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e08fe0 con 0x7f306c00f070 2024-09-21T09:05:04.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.188+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0a900 con 0x5583b4dfb120 2024-09-21T09:05:04.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.189+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94024163693872] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3070057030 con 0x7f306c00f070 2024-09-21T09:05:04.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.189+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.189+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94024163691792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0a900 con 0x5583b4dfb120 2024-09-21T09:05:04.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.189+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0b320 con 0x5583b4e04460 2024-09-21T09:05:04.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.190+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94024163691792] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.191+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.191+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94024163697744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0a870 con 0x5583b4e04460 2024-09-21T09:05:04.202 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.191+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0c1e0 con 0x7f306c00f070 2024-09-21T09:05:04.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.192+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94024163697744] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.192+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3070057030 con 0x7f306c00f070 2024-09-21T09:05:04.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.192+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94024163704112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0c150 con 0x7f306c00f070 2024-09-21T09:05:04.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.192+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0d0a0 con 0x5583b4dfb120 2024-09-21T09:05:04.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.193+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94024163704112] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3070057030 con 0x7f306c00f070 2024-09-21T09:05:04.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.193+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.193+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94024163706240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0d0a0 con 0x5583b4dfb120 2024-09-21T09:05:04.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.193+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0dab0 con 0x5583b4dffaa0 2024-09-21T09:05:04.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.194+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94024163706240] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.194+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.194+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94024163707888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0d010 con 0x5583b4dffaa0 2024-09-21T09:05:04.203 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.194+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0e7d0 con 0x5583b4dffaa0 2024-09-21T09:05:04.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.196+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94024163707888] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.196+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.196+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94024163712592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0e7d0 con 0x5583b4dffaa0 2024-09-21T09:05:04.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.196+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0f1f0 con 0x5583b4dffaa0 2024-09-21T09:05:04.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.197+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94024163712592] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.197+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.197+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94024163716320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0f1b0 con 0x5583b4dffaa0 2024-09-21T09:05:04.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.197+0000 7f3080230800 20 add_watcher() i=0 2024-09-21T09:05:04.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.197+0000 7f3080230800 20 add_watcher() i=1 2024-09-21T09:05:04.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.197+0000 7f3080230800 20 add_watcher() i=2 2024-09-21T09:05:04.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.197+0000 7f3080230800 20 add_watcher() i=3 2024-09-21T09:05:04.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.197+0000 7f3080230800 20 add_watcher() i=4 2024-09-21T09:05:04.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.197+0000 7f3080230800 20 add_watcher() i=5 2024-09-21T09:05:04.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.197+0000 7f3080230800 20 add_watcher() i=6 2024-09-21T09:05:04.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.198+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94024163716320] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.198+0000 7f3080230800 20 add_watcher() i=7 2024-09-21T09:05:04.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.198+0000 7f3080230800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:04.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.198+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e12670 con 0x5583b4dfb120 2024-09-21T09:05:04.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.198+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.198+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94024163713648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e0fbc0 con 0x5583b4dfb120 2024-09-21T09:05:04.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.199+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94024163713648] v31'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.199+0000 7f2f31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:04.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.199+0000 7f3080230800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:04.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.199+0000 7f3080230800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:04.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.199+0000 7f3080230800 5 note: GC not initialized 2024-09-21T09:05:04.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.199+0000 7f2f30fe1640 20 reqs_thread_entry: start 2024-09-21T09:05:04.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:04.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 20 Filter name: none 2024-09-21T09:05:04.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f2eaa7fc640 20 reqs_thread_entry: start 2024-09-21T09:05:04.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-21T09:05:04.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e45a60 con 0x5583b4e04460 2024-09-21T09:05:04.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-21T09:05:04.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-21T09:05:04.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-21T09:05:04.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e44550 con 0x5583b4e04460 2024-09-21T09:05:04.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-21T09:05:04.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-21T09:05:04.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-21T09:05:04.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-21T09:05:04.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.200+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e49050 con 0x5583b4e04460 2024-09-21T09:05:04.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.201+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v31'3 uv3 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.201+0000 7f3080230800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-21T09:05:04.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.201+0000 7f3080230800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-21T09:05:04.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.201+0000 7f3080230800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-21T09:05:04.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.201+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94024163950656 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e499a0 con 0x5583b4e04460 2024-09-21T09:05:04.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.202+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== watch-notify(notify (1) cookie 94024163697744 notify 133143986185 ret 0) ==== 584+0+0 (crc 0 0 0) 0x5583b4e44350 con 0x5583b4e04460 2024-09-21T09:05:04.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.202+0000 7f2f5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 94024163697744 notifier 4861 bl.length()=542 2024-09-21T09:05:04.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.202+0000 7f2f5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-21T09:05:04.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.202+0000 7f2f5effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-21T09:05:04.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.202+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(65 notify.2 [notify cookie 94024163950656 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.202+0000 7f2f5effd640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2f40003ea0 con 0x5583b4e04460 2024-09-21T09:05:04.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.202+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.202+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== watch-notify(notify_complete (2) cookie 94024163950656 notify 133143986185 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f306c053040 con 0x5583b4e04460 2024-09-21T09:05:04.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.202+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e474e0 con 0x5583b4e04460 2024-09-21T09:05:04.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.203+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v31'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.203+0000 7f3080230800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-21T09:05:04.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.203+0000 7f3080230800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-21T09:05:04.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.203+0000 7f3080230800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-21T09:05:04.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.203+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94024163946544 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e47450 con 0x5583b4dffaa0 2024-09-21T09:05:04.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.204+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== watch-notify(notify (1) cookie 94024163707888 notify 133143986220 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5583b4df28e0 con 0x5583b4dffaa0 2024-09-21T09:05:04.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.204+0000 7f2f5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986220 cookie 94024163707888 notifier 4861 bl.length()=175 2024-09-21T09:05:04.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.204+0000 7f2f5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-21T09:05:04.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.204+0000 7f2f5effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-21T09:05:04.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.204+0000 7f2f5effd640 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2f40003ea0 con 0x5583b4dffaa0 2024-09-21T09:05:04.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.204+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(68 notify.5 [notify cookie 94024163946544 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.204+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.204+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== watch-notify(notify_complete (2) cookie 94024163946544 notify 133143986220 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5583b4defc30 con 0x5583b4dffaa0 2024-09-21T09:05:04.214 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-21T09:05:04.201672Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:05:04.201655Z","tags":[],"group_ids":[]} 2024-09-21T09:05:04.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.205+0000 7f2f31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:04.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.205+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94024163713648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e43780 con 0x5583b4dfb120 2024-09-21T09:05:04.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.206+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94024163713648] v31'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.206+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94024163693872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e43780 con 0x7f306c00f070 2024-09-21T09:05:04.216 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.207+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94024163693872] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3070057030 con 0x7f306c00f070 2024-09-21T09:05:04.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.207+0000 7f3080230800 20 remove_watcher() i=0 2024-09-21T09:05:04.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.207+0000 7f3080230800 2 removed watcher, disabling cache 2024-09-21T09:05:04.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.207+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94024163691792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e43780 con 0x5583b4dfb120 2024-09-21T09:05:04.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.208+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94024163691792] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.208+0000 7f3080230800 20 remove_watcher() i=1 2024-09-21T09:05:04.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.208+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94024163697744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e43780 con 0x5583b4e04460 2024-09-21T09:05:04.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.209+0000 7f307b560640 1 -- 172.21.15.178:0/1464535164 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94024163697744] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306c02e070 con 0x5583b4e04460 2024-09-21T09:05:04.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.209+0000 7f3080230800 20 remove_watcher() i=2 2024-09-21T09:05:04.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.209+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94024163704112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e43780 con 0x7f306c00f070 2024-09-21T09:05:04.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.210+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94024163704112] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3070057030 con 0x7f306c00f070 2024-09-21T09:05:04.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.210+0000 7f3080230800 20 remove_watcher() i=3 2024-09-21T09:05:04.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.210+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94024163706240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e43780 con 0x5583b4dfb120 2024-09-21T09:05:04.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.211+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94024163706240] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3070057030 con 0x5583b4dfb120 2024-09-21T09:05:04.217 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.211+0000 7f3080230800 20 remove_watcher() i=4 2024-09-21T09:05:04.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.211+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94024163707888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e43780 con 0x5583b4dffaa0 2024-09-21T09:05:04.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.212+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94024163707888] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.212+0000 7f3080230800 20 remove_watcher() i=5 2024-09-21T09:05:04.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.212+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94024163712592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e43780 con 0x5583b4dffaa0 2024-09-21T09:05:04.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.213+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94024163712592] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.213+0000 7f3080230800 20 remove_watcher() i=6 2024-09-21T09:05:04.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.213+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94024163716320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583b4e43780 con 0x5583b4dffaa0 2024-09-21T09:05:04.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.214+0000 7f307bd61640 1 -- 172.21.15.178:0/1464535164 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94024163716320] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f307402a070 con 0x5583b4dffaa0 2024-09-21T09:05:04.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.214+0000 7f3080230800 20 remove_watcher() i=7 2024-09-21T09:05:04.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.214+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5583b4dffaa0 msgr2=0x5583b4e01e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.214+0000 7f3080230800 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5583b4dffaa0 0x5583b4e01e90 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.214+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5583b4dfb120 msgr2=0x5583b4dfd5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.214+0000 7f3080230800 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5583b4dfb120 0x5583b4dfd5e0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.214+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f306c00f070 msgr2=0x7f306c01d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.214+0000 7f3080230800 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f306c00f070 0x7f306c01d5f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.214+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5583b4e04460 msgr2=0x5583b4e06920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.214+0000 7f3080230800 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5583b4e04460 0x5583b4e06920 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f44036b40 msgr2=0x7f2f44039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f44036b40 0x7f2f44039000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f306c024410 tx=0x7f306c04d000 comp rx=0 tx=0).stop 2024-09-21T09:05:04.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4de80f0 msgr2=0x5583b4def460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 --2- 172.21.15.178:0/1464535164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4de80f0 0x5583b4def460 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f307404cca0 tx=0x7f307404ccd0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f307ad5f640 1 -- 172.21.15.178:0/1464535164 reap_dead start 2024-09-21T09:05:04.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 shutdown_connections 2024-09-21T09:05:04.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 >> 172.21.15.178:0/1464535164 conn(0x5583b4de4450 msgr2=0x5583b4de2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 shutdown_connections 2024-09-21T09:05:04.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/1464535164 wait complete. 2024-09-21T09:05:04.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/3439639234 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f54036b40 msgr2=0x7f2f54039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 --2- 172.21.15.178:0/3439639234 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f54036b40 0x7f2f54039000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5583b4cc74b0 tx=0x7f306c04b760 comp rx=0 tx=0).stop 2024-09-21T09:05:04.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/3439639234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4ddb420 msgr2=0x5583b4ddb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 --2- 172.21.15.178:0/3439639234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4ddb420 0x5583b4ddb840 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x5583b4cc8070 tx=0x7f3074012fd0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/3439639234 shutdown_connections 2024-09-21T09:05:04.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 --2- 172.21.15.178:0/3439639234 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f54036b40 0x7f2f54039000 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 --2- 172.21.15.178:0/3439639234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4ddb420 0x5583b4ddb840 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/3439639234 >> 172.21.15.178:0/3439639234 conn(0x5583b4dd03b0 msgr2=0x5583b4dd2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/3439639234 shutdown_connections 2024-09-21T09:05:04.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/3439639234 wait complete. 2024-09-21T09:05:04.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5583b4dc9ea0 msgr2=0x5583b4dcc310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5583b4dc9ea0 0x5583b4dcc310 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5583b4ccba50 msgr2=0x5583b4dc76e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5583b4ccba50 0x5583b4dc76e0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f60036af0 msgr2=0x7f2f60038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f60036af0 0x7f2f60038fb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3070057000 tx=0x7f3070052000 comp rx=0 tx=0).stop 2024-09-21T09:05:04.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4cc5970 msgr2=0x5583b4cc8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.215+0000 7f3080230800 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4cc5970 0x5583b4cc8330 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f306c000f60 tx=0x7f306c000bc0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.223 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.216+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 shutdown_connections 2024-09-21T09:05:04.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.216+0000 7f3080230800 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5583b4dc9ea0 0x5583b4dcc310 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.216+0000 7f3080230800 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5583b4ccba50 0x5583b4dc76e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.216+0000 7f3080230800 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f60036af0 0x7f2f60038fb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.216+0000 7f3080230800 1 --2- 172.21.15.178:0/774899329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583b4cc5970 0x5583b4cc8330 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.216+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 >> 172.21.15.178:0/774899329 conn(0x5583b4cc1580 msgr2=0x5583b4db0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.216+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 shutdown_connections 2024-09-21T09:05:04.224 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.216+0000 7f3080230800 1 -- 172.21.15.178:0/774899329 wait complete. 2024-09-21T09:05:04.226 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-21T09:05:04.201672Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:04.201655Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:04.226 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-21T09:05:04.201672Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:04.201655Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:04.226 ERROR:root:0 2024-09-21T09:05:04.227 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:04.231 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:04.231 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-21T09:05:04.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-21T09:05:04.232 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-21T09:05:04.276 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:04.276 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:04.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.275+0000 7fdc23e32800 1 Processor -- start 2024-09-21T09:05:04.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.275+0000 7fdc23e32800 1 -- start start 2024-09-21T09:05:04.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.275+0000 7fdc23e32800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55fbaab2ae90 0x55fbaabba140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.275+0000 7fdc23e32800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fbaaa76b30 con 0x55fbaabba680 2024-09-21T09:05:04.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.275+0000 7fdc23e32800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55fbaaa58360 con 0x55fbaab2ae90 2024-09-21T09:05:04.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.276+0000 7fdc1f1d6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55fbaab2ae90 0x55fbaabba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.276+0000 7fdc17fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55fbaabba680 0x55fbaabbca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40536/0 (socket says 172.21.15.178:40536) 2024-09-21T09:05:04.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.276+0000 7fdc17fff640 1 -- 172.21.15.178:0/3331833590 learned_addr learned my addr 172.21.15.178:0/3331833590 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:05:04.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.276+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/3331833590 >> v1:172.21.15.44:6789/0 conn(0x55fbaabba680 legacy=0x55fbaabbca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.276+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/3331833590 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbaaa7ee00 con 0x55fbaab2ae90 2024-09-21T09:05:04.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.278+0000 7fdc1f1d6640 1 --2- 172.21.15.178:0/3331833590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaabba140 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000a470 tx=0x7fdc10045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf63e5f4718f67af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.278+0000 7fdc1e9d5640 1 -- 172.21.15.178:0/3331833590 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc10053570 con 0x55fbaab2ae90 2024-09-21T09:05:04.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.278+0000 7fdc1e9d5640 1 -- 172.21.15.178:0/3331833590 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc10058070 con 0x55fbaab2ae90 2024-09-21T09:05:04.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.278+0000 7fdc1e9d5640 1 -- 172.21.15.178:0/3331833590 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc10053880 con 0x55fbaab2ae90 2024-09-21T09:05:04.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.278+0000 7fdc23e32800 1 -- 172.21.15.178:0/3331833590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 msgr2=0x55fbaabba140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.278+0000 7fdc23e32800 1 --2- 172.21.15.178:0/3331833590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaabba140 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000a470 tx=0x7fdc10045a20 comp rx=0 tx=0).stop 2024-09-21T09:05:04.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.278+0000 7fdc23e32800 1 -- 172.21.15.178:0/3331833590 shutdown_connections 2024-09-21T09:05:04.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.278+0000 7fdc23e32800 1 --2- 172.21.15.178:0/3331833590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaabba140 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.278+0000 7fdc23e32800 1 -- 172.21.15.178:0/3331833590 >> 172.21.15.178:0/3331833590 conn(0x55fbaabb1df0 msgr2=0x55fbaabb4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.278+0000 7fdc23e32800 1 -- 172.21.15.178:0/3331833590 shutdown_connections 2024-09-21T09:05:04.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.278+0000 7fdc23e32800 1 -- 172.21.15.178:0/3331833590 wait complete. 2024-09-21T09:05:04.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.292+0000 7fdc23e32800 1 Processor -- start 2024-09-21T09:05:04.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.292+0000 7fdc23e32800 1 -- start start 2024-09-21T09:05:04.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.292+0000 7fdc23e32800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaaca6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.292+0000 7fdc23e32800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fbaab03330 con 0x55fbaab2ae90 2024-09-21T09:05:04.296 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.293+0000 7fdc1f1d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaaca6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.293+0000 7fdc1f1d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaaca6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60810/0 (socket says 172.21.15.178:60810) 2024-09-21T09:05:04.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.293+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/3871115794 learned_addr learned my addr 172.21.15.178:0/3871115794 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.293+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/3871115794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbaaa50bc0 con 0x55fbaab2ae90 2024-09-21T09:05:04.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.293+0000 7fdc1f1d6640 1 --2- 172.21.15.178:0/3871115794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaaca6880 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdc10025c20 tx=0x7fdc10051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139c614230f938d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.293+0000 7fdb0d60a640 1 -- 172.21.15.178:0/3871115794 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1005c580 con 0x55fbaab2ae90 2024-09-21T09:05:04.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.293+0000 7fdb0d60a640 1 -- 172.21.15.178:0/3871115794 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc10063030 con 0x55fbaab2ae90 2024-09-21T09:05:04.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.293+0000 7fdb0d60a640 1 -- 172.21.15.178:0/3871115794 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1005c850 con 0x55fbaab2ae90 2024-09-21T09:05:04.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.294+0000 7fdc23e32800 1 -- 172.21.15.178:0/3871115794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 msgr2=0x55fbaaca6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.294+0000 7fdc23e32800 1 --2- 172.21.15.178:0/3871115794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaaca6880 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdc10025c20 tx=0x7fdc10051000 comp rx=0 tx=0).stop 2024-09-21T09:05:04.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.294+0000 7fdc23e32800 1 -- 172.21.15.178:0/3871115794 shutdown_connections 2024-09-21T09:05:04.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.294+0000 7fdc23e32800 1 --2- 172.21.15.178:0/3871115794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaaca6880 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.294+0000 7fdc23e32800 1 -- 172.21.15.178:0/3871115794 >> 172.21.15.178:0/3871115794 conn(0x55fbaabb1df0 msgr2=0x55fbaaca2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.297 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.294+0000 7fdc23e32800 1 -- 172.21.15.178:0/3871115794 shutdown_connections 2024-09-21T09:05:04.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.294+0000 7fdc23e32800 1 -- 172.21.15.178:0/3871115794 wait complete. 2024-09-21T09:05:04.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.294+0000 7fdc23e32800 1 Processor -- start 2024-09-21T09:05:04.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.294+0000 7fdc23e32800 1 -- start start 2024-09-21T09:05:04.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.295+0000 7fdc23e32800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaacae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.295+0000 7fdc23e32800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fbaabbe5f0 con 0x55fbaab2ae90 2024-09-21T09:05:04.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.295+0000 7fdc1f1d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaacae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.295+0000 7fdc1f1d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaacae1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60814/0 (socket says 172.21.15.178:60814) 2024-09-21T09:05:04.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.295+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/480174458 learned_addr learned my addr 172.21.15.178:0/480174458 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.298 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.295+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/480174458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbaaa64fe0 con 0x55fbaab2ae90 2024-09-21T09:05:04.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.295+0000 7fdc1f1d6640 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaacae1c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000a330 tx=0x7fdc10002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.295+0000 7fdb0be07640 1 -- 172.21.15.178:0/480174458 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1006c030 con 0x55fbaab2ae90 2024-09-21T09:05:04.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.295+0000 7fdb0be07640 1 -- 172.21.15.178:0/480174458 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1005c580 con 0x55fbaab2ae90 2024-09-21T09:05:04.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.295+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbaacae700 con 0x55fbaab2ae90 2024-09-21T09:05:04.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.295+0000 7fdb0be07640 1 -- 172.21.15.178:0/480174458 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1005c880 con 0x55fbaab2ae90 2024-09-21T09:05:04.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.296+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbaacaec80 con 0x55fbaab2ae90 2024-09-21T09:05:04.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.296+0000 7fdb0be07640 1 -- 172.21.15.178:0/480174458 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdc10053440 con 0x55fbaab2ae90 2024-09-21T09:05:04.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.296+0000 7fdb0be07640 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdb04036ce0 0x7fdb040391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.297+0000 7fdb0be07640 1 -- 172.21.15.178:0/480174458 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fdc10070020 con 0x55fbaab2ae90 2024-09-21T09:05:04.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.297+0000 7fdc17fff640 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdb04036ce0 0x7fdb040391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.297+0000 7fdc23e32800 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fbaabba680 0x55fbaacb5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.297+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacb57b0 con 0x55fbaabba680 2024-09-21T09:05:04.301 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.297+0000 7fdc1f9d7640 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fbaabba680 0x55fbaacb5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.297+0000 7fdc17fff640 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdb04036ce0 0x7fdb040391a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdc08000f60 tx=0x7fdc080012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.297+0000 7fdc1f9d7640 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fbaabba680 0x55fbaacb5230 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.297+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/480174458 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc1800a4a0 con 0x55fbaabba680 2024-09-21T09:05:04.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.297+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacb2800 con 0x55fbaabba680 2024-09-21T09:05:04.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.298+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/480174458 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc1800a4a0 con 0x55fbaabba680 2024-09-21T09:05:04.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.298+0000 7fdc23e32800 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fbaacb7b30 0x55fbaacb9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.298+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacba610 con 0x55fbaacb7b30 2024-09-21T09:05:04.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.298+0000 7fdc1f1d6640 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fbaacb7b30 0x55fbaacb9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.298+0000 7fdc1f1d6640 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fbaacb7b30 0x55fbaacb9f20 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.299+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/480174458 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacb7b30 2024-09-21T09:05:04.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.299+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacb69d0 con 0x55fbaabba680 2024-09-21T09:05:04.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.299+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/480174458 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc1800a4a0 con 0x55fbaabba680 2024-09-21T09:05:04.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.299+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacb6eb0 con 0x55fbaabba680 2024-09-21T09:05:04.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.299+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/480174458 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdc1800a4a0 con 0x55fbaabba680 2024-09-21T09:05:04.307 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.299+0000 7fdc23e32800 1 Processor -- start 2024-09-21T09:05:04.307 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.299+0000 7fdc23e32800 1 -- start start 2024-09-21T09:05:04.307 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.300+0000 7fdc23e32800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaabb7b10 0x55fbaabb6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.307 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.300+0000 7fdc23e32800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fbaaa52580 con 0x55fbaabb7b10 2024-09-21T09:05:04.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.300+0000 7fdc1f9d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaabb7b10 0x55fbaabb6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.300+0000 7fdc1f9d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaabb7b10 0x55fbaabb6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60828/0 (socket says 172.21.15.178:60828) 2024-09-21T09:05:04.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.300+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/529285047 learned_addr learned my addr 172.21.15.178:0/529285047 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.300+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/529285047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbaabb7f30 con 0x55fbaabb7b10 2024-09-21T09:05:04.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.300+0000 7fdc1f9d7640 1 --2- 172.21.15.178:0/529285047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaabb7b10 0x55fbaabb6160 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x55fbaacb5b90 tx=0x7fdc18018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.300+0000 7fdb09602640 1 -- 172.21.15.178:0/529285047 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc18014450 con 0x55fbaabb7b10 2024-09-21T09:05:04.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.300+0000 7fdb09602640 1 -- 172.21.15.178:0/529285047 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc18014610 con 0x55fbaabb7b10 2024-09-21T09:05:04.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.300+0000 7fdb09602640 1 -- 172.21.15.178:0/529285047 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc18014930 con 0x55fbaabb7b10 2024-09-21T09:05:04.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.300+0000 7fdc23e32800 1 -- 172.21.15.178:0/529285047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbaabb6760 con 0x55fbaabb7b10 2024-09-21T09:05:04.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.300+0000 7fdc23e32800 1 -- 172.21.15.178:0/529285047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbaabb6c60 con 0x55fbaabb7b10 2024-09-21T09:05:04.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.301+0000 7fdb09602640 1 -- 172.21.15.178:0/529285047 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdc18011040 con 0x55fbaabb7b10 2024-09-21T09:05:04.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.301+0000 7fdb09602640 1 --2- 172.21.15.178:0/529285047 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdaf8036b40 0x7fdaf8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.301+0000 7fdb09602640 1 -- 172.21.15.178:0/529285047 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fdc1801e070 con 0x55fbaabb7b10 2024-09-21T09:05:04.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.301+0000 7fdc1f1d6640 1 --2- 172.21.15.178:0/529285047 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdaf8036b40 0x7fdaf8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.302+0000 7fdc23e32800 1 Processor -- start 2024-09-21T09:05:04.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.302+0000 7fdc1f1d6640 1 --2- 172.21.15.178:0/529285047 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdaf8036b40 0x7fdaf8039000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55fbaacb5c80 tx=0x7fdc10067a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.302+0000 7fdc23e32800 1 -- start start 2024-09-21T09:05:04.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.302+0000 7fdc23e32800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaacd7da0 0x55fbaacd81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.302+0000 7fdc23e32800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fbaaca6fd0 con 0x55fbaacd7da0 2024-09-21T09:05:04.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.302+0000 7fdc1f9d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaacd7da0 0x55fbaacd81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.302+0000 7fdc1f9d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaacd7da0 0x55fbaacd81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60844/0 (socket says 172.21.15.178:60844) 2024-09-21T09:05:04.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.302+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/1392813061 learned_addr learned my addr 172.21.15.178:0/1392813061 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.302+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/1392813061 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbaacd8770 con 0x55fbaacd7da0 2024-09-21T09:05:04.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.303+0000 7fdc1f9d7640 1 --2- 172.21.15.178:0/1392813061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaacd7da0 0x55fbaacd81a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fdc1804ccc0 tx=0x7fdc1804ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4260ae0ea9050660 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.303+0000 7fdb02ffd640 1 -- 172.21.15.178:0/1392813061 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc18013dc0 con 0x55fbaacd7da0 2024-09-21T09:05:04.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.303+0000 7fdb02ffd640 1 -- 172.21.15.178:0/1392813061 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc18014ad0 con 0x55fbaacd7da0 2024-09-21T09:05:04.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.303+0000 7fdb02ffd640 1 -- 172.21.15.178:0/1392813061 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc18014dd0 con 0x55fbaacd7da0 2024-09-21T09:05:04.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.303+0000 7fdc23e32800 1 -- 172.21.15.178:0/1392813061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaacd7da0 msgr2=0x55fbaacd81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.303+0000 7fdc23e32800 1 --2- 172.21.15.178:0/1392813061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaacd7da0 0x55fbaacd81a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fdc1804ccc0 tx=0x7fdc1804ce00 comp rx=0 tx=0).stop 2024-09-21T09:05:04.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.303+0000 7fdc23e32800 1 -- 172.21.15.178:0/1392813061 shutdown_connections 2024-09-21T09:05:04.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.303+0000 7fdc23e32800 1 --2- 172.21.15.178:0/1392813061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaacd7da0 0x55fbaacd81a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.303+0000 7fdc23e32800 1 -- 172.21.15.178:0/1392813061 >> 172.21.15.178:0/1392813061 conn(0x55fbaacd4150 msgr2=0x55fbaacd2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.303+0000 7fdc23e32800 1 -- 172.21.15.178:0/1392813061 shutdown_connections 2024-09-21T09:05:04.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.303+0000 7fdc23e32800 1 -- 172.21.15.178:0/1392813061 wait complete. 2024-09-21T09:05:04.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.303+0000 7fdc23e32800 1 Processor -- start 2024-09-21T09:05:04.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.304+0000 7fdc23e32800 1 -- start start 2024-09-21T09:05:04.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.304+0000 7fdc23e32800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaacd7da0 0x55fbaacdf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.304+0000 7fdc23e32800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fbaacd8d40 con 0x55fbaacd7da0 2024-09-21T09:05:04.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.304+0000 7fdc1f9d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaacd7da0 0x55fbaacdf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.304+0000 7fdc1f9d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaacd7da0 0x55fbaacdf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60852/0 (socket says 172.21.15.178:60852) 2024-09-21T09:05:04.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.304+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 learned_addr learned my addr 172.21.15.178:0/816635718 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.304+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbaacdf770 con 0x55fbaacd7da0 2024-09-21T09:05:04.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.304+0000 7fdc1f9d7640 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaacd7da0 0x55fbaacdf230 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fdc180117d0 tx=0x7fdc1804cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.305+0000 7fdb017fa640 1 -- 172.21.15.178:0/816635718 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1803b070 con 0x55fbaacd7da0 2024-09-21T09:05:04.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.305+0000 7fdb017fa640 1 -- 172.21.15.178:0/816635718 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc18022dc0 con 0x55fbaacd7da0 2024-09-21T09:05:04.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.305+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbaacdfa00 con 0x55fbaacd7da0 2024-09-21T09:05:04.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.305+0000 7fdb017fa640 1 -- 172.21.15.178:0/816635718 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1802b4a0 con 0x55fbaacd7da0 2024-09-21T09:05:04.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.305+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbaace26b0 con 0x55fbaacd7da0 2024-09-21T09:05:04.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.305+0000 7fdb017fa640 1 -- 172.21.15.178:0/816635718 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdc18044020 con 0x55fbaacd7da0 2024-09-21T09:05:04.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.306+0000 7fdb017fa640 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdae8036b90 0x7fdae8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.306+0000 7fdb017fa640 1 -- 172.21.15.178:0/816635718 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fdc18033070 con 0x55fbaacd7da0 2024-09-21T09:05:04.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.306+0000 7fdc1f1d6640 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdae8036b90 0x7fdae8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.306+0000 7fdc1f1d6640 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdae8036b90 0x7fdae8039050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdc10008370 tx=0x7fdc10085000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.306+0000 7fdc23e32800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.306+0000 7fdc23e32800 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fbaaceaef0 0x55fbaaced3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.306+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacedb00 con 0x55fbaaceaef0 2024-09-21T09:05:04.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.307+0000 7fdc17fff640 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fbaaceaef0 0x55fbaaced3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.307+0000 7fdc17fff640 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fbaaceaef0 0x55fbaaced3b0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.307+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc08009050 con 0x55fbaaceaef0 2024-09-21T09:05:04.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.307+0000 7fdc23e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.307+0000 7fdc23e32800 20 realm 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.307+0000 7fdc23e32800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.307+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacea340 con 0x55fbaaceaef0 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.307+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc08009050 con 0x55fbaaceaef0 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.307+0000 7fdc23e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.307+0000 7fdc23e32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.307+0000 7fdc23e32800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.307+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacee5f0 con 0x55fbaaceaef0 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.308+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc08009050 con 0x55fbaaceaef0 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.308+0000 7fdc23e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.308+0000 7fdc23e32800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.308+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaaceeec0 con 0x55fbaaceaef0 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.308+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc08009050 con 0x55fbaaceaef0 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.308+0000 7fdc23e32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.308+0000 7fdc23e32800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.324 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.308+0000 7fdc23e32800 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fbaacef8e0 0x55fbaacf1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.308+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf23c0 con 0x55fbaacef8e0 2024-09-21T09:05:04.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.308+0000 7fdc1f9d7640 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fbaacef8e0 0x55fbaacf1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.308+0000 7fdc1f9d7640 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fbaacef8e0 0x55fbaacf1cd0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.309+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.309+0000 7fdc23e32800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:04.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.309+0000 7fdc23e32800 20 searching for the correct realm 2024-09-21T09:05:04.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.309+0000 7fdc23e32800 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fbaacf4390 0x55fbaacf6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.309+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf6f20 con 0x55fbaacf4390 2024-09-21T09:05:04.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.309+0000 7fdc1f1d6640 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fbaacf4390 0x55fbaacf6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.309+0000 7fdc1f1d6640 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fbaacf4390 0x55fbaacf6850 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.309+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.309+0000 7fdc1f1d6640 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fdc1005c070 0x7fdc10053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.309+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf6f20 con 0x7fdc1005c070 2024-09-21T09:05:04.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.310+0000 7fdc17fff640 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fdc1005c070 0x7fdc10053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.310+0000 7fdc17fff640 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fdc1005c070 0x7fdc10053730 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.310+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc08009050 con 0x7fdc1005c070 2024-09-21T09:05:04.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.310+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf6f20 con 0x55fbaacef8e0 2024-09-21T09:05:04.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.310+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.310+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf6f20 con 0x55fbaaceaef0 2024-09-21T09:05:04.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.311+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc08009050 con 0x55fbaaceaef0 2024-09-21T09:05:04.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.311+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf6f20 con 0x55fbaaceaef0 2024-09-21T09:05:04.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.311+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc08029040 con 0x55fbaaceaef0 2024-09-21T09:05:04.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.311+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf6f20 con 0x55fbaacef8e0 2024-09-21T09:05:04.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.312+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.312+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf6f20 con 0x55fbaacef8e0 2024-09-21T09:05:04.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.312+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.312+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf6f20 con 0x7fdc1005c070 2024-09-21T09:05:04.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.312+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc08029040 con 0x7fdc1005c070 2024-09-21T09:05:04.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.312+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf6f20 con 0x55fbaacf4390 2024-09-21T09:05:04.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.312+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.312+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf6f20 con 0x55fbaaceaef0 2024-09-21T09:05:04.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.313+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc08029040 con 0x55fbaaceaef0 2024-09-21T09:05:04.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.313+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf6f20 con 0x55fbaacef8e0 2024-09-21T09:05:04.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.313+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.313+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf6f20 con 0x55fbaaceaef0 2024-09-21T09:05:04.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.313+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc08029040 con 0x55fbaaceaef0 2024-09-21T09:05:04.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.313+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf6f20 con 0x7fdc1005c070 2024-09-21T09:05:04.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.313+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdc08029040 con 0x7fdc1005c070 2024-09-21T09:05:04.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.313+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf6f20 con 0x55fbaacf4390 2024-09-21T09:05:04.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.313+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.313+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x55fbaacf4390 2024-09-21T09:05:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.314+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.314+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x55fbaacef8e0 2024-09-21T09:05:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.314+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.314+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x55fbaacf4390 2024-09-21T09:05:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.314+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.314+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x55fbaacf4390 2024-09-21T09:05:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.314+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.314+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x55fbaaceaef0 2024-09-21T09:05:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.315+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdc08029040 con 0x55fbaaceaef0 2024-09-21T09:05:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.315+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x55fbaaceaef0 2024-09-21T09:05:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.315+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdc08029040 con 0x55fbaaceaef0 2024-09-21T09:05:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.315+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x55fbaacef8e0 2024-09-21T09:05:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.315+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.315+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x55fbaacf4390 2024-09-21T09:05:04.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.315+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.315+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x7fdc1005c070 2024-09-21T09:05:04.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.316+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc08029040 con 0x7fdc1005c070 2024-09-21T09:05:04.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.316+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x55fbaaceaef0 2024-09-21T09:05:04.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.316+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc08029040 con 0x55fbaaceaef0 2024-09-21T09:05:04.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.316+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x55fbaacef8e0 2024-09-21T09:05:04.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.317+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.317+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x55fbaacf4390 2024-09-21T09:05:04.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.317+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.317+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x7fdc1005c070 2024-09-21T09:05:04.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.317+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc08029040 con 0x7fdc1005c070 2024-09-21T09:05:04.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.317+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x7fdc1005c070 2024-09-21T09:05:04.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.317+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc08029040 con 0x7fdc1005c070 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.317+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x55fbaacf4390 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.317+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.317+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x55fbaacef8e0 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x55fbaaceaef0 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdc08029040 con 0x55fbaaceaef0 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc100ab040 con 0x7fdc1005c070 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc08029040 con 0x7fdc1005c070 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc23e32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc23e32800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc23e32800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc23e32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc23e32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc23e32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:04.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc23e32800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf2d80 con 0x55fbaaceaef0 2024-09-21T09:05:04.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc23e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc23e32800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.318+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf29c0 con 0x55fbaaceaef0 2024-09-21T09:05:04.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:04.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf3760 con 0x55fbaaceaef0 2024-09-21T09:05:04.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:04.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 20 zone default found 2024-09-21T09:05:04.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 4 Realm: () 2024-09-21T09:05:04.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:04.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:04.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:04.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 20 zonegroup default 2024-09-21T09:05:04.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf7430 con 0x55fbaacef8e0 2024-09-21T09:05:04.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.319+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf9700 con 0x55fbaacf4390 2024-09-21T09:05:04.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.320+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.320+0000 7fdc23e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.320+0000 7fdc23e32800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.320+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf9aa0 con 0x55fbaacf4390 2024-09-21T09:05:04.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.320+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.320+0000 7fdc23e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.320+0000 7fdc23e32800 20 started sync module instance, tier type = 2024-09-21T09:05:04.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.320+0000 7fdc23e32800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:04.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.320+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf8b90 con 0x7fdc1005c070 2024-09-21T09:05:04.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.321+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x7fdc1005c070 2024-09-21T09:05:04.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.321+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94539390881984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf8b90 con 0x7fdc1005c070 2024-09-21T09:05:04.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.321+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfa4b0 con 0x55fbaaceaef0 2024-09-21T09:05:04.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.322+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94539390881984] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x7fdc1005c070 2024-09-21T09:05:04.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.322+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.322+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94539390886368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf8b90 con 0x55fbaaceaef0 2024-09-21T09:05:04.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.322+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfaf00 con 0x55fbaacf4390 2024-09-21T09:05:04.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.323+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.323+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94539390888464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfb750 con 0x55fbaacf4390 2024-09-21T09:05:04.337 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.323+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfc220 con 0x7fdc1005c070 2024-09-21T09:05:04.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.324+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94539390886368] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.324+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94539390888464] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.324+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x7fdc1005c070 2024-09-21T09:05:04.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.324+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94539390890656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf86e0 con 0x7fdc1005c070 2024-09-21T09:05:04.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.324+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfcaf0 con 0x55fbaaceaef0 2024-09-21T09:05:04.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.325+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94539390890656] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x7fdc1005c070 2024-09-21T09:05:04.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.326+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.326+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94539390893328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfcaa0 con 0x55fbaaceaef0 2024-09-21T09:05:04.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.326+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfd4a0 con 0x55fbaacef8e0 2024-09-21T09:05:04.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.327+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.327+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94539390898096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfd410 con 0x55fbaacef8e0 2024-09-21T09:05:04.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.327+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94539390893328] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.327+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfe470 con 0x55fbaacef8e0 2024-09-21T09:05:04.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.328+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94539390898096] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.328+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.328+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94539390900368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfc5f0 con 0x55fbaacef8e0 2024-09-21T09:05:04.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.328+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfea50 con 0x55fbaacef8e0 2024-09-21T09:05:04.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.329+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94539390900368] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.329+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.329+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94539390902112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfea50 con 0x55fbaacef8e0 2024-09-21T09:05:04.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.329+0000 7fdc23e32800 20 add_watcher() i=0 2024-09-21T09:05:04.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.329+0000 7fdc23e32800 20 add_watcher() i=1 2024-09-21T09:05:04.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.329+0000 7fdc23e32800 20 add_watcher() i=2 2024-09-21T09:05:04.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.329+0000 7fdc23e32800 20 add_watcher() i=3 2024-09-21T09:05:04.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.329+0000 7fdc23e32800 20 add_watcher() i=4 2024-09-21T09:05:04.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.329+0000 7fdc23e32800 20 add_watcher() i=5 2024-09-21T09:05:04.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.329+0000 7fdc23e32800 20 add_watcher() i=6 2024-09-21T09:05:04.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.330+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94539390902112] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.330+0000 7fdc23e32800 20 add_watcher() i=7 2024-09-21T09:05:04.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.330+0000 7fdc23e32800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:04.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.330+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad01d10 con 0x55fbaaceaef0 2024-09-21T09:05:04.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.330+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.330+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94539390904080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfefe0 con 0x55fbaaceaef0 2024-09-21T09:05:04.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.331+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94539390904080] v31'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.331+0000 7fdad5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:04.340 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.331+0000 7fdc23e32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:04.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.331+0000 7fdc23e32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:04.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.331+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad016c0 con 0x55fbaaceaef0 2024-09-21T09:05:04.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.333+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.333+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0afa0 con 0x55fbaacef8e0 2024-09-21T09:05:04.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.334+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.334+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0afa0 con 0x55fbaacf4390 2024-09-21T09:05:04.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.335+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.335+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0b3a0 con 0x55fbaaceaef0 2024-09-21T09:05:04.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.336+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'253 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.336+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0b830 con 0x7fdc1005c070 2024-09-21T09:05:04.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.337+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x7fdc1005c070 2024-09-21T09:05:04.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.337+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0a440 con 0x55fbaacf4390 2024-09-21T09:05:04.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.338+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'55 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.338+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0a440 con 0x55fbaaceaef0 2024-09-21T09:05:04.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.339+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.339+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0a440 con 0x55fbaacef8e0 2024-09-21T09:05:04.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.340+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.340+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0a550 con 0x7fdc1005c070 2024-09-21T09:05:04.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.341+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x7fdc1005c070 2024-09-21T09:05:04.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.341+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0a550 con 0x55fbaacf4390 2024-09-21T09:05:04.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.342+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.344 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.342+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x7fdc1005c070 2024-09-21T09:05:04.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.343+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x7fdc1005c070 2024-09-21T09:05:04.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.343+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaacef8e0 2024-09-21T09:05:04.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.344+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'36 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.344+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x7fdc1005c070 2024-09-21T09:05:04.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.345+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x7fdc1005c070 2024-09-21T09:05:04.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.345+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaacef8e0 2024-09-21T09:05:04.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.346+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.346+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaaceaef0 2024-09-21T09:05:04.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.347+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'254 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.347+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaacf4390 2024-09-21T09:05:04.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.348+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'74 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.348+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x7fdc1005c070 2024-09-21T09:05:04.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.349+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x7fdc1005c070 2024-09-21T09:05:04.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.349+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaacf4390 2024-09-21T09:05:04.351 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.350+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.352 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.350+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaaceaef0 2024-09-21T09:05:04.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.351+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.351+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaaceaef0 2024-09-21T09:05:04.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.352+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'255 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.352+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaacf4390 2024-09-21T09:05:04.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.353+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'75 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.353+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x7fdc1005c070 2024-09-21T09:05:04.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.354+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x7fdc1005c070 2024-09-21T09:05:04.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.354+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaacf4390 2024-09-21T09:05:04.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.355+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.355+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaacf4390 2024-09-21T09:05:04.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.356+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.356+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaacf4390 2024-09-21T09:05:04.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.357+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.357+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaacf4390 2024-09-21T09:05:04.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.358+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.360 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.358+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaacef8e0 2024-09-21T09:05:04.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.359+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.359+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaacf4390 2024-09-21T09:05:04.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.360+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.360+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaacef8e0 2024-09-21T09:05:04.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.361+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.361+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaacf4390 2024-09-21T09:05:04.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.362+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'76 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.364 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.362+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x55fbaacef8e0 2024-09-21T09:05:04.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.363+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.363+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad0c390 con 0x7fdc1005c070 2024-09-21T09:05:04.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.365+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x7fdc1005c070 2024-09-21T09:05:04.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.365+0000 7fdad4fe1640 20 reqs_thread_entry: start 2024-09-21T09:05:04.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.365+0000 7fdc23e32800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:04.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.365+0000 7fdc23e32800 20 Filter name: none 2024-09-21T09:05:04.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.365+0000 7fda4e7fc640 20 reqs_thread_entry: start 2024-09-21T09:05:04.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.365+0000 7fdc23e32800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-21T09:05:04.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.365+0000 7fdc23e32800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.365+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad372b0 con 0x55fbaacf4390 2024-09-21T09:05:04.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.365+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.365+0000 7fdc23e32800 20 rados_obj.operate() r=0 bl.length=363 2024-09-21T09:05:04.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.365+0000 7fdc23e32800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-21T09:05:04.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.365+0000 7fdc23e32800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-21T09:05:04.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.365+0000 7fdc23e32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:05:04.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.366+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad39bc0 con 0x55fbaacf4390 2024-09-21T09:05:04.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.366+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fdc1007b070 con 0x55fbaacf4390 2024-09-21T09:05:04.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.366+0000 7fdc23e32800 10 removing key index: true_admin_akey 2024-09-21T09:05:04.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.366+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad37ba0 con 0x55fbaacf4390 2024-09-21T09:05:04.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.367+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 28 ==== osd_op_reply(96 true_admin_akey [delete] v31'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fdc100b0040 con 0x55fbaacf4390 2024-09-21T09:05:04.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.367+0000 7fdc23e32800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-21T09:05:04.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.367+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94539391141552 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad3a130 con 0x55fbaacef8e0 2024-09-21T09:05:04.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.367+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== watch-notify(notify (1) cookie 94539390898096 notify 133143986221 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55fbaad013d0 con 0x55fbaacef8e0 2024-09-21T09:05:04.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.367+0000 7fdb02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986221 cookie 94539390898096 notifier 4868 bl.length()=165 2024-09-21T09:05:04.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.367+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(97 notify.5 [notify cookie 94539391141552 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.367+0000 7fdb02ffd640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fdae4003d60 con 0x55fbaacef8e0 2024-09-21T09:05:04.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.367+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.367+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== watch-notify(notify_complete (2) cookie 94539391141552 notify 133143986221 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fbaacdfa00 con 0x55fbaacef8e0 2024-09-21T09:05:04.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.368+0000 7fdc23e32800 10 removing email index: 2024-09-21T09:05:04.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.368+0000 7fdc23e32800 10 removing user buckets index 2024-09-21T09:05:04.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.368+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad3a030 con 0x55fbaacf4390 2024-09-21T09:05:04.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.368+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 29 ==== osd_op_reply(99 a_user.buckets [delete] v31'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fdc100b0040 con 0x55fbaacf4390 2024-09-21T09:05:04.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.368+0000 7fdc23e32800 10 removing user index: a_user 2024-09-21T09:05:04.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.368+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad3a060 con 0x55fbaacf4390 2024-09-21T09:05:04.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.369+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 30 ==== osd_op_reply(100 a_user [call,call,delete] v31'4 uv4 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fdc100b0040 con 0x55fbaacf4390 2024-09-21T09:05:04.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.369+0000 7fdc23e32800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-21T09:05:04.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.369+0000 7fdc23e32800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-21T09:05:04.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.369+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94539391146928 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad386b0 con 0x55fbaacf4390 2024-09-21T09:05:04.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.369+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 31 ==== watch-notify(notify (1) cookie 94539390888464 notify 133143986186 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55fbaace26b0 con 0x55fbaacf4390 2024-09-21T09:05:04.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.369+0000 7fdb02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 94539390888464 notifier 4868 bl.length()=155 2024-09-21T09:05:04.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.369+0000 7fdb02ffd640 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fdae4003d60 con 0x55fbaacf4390 2024-09-21T09:05:04.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.370+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 32 ==== osd_op_reply(101 notify.2 [notify cookie 94539391146928 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdc100b0040 con 0x55fbaacf4390 2024-09-21T09:05:04.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.370+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 33 ==== watch-notify(notify_complete (2) cookie 94539391146928 notify 133143986186 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdc100a5040 con 0x55fbaacf4390 2024-09-21T09:05:04.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.370+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc100b0040 con 0x55fbaacf4390 2024-09-21T09:05:04.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.371+0000 7fdad5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:04.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.371+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94539390904080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad3a060 con 0x55fbaaceaef0 2024-09-21T09:05:04.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.372+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94539390904080] v31'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.372+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94539390881984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaad3a060 con 0x7fdc1005c070 2024-09-21T09:05:04.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.373+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94539390881984] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x7fdc1005c070 2024-09-21T09:05:04.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.373+0000 7fdc23e32800 20 remove_watcher() i=0 2024-09-21T09:05:04.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.373+0000 7fdc23e32800 2 removed watcher, disabling cache 2024-09-21T09:05:04.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.373+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94539390886368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf90c0 con 0x55fbaaceaef0 2024-09-21T09:05:04.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.374+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94539390886368] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.374+0000 7fdc23e32800 20 remove_watcher() i=1 2024-09-21T09:05:04.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.374+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94539390888464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfa1e0 con 0x55fbaacf4390 2024-09-21T09:05:04.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.375+0000 7fdc1f1d6640 1 -- 172.21.15.178:0/816635718 <== osd.3 v2:172.21.15.178:6808/24558189 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94539390888464] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc100b0040 con 0x55fbaacf4390 2024-09-21T09:05:04.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.375+0000 7fdc23e32800 20 remove_watcher() i=2 2024-09-21T09:05:04.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.375+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94539390890656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf90c0 con 0x7fdc1005c070 2024-09-21T09:05:04.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.376+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94539390890656] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x7fdc1005c070 2024-09-21T09:05:04.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.376+0000 7fdc23e32800 20 remove_watcher() i=3 2024-09-21T09:05:04.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.376+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94539390893328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfa1e0 con 0x55fbaaceaef0 2024-09-21T09:05:04.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.377+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94539390893328] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0803d040 con 0x55fbaaceaef0 2024-09-21T09:05:04.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.377+0000 7fdc23e32800 20 remove_watcher() i=4 2024-09-21T09:05:04.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.377+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94539390898096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfb2a0 con 0x55fbaacef8e0 2024-09-21T09:05:04.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.378+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94539390898096] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.378+0000 7fdc23e32800 20 remove_watcher() i=5 2024-09-21T09:05:04.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.378+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94539390900368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacf90c0 con 0x55fbaacef8e0 2024-09-21T09:05:04.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.379+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94539390900368] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.379+0000 7fdc23e32800 20 remove_watcher() i=6 2024-09-21T09:05:04.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.379+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94539390902112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fbaacfa1e0 con 0x55fbaacef8e0 2024-09-21T09:05:04.384 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.380+0000 7fdc1f9d7640 1 -- 172.21.15.178:0/816635718 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94539390902112] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18055070 con 0x55fbaacef8e0 2024-09-21T09:05:04.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.380+0000 7fdc23e32800 20 remove_watcher() i=7 2024-09-21T09:05:04.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.380+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fbaacef8e0 msgr2=0x55fbaacf1cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.380+0000 7fdc23e32800 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fbaacef8e0 0x55fbaacf1cd0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.380+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fbaaceaef0 msgr2=0x55fbaaced3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.380+0000 7fdc23e32800 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fbaaceaef0 0x55fbaaced3b0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.380+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fdc1005c070 msgr2=0x7fdc10053730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fdc1005c070 0x7fdc10053730 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fbaacf4390 msgr2=0x55fbaacf6850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55fbaacf4390 0x55fbaacf6850 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdae8036b90 msgr2=0x7fdae8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdae8036b90 0x7fdae8039050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdc10008370 tx=0x7fdc10085000 comp rx=0 tx=0).stop 2024-09-21T09:05:04.385 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaacd7da0 msgr2=0x55fbaacdf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc17fff640 1 -- 172.21.15.178:0/816635718 reap_dead start 2024-09-21T09:05:04.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaacd7da0 0x55fbaacdf230 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fdc180117d0 tx=0x7fdc1804cc50 comp rx=0 tx=0).stop 2024-09-21T09:05:04.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 shutdown_connections 2024-09-21T09:05:04.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 --2- 172.21.15.178:0/816635718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaacd7da0 0x55fbaacdf230 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 >> 172.21.15.178:0/816635718 conn(0x55fbaacd4150 msgr2=0x55fbaacd94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 shutdown_connections 2024-09-21T09:05:04.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 -- 172.21.15.178:0/816635718 wait complete. 2024-09-21T09:05:04.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 -- 172.21.15.178:0/529285047 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdaf8036b40 msgr2=0x7fdaf8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 --2- 172.21.15.178:0/529285047 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdaf8036b40 0x7fdaf8039000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55fbaacb5c80 tx=0x7fdc10067a10 comp rx=0 tx=0).stop 2024-09-21T09:05:04.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 -- 172.21.15.178:0/529285047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaabb7b10 msgr2=0x55fbaabb6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 --2- 172.21.15.178:0/529285047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaabb7b10 0x55fbaabb6160 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x55fbaacb5b90 tx=0x7fdc18018830 comp rx=0 tx=0).stop 2024-09-21T09:05:04.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 -- 172.21.15.178:0/529285047 shutdown_connections 2024-09-21T09:05:04.386 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 --2- 172.21.15.178:0/529285047 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdaf8036b40 0x7fdaf8039000 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 --2- 172.21.15.178:0/529285047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaabb7b10 0x55fbaabb6160 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 -- 172.21.15.178:0/529285047 >> 172.21.15.178:0/529285047 conn(0x55fbaacbdeb0 msgr2=0x55fbaacc0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 -- 172.21.15.178:0/529285047 shutdown_connections 2024-09-21T09:05:04.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.381+0000 7fdc23e32800 1 -- 172.21.15.178:0/529285047 wait complete. 2024-09-21T09:05:04.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fbaacb7b30 msgr2=0x55fbaacb9f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fbaacb7b30 0x55fbaacb9f20 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fbaabba680 msgr2=0x55fbaacb5230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fbaabba680 0x55fbaacb5230 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdb04036ce0 msgr2=0x7fdb040391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdb04036ce0 0x7fdb040391a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdc08000f60 tx=0x7fdc080012b0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 msgr2=0x55fbaacae1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaacae1c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000a330 tx=0x7fdc10002fb0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 shutdown_connections 2024-09-21T09:05:04.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55fbaacb7b30 0x55fbaacb9f20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55fbaabba680 0x55fbaacb5230 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdb04036ce0 0x7fdb040391a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 --2- 172.21.15.178:0/480174458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbaab2ae90 0x55fbaacae1c0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 >> 172.21.15.178:0/480174458 conn(0x55fbaabb1df0 msgr2=0x55fbaaca0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 shutdown_connections 2024-09-21T09:05:04.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.382+0000 7fdc23e32800 1 -- 172.21.15.178:0/480174458 wait complete. 2024-09-21T09:05:04.392 ERROR:root:None 2024-09-21T09:05:04.392 ERROR:root:0 2024-09-21T09:05:04.392 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-21T09:05:04.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-21T09:05:04.392 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-21T09:05:04.438 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:04.438 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:04.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.437+0000 7f5397919800 1 Processor -- start 2024-09-21T09:05:04.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.437+0000 7f5397919800 1 -- start start 2024-09-21T09:05:04.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.437+0000 7f5397919800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5578e287f4e0 0x5578e287f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.437+0000 7f5397919800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5578e273fb30 con 0x5578e287fe20 2024-09-21T09:05:04.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.437+0000 7f5397919800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x5578e2721360 con 0x5578e287f4e0 2024-09-21T09:05:04.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.438+0000 7f539540d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x5578e287f4e0 0x5578e287f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.438+0000 7f538cc0c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x5578e287fe20 0x5578e28849a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40542/0 (socket says 172.21.15.178:40542) 2024-09-21T09:05:04.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.438+0000 7f538cc0c640 1 -- 172.21.15.178:0/2449760903 learned_addr learned my addr 172.21.15.178:0/2449760903 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:05:04.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.438+0000 7f5394c0c640 1 -- 172.21.15.178:0/2449760903 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563346067 0 0) 0x5578e273fb30 con 0x5578e287fe20 2024-09-21T09:05:04.441 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.438+0000 7f5394c0c640 1 -- 172.21.15.178:0/2449760903 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5384001e10 con 0x5578e287fe20 2024-09-21T09:05:04.441 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.438+0000 7f539540d640 1 -- 172.21.15.178:0/2449760903 >> v1:172.21.15.44:6789/0 conn(0x5578e287fe20 legacy=0x5578e28849a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.441 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.438+0000 7f539540d640 1 -- 172.21.15.178:0/2449760903 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e2747e00 con 0x5578e287f4e0 2024-09-21T09:05:04.442 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.440+0000 7f539540d640 1 --2- 172.21.15.178:0/2449760903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e287f8e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f538800a470 tx=0x7f5388045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624a64d27b1a896a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.442 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.440+0000 7f5394c0c640 1 -- 172.21.15.178:0/2449760903 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5388059070 con 0x5578e287f4e0 2024-09-21T09:05:04.442 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.440+0000 7f5394c0c640 1 -- 172.21.15.178:0/2449760903 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5388054570 con 0x5578e287f4e0 2024-09-21T09:05:04.442 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.440+0000 7f5394c0c640 1 -- 172.21.15.178:0/2449760903 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5388054870 con 0x5578e287f4e0 2024-09-21T09:05:04.443 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.441+0000 7f5397919800 1 -- 172.21.15.178:0/2449760903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 msgr2=0x5578e287f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.443 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.441+0000 7f5397919800 1 --2- 172.21.15.178:0/2449760903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e287f8e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f538800a470 tx=0x7f5388045920 comp rx=0 tx=0).stop 2024-09-21T09:05:04.443 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.441+0000 7f5397919800 1 -- 172.21.15.178:0/2449760903 shutdown_connections 2024-09-21T09:05:04.443 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.441+0000 7f5397919800 1 --2- 172.21.15.178:0/2449760903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e287f8e0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.443 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.441+0000 7f5397919800 1 -- 172.21.15.178:0/2449760903 >> 172.21.15.178:0/2449760903 conn(0x5578e287add0 msgr2=0x5578e287d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.443 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.441+0000 7f5397919800 1 -- 172.21.15.178:0/2449760903 shutdown_connections 2024-09-21T09:05:04.443 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.441+0000 7f5397919800 1 -- 172.21.15.178:0/2449760903 wait complete. 2024-09-21T09:05:04.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.454+0000 7f5397919800 1 Processor -- start 2024-09-21T09:05:04.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.454+0000 7f5397919800 1 -- start start 2024-09-21T09:05:04.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.455+0000 7f5397919800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e27f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.455+0000 7f5397919800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5578e27cc360 con 0x5578e287f4e0 2024-09-21T09:05:04.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.455+0000 7f539540d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e27f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.455+0000 7f539540d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e27f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60862/0 (socket says 172.21.15.178:60862) 2024-09-21T09:05:04.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.455+0000 7f539540d640 1 -- 172.21.15.178:0/2315053327 learned_addr learned my addr 172.21.15.178:0/2315053327 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.455+0000 7f539540d640 1 -- 172.21.15.178:0/2315053327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e2719bc0 con 0x5578e287f4e0 2024-09-21T09:05:04.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.455+0000 7f539540d640 1 --2- 172.21.15.178:0/2315053327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e27f3da0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5388025b20 tx=0x7f538804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27fb1ecd0f92e54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.456+0000 7f5283606640 1 -- 172.21.15.178:0/2315053327 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5388062070 con 0x5578e287f4e0 2024-09-21T09:05:04.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.456+0000 7f5283606640 1 -- 172.21.15.178:0/2315053327 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f538800a170 con 0x5578e287f4e0 2024-09-21T09:05:04.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.456+0000 7f5283606640 1 -- 172.21.15.178:0/2315053327 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5388059040 con 0x5578e287f4e0 2024-09-21T09:05:04.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.456+0000 7f5397919800 1 -- 172.21.15.178:0/2315053327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 msgr2=0x5578e27f3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.456+0000 7f5397919800 1 --2- 172.21.15.178:0/2315053327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e27f3da0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5388025b20 tx=0x7f538804e000 comp rx=0 tx=0).stop 2024-09-21T09:05:04.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.456+0000 7f5397919800 1 -- 172.21.15.178:0/2315053327 shutdown_connections 2024-09-21T09:05:04.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.456+0000 7f5397919800 1 --2- 172.21.15.178:0/2315053327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e27f3da0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.456+0000 7f5397919800 1 -- 172.21.15.178:0/2315053327 >> 172.21.15.178:0/2315053327 conn(0x5578e287add0 msgr2=0x5578e296a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.456+0000 7f5397919800 1 -- 172.21.15.178:0/2315053327 shutdown_connections 2024-09-21T09:05:04.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.456+0000 7f5397919800 1 -- 172.21.15.178:0/2315053327 wait complete. 2024-09-21T09:05:04.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.457+0000 7f5397919800 1 Processor -- start 2024-09-21T09:05:04.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.457+0000 7f5397919800 1 -- start start 2024-09-21T09:05:04.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.457+0000 7f5397919800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e296fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.457+0000 7f5397919800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5578e2886500 con 0x5578e287f4e0 2024-09-21T09:05:04.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.457+0000 7f539540d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e296fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.457+0000 7f539540d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e296fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60864/0 (socket says 172.21.15.178:60864) 2024-09-21T09:05:04.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.457+0000 7f539540d640 1 -- 172.21.15.178:0/3725583637 learned_addr learned my addr 172.21.15.178:0/3725583637 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.457+0000 7f539540d640 1 -- 172.21.15.178:0/3725583637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e272dfe0 con 0x5578e287f4e0 2024-09-21T09:05:04.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.458+0000 7f539540d640 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e296fda0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5388045960 tx=0x7f5388002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.458+0000 7f5281e03640 1 -- 172.21.15.178:0/3725583637 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f538806c070 con 0x5578e287f4e0 2024-09-21T09:05:04.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.458+0000 7f5281e03640 1 -- 172.21.15.178:0/3725583637 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5388054bf0 con 0x5578e287f4e0 2024-09-21T09:05:04.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.458+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578e296e490 con 0x5578e287f4e0 2024-09-21T09:05:04.461 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.458+0000 7f5281e03640 1 -- 172.21.15.178:0/3725583637 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5388062070 con 0x5578e287f4e0 2024-09-21T09:05:04.462 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.458+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578e296e9b0 con 0x5578e287f4e0 2024-09-21T09:05:04.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.459+0000 7f5281e03640 1 -- 172.21.15.178:0/3725583637 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5388065040 con 0x5578e287f4e0 2024-09-21T09:05:04.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.459+0000 7f5281e03640 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f527c036b90 0x7f527c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.459+0000 7f5281e03640 1 -- 172.21.15.178:0/3725583637 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f538808f2a0 con 0x5578e287f4e0 2024-09-21T09:05:04.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.459+0000 7f538cc0c640 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f527c036b90 0x7f527c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.465 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.459+0000 7f5397919800 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5578e287fe20 0x5578e2980510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.459+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e2980a50 con 0x5578e287fe20 2024-09-21T09:05:04.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.459+0000 7f5395c0e640 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5578e287fe20 0x5578e2980510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.460+0000 7f538cc0c640 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f527c036b90 0x7f527c039050 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5380000f60 tx=0x7f53800010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.460+0000 7f5395c0e640 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5578e287fe20 0x5578e2980510 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.460+0000 7f5395c0e640 1 -- 172.21.15.178:0/3725583637 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f539000a4a0 con 0x5578e287fe20 2024-09-21T09:05:04.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.460+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29812a0 con 0x5578e287fe20 2024-09-21T09:05:04.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.460+0000 7f5395c0e640 1 -- 172.21.15.178:0/3725583637 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f539000a4a0 con 0x5578e287fe20 2024-09-21T09:05:04.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.460+0000 7f5397919800 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5578e2982bb0 0x5578e2985030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.460+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29857c0 con 0x5578e2982bb0 2024-09-21T09:05:04.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.461+0000 7f539540d640 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5578e2982bb0 0x5578e2985030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.461+0000 7f539540d640 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5578e2982bb0 0x5578e2985030 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.461+0000 7f539540d640 1 -- 172.21.15.178:0/3725583637 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f538805c040 con 0x5578e2982bb0 2024-09-21T09:05:04.466 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.461+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e2981af0 con 0x5578e287fe20 2024-09-21T09:05:04.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.462+0000 7f5395c0e640 1 -- 172.21.15.178:0/3725583637 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f539000a4a0 con 0x5578e287fe20 2024-09-21T09:05:04.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.462+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e2981ed0 con 0x5578e287fe20 2024-09-21T09:05:04.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.462+0000 7f5395c0e640 1 -- 172.21.15.178:0/3725583637 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f539000a4a0 con 0x5578e287fe20 2024-09-21T09:05:04.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.462+0000 7f5397919800 1 Processor -- start 2024-09-21T09:05:04.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.462+0000 7f5397919800 1 -- start start 2024-09-21T09:05:04.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.462+0000 7f5397919800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e2994180 0x5578e29945a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.462+0000 7f5397919800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5578e29702e0 con 0x5578e2994180 2024-09-21T09:05:04.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.463+0000 7f5395c0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e2994180 0x5578e29945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.463+0000 7f5395c0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e2994180 0x5578e29945a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60872/0 (socket says 172.21.15.178:60872) 2024-09-21T09:05:04.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.463+0000 7f5395c0e640 1 -- 172.21.15.178:0/4083231691 learned_addr learned my addr 172.21.15.178:0/4083231691 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.463+0000 7f5395c0e640 1 -- 172.21.15.178:0/4083231691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e2994ae0 con 0x5578e2994180 2024-09-21T09:05:04.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.463+0000 7f5395c0e640 1 --2- 172.21.15.178:0/4083231691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e2994180 0x5578e29945a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x5578e296f790 tx=0x7f53900188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.467 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.463+0000 7f527affd640 1 -- 172.21.15.178:0/4083231691 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5390014450 con 0x5578e2994180 2024-09-21T09:05:04.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.463+0000 7f527affd640 1 -- 172.21.15.178:0/4083231691 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53900145f0 con 0x5578e2994180 2024-09-21T09:05:04.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.463+0000 7f5397919800 1 -- 172.21.15.178:0/4083231691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578e2994d70 con 0x5578e2994180 2024-09-21T09:05:04.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.463+0000 7f527affd640 1 -- 172.21.15.178:0/4083231691 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53900148d0 con 0x5578e2994180 2024-09-21T09:05:04.468 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.463+0000 7f5397919800 1 -- 172.21.15.178:0/4083231691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578e2997a50 con 0x5578e2994180 2024-09-21T09:05:04.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.464+0000 7f527affd640 1 -- 172.21.15.178:0/4083231691 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5390011040 con 0x5578e2994180 2024-09-21T09:05:04.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.464+0000 7f527affd640 1 --2- 172.21.15.178:0/4083231691 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f526c036b40 0x7f526c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.464+0000 7f527affd640 1 -- 172.21.15.178:0/4083231691 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f539001e070 con 0x5578e2994180 2024-09-21T09:05:04.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.464+0000 7f539540d640 1 --2- 172.21.15.178:0/4083231691 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f526c036b40 0x7f526c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.465+0000 7f5397919800 1 Processor -- start 2024-09-21T09:05:04.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.465+0000 7f5397919800 1 -- start start 2024-09-21T09:05:04.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.465+0000 7f539540d640 1 --2- 172.21.15.178:0/4083231691 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f526c036b40 0x7f526c039000 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5578e296ee60 tx=0x7f538808d610 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.465+0000 7f5397919800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e29a0e50 0x5578e29a1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.465+0000 7f5397919800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5578e271b580 con 0x5578e29a0e50 2024-09-21T09:05:04.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.465+0000 7f5395c0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e29a0e50 0x5578e29a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.465+0000 7f5395c0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e29a0e50 0x5578e29a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60888/0 (socket says 172.21.15.178:60888) 2024-09-21T09:05:04.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.465+0000 7f5395c0e640 1 -- 172.21.15.178:0/2546460570 learned_addr learned my addr 172.21.15.178:0/2546460570 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.465+0000 7f5395c0e640 1 -- 172.21.15.178:0/2546460570 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e29a1820 con 0x5578e29a0e50 2024-09-21T09:05:04.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.465+0000 7f5395c0e640 1 --2- 172.21.15.178:0/2546460570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e29a0e50 0x5578e29a1250 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f539004cb80 tx=0x7f539003bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf83819827575138 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.465+0000 7f5278ff9640 1 -- 172.21.15.178:0/2546460570 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5390013c80 con 0x5578e29a0e50 2024-09-21T09:05:04.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.466+0000 7f5278ff9640 1 -- 172.21.15.178:0/2546460570 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5390013e20 con 0x5578e29a0e50 2024-09-21T09:05:04.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.466+0000 7f5278ff9640 1 -- 172.21.15.178:0/2546460570 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5390014a70 con 0x5578e29a0e50 2024-09-21T09:05:04.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.466+0000 7f5397919800 1 -- 172.21.15.178:0/2546460570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e29a0e50 msgr2=0x5578e29a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.466+0000 7f5397919800 1 --2- 172.21.15.178:0/2546460570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e29a0e50 0x5578e29a1250 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f539004cb80 tx=0x7f539003bf60 comp rx=0 tx=0).stop 2024-09-21T09:05:04.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.466+0000 7f5397919800 1 -- 172.21.15.178:0/2546460570 shutdown_connections 2024-09-21T09:05:04.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.466+0000 7f5397919800 1 --2- 172.21.15.178:0/2546460570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e29a0e50 0x5578e29a1250 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.466+0000 7f5397919800 1 -- 172.21.15.178:0/2546460570 >> 172.21.15.178:0/2546460570 conn(0x5578e299d1b0 msgr2=0x5578e299b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.466+0000 7f5397919800 1 -- 172.21.15.178:0/2546460570 shutdown_connections 2024-09-21T09:05:04.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.466+0000 7f5397919800 1 -- 172.21.15.178:0/2546460570 wait complete. 2024-09-21T09:05:04.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.466+0000 7f5397919800 1 Processor -- start 2024-09-21T09:05:04.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.466+0000 7f5397919800 1 -- start start 2024-09-21T09:05:04.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.466+0000 7f5397919800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e29a0e50 0x5578e29a8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.466+0000 7f5397919800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5578e29a1d10 con 0x5578e29a0e50 2024-09-21T09:05:04.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.467+0000 7f5395c0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e29a0e50 0x5578e29a8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.467+0000 7f5395c0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e29a0e50 0x5578e29a8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60898/0 (socket says 172.21.15.178:60898) 2024-09-21T09:05:04.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.467+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 learned_addr learned my addr 172.21.15.178:0/142612679 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.467+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e29a86a0 con 0x5578e29a0e50 2024-09-21T09:05:04.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.467+0000 7f5395c0e640 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e29a0e50 0x5578e29a8160 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f539003e040 tx=0x7f539004cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.467+0000 7f526affd640 1 -- 172.21.15.178:0/142612679 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5390044030 con 0x5578e29a0e50 2024-09-21T09:05:04.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.467+0000 7f526affd640 1 -- 172.21.15.178:0/142612679 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5390022c90 con 0x5578e29a0e50 2024-09-21T09:05:04.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.467+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578e29a8930 con 0x5578e29a0e50 2024-09-21T09:05:04.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.467+0000 7f526affd640 1 -- 172.21.15.178:0/142612679 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5390013c80 con 0x5578e29a0e50 2024-09-21T09:05:04.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.467+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578e29ab5e0 con 0x5578e29a0e50 2024-09-21T09:05:04.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.468+0000 7f526affd640 1 -- 172.21.15.178:0/142612679 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f539004e0d0 con 0x5578e29a0e50 2024-09-21T09:05:04.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.468+0000 7f526affd640 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5260036b90 0x7f5260039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.468+0000 7f526affd640 1 -- 172.21.15.178:0/142612679 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f5390045070 con 0x5578e29a0e50 2024-09-21T09:05:04.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.468+0000 7f539540d640 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5260036b90 0x7f5260039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.469+0000 7f539540d640 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5260036b90 0x7f5260039050 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5388054540 tx=0x7f538807f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.469+0000 7f5397919800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.469+0000 7f5397919800 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5578e29b3db0 0x5578e29b6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.469+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29b69c0 con 0x5578e29b3db0 2024-09-21T09:05:04.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.469+0000 7f538cc0c640 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5578e29b3db0 0x5578e29b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.469+0000 7f538cc0c640 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5578e29b3db0 0x5578e29b6270 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5380009050 con 0x5578e29b3db0 2024-09-21T09:05:04.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 20 realm 2024-09-21T09:05:04.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29b3200 con 0x5578e29b3db0 2024-09-21T09:05:04.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5380009050 con 0x5578e29b3db0 2024-09-21T09:05:04.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:04.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29b74b0 con 0x5578e29b3db0 2024-09-21T09:05:04.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5380009050 con 0x5578e29b3db0 2024-09-21T09:05:04.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29b7d80 con 0x5578e29b3db0 2024-09-21T09:05:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5380009050 con 0x5578e29b3db0 2024-09-21T09:05:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5578e29b87a0 0x5578e29bab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bb280 con 0x5578e29b87a0 2024-09-21T09:05:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.470+0000 7f5395c0e640 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5578e29b87a0 0x5578e29bab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.471+0000 7f5395c0e640 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5578e29b87a0 0x5578e29bab90 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.471+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.471+0000 7f5397919800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.471+0000 7f5397919800 20 searching for the correct realm 2024-09-21T09:05:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.471+0000 7f5397919800 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5578e29bd250 0x5578e29bf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.471+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29bd250 2024-09-21T09:05:04.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.471+0000 7f539540d640 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5578e29bd250 0x5578e29bf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.472+0000 7f539540d640 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5578e29bd250 0x5578e29bf710 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.472+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538805c040 con 0x5578e29bd250 2024-09-21T09:05:04.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.472+0000 7f539540d640 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5388068040 0x7f538806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.472+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x7f5388068040 2024-09-21T09:05:04.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.472+0000 7f538cc0c640 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5388068040 0x7f538806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.472+0000 7f538cc0c640 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5388068040 0x7f538806f590 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.472+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5380009050 con 0x7f5388068040 2024-09-21T09:05:04.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.472+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b87a0 2024-09-21T09:05:04.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.473+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.473+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b3db0 2024-09-21T09:05:04.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.473+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5380009050 con 0x5578e29b3db0 2024-09-21T09:05:04.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.473+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b3db0 2024-09-21T09:05:04.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.473+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5380029040 con 0x5578e29b3db0 2024-09-21T09:05:04.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.473+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b87a0 2024-09-21T09:05:04.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.474+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.474+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b87a0 2024-09-21T09:05:04.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.474+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.474+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x7f5388068040 2024-09-21T09:05:04.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.474+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5380029040 con 0x7f5388068040 2024-09-21T09:05:04.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.474+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29bd250 2024-09-21T09:05:04.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.474+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538805c040 con 0x5578e29bd250 2024-09-21T09:05:04.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.474+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b3db0 2024-09-21T09:05:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.475+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5380029040 con 0x5578e29b3db0 2024-09-21T09:05:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.475+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b87a0 2024-09-21T09:05:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.475+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.475+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b3db0 2024-09-21T09:05:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.475+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5380029040 con 0x5578e29b3db0 2024-09-21T09:05:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.475+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x7f5388068040 2024-09-21T09:05:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.475+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5380029040 con 0x7f5388068040 2024-09-21T09:05:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.475+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29bd250 2024-09-21T09:05:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.476+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538805c040 con 0x5578e29bd250 2024-09-21T09:05:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.476+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29bd250 2024-09-21T09:05:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.476+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538805c040 con 0x5578e29bd250 2024-09-21T09:05:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.476+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b87a0 2024-09-21T09:05:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.477+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.477+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29bd250 2024-09-21T09:05:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.477+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538805c040 con 0x5578e29bd250 2024-09-21T09:05:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.477+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29bd250 2024-09-21T09:05:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.477+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538805c040 con 0x5578e29bd250 2024-09-21T09:05:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.477+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b3db0 2024-09-21T09:05:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.477+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5380029040 con 0x5578e29b3db0 2024-09-21T09:05:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.477+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b3db0 2024-09-21T09:05:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.478+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5380029040 con 0x5578e29b3db0 2024-09-21T09:05:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.478+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b87a0 2024-09-21T09:05:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.478+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.478+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29bd250 2024-09-21T09:05:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.478+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538805c040 con 0x5578e29bd250 2024-09-21T09:05:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.478+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x7f5388068040 2024-09-21T09:05:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.478+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5380029040 con 0x7f5388068040 2024-09-21T09:05:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.478+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b3db0 2024-09-21T09:05:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.479+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5380029040 con 0x5578e29b3db0 2024-09-21T09:05:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.479+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b87a0 2024-09-21T09:05:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.479+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.479+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29bd250 2024-09-21T09:05:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.479+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538805c040 con 0x5578e29bd250 2024-09-21T09:05:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.479+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x7f5388068040 2024-09-21T09:05:04.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.479+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5380029040 con 0x7f5388068040 2024-09-21T09:05:04.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.479+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x7f5388068040 2024-09-21T09:05:04.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.479+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5380029040 con 0x7f5388068040 2024-09-21T09:05:04.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.479+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29bd250 2024-09-21T09:05:04.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.480+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538805c040 con 0x5578e29bd250 2024-09-21T09:05:04.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.480+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b87a0 2024-09-21T09:05:04.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.480+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.480+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x5578e29b3db0 2024-09-21T09:05:04.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.480+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5380029040 con 0x5578e29b3db0 2024-09-21T09:05:04.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.480+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bfde0 con 0x7f5388068040 2024-09-21T09:05:04.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5380029040 con 0x7f5388068040 2024-09-21T09:05:04.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:04.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:04.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:04.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:04.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:04.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:04.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bbc70 con 0x5578e29b3db0 2024-09-21T09:05:04.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5380029040 con 0x5578e29b3db0 2024-09-21T09:05:04.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bc510 con 0x5578e29b3db0 2024-09-21T09:05:04.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f538003d040 con 0x5578e29b3db0 2024-09-21T09:05:04.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29bb8b0 con 0x5578e29b3db0 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f538003d040 con 0x5578e29b3db0 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 zone default found 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 4 Realm: () 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 zonegroup default 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.481+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c02c0 con 0x5578e29b87a0 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.482+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.482+0000 7f5397919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.482+0000 7f5397919800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.482+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c2590 con 0x5578e29bd250 2024-09-21T09:05:04.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.482+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f538805c040 con 0x5578e29bd250 2024-09-21T09:05:04.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.482+0000 7f5397919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.482+0000 7f5397919800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.482+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c2930 con 0x5578e29bd250 2024-09-21T09:05:04.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.482+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f538805c040 con 0x5578e29bd250 2024-09-21T09:05:04.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.482+0000 7f5397919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.482+0000 7f5397919800 20 started sync module instance, tier type = 2024-09-21T09:05:04.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.482+0000 7f5397919800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:04.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.482+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c1a20 con 0x7f5388068040 2024-09-21T09:05:04.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.483+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538003d040 con 0x7f5388068040 2024-09-21T09:05:04.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.483+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93977686318928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c1a20 con 0x7f5388068040 2024-09-21T09:05:04.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.483+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c3340 con 0x5578e29b3db0 2024-09-21T09:05:04.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.484+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93977686318928] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538003d040 con 0x7f5388068040 2024-09-21T09:05:04.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.485+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538003d040 con 0x5578e29b3db0 2024-09-21T09:05:04.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.485+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93977686316880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c3340 con 0x5578e29b3db0 2024-09-21T09:05:04.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.485+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c3d40 con 0x5578e29bd250 2024-09-21T09:05:04.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.486+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538805c040 con 0x5578e29bd250 2024-09-21T09:05:04.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.486+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93977686325328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c45e0 con 0x5578e29bd250 2024-09-21T09:05:04.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.486+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c5080 con 0x7f5388068040 2024-09-21T09:05:04.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.486+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93977686316880] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538003d040 con 0x5578e29b3db0 2024-09-21T09:05:04.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.487+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538003d040 con 0x7f5388068040 2024-09-21T09:05:04.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.487+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93977686330192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c5470 con 0x7f5388068040 2024-09-21T09:05:04.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.487+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c5e70 con 0x5578e29b3db0 2024-09-21T09:05:04.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.487+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93977686325328] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538805c040 con 0x5578e29bd250 2024-09-21T09:05:04.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.488+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538003d040 con 0x5578e29b3db0 2024-09-21T09:05:04.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.488+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93977686330192] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538003d040 con 0x7f5388068040 2024-09-21T09:05:04.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.488+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93977686327600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c5e30 con 0x5578e29b3db0 2024-09-21T09:05:04.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.488+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c63d0 con 0x5578e29b87a0 2024-09-21T09:05:04.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.489+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.489+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93977686322832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c6c20 con 0x5578e29b87a0 2024-09-21T09:05:04.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.489+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c7620 con 0x5578e29b87a0 2024-09-21T09:05:04.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.489+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93977686327600] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538003d040 con 0x5578e29b3db0 2024-09-21T09:05:04.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.490+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93977686322832] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.490+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.490+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93977686333824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c7130 con 0x5578e29b87a0 2024-09-21T09:05:04.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.490+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c7b30 con 0x5578e29b87a0 2024-09-21T09:05:04.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.491+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93977686333824] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.491+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.491+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93977686337392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c7af0 con 0x5578e29b87a0 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.491+0000 7f5397919800 20 add_watcher() i=0 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.491+0000 7f5397919800 20 add_watcher() i=1 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.491+0000 7f5397919800 20 add_watcher() i=2 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.491+0000 7f5397919800 20 add_watcher() i=3 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.491+0000 7f5397919800 20 add_watcher() i=4 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.491+0000 7f5397919800 20 add_watcher() i=5 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.491+0000 7f5397919800 20 add_watcher() i=6 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.492+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93977686337392] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.492+0000 7f5397919800 20 add_watcher() i=7 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.492+0000 7f5397919800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.492+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29caf80 con 0x5578e29b3db0 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.492+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f538003d040 con 0x5578e29b3db0 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.492+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93977686341648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c84d0 con 0x5578e29b3db0 2024-09-21T09:05:04.504 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.493+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93977686341648] v31'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f538003d040 con 0x5578e29b3db0 2024-09-21T09:05:04.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.493+0000 7f524b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:04.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.493+0000 7f5397919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:04.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.493+0000 7f5397919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:04.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.494+0000 7f5397919800 5 note: GC not initialized 2024-09-21T09:05:04.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.494+0000 7f524a7e4640 20 reqs_thread_entry: start 2024-09-21T09:05:04.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.494+0000 7f5397919800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:04.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.494+0000 7f5397919800 20 Filter name: none 2024-09-21T09:05:04.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.494+0000 7f51bbfff640 20 reqs_thread_entry: start 2024-09-21T09:05:04.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.494+0000 7f5397919800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T09:05:04.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.494+0000 7f5397919800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.494+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e29fe400 con 0x5578e29b87a0 2024-09-21T09:05:04.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.495+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.495+0000 7f5397919800 20 rados_obj.operate() r=0 bl.length=460 2024-09-21T09:05:04.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.495+0000 7f5397919800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T09:05:04.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.495+0000 7f5397919800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:04.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.495+0000 7f5397919800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:05:04.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.495+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e2a04aa0 con 0x5578e29b87a0 2024-09-21T09:05:04.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.496+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v31'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.496+0000 7f5397919800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:04.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.496+0000 7f5397919800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:04.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.496+0000 7f5397919800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T09:05:04.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.496+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93977686590560 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5578e2a00080 con 0x5578e29b3db0 2024-09-21T09:05:04.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.496+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== watch-notify(notify (1) cookie 93977686327600 notify 133143986204 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f5384001e10 con 0x5578e29b3db0 2024-09-21T09:05:04.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.496+0000 7f5278ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986204 cookie 93977686327600 notifier 4875 bl.length()=666 2024-09-21T09:05:04.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.496+0000 7f5278ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:04.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.496+0000 7f5278ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:04.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.496+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 notify.4 [notify cookie 93977686590560 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f538003d040 con 0x5578e29b3db0 2024-09-21T09:05:04.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.496+0000 7f5278ff9640 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5258003ea0 con 0x5578e29b3db0 2024-09-21T09:05:04.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.496+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538003d040 con 0x5578e29b3db0 2024-09-21T09:05:04.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.497+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== watch-notify(notify_complete (2) cookie 93977686590560 notify 133143986204 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f538003e8c0 con 0x5578e29b3db0 2024-09-21T09:05:04.507 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T09:05:03.575855Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:05:03.575846Z","tags":[],"group_ids":[]} 2024-09-21T09:05:04.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.497+0000 7f524b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:04.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.497+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93977686341648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29fc120 con 0x5578e29b3db0 2024-09-21T09:05:04.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.498+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93977686341648] v31'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f538003d040 con 0x5578e29b3db0 2024-09-21T09:05:04.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.498+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93977686318928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29fc120 con 0x7f5388068040 2024-09-21T09:05:04.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.499+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93977686318928] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538003d040 con 0x7f5388068040 2024-09-21T09:05:04.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.499+0000 7f5397919800 20 remove_watcher() i=0 2024-09-21T09:05:04.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.499+0000 7f5397919800 2 removed watcher, disabling cache 2024-09-21T09:05:04.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.499+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93977686316880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29fc120 con 0x5578e29b3db0 2024-09-21T09:05:04.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.500+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93977686316880] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538003d040 con 0x5578e29b3db0 2024-09-21T09:05:04.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.500+0000 7f5397919800 20 remove_watcher() i=1 2024-09-21T09:05:04.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.500+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93977686325328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29fc120 con 0x5578e29bd250 2024-09-21T09:05:04.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.502+0000 7f539540d640 1 -- 172.21.15.178:0/142612679 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93977686325328] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538805c040 con 0x5578e29bd250 2024-09-21T09:05:04.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.502+0000 7f5397919800 20 remove_watcher() i=2 2024-09-21T09:05:04.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.502+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93977686330192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c1f50 con 0x7f5388068040 2024-09-21T09:05:04.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.503+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93977686330192] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538003d040 con 0x7f5388068040 2024-09-21T09:05:04.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.503+0000 7f5397919800 20 remove_watcher() i=3 2024-09-21T09:05:04.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.503+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93977686327600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c1f50 con 0x5578e29b3db0 2024-09-21T09:05:04.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.504+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93977686327600] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538003d040 con 0x5578e29b3db0 2024-09-21T09:05:04.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.504+0000 7f5397919800 20 remove_watcher() i=4 2024-09-21T09:05:04.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.504+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93977686322832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c1f50 con 0x5578e29b87a0 2024-09-21T09:05:04.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.505+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93977686322832] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.505+0000 7f5397919800 20 remove_watcher() i=5 2024-09-21T09:05:04.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.505+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93977686333824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c1f50 con 0x5578e29b87a0 2024-09-21T09:05:04.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.506+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93977686333824] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.506+0000 7f5397919800 20 remove_watcher() i=6 2024-09-21T09:05:04.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.506+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93977686337392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5578e29c1f50 con 0x5578e29b87a0 2024-09-21T09:05:04.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5395c0e640 1 -- 172.21.15.178:0/142612679 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93977686337392] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539002a070 con 0x5578e29b87a0 2024-09-21T09:05:04.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 20 remove_watcher() i=7 2024-09-21T09:05:04.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5578e29b87a0 msgr2=0x5578e29bab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5578e29b87a0 0x5578e29bab90 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5578e29b3db0 msgr2=0x5578e29b6270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5578e29b3db0 0x5578e29b6270 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5388068040 msgr2=0x7f538806f590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f5388068040 0x7f538806f590 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5578e29bd250 msgr2=0x5578e29bf710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.514 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x5578e29bd250 0x5578e29bf710 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5260036b90 msgr2=0x7f5260039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5260036b90 0x7f5260039050 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5388054540 tx=0x7f538807f000 comp rx=0 tx=0).stop 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e29a0e50 msgr2=0x5578e29a8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f538cc0c640 1 -- 172.21.15.178:0/142612679 reap_dead start 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e29a0e50 0x5578e29a8160 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f539003e040 tx=0x7f539004cb10 comp rx=0 tx=0).stop 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 shutdown_connections 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 --2- 172.21.15.178:0/142612679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e29a0e50 0x5578e29a8160 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 >> 172.21.15.178:0/142612679 conn(0x5578e299d1b0 msgr2=0x5578e299b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 shutdown_connections 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 -- 172.21.15.178:0/142612679 wait complete. 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 -- 172.21.15.178:0/4083231691 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f526c036b40 msgr2=0x7f526c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 --2- 172.21.15.178:0/4083231691 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f526c036b40 0x7f526c039000 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5578e296ee60 tx=0x7f538808d610 comp rx=0 tx=0).stop 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 -- 172.21.15.178:0/4083231691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e2994180 msgr2=0x5578e29945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.507+0000 7f5397919800 1 --2- 172.21.15.178:0/4083231691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e2994180 0x5578e29945a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x5578e296f790 tx=0x7f53900188f0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 -- 172.21.15.178:0/4083231691 shutdown_connections 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 --2- 172.21.15.178:0/4083231691 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f526c036b40 0x7f526c039000 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 --2- 172.21.15.178:0/4083231691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e2994180 0x5578e29945a0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 -- 172.21.15.178:0/4083231691 >> 172.21.15.178:0/4083231691 conn(0x5578e2989110 msgr2=0x5578e298bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 -- 172.21.15.178:0/4083231691 shutdown_connections 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 -- 172.21.15.178:0/4083231691 wait complete. 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5578e2982bb0 msgr2=0x5578e2985030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5578e2982bb0 0x5578e2985030 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5578e287fe20 msgr2=0x5578e2980510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5578e287fe20 0x5578e2980510 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f527c036b90 msgr2=0x7f527c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f527c036b90 0x7f527c039050 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5380000f60 tx=0x7f53800010a0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 msgr2=0x5578e296fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e296fda0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5388045960 tx=0x7f5388002fb0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 shutdown_connections 2024-09-21T09:05:04.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x5578e2982bb0 0x5578e2985030 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x5578e287fe20 0x5578e2980510 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f527c036b90 0x7f527c039050 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 --2- 172.21.15.178:0/3725583637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578e287f4e0 0x5578e296fda0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 >> 172.21.15.178:0/3725583637 conn(0x5578e287add0 msgr2=0x5578e2968890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 shutdown_connections 2024-09-21T09:05:04.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.508+0000 7f5397919800 1 -- 172.21.15.178:0/3725583637 wait complete. 2024-09-21T09:05:04.519 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:04.519 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:04.519 ERROR:root:0 2024-09-21T09:05:04.519 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:04.523 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:04.524 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-21T09:05:04.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-21T09:05:04.524 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-21T09:05:04.569 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:04.569 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:04.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.569+0000 7ffa85430800 1 Processor -- start 2024-09-21T09:05:04.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.569+0000 7ffa85430800 1 -- start start 2024-09-21T09:05:04.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.569+0000 7ffa85430800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55ff81a75e30 0x55ff81b051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.569+0000 7ffa85430800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ff819c1b30 con 0x55ff81b05720 2024-09-21T09:05:04.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.569+0000 7ffa85430800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55ff819a3360 con 0x55ff81a75e30 2024-09-21T09:05:04.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.569+0000 7ffa8074b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55ff81a75e30 0x55ff81b051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.569+0000 7ffa8074b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55ff81a75e30 0x55ff81b051e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60902/0 (socket says 172.21.15.178:60902) 2024-09-21T09:05:04.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.569+0000 7ffa8074b640 1 -- 172.21.15.178:0/477246455 learned_addr learned my addr 172.21.15.178:0/477246455 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.569+0000 7ffa77fff640 1 --1- 172.21.15.178:0/477246455 >> v1:172.21.15.44:6789/0 conn(0x55ff81b05720 0x55ff81b07b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40556/0 (socket says 172.21.15.178:40556) 2024-09-21T09:05:04.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.569+0000 7ffa8074b640 1 -- 172.21.15.178:0/477246455 >> v1:172.21.15.44:6789/0 conn(0x55ff81b05720 legacy=0x55ff81b07b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.569+0000 7ffa8074b640 1 -- 172.21.15.178:0/477246455 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff819c9e00 con 0x55ff81a75e30 2024-09-21T09:05:04.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.571+0000 7ffa8074b640 1 --2- 172.21.15.178:0/477246455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81b051e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000a520 tx=0x7ffa70045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39cd255aaf952a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.571+0000 7ffa7ff4a640 1 -- 172.21.15.178:0/477246455 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa70055070 con 0x55ff81a75e30 2024-09-21T09:05:04.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.571+0000 7ffa7ff4a640 1 -- 172.21.15.178:0/477246455 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa700515b0 con 0x55ff81a75e30 2024-09-21T09:05:04.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.571+0000 7ffa7ff4a640 1 -- 172.21.15.178:0/477246455 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa700518d0 con 0x55ff81a75e30 2024-09-21T09:05:04.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.572+0000 7ffa85430800 1 -- 172.21.15.178:0/477246455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 msgr2=0x55ff81b051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.574 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.572+0000 7ffa85430800 1 --2- 172.21.15.178:0/477246455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81b051e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000a520 tx=0x7ffa70045ba0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.572+0000 7ffa85430800 1 -- 172.21.15.178:0/477246455 shutdown_connections 2024-09-21T09:05:04.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.572+0000 7ffa85430800 1 --2- 172.21.15.178:0/477246455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81b051e0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.572+0000 7ffa85430800 1 -- 172.21.15.178:0/477246455 >> 172.21.15.178:0/477246455 conn(0x55ff81afcdd0 msgr2=0x55ff81aff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.572+0000 7ffa85430800 1 -- 172.21.15.178:0/477246455 shutdown_connections 2024-09-21T09:05:04.575 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.572+0000 7ffa85430800 1 -- 172.21.15.178:0/477246455 wait complete. 2024-09-21T09:05:04.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.585+0000 7ffa85430800 1 Processor -- start 2024-09-21T09:05:04.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.586+0000 7ffa85430800 1 -- start start 2024-09-21T09:05:04.587 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.586+0000 7ffa85430800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81b02b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.586+0000 7ffa85430800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff81a4e360 con 0x55ff81a75e30 2024-09-21T09:05:04.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.586+0000 7ffa8074b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81b02b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.586+0000 7ffa8074b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81b02b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60910/0 (socket says 172.21.15.178:60910) 2024-09-21T09:05:04.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.586+0000 7ffa8074b640 1 -- 172.21.15.178:0/1901600602 learned_addr learned my addr 172.21.15.178:0/1901600602 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.587+0000 7ffa8074b640 1 -- 172.21.15.178:0/1901600602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff8199bbc0 con 0x55ff81a75e30 2024-09-21T09:05:04.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.587+0000 7ffa8074b640 1 --2- 172.21.15.178:0/1901600602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81b02b10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ffa70025da0 tx=0x7ffa70051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfc1c364d50bdb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.587+0000 7ff96e60c640 1 -- 172.21.15.178:0/1901600602 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa70051950 con 0x55ff81a75e30 2024-09-21T09:05:04.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.587+0000 7ff96e60c640 1 -- 172.21.15.178:0/1901600602 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa70051af0 con 0x55ff81a75e30 2024-09-21T09:05:04.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.587+0000 7ff96e60c640 1 -- 172.21.15.178:0/1901600602 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa70051dd0 con 0x55ff81a75e30 2024-09-21T09:05:04.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.588+0000 7ffa85430800 1 -- 172.21.15.178:0/1901600602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 msgr2=0x55ff81b02b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.588+0000 7ffa85430800 1 --2- 172.21.15.178:0/1901600602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81b02b10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ffa70025da0 tx=0x7ffa70051000 comp rx=0 tx=0).stop 2024-09-21T09:05:04.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.588+0000 7ffa85430800 1 -- 172.21.15.178:0/1901600602 shutdown_connections 2024-09-21T09:05:04.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.588+0000 7ffa85430800 1 --2- 172.21.15.178:0/1901600602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81b02b10 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.588+0000 7ffa85430800 1 -- 172.21.15.178:0/1901600602 >> 172.21.15.178:0/1901600602 conn(0x55ff81afcdd0 msgr2=0x55ff81bed2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.588+0000 7ffa85430800 1 -- 172.21.15.178:0/1901600602 shutdown_connections 2024-09-21T09:05:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.588+0000 7ffa85430800 1 -- 172.21.15.178:0/1901600602 wait complete. 2024-09-21T09:05:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.588+0000 7ffa85430800 1 Processor -- start 2024-09-21T09:05:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.588+0000 7ffa85430800 1 -- start start 2024-09-21T09:05:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.588+0000 7ffa85430800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81bfb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.588+0000 7ffa85430800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff81b09620 con 0x55ff81a75e30 2024-09-21T09:05:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.588+0000 7ffa8074b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81bfb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.589+0000 7ffa8074b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81bfb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60918/0 (socket says 172.21.15.178:60918) 2024-09-21T09:05:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.589+0000 7ffa8074b640 1 -- 172.21.15.178:0/57653957 learned_addr learned my addr 172.21.15.178:0/57653957 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.589+0000 7ffa8074b640 1 -- 172.21.15.178:0/57653957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff819affe0 con 0x55ff81a75e30 2024-09-21T09:05:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.589+0000 7ffa8074b640 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81bfb3b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ffa70067040 tx=0x7ffa70002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.589+0000 7ff96ce09640 1 -- 172.21.15.178:0/57653957 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa70073070 con 0x55ff81a75e30 2024-09-21T09:05:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.589+0000 7ff96ce09640 1 -- 172.21.15.178:0/57653957 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7005a450 con 0x55ff81a75e30 2024-09-21T09:05:04.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.589+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff81bfb8f0 con 0x55ff81a75e30 2024-09-21T09:05:04.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.589+0000 7ff96ce09640 1 -- 172.21.15.178:0/57653957 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa7005a730 con 0x55ff81a75e30 2024-09-21T09:05:04.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.590+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff81bfbe70 con 0x55ff81a75e30 2024-09-21T09:05:04.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.590+0000 7ff96ce09640 1 -- 172.21.15.178:0/57653957 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffa70076070 con 0x55ff81a75e30 2024-09-21T09:05:04.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.590+0000 7ff96ce09640 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff968036b90 0x7ff968039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.590+0000 7ff96ce09640 1 -- 172.21.15.178:0/57653957 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ffa70062070 con 0x55ff81a75e30 2024-09-21T09:05:04.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.591+0000 7ffa77fff640 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff968036b90 0x7ff968039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.591+0000 7ffa85430800 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ff81b05720 0x55ff81c02420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.591+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c029a0 con 0x55ff81b05720 2024-09-21T09:05:04.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.591+0000 7ffa80f4c640 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ff81b05720 0x55ff81c02420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.591+0000 7ffa77fff640 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff968036b90 0x7ff968039050 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffa68000f60 tx=0x7ffa68001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.591+0000 7ffa80f4c640 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ff81b05720 0x55ff81c02420 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.591+0000 7ffa80f4c640 1 -- 172.21.15.178:0/57653957 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa7800a4a0 con 0x55ff81b05720 2024-09-21T09:05:04.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.591+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81bff9f0 con 0x55ff81b05720 2024-09-21T09:05:04.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.592+0000 7ffa80f4c640 1 -- 172.21.15.178:0/57653957 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa7800a4a0 con 0x55ff81b05720 2024-09-21T09:05:04.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.592+0000 7ffa85430800 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ff81c04cd0 0x55ff81c070c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.592+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c07760 con 0x55ff81c04cd0 2024-09-21T09:05:04.596 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.592+0000 7ffa8074b640 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ff81c04cd0 0x55ff81c070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.592+0000 7ffa8074b640 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ff81c04cd0 0x55ff81c070c0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.593+0000 7ffa8074b640 1 -- 172.21.15.178:0/57653957 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffa70075030 con 0x55ff81c04cd0 2024-09-21T09:05:04.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.593+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c03b70 con 0x55ff81b05720 2024-09-21T09:05:04.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.593+0000 7ffa80f4c640 1 -- 172.21.15.178:0/57653957 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa7800a4a0 con 0x55ff81b05720 2024-09-21T09:05:04.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.593+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c04050 con 0x55ff81b05720 2024-09-21T09:05:04.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.593+0000 7ffa80f4c640 1 -- 172.21.15.178:0/57653957 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffa7800a4a0 con 0x55ff81b05720 2024-09-21T09:05:04.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.593+0000 7ffa85430800 1 Processor -- start 2024-09-21T09:05:04.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.593+0000 7ffa85430800 1 -- start start 2024-09-21T09:05:04.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.594+0000 7ffa85430800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c16120 0x55ff81c16540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.594+0000 7ffa85430800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff8199d580 con 0x55ff81c16120 2024-09-21T09:05:04.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.594+0000 7ffa80f4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c16120 0x55ff81c16540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.594+0000 7ffa80f4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c16120 0x55ff81c16540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60924/0 (socket says 172.21.15.178:60924) 2024-09-21T09:05:04.597 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.594+0000 7ffa80f4c640 1 -- 172.21.15.178:0/429854440 learned_addr learned my addr 172.21.15.178:0/429854440 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.594+0000 7ffa80f4c640 1 -- 172.21.15.178:0/429854440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff81c16a80 con 0x55ff81c16120 2024-09-21T09:05:04.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.594+0000 7ffa80f4c640 1 --2- 172.21.15.178:0/429854440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c16120 0x55ff81c16540 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x55ff81bfc460 tx=0x7ffa780188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.595+0000 7ff965ffb640 1 -- 172.21.15.178:0/429854440 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa78014450 con 0x55ff81c16120 2024-09-21T09:05:04.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.595+0000 7ff965ffb640 1 -- 172.21.15.178:0/429854440 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa780145f0 con 0x55ff81c16120 2024-09-21T09:05:04.602 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.595+0000 7ffa85430800 1 -- 172.21.15.178:0/429854440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff81c16d10 con 0x55ff81c16120 2024-09-21T09:05:04.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.595+0000 7ff965ffb640 1 -- 172.21.15.178:0/429854440 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa780148d0 con 0x55ff81c16120 2024-09-21T09:05:04.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.595+0000 7ffa85430800 1 -- 172.21.15.178:0/429854440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff81c199f0 con 0x55ff81c16120 2024-09-21T09:05:04.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.595+0000 7ff965ffb640 1 -- 172.21.15.178:0/429854440 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffa78011040 con 0x55ff81c16120 2024-09-21T09:05:04.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.596+0000 7ff965ffb640 1 --2- 172.21.15.178:0/429854440 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff958036b40 0x7ff958039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.596+0000 7ff965ffb640 1 -- 172.21.15.178:0/429854440 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ffa7801e070 con 0x55ff81c16120 2024-09-21T09:05:04.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.596+0000 7ffa8074b640 1 --2- 172.21.15.178:0/429854440 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff958036b40 0x7ff958039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.596+0000 7ffa85430800 1 Processor -- start 2024-09-21T09:05:04.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.596+0000 7ffa85430800 1 -- start start 2024-09-21T09:05:04.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.596+0000 7ffa8074b640 1 --2- 172.21.15.178:0/429854440 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff958036b40 0x7ff958039000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55ff81c02df0 tx=0x7ffa700643b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.596+0000 7ffa85430800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c22dc0 0x55ff81c231c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.596+0000 7ffa85430800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff81b010f0 con 0x55ff81c22dc0 2024-09-21T09:05:04.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.596+0000 7ffa80f4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c22dc0 0x55ff81c231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.596+0000 7ffa80f4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c22dc0 0x55ff81c231c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60934/0 (socket says 172.21.15.178:60934) 2024-09-21T09:05:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.596+0000 7ffa80f4c640 1 -- 172.21.15.178:0/261896233 learned_addr learned my addr 172.21.15.178:0/261896233 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.597+0000 7ffa80f4c640 1 -- 172.21.15.178:0/261896233 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff81c23790 con 0x55ff81c22dc0 2024-09-21T09:05:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.597+0000 7ffa80f4c640 1 --2- 172.21.15.178:0/261896233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c22dc0 0x55ff81c231c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffa7804cb90 tx=0x7ffa78011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d14cc594cc073a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.597+0000 7ff95f7fe640 1 -- 172.21.15.178:0/261896233 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa78044070 con 0x55ff81c22dc0 2024-09-21T09:05:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.597+0000 7ff95f7fe640 1 -- 172.21.15.178:0/261896233 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa78013c90 con 0x55ff81c22dc0 2024-09-21T09:05:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.597+0000 7ff95f7fe640 1 -- 172.21.15.178:0/261896233 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa7802ba60 con 0x55ff81c22dc0 2024-09-21T09:05:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.597+0000 7ffa85430800 1 -- 172.21.15.178:0/261896233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c22dc0 msgr2=0x55ff81c231c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.597+0000 7ffa85430800 1 --2- 172.21.15.178:0/261896233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c22dc0 0x55ff81c231c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffa7804cb90 tx=0x7ffa78011700 comp rx=0 tx=0).stop 2024-09-21T09:05:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.597+0000 7ffa85430800 1 -- 172.21.15.178:0/261896233 shutdown_connections 2024-09-21T09:05:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.597+0000 7ffa85430800 1 --2- 172.21.15.178:0/261896233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c22dc0 0x55ff81c231c0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.597+0000 7ffa85430800 1 -- 172.21.15.178:0/261896233 >> 172.21.15.178:0/261896233 conn(0x55ff81c1f170 msgr2=0x55ff81c1d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.597+0000 7ffa85430800 1 -- 172.21.15.178:0/261896233 shutdown_connections 2024-09-21T09:05:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.597+0000 7ffa85430800 1 -- 172.21.15.178:0/261896233 wait complete. 2024-09-21T09:05:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.598+0000 7ffa85430800 1 Processor -- start 2024-09-21T09:05:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.598+0000 7ffa85430800 1 -- start start 2024-09-21T09:05:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.598+0000 7ffa85430800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c22dc0 0x55ff81c2a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.598+0000 7ffa85430800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff81c23d60 con 0x55ff81c22dc0 2024-09-21T09:05:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.598+0000 7ffa80f4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c22dc0 0x55ff81c2a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.598+0000 7ffa80f4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c22dc0 0x55ff81c2a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60950/0 (socket says 172.21.15.178:60950) 2024-09-21T09:05:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.598+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 learned_addr learned my addr 172.21.15.178:0/4260604467 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.598+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff81c2a750 con 0x55ff81c22dc0 2024-09-21T09:05:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.599+0000 7ffa80f4c640 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c22dc0 0x55ff81c2a210 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffa7804ba60 tx=0x7ffa7804cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.599+0000 7ff95dffb640 1 -- 172.21.15.178:0/4260604467 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa7803a020 con 0x55ff81c22dc0 2024-09-21T09:05:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.599+0000 7ff95dffb640 1 -- 172.21.15.178:0/4260604467 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7804e2e0 con 0x55ff81c22dc0 2024-09-21T09:05:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.599+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff81c2a9e0 con 0x55ff81c22dc0 2024-09-21T09:05:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.599+0000 7ff95dffb640 1 -- 172.21.15.178:0/4260604467 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa7802b350 con 0x55ff81c22dc0 2024-09-21T09:05:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.599+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff81c2d690 con 0x55ff81c22dc0 2024-09-21T09:05:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.599+0000 7ff95dffb640 1 -- 172.21.15.178:0/4260604467 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffa7803d020 con 0x55ff81c22dc0 2024-09-21T09:05:04.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.600+0000 7ff95dffb640 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff950036b40 0x7ff950039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.600+0000 7ff95dffb640 1 -- 172.21.15.178:0/4260604467 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ffa78033040 con 0x55ff81c22dc0 2024-09-21T09:05:04.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.600+0000 7ffa8074b640 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff950036b40 0x7ff950039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.600+0000 7ffa8074b640 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff950036b40 0x7ff950039000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ffa70064520 tx=0x7ffa70084000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.600+0000 7ffa85430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.600+0000 7ffa85430800 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ff81c35eb0 0x55ff81c38370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.600+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c38ac0 con 0x55ff81c35eb0 2024-09-21T09:05:04.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.600+0000 7ffa77fff640 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ff81c35eb0 0x55ff81c38370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.606 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa77fff640 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ff81c35eb0 0x55ff81c38370 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa6800f610 con 0x55ff81c35eb0 2024-09-21T09:05:04.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa85430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa85430800 20 realm 2024-09-21T09:05:04.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa85430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c35300 con 0x55ff81c35eb0 2024-09-21T09:05:04.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa6800f610 con 0x55ff81c35eb0 2024-09-21T09:05:04.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa85430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa85430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:04.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa85430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c395b0 con 0x55ff81c35eb0 2024-09-21T09:05:04.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa6800f610 con 0x55ff81c35eb0 2024-09-21T09:05:04.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa85430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa85430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.601+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c39e80 con 0x55ff81c35eb0 2024-09-21T09:05:04.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.602+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa6800f610 con 0x55ff81c35eb0 2024-09-21T09:05:04.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.602+0000 7ffa85430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:04.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.602+0000 7ffa85430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.602+0000 7ffa85430800 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ff81c3a8a0 0x55ff81c3cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.602+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c3d380 con 0x55ff81c3a8a0 2024-09-21T09:05:04.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.602+0000 7ffa80f4c640 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ff81c3a8a0 0x55ff81c3cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.602+0000 7ffa80f4c640 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ff81c3a8a0 0x55ff81c3cc90 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.603+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.603+0000 7ffa85430800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:04.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.603+0000 7ffa85430800 20 searching for the correct realm 2024-09-21T09:05:04.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.603+0000 7ffa85430800 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ff81c3f330 0x55ff81c417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.603+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3f330 2024-09-21T09:05:04.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.603+0000 7ffa8074b640 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ff81c3f330 0x55ff81c417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.603+0000 7ffa8074b640 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ff81c3f330 0x55ff81c417f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.603+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa70075030 con 0x55ff81c3f330 2024-09-21T09:05:04.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.603+0000 7ffa8074b640 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ffa700a5040 0x7ffa7004f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.603+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x7ffa700a5040 2024-09-21T09:05:04.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.603+0000 7ffa77fff640 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ffa700a5040 0x7ffa7004f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.604+0000 7ffa77fff640 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ffa700a5040 0x7ffa7004f360 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.604+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6800f610 con 0x7ffa700a5040 2024-09-21T09:05:04.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.604+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3a8a0 2024-09-21T09:05:04.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.604+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.604+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c35eb0 2024-09-21T09:05:04.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.605+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6800f610 con 0x55ff81c35eb0 2024-09-21T09:05:04.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.605+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c35eb0 2024-09-21T09:05:04.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.605+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802b040 con 0x55ff81c35eb0 2024-09-21T09:05:04.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.605+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3a8a0 2024-09-21T09:05:04.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.605+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.605+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3a8a0 2024-09-21T09:05:04.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.606+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.606+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x7ffa700a5040 2024-09-21T09:05:04.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.606+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802b040 con 0x7ffa700a5040 2024-09-21T09:05:04.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.606+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3f330 2024-09-21T09:05:04.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.606+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa70075030 con 0x55ff81c3f330 2024-09-21T09:05:04.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.606+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c35eb0 2024-09-21T09:05:04.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.606+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802b040 con 0x55ff81c35eb0 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.606+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3a8a0 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.607+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.607+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c35eb0 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.607+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802b040 con 0x55ff81c35eb0 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.607+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x7ffa700a5040 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.607+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffa6802b040 con 0x7ffa700a5040 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.607+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3f330 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.607+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa70075030 con 0x55ff81c3f330 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.607+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3f330 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.607+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa70075030 con 0x55ff81c3f330 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.608+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3a8a0 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.608+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.608+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3f330 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.608+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa70075030 con 0x55ff81c3f330 2024-09-21T09:05:04.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.608+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3f330 2024-09-21T09:05:04.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.608+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa700b5040 con 0x55ff81c3f330 2024-09-21T09:05:04.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.608+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c35eb0 2024-09-21T09:05:04.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.608+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffa6802b040 con 0x55ff81c35eb0 2024-09-21T09:05:04.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.608+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c35eb0 2024-09-21T09:05:04.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.609+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffa6802b040 con 0x55ff81c35eb0 2024-09-21T09:05:04.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.609+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3a8a0 2024-09-21T09:05:04.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.609+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.609+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3f330 2024-09-21T09:05:04.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.609+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa700b5040 con 0x55ff81c3f330 2024-09-21T09:05:04.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.609+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x7ffa700a5040 2024-09-21T09:05:04.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.609+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802b040 con 0x7ffa700a5040 2024-09-21T09:05:04.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.609+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c35eb0 2024-09-21T09:05:04.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.610+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802b040 con 0x55ff81c35eb0 2024-09-21T09:05:04.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.610+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3a8a0 2024-09-21T09:05:04.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.610+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.610+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3f330 2024-09-21T09:05:04.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.610+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa700b5040 con 0x55ff81c3f330 2024-09-21T09:05:04.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.610+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x7ffa700a5040 2024-09-21T09:05:04.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.611+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802b040 con 0x7ffa700a5040 2024-09-21T09:05:04.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.611+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x7ffa700a5040 2024-09-21T09:05:04.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.611+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802b040 con 0x7ffa700a5040 2024-09-21T09:05:04.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.611+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3f330 2024-09-21T09:05:04.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.611+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa700b5040 con 0x55ff81c3f330 2024-09-21T09:05:04.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.611+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c3a8a0 2024-09-21T09:05:04.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x55ff81c35eb0 2024-09-21T09:05:04.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffa6802b040 con 0x55ff81c35eb0 2024-09-21T09:05:04.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c41ec0 con 0x7ffa700a5040 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802b040 con 0x7ffa700a5040 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa85430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa85430800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa85430800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa85430800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa85430800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa85430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa85430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c3dd70 con 0x55ff81c35eb0 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x55ff81c35eb0 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa85430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa85430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.612+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c3d9b0 con 0x55ff81c35eb0 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa6803f040 con 0x55ff81c35eb0 2024-09-21T09:05:04.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:04.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c3e750 con 0x55ff81c35eb0 2024-09-21T09:05:04.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffa6803f040 con 0x55ff81c35eb0 2024-09-21T09:05:04.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:04.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 20 zone default found 2024-09-21T09:05:04.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 4 Realm: () 2024-09-21T09:05:04.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:04.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:04.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:04.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 20 zonegroup default 2024-09-21T09:05:04.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c3e230 con 0x55ff81c3a8a0 2024-09-21T09:05:04.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c446d0 con 0x55ff81c3f330 2024-09-21T09:05:04.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.613+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa700b5040 con 0x55ff81c3f330 2024-09-21T09:05:04.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.614+0000 7ffa85430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.614+0000 7ffa85430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.614+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c44a70 con 0x55ff81c3f330 2024-09-21T09:05:04.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.614+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa700b5040 con 0x55ff81c3f330 2024-09-21T09:05:04.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.614+0000 7ffa85430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.614+0000 7ffa85430800 20 started sync module instance, tier type = 2024-09-21T09:05:04.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.614+0000 7ffa85430800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:04.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.614+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c43b60 con 0x7ffa700a5040 2024-09-21T09:05:04.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.615+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x7ffa700a5040 2024-09-21T09:05:04.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.615+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94555882143872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c43b60 con 0x7ffa700a5040 2024-09-21T09:05:04.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.615+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c45470 con 0x55ff81c35eb0 2024-09-21T09:05:04.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.616+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94555882143872] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x7ffa700a5040 2024-09-21T09:05:04.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.616+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x55ff81c35eb0 2024-09-21T09:05:04.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.616+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94555882147712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c43b60 con 0x55ff81c35eb0 2024-09-21T09:05:04.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.616+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c45f20 con 0x55ff81c3f330 2024-09-21T09:05:04.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.617+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa700b5040 con 0x55ff81c3f330 2024-09-21T09:05:04.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.617+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94555882150400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c467c0 con 0x55ff81c3f330 2024-09-21T09:05:04.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.617+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c47260 con 0x7ffa700a5040 2024-09-21T09:05:04.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.618+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94555882147712] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x55ff81c35eb0 2024-09-21T09:05:04.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.618+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x7ffa700a5040 2024-09-21T09:05:04.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.618+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94555882155312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c47650 con 0x7ffa700a5040 2024-09-21T09:05:04.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.619+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c48070 con 0x55ff81c35eb0 2024-09-21T09:05:04.632 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.619+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94555882150400] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa700b5040 con 0x55ff81c3f330 2024-09-21T09:05:04.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.620+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94555882155312] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x7ffa700a5040 2024-09-21T09:05:04.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.620+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x55ff81c35eb0 2024-09-21T09:05:04.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.620+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94555882141360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c48030 con 0x55ff81c35eb0 2024-09-21T09:05:04.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.620+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c48910 con 0x55ff81c3a8a0 2024-09-21T09:05:04.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.621+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94555882141360] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x55ff81c35eb0 2024-09-21T09:05:04.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.621+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.621+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94555882161248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c48030 con 0x55ff81c3a8a0 2024-09-21T09:05:04.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.621+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c492d0 con 0x55ff81c3a8a0 2024-09-21T09:05:04.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.622+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94555882161248] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.622+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.622+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94555882158944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c492d0 con 0x55ff81c3a8a0 2024-09-21T09:05:04.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.622+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c49d10 con 0x55ff81c3a8a0 2024-09-21T09:05:04.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.623+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(58 notify.7 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.623+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94555882166240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c4a180 con 0x55ff81c3a8a0 2024-09-21T09:05:04.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.623+0000 7ffa85430800 20 add_watcher() i=0 2024-09-21T09:05:04.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.623+0000 7ffa85430800 20 add_watcher() i=1 2024-09-21T09:05:04.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.623+0000 7ffa85430800 20 add_watcher() i=2 2024-09-21T09:05:04.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.623+0000 7ffa85430800 20 add_watcher() i=3 2024-09-21T09:05:04.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.623+0000 7ffa85430800 20 add_watcher() i=4 2024-09-21T09:05:04.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.623+0000 7ffa85430800 20 add_watcher() i=5 2024-09-21T09:05:04.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.623+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94555882158944] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.623+0000 7ffa85430800 20 add_watcher() i=6 2024-09-21T09:05:04.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.624+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94555882166240] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.624+0000 7ffa85430800 20 add_watcher() i=7 2024-09-21T09:05:04.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.624+0000 7ffa85430800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:04.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.624+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c4a180 con 0x55ff81c35eb0 2024-09-21T09:05:04.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.624+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffa6803f040 con 0x55ff81c35eb0 2024-09-21T09:05:04.634 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.624+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94555882167504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c4a0f0 con 0x55ff81c35eb0 2024-09-21T09:05:04.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.625+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94555882167504] v31'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x55ff81c35eb0 2024-09-21T09:05:04.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.625+0000 7ff9367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:04.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.625+0000 7ffa85430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:04.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.625+0000 7ffa85430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:04.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.626+0000 7ffa85430800 5 note: GC not initialized 2024-09-21T09:05:04.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.626+0000 7ff9357e2640 20 reqs_thread_entry: start 2024-09-21T09:05:04.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.626+0000 7ffa85430800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:04.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.626+0000 7ffa85430800 20 Filter name: none 2024-09-21T09:05:04.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.626+0000 7ff8a6ffd640 20 reqs_thread_entry: start 2024-09-21T09:05:04.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.626+0000 7ffa85430800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T09:05:04.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.626+0000 7ffa85430800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.626+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c80620 con 0x55ff81c3a8a0 2024-09-21T09:05:04.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.627+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.635 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.627+0000 7ffa85430800 20 rados_obj.operate() r=0 bl.length=490 2024-09-21T09:05:04.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.627+0000 7ffa85430800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T09:05:04.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.627+0000 7ffa85430800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:04.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.627+0000 7ffa85430800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:05:04.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.627+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c86da0 con 0x55ff81c3a8a0 2024-09-21T09:05:04.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.628+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v31'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.628+0000 7ffa85430800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:04.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.628+0000 7ffa85430800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:04.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.628+0000 7ffa85430800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T09:05:04.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.628+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94555882415968 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c82380 con 0x55ff81c35eb0 2024-09-21T09:05:04.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.628+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== watch-notify(notify (1) cookie 94555882141360 notify 133143986205 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7ffa68018040 con 0x55ff81c35eb0 2024-09-21T09:05:04.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.629+0000 7ff95f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986205 cookie 94555882141360 notifier 4882 bl.length()=666 2024-09-21T09:05:04.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.629+0000 7ff95f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:04.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.629+0000 7ff95f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:04.636 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.629+0000 7ff95f7fe640 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7ff944003ea0 con 0x55ff81c35eb0 2024-09-21T09:05:04.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.629+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 notify.4 [notify cookie 94555882415968 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffa6803f040 con 0x55ff81c35eb0 2024-09-21T09:05:04.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.629+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify_complete (2) cookie 94555882415968 notify 133143986205 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ffa68009050 con 0x55ff81c35eb0 2024-09-21T09:05:04.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.629+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x55ff81c35eb0 2024-09-21T09:05:04.637 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T09:05:03.575855Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:05:03.575846Z","tags":[],"group_ids":[]} 2024-09-21T09:05:04.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.630+0000 7ff9367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:04.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.630+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94555882167504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c7e340 con 0x55ff81c35eb0 2024-09-21T09:05:04.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.631+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94555882167504] v31'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x55ff81c35eb0 2024-09-21T09:05:04.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.631+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94555882143872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c7e340 con 0x7ffa700a5040 2024-09-21T09:05:04.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.632+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94555882143872] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x7ffa700a5040 2024-09-21T09:05:04.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.632+0000 7ffa85430800 20 remove_watcher() i=0 2024-09-21T09:05:04.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.632+0000 7ffa85430800 2 removed watcher, disabling cache 2024-09-21T09:05:04.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.632+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94555882147712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c7e340 con 0x55ff81c35eb0 2024-09-21T09:05:04.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.633+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94555882147712] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x55ff81c35eb0 2024-09-21T09:05:04.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.633+0000 7ffa85430800 20 remove_watcher() i=1 2024-09-21T09:05:04.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.633+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94555882150400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c7e340 con 0x55ff81c3f330 2024-09-21T09:05:04.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.634+0000 7ffa8074b640 1 -- 172.21.15.178:0/4260604467 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94555882150400] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa700b5040 con 0x55ff81c3f330 2024-09-21T09:05:04.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.634+0000 7ffa85430800 20 remove_watcher() i=2 2024-09-21T09:05:04.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.634+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94555882155312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c44f80 con 0x7ffa700a5040 2024-09-21T09:05:04.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.635+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94555882155312] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x7ffa700a5040 2024-09-21T09:05:04.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.635+0000 7ffa85430800 20 remove_watcher() i=3 2024-09-21T09:05:04.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.635+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94555882141360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c46d30 con 0x55ff81c35eb0 2024-09-21T09:05:04.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.636+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94555882141360] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6803f040 con 0x55ff81c35eb0 2024-09-21T09:05:04.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.636+0000 7ffa85430800 20 remove_watcher() i=4 2024-09-21T09:05:04.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.636+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94555882161248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c44f80 con 0x55ff81c3a8a0 2024-09-21T09:05:04.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.637+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94555882161248] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.637+0000 7ffa85430800 20 remove_watcher() i=5 2024-09-21T09:05:04.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.637+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94555882158944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c436b0 con 0x55ff81c3a8a0 2024-09-21T09:05:04.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.638+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94555882158944] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.638+0000 7ffa85430800 20 remove_watcher() i=6 2024-09-21T09:05:04.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.638+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94555882166240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff81c44f80 con 0x55ff81c3a8a0 2024-09-21T09:05:04.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa80f4c640 1 -- 172.21.15.178:0/4260604467 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94555882166240] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7802a070 con 0x55ff81c3a8a0 2024-09-21T09:05:04.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa85430800 20 remove_watcher() i=7 2024-09-21T09:05:04.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ff81c3a8a0 msgr2=0x55ff81c3cc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa85430800 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ff81c3a8a0 0x55ff81c3cc90 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ff81c35eb0 msgr2=0x55ff81c38370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa85430800 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ff81c35eb0 0x55ff81c38370 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.644 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ffa700a5040 msgr2=0x7ffa7004f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa85430800 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ffa700a5040 0x7ffa7004f360 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ff81c3f330 msgr2=0x55ff81c417f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa85430800 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55ff81c3f330 0x55ff81c417f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff950036b40 msgr2=0x7ff950039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa85430800 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff950036b40 0x7ff950039000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ffa70064520 tx=0x7ffa70084000 comp rx=0 tx=0).stop 2024-09-21T09:05:04.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c22dc0 msgr2=0x55ff81c2a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa77fff640 1 -- 172.21.15.178:0/4260604467 reap_dead start 2024-09-21T09:05:04.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.639+0000 7ffa85430800 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c22dc0 0x55ff81c2a210 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffa7804ba60 tx=0x7ffa7804cb20 comp rx=0 tx=0).stop 2024-09-21T09:05:04.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 shutdown_connections 2024-09-21T09:05:04.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 --2- 172.21.15.178:0/4260604467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c22dc0 0x55ff81c2a210 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 >> 172.21.15.178:0/4260604467 conn(0x55ff81c1f170 msgr2=0x55ff81c1d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 shutdown_connections 2024-09-21T09:05:04.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/4260604467 wait complete. 2024-09-21T09:05:04.645 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/429854440 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff958036b40 msgr2=0x7ff958039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 --2- 172.21.15.178:0/429854440 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff958036b40 0x7ff958039000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55ff81c02df0 tx=0x7ffa700643b0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/429854440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c16120 msgr2=0x55ff81c16540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 --2- 172.21.15.178:0/429854440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c16120 0x55ff81c16540 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x55ff81bfc460 tx=0x7ffa780188f0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/429854440 shutdown_connections 2024-09-21T09:05:04.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 --2- 172.21.15.178:0/429854440 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff958036b40 0x7ff958039000 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 --2- 172.21.15.178:0/429854440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81c16120 0x55ff81c16540 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/429854440 >> 172.21.15.178:0/429854440 conn(0x55ff81c0b0b0 msgr2=0x55ff81c0dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/429854440 shutdown_connections 2024-09-21T09:05:04.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/429854440 wait complete. 2024-09-21T09:05:04.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ff81c04cd0 msgr2=0x55ff81c070c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ff81c04cd0 0x55ff81c070c0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ff81b05720 msgr2=0x55ff81c02420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ff81b05720 0x55ff81c02420 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff968036b90 msgr2=0x7ff968039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff968036b90 0x7ff968039050 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffa68000f60 tx=0x7ffa68001370 comp rx=0 tx=0).stop 2024-09-21T09:05:04.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 msgr2=0x55ff81bfb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81bfb3b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ffa70067040 tx=0x7ffa70002fb0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 shutdown_connections 2024-09-21T09:05:04.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55ff81c04cd0 0x55ff81c070c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.640+0000 7ffa85430800 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55ff81b05720 0x55ff81c02420 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.641+0000 7ffa85430800 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff968036b90 0x7ff968039050 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.641+0000 7ffa85430800 1 --2- 172.21.15.178:0/57653957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff81a75e30 0x55ff81bfb3b0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.641+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 >> 172.21.15.178:0/57653957 conn(0x55ff81afcdd0 msgr2=0x55ff81b01620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.641+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 shutdown_connections 2024-09-21T09:05:04.647 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.641+0000 7ffa85430800 1 -- 172.21.15.178:0/57653957 wait complete. 2024-09-21T09:05:04.651 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:04.651 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:04.651 ERROR:root:0 2024-09-21T09:05:04.651 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:04.655 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:04.656 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T09:05:04.656 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T09:05:04.656 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-21T09:05:04.702 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:04.702 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:04.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.701+0000 7f835a91f800 1 Processor -- start 2024-09-21T09:05:04.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.701+0000 7f835a91f800 1 -- start start 2024-09-21T09:05:04.703 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.701+0000 7f835a91f800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556e537d6880 0x556e537d8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.701+0000 7f835a91f800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556e53691b30 con 0x556e53745eb0 2024-09-21T09:05:04.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.701+0000 7f835a91f800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x556e53673360 con 0x556e537d6880 2024-09-21T09:05:04.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.701+0000 7f8355d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556e537d6880 0x556e537d8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.701+0000 7f835659c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x556e53745eb0 0x556e537d5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40560/0 (socket says 172.21.15.178:40560) 2024-09-21T09:05:04.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.701+0000 7f835659c640 1 -- 172.21.15.178:0/2019076480 learned_addr learned my addr 172.21.15.178:0/2019076480 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:05:04.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.701+0000 7f8355d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x556e537d6880 0x556e537d8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60956/0 (socket says 172.21.15.178:60956) 2024-09-21T09:05:04.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.702+0000 7f835559a640 1 -- 172.21.15.178:0/2019076480 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1258990197 0 0) 0x556e53691b30 con 0x556e53745eb0 2024-09-21T09:05:04.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.702+0000 7f835559a640 1 -- 172.21.15.178:0/2019076480 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8340001e10 con 0x556e53745eb0 2024-09-21T09:05:04.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.702+0000 7f8355d9b640 1 -- 172.21.15.178:0/2019076480 >> v1:172.21.15.44:6789/0 conn(0x556e53745eb0 legacy=0x556e537d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.702+0000 7f8355d9b640 1 -- 172.21.15.178:0/2019076480 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e53699e00 con 0x556e537d6880 2024-09-21T09:05:04.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.704+0000 7f8355d9b640 1 --2- 172.21.15.178:0/2019076480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e537d6880 0x556e537d8c90 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f834c00a470 tx=0x7f834c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47fce0ff3677d25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.704+0000 7f835559a640 1 -- 172.21.15.178:0/2019076480 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f834c059070 con 0x556e537d6880 2024-09-21T09:05:04.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.704+0000 7f835559a640 1 -- 172.21.15.178:0/2019076480 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834c054570 con 0x556e537d6880 2024-09-21T09:05:04.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.704+0000 7f835559a640 1 -- 172.21.15.178:0/2019076480 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f834c054870 con 0x556e537d6880 2024-09-21T09:05:04.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.704+0000 7f835a91f800 1 -- 172.21.15.178:0/2019076480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e537d6880 msgr2=0x556e537d8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.706 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.704+0000 7f835a91f800 1 --2- 172.21.15.178:0/2019076480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e537d6880 0x556e537d8c90 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f834c00a470 tx=0x7f834c045920 comp rx=0 tx=0).stop 2024-09-21T09:05:04.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.704+0000 7f835a91f800 1 -- 172.21.15.178:0/2019076480 shutdown_connections 2024-09-21T09:05:04.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.704+0000 7f835a91f800 1 --2- 172.21.15.178:0/2019076480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e537d6880 0x556e537d8c90 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.704+0000 7f835a91f800 1 -- 172.21.15.178:0/2019076480 >> 172.21.15.178:0/2019076480 conn(0x556e537ccdd0 msgr2=0x556e537cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.704+0000 7f835a91f800 1 -- 172.21.15.178:0/2019076480 shutdown_connections 2024-09-21T09:05:04.707 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.704+0000 7f835a91f800 1 -- 172.21.15.178:0/2019076480 wait complete. 2024-09-21T09:05:04.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.718+0000 7f835a91f800 1 Processor -- start 2024-09-21T09:05:04.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.718+0000 7f835a91f800 1 -- start start 2024-09-21T09:05:04.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.718+0000 7f835a91f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e53745eb0 0x556e538c1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.720 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.718+0000 7f835a91f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556e5371e360 con 0x556e53745eb0 2024-09-21T09:05:04.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.719+0000 7f835659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e53745eb0 0x556e538c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.719+0000 7f835659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e53745eb0 0x556e538c1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60970/0 (socket says 172.21.15.178:60970) 2024-09-21T09:05:04.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.719+0000 7f835659c640 1 -- 172.21.15.178:0/2245869686 learned_addr learned my addr 172.21.15.178:0/2245869686 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.719+0000 7f835659c640 1 -- 172.21.15.178:0/2245869686 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e5366bbc0 con 0x556e53745eb0 2024-09-21T09:05:04.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.719+0000 7f835659c640 1 --2- 172.21.15.178:0/2245869686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e53745eb0 0x556e538c1740 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8348001e30 tx=0x7f834800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae0e03b77bff2fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.719+0000 7f8244608640 1 -- 172.21.15.178:0/2245869686 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8348012020 con 0x556e53745eb0 2024-09-21T09:05:04.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.719+0000 7f8244608640 1 -- 172.21.15.178:0/2245869686 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834800e5a0 con 0x556e53745eb0 2024-09-21T09:05:04.721 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.719+0000 7f8244608640 1 -- 172.21.15.178:0/2245869686 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f834800e8e0 con 0x556e53745eb0 2024-09-21T09:05:04.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.720+0000 7f835a91f800 1 -- 172.21.15.178:0/2245869686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e53745eb0 msgr2=0x556e538c1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.720+0000 7f835a91f800 1 --2- 172.21.15.178:0/2245869686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e53745eb0 0x556e538c1740 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8348001e30 tx=0x7f834800b780 comp rx=0 tx=0).stop 2024-09-21T09:05:04.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.720+0000 7f835a91f800 1 -- 172.21.15.178:0/2245869686 shutdown_connections 2024-09-21T09:05:04.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.720+0000 7f835a91f800 1 --2- 172.21.15.178:0/2245869686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e53745eb0 0x556e538c1740 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.720+0000 7f835a91f800 1 -- 172.21.15.178:0/2245869686 >> 172.21.15.178:0/2245869686 conn(0x556e537ccdd0 msgr2=0x556e538bd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.720+0000 7f835a91f800 1 -- 172.21.15.178:0/2245869686 shutdown_connections 2024-09-21T09:05:04.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.720+0000 7f835a91f800 1 -- 172.21.15.178:0/2245869686 wait complete. 2024-09-21T09:05:04.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.720+0000 7f835a91f800 1 Processor -- start 2024-09-21T09:05:04.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.720+0000 7f835a91f800 1 -- start start 2024-09-21T09:05:04.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.721+0000 7f835a91f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e53745eb0 0x556e538c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.721+0000 7f835a91f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556e537d9610 con 0x556e53745eb0 2024-09-21T09:05:04.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.721+0000 7f835659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e53745eb0 0x556e538c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.721+0000 7f835659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e53745eb0 0x556e538c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60986/0 (socket says 172.21.15.178:60986) 2024-09-21T09:05:04.724 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.721+0000 7f835659c640 1 -- 172.21.15.178:0/2452501238 learned_addr learned my addr 172.21.15.178:0/2452501238 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.721+0000 7f835659c640 1 -- 172.21.15.178:0/2452501238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e5367ffe0 con 0x556e53745eb0 2024-09-21T09:05:04.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.721+0000 7f835659c640 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e53745eb0 0x556e538c9130 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8348001e30 tx=0x7f8348000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.721+0000 7f8242e05640 1 -- 172.21.15.178:0/2452501238 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8348012030 con 0x556e53745eb0 2024-09-21T09:05:04.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.722+0000 7f8242e05640 1 -- 172.21.15.178:0/2452501238 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8348001490 con 0x556e53745eb0 2024-09-21T09:05:04.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.722+0000 7f8242e05640 1 -- 172.21.15.178:0/2452501238 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f834801a8f0 con 0x556e53745eb0 2024-09-21T09:05:04.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.722+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e538c9670 con 0x556e53745eb0 2024-09-21T09:05:04.725 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.722+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e538c9b90 con 0x556e53745eb0 2024-09-21T09:05:04.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.722+0000 7f8242e05640 1 -- 172.21.15.178:0/2452501238 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8348015020 con 0x556e53745eb0 2024-09-21T09:05:04.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.722+0000 7f8242e05640 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f823c036b40 0x7f823c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.723+0000 7f8242e05640 1 -- 172.21.15.178:0/2452501238 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8348020030 con 0x556e53745eb0 2024-09-21T09:05:04.728 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.723+0000 7f8355d9b640 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f823c036b40 0x7f823c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.723+0000 7f835a91f800 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556e537d6880 0x556e538d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.723+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e538d0770 con 0x556e537d6880 2024-09-21T09:05:04.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.723+0000 7f8356d9d640 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556e537d6880 0x556e538d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.723+0000 7f8355d9b640 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f823c036b40 0x7f823c039000 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x556e537455f0 tx=0x7f834c050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.723+0000 7f8356d9d640 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556e537d6880 0x556e538d01a0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.723+0000 7f8356d9d640 1 -- 172.21.15.178:0/2452501238 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f835000a4a0 con 0x556e537d6880 2024-09-21T09:05:04.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.723+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e538cd6c0 con 0x556e537d6880 2024-09-21T09:05:04.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.724+0000 7f8356d9d640 1 -- 172.21.15.178:0/2452501238 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f835000a4a0 con 0x556e537d6880 2024-09-21T09:05:04.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.724+0000 7f835a91f800 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556e538d2800 0x556e538d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.724+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e538d5450 con 0x556e538d2800 2024-09-21T09:05:04.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.724+0000 7f835659c640 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556e538d2800 0x556e538d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.724+0000 7f835659c640 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556e538d2800 0x556e538d4cc0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.725+0000 7f835659c640 1 -- 172.21.15.178:0/2452501238 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8348026d90 con 0x556e538d2800 2024-09-21T09:05:04.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.725+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e538d1030 con 0x556e537d6880 2024-09-21T09:05:04.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.725+0000 7f8356d9d640 1 -- 172.21.15.178:0/2452501238 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f835000a4a0 con 0x556e537d6880 2024-09-21T09:05:04.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.725+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e538d1450 con 0x556e537d6880 2024-09-21T09:05:04.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.725+0000 7f8356d9d640 1 -- 172.21.15.178:0/2452501238 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f835000a4a0 con 0x556e537d6880 2024-09-21T09:05:04.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.725+0000 7f835a91f800 1 Processor -- start 2024-09-21T09:05:04.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.726+0000 7f835a91f800 1 -- start start 2024-09-21T09:05:04.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.726+0000 7f835a91f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538e3e10 0x556e538e4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.726+0000 7f835a91f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556e5366d580 con 0x556e538e3e10 2024-09-21T09:05:04.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.726+0000 7f8356d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538e3e10 0x556e538e4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.726+0000 7f8356d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538e3e10 0x556e538e4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:60992/0 (socket says 172.21.15.178:60992) 2024-09-21T09:05:04.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.726+0000 7f8356d9d640 1 -- 172.21.15.178:0/1548084932 learned_addr learned my addr 172.21.15.178:0/1548084932 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.726+0000 7f8356d9d640 1 -- 172.21.15.178:0/1548084932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e538e4770 con 0x556e538e3e10 2024-09-21T09:05:04.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.726+0000 7f8356d9d640 1 --2- 172.21.15.178:0/1548084932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538e3e10 0x556e538e4230 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x556e538ca1e0 tx=0x7f83500188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.726+0000 7f823bfff640 1 -- 172.21.15.178:0/1548084932 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8350014450 con 0x556e538e3e10 2024-09-21T09:05:04.730 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.727+0000 7f835a91f800 1 -- 172.21.15.178:0/1548084932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e538e4a00 con 0x556e538e3e10 2024-09-21T09:05:04.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.727+0000 7f823bfff640 1 -- 172.21.15.178:0/1548084932 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83500145f0 con 0x556e538e3e10 2024-09-21T09:05:04.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.727+0000 7f823bfff640 1 -- 172.21.15.178:0/1548084932 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83500148d0 con 0x556e538e3e10 2024-09-21T09:05:04.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.727+0000 7f835a91f800 1 -- 172.21.15.178:0/1548084932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e538e76e0 con 0x556e538e3e10 2024-09-21T09:05:04.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.727+0000 7f823bfff640 1 -- 172.21.15.178:0/1548084932 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8350011040 con 0x556e538e3e10 2024-09-21T09:05:04.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.727+0000 7f823bfff640 1 --2- 172.21.15.178:0/1548084932 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8230036b40 0x7f8230039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.728+0000 7f823bfff640 1 -- 172.21.15.178:0/1548084932 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f835001e070 con 0x556e538e3e10 2024-09-21T09:05:04.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.728+0000 7f835659c640 1 --2- 172.21.15.178:0/1548084932 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8230036b40 0x7f8230039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.728+0000 7f835a91f800 1 Processor -- start 2024-09-21T09:05:04.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.728+0000 7f835a91f800 1 -- start start 2024-09-21T09:05:04.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.728+0000 7f835659c640 1 --2- 172.21.15.178:0/1548084932 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8230036b40 0x7f8230039000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x556e538d1b90 tx=0x7f834800dcd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.728+0000 7f835a91f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538f0ae0 0x556e538f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.728+0000 7f835a91f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556e538c1ef0 con 0x556e538f0ae0 2024-09-21T09:05:04.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.728+0000 7f8356d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538f0ae0 0x556e538f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.728+0000 7f8356d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538f0ae0 0x556e538f0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32770/0 (socket says 172.21.15.178:32770) 2024-09-21T09:05:04.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.728+0000 7f8356d9d640 1 -- 172.21.15.178:0/1111274608 learned_addr learned my addr 172.21.15.178:0/1111274608 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.728+0000 7f8356d9d640 1 -- 172.21.15.178:0/1111274608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e538f14b0 con 0x556e538f0ae0 2024-09-21T09:05:04.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.729+0000 7f8356d9d640 1 --2- 172.21.15.178:0/1111274608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538f0ae0 0x556e538f0ee0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f835004cb90 tx=0x7f8350011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23c3d18b8b0ecc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.729+0000 7f8239ffb640 1 -- 172.21.15.178:0/1111274608 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8350044070 con 0x556e538f0ae0 2024-09-21T09:05:04.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.729+0000 7f8239ffb640 1 -- 172.21.15.178:0/1111274608 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8350013c90 con 0x556e538f0ae0 2024-09-21T09:05:04.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.729+0000 7f8239ffb640 1 -- 172.21.15.178:0/1111274608 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f835002ba60 con 0x556e538f0ae0 2024-09-21T09:05:04.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.729+0000 7f835a91f800 1 -- 172.21.15.178:0/1111274608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538f0ae0 msgr2=0x556e538f0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.729+0000 7f835a91f800 1 --2- 172.21.15.178:0/1111274608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538f0ae0 0x556e538f0ee0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f835004cb90 tx=0x7f8350011700 comp rx=0 tx=0).stop 2024-09-21T09:05:04.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.729+0000 7f835a91f800 1 -- 172.21.15.178:0/1111274608 shutdown_connections 2024-09-21T09:05:04.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.729+0000 7f835a91f800 1 --2- 172.21.15.178:0/1111274608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538f0ae0 0x556e538f0ee0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.729+0000 7f835a91f800 1 -- 172.21.15.178:0/1111274608 >> 172.21.15.178:0/1111274608 conn(0x556e538ece40 msgr2=0x556e538eaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.729+0000 7f835a91f800 1 -- 172.21.15.178:0/1111274608 shutdown_connections 2024-09-21T09:05:04.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.729+0000 7f835a91f800 1 -- 172.21.15.178:0/1111274608 wait complete. 2024-09-21T09:05:04.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.729+0000 7f835a91f800 1 Processor -- start 2024-09-21T09:05:04.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.730+0000 7f835a91f800 1 -- start start 2024-09-21T09:05:04.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.730+0000 7f835a91f800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538f0ae0 0x556e538f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.730+0000 7f835a91f800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556e538f1a30 con 0x556e538f0ae0 2024-09-21T09:05:04.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.730+0000 7f8356d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538f0ae0 0x556e538f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.730+0000 7f8356d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538f0ae0 0x556e538f7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32772/0 (socket says 172.21.15.178:32772) 2024-09-21T09:05:04.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.730+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 learned_addr learned my addr 172.21.15.178:0/3584034308 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.730+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e538f8470 con 0x556e538f0ae0 2024-09-21T09:05:04.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.730+0000 7f8356d9d640 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538f0ae0 0x556e538f7f30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f835004ba60 tx=0x7f835004cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.730+0000 7f8227fff640 1 -- 172.21.15.178:0/3584034308 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f835003a020 con 0x556e538f0ae0 2024-09-21T09:05:04.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.730+0000 7f8227fff640 1 -- 172.21.15.178:0/3584034308 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f835004e2e0 con 0x556e538f0ae0 2024-09-21T09:05:04.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.730+0000 7f8227fff640 1 -- 172.21.15.178:0/3584034308 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f835002b350 con 0x556e538f0ae0 2024-09-21T09:05:04.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.731+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e538f8700 con 0x556e538f0ae0 2024-09-21T09:05:04.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.731+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e538fb3b0 con 0x556e538f0ae0 2024-09-21T09:05:04.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.731+0000 7f8227fff640 1 -- 172.21.15.178:0/3584034308 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f835003d020 con 0x556e538f0ae0 2024-09-21T09:05:04.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.731+0000 7f8227fff640 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8220036b40 0x7f8220039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.731+0000 7f8227fff640 1 -- 172.21.15.178:0/3584034308 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8350033040 con 0x556e538f0ae0 2024-09-21T09:05:04.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.732+0000 7f835659c640 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8220036b40 0x7f8220039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.732+0000 7f835659c640 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8220036b40 0x7f8220039000 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8348044510 tx=0x7f8348034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.732+0000 7f835a91f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.732+0000 7f835a91f800 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556e53903b50 0x556e53906010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.732+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e53906760 con 0x556e53903b50 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.732+0000 7f8355d9b640 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556e53903b50 0x556e53906010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f8355d9b640 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556e53903b50 0x556e53906010 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f835a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f835a91f800 20 realm 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f835a91f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e53906b90 con 0x556e53903b50 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f835a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f835a91f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f835a91f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e53907460 con 0x556e53903b50 2024-09-21T09:05:04.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f835a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f835a91f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.733+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e53907800 con 0x556e53903b50 2024-09-21T09:05:04.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.734+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.734+0000 7f835a91f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:04.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.734+0000 7f835a91f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.734+0000 7f835a91f800 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556e53908560 0x556e5390a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.734+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e5390afa0 con 0x556e53908560 2024-09-21T09:05:04.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.734+0000 7f8356d9d640 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556e53908560 0x556e5390a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.734+0000 7f8356d9d640 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556e53908560 0x556e5390a950 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.734+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.734+0000 7f835a91f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:04.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.734+0000 7f835a91f800 20 searching for the correct realm 2024-09-21T09:05:04.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.734+0000 7f835a91f800 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556e5390cf50 0x556e5390f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.734+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e5390cf50 2024-09-21T09:05:04.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.734+0000 7f835659c640 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556e5390cf50 0x556e5390f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.735+0000 7f835659c640 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556e5390cf50 0x556e5390f410 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.735+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8348018430 con 0x556e5390cf50 2024-09-21T09:05:04.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.735+0000 7f835659c640 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f834803a040 0x7f834802d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.735+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x7f834803a040 2024-09-21T09:05:04.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.735+0000 7f8355d9b640 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f834803a040 0x7f834802d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.735+0000 7f8355d9b640 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f834803a040 0x7f834802d3f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.736+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834c05c040 con 0x7f834803a040 2024-09-21T09:05:04.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.736+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53908560 2024-09-21T09:05:04.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.736+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.736+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53903b50 2024-09-21T09:05:04.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.736+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.736+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53903b50 2024-09-21T09:05:04.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.736+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.736+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53908560 2024-09-21T09:05:04.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.737+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.737+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53908560 2024-09-21T09:05:04.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.737+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.737+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x7f834803a040 2024-09-21T09:05:04.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.737+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834c05c040 con 0x7f834803a040 2024-09-21T09:05:04.750 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.737+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e5390cf50 2024-09-21T09:05:04.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.737+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8348018430 con 0x556e5390cf50 2024-09-21T09:05:04.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.737+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53903b50 2024-09-21T09:05:04.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.738+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.738+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53908560 2024-09-21T09:05:04.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.738+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.738+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53903b50 2024-09-21T09:05:04.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.738+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.738+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x7f834803a040 2024-09-21T09:05:04.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.738+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f834c05c040 con 0x7f834803a040 2024-09-21T09:05:04.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.738+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e5390cf50 2024-09-21T09:05:04.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.739+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8348018430 con 0x556e5390cf50 2024-09-21T09:05:04.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.739+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e5390cf50 2024-09-21T09:05:04.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.739+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8348018430 con 0x556e5390cf50 2024-09-21T09:05:04.751 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.739+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53908560 2024-09-21T09:05:04.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.739+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.739+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e5390cf50 2024-09-21T09:05:04.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.739+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8348018430 con 0x556e5390cf50 2024-09-21T09:05:04.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.739+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e5390cf50 2024-09-21T09:05:04.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.739+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8348018430 con 0x556e5390cf50 2024-09-21T09:05:04.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.740+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53903b50 2024-09-21T09:05:04.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.740+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.740+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53903b50 2024-09-21T09:05:04.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.740+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.740+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53908560 2024-09-21T09:05:04.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.740+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.740+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e5390cf50 2024-09-21T09:05:04.752 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.741+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8348018430 con 0x556e5390cf50 2024-09-21T09:05:04.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.741+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x7f834803a040 2024-09-21T09:05:04.753 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.741+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834c05c040 con 0x7f834803a040 2024-09-21T09:05:04.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.741+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53903b50 2024-09-21T09:05:04.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.741+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.741+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53908560 2024-09-21T09:05:04.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.741+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.741+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e5390cf50 2024-09-21T09:05:04.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.742+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8348018430 con 0x556e5390cf50 2024-09-21T09:05:04.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.742+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x7f834803a040 2024-09-21T09:05:04.754 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.742+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834c05c040 con 0x7f834803a040 2024-09-21T09:05:04.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.742+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x7f834803a040 2024-09-21T09:05:04.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.742+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834c05c040 con 0x7f834803a040 2024-09-21T09:05:04.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.742+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e5390cf50 2024-09-21T09:05:04.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.742+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8348018430 con 0x556e5390cf50 2024-09-21T09:05:04.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.742+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53908560 2024-09-21T09:05:04.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x556e53903b50 2024-09-21T09:05:04.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556e5390fae0 con 0x7f834803a040 2024-09-21T09:05:04.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834c05c040 con 0x7f834803a040 2024-09-21T09:05:04.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f835a91f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:04.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f835a91f800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:04.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f835a91f800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:04.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f835a91f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:04.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f835a91f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:04.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f835a91f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:04.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f835a91f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e5390b990 con 0x556e53903b50 2024-09-21T09:05:04.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f835a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f835a91f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e5390c230 con 0x556e53903b50 2024-09-21T09:05:04.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f835a91f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:04.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f835a91f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.743+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e5390b5d0 con 0x556e53903b50 2024-09-21T09:05:04.756 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:04.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 20 zone default found 2024-09-21T09:05:04.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 4 Realm: () 2024-09-21T09:05:04.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:04.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:04.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:04.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 20 zonegroup default 2024-09-21T09:05:04.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e5390ff60 con 0x556e53908560 2024-09-21T09:05:04.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e5390bf00 con 0x556e5390cf50 2024-09-21T09:05:04.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8348018430 con 0x556e5390cf50 2024-09-21T09:05:04.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.744+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e53912250 con 0x556e5390cf50 2024-09-21T09:05:04.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.745+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8348018430 con 0x556e5390cf50 2024-09-21T09:05:04.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.745+0000 7f835a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.745+0000 7f835a91f800 20 started sync module instance, tier type = 2024-09-21T09:05:04.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.745+0000 7f835a91f800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:04.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.745+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53911620 con 0x7f834803a040 2024-09-21T09:05:04.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.746+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x7f834803a040 2024-09-21T09:05:04.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.746+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93932336782144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53911620 con 0x7f834803a040 2024-09-21T09:05:04.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.746+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53912d10 con 0x556e53903b50 2024-09-21T09:05:04.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.747+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93932336782144] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x7f834803a040 2024-09-21T09:05:04.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.747+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.747+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93932336785440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53911620 con 0x556e53903b50 2024-09-21T09:05:04.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.747+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53913760 con 0x556e5390cf50 2024-09-21T09:05:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.748+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93932336785440] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.748+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8348018430 con 0x556e5390cf50 2024-09-21T09:05:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.748+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93932336779632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53911590 con 0x556e5390cf50 2024-09-21T09:05:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.748+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53914620 con 0x7f834803a040 2024-09-21T09:05:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.749+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93932336779632] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8348018430 con 0x556e5390cf50 2024-09-21T09:05:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.749+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x7f834803a040 2024-09-21T09:05:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.749+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93932336791920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53914a40 con 0x7f834803a040 2024-09-21T09:05:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.749+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53915400 con 0x556e53903b50 2024-09-21T09:05:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.750+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93932336791920] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x7f834803a040 2024-09-21T09:05:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.751+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.751+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93932336793456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53915400 con 0x556e53903b50 2024-09-21T09:05:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.751+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53915dc0 con 0x556e53908560 2024-09-21T09:05:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.752+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.752+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93932336797968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53916610 con 0x556e53908560 2024-09-21T09:05:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.752+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e539170d0 con 0x556e53908560 2024-09-21T09:05:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.752+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93932336793456] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.753+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93932336797968] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.753+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.753+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93932336800096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53914f50 con 0x556e53908560 2024-09-21T09:05:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.753+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e539176b0 con 0x556e53908560 2024-09-21T09:05:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.754+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(58 notify.7 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.754+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93932336800096] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.754+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93932336804352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53917ad0 con 0x556e53908560 2024-09-21T09:05:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.754+0000 7f835a91f800 20 add_watcher() i=0 2024-09-21T09:05:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.754+0000 7f835a91f800 20 add_watcher() i=1 2024-09-21T09:05:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.754+0000 7f835a91f800 20 add_watcher() i=2 2024-09-21T09:05:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.754+0000 7f835a91f800 20 add_watcher() i=3 2024-09-21T09:05:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.754+0000 7f835a91f800 20 add_watcher() i=4 2024-09-21T09:05:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.754+0000 7f835a91f800 20 add_watcher() i=5 2024-09-21T09:05:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.754+0000 7f835a91f800 20 add_watcher() i=6 2024-09-21T09:05:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.754+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93932336804352] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.755+0000 7f835a91f800 20 add_watcher() i=7 2024-09-21T09:05:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.755+0000 7f835a91f800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.755+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e5391ab00 con 0x556e53903b50 2024-09-21T09:05:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.755+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.755+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93932336805408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53917fc0 con 0x556e53903b50 2024-09-21T09:05:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.756+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93932336805408] v31'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.756+0000 7f820cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.756+0000 7f835a91f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.756+0000 7f835a91f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.756+0000 7f835a91f800 5 note: GC not initialized 2024-09-21T09:05:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.756+0000 7f81877fe640 20 reqs_thread_entry: start 2024-09-21T09:05:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.756+0000 7f835a91f800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.757+0000 7f835a91f800 20 Filter name: none 2024-09-21T09:05:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.757+0000 7f81857fa640 20 reqs_thread_entry: start 2024-09-21T09:05:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.757+0000 7f835a91f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T09:05:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.757+0000 7f835a91f800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.757+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e5394de50 con 0x556e53908560 2024-09-21T09:05:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.758+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.758+0000 7f835a91f800 20 rados_obj.operate() r=0 bl.length=490 2024-09-21T09:05:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.758+0000 7f835a91f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T09:05:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.758+0000 7f835a91f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.758+0000 7f835a91f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:05:04.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.758+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53954610 con 0x556e53908560 2024-09-21T09:05:04.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.759+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v31'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.759+0000 7f835a91f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:04.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.759+0000 7f835a91f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:04.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.759+0000 7f835a91f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T09:05:04.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.759+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93932337053648 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556e5394fbf0 con 0x556e53903b50 2024-09-21T09:05:04.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.759+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== watch-notify(notify (1) cookie 93932336793456 notify 133143986206 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7f834c075040 con 0x556e53903b50 2024-09-21T09:05:04.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.759+0000 7f8239ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986206 cookie 93932336793456 notifier 4889 bl.length()=679 2024-09-21T09:05:04.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.759+0000 7f8239ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:04.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.759+0000 7f8239ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:04.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.759+0000 7f8239ffb640 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f821c003ea0 con 0x556e53903b50 2024-09-21T09:05:04.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.759+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 notify.4 [notify cookie 93932337053648 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.760+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify_complete (2) cookie 93932337053648 notify 133143986206 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f834c068040 con 0x556e53903b50 2024-09-21T09:05:04.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.760+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.769 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T09:05:03.575855Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:05:03.575846Z","tags":[],"group_ids":[]} 2024-09-21T09:05:04.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.760+0000 7f820cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:04.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.760+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93932336805408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e5394bb90 con 0x556e53903b50 2024-09-21T09:05:04.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.761+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93932336805408] v31'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.761+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93932336782144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e5394bb90 con 0x7f834803a040 2024-09-21T09:05:04.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.762+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93932336782144] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x7f834803a040 2024-09-21T09:05:04.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.762+0000 7f835a91f800 20 remove_watcher() i=0 2024-09-21T09:05:04.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.762+0000 7f835a91f800 2 removed watcher, disabling cache 2024-09-21T09:05:04.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.762+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93932336785440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e5394bb90 con 0x556e53903b50 2024-09-21T09:05:04.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.763+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93932336785440] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.763+0000 7f835a91f800 20 remove_watcher() i=1 2024-09-21T09:05:04.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.763+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93932336779632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e5394bb90 con 0x556e5390cf50 2024-09-21T09:05:04.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.765+0000 7f835659c640 1 -- 172.21.15.178:0/3584034308 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93932336779632] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8348018430 con 0x556e5390cf50 2024-09-21T09:05:04.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.765+0000 7f835a91f800 20 remove_watcher() i=2 2024-09-21T09:05:04.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.765+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93932336791920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53912820 con 0x7f834803a040 2024-09-21T09:05:04.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.765+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93932336791920] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x7f834803a040 2024-09-21T09:05:04.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.765+0000 7f835a91f800 20 remove_watcher() i=3 2024-09-21T09:05:04.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.765+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93932336793456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53911170 con 0x556e53903b50 2024-09-21T09:05:04.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.766+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93932336793456] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834c05c040 con 0x556e53903b50 2024-09-21T09:05:04.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.767+0000 7f835a91f800 20 remove_watcher() i=4 2024-09-21T09:05:04.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.767+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93932336797968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53914170 con 0x556e53908560 2024-09-21T09:05:04.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.768+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93932336797968] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.768+0000 7f835a91f800 20 remove_watcher() i=5 2024-09-21T09:05:04.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.768+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93932336800096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53912820 con 0x556e53908560 2024-09-21T09:05:04.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.769+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93932336800096] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.769+0000 7f835a91f800 20 remove_watcher() i=6 2024-09-21T09:05:04.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.769+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93932336804352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556e53914770 con 0x556e53908560 2024-09-21T09:05:04.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f8356d9d640 1 -- 172.21.15.178:0/3584034308 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93932336804352] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f835002a070 con 0x556e53908560 2024-09-21T09:05:04.775 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 20 remove_watcher() i=7 2024-09-21T09:05:04.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556e53908560 msgr2=0x556e5390a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556e53908560 0x556e5390a950 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556e53903b50 msgr2=0x556e53906010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556e53903b50 0x556e53906010 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f834803a040 msgr2=0x7f834802d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f834803a040 0x7f834802d3f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556e5390cf50 msgr2=0x556e5390f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x556e5390cf50 0x556e5390f410 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8220036b40 msgr2=0x7f8220039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8220036b40 0x7f8220039000 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8348044510 tx=0x7f8348034000 comp rx=0 tx=0).stop 2024-09-21T09:05:04.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538f0ae0 msgr2=0x556e538f7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f8355d9b640 1 -- 172.21.15.178:0/3584034308 reap_dead start 2024-09-21T09:05:04.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538f0ae0 0x556e538f7f30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f835004ba60 tx=0x7f835004cb20 comp rx=0 tx=0).stop 2024-09-21T09:05:04.776 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 shutdown_connections 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 --2- 172.21.15.178:0/3584034308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538f0ae0 0x556e538f7f30 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 >> 172.21.15.178:0/3584034308 conn(0x556e538ece40 msgr2=0x556e538eaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 shutdown_connections 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/3584034308 wait complete. 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/1548084932 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8230036b40 msgr2=0x7f8230039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 --2- 172.21.15.178:0/1548084932 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8230036b40 0x7f8230039000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x556e538d1b90 tx=0x7f834800dcd0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/1548084932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538e3e10 msgr2=0x556e538e4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 --2- 172.21.15.178:0/1548084932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538e3e10 0x556e538e4230 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x556e538ca1e0 tx=0x7f83500188f0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/1548084932 shutdown_connections 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 --2- 172.21.15.178:0/1548084932 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f8230036b40 0x7f8230039000 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 --2- 172.21.15.178:0/1548084932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e538e3e10 0x556e538e4230 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/1548084932 >> 172.21.15.178:0/1548084932 conn(0x556e538d8da0 msgr2=0x556e538db920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.770+0000 7f835a91f800 1 -- 172.21.15.178:0/1548084932 shutdown_connections 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 -- 172.21.15.178:0/1548084932 wait complete. 2024-09-21T09:05:04.777 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556e538d2800 msgr2=0x556e538d4cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556e538d2800 0x556e538d4cc0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556e537d6880 msgr2=0x556e538d01a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556e537d6880 0x556e538d01a0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f823c036b40 msgr2=0x7f823c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f823c036b40 0x7f823c039000 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x556e537455f0 tx=0x7f834c050000 comp rx=0 tx=0).stop 2024-09-21T09:05:04.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e53745eb0 msgr2=0x556e538c9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e53745eb0 0x556e538c9130 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8348001e30 tx=0x7f8348000ed0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 shutdown_connections 2024-09-21T09:05:04.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x556e538d2800 0x556e538d4cc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x556e537d6880 0x556e538d01a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f823c036b40 0x7f823c039000 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 --2- 172.21.15.178:0/2452501238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e53745eb0 0x556e538c9130 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 >> 172.21.15.178:0/2452501238 conn(0x556e537ccdd0 msgr2=0x556e538bb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 shutdown_connections 2024-09-21T09:05:04.779 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.771+0000 7f835a91f800 1 -- 172.21.15.178:0/2452501238 wait complete. 2024-09-21T09:05:04.781 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:04.782 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:04.782 ERROR:root:0 2024-09-21T09:05:04.782 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:04.786 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:04.786 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-21T09:05:04.786 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-21T09:05:04.786 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-21T09:05:04.832 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:04.832 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:04.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.831+0000 7f6e34215800 1 Processor -- start 2024-09-21T09:05:04.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.831+0000 7f6e34215800 1 -- start start 2024-09-21T09:05:04.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.831+0000 7f6e34215800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55724e3b7e10 0x55724e449600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.831+0000 7f6e34215800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55724e303b30 con 0x55724e449b40 2024-09-21T09:05:04.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.831+0000 7f6e34215800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55724e2e5360 con 0x55724e3b7e10 2024-09-21T09:05:04.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.831+0000 7f6e2f99c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55724e3b7e10 0x55724e449600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.831+0000 7f6e2f99c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55724e3b7e10 0x55724e449600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32780/0 (socket says 172.21.15.178:32780) 2024-09-21T09:05:04.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.831+0000 7f6e2f99c640 1 -- 172.21.15.178:0/748117852 learned_addr learned my addr 172.21.15.178:0/748117852 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.832+0000 7f6e2f99c640 1 -- 172.21.15.178:0/748117852 >> v1:172.21.15.44:6789/0 conn(0x55724e449b40 legacy=0x55724e44bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.832+0000 7f6e2f99c640 1 -- 172.21.15.178:0/748117852 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55724e30be00 con 0x55724e3b7e10 2024-09-21T09:05:04.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.833+0000 7f6e2f99c640 1 --2- 172.21.15.178:0/748117852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e449600 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000a520 tx=0x7f6e20045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5ff9a4e47df981 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.834+0000 7f6e2f19b640 1 -- 172.21.15.178:0/748117852 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e20055070 con 0x55724e3b7e10 2024-09-21T09:05:04.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.834+0000 7f6e2f19b640 1 -- 172.21.15.178:0/748117852 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e200515b0 con 0x55724e3b7e10 2024-09-21T09:05:04.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.834+0000 7f6e2f19b640 1 -- 172.21.15.178:0/748117852 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e200518d0 con 0x55724e3b7e10 2024-09-21T09:05:04.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.834+0000 7f6e34215800 1 -- 172.21.15.178:0/748117852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 msgr2=0x55724e449600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.834+0000 7f6e34215800 1 --2- 172.21.15.178:0/748117852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e449600 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000a520 tx=0x7f6e20045ba0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.834+0000 7f6e34215800 1 -- 172.21.15.178:0/748117852 shutdown_connections 2024-09-21T09:05:04.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.834+0000 7f6e34215800 1 --2- 172.21.15.178:0/748117852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e449600 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.834+0000 7f6e34215800 1 -- 172.21.15.178:0/748117852 >> 172.21.15.178:0/748117852 conn(0x55724e43edd0 msgr2=0x55724e4411f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.834+0000 7f6e34215800 1 -- 172.21.15.178:0/748117852 shutdown_connections 2024-09-21T09:05:04.837 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.834+0000 7f6e34215800 1 -- 172.21.15.178:0/748117852 wait complete. 2024-09-21T09:05:04.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.848+0000 7f6e34215800 1 Processor -- start 2024-09-21T09:05:04.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.848+0000 7f6e34215800 1 -- start start 2024-09-21T09:05:04.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.848+0000 7f6e34215800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e535b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.848+0000 7f6e34215800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55724e390360 con 0x55724e3b7e10 2024-09-21T09:05:04.850 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.849+0000 7f6e2f99c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e535b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.849+0000 7f6e2f99c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e535b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32790/0 (socket says 172.21.15.178:32790) 2024-09-21T09:05:04.851 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.849+0000 7f6e2f99c640 1 -- 172.21.15.178:0/3728029120 learned_addr learned my addr 172.21.15.178:0/3728029120 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.849+0000 7f6e2f99c640 1 -- 172.21.15.178:0/3728029120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55724e2ddbc0 con 0x55724e3b7e10 2024-09-21T09:05:04.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.849+0000 7f6e2f99c640 1 --2- 172.21.15.178:0/3728029120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e535b00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6e20025da0 tx=0x7f6e20051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7019974f7fd526b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.849+0000 7f6d1de0b640 1 -- 172.21.15.178:0/3728029120 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e20051950 con 0x55724e3b7e10 2024-09-21T09:05:04.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.849+0000 7f6d1de0b640 1 -- 172.21.15.178:0/3728029120 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e20051af0 con 0x55724e3b7e10 2024-09-21T09:05:04.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.849+0000 7f6d1de0b640 1 -- 172.21.15.178:0/3728029120 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e20051dd0 con 0x55724e3b7e10 2024-09-21T09:05:04.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.850+0000 7f6e34215800 1 -- 172.21.15.178:0/3728029120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 msgr2=0x55724e535b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.850+0000 7f6e34215800 1 --2- 172.21.15.178:0/3728029120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e535b00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6e20025da0 tx=0x7f6e20051000 comp rx=0 tx=0).stop 2024-09-21T09:05:04.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.850+0000 7f6e34215800 1 -- 172.21.15.178:0/3728029120 shutdown_connections 2024-09-21T09:05:04.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.850+0000 7f6e34215800 1 --2- 172.21.15.178:0/3728029120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e535b00 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.850+0000 7f6e34215800 1 -- 172.21.15.178:0/3728029120 >> 172.21.15.178:0/3728029120 conn(0x55724e43edd0 msgr2=0x55724e5314c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.850+0000 7f6e34215800 1 -- 172.21.15.178:0/3728029120 shutdown_connections 2024-09-21T09:05:04.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.850+0000 7f6e34215800 1 -- 172.21.15.178:0/3728029120 wait complete. 2024-09-21T09:05:04.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.850+0000 7f6e34215800 1 Processor -- start 2024-09-21T09:05:04.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.850+0000 7f6e34215800 1 -- start start 2024-09-21T09:05:04.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.851+0000 7f6e34215800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e53d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.851+0000 7f6e34215800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55724e44d920 con 0x55724e3b7e10 2024-09-21T09:05:04.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.851+0000 7f6e2f99c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e53d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.851+0000 7f6e2f99c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e53d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32806/0 (socket says 172.21.15.178:32806) 2024-09-21T09:05:04.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.851+0000 7f6e2f99c640 1 -- 172.21.15.178:0/221728168 learned_addr learned my addr 172.21.15.178:0/221728168 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.851+0000 7f6e2f99c640 1 -- 172.21.15.178:0/221728168 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55724e2f1fe0 con 0x55724e3b7e10 2024-09-21T09:05:04.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.851+0000 7f6e2f99c640 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e53d360 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f6e20067040 tx=0x7f6e20002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.852+0000 7f6d17fff640 1 -- 172.21.15.178:0/221728168 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e20073070 con 0x55724e3b7e10 2024-09-21T09:05:04.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.852+0000 7f6d17fff640 1 -- 172.21.15.178:0/221728168 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2005a450 con 0x55724e3b7e10 2024-09-21T09:05:04.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.852+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55724e53d8a0 con 0x55724e3b7e10 2024-09-21T09:05:04.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.852+0000 7f6d17fff640 1 -- 172.21.15.178:0/221728168 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2005a730 con 0x55724e3b7e10 2024-09-21T09:05:04.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.852+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55724e53de20 con 0x55724e3b7e10 2024-09-21T09:05:04.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.852+0000 7f6d17fff640 1 -- 172.21.15.178:0/221728168 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6e20076070 con 0x55724e3b7e10 2024-09-21T09:05:04.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.853+0000 7f6d17fff640 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6d18036b90 0x7f6d18039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.853+0000 7f6d17fff640 1 -- 172.21.15.178:0/221728168 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f6e20062070 con 0x55724e3b7e10 2024-09-21T09:05:04.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.853+0000 7f6e2719b640 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6d18036b90 0x7f6d18039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.853+0000 7f6e34215800 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55724e449b40 0x55724e5443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.853+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e544950 con 0x55724e449b40 2024-09-21T09:05:04.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.853+0000 7f6e3019d640 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55724e449b40 0x55724e5443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.853+0000 7f6e2719b640 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6d18036b90 0x7f6d18039050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6e18001e10 tx=0x7f6e18001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.853+0000 7f6e3019d640 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55724e449b40 0x55724e5443d0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.853+0000 7f6e3019d640 1 -- 172.21.15.178:0/221728168 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e2800a4a0 con 0x55724e449b40 2024-09-21T09:05:04.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.853+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e545210 con 0x55724e449b40 2024-09-21T09:05:04.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.854+0000 7f6e3019d640 1 -- 172.21.15.178:0/221728168 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e2800a4a0 con 0x55724e449b40 2024-09-21T09:05:04.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.854+0000 7f6e34215800 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55724e546b20 0x55724e548fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.854+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e549740 con 0x55724e546b20 2024-09-21T09:05:04.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.854+0000 7f6e2f99c640 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55724e546b20 0x55724e548fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.854+0000 7f6e2f99c640 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55724e546b20 0x55724e548fb0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.855+0000 7f6e2f99c640 1 -- 172.21.15.178:0/221728168 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e546b20 2024-09-21T09:05:04.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.855+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e545a60 con 0x55724e449b40 2024-09-21T09:05:04.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.855+0000 7f6e3019d640 1 -- 172.21.15.178:0/221728168 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e2800a4a0 con 0x55724e449b40 2024-09-21T09:05:04.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.855+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e545e40 con 0x55724e449b40 2024-09-21T09:05:04.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.855+0000 7f6e3019d640 1 -- 172.21.15.178:0/221728168 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e2800a4a0 con 0x55724e449b40 2024-09-21T09:05:04.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.856+0000 7f6e34215800 1 Processor -- start 2024-09-21T09:05:04.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.856+0000 7f6e34215800 1 -- start start 2024-09-21T09:05:04.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.856+0000 7f6e34215800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e558100 0x55724e558520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.856+0000 7f6e34215800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55724e2df580 con 0x55724e558100 2024-09-21T09:05:04.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.856+0000 7f6e3019d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e558100 0x55724e558520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.856+0000 7f6e3019d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e558100 0x55724e558520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32822/0 (socket says 172.21.15.178:32822) 2024-09-21T09:05:04.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.856+0000 7f6e3019d640 1 -- 172.21.15.178:0/2288678843 learned_addr learned my addr 172.21.15.178:0/2288678843 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.856+0000 7f6e3019d640 1 -- 172.21.15.178:0/2288678843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55724e558a60 con 0x55724e558100 2024-09-21T09:05:04.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.856+0000 7f6e3019d640 1 --2- 172.21.15.178:0/2288678843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e558100 0x55724e558520 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x55724e53e410 tx=0x7f6e280188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.857+0000 7f6d157fa640 1 -- 172.21.15.178:0/2288678843 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e28014450 con 0x55724e558100 2024-09-21T09:05:04.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.857+0000 7f6d157fa640 1 -- 172.21.15.178:0/2288678843 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e280145f0 con 0x55724e558100 2024-09-21T09:05:04.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.857+0000 7f6e34215800 1 -- 172.21.15.178:0/2288678843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55724e558cf0 con 0x55724e558100 2024-09-21T09:05:04.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.857+0000 7f6d157fa640 1 -- 172.21.15.178:0/2288678843 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e280148d0 con 0x55724e558100 2024-09-21T09:05:04.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.857+0000 7f6e34215800 1 -- 172.21.15.178:0/2288678843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55724e55b9d0 con 0x55724e558100 2024-09-21T09:05:04.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.857+0000 7f6d157fa640 1 -- 172.21.15.178:0/2288678843 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6e28011040 con 0x55724e558100 2024-09-21T09:05:04.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.858+0000 7f6d157fa640 1 --2- 172.21.15.178:0/2288678843 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6d08036b40 0x7f6d08039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.858+0000 7f6d157fa640 1 -- 172.21.15.178:0/2288678843 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f6e2801e070 con 0x55724e558100 2024-09-21T09:05:04.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.858+0000 7f6e2f99c640 1 --2- 172.21.15.178:0/2288678843 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6d08036b40 0x7f6d08039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.858+0000 7f6e34215800 1 Processor -- start 2024-09-21T09:05:04.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.858+0000 7f6e34215800 1 -- start start 2024-09-21T09:05:04.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.858+0000 7f6e2f99c640 1 --2- 172.21.15.178:0/2288678843 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6d08036b40 0x7f6d08039000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55724e541aa0 tx=0x7f6e20065ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.858+0000 7f6e34215800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e564dd0 0x55724e5651d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.858+0000 7f6e34215800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55724e5361f0 con 0x55724e564dd0 2024-09-21T09:05:04.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.859+0000 7f6e3019d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e564dd0 0x55724e5651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.859+0000 7f6e3019d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e564dd0 0x55724e5651d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32830/0 (socket says 172.21.15.178:32830) 2024-09-21T09:05:04.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.859+0000 7f6e3019d640 1 -- 172.21.15.178:0/69447345 learned_addr learned my addr 172.21.15.178:0/69447345 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.859+0000 7f6e3019d640 1 -- 172.21.15.178:0/69447345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55724e5657a0 con 0x55724e564dd0 2024-09-21T09:05:04.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.859+0000 7f6e3019d640 1 --2- 172.21.15.178:0/69447345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e564dd0 0x55724e5651d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6e2804cb80 tx=0x7f6e2803bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2efa8983cb9884 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.859+0000 7f6d0effd640 1 -- 172.21.15.178:0/69447345 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e280168f0 con 0x55724e564dd0 2024-09-21T09:05:04.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.859+0000 7f6d0effd640 1 -- 172.21.15.178:0/69447345 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e28013c80 con 0x55724e564dd0 2024-09-21T09:05:04.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.859+0000 7f6d0effd640 1 -- 172.21.15.178:0/69447345 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e28014a70 con 0x55724e564dd0 2024-09-21T09:05:04.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.860+0000 7f6e34215800 1 -- 172.21.15.178:0/69447345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e564dd0 msgr2=0x55724e5651d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.860+0000 7f6e34215800 1 --2- 172.21.15.178:0/69447345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e564dd0 0x55724e5651d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6e2804cb80 tx=0x7f6e2803bf60 comp rx=0 tx=0).stop 2024-09-21T09:05:04.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.860+0000 7f6e34215800 1 -- 172.21.15.178:0/69447345 shutdown_connections 2024-09-21T09:05:04.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.860+0000 7f6e34215800 1 --2- 172.21.15.178:0/69447345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e564dd0 0x55724e5651d0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.860+0000 7f6e34215800 1 -- 172.21.15.178:0/69447345 >> 172.21.15.178:0/69447345 conn(0x55724e561130 msgr2=0x55724e55f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.860+0000 7f6e34215800 1 -- 172.21.15.178:0/69447345 shutdown_connections 2024-09-21T09:05:04.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.860+0000 7f6e34215800 1 -- 172.21.15.178:0/69447345 wait complete. 2024-09-21T09:05:04.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.860+0000 7f6e34215800 1 Processor -- start 2024-09-21T09:05:04.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.860+0000 7f6e34215800 1 -- start start 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.860+0000 7f6e34215800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e564dd0 0x55724e56c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.860+0000 7f6e34215800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55724e565e10 con 0x55724e564dd0 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.860+0000 7f6e3019d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e564dd0 0x55724e56c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.860+0000 7f6e3019d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e564dd0 0x55724e56c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32838/0 (socket says 172.21.15.178:32838) 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.860+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 learned_addr learned my addr 172.21.15.178:0/1966751693 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.861+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55724e56c780 con 0x55724e564dd0 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.861+0000 7f6e3019d640 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e564dd0 0x55724e56c240 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f6e2804cb80 tx=0x7f6e2804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.861+0000 7f6d0d7fa640 1 -- 172.21.15.178:0/1966751693 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e28044030 con 0x55724e564dd0 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.861+0000 7f6d0d7fa640 1 -- 172.21.15.178:0/1966751693 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e28031070 con 0x55724e564dd0 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.861+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55724e56ca10 con 0x55724e564dd0 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.861+0000 7f6d0d7fa640 1 -- 172.21.15.178:0/1966751693 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e28013e30 con 0x55724e564dd0 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.861+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55724e56f6c0 con 0x55724e564dd0 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.862+0000 7f6d0d7fa640 1 -- 172.21.15.178:0/1966751693 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6e28022a80 con 0x55724e564dd0 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.862+0000 7f6d0d7fa640 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cf8036b90 0x7f6cf8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.862+0000 7f6d0d7fa640 1 -- 172.21.15.178:0/1966751693 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f6e2800e040 con 0x55724e564dd0 2024-09-21T09:05:04.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.862+0000 7f6e2f99c640 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cf8036b90 0x7f6cf8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.862+0000 7f6e2f99c640 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cf8036b90 0x7f6cf8039050 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55724e549b40 tx=0x7f6e2008b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.863+0000 7f6e34215800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.863+0000 7f6e34215800 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55724e577e40 0x55724e57a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.863+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e57aa50 con 0x55724e577e40 2024-09-21T09:05:04.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.863+0000 7f6e2719b640 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55724e577e40 0x55724e57a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.863+0000 7f6e2719b640 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55724e577e40 0x55724e57a300 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.863+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e1800bdb0 con 0x55724e577e40 2024-09-21T09:05:04.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.863+0000 7f6e34215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.863+0000 7f6e34215800 20 realm 2024-09-21T09:05:04.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.863+0000 7f6e34215800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.863+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e577290 con 0x55724e577e40 2024-09-21T09:05:04.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.864+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e1800bdb0 con 0x55724e577e40 2024-09-21T09:05:04.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.864+0000 7f6e34215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.864+0000 7f6e34215800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:04.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.864+0000 7f6e34215800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.864+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e57b540 con 0x55724e577e40 2024-09-21T09:05:04.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.864+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e1800bdb0 con 0x55724e577e40 2024-09-21T09:05:04.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.864+0000 7f6e34215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.864+0000 7f6e34215800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.864+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e57be10 con 0x55724e577e40 2024-09-21T09:05:04.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.864+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e1800bdb0 con 0x55724e577e40 2024-09-21T09:05:04.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.864+0000 7f6e34215800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:04.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.864+0000 7f6e34215800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.864+0000 7f6e34215800 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55724e57c750 0x55724e57eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.864+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e57f310 con 0x55724e57c750 2024-09-21T09:05:04.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.865+0000 7f6e3019d640 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55724e57c750 0x55724e57eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.865+0000 7f6e3019d640 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55724e57c750 0x55724e57eb80 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.865+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.865+0000 7f6e34215800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.865+0000 7f6e34215800 20 searching for the correct realm 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.865+0000 7f6e34215800 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55724e5812e0 0x55724e5837a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.865+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e5812e0 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.865+0000 7f6e2f99c640 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55724e5812e0 0x55724e5837a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.866+0000 7f6e2f99c640 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55724e5812e0 0x55724e5837a0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.866+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e5812e0 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.866+0000 7f6e2f99c640 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6e20078070 0x7f6e2006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.866+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x7f6e20078070 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.866+0000 7f6e2719b640 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6e20078070 0x7f6e2006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.866+0000 7f6e2719b640 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6e20078070 0x7f6e2006e3c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.867+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1800bdb0 con 0x7f6e20078070 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.867+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e57c750 2024-09-21T09:05:04.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.867+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.867+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e577e40 2024-09-21T09:05:04.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.867+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1800bdb0 con 0x55724e577e40 2024-09-21T09:05:04.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.867+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e577e40 2024-09-21T09:05:04.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.867+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.867+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e57c750 2024-09-21T09:05:04.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.868+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.868+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e57c750 2024-09-21T09:05:04.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.868+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.868+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x7f6e20078070 2024-09-21T09:05:04.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.868+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1802a040 con 0x7f6e20078070 2024-09-21T09:05:04.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.868+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e5812e0 2024-09-21T09:05:04.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.868+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e5812e0 2024-09-21T09:05:04.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.868+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e577e40 2024-09-21T09:05:04.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.869+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.869+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e57c750 2024-09-21T09:05:04.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.869+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.869+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e577e40 2024-09-21T09:05:04.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.869+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.869+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x7f6e20078070 2024-09-21T09:05:04.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.869+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6e1802a040 con 0x7f6e20078070 2024-09-21T09:05:04.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.869+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e5812e0 2024-09-21T09:05:04.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.869+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e5812e0 2024-09-21T09:05:04.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.869+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e5812e0 2024-09-21T09:05:04.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.870+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e5812e0 2024-09-21T09:05:04.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.870+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e57c750 2024-09-21T09:05:04.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.870+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.870+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e5812e0 2024-09-21T09:05:04.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.870+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e5812e0 2024-09-21T09:05:04.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.870+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e5812e0 2024-09-21T09:05:04.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.870+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e5812e0 2024-09-21T09:05:04.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.870+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e577e40 2024-09-21T09:05:04.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.871+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.871+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e577e40 2024-09-21T09:05:04.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.871+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.871+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e57c750 2024-09-21T09:05:04.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.871+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.871+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e5812e0 2024-09-21T09:05:04.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.872+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e5812e0 2024-09-21T09:05:04.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.872+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x7f6e20078070 2024-09-21T09:05:04.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.872+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1802a040 con 0x7f6e20078070 2024-09-21T09:05:04.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.872+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e577e40 2024-09-21T09:05:04.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.872+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.872+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e57c750 2024-09-21T09:05:04.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.872+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.872+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e5812e0 2024-09-21T09:05:04.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.873+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e5812e0 2024-09-21T09:05:04.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.873+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x7f6e20078070 2024-09-21T09:05:04.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.873+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1802a040 con 0x7f6e20078070 2024-09-21T09:05:04.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.873+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x7f6e20078070 2024-09-21T09:05:04.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.873+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1802a040 con 0x7f6e20078070 2024-09-21T09:05:04.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.873+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e5812e0 2024-09-21T09:05:04.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.873+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e5812e0 2024-09-21T09:05:04.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.873+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e57c750 2024-09-21T09:05:04.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x55724e577e40 2024-09-21T09:05:04.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55724e583e70 con 0x7f6e20078070 2024-09-21T09:05:04.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1802a040 con 0x7f6e20078070 2024-09-21T09:05:04.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e34215800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:04.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e34215800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:04.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e34215800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:04.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e34215800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:04.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e34215800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:04.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e34215800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:04.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e34215800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e57fd00 con 0x55724e577e40 2024-09-21T09:05:04.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e34215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e34215800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.874+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e5805a0 con 0x55724e577e40 2024-09-21T09:05:04.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:04.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e57f940 con 0x55724e577e40 2024-09-21T09:05:04.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:04.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 20 zone default found 2024-09-21T09:05:04.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 4 Realm: () 2024-09-21T09:05:04.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:04.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:04.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:04.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 20 zonegroup default 2024-09-21T09:05:04.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e584350 con 0x55724e57c750 2024-09-21T09:05:04.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.875+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e586620 con 0x55724e5812e0 2024-09-21T09:05:04.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.876+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e5812e0 2024-09-21T09:05:04.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.876+0000 7f6e34215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.876+0000 7f6e34215800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.876+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e5869c0 con 0x55724e5812e0 2024-09-21T09:05:04.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.876+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e5812e0 2024-09-21T09:05:04.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.876+0000 7f6e34215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.876+0000 7f6e34215800 20 started sync module instance, tier type = 2024-09-21T09:05:04.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.876+0000 7f6e34215800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:04.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.876+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e585ab0 con 0x7f6e20078070 2024-09-21T09:05:04.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.877+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x7f6e20078070 2024-09-21T09:05:04.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.877+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93949429047248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e585ab0 con 0x7f6e20078070 2024-09-21T09:05:04.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.877+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e587420 con 0x55724e577e40 2024-09-21T09:05:04.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.878+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93949429047248] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x7f6e20078070 2024-09-21T09:05:04.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.878+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.878+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93949429051728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e585ab0 con 0x55724e577e40 2024-09-21T09:05:04.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.878+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e587e90 con 0x55724e5812e0 2024-09-21T09:05:04.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.879+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93949429051728] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.879+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e5812e0 2024-09-21T09:05:04.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.879+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93949429044736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e585a20 con 0x55724e5812e0 2024-09-21T09:05:04.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.879+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e588d80 con 0x7f6e20078070 2024-09-21T09:05:04.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.880+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93949429044736] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e5812e0 2024-09-21T09:05:04.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.881+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x7f6e20078070 2024-09-21T09:05:04.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.881+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93949429057744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e5891a0 con 0x7f6e20078070 2024-09-21T09:05:04.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.881+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e589b60 con 0x55724e577e40 2024-09-21T09:05:04.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.881+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93949429057744] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x7f6e20078070 2024-09-21T09:05:04.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.882+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.882+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93949429059280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e589b60 con 0x55724e577e40 2024-09-21T09:05:04.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.882+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e58a560 con 0x55724e57c750 2024-09-21T09:05:04.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.883+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93949429059280] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.883+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.883+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93949429063792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e589b60 con 0x55724e57c750 2024-09-21T09:05:04.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.883+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e58af70 con 0x55724e57c750 2024-09-21T09:05:04.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.884+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93949429063792] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.884+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.884+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93949429061296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e58af70 con 0x55724e57c750 2024-09-21T09:05:04.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.884+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e58b9a0 con 0x55724e57c750 2024-09-21T09:05:04.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.885+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93949429061296] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.885+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.885+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93949429066432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e58b960 con 0x55724e57c750 2024-09-21T09:05:04.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.885+0000 7f6e34215800 20 add_watcher() i=0 2024-09-21T09:05:04.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.885+0000 7f6e34215800 20 add_watcher() i=1 2024-09-21T09:05:04.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.885+0000 7f6e34215800 20 add_watcher() i=2 2024-09-21T09:05:04.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.885+0000 7f6e34215800 20 add_watcher() i=3 2024-09-21T09:05:04.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.885+0000 7f6e34215800 20 add_watcher() i=4 2024-09-21T09:05:04.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.885+0000 7f6e34215800 20 add_watcher() i=5 2024-09-21T09:05:04.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.885+0000 7f6e34215800 20 add_watcher() i=6 2024-09-21T09:05:04.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.886+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93949429066432] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.886+0000 7f6e34215800 20 add_watcher() i=7 2024-09-21T09:05:04.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.886+0000 7f6e34215800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:04.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.886+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e58ee20 con 0x55724e577e40 2024-09-21T09:05:04.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.886+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.886+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93949429069440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e58c340 con 0x55724e577e40 2024-09-21T09:05:04.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.887+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93949429069440] v31'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.887+0000 7f6ce5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:04.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.887+0000 7f6e34215800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:04.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.887+0000 7f6e34215800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:04.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.887+0000 7f6e34215800 5 note: GC not initialized 2024-09-21T09:05:04.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.888+0000 7f6ce4fe1640 20 reqs_thread_entry: start 2024-09-21T09:05:04.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.888+0000 7f6e34215800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:04.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.888+0000 7f6e34215800 20 Filter name: none 2024-09-21T09:05:04.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.888+0000 7f6c5e7fc640 20 reqs_thread_entry: start 2024-09-21T09:05:04.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.888+0000 7f6e34215800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T09:05:04.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.888+0000 7f6e34215800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.888+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e5c2290 con 0x55724e57c750 2024-09-21T09:05:04.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.889+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.889+0000 7f6e34215800 20 rados_obj.operate() r=0 bl.length=503 2024-09-21T09:05:04.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.889+0000 7f6e34215800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T09:05:04.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.889+0000 7f6e34215800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:04.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.889+0000 7f6e34215800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:05:04.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.889+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e5c8d10 con 0x55724e57c750 2024-09-21T09:05:04.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.890+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v31'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.890+0000 7f6e34215800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:04.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.890+0000 7f6e34215800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:04.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.890+0000 7f6e34215800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T09:05:04.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.890+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93949429319376 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55724e5c4370 con 0x55724e577e40 2024-09-21T09:05:04.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.890+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== watch-notify(notify (1) cookie 93949429059280 notify 133143986207 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55724e303b30 con 0x55724e577e40 2024-09-21T09:05:04.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.891+0000 7f6d0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986207 cookie 93949429059280 notifier 4896 bl.length()=636 2024-09-21T09:05:04.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.891+0000 7f6d0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:04.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.891+0000 7f6d0effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:04.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.891+0000 7f6d0effd640 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f6cf4003ea0 con 0x55724e577e40 2024-09-21T09:05:04.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.891+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 notify.4 [notify cookie 93949429319376 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.891+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.891+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== watch-notify(notify_complete (2) cookie 93949429319376 notify 133143986207 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6e1802e5f0 con 0x55724e577e40 2024-09-21T09:05:04.899 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T09:05:03.575855Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:05:03.575846Z","tags":[],"group_ids":[]} 2024-09-21T09:05:04.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.892+0000 7f6ce5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:04.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.892+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93949429069440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e5bffa0 con 0x55724e577e40 2024-09-21T09:05:04.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.893+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93949429069440] v31'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.893+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93949429047248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e5bffa0 con 0x7f6e20078070 2024-09-21T09:05:04.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.894+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93949429047248] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x7f6e20078070 2024-09-21T09:05:04.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.894+0000 7f6e34215800 20 remove_watcher() i=0 2024-09-21T09:05:04.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.894+0000 7f6e34215800 2 removed watcher, disabling cache 2024-09-21T09:05:04.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.894+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93949429051728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e5bffa0 con 0x55724e577e40 2024-09-21T09:05:04.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.895+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93949429051728] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.895+0000 7f6e34215800 20 remove_watcher() i=1 2024-09-21T09:05:04.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.895+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93949429044736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e5bffa0 con 0x55724e5812e0 2024-09-21T09:05:04.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.896+0000 7f6e2f99c640 1 -- 172.21.15.178:0/1966751693 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93949429044736] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2007f070 con 0x55724e5812e0 2024-09-21T09:05:04.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.896+0000 7f6e34215800 20 remove_watcher() i=2 2024-09-21T09:05:04.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.896+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93949429057744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e585600 con 0x7f6e20078070 2024-09-21T09:05:04.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.897+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93949429057744] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x7f6e20078070 2024-09-21T09:05:04.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.897+0000 7f6e34215800 20 remove_watcher() i=3 2024-09-21T09:05:04.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.897+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93949429059280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e5888d0 con 0x55724e577e40 2024-09-21T09:05:04.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.898+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93949429059280] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1802a040 con 0x55724e577e40 2024-09-21T09:05:04.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.898+0000 7f6e34215800 20 remove_watcher() i=4 2024-09-21T09:05:04.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.898+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93949429063792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e585600 con 0x55724e57c750 2024-09-21T09:05:04.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.899+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93949429063792] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.899+0000 7f6e34215800 20 remove_watcher() i=5 2024-09-21T09:05:04.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.899+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93949429061296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e5888d0 con 0x55724e57c750 2024-09-21T09:05:04.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.900+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93949429061296] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.900+0000 7f6e34215800 20 remove_watcher() i=6 2024-09-21T09:05:04.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.900+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93949429066432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55724e585600 con 0x55724e57c750 2024-09-21T09:05:04.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e3019d640 1 -- 172.21.15.178:0/1966751693 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93949429066432] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2802a070 con 0x55724e57c750 2024-09-21T09:05:04.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e34215800 20 remove_watcher() i=7 2024-09-21T09:05:04.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55724e57c750 msgr2=0x55724e57eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e34215800 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55724e57c750 0x55724e57eb80 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55724e577e40 msgr2=0x55724e57a300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e34215800 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55724e577e40 0x55724e57a300 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6e20078070 msgr2=0x7f6e2006e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e34215800 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f6e20078070 0x7f6e2006e3c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55724e5812e0 msgr2=0x55724e5837a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e34215800 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55724e5812e0 0x55724e5837a0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cf8036b90 msgr2=0x7f6cf8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e34215800 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6cf8036b90 0x7f6cf8039050 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55724e549b40 tx=0x7f6e2008b000 comp rx=0 tx=0).stop 2024-09-21T09:05:04.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e2719b640 1 -- 172.21.15.178:0/1966751693 reap_dead start 2024-09-21T09:05:04.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e564dd0 msgr2=0x55724e56c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.901+0000 7f6e34215800 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e564dd0 0x55724e56c240 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f6e2804cb80 tx=0x7f6e2804cb10 comp rx=0 tx=0).stop 2024-09-21T09:05:04.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 shutdown_connections 2024-09-21T09:05:04.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 --2- 172.21.15.178:0/1966751693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e564dd0 0x55724e56c240 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 >> 172.21.15.178:0/1966751693 conn(0x55724e561130 msgr2=0x55724e55f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 shutdown_connections 2024-09-21T09:05:04.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/1966751693 wait complete. 2024-09-21T09:05:04.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/2288678843 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6d08036b40 msgr2=0x7f6d08039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 --2- 172.21.15.178:0/2288678843 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6d08036b40 0x7f6d08039000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55724e541aa0 tx=0x7f6e20065ef0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/2288678843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e558100 msgr2=0x55724e558520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 --2- 172.21.15.178:0/2288678843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e558100 0x55724e558520 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x55724e53e410 tx=0x7f6e280188f0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/2288678843 shutdown_connections 2024-09-21T09:05:04.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 --2- 172.21.15.178:0/2288678843 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6d08036b40 0x7f6d08039000 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 --2- 172.21.15.178:0/2288678843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e558100 0x55724e558520 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/2288678843 >> 172.21.15.178:0/2288678843 conn(0x55724e54d090 msgr2=0x55724e54fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/2288678843 shutdown_connections 2024-09-21T09:05:04.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/2288678843 wait complete. 2024-09-21T09:05:04.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55724e546b20 msgr2=0x55724e548fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55724e546b20 0x55724e548fb0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55724e449b40 msgr2=0x55724e5443d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55724e449b40 0x55724e5443d0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6d18036b90 msgr2=0x7f6d18039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6d18036b90 0x7f6d18039050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6e18001e10 tx=0x7f6e18001390 comp rx=0 tx=0).stop 2024-09-21T09:05:04.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 msgr2=0x55724e53d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e53d360 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f6e20067040 tx=0x7f6e20002fb0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 shutdown_connections 2024-09-21T09:05:04.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55724e546b20 0x55724e548fb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55724e449b40 0x55724e5443d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.902+0000 7f6e34215800 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6d18036b90 0x7f6d18039050 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.903+0000 7f6e34215800 1 --2- 172.21.15.178:0/221728168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55724e3b7e10 0x55724e53d360 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.903+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 >> 172.21.15.178:0/221728168 conn(0x55724e43edd0 msgr2=0x55724e52fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.903+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 shutdown_connections 2024-09-21T09:05:04.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.903+0000 7f6e34215800 1 -- 172.21.15.178:0/221728168 wait complete. 2024-09-21T09:05:04.913 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:04.913 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:04.913 ERROR:root:0 2024-09-21T09:05:04.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-21T09:05:04.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-21T09:05:04.913 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-21T09:05:04.959 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:04.959 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:04.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.958+0000 7f5359613800 1 Processor -- start 2024-09-21T09:05:04.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.958+0000 7f5359613800 1 -- start start 2024-09-21T09:05:04.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.959+0000 7f5359613800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55703d7b0900 0x55703d7b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.959+0000 7f5359613800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55703d66bb30 con 0x55703d720650 2024-09-21T09:05:04.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.959+0000 7f5359613800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55703d64d360 con 0x55703d7b0900 2024-09-21T09:05:04.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.959+0000 7f534c63a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55703d7b0900 0x55703d7b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.959+0000 7f534c63a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55703d7b0900 0x55703d7b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32844/0 (socket says 172.21.15.178:32844) 2024-09-21T09:05:04.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.959+0000 7f534c63a640 1 -- 172.21.15.178:0/1476038272 learned_addr learned my addr 172.21.15.178:0/1476038272 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.959+0000 7f5354e3b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55703d720650 0x55703d7af1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40578/0 (socket says 172.21.15.178:40578) 2024-09-21T09:05:04.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.959+0000 7f534c63a640 1 -- 172.21.15.178:0/1476038272 >> v1:172.21.15.44:6789/0 conn(0x55703d720650 legacy=0x55703d7af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.959+0000 7f534c63a640 1 -- 172.21.15.178:0/1476038272 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55703d673e00 con 0x55703d7b0900 2024-09-21T09:05:04.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.961+0000 7f534c63a640 1 --2- 172.21.15.178:0/1476038272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d7b0900 0x55703d7b2cf0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f533c00a520 tx=0x7f533c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d923b224087cd66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.961+0000 7f534ffff640 1 -- 172.21.15.178:0/1476038272 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f533c055070 con 0x55703d7b0900 2024-09-21T09:05:04.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.961+0000 7f534ffff640 1 -- 172.21.15.178:0/1476038272 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f533c0515b0 con 0x55703d7b0900 2024-09-21T09:05:04.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.961+0000 7f534ffff640 1 -- 172.21.15.178:0/1476038272 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f533c0518d0 con 0x55703d7b0900 2024-09-21T09:05:04.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.962+0000 7f5359613800 1 -- 172.21.15.178:0/1476038272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d7b0900 msgr2=0x55703d7b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.962+0000 7f5359613800 1 --2- 172.21.15.178:0/1476038272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d7b0900 0x55703d7b2cf0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f533c00a520 tx=0x7f533c045ba0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.962+0000 7f5359613800 1 -- 172.21.15.178:0/1476038272 shutdown_connections 2024-09-21T09:05:04.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.962+0000 7f5359613800 1 --2- 172.21.15.178:0/1476038272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d7b0900 0x55703d7b2cf0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.962+0000 7f5359613800 1 -- 172.21.15.178:0/1476038272 >> 172.21.15.178:0/1476038272 conn(0x55703d7a6db0 msgr2=0x55703d7a91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.962+0000 7f5359613800 1 -- 172.21.15.178:0/1476038272 shutdown_connections 2024-09-21T09:05:04.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.962+0000 7f5359613800 1 -- 172.21.15.178:0/1476038272 wait complete. 2024-09-21T09:05:04.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.976+0000 7f5359613800 1 Processor -- start 2024-09-21T09:05:04.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.976+0000 7f5359613800 1 -- start start 2024-09-21T09:05:04.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.976+0000 7f5359613800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d720650 0x55703d89b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.976+0000 7f5359613800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55703d6f8360 con 0x55703d720650 2024-09-21T09:05:04.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.976+0000 7f5354e3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d720650 0x55703d89b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.976+0000 7f5354e3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d720650 0x55703d89b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32850/0 (socket says 172.21.15.178:32850) 2024-09-21T09:05:04.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.976+0000 7f5354e3b640 1 -- 172.21.15.178:0/3383466689 learned_addr learned my addr 172.21.15.178:0/3383466689 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.977+0000 7f5354e3b640 1 -- 172.21.15.178:0/3383466689 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55703d645bc0 con 0x55703d720650 2024-09-21T09:05:04.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.977+0000 7f5354e3b640 1 --2- 172.21.15.178:0/3383466689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d720650 0x55703d89b8c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f534400b230 tx=0x7f534400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ae90793665b3a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.977+0000 7f5242e0d640 1 -- 172.21.15.178:0/3383466689 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f534400e5c0 con 0x55703d720650 2024-09-21T09:05:04.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.977+0000 7f5242e0d640 1 -- 172.21.15.178:0/3383466689 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5344006070 con 0x55703d720650 2024-09-21T09:05:04.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.977+0000 7f5242e0d640 1 -- 172.21.15.178:0/3383466689 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f534400e890 con 0x55703d720650 2024-09-21T09:05:04.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.978+0000 7f5359613800 1 -- 172.21.15.178:0/3383466689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d720650 msgr2=0x55703d89b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.978+0000 7f5359613800 1 --2- 172.21.15.178:0/3383466689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d720650 0x55703d89b8c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f534400b230 tx=0x7f534400b6f0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.978+0000 7f5359613800 1 -- 172.21.15.178:0/3383466689 shutdown_connections 2024-09-21T09:05:04.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.978+0000 7f5359613800 1 --2- 172.21.15.178:0/3383466689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d720650 0x55703d89b8c0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.978+0000 7f5359613800 1 -- 172.21.15.178:0/3383466689 >> 172.21.15.178:0/3383466689 conn(0x55703d7a6db0 msgr2=0x55703d897280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.978+0000 7f5359613800 1 -- 172.21.15.178:0/3383466689 shutdown_connections 2024-09-21T09:05:04.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.978+0000 7f5359613800 1 -- 172.21.15.178:0/3383466689 wait complete. 2024-09-21T09:05:04.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.978+0000 7f5359613800 1 Processor -- start 2024-09-21T09:05:04.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.978+0000 7f5359613800 1 -- start start 2024-09-21T09:05:04.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.978+0000 7f5359613800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d720650 0x55703d8a32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.978+0000 7f5359613800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55703d7b3620 con 0x55703d720650 2024-09-21T09:05:04.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.979+0000 7f5354e3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d720650 0x55703d8a32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.979+0000 7f5354e3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d720650 0x55703d8a32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32866/0 (socket says 172.21.15.178:32866) 2024-09-21T09:05:04.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.979+0000 7f5354e3b640 1 -- 172.21.15.178:0/3410895807 learned_addr learned my addr 172.21.15.178:0/3410895807 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.979+0000 7f5354e3b640 1 -- 172.21.15.178:0/3410895807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55703d659fe0 con 0x55703d720650 2024-09-21T09:05:04.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.979+0000 7f5354e3b640 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d720650 0x55703d8a32d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f5344000fd0 tx=0x7f5344000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.979+0000 7f524160a640 1 -- 172.21.15.178:0/3410895807 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f534400f8d0 con 0x55703d720650 2024-09-21T09:05:04.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.979+0000 7f524160a640 1 -- 172.21.15.178:0/3410895807 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f534400fa90 con 0x55703d720650 2024-09-21T09:05:04.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.979+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55703d8a3810 con 0x55703d720650 2024-09-21T09:05:04.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.979+0000 7f524160a640 1 -- 172.21.15.178:0/3410895807 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f534400fdb0 con 0x55703d720650 2024-09-21T09:05:04.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.980+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55703d8a3d30 con 0x55703d720650 2024-09-21T09:05:04.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.980+0000 7f524160a640 1 -- 172.21.15.178:0/3410895807 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5344017070 con 0x55703d720650 2024-09-21T09:05:04.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.980+0000 7f524160a640 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f523c036b90 0x7f523c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.980+0000 7f524160a640 1 -- 172.21.15.178:0/3410895807 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f5344015020 con 0x55703d720650 2024-09-21T09:05:04.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.981+0000 7f534c63a640 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f523c036b90 0x7f523c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.981+0000 7f5359613800 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55703d7b0900 0x55703d8aa340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.981+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8aa8c0 con 0x55703d7b0900 2024-09-21T09:05:04.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.981+0000 7f535563c640 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55703d7b0900 0x55703d8aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.981+0000 7f534c63a640 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f523c036b90 0x7f523c039050 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f533c057000 tx=0x7f533c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.981+0000 7f535563c640 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55703d7b0900 0x55703d8aa340 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.981+0000 7f535563c640 1 -- 172.21.15.178:0/3410895807 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f535000a4a0 con 0x55703d7b0900 2024-09-21T09:05:04.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.981+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8a7910 con 0x55703d7b0900 2024-09-21T09:05:04.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.982+0000 7f535563c640 1 -- 172.21.15.178:0/3410895807 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f535000a4a0 con 0x55703d7b0900 2024-09-21T09:05:04.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.982+0000 7f5359613800 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55703d8acbf0 0x55703d8aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.982+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8af6d0 con 0x55703d8acbf0 2024-09-21T09:05:04.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.982+0000 7f5354e3b640 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55703d8acbf0 0x55703d8aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.982+0000 7f5354e3b640 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55703d8acbf0 0x55703d8aefe0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.983+0000 7f5354e3b640 1 -- 172.21.15.178:0/3410895807 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f534402e070 con 0x55703d8acbf0 2024-09-21T09:05:04.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.983+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8aba90 con 0x55703d7b0900 2024-09-21T09:05:04.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.983+0000 7f535563c640 1 -- 172.21.15.178:0/3410895807 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f535000a4a0 con 0x55703d7b0900 2024-09-21T09:05:04.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.983+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8abf70 con 0x55703d7b0900 2024-09-21T09:05:04.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.983+0000 7f535563c640 1 -- 172.21.15.178:0/3410895807 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f535000a4a0 con 0x55703d7b0900 2024-09-21T09:05:04.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.984+0000 7f5359613800 1 Processor -- start 2024-09-21T09:05:04.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.984+0000 7f5359613800 1 -- start start 2024-09-21T09:05:04.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.984+0000 7f5359613800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8be050 0x55703d8be470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.984+0000 7f5359613800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55703d647580 con 0x55703d8be050 2024-09-21T09:05:04.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.984+0000 7f535563c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8be050 0x55703d8be470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.984+0000 7f535563c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8be050 0x55703d8be470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32876/0 (socket says 172.21.15.178:32876) 2024-09-21T09:05:04.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.984+0000 7f535563c640 1 -- 172.21.15.178:0/3625577188 learned_addr learned my addr 172.21.15.178:0/3625577188 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.988 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.984+0000 7f535563c640 1 -- 172.21.15.178:0/3625577188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55703d8be9b0 con 0x55703d8be050 2024-09-21T09:05:04.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.984+0000 7f535563c640 1 --2- 172.21.15.178:0/3625577188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8be050 0x55703d8be470 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x55703d8aaca0 tx=0x7f5350018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.984+0000 7f523a7fc640 1 -- 172.21.15.178:0/3625577188 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5350014450 con 0x55703d8be050 2024-09-21T09:05:04.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.985+0000 7f523a7fc640 1 -- 172.21.15.178:0/3625577188 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5350014610 con 0x55703d8be050 2024-09-21T09:05:04.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.985+0000 7f5359613800 1 -- 172.21.15.178:0/3625577188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55703d8bec40 con 0x55703d8be050 2024-09-21T09:05:04.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.985+0000 7f523a7fc640 1 -- 172.21.15.178:0/3625577188 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5350014930 con 0x55703d8be050 2024-09-21T09:05:04.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.985+0000 7f5359613800 1 -- 172.21.15.178:0/3625577188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55703d8c1920 con 0x55703d8be050 2024-09-21T09:05:04.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.985+0000 7f523a7fc640 1 -- 172.21.15.178:0/3625577188 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5350011040 con 0x55703d8be050 2024-09-21T09:05:04.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.985+0000 7f523a7fc640 1 --2- 172.21.15.178:0/3625577188 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f522c036b40 0x7f522c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.986+0000 7f523a7fc640 1 -- 172.21.15.178:0/3625577188 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f535001e070 con 0x55703d8be050 2024-09-21T09:05:04.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.986+0000 7f5354e3b640 1 --2- 172.21.15.178:0/3625577188 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f522c036b40 0x7f522c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.986+0000 7f5354e3b640 1 --2- 172.21.15.178:0/3625577188 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f522c036b40 0x7f522c039000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55703d8aad40 tx=0x7f534404b640 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.986+0000 7f5359613800 1 Processor -- start 2024-09-21T09:05:04.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.986+0000 7f5359613800 1 -- start start 2024-09-21T09:05:04.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.986+0000 7f5359613800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8cad00 0x55703d8cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.986+0000 7f5359613800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55703d89c070 con 0x55703d8cad00 2024-09-21T09:05:04.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.986+0000 7f535563c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8cad00 0x55703d8cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.986+0000 7f535563c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8cad00 0x55703d8cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32878/0 (socket says 172.21.15.178:32878) 2024-09-21T09:05:04.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.986+0000 7f535563c640 1 -- 172.21.15.178:0/508652930 learned_addr learned my addr 172.21.15.178:0/508652930 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.986+0000 7f535563c640 1 -- 172.21.15.178:0/508652930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55703d8cb6d0 con 0x55703d8cad00 2024-09-21T09:05:04.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.987+0000 7f535563c640 1 --2- 172.21.15.178:0/508652930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8cad00 0x55703d8cb100 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f535004cba0 tx=0x7f535002b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541e97aff87845c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.987+0000 7f522bfff640 1 -- 172.21.15.178:0/508652930 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5350028040 con 0x55703d8cad00 2024-09-21T09:05:04.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.987+0000 7f522bfff640 1 -- 172.21.15.178:0/508652930 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53500400c0 con 0x55703d8cad00 2024-09-21T09:05:04.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.987+0000 7f522bfff640 1 -- 172.21.15.178:0/508652930 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5350016980 con 0x55703d8cad00 2024-09-21T09:05:04.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.987+0000 7f5359613800 1 -- 172.21.15.178:0/508652930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8cad00 msgr2=0x55703d8cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:04.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.987+0000 7f5359613800 1 --2- 172.21.15.178:0/508652930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8cad00 0x55703d8cb100 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f535004cba0 tx=0x7f535002b410 comp rx=0 tx=0).stop 2024-09-21T09:05:04.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.987+0000 7f5359613800 1 -- 172.21.15.178:0/508652930 shutdown_connections 2024-09-21T09:05:04.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.987+0000 7f5359613800 1 --2- 172.21.15.178:0/508652930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8cad00 0x55703d8cb100 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:04.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.987+0000 7f5359613800 1 -- 172.21.15.178:0/508652930 >> 172.21.15.178:0/508652930 conn(0x55703d8c7010 msgr2=0x55703d8c5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:04.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.987+0000 7f5359613800 1 -- 172.21.15.178:0/508652930 shutdown_connections 2024-09-21T09:05:04.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.987+0000 7f5359613800 1 -- 172.21.15.178:0/508652930 wait complete. 2024-09-21T09:05:04.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.988+0000 7f5359613800 1 Processor -- start 2024-09-21T09:05:04.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.988+0000 7f5359613800 1 -- start start 2024-09-21T09:05:04.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.988+0000 7f5359613800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8cad00 0x55703d8d2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.988+0000 7f5359613800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55703d8cbd40 con 0x55703d8cad00 2024-09-21T09:05:04.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.988+0000 7f535563c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8cad00 0x55703d8d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.988+0000 7f535563c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8cad00 0x55703d8d2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32890/0 (socket says 172.21.15.178:32890) 2024-09-21T09:05:04.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.988+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 learned_addr learned my addr 172.21.15.178:0/2797081059 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:04.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.988+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55703d8d26c0 con 0x55703d8cad00 2024-09-21T09:05:04.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.988+0000 7f535563c640 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8cad00 0x55703d8d2180 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5350011b50 tx=0x7f535004cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.988+0000 7f522a7fc640 1 -- 172.21.15.178:0/2797081059 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5350028050 con 0x55703d8cad00 2024-09-21T09:05:04.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.988+0000 7f522a7fc640 1 -- 172.21.15.178:0/2797081059 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5350016980 con 0x55703d8cad00 2024-09-21T09:05:04.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.988+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55703d8d2950 con 0x55703d8cad00 2024-09-21T09:05:04.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.988+0000 7f522a7fc640 1 -- 172.21.15.178:0/2797081059 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f535004e070 con 0x55703d8cad00 2024-09-21T09:05:04.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.989+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55703d8d5600 con 0x55703d8cad00 2024-09-21T09:05:04.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.989+0000 7f522a7fc640 1 -- 172.21.15.178:0/2797081059 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f535004e210 con 0x55703d8cad00 2024-09-21T09:05:04.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.989+0000 7f522a7fc640 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5220036b40 0x7f5220039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.989+0000 7f522a7fc640 1 -- 172.21.15.178:0/2797081059 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f535000e040 con 0x55703d8cad00 2024-09-21T09:05:04.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.989+0000 7f5354e3b640 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5220036b40 0x7f5220039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.990+0000 7f5354e3b640 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5220036b40 0x7f5220039000 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f534401dfd0 tx=0x7f5344033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.990+0000 7f5359613800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.990+0000 7f5359613800 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55703d8ddc70 0x55703d8e0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:04.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.990+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e0880 con 0x55703d8ddc70 2024-09-21T09:05:04.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.990+0000 7f534c63a640 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55703d8ddc70 0x55703d8e0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:04.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f534c63a640 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55703d8ddc70 0x55703d8e0130 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:04.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:04.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f5359613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:04.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f5359613800 20 realm 2024-09-21T09:05:04.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f5359613800 20 rados->read ofs=0 len=0 2024-09-21T09:05:04.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e0cb0 con 0x55703d8ddc70 2024-09-21T09:05:05.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f5359613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f5359613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:05.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f5359613800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e1580 con 0x55703d8ddc70 2024-09-21T09:05:05.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f5359613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f5359613800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e1920 con 0x55703d8ddc70 2024-09-21T09:05:05.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.991+0000 7f5359613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:05.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.992+0000 7f5359613800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.992+0000 7f5359613800 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55703d8e2680 0x55703d8e4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.992+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e5080 con 0x55703d8e2680 2024-09-21T09:05:05.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.992+0000 7f535563c640 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55703d8e2680 0x55703d8e4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.992+0000 7f535563c640 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55703d8e2680 0x55703d8e4a70 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.993+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.993+0000 7f5359613800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:05.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.993+0000 7f5359613800 20 searching for the correct realm 2024-09-21T09:05:05.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.993+0000 7f5359613800 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55703d8e7010 0x55703d8e94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.993+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e9ba0 con 0x55703d8e7010 2024-09-21T09:05:05.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.993+0000 7f5354e3b640 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55703d8e7010 0x55703d8e94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.993+0000 7f5354e3b640 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55703d8e7010 0x55703d8e94d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.993+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f534402e070 con 0x55703d8e7010 2024-09-21T09:05:05.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.993+0000 7f5354e3b640 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f534400f070 0x7f5344019800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.993+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e9ba0 con 0x7f534400f070 2024-09-21T09:05:05.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.994+0000 7f534c63a640 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f534400f070 0x7f5344019800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.994+0000 7f534c63a640 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f534400f070 0x7f5344019800 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.994+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c057030 con 0x7f534400f070 2024-09-21T09:05:05.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.994+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e9ba0 con 0x55703d8e2680 2024-09-21T09:05:05.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.994+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.994+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e9ba0 con 0x55703d8ddc70 2024-09-21T09:05:05.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.995+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.995+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e9ba0 con 0x55703d8ddc70 2024-09-21T09:05:05.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.995+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.995+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e9ba0 con 0x55703d8e2680 2024-09-21T09:05:05.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.995+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.995+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e9ba0 con 0x55703d8e2680 2024-09-21T09:05:05.010 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.995+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.996+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e9ba0 con 0x7f534400f070 2024-09-21T09:05:05.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.996+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c057030 con 0x7f534400f070 2024-09-21T09:05:05.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.996+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e9ba0 con 0x55703d8e7010 2024-09-21T09:05:05.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.996+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f534402e070 con 0x55703d8e7010 2024-09-21T09:05:05.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.996+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e9ba0 con 0x55703d8ddc70 2024-09-21T09:05:05.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.996+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.996+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e9ba0 con 0x55703d8e2680 2024-09-21T09:05:05.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.997+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.997+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e9ba0 con 0x55703d8ddc70 2024-09-21T09:05:05.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.997+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.997+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e9ba0 con 0x7f534400f070 2024-09-21T09:05:05.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.997+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f533c057030 con 0x7f534400f070 2024-09-21T09:05:05.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.997+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e9ba0 con 0x55703d8e7010 2024-09-21T09:05:05.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.997+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f534402e070 con 0x55703d8e7010 2024-09-21T09:05:05.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.997+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x55703d8e7010 2024-09-21T09:05:05.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.997+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f534402e070 con 0x55703d8e7010 2024-09-21T09:05:05.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.997+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x55703d8e2680 2024-09-21T09:05:05.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.998+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.998+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x55703d8e7010 2024-09-21T09:05:05.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.998+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f534402e070 con 0x55703d8e7010 2024-09-21T09:05:05.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.998+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x55703d8e7010 2024-09-21T09:05:05.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.998+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f534402e070 con 0x55703d8e7010 2024-09-21T09:05:05.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.998+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x55703d8ddc70 2024-09-21T09:05:05.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.998+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.998+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x55703d8ddc70 2024-09-21T09:05:05.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.999+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.999+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x55703d8e2680 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.999+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.999+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x55703d8e7010 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.999+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f534402e070 con 0x55703d8e7010 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.999+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x7f534400f070 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.999+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c057030 con 0x7f534400f070 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:04.999+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x55703d8ddc70 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.000+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.000+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x55703d8e2680 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.000+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.000+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x55703d8e7010 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.000+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f534402e070 con 0x55703d8e7010 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.000+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x7f534400f070 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.000+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c057030 con 0x7f534400f070 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.000+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x7f534400f070 2024-09-21T09:05:05.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.001+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c057030 con 0x7f534400f070 2024-09-21T09:05:05.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.001+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x55703d8e7010 2024-09-21T09:05:05.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.001+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f534402e070 con 0x55703d8e7010 2024-09-21T09:05:05.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.001+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x55703d8e2680 2024-09-21T09:05:05.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.001+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.001+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x55703d8ddc70 2024-09-21T09:05:05.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.001+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.001+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f534405c040 con 0x7f534400f070 2024-09-21T09:05:05.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c057030 con 0x7f534400f070 2024-09-21T09:05:05.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:05.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:05.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:05.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:05.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:05.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e58d0 con 0x55703d8ddc70 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8e5cc0 con 0x55703d8ddc70 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8ea020 con 0x55703d8ddc70 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 zone default found 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 4 Realm: () 2024-09-21T09:05:05.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 zonegroup default 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.002+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8ea090 con 0x55703d8e2680 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.003+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.003+0000 7f5359613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.003+0000 7f5359613800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.003+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8ec360 con 0x55703d8e7010 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.003+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f534402e070 con 0x55703d8e7010 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.003+0000 7f5359613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.003+0000 7f5359613800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.003+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8ec700 con 0x55703d8e7010 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.003+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f534402e070 con 0x55703d8e7010 2024-09-21T09:05:05.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.003+0000 7f5359613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.003+0000 7f5359613800 20 started sync module instance, tier type = 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.003+0000 7f5359613800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.003+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8eb7f0 con 0x7f534400f070 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.004+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c057030 con 0x7f534400f070 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.004+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93940557462800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8eb7f0 con 0x7f534400f070 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.004+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8ed110 con 0x55703d8ddc70 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.005+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93940557462800] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c057030 con 0x7f534400f070 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.005+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.005+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93940557467200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8eb7f0 con 0x55703d8ddc70 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.005+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8edbb0 con 0x55703d8e7010 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.006+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93940557467200] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.007+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f534402e070 con 0x55703d8e7010 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.007+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93940557460288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8eb760 con 0x55703d8e7010 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.007+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8eea70 con 0x7f534400f070 2024-09-21T09:05:05.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.007+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93940557460288] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f534402e070 con 0x55703d8e7010 2024-09-21T09:05:05.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.008+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c057030 con 0x7f534400f070 2024-09-21T09:05:05.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.008+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93940557473216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8eee90 con 0x7f534400f070 2024-09-21T09:05:05.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.008+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8ef850 con 0x55703d8ddc70 2024-09-21T09:05:05.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.009+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93940557473216] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c057030 con 0x7f534400f070 2024-09-21T09:05:05.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.009+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.009+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93940557474752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8ef850 con 0x55703d8ddc70 2024-09-21T09:05:05.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.009+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8f0210 con 0x55703d8e2680 2024-09-21T09:05:05.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.010+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93940557474752] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.010+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.010+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93940557476768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8ef7c0 con 0x55703d8e2680 2024-09-21T09:05:05.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.010+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8f10d0 con 0x55703d8e2680 2024-09-21T09:05:05.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.011+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93940557476768] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.011+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.011+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93940557481392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8f10d0 con 0x55703d8e2680 2024-09-21T09:05:05.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.011+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8f1a90 con 0x55703d8e2680 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.012+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93940557481392] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.012+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.012+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93940557483040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8f1c70 con 0x55703d8e2680 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.012+0000 7f5359613800 20 add_watcher() i=0 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.012+0000 7f5359613800 20 add_watcher() i=1 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.012+0000 7f5359613800 20 add_watcher() i=2 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.012+0000 7f5359613800 20 add_watcher() i=3 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.012+0000 7f5359613800 20 add_watcher() i=4 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.012+0000 7f5359613800 20 add_watcher() i=5 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.012+0000 7f5359613800 20 add_watcher() i=6 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.013+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93940557483040] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.013+0000 7f5359613800 20 add_watcher() i=7 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.013+0000 7f5359613800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.013+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d8f4e40 con 0x55703d8ddc70 2024-09-21T09:05:05.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.013+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.013+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93940557486112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d8f20f0 con 0x55703d8ddc70 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.014+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93940557486112] v31'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.014+0000 7f520afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.015+0000 7f5359613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.015+0000 7f5359613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.015+0000 7f5359613800 5 note: GC not initialized 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.015+0000 7f5209fe3640 20 reqs_thread_entry: start 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.015+0000 7f5359613800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.015+0000 7f5359613800 20 Filter name: none 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.015+0000 7f517b7fe640 20 reqs_thread_entry: start 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.015+0000 7f5359613800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.015+0000 7f5359613800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.015+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d928290 con 0x55703d8e2680 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.016+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.016+0000 7f5359613800 20 rados_obj.operate() r=0 bl.length=460 2024-09-21T09:05:05.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.016+0000 7f5359613800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.016+0000 7f5359613800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.016+0000 7f5359613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.016+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d92e900 con 0x55703d8e2680 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.018+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v31'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.018+0000 7f5359613800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.018+0000 7f5359613800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.018+0000 7f5359613800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.018+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93940557734592 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703d929f60 con 0x55703d8ddc70 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.018+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== watch-notify(notify (1) cookie 93940557474752 notify 133143986208 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55703d673e00 con 0x55703d8ddc70 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.018+0000 7f522bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986208 cookie 93940557474752 notifier 4903 bl.length()=666 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.018+0000 7f522bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.018+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 notify.4 [notify cookie 93940557734592 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.018+0000 7f522bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.018+0000 7f522bfff640 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5218003ea0 con 0x55703d8ddc70 2024-09-21T09:05:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.018+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.018+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== watch-notify(notify_complete (2) cookie 93940557734592 notify 133143986208 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f533c05b870 con 0x55703d8ddc70 2024-09-21T09:05:05.026 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T09:05:03.575855Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:05:03.575846Z","tags":[],"group_ids":[]} 2024-09-21T09:05:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.019+0000 7f520afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.019+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93940557486112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d925fd0 con 0x55703d8ddc70 2024-09-21T09:05:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.020+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93940557486112] v31'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.020+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93940557462800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d925fd0 con 0x7f534400f070 2024-09-21T09:05:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.021+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93940557462800] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c057030 con 0x7f534400f070 2024-09-21T09:05:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.021+0000 7f5359613800 20 remove_watcher() i=0 2024-09-21T09:05:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.021+0000 7f5359613800 2 removed watcher, disabling cache 2024-09-21T09:05:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.021+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93940557467200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d925fd0 con 0x55703d8ddc70 2024-09-21T09:05:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.022+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93940557467200] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.023+0000 7f5359613800 20 remove_watcher() i=1 2024-09-21T09:05:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.023+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93940557460288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d925fd0 con 0x55703d8e7010 2024-09-21T09:05:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.024+0000 7f5354e3b640 1 -- 172.21.15.178:0/2797081059 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93940557460288] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f534402e070 con 0x55703d8e7010 2024-09-21T09:05:05.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.024+0000 7f5359613800 20 remove_watcher() i=2 2024-09-21T09:05:05.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.024+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93940557473216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d925fd0 con 0x7f534400f070 2024-09-21T09:05:05.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.025+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93940557473216] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c057030 con 0x7f534400f070 2024-09-21T09:05:05.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.025+0000 7f5359613800 20 remove_watcher() i=3 2024-09-21T09:05:05.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.025+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93940557474752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d925fd0 con 0x55703d8ddc70 2024-09-21T09:05:05.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.026+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93940557474752] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c057030 con 0x55703d8ddc70 2024-09-21T09:05:05.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.026+0000 7f5359613800 20 remove_watcher() i=4 2024-09-21T09:05:05.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.026+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93940557476768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d925fd0 con 0x55703d8e2680 2024-09-21T09:05:05.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.027+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93940557476768] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.027+0000 7f5359613800 20 remove_watcher() i=5 2024-09-21T09:05:05.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.027+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93940557481392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d925fd0 con 0x55703d8e2680 2024-09-21T09:05:05.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.028+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93940557481392] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.028+0000 7f5359613800 20 remove_watcher() i=6 2024-09-21T09:05:05.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.028+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93940557483040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703d925fd0 con 0x55703d8e2680 2024-09-21T09:05:05.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f535563c640 1 -- 172.21.15.178:0/2797081059 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93940557483040] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535002a070 con 0x55703d8e2680 2024-09-21T09:05:05.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 20 remove_watcher() i=7 2024-09-21T09:05:05.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55703d8e2680 msgr2=0x55703d8e4a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55703d8e2680 0x55703d8e4a70 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55703d8ddc70 msgr2=0x55703d8e0130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55703d8ddc70 0x55703d8e0130 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f534400f070 msgr2=0x7f5344019800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f534400f070 0x7f5344019800 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55703d8e7010 msgr2=0x55703d8e94d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55703d8e7010 0x55703d8e94d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5220036b40 msgr2=0x7f5220039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f5220036b40 0x7f5220039000 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f534401dfd0 tx=0x7f5344033000 comp rx=0 tx=0).stop 2024-09-21T09:05:05.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8cad00 msgr2=0x55703d8d2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 --2- 172.21.15.178:0/2797081059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8cad00 0x55703d8d2180 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5350011b50 tx=0x7f535004cb30 comp rx=0 tx=0).stop 2024-09-21T09:05:05.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 reap_dead start 2024-09-21T09:05:05.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f534c63a640 1 -- 172.21.15.178:0/2797081059 reap_dead start 2024-09-21T09:05:05.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 shutdown_connections 2024-09-21T09:05:05.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 >> 172.21.15.178:0/2797081059 conn(0x55703d8c7010 msgr2=0x55703d8c5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 shutdown_connections 2024-09-21T09:05:05.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.029+0000 7f5359613800 1 -- 172.21.15.178:0/2797081059 wait complete. 2024-09-21T09:05:05.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 -- 172.21.15.178:0/3625577188 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f522c036b40 msgr2=0x7f522c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 --2- 172.21.15.178:0/3625577188 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f522c036b40 0x7f522c039000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55703d8aad40 tx=0x7f534404b640 comp rx=0 tx=0).stop 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 -- 172.21.15.178:0/3625577188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8be050 msgr2=0x55703d8be470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 --2- 172.21.15.178:0/3625577188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8be050 0x55703d8be470 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x55703d8aaca0 tx=0x7f5350018830 comp rx=0 tx=0).stop 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 -- 172.21.15.178:0/3625577188 shutdown_connections 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 --2- 172.21.15.178:0/3625577188 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f522c036b40 0x7f522c039000 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 --2- 172.21.15.178:0/3625577188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d8be050 0x55703d8be470 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 -- 172.21.15.178:0/3625577188 >> 172.21.15.178:0/3625577188 conn(0x55703d8b2fe0 msgr2=0x55703d8b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 -- 172.21.15.178:0/3625577188 shutdown_connections 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 -- 172.21.15.178:0/3625577188 wait complete. 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55703d8acbf0 msgr2=0x55703d8aefe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55703d8acbf0 0x55703d8aefe0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55703d7b0900 msgr2=0x55703d8aa340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55703d7b0900 0x55703d8aa340 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f523c036b90 msgr2=0x7f523c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f523c036b90 0x7f523c039050 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f533c057000 tx=0x7f533c052000 comp rx=0 tx=0).stop 2024-09-21T09:05:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d720650 msgr2=0x55703d8a32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d720650 0x55703d8a32d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f5344000fd0 tx=0x7f5344000ed0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 shutdown_connections 2024-09-21T09:05:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55703d8acbf0 0x55703d8aefe0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55703d7b0900 0x55703d8aa340 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f523c036b90 0x7f523c039050 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 --2- 172.21.15.178:0/3410895807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55703d720650 0x55703d8a32d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 >> 172.21.15.178:0/3410895807 conn(0x55703d7a6db0 msgr2=0x55703d895b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 shutdown_connections 2024-09-21T09:05:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.030+0000 7f5359613800 1 -- 172.21.15.178:0/3410895807 wait complete. 2024-09-21T09:05:05.040 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:05.040 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:05.041 ERROR:root:0 2024-09-21T09:05:05.041 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:05.045 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx000005968b5b4ed4187a0-0066ee8c41-4231-default', 'HostId': '4231-default-default'} 2024-09-21T09:05:05.045 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-21T09:05:05.045 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-21T09:05:05.045 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-21T09:05:05.091 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:05.091 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:05.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.090+0000 7ff697013800 1 Processor -- start 2024-09-21T09:05:05.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.090+0000 7ff697013800 1 -- start start 2024-09-21T09:05:05.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.091+0000 7ff697013800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x559c47823d60 0x559c47826150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.091+0000 7ff697013800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559c476dcb30 con 0x559c47790dd0 2024-09-21T09:05:05.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.091+0000 7ff697013800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x559c476be360 con 0x559c47823d60 2024-09-21T09:05:05.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.091+0000 7ff691e66640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x559c47823d60 0x559c47826150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.091+0000 7ff691e66640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x559c47823d60 0x559c47826150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32896/0 (socket says 172.21.15.178:32896) 2024-09-21T09:05:05.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.091+0000 7ff692667640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x559c47790dd0 0x559c47822640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40586/0 (socket says 172.21.15.178:40586) 2024-09-21T09:05:05.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.091+0000 7ff691e66640 1 -- 172.21.15.178:0/2273930325 learned_addr learned my addr 172.21.15.178:0/2273930325 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.091+0000 7ff691e66640 1 -- 172.21.15.178:0/2273930325 >> v1:172.21.15.44:6789/0 conn(0x559c47790dd0 legacy=0x559c47822640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.091+0000 7ff691e66640 1 -- 172.21.15.178:0/2273930325 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c476e4e00 con 0x559c47823d60 2024-09-21T09:05:05.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.093+0000 7ff691e66640 1 --2- 172.21.15.178:0/2273930325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47823d60 0x559c47826150 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff68800a520 tx=0x7ff688045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f30b90592eab8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.093+0000 7ff691665640 1 -- 172.21.15.178:0/2273930325 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff688055070 con 0x559c47823d60 2024-09-21T09:05:05.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.093+0000 7ff691665640 1 -- 172.21.15.178:0/2273930325 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6880515b0 con 0x559c47823d60 2024-09-21T09:05:05.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.093+0000 7ff691665640 1 -- 172.21.15.178:0/2273930325 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6880518d0 con 0x559c47823d60 2024-09-21T09:05:05.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.094+0000 7ff697013800 1 -- 172.21.15.178:0/2273930325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47823d60 msgr2=0x559c47826150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.094+0000 7ff697013800 1 --2- 172.21.15.178:0/2273930325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47823d60 0x559c47826150 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff68800a520 tx=0x7ff688045ba0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.094+0000 7ff697013800 1 -- 172.21.15.178:0/2273930325 shutdown_connections 2024-09-21T09:05:05.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.094+0000 7ff697013800 1 --2- 172.21.15.178:0/2273930325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47823d60 0x559c47826150 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.094+0000 7ff697013800 1 -- 172.21.15.178:0/2273930325 >> 172.21.15.178:0/2273930325 conn(0x559c47817dd0 msgr2=0x559c4781a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.094+0000 7ff697013800 1 -- 172.21.15.178:0/2273930325 shutdown_connections 2024-09-21T09:05:05.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.094+0000 7ff697013800 1 -- 172.21.15.178:0/2273930325 wait complete. 2024-09-21T09:05:05.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.108+0000 7ff697013800 1 Processor -- start 2024-09-21T09:05:05.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.108+0000 7ff697013800 1 -- start start 2024-09-21T09:05:05.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.108+0000 7ff697013800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47790dd0 0x559c4790eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.108+0000 7ff697013800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559c47769360 con 0x559c47790dd0 2024-09-21T09:05:05.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.108+0000 7ff692667640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47790dd0 0x559c4790eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.108+0000 7ff692667640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47790dd0 0x559c4790eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32904/0 (socket says 172.21.15.178:32904) 2024-09-21T09:05:05.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.108+0000 7ff692667640 1 -- 172.21.15.178:0/1845257101 learned_addr learned my addr 172.21.15.178:0/1845257101 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.108+0000 7ff692667640 1 -- 172.21.15.178:0/1845257101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c476b6bc0 con 0x559c47790dd0 2024-09-21T09:05:05.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.109+0000 7ff692667640 1 --2- 172.21.15.178:0/1845257101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47790dd0 0x559c4790eaf0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff68400b230 tx=0x7ff68400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f50819c3fab654 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.109+0000 7ff580608640 1 -- 172.21.15.178:0/1845257101 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff68400e5c0 con 0x559c47790dd0 2024-09-21T09:05:05.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.109+0000 7ff580608640 1 -- 172.21.15.178:0/1845257101 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff684006070 con 0x559c47790dd0 2024-09-21T09:05:05.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.109+0000 7ff580608640 1 -- 172.21.15.178:0/1845257101 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff68400e890 con 0x559c47790dd0 2024-09-21T09:05:05.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.109+0000 7ff697013800 1 -- 172.21.15.178:0/1845257101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47790dd0 msgr2=0x559c4790eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.109+0000 7ff697013800 1 --2- 172.21.15.178:0/1845257101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47790dd0 0x559c4790eaf0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff68400b230 tx=0x7ff68400b6f0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.109+0000 7ff697013800 1 -- 172.21.15.178:0/1845257101 shutdown_connections 2024-09-21T09:05:05.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.109+0000 7ff697013800 1 --2- 172.21.15.178:0/1845257101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47790dd0 0x559c4790eaf0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.109+0000 7ff697013800 1 -- 172.21.15.178:0/1845257101 >> 172.21.15.178:0/1845257101 conn(0x559c47817dd0 msgr2=0x559c4790a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.109+0000 7ff697013800 1 -- 172.21.15.178:0/1845257101 shutdown_connections 2024-09-21T09:05:05.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.110+0000 7ff697013800 1 -- 172.21.15.178:0/1845257101 wait complete. 2024-09-21T09:05:05.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.110+0000 7ff697013800 1 Processor -- start 2024-09-21T09:05:05.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.110+0000 7ff697013800 1 -- start start 2024-09-21T09:05:05.113 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.110+0000 7ff697013800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47790dd0 0x559c47916500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.110+0000 7ff697013800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559c47826930 con 0x559c47790dd0 2024-09-21T09:05:05.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.110+0000 7ff692667640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47790dd0 0x559c47916500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.110+0000 7ff692667640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47790dd0 0x559c47916500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32914/0 (socket says 172.21.15.178:32914) 2024-09-21T09:05:05.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.110+0000 7ff692667640 1 -- 172.21.15.178:0/3341950128 learned_addr learned my addr 172.21.15.178:0/3341950128 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.110+0000 7ff692667640 1 -- 172.21.15.178:0/3341950128 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c476cafe0 con 0x559c47790dd0 2024-09-21T09:05:05.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.111+0000 7ff692667640 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47790dd0 0x559c47916500 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff684000fd0 tx=0x7ff684000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.111+0000 7ff57ee05640 1 -- 172.21.15.178:0/3341950128 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff68400f8d0 con 0x559c47790dd0 2024-09-21T09:05:05.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.111+0000 7ff57ee05640 1 -- 172.21.15.178:0/3341950128 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68400fa90 con 0x559c47790dd0 2024-09-21T09:05:05.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.111+0000 7ff57ee05640 1 -- 172.21.15.178:0/3341950128 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff68400fdb0 con 0x559c47790dd0 2024-09-21T09:05:05.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.111+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c47916a40 con 0x559c47790dd0 2024-09-21T09:05:05.114 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.111+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c47916f60 con 0x559c47790dd0 2024-09-21T09:05:05.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.112+0000 7ff57ee05640 1 -- 172.21.15.178:0/3341950128 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff684017070 con 0x559c47790dd0 2024-09-21T09:05:05.117 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.112+0000 7ff57ee05640 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff578036b90 0x7ff578039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.112+0000 7ff57ee05640 1 -- 172.21.15.178:0/3341950128 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ff684015020 con 0x559c47790dd0 2024-09-21T09:05:05.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.112+0000 7ff691e66640 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff578036b90 0x7ff578039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.112+0000 7ff697013800 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559c47823d60 0x559c4791d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.112+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c4791daf0 con 0x559c47823d60 2024-09-21T09:05:05.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.112+0000 7ff692e68640 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559c47823d60 0x559c4791d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.112+0000 7ff691e66640 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff578036b90 0x7ff578039050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff688057000 tx=0x7ff688052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.112+0000 7ff692e68640 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559c47823d60 0x559c4791d570 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.113+0000 7ff692e68640 1 -- 172.21.15.178:0/3341950128 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff68c00a4a0 con 0x559c47823d60 2024-09-21T09:05:05.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.113+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c4791ab20 con 0x559c47823d60 2024-09-21T09:05:05.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.113+0000 7ff692e68640 1 -- 172.21.15.178:0/3341950128 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff68c00a4a0 con 0x559c47823d60 2024-09-21T09:05:05.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.113+0000 7ff697013800 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559c4791fe20 0x559c47922210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.113+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c479228b0 con 0x559c4791fe20 2024-09-21T09:05:05.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.113+0000 7ff692667640 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559c4791fe20 0x559c47922210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.114+0000 7ff692667640 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559c4791fe20 0x559c47922210 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.114+0000 7ff692667640 1 -- 172.21.15.178:0/3341950128 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff68402e070 con 0x559c4791fe20 2024-09-21T09:05:05.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.114+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c4791ecc0 con 0x559c47823d60 2024-09-21T09:05:05.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.114+0000 7ff692e68640 1 -- 172.21.15.178:0/3341950128 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff68c00a4a0 con 0x559c47823d60 2024-09-21T09:05:05.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.114+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c4791f1a0 con 0x559c47823d60 2024-09-21T09:05:05.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.114+0000 7ff692e68640 1 -- 172.21.15.178:0/3341950128 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff68c00a4a0 con 0x559c47823d60 2024-09-21T09:05:05.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.115+0000 7ff697013800 1 Processor -- start 2024-09-21T09:05:05.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.115+0000 7ff697013800 1 -- start start 2024-09-21T09:05:05.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.115+0000 7ff697013800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47931270 0x559c47931690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.115+0000 7ff697013800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559c476b8580 con 0x559c47931270 2024-09-21T09:05:05.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.115+0000 7ff692e68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47931270 0x559c47931690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.115+0000 7ff692e68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47931270 0x559c47931690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32930/0 (socket says 172.21.15.178:32930) 2024-09-21T09:05:05.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.115+0000 7ff692e68640 1 -- 172.21.15.178:0/4113534976 learned_addr learned my addr 172.21.15.178:0/4113534976 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.115+0000 7ff692e68640 1 -- 172.21.15.178:0/4113534976 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c47931bd0 con 0x559c47931270 2024-09-21T09:05:05.119 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.116+0000 7ff692e68640 1 --2- 172.21.15.178:0/4113534976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47931270 0x559c47931690 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x559c479175b0 tx=0x7ff68c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.116+0000 7ff577fff640 1 -- 172.21.15.178:0/4113534976 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff68c014450 con 0x559c47931270 2024-09-21T09:05:05.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.116+0000 7ff577fff640 1 -- 172.21.15.178:0/4113534976 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68c0145f0 con 0x559c47931270 2024-09-21T09:05:05.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.116+0000 7ff697013800 1 -- 172.21.15.178:0/4113534976 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c47931e60 con 0x559c47931270 2024-09-21T09:05:05.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.116+0000 7ff577fff640 1 -- 172.21.15.178:0/4113534976 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff68c0148d0 con 0x559c47931270 2024-09-21T09:05:05.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.116+0000 7ff697013800 1 -- 172.21.15.178:0/4113534976 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c47934b40 con 0x559c47931270 2024-09-21T09:05:05.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.117+0000 7ff577fff640 1 -- 172.21.15.178:0/4113534976 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff68c011040 con 0x559c47931270 2024-09-21T09:05:05.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.117+0000 7ff577fff640 1 --2- 172.21.15.178:0/4113534976 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff56c036b40 0x7ff56c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.117+0000 7ff577fff640 1 -- 172.21.15.178:0/4113534976 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ff68c01e070 con 0x559c47931270 2024-09-21T09:05:05.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.117+0000 7ff692667640 1 --2- 172.21.15.178:0/4113534976 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff56c036b40 0x7ff56c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.117+0000 7ff697013800 1 Processor -- start 2024-09-21T09:05:05.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.117+0000 7ff692667640 1 --2- 172.21.15.178:0/4113534976 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff56c036b40 0x7ff56c039000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x559c4791df60 tx=0x7ff68401d450 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.117+0000 7ff697013800 1 -- start start 2024-09-21T09:05:05.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.117+0000 7ff697013800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c4793df40 0x559c4793e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.117+0000 7ff697013800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559c4790f2a0 con 0x559c4793df40 2024-09-21T09:05:05.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.117+0000 7ff692e68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c4793df40 0x559c4793e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.117+0000 7ff692e68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c4793df40 0x559c4793e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32936/0 (socket says 172.21.15.178:32936) 2024-09-21T09:05:05.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.117+0000 7ff692e68640 1 -- 172.21.15.178:0/868047884 learned_addr learned my addr 172.21.15.178:0/868047884 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.128 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.118+0000 7ff692e68640 1 -- 172.21.15.178:0/868047884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c4793e910 con 0x559c4793df40 2024-09-21T09:05:05.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.118+0000 7ff692e68640 1 --2- 172.21.15.178:0/868047884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c4793df40 0x559c4793e340 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff68c04cb90 tx=0x7ff68c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab33bd61f6e0a121 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.118+0000 7ff575ffb640 1 -- 172.21.15.178:0/868047884 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff68c044070 con 0x559c4793df40 2024-09-21T09:05:05.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.118+0000 7ff575ffb640 1 -- 172.21.15.178:0/868047884 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68c013c90 con 0x559c4793df40 2024-09-21T09:05:05.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.118+0000 7ff575ffb640 1 -- 172.21.15.178:0/868047884 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff68c02ba60 con 0x559c4793df40 2024-09-21T09:05:05.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.118+0000 7ff697013800 1 -- 172.21.15.178:0/868047884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c4793df40 msgr2=0x559c4793e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.118+0000 7ff697013800 1 --2- 172.21.15.178:0/868047884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c4793df40 0x559c4793e340 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff68c04cb90 tx=0x7ff68c011700 comp rx=0 tx=0).stop 2024-09-21T09:05:05.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.118+0000 7ff697013800 1 -- 172.21.15.178:0/868047884 shutdown_connections 2024-09-21T09:05:05.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.118+0000 7ff697013800 1 --2- 172.21.15.178:0/868047884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c4793df40 0x559c4793e340 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.118+0000 7ff697013800 1 -- 172.21.15.178:0/868047884 >> 172.21.15.178:0/868047884 conn(0x559c4793a2a0 msgr2=0x559c479383a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.118+0000 7ff697013800 1 -- 172.21.15.178:0/868047884 shutdown_connections 2024-09-21T09:05:05.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.118+0000 7ff697013800 1 -- 172.21.15.178:0/868047884 wait complete. 2024-09-21T09:05:05.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.119+0000 7ff697013800 1 Processor -- start 2024-09-21T09:05:05.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.119+0000 7ff697013800 1 -- start start 2024-09-21T09:05:05.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.119+0000 7ff697013800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c4793df40 0x559c479453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.119+0000 7ff697013800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559c4793ef80 con 0x559c4793df40 2024-09-21T09:05:05.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.119+0000 7ff692e68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c4793df40 0x559c479453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.119+0000 7ff692e68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c4793df40 0x559c479453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32944/0 (socket says 172.21.15.178:32944) 2024-09-21T09:05:05.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.119+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 learned_addr learned my addr 172.21.15.178:0/1056695794 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.119+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c47945930 con 0x559c4793df40 2024-09-21T09:05:05.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.119+0000 7ff692e68640 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c4793df40 0x559c479453f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff68c04ba60 tx=0x7ff68c04cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.120+0000 7ff563fff640 1 -- 172.21.15.178:0/1056695794 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff68c03a020 con 0x559c4793df40 2024-09-21T09:05:05.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.120+0000 7ff563fff640 1 -- 172.21.15.178:0/1056695794 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68c04e2e0 con 0x559c4793df40 2024-09-21T09:05:05.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.120+0000 7ff563fff640 1 -- 172.21.15.178:0/1056695794 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff68c02b350 con 0x559c4793df40 2024-09-21T09:05:05.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.120+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c47945bc0 con 0x559c4793df40 2024-09-21T09:05:05.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.120+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c47948870 con 0x559c4793df40 2024-09-21T09:05:05.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.120+0000 7ff563fff640 1 -- 172.21.15.178:0/1056695794 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff68c03d020 con 0x559c4793df40 2024-09-21T09:05:05.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.120+0000 7ff563fff640 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff55c036af0 0x7ff55c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.130 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.121+0000 7ff563fff640 1 -- 172.21.15.178:0/1056695794 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ff68c033040 con 0x559c4793df40 2024-09-21T09:05:05.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.121+0000 7ff692667640 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff55c036af0 0x7ff55c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.121+0000 7ff692667640 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff55c036af0 0x7ff55c038fb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff68401dfd0 tx=0x7ff68404d000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.121+0000 7ff697013800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.121+0000 7ff697013800 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559c47951010 0x559c479534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.121+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c47953c20 con 0x559c47951010 2024-09-21T09:05:05.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.121+0000 7ff691e66640 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559c47951010 0x559c479534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff691e66640 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559c47951010 0x559c479534d0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff697013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff697013800 20 realm 2024-09-21T09:05:05.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff697013800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c47954050 con 0x559c47951010 2024-09-21T09:05:05.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff697013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff697013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff697013800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c47954920 con 0x559c47951010 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff697013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff697013800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.122+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c47954cc0 con 0x559c47951010 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.123+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.123+0000 7ff697013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.123+0000 7ff697013800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.123+0000 7ff697013800 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559c47955a20 0x559c47957e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.123+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c47958420 con 0x559c47955a20 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.123+0000 7ff692e68640 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559c47955a20 0x559c47957e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.123+0000 7ff692e68640 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559c47955a20 0x559c47957e10 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.123+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.123+0000 7ff697013800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:05.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.124+0000 7ff697013800 20 searching for the correct realm 2024-09-21T09:05:05.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.124+0000 7ff697013800 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559c4795a3b0 0x559c4795c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.124+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c4795a3b0 2024-09-21T09:05:05.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.124+0000 7ff692667640 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559c4795a3b0 0x559c4795c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.124+0000 7ff692667640 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559c4795a3b0 0x559c4795c870 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.124+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68403b040 con 0x559c4795a3b0 2024-09-21T09:05:05.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.124+0000 7ff692667640 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff68400f070 0x7ff684019860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.124+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x7ff68400f070 2024-09-21T09:05:05.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.124+0000 7ff691e66640 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff68400f070 0x7ff684019860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.125+0000 7ff691e66640 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff68400f070 0x7ff684019860 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.125+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff688057030 con 0x7ff68400f070 2024-09-21T09:05:05.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.125+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47955a20 2024-09-21T09:05:05.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.125+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.125+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47951010 2024-09-21T09:05:05.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.125+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.125+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47951010 2024-09-21T09:05:05.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.126+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.126+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47955a20 2024-09-21T09:05:05.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.126+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.126+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47955a20 2024-09-21T09:05:05.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.126+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.126+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x7ff68400f070 2024-09-21T09:05:05.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.126+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff688057030 con 0x7ff68400f070 2024-09-21T09:05:05.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.126+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c4795a3b0 2024-09-21T09:05:05.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.126+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68403b040 con 0x559c4795a3b0 2024-09-21T09:05:05.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.127+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47951010 2024-09-21T09:05:05.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.127+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.127+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47955a20 2024-09-21T09:05:05.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.127+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.127+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47951010 2024-09-21T09:05:05.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.127+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.127+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x7ff68400f070 2024-09-21T09:05:05.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.127+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff688057030 con 0x7ff68400f070 2024-09-21T09:05:05.143 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.128+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c4795a3b0 2024-09-21T09:05:05.144 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.128+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68403b040 con 0x559c4795a3b0 2024-09-21T09:05:05.144 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.128+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c4795a3b0 2024-09-21T09:05:05.144 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.128+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68403b040 con 0x559c4795a3b0 2024-09-21T09:05:05.144 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.128+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47955a20 2024-09-21T09:05:05.144 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.128+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.144 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.128+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c4795a3b0 2024-09-21T09:05:05.144 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.129+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68403b040 con 0x559c4795a3b0 2024-09-21T09:05:05.144 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.129+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c4795a3b0 2024-09-21T09:05:05.144 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.129+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68403b040 con 0x559c4795a3b0 2024-09-21T09:05:05.144 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.129+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47951010 2024-09-21T09:05:05.144 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.129+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.144 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.129+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47951010 2024-09-21T09:05:05.144 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.129+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.129+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47955a20 2024-09-21T09:05:05.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.130+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.130+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c4795a3b0 2024-09-21T09:05:05.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.130+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68403b040 con 0x559c4795a3b0 2024-09-21T09:05:05.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.130+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x7ff68400f070 2024-09-21T09:05:05.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.130+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff688057030 con 0x7ff68400f070 2024-09-21T09:05:05.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.130+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47951010 2024-09-21T09:05:05.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.130+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.130+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47955a20 2024-09-21T09:05:05.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.131+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.131+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c4795a3b0 2024-09-21T09:05:05.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.131+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68403b040 con 0x559c4795a3b0 2024-09-21T09:05:05.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.131+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x7ff68400f070 2024-09-21T09:05:05.145 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.131+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff688057030 con 0x7ff68400f070 2024-09-21T09:05:05.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.131+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x7ff68400f070 2024-09-21T09:05:05.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.131+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff688057030 con 0x7ff68400f070 2024-09-21T09:05:05.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.131+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c4795a3b0 2024-09-21T09:05:05.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.131+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68403b040 con 0x559c4795a3b0 2024-09-21T09:05:05.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.131+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47955a20 2024-09-21T09:05:05.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x559c47951010 2024-09-21T09:05:05.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559c4795cf40 con 0x7ff68400f070 2024-09-21T09:05:05.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff688057030 con 0x7ff68400f070 2024-09-21T09:05:05.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff697013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:05.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff697013800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:05.146 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff697013800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:05.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff697013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:05.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff697013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:05.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff697013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:05.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff697013800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c47958c70 con 0x559c47951010 2024-09-21T09:05:05.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff697013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff697013800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.132+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c47959060 con 0x559c47951010 2024-09-21T09:05:05.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:05.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c4795d3c0 con 0x559c47951010 2024-09-21T09:05:05.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 20 zone default found 2024-09-21T09:05:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 4 Realm: () 2024-09-21T09:05:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 20 zonegroup default 2024-09-21T09:05:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c4795d430 con 0x559c47955a20 2024-09-21T09:05:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.133+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c4795f700 con 0x559c4795a3b0 2024-09-21T09:05:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.134+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff68403b040 con 0x559c4795a3b0 2024-09-21T09:05:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.134+0000 7ff697013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.134+0000 7ff697013800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.134+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c4795faa0 con 0x559c4795a3b0 2024-09-21T09:05:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.134+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff68403b040 con 0x559c4795a3b0 2024-09-21T09:05:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.134+0000 7ff697013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.134+0000 7ff697013800 20 started sync module instance, tier type = 2024-09-21T09:05:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.134+0000 7ff697013800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.134+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c4795eb90 con 0x7ff68400f070 2024-09-21T09:05:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.135+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff688057030 con 0x7ff68400f070 2024-09-21T09:05:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.135+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94129704267968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c4795eb90 con 0x7ff68400f070 2024-09-21T09:05:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.135+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c479604b0 con 0x559c47951010 2024-09-21T09:05:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.136+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94129704267968] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff688057030 con 0x7ff68400f070 2024-09-21T09:05:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.136+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.136+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94129704272352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c4795eb90 con 0x559c47951010 2024-09-21T09:05:05.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.136+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c47960f00 con 0x559c4795a3b0 2024-09-21T09:05:05.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.137+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff68403b040 con 0x559c4795a3b0 2024-09-21T09:05:05.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.138+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94129704274448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c479617a0 con 0x559c4795a3b0 2024-09-21T09:05:05.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.138+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c47962290 con 0x7ff68400f070 2024-09-21T09:05:05.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.138+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94129704272352] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.139+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff688057030 con 0x7ff68400f070 2024-09-21T09:05:05.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.139+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94129704274448] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff68403b040 con 0x559c4795a3b0 2024-09-21T09:05:05.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.139+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94129704279392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c47962680 con 0x7ff68400f070 2024-09-21T09:05:05.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.139+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c479612f0 con 0x559c47951010 2024-09-21T09:05:05.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.139+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94129704279392] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff688057030 con 0x7ff68400f070 2024-09-21T09:05:05.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.140+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.140+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94129704265440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c479612f0 con 0x559c47951010 2024-09-21T09:05:05.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.140+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c47963530 con 0x559c47955a20 2024-09-21T09:05:05.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.141+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94129704265440] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.141+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.141+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94129704283024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c47963920 con 0x559c47955a20 2024-09-21T09:05:05.151 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.141+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c47964320 con 0x559c47955a20 2024-09-21T09:05:05.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.142+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(56 notify.6 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.142+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94129704287792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c479647a0 con 0x559c47955a20 2024-09-21T09:05:05.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.142+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c479652c0 con 0x559c47955a20 2024-09-21T09:05:05.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.142+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94129704283024] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.143+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94129704287792] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.143+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.143+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94129704288848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c47962fb0 con 0x559c47955a20 2024-09-21T09:05:05.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.143+0000 7ff697013800 20 add_watcher() i=0 2024-09-21T09:05:05.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.143+0000 7ff697013800 20 add_watcher() i=1 2024-09-21T09:05:05.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.143+0000 7ff697013800 20 add_watcher() i=2 2024-09-21T09:05:05.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.143+0000 7ff697013800 20 add_watcher() i=3 2024-09-21T09:05:05.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.143+0000 7ff697013800 20 add_watcher() i=4 2024-09-21T09:05:05.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.143+0000 7ff697013800 20 add_watcher() i=5 2024-09-21T09:05:05.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.143+0000 7ff697013800 20 add_watcher() i=6 2024-09-21T09:05:05.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.144+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94129704288848] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.144+0000 7ff697013800 20 add_watcher() i=7 2024-09-21T09:05:05.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.144+0000 7ff697013800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:05.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.144+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c479682b0 con 0x559c47951010 2024-09-21T09:05:05.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.144+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.144+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94129704291728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c47965730 con 0x559c47951010 2024-09-21T09:05:05.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.145+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94129704291728] v31'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.145+0000 7ff548fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:05.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.145+0000 7ff697013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:05.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.145+0000 7ff697013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:05.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.145+0000 7ff697013800 5 note: GC not initialized 2024-09-21T09:05:05.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.145+0000 7ff4c37fe640 20 reqs_thread_entry: start 2024-09-21T09:05:05.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.146+0000 7ff697013800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:05.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.146+0000 7ff697013800 20 Filter name: none 2024-09-21T09:05:05.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.146+0000 7ff4c17fa640 20 reqs_thread_entry: start 2024-09-21T09:05:05.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.146+0000 7ff697013800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T09:05:05.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.146+0000 7ff697013800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.146+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c4799b5b0 con 0x559c47955a20 2024-09-21T09:05:05.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.146+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.146+0000 7ff697013800 20 rados_obj.operate() r=0 bl.length=490 2024-09-21T09:05:05.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.147+0000 7ff697013800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T09:05:05.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.147+0000 7ff697013800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:05.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.147+0000 7ff697013800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:05:05.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.147+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c479a1d40 con 0x559c47955a20 2024-09-21T09:05:05.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.148+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v31'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.148+0000 7ff697013800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:05.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.148+0000 7ff697013800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:05.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.148+0000 7ff697013800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T09:05:05.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.148+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94129704539904 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559c4799d3c0 con 0x559c47951010 2024-09-21T09:05:05.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.148+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== watch-notify(notify (1) cookie 94129704265440 notify 133143986209 ret 0) ==== 678+0+0 (crc 0 0 0) 0x559c476e4e00 con 0x559c47951010 2024-09-21T09:05:05.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.148+0000 7ff575ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986209 cookie 94129704265440 notifier 4910 bl.length()=636 2024-09-21T09:05:05.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.148+0000 7ff575ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:05.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.148+0000 7ff575ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:05.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.148+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 notify.4 [notify cookie 94129704539904 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.148+0000 7ff575ffb640 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7ff558003ea0 con 0x559c47951010 2024-09-21T09:05:05.158 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.149+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== watch-notify(notify_complete (2) cookie 94129704539904 notify 133143986209 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff68805b870 con 0x559c47951010 2024-09-21T09:05:05.158 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.149+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.158 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T09:05:03.575855Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:05:03.575846Z","tags":[],"group_ids":[]} 2024-09-21T09:05:05.162 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.149+0000 7ff548fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:05.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.149+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94129704291728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c479992d0 con 0x559c47951010 2024-09-21T09:05:05.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.150+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94129704291728] v31'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.150+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94129704267968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c479992d0 con 0x7ff68400f070 2024-09-21T09:05:05.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.151+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94129704267968] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff688057030 con 0x7ff68400f070 2024-09-21T09:05:05.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.151+0000 7ff697013800 20 remove_watcher() i=0 2024-09-21T09:05:05.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.151+0000 7ff697013800 2 removed watcher, disabling cache 2024-09-21T09:05:05.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.151+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94129704272352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c479992d0 con 0x559c47951010 2024-09-21T09:05:05.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.152+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94129704272352] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.153+0000 7ff697013800 20 remove_watcher() i=1 2024-09-21T09:05:05.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.153+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94129704274448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c479992d0 con 0x559c4795a3b0 2024-09-21T09:05:05.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.153+0000 7ff692667640 1 -- 172.21.15.178:0/1056695794 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94129704274448] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff68403b040 con 0x559c4795a3b0 2024-09-21T09:05:05.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.154+0000 7ff697013800 20 remove_watcher() i=2 2024-09-21T09:05:05.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.154+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94129704279392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c479601e0 con 0x7ff68400f070 2024-09-21T09:05:05.163 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.154+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94129704279392] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff688057030 con 0x7ff68400f070 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.155+0000 7ff697013800 20 remove_watcher() i=3 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.155+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94129704265440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c47961d60 con 0x559c47951010 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.155+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94129704265440] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff688057030 con 0x559c47951010 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.156+0000 7ff697013800 20 remove_watcher() i=4 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.156+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94129704283024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c479601e0 con 0x559c47955a20 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.156+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94129704283024] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.157+0000 7ff697013800 20 remove_watcher() i=5 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.157+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94129704287792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c4795e6e0 con 0x559c47955a20 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.157+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94129704287792] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.157+0000 7ff697013800 20 remove_watcher() i=6 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.157+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94129704288848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559c47962b90 con 0x559c47955a20 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.158+0000 7ff692e68640 1 -- 172.21.15.178:0/1056695794 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94129704288848] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff68c02a070 con 0x559c47955a20 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.158+0000 7ff697013800 20 remove_watcher() i=7 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559c47955a20 msgr2=0x559c47957e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.164 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559c47955a20 0x559c47957e10 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559c47951010 msgr2=0x559c479534d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559c47951010 0x559c479534d0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff68400f070 msgr2=0x7ff684019860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7ff68400f070 0x7ff684019860 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559c4795a3b0 msgr2=0x559c4795c870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x559c4795a3b0 0x559c4795c870 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff55c036af0 msgr2=0x7ff55c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff55c036af0 0x7ff55c038fb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff68401dfd0 tx=0x7ff68404d000 comp rx=0 tx=0).stop 2024-09-21T09:05:05.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c4793df40 msgr2=0x559c479453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff691e66640 1 -- 172.21.15.178:0/1056695794 reap_dead start 2024-09-21T09:05:05.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c4793df40 0x559c479453f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff68c04ba60 tx=0x7ff68c04cb20 comp rx=0 tx=0).stop 2024-09-21T09:05:05.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 shutdown_connections 2024-09-21T09:05:05.165 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 --2- 172.21.15.178:0/1056695794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c4793df40 0x559c479453f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 >> 172.21.15.178:0/1056695794 conn(0x559c4793a2a0 msgr2=0x559c47938370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 shutdown_connections 2024-09-21T09:05:05.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/1056695794 wait complete. 2024-09-21T09:05:05.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/4113534976 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff56c036b40 msgr2=0x7ff56c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 --2- 172.21.15.178:0/4113534976 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff56c036b40 0x7ff56c039000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x559c4791df60 tx=0x7ff68401d450 comp rx=0 tx=0).stop 2024-09-21T09:05:05.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/4113534976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47931270 msgr2=0x559c47931690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 --2- 172.21.15.178:0/4113534976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47931270 0x559c47931690 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x559c479175b0 tx=0x7ff68c0188f0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/4113534976 shutdown_connections 2024-09-21T09:05:05.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 --2- 172.21.15.178:0/4113534976 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff56c036b40 0x7ff56c039000 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 --2- 172.21.15.178:0/4113534976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47931270 0x559c47931690 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/4113534976 >> 172.21.15.178:0/4113534976 conn(0x559c47926200 msgr2=0x559c47928d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/4113534976 shutdown_connections 2024-09-21T09:05:05.166 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.159+0000 7ff697013800 1 -- 172.21.15.178:0/4113534976 wait complete. 2024-09-21T09:05:05.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559c4791fe20 msgr2=0x559c47922210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559c4791fe20 0x559c47922210 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559c47823d60 msgr2=0x559c4791d570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559c47823d60 0x559c4791d570 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff578036b90 msgr2=0x7ff578039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff578036b90 0x7ff578039050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff688057000 tx=0x7ff688052000 comp rx=0 tx=0).stop 2024-09-21T09:05:05.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47790dd0 msgr2=0x559c47916500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47790dd0 0x559c47916500 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff684000fd0 tx=0x7ff684000ed0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 shutdown_connections 2024-09-21T09:05:05.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x559c4791fe20 0x559c47922210 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x559c47823d60 0x559c4791d570 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7ff578036b90 0x7ff578039050 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 --2- 172.21.15.178:0/3341950128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c47790dd0 0x559c47916500 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.167 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 >> 172.21.15.178:0/3341950128 conn(0x559c47817dd0 msgr2=0x559c47908d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 shutdown_connections 2024-09-21T09:05:05.168 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.160+0000 7ff697013800 1 -- 172.21.15.178:0/3341950128 wait complete. 2024-09-21T09:05:05.170 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:05.170 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:05.170 ERROR:root:0 2024-09-21T09:05:05.170 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T09:05:05.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T09:05:05.171 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-21T09:05:05.217 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:05.217 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:05.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.216+0000 7f01c0c10800 1 Processor -- start 2024-09-21T09:05:05.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.216+0000 7f01c0c10800 1 -- start start 2024-09-21T09:05:05.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.216+0000 7f01c0c10800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55acf2476650 0x55acf25051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.216+0000 7f01c0c10800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55acf23c1b30 con 0x55acf2505720 2024-09-21T09:05:05.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.216+0000 7f01c0c10800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x55acf23a3360 con 0x55acf2476650 2024-09-21T09:05:05.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.217+0000 7f01bc3c6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x55acf2476650 0x55acf25051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.217+0000 7f01b3bc5640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x55acf2505720 0x55acf2507b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40588/0 (socket says 172.21.15.178:40588) 2024-09-21T09:05:05.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.217+0000 7f01b3bc5640 1 -- 172.21.15.178:0/3955293973 learned_addr learned my addr 172.21.15.178:0/3955293973 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-21T09:05:05.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.217+0000 7f01bc3c6640 1 -- 172.21.15.178:0/3955293973 >> v1:172.21.15.44:6789/0 conn(0x55acf2505720 legacy=0x55acf2507b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.219 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.217+0000 7f01bc3c6640 1 -- 172.21.15.178:0/3955293973 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf23c9e00 con 0x55acf2476650 2024-09-21T09:05:05.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.219+0000 7f01bc3c6640 1 --2- 172.21.15.178:0/3955293973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25051e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00a470 tx=0x7f01ac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1376e8477bd6cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.219+0000 7f01bbbc5640 1 -- 172.21.15.178:0/3955293973 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ac053570 con 0x55acf2476650 2024-09-21T09:05:05.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.219+0000 7f01bbbc5640 1 -- 172.21.15.178:0/3955293973 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ac058070 con 0x55acf2476650 2024-09-21T09:05:05.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.219+0000 7f01bbbc5640 1 -- 172.21.15.178:0/3955293973 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ac053880 con 0x55acf2476650 2024-09-21T09:05:05.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.220+0000 7f01c0c10800 1 -- 172.21.15.178:0/3955293973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 msgr2=0x55acf25051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.220+0000 7f01c0c10800 1 --2- 172.21.15.178:0/3955293973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25051e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00a470 tx=0x7f01ac045a20 comp rx=0 tx=0).stop 2024-09-21T09:05:05.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.220+0000 7f01c0c10800 1 -- 172.21.15.178:0/3955293973 shutdown_connections 2024-09-21T09:05:05.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.220+0000 7f01c0c10800 1 --2- 172.21.15.178:0/3955293973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25051e0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.220+0000 7f01c0c10800 1 -- 172.21.15.178:0/3955293973 >> 172.21.15.178:0/3955293973 conn(0x55acf24fcdb0 msgr2=0x55acf24ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.220+0000 7f01c0c10800 1 -- 172.21.15.178:0/3955293973 shutdown_connections 2024-09-21T09:05:05.222 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.220+0000 7f01c0c10800 1 -- 172.21.15.178:0/3955293973 wait complete. 2024-09-21T09:05:05.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.233+0000 7f01c0c10800 1 Processor -- start 2024-09-21T09:05:05.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.233+0000 7f01c0c10800 1 -- start start 2024-09-21T09:05:05.235 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.234+0000 7f01c0c10800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.234+0000 7f01c0c10800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55acf244e360 con 0x55acf2476650 2024-09-21T09:05:05.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.234+0000 7f01bc3c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.234+0000 7f01bc3c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25f18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32962/0 (socket says 172.21.15.178:32962) 2024-09-21T09:05:05.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.234+0000 7f01bc3c6640 1 -- 172.21.15.178:0/3817096762 learned_addr learned my addr 172.21.15.178:0/3817096762 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.234+0000 7f01bc3c6640 1 -- 172.21.15.178:0/3817096762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf239bbc0 con 0x55acf2476650 2024-09-21T09:05:05.236 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.234+0000 7f01bc3c6640 1 --2- 172.21.15.178:0/3817096762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25f18e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f01ac025c20 tx=0x7f01ac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921f74d1d5e19c22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.235+0000 7f00aa60c640 1 -- 172.21.15.178:0/3817096762 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ac05c580 con 0x55acf2476650 2024-09-21T09:05:05.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.235+0000 7f00aa60c640 1 -- 172.21.15.178:0/3817096762 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ac063030 con 0x55acf2476650 2024-09-21T09:05:05.237 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.235+0000 7f00aa60c640 1 -- 172.21.15.178:0/3817096762 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ac05c850 con 0x55acf2476650 2024-09-21T09:05:05.238 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.235+0000 7f01c0c10800 1 -- 172.21.15.178:0/3817096762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 msgr2=0x55acf25f18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.235+0000 7f01c0c10800 1 --2- 172.21.15.178:0/3817096762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25f18e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f01ac025c20 tx=0x7f01ac051000 comp rx=0 tx=0).stop 2024-09-21T09:05:05.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.235+0000 7f01c0c10800 1 -- 172.21.15.178:0/3817096762 shutdown_connections 2024-09-21T09:05:05.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.235+0000 7f01c0c10800 1 --2- 172.21.15.178:0/3817096762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25f18e0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.235+0000 7f01c0c10800 1 -- 172.21.15.178:0/3817096762 >> 172.21.15.178:0/3817096762 conn(0x55acf24fcdb0 msgr2=0x55acf25ed2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.235+0000 7f01c0c10800 1 -- 172.21.15.178:0/3817096762 shutdown_connections 2024-09-21T09:05:05.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.235+0000 7f01c0c10800 1 -- 172.21.15.178:0/3817096762 wait complete. 2024-09-21T09:05:05.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.236+0000 7f01c0c10800 1 Processor -- start 2024-09-21T09:05:05.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.236+0000 7f01c0c10800 1 -- start start 2024-09-21T09:05:05.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.236+0000 7f01c0c10800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25f91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.236+0000 7f01c0c10800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55acf2509620 con 0x55acf2476650 2024-09-21T09:05:05.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.236+0000 7f01bc3c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.239 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.236+0000 7f01bc3c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25f91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32976/0 (socket says 172.21.15.178:32976) 2024-09-21T09:05:05.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.236+0000 7f01bc3c6640 1 -- 172.21.15.178:0/2982789344 learned_addr learned my addr 172.21.15.178:0/2982789344 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.236+0000 7f01bc3c6640 1 -- 172.21.15.178:0/2982789344 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf23affe0 con 0x55acf2476650 2024-09-21T09:05:05.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.236+0000 7f01bc3c6640 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25f91c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00a330 tx=0x7f01ac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.237+0000 7f00a8e09640 1 -- 172.21.15.178:0/2982789344 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ac06c030 con 0x55acf2476650 2024-09-21T09:05:05.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.237+0000 7f00a8e09640 1 -- 172.21.15.178:0/2982789344 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ac05c580 con 0x55acf2476650 2024-09-21T09:05:05.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.237+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acf25f9700 con 0x55acf2476650 2024-09-21T09:05:05.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.237+0000 7f00a8e09640 1 -- 172.21.15.178:0/2982789344 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ac05c860 con 0x55acf2476650 2024-09-21T09:05:05.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.237+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acf25f9c80 con 0x55acf2476650 2024-09-21T09:05:05.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.237+0000 7f00a8e09640 1 -- 172.21.15.178:0/2982789344 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f01ac053440 con 0x55acf2476650 2024-09-21T09:05:05.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.238+0000 7f00a8e09640 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f00a4036b90 0x7f00a4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.238+0000 7f00a8e09640 1 -- 172.21.15.178:0/2982789344 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f01ac070020 con 0x55acf2476650 2024-09-21T09:05:05.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.238+0000 7f01b3bc5640 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f00a4036b90 0x7f00a4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.238+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acf2505720 0x55acf2600230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.238+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf26007b0 con 0x55acf2505720 2024-09-21T09:05:05.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.238+0000 7f01bcbc7640 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acf2505720 0x55acf2600230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.238+0000 7f01b3bc5640 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f00a4036b90 0x7f00a4039050 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f01a4000f60 tx=0x7f01a40012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.238+0000 7f01bcbc7640 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acf2505720 0x55acf2600230 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.239+0000 7f01bcbc7640 1 -- 172.21.15.178:0/2982789344 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01b400a4a0 con 0x55acf2505720 2024-09-21T09:05:05.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.239+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf25fd800 con 0x55acf2505720 2024-09-21T09:05:05.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.239+0000 7f01bcbc7640 1 -- 172.21.15.178:0/2982789344 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01b400a4a0 con 0x55acf2505720 2024-09-21T09:05:05.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.239+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acf2602b30 0x55acf2604f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.239+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf2605610 con 0x55acf2602b30 2024-09-21T09:05:05.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.239+0000 7f01bc3c6640 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acf2602b30 0x55acf2604f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.240+0000 7f01bc3c6640 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acf2602b30 0x55acf2604f20 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.240+0000 7f01bc3c6640 1 -- 172.21.15.178:0/2982789344 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f01ac07b070 con 0x55acf2602b30 2024-09-21T09:05:05.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.240+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf26019d0 con 0x55acf2505720 2024-09-21T09:05:05.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.240+0000 7f01bcbc7640 1 -- 172.21.15.178:0/2982789344 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01b400a4a0 con 0x55acf2505720 2024-09-21T09:05:05.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.240+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf2601e70 con 0x55acf2505720 2024-09-21T09:05:05.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.241+0000 7f01bcbc7640 1 -- 172.21.15.178:0/2982789344 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f01b400a4a0 con 0x55acf2505720 2024-09-21T09:05:05.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.241+0000 7f01c0c10800 1 Processor -- start 2024-09-21T09:05:05.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.241+0000 7f01c0c10800 1 -- start start 2024-09-21T09:05:05.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.241+0000 7f01c0c10800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2613f70 0x55acf2614390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.241+0000 7f01c0c10800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55acf239d580 con 0x55acf2613f70 2024-09-21T09:05:05.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.241+0000 7f01bcbc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2613f70 0x55acf2614390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.241+0000 7f01bcbc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2613f70 0x55acf2614390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:32990/0 (socket says 172.21.15.178:32990) 2024-09-21T09:05:05.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.241+0000 7f01bcbc7640 1 -- 172.21.15.178:0/2419344693 learned_addr learned my addr 172.21.15.178:0/2419344693 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.241+0000 7f01bcbc7640 1 -- 172.21.15.178:0/2419344693 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf26148d0 con 0x55acf2613f70 2024-09-21T09:05:05.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.242+0000 7f01bcbc7640 1 --2- 172.21.15.178:0/2419344693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2613f70 0x55acf2614390 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x55acf2600b90 tx=0x7f01b4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.242+0000 7f00a1ffb640 1 -- 172.21.15.178:0/2419344693 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b4014450 con 0x55acf2613f70 2024-09-21T09:05:05.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.242+0000 7f00a1ffb640 1 -- 172.21.15.178:0/2419344693 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b4014610 con 0x55acf2613f70 2024-09-21T09:05:05.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.242+0000 7f00a1ffb640 1 -- 172.21.15.178:0/2419344693 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b4014930 con 0x55acf2613f70 2024-09-21T09:05:05.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.242+0000 7f01c0c10800 1 -- 172.21.15.178:0/2419344693 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acf2614b60 con 0x55acf2613f70 2024-09-21T09:05:05.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.242+0000 7f01c0c10800 1 -- 172.21.15.178:0/2419344693 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acf2617840 con 0x55acf2613f70 2024-09-21T09:05:05.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.243+0000 7f00a1ffb640 1 -- 172.21.15.178:0/2419344693 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f01b4011040 con 0x55acf2613f70 2024-09-21T09:05:05.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.243+0000 7f00a1ffb640 1 --2- 172.21.15.178:0/2419344693 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0094036b40 0x7f0094039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.243+0000 7f00a1ffb640 1 -- 172.21.15.178:0/2419344693 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f01b401e070 con 0x55acf2613f70 2024-09-21T09:05:05.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.243+0000 7f01bc3c6640 1 --2- 172.21.15.178:0/2419344693 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0094036b40 0x7f0094039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.243+0000 7f01c0c10800 1 Processor -- start 2024-09-21T09:05:05.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.243+0000 7f01c0c10800 1 -- start start 2024-09-21T09:05:05.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.243+0000 7f01bc3c6640 1 --2- 172.21.15.178:0/2419344693 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0094036b40 0x7f0094039000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55acf2600c80 tx=0x7f01ac08edb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.243+0000 7f01c0c10800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2501210 0x55acf2501610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.243+0000 7f01c0c10800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55acf25f2030 con 0x55acf2501210 2024-09-21T09:05:05.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.243+0000 7f01bcbc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2501210 0x55acf2501610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.244+0000 7f01bcbc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2501210 0x55acf2501610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33006/0 (socket says 172.21.15.178:33006) 2024-09-21T09:05:05.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.244+0000 7f01bcbc7640 1 -- 172.21.15.178:0/2122342592 learned_addr learned my addr 172.21.15.178:0/2122342592 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.244+0000 7f01bcbc7640 1 -- 172.21.15.178:0/2122342592 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf2501b50 con 0x55acf2501210 2024-09-21T09:05:05.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.244+0000 7f01bcbc7640 1 --2- 172.21.15.178:0/2122342592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2501210 0x55acf2501610 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f01b404cb40 tx=0x7f01b4011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37fe08212d983aeb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.244+0000 7f00937fe640 1 -- 172.21.15.178:0/2122342592 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b4013c90 con 0x55acf2501210 2024-09-21T09:05:05.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.244+0000 7f00937fe640 1 -- 172.21.15.178:0/2122342592 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b4013e30 con 0x55acf2501210 2024-09-21T09:05:05.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.244+0000 7f00937fe640 1 -- 172.21.15.178:0/2122342592 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b4014c00 con 0x55acf2501210 2024-09-21T09:05:05.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.244+0000 7f01c0c10800 1 -- 172.21.15.178:0/2122342592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2501210 msgr2=0x55acf2501610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.244+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2122342592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2501210 0x55acf2501610 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f01b404cb40 tx=0x7f01b4011d00 comp rx=0 tx=0).stop 2024-09-21T09:05:05.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.244+0000 7f01c0c10800 1 -- 172.21.15.178:0/2122342592 shutdown_connections 2024-09-21T09:05:05.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.244+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2122342592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2501210 0x55acf2501610 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.244+0000 7f01c0c10800 1 -- 172.21.15.178:0/2122342592 >> 172.21.15.178:0/2122342592 conn(0x55acf261cf80 msgr2=0x55acf261b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.245+0000 7f01c0c10800 1 -- 172.21.15.178:0/2122342592 shutdown_connections 2024-09-21T09:05:05.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.245+0000 7f01c0c10800 1 -- 172.21.15.178:0/2122342592 wait complete. 2024-09-21T09:05:05.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.245+0000 7f01c0c10800 1 Processor -- start 2024-09-21T09:05:05.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.245+0000 7f01c0c10800 1 -- start start 2024-09-21T09:05:05.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.245+0000 7f01c0c10800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2501210 0x55acf2625ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.245+0000 7f01c0c10800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55acf2502290 con 0x55acf2501210 2024-09-21T09:05:05.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.245+0000 7f01bcbc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2501210 0x55acf2625ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.245+0000 7f01bcbc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2501210 0x55acf2625ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33022/0 (socket says 172.21.15.178:33022) 2024-09-21T09:05:05.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.245+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 learned_addr learned my addr 172.21.15.178:0/1652673323 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.245+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf2626400 con 0x55acf2501210 2024-09-21T09:05:05.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.246+0000 7f01bcbc7640 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2501210 0x55acf2625ec0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f01b404ba10 tx=0x7f01b404cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.246+0000 7f0091ffb640 1 -- 172.21.15.178:0/1652673323 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b4013c90 con 0x55acf2501210 2024-09-21T09:05:05.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.246+0000 7f0091ffb640 1 -- 172.21.15.178:0/1652673323 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b402b350 con 0x55acf2501210 2024-09-21T09:05:05.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.246+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acf2626690 con 0x55acf2501210 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.246+0000 7f0091ffb640 1 -- 172.21.15.178:0/1652673323 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b402b670 con 0x55acf2501210 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.246+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acf2629340 con 0x55acf2501210 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.246+0000 7f0091ffb640 1 -- 172.21.15.178:0/1652673323 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f01b403f020 con 0x55acf2501210 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.247+0000 7f0091ffb640 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0084036b90 0x7f0084039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.247+0000 7f0091ffb640 1 -- 172.21.15.178:0/1652673323 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f01b403d020 con 0x55acf2501210 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.247+0000 7f01bc3c6640 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0084036b90 0x7f0084039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.247+0000 7f01bc3c6640 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0084036b90 0x7f0084039050 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f01ac090010 tx=0x7f01ac08a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.247+0000 7f01c0c10800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.247+0000 7f01c0c10800 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acf2631b80 0x55acf2634040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.247+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf2634790 con 0x55acf2631b80 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.248+0000 7f01b3bc5640 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acf2631b80 0x55acf2634040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.248+0000 7f01b3bc5640 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acf2631b80 0x55acf2634040 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.248+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a4009050 con 0x55acf2631b80 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.248+0000 7f01c0c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.248+0000 7f01c0c10800 20 realm 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.248+0000 7f01c0c10800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.248+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf2630fd0 con 0x55acf2631b80 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.248+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a4009050 con 0x55acf2631b80 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.248+0000 7f01c0c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.248+0000 7f01c0c10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.248+0000 7f01c0c10800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.248+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf2635280 con 0x55acf2631b80 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.248+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a4009050 con 0x55acf2631b80 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.249+0000 7f01c0c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.249+0000 7f01c0c10800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.249+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf2635b50 con 0x55acf2631b80 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.249+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01a4009050 con 0x55acf2631b80 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.249+0000 7f01c0c10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.249+0000 7f01c0c10800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.257 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.249+0000 7f01c0c10800 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acf2636490 0x55acf2638880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.249+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf2639010 con 0x55acf2636490 2024-09-21T09:05:05.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.249+0000 7f01bcbc7640 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acf2636490 0x55acf2638880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.249+0000 7f01bcbc7640 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acf2636490 0x55acf2638880 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.250+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.250+0000 7f01c0c10800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:05.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.250+0000 7f01c0c10800 20 searching for the correct realm 2024-09-21T09:05:05.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.250+0000 7f01c0c10800 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55acf263afe0 0x55acf263d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.250+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55acf263db70 con 0x55acf263afe0 2024-09-21T09:05:05.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.250+0000 7f01bc3c6640 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55acf263afe0 0x55acf263d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.250+0000 7f01bc3c6640 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55acf263afe0 0x55acf263d4a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.250+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac09e070 con 0x55acf263afe0 2024-09-21T09:05:05.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.250+0000 7f01bc3c6640 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f01ac08c070 0x7f01ac0900b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.250+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55acf263db70 con 0x7f01ac08c070 2024-09-21T09:05:05.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.251+0000 7f01b3bc5640 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f01ac08c070 0x7f01ac0900b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.251+0000 7f01b3bc5640 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f01ac08c070 0x7f01ac0900b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.251+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4009050 con 0x7f01ac08c070 2024-09-21T09:05:05.259 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.251+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55acf263db70 con 0x55acf2636490 2024-09-21T09:05:05.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.252+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.252+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55acf263db70 con 0x55acf2631b80 2024-09-21T09:05:05.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.252+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4009050 con 0x55acf2631b80 2024-09-21T09:05:05.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.252+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55acf263db70 con 0x55acf2631b80 2024-09-21T09:05:05.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.252+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4029040 con 0x55acf2631b80 2024-09-21T09:05:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.252+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55acf263db70 con 0x55acf2636490 2024-09-21T09:05:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.253+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.253+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55acf263db70 con 0x55acf2636490 2024-09-21T09:05:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.253+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.253+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55acf263db70 con 0x7f01ac08c070 2024-09-21T09:05:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.253+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4029040 con 0x7f01ac08c070 2024-09-21T09:05:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.253+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55acf263db70 con 0x55acf263afe0 2024-09-21T09:05:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.253+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac09e070 con 0x55acf263afe0 2024-09-21T09:05:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.253+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55acf263db70 con 0x55acf2631b80 2024-09-21T09:05:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.254+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4029040 con 0x55acf2631b80 2024-09-21T09:05:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.254+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55acf263db70 con 0x55acf2636490 2024-09-21T09:05:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.254+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.254+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55acf263db70 con 0x55acf2631b80 2024-09-21T09:05:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.254+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4029040 con 0x55acf2631b80 2024-09-21T09:05:05.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.254+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55acf263db70 con 0x7f01ac08c070 2024-09-21T09:05:05.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.254+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f01a4029040 con 0x7f01ac08c070 2024-09-21T09:05:05.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.254+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55acf263db70 con 0x55acf263afe0 2024-09-21T09:05:05.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.255+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac09e070 con 0x55acf263afe0 2024-09-21T09:05:05.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.255+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x55acf263afe0 2024-09-21T09:05:05.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.255+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac09e070 con 0x55acf263afe0 2024-09-21T09:05:05.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.255+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x55acf2636490 2024-09-21T09:05:05.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.255+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.255+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x55acf263afe0 2024-09-21T09:05:05.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.255+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac09e070 con 0x55acf263afe0 2024-09-21T09:05:05.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.255+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x55acf263afe0 2024-09-21T09:05:05.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.256+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac09e070 con 0x55acf263afe0 2024-09-21T09:05:05.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.256+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x55acf2631b80 2024-09-21T09:05:05.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.256+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f01a4029040 con 0x55acf2631b80 2024-09-21T09:05:05.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.256+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x55acf2631b80 2024-09-21T09:05:05.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.256+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f01a4029040 con 0x55acf2631b80 2024-09-21T09:05:05.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.256+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x55acf2636490 2024-09-21T09:05:05.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.256+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.256+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x55acf263afe0 2024-09-21T09:05:05.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.257+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac09e070 con 0x55acf263afe0 2024-09-21T09:05:05.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.257+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x7f01ac08c070 2024-09-21T09:05:05.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.257+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4029040 con 0x7f01ac08c070 2024-09-21T09:05:05.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.257+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x55acf2631b80 2024-09-21T09:05:05.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.257+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4029040 con 0x55acf2631b80 2024-09-21T09:05:05.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.257+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x55acf2636490 2024-09-21T09:05:05.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.257+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.257+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x55acf263afe0 2024-09-21T09:05:05.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.258+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac09e070 con 0x55acf263afe0 2024-09-21T09:05:05.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.258+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x7f01ac08c070 2024-09-21T09:05:05.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.258+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4029040 con 0x7f01ac08c070 2024-09-21T09:05:05.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.258+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x7f01ac08c070 2024-09-21T09:05:05.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.258+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4029040 con 0x7f01ac08c070 2024-09-21T09:05:05.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.258+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x55acf263afe0 2024-09-21T09:05:05.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.258+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac09e070 con 0x55acf263afe0 2024-09-21T09:05:05.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.258+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x55acf2636490 2024-09-21T09:05:05.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x55acf2631b80 2024-09-21T09:05:05.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f01a4029040 con 0x55acf2631b80 2024-09-21T09:05:05.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f01ac0ad040 con 0x7f01ac08c070 2024-09-21T09:05:05.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4029040 con 0x7f01ac08c070 2024-09-21T09:05:05.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01c0c10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:05.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01c0c10800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:05.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01c0c10800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:05.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01c0c10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:05.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01c0c10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:05.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01c0c10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:05.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01c0c10800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf2639a00 con 0x55acf2631b80 2024-09-21T09:05:05.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a4029040 con 0x55acf2631b80 2024-09-21T09:05:05.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01c0c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01c0c10800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.259+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf263a2a0 con 0x55acf2631b80 2024-09-21T09:05:05.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01a403d040 con 0x55acf2631b80 2024-09-21T09:05:05.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:05.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf2639640 con 0x55acf2631b80 2024-09-21T09:05:05.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f01a403d040 con 0x55acf2631b80 2024-09-21T09:05:05.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:05.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 20 zone default found 2024-09-21T09:05:05.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 4 Realm: () 2024-09-21T09:05:05.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:05.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:05.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:05.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 20 zonegroup default 2024-09-21T09:05:05.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf2639ef0 con 0x55acf2636490 2024-09-21T09:05:05.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf26403d0 con 0x55acf263afe0 2024-09-21T09:05:05.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.260+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01ac09e070 con 0x55acf263afe0 2024-09-21T09:05:05.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.261+0000 7f01c0c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.261+0000 7f01c0c10800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.261+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf2640770 con 0x55acf263afe0 2024-09-21T09:05:05.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.261+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01ac09e070 con 0x55acf263afe0 2024-09-21T09:05:05.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.261+0000 7f01c0c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.261+0000 7f01c0c10800 20 started sync module instance, tier type = 2024-09-21T09:05:05.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.261+0000 7f01c0c10800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:05.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.261+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf263f860 con 0x7f01ac08c070 2024-09-21T09:05:05.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.262+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x7f01ac08c070 2024-09-21T09:05:05.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.262+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94201289375072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf263f860 con 0x7f01ac08c070 2024-09-21T09:05:05.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.262+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2641180 con 0x55acf2631b80 2024-09-21T09:05:05.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.263+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94201289375072] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x7f01ac08c070 2024-09-21T09:05:05.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.263+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x55acf2631b80 2024-09-21T09:05:05.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.263+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94201289373072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2641180 con 0x55acf2631b80 2024-09-21T09:05:05.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.263+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2641bc0 con 0x55acf263afe0 2024-09-21T09:05:05.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.264+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ac09e070 con 0x55acf263afe0 2024-09-21T09:05:05.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.264+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94201289381520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2642460 con 0x55acf263afe0 2024-09-21T09:05:05.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.264+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2642f20 con 0x7f01ac08c070 2024-09-21T09:05:05.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.264+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94201289373072] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x55acf2631b80 2024-09-21T09:05:05.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.265+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94201289381520] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ac09e070 con 0x55acf263afe0 2024-09-21T09:05:05.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.265+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x7f01ac08c070 2024-09-21T09:05:05.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.265+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94201289383856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2640cd0 con 0x7f01ac08c070 2024-09-21T09:05:05.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.265+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf26437c0 con 0x55acf2631b80 2024-09-21T09:05:05.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.266+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94201289383856] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x7f01ac08c070 2024-09-21T09:05:05.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.266+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x55acf2631b80 2024-09-21T09:05:05.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.266+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94201289386480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2643720 con 0x55acf2631b80 2024-09-21T09:05:05.277 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.266+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf26441d0 con 0x55acf2636490 2024-09-21T09:05:05.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.267+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94201289386480] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x55acf2631b80 2024-09-21T09:05:05.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.267+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.268+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94201289388656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2643690 con 0x55acf2636490 2024-09-21T09:05:05.280 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.268+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2645090 con 0x55acf2636490 2024-09-21T09:05:05.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.269+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94201289388656] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.269+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.269+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94201289395168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf26454b0 con 0x55acf2636490 2024-09-21T09:05:05.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.269+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2645d80 con 0x55acf2636490 2024-09-21T09:05:05.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.270+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94201289395168] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.270+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.270+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94201289396224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf26458d0 con 0x55acf2636490 2024-09-21T09:05:05.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.270+0000 7f01c0c10800 20 add_watcher() i=0 2024-09-21T09:05:05.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.270+0000 7f01c0c10800 20 add_watcher() i=1 2024-09-21T09:05:05.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.270+0000 7f01c0c10800 20 add_watcher() i=2 2024-09-21T09:05:05.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.270+0000 7f01c0c10800 20 add_watcher() i=3 2024-09-21T09:05:05.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.270+0000 7f01c0c10800 20 add_watcher() i=4 2024-09-21T09:05:05.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.270+0000 7f01c0c10800 20 add_watcher() i=5 2024-09-21T09:05:05.281 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.270+0000 7f01c0c10800 20 add_watcher() i=6 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.271+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94201289396224] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.271+0000 7f01c0c10800 20 add_watcher() i=7 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.271+0000 7f01c0c10800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.271+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf26491d0 con 0x55acf2631b80 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.271+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f01a403d040 con 0x55acf2631b80 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.272+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94201289397744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2646690 con 0x55acf2631b80 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.272+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94201289397744] v31'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x55acf2631b80 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.273+0000 7f00727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.273+0000 7f01c0c10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.273+0000 7f01c0c10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.273+0000 7f01c0c10800 5 note: GC not initialized 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.273+0000 7f00717e2640 20 reqs_thread_entry: start 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.273+0000 7f01c0c10800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.273+0000 7f01c0c10800 20 Filter name: none 2024-09-21T09:05:05.282 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.273+0000 7effe2ffd640 20 reqs_thread_entry: start 2024-09-21T09:05:05.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.273+0000 7f01c0c10800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T09:05:05.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.273+0000 7f01c0c10800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.273+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf267c650 con 0x55acf2636490 2024-09-21T09:05:05.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.274+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.274+0000 7f01c0c10800 20 rados_obj.operate() r=0 bl.length=460 2024-09-21T09:05:05.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.274+0000 7f01c0c10800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T09:05:05.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.274+0000 7f01c0c10800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:05.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.274+0000 7f01c0c10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:05:05.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.274+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2682ce0 con 0x55acf2636490 2024-09-21T09:05:05.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.275+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v31'16 uv16 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.275+0000 7f01c0c10800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:05.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.275+0000 7f01c0c10800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:05.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.275+0000 7f01c0c10800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T09:05:05.283 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.275+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94201289647776 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55acf267e2c0 con 0x55acf2631b80 2024-09-21T09:05:05.284 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.276+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== watch-notify(notify (1) cookie 94201289386480 notify 133143986210 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55acf23c1b30 con 0x55acf2631b80 2024-09-21T09:05:05.284 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.276+0000 7f00937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986210 cookie 94201289386480 notifier 4917 bl.length()=649 2024-09-21T09:05:05.284 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.276+0000 7f00937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:05.284 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.276+0000 7f00937fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:05.284 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.276+0000 7f00937fe640 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0080003ea0 con 0x55acf2631b80 2024-09-21T09:05:05.284 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.276+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 notify.4 [notify cookie 94201289647776 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01a403d040 con 0x55acf2631b80 2024-09-21T09:05:05.284 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.276+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x55acf2631b80 2024-09-21T09:05:05.284 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.276+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== watch-notify(notify_complete (2) cookie 94201289647776 notify 133143986210 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f01a403e590 con 0x55acf2631b80 2024-09-21T09:05:05.284 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T09:05:03.575855Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:05:03.575846Z","tags":[],"group_ids":[]} 2024-09-21T09:05:05.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.277+0000 7f00727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:05.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.277+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94201289397744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2681f40 con 0x55acf2631b80 2024-09-21T09:05:05.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.278+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94201289397744] v31'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x55acf2631b80 2024-09-21T09:05:05.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.278+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94201289375072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2681f40 con 0x7f01ac08c070 2024-09-21T09:05:05.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.279+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94201289375072] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x7f01ac08c070 2024-09-21T09:05:05.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.279+0000 7f01c0c10800 20 remove_watcher() i=0 2024-09-21T09:05:05.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.279+0000 7f01c0c10800 2 removed watcher, disabling cache 2024-09-21T09:05:05.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.279+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94201289373072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2681f40 con 0x55acf2631b80 2024-09-21T09:05:05.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.280+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94201289373072] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x55acf2631b80 2024-09-21T09:05:05.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.280+0000 7f01c0c10800 20 remove_watcher() i=1 2024-09-21T09:05:05.287 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.280+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94201289381520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2681f40 con 0x55acf263afe0 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.281+0000 7f01bc3c6640 1 -- 172.21.15.178:0/1652673323 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94201289381520] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ac09e070 con 0x55acf263afe0 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.281+0000 7f01c0c10800 20 remove_watcher() i=2 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.281+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94201289383856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2681f40 con 0x7f01ac08c070 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.282+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94201289383856] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x7f01ac08c070 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.282+0000 7f01c0c10800 20 remove_watcher() i=3 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.282+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94201289386480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2681f40 con 0x55acf2631b80 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.283+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94201289386480] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a403d040 con 0x55acf2631b80 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.283+0000 7f01c0c10800 20 remove_watcher() i=4 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.283+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94201289388656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2681f40 con 0x55acf2636490 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.284+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94201289388656] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.284+0000 7f01c0c10800 20 remove_watcher() i=5 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.284+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94201289395168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf2681f40 con 0x55acf2636490 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.285+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94201289395168] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.285+0000 7f01c0c10800 20 remove_watcher() i=6 2024-09-21T09:05:05.288 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.285+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94201289396224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55acf267a370 con 0x55acf2636490 2024-09-21T09:05:05.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01bcbc7640 1 -- 172.21.15.178:0/1652673323 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94201289396224] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b402a070 con 0x55acf2636490 2024-09-21T09:05:05.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01c0c10800 20 remove_watcher() i=7 2024-09-21T09:05:05.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acf2636490 msgr2=0x55acf2638880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01c0c10800 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acf2636490 0x55acf2638880 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.291 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acf2631b80 msgr2=0x55acf2634040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01c0c10800 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acf2631b80 0x55acf2634040 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f01ac08c070 msgr2=0x7f01ac0900b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01c0c10800 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f01ac08c070 0x7f01ac0900b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55acf263afe0 msgr2=0x55acf263d4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01c0c10800 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x55acf263afe0 0x55acf263d4a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0084036b90 msgr2=0x7f0084039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01c0c10800 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0084036b90 0x7f0084039050 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f01ac090010 tx=0x7f01ac08a000 comp rx=0 tx=0).stop 2024-09-21T09:05:05.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2501210 msgr2=0x55acf2625ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01b3bc5640 1 -- 172.21.15.178:0/1652673323 reap_dead start 2024-09-21T09:05:05.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.286+0000 7f01c0c10800 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2501210 0x55acf2625ec0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f01b404ba10 tx=0x7f01b404cad0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 shutdown_connections 2024-09-21T09:05:05.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 --2- 172.21.15.178:0/1652673323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2501210 0x55acf2625ec0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 >> 172.21.15.178:0/1652673323 conn(0x55acf261cf80 msgr2=0x55acf261b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 shutdown_connections 2024-09-21T09:05:05.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/1652673323 wait complete. 2024-09-21T09:05:05.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/2419344693 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0094036b40 msgr2=0x7f0094039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2419344693 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0094036b40 0x7f0094039000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55acf2600c80 tx=0x7f01ac08edb0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/2419344693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2613f70 msgr2=0x55acf2614390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2419344693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2613f70 0x55acf2614390 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x55acf2600b90 tx=0x7f01b4018830 comp rx=0 tx=0).stop 2024-09-21T09:05:05.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/2419344693 shutdown_connections 2024-09-21T09:05:05.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2419344693 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0094036b40 0x7f0094039000 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2419344693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2613f70 0x55acf2614390 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/2419344693 >> 172.21.15.178:0/2419344693 conn(0x55acf2608f00 msgr2=0x55acf260ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/2419344693 shutdown_connections 2024-09-21T09:05:05.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/2419344693 wait complete. 2024-09-21T09:05:05.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acf2602b30 msgr2=0x55acf2604f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acf2602b30 0x55acf2604f20 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.293 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acf2505720 msgr2=0x55acf2600230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acf2505720 0x55acf2600230 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f00a4036b90 msgr2=0x7f00a4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f00a4036b90 0x7f00a4039050 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f01a4000f60 tx=0x7f01a40012b0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 msgr2=0x55acf25f91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25f91c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00a330 tx=0x7f01ac002fb0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 shutdown_connections 2024-09-21T09:05:05.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x55acf2602b30 0x55acf2604f20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x55acf2505720 0x55acf2600230 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f00a4036b90 0x7f00a4039050 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 --2- 172.21.15.178:0/2982789344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55acf2476650 0x55acf25f91c0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.287+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 >> 172.21.15.178:0/2982789344 conn(0x55acf24fcdb0 msgr2=0x55acf25ebb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.288+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 shutdown_connections 2024-09-21T09:05:05.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.288+0000 7f01c0c10800 1 -- 172.21.15.178:0/2982789344 wait complete. 2024-09-21T09:05:05.297 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:05.298 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:05.298 ERROR:root:0 2024-09-21T09:05:05.298 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T09:05:05.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T09:05:05.298 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-21T09:05:05.344 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:05:05.344 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:05:05.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.343+0000 7f8b19528800 1 Processor -- start 2024-09-21T09:05:05.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.343+0000 7f8b19528800 1 -- start start 2024-09-21T09:05:05.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.343+0000 7f8b19528800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x561f25a52880 0x561f25a54c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.343+0000 7f8b19528800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561f2590db30 con 0x561f259c26d0 2024-09-21T09:05:05.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.343+0000 7f8b19528800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x561f258ef360 con 0x561f25a52880 2024-09-21T09:05:05.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.344+0000 7f8b14a1c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x561f25a52880 0x561f25a54c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.344+0000 7f8b14a1c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x561f25a52880 0x561f25a54c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33032/0 (socket says 172.21.15.178:33032) 2024-09-21T09:05:05.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.344+0000 7f8b1521d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x561f259c26d0 0x561f25a51160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:40602/0 (socket says 172.21.15.178:40602) 2024-09-21T09:05:05.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.344+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1538379407 learned_addr learned my addr 172.21.15.178:0/1538379407 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.344+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1538379407 >> v1:172.21.15.44:6789/0 conn(0x561f259c26d0 legacy=0x561f25a51160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.344+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1538379407 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f25915e00 con 0x561f25a52880 2024-09-21T09:05:05.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.346+0000 7f8b14a1c640 1 --2- 172.21.15.178:0/1538379407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25a52880 0x561f25a54c90 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00a520 tx=0x7f8b0c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff4b8f71765977b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.346+0000 7f8b07fff640 1 -- 172.21.15.178:0/1538379407 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b0c055070 con 0x561f25a52880 2024-09-21T09:05:05.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.346+0000 7f8b07fff640 1 -- 172.21.15.178:0/1538379407 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0c0515b0 con 0x561f25a52880 2024-09-21T09:05:05.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.346+0000 7f8b07fff640 1 -- 172.21.15.178:0/1538379407 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b0c0518d0 con 0x561f25a52880 2024-09-21T09:05:05.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.346+0000 7f8b19528800 1 -- 172.21.15.178:0/1538379407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25a52880 msgr2=0x561f25a54c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.346+0000 7f8b19528800 1 --2- 172.21.15.178:0/1538379407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25a52880 0x561f25a54c90 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00a520 tx=0x7f8b0c045ba0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.346+0000 7f8b19528800 1 -- 172.21.15.178:0/1538379407 shutdown_connections 2024-09-21T09:05:05.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.346+0000 7f8b19528800 1 --2- 172.21.15.178:0/1538379407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25a52880 0x561f25a54c90 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.346+0000 7f8b19528800 1 -- 172.21.15.178:0/1538379407 >> 172.21.15.178:0/1538379407 conn(0x561f25a48db0 msgr2=0x561f25a4b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.346+0000 7f8b19528800 1 -- 172.21.15.178:0/1538379407 shutdown_connections 2024-09-21T09:05:05.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.346+0000 7f8b19528800 1 -- 172.21.15.178:0/1538379407 wait complete. 2024-09-21T09:05:05.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.360+0000 7f8b19528800 1 Processor -- start 2024-09-21T09:05:05.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.360+0000 7f8b19528800 1 -- start start 2024-09-21T09:05:05.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.360+0000 7f8b19528800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f259c26d0 0x561f25a4ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.362 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.360+0000 7f8b19528800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561f2599a360 con 0x561f259c26d0 2024-09-21T09:05:05.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.361+0000 7f8b1521d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f259c26d0 0x561f25a4ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.361+0000 7f8b1521d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f259c26d0 0x561f25a4ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33042/0 (socket says 172.21.15.178:33042) 2024-09-21T09:05:05.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.361+0000 7f8b1521d640 1 -- 172.21.15.178:0/4141177263 learned_addr learned my addr 172.21.15.178:0/4141177263 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.361+0000 7f8b1521d640 1 -- 172.21.15.178:0/4141177263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f258e7bc0 con 0x561f259c26d0 2024-09-21T09:05:05.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.361+0000 7f8b1521d640 1 --2- 172.21.15.178:0/4141177263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f259c26d0 0x561f25a4ea90 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f8b08001650 tx=0x7f8b08001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5d9ef1cf688800 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.361+0000 7f8a03606640 1 -- 172.21.15.178:0/4141177263 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b08013420 con 0x561f259c26d0 2024-09-21T09:05:05.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.361+0000 7f8a03606640 1 -- 172.21.15.178:0/4141177263 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b080135c0 con 0x561f259c26d0 2024-09-21T09:05:05.363 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.361+0000 7f8a03606640 1 -- 172.21.15.178:0/4141177263 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b080138c0 con 0x561f259c26d0 2024-09-21T09:05:05.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.362+0000 7f8b19528800 1 -- 172.21.15.178:0/4141177263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f259c26d0 msgr2=0x561f25a4ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.362+0000 7f8b19528800 1 --2- 172.21.15.178:0/4141177263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f259c26d0 0x561f25a4ea90 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f8b08001650 tx=0x7f8b08001b10 comp rx=0 tx=0).stop 2024-09-21T09:05:05.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.362+0000 7f8b19528800 1 -- 172.21.15.178:0/4141177263 shutdown_connections 2024-09-21T09:05:05.365 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.362+0000 7f8b19528800 1 --2- 172.21.15.178:0/4141177263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f259c26d0 0x561f25a4ea90 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.362+0000 7f8b19528800 1 -- 172.21.15.178:0/4141177263 >> 172.21.15.178:0/4141177263 conn(0x561f25a48db0 msgr2=0x561f25b39290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.362+0000 7f8b19528800 1 -- 172.21.15.178:0/4141177263 shutdown_connections 2024-09-21T09:05:05.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.362+0000 7f8b19528800 1 -- 172.21.15.178:0/4141177263 wait complete. 2024-09-21T09:05:05.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.362+0000 7f8b19528800 1 Processor -- start 2024-09-21T09:05:05.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.362+0000 7f8b19528800 1 -- start start 2024-09-21T09:05:05.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.362+0000 7f8b19528800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25a52880 0x561f25b47730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.362+0000 7f8b19528800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561f25a55610 con 0x561f25a52880 2024-09-21T09:05:05.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.363+0000 7f8b1521d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25a52880 0x561f25b47730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.363+0000 7f8b1521d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25a52880 0x561f25b47730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33048/0 (socket says 172.21.15.178:33048) 2024-09-21T09:05:05.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.363+0000 7f8b1521d640 1 -- 172.21.15.178:0/2214094891 learned_addr learned my addr 172.21.15.178:0/2214094891 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.363+0000 7f8b1521d640 1 -- 172.21.15.178:0/2214094891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f258fbfe0 con 0x561f25a52880 2024-09-21T09:05:05.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.363+0000 7f8b1521d640 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25a52880 0x561f25b47730 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x561f25a4e190 tx=0x7f8b08001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.363+0000 7f8a01e03640 1 -- 172.21.15.178:0/2214094891 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b08022020 con 0x561f25a52880 2024-09-21T09:05:05.366 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.363+0000 7f8a01e03640 1 -- 172.21.15.178:0/2214094891 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b08006830 con 0x561f25a52880 2024-09-21T09:05:05.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.363+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f25b47c70 con 0x561f25a52880 2024-09-21T09:05:05.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.363+0000 7f8a01e03640 1 -- 172.21.15.178:0/2214094891 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b08004a90 con 0x561f25a52880 2024-09-21T09:05:05.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.363+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f25b48190 con 0x561f25a52880 2024-09-21T09:05:05.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.364+0000 7f8a01e03640 1 -- 172.21.15.178:0/2214094891 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8b08025020 con 0x561f25a52880 2024-09-21T09:05:05.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.364+0000 7f8a01e03640 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89fc036b90 0x7f89fc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.364+0000 7f8a01e03640 1 -- 172.21.15.178:0/2214094891 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8b08018030 con 0x561f25a52880 2024-09-21T09:05:05.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.365+0000 7f8b14a1c640 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89fc036b90 0x7f89fc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.365+0000 7f8b19528800 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561f25b4c790 0x561f25b4eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.365+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b4f0c0 con 0x561f25b4c790 2024-09-21T09:05:05.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.365+0000 7f8b15a1e640 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561f25b4c790 0x561f25b4eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.365+0000 7f8b14a1c640 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89fc036b90 0x7f89fc039050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c057000 tx=0x7f8b0c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.365+0000 7f8b15a1e640 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561f25b4c790 0x561f25b4eb80 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.365+0000 7f8b15a1e640 1 -- 172.21.15.178:0/2214094891 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b100083e0 con 0x561f25b4c790 2024-09-21T09:05:05.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.365+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b4bd50 con 0x561f25b4c790 2024-09-21T09:05:05.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.366+0000 7f8b15a1e640 1 -- 172.21.15.178:0/2214094891 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b100083e0 con 0x561f25b4c790 2024-09-21T09:05:05.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.366+0000 7f8b19528800 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561f25b51360 0x561f25b53750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.366+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b53e40 con 0x561f25b51360 2024-09-21T09:05:05.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.366+0000 7f8b1521d640 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561f25b51360 0x561f25b53750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.366+0000 7f8b1521d640 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561f25b51360 0x561f25b53750 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.367+0000 7f8b1521d640 1 -- 172.21.15.178:0/2214094891 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b51360 2024-09-21T09:05:05.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.367+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b50200 con 0x561f25b4c790 2024-09-21T09:05:05.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.367+0000 7f8b15a1e640 1 -- 172.21.15.178:0/2214094891 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b100083e0 con 0x561f25b4c790 2024-09-21T09:05:05.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.367+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b506c0 con 0x561f25b4c790 2024-09-21T09:05:05.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.367+0000 7f8b15a1e640 1 -- 172.21.15.178:0/2214094891 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8b100083e0 con 0x561f25b4c790 2024-09-21T09:05:05.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.368+0000 7f8b19528800 1 Processor -- start 2024-09-21T09:05:05.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.368+0000 7f8b19528800 1 -- start start 2024-09-21T09:05:05.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.368+0000 7f8b19528800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b62820 0x561f25b62c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.368+0000 7f8b19528800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561f258e9580 con 0x561f25b62820 2024-09-21T09:05:05.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.368+0000 7f8b15a1e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b62820 0x561f25b62c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.368+0000 7f8b15a1e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b62820 0x561f25b62c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33052/0 (socket says 172.21.15.178:33052) 2024-09-21T09:05:05.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.368+0000 7f8b15a1e640 1 -- 172.21.15.178:0/3687438316 learned_addr learned my addr 172.21.15.178:0/3687438316 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.368+0000 7f8b15a1e640 1 -- 172.21.15.178:0/3687438316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f25b63180 con 0x561f25b62820 2024-09-21T09:05:05.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.369+0000 7f8b15a1e640 1 --2- 172.21.15.178:0/3687438316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b62820 0x561f25b62c40 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x561f25b48b30 tx=0x7f8b1000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.369+0000 7f89faffd640 1 -- 172.21.15.178:0/3687438316 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b10007d00 con 0x561f25b62820 2024-09-21T09:05:05.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.369+0000 7f89faffd640 1 -- 172.21.15.178:0/3687438316 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1001e020 con 0x561f25b62820 2024-09-21T09:05:05.375 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.369+0000 7f8b19528800 1 -- 172.21.15.178:0/3687438316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f25b63410 con 0x561f25b62820 2024-09-21T09:05:05.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.369+0000 7f89faffd640 1 -- 172.21.15.178:0/3687438316 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b10019420 con 0x561f25b62820 2024-09-21T09:05:05.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.369+0000 7f8b19528800 1 -- 172.21.15.178:0/3687438316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f25b660f0 con 0x561f25b62820 2024-09-21T09:05:05.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.369+0000 7f89faffd640 1 -- 172.21.15.178:0/3687438316 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8b10016040 con 0x561f25b62820 2024-09-21T09:05:05.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.370+0000 7f89faffd640 1 --2- 172.21.15.178:0/3687438316 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89ec036b40 0x7f89ec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.370+0000 7f89faffd640 1 -- 172.21.15.178:0/3687438316 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8b1001f030 con 0x561f25b62820 2024-09-21T09:05:05.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.370+0000 7f8b1521d640 1 --2- 172.21.15.178:0/3687438316 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89ec036b40 0x7f89ec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.370+0000 7f8b19528800 1 Processor -- start 2024-09-21T09:05:05.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.370+0000 7f8b19528800 1 -- start start 2024-09-21T09:05:05.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.370+0000 7f8b1521d640 1 --2- 172.21.15.178:0/3687438316 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89ec036b40 0x7f89ec039000 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x561f25b4f4d0 tx=0x7f8b08012f20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.370+0000 7f8b19528800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b6f490 0x561f25b6f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.370+0000 7f8b19528800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561f25a4d160 con 0x561f25b6f490 2024-09-21T09:05:05.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.370+0000 7f8b15a1e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b6f490 0x561f25b6f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.370+0000 7f8b15a1e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b6f490 0x561f25b6f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33058/0 (socket says 172.21.15.178:33058) 2024-09-21T09:05:05.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.370+0000 7f8b15a1e640 1 -- 172.21.15.178:0/3320554099 learned_addr learned my addr 172.21.15.178:0/3320554099 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.371+0000 7f8b15a1e640 1 -- 172.21.15.178:0/3320554099 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f25b6fe60 con 0x561f25b6f490 2024-09-21T09:05:05.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.371+0000 7f8b15a1e640 1 --2- 172.21.15.178:0/3320554099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b6f490 0x561f25b6f890 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8b10005700 tx=0x7f8b1004ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5538acb6a524c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.371+0000 7f89f8ff9640 1 -- 172.21.15.178:0/3320554099 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1001d040 con 0x561f25b6f490 2024-09-21T09:05:05.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.371+0000 7f89f8ff9640 1 -- 172.21.15.178:0/3320554099 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b100184e0 con 0x561f25b6f490 2024-09-21T09:05:05.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.371+0000 7f89f8ff9640 1 -- 172.21.15.178:0/3320554099 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b100144b0 con 0x561f25b6f490 2024-09-21T09:05:05.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.371+0000 7f8b19528800 1 -- 172.21.15.178:0/3320554099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b6f490 msgr2=0x561f25b6f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.371+0000 7f8b19528800 1 --2- 172.21.15.178:0/3320554099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b6f490 0x561f25b6f890 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8b10005700 tx=0x7f8b1004ce90 comp rx=0 tx=0).stop 2024-09-21T09:05:05.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.371+0000 7f8b19528800 1 -- 172.21.15.178:0/3320554099 shutdown_connections 2024-09-21T09:05:05.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.371+0000 7f8b19528800 1 --2- 172.21.15.178:0/3320554099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b6f490 0x561f25b6f890 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.371+0000 7f8b19528800 1 -- 172.21.15.178:0/3320554099 >> 172.21.15.178:0/3320554099 conn(0x561f25b6b7f0 msgr2=0x561f25b698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.371+0000 7f8b19528800 1 -- 172.21.15.178:0/3320554099 shutdown_connections 2024-09-21T09:05:05.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.371+0000 7f8b19528800 1 -- 172.21.15.178:0/3320554099 wait complete. 2024-09-21T09:05:05.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.372+0000 7f8b19528800 1 Processor -- start 2024-09-21T09:05:05.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.372+0000 7f8b19528800 1 -- start start 2024-09-21T09:05:05.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.372+0000 7f8b19528800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b6f490 0x561f25b76940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.372+0000 7f8b19528800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561f25b704d0 con 0x561f25b6f490 2024-09-21T09:05:05.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.372+0000 7f8b15a1e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b6f490 0x561f25b76940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.372+0000 7f8b15a1e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b6f490 0x561f25b76940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:33060/0 (socket says 172.21.15.178:33060) 2024-09-21T09:05:05.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.372+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 learned_addr learned my addr 172.21.15.178:0/1661442385 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:05:05.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.372+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f25b76e80 con 0x561f25b6f490 2024-09-21T09:05:05.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.373+0000 7f8b15a1e640 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b6f490 0x561f25b76940 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8b10005700 tx=0x7f8b1004cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.373+0000 7f89eaffd640 1 -- 172.21.15.178:0/1661442385 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b10030070 con 0x561f25b6f490 2024-09-21T09:05:05.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.373+0000 7f89eaffd640 1 -- 172.21.15.178:0/1661442385 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b10019650 con 0x561f25b6f490 2024-09-21T09:05:05.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.373+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f25b77110 con 0x561f25b6f490 2024-09-21T09:05:05.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.373+0000 7f89eaffd640 1 -- 172.21.15.178:0/1661442385 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1001d070 con 0x561f25b6f490 2024-09-21T09:05:05.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.373+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f25b79dc0 con 0x561f25b6f490 2024-09-21T09:05:05.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.373+0000 7f89eaffd640 1 -- 172.21.15.178:0/1661442385 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8b10033070 con 0x561f25b6f490 2024-09-21T09:05:05.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.374+0000 7f89eaffd640 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89e0036b40 0x7f89e0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.374+0000 7f89eaffd640 1 -- 172.21.15.178:0/1661442385 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8b10036c00 con 0x561f25b6f490 2024-09-21T09:05:05.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.374+0000 7f8b1521d640 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89e0036b40 0x7f89e0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.374+0000 7f8b1521d640 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89e0036b40 0x7f89e0039000 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8b08011ff0 tx=0x7f8b08028000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.374+0000 7f8b19528800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.374+0000 7f8b19528800 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561f25b82360 0x561f25b84820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.374+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b84f70 con 0x561f25b82360 2024-09-21T09:05:05.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.374+0000 7f8b14a1c640 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561f25b82360 0x561f25b84820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b14a1c640 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561f25b82360 0x561f25b84820 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.387 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b19528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b19528800 20 realm 2024-09-21T09:05:05.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b19528800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b853a0 con 0x561f25b82360 2024-09-21T09:05:05.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b19528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b19528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:05:05.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b19528800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b85c70 con 0x561f25b82360 2024-09-21T09:05:05.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b19528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b19528800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.375+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b86010 con 0x561f25b82360 2024-09-21T09:05:05.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.376+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.388 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.376+0000 7f8b19528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:05.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.376+0000 7f8b19528800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.376+0000 7f8b19528800 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561f25b86d70 0x561f25b89160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.376+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b89770 con 0x561f25b86d70 2024-09-21T09:05:05.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.376+0000 7f8b15a1e640 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561f25b86d70 0x561f25b89160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.377+0000 7f8b15a1e640 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561f25b86d70 0x561f25b89160 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.377+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.377+0000 7f8b19528800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:05:05.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.377+0000 7f8b19528800 20 searching for the correct realm 2024-09-21T09:05:05.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.377+0000 7f8b19528800 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x561f25b8b700 0x561f25b8dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.377+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b8b700 2024-09-21T09:05:05.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.377+0000 7f8b1521d640 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x561f25b8b700 0x561f25b8dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.377+0000 7f8b1521d640 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x561f25b8b700 0x561f25b8dbc0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.377+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b8b700 2024-09-21T09:05:05.389 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.378+0000 7f8b1521d640 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8b08027020 0x7f8b0804c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:05:05.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.378+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x7f8b08027020 2024-09-21T09:05:05.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.378+0000 7f8b14a1c640 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8b08027020 0x7f8b0804c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:05:05.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.378+0000 7f8b14a1c640 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8b08027020 0x7f8b0804c220 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:05:05.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.378+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c057030 con 0x7f8b08027020 2024-09-21T09:05:05.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.378+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b86d70 2024-09-21T09:05:05.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.378+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.379+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b82360 2024-09-21T09:05:05.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.379+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.379+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b82360 2024-09-21T09:05:05.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.379+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.379+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b86d70 2024-09-21T09:05:05.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.380+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.380+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b86d70 2024-09-21T09:05:05.390 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.380+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.380+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x7f8b08027020 2024-09-21T09:05:05.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.380+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c057030 con 0x7f8b08027020 2024-09-21T09:05:05.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.380+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b8b700 2024-09-21T09:05:05.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.380+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b8b700 2024-09-21T09:05:05.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.380+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b82360 2024-09-21T09:05:05.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.381+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.381+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b86d70 2024-09-21T09:05:05.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.381+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.381+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b82360 2024-09-21T09:05:05.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.381+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.381+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x7f8b08027020 2024-09-21T09:05:05.391 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.381+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8b0c057030 con 0x7f8b08027020 2024-09-21T09:05:05.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.381+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b8b700 2024-09-21T09:05:05.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.382+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b8b700 2024-09-21T09:05:05.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.382+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b8b700 2024-09-21T09:05:05.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.382+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b8b700 2024-09-21T09:05:05.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.382+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b86d70 2024-09-21T09:05:05.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.382+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.382+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b8b700 2024-09-21T09:05:05.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.382+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b8b700 2024-09-21T09:05:05.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.382+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b8b700 2024-09-21T09:05:05.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.383+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b8b700 2024-09-21T09:05:05.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.383+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b82360 2024-09-21T09:05:05.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.383+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.383+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b82360 2024-09-21T09:05:05.392 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.383+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.383+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b86d70 2024-09-21T09:05:05.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.383+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.383+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b8b700 2024-09-21T09:05:05.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.384+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b8b700 2024-09-21T09:05:05.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.384+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x7f8b08027020 2024-09-21T09:05:05.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.384+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c057030 con 0x7f8b08027020 2024-09-21T09:05:05.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.384+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b82360 2024-09-21T09:05:05.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.384+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.384+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b86d70 2024-09-21T09:05:05.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.384+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.384+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b8b700 2024-09-21T09:05:05.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.385+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b8b700 2024-09-21T09:05:05.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.385+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x7f8b08027020 2024-09-21T09:05:05.393 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.385+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c057030 con 0x7f8b08027020 2024-09-21T09:05:05.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.385+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x7f8b08027020 2024-09-21T09:05:05.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.385+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c057030 con 0x7f8b08027020 2024-09-21T09:05:05.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.385+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b8b700 2024-09-21T09:05:05.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.385+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b8b700 2024-09-21T09:05:05.394 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.385+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b86d70 2024-09-21T09:05:05.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x561f25b82360 2024-09-21T09:05:05.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8e290 con 0x7f8b08027020 2024-09-21T09:05:05.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c057030 con 0x7f8b08027020 2024-09-21T09:05:05.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b19528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:05:05.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b19528800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:05:05.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b19528800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:05:05.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b19528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:05:05.400 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b19528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:05:05.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b19528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:05:05.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b19528800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8ac50 con 0x561f25b82360 2024-09-21T09:05:05.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b19528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b19528800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b89c00 con 0x561f25b82360 2024-09-21T09:05:05.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.386+0000 7f8b19528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:05:05.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8a5c0 con 0x561f25b82360 2024-09-21T09:05:05.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:05:05.401 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 20 zone default found 2024-09-21T09:05:05.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 4 Realm: () 2024-09-21T09:05:05.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:05:05.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:05:05.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:05:05.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 20 zonegroup default 2024-09-21T09:05:05.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8ebc0 con 0x561f25b86d70 2024-09-21T09:05:05.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b90df0 con 0x561f25b8b700 2024-09-21T09:05:05.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b8b700 2024-09-21T09:05:05.402 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.387+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b91190 con 0x561f25b8b700 2024-09-21T09:05:05.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.388+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b8b700 2024-09-21T09:05:05.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.388+0000 7f8b19528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:05:05.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.388+0000 7f8b19528800 20 started sync module instance, tier type = 2024-09-21T09:05:05.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.388+0000 7f8b19528800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:05:05.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.388+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b90230 con 0x7f8b08027020 2024-09-21T09:05:05.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.389+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x7f8b08027020 2024-09-21T09:05:05.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.389+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94691776857952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b90230 con 0x7f8b08027020 2024-09-21T09:05:05.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.389+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b91b50 con 0x561f25b82360 2024-09-21T09:05:05.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.390+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94691776857952] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x7f8b08027020 2024-09-21T09:05:05.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.390+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.390+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94691776862336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b90230 con 0x561f25b82360 2024-09-21T09:05:05.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.390+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b925a0 con 0x561f25b8b700 2024-09-21T09:05:05.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.391+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b8b700 2024-09-21T09:05:05.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.391+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94691776864432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b92e70 con 0x561f25b8b700 2024-09-21T09:05:05.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.391+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b938e0 con 0x7f8b08027020 2024-09-21T09:05:05.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.391+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94691776862336] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.392+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94691776864432] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b8b700 2024-09-21T09:05:05.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.392+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x7f8b08027020 2024-09-21T09:05:05.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.392+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94691776866752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b8fd80 con 0x7f8b08027020 2024-09-21T09:05:05.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.392+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b941c0 con 0x561f25b82360 2024-09-21T09:05:05.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.393+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94691776866752] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x7f8b08027020 2024-09-21T09:05:05.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.394+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.394+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94691776869296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b94130 con 0x561f25b82360 2024-09-21T09:05:05.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.394+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b94bd0 con 0x561f25b86d70 2024-09-21T09:05:05.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.395+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94691776869296] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.404 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.395+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.405 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.395+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94691776874752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b94130 con 0x561f25b86d70 2024-09-21T09:05:05.405 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.395+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b955e0 con 0x561f25b86d70 2024-09-21T09:05:05.405 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.396+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94691776874752] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.405 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.396+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.405 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.396+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94691776871552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b957c0 con 0x561f25b86d70 2024-09-21T09:05:05.405 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.396+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b96050 con 0x561f25b86d70 2024-09-21T09:05:05.405 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.397+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94691776871552] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.405 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.397+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.405 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.397+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94691776877328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b96230 con 0x561f25b86d70 2024-09-21T09:05:05.405 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.397+0000 7f8b19528800 20 add_watcher() i=0 2024-09-21T09:05:05.405 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.397+0000 7f8b19528800 20 add_watcher() i=1 2024-09-21T09:05:05.405 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.397+0000 7f8b19528800 20 add_watcher() i=2 2024-09-21T09:05:05.405 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.397+0000 7f8b19528800 20 add_watcher() i=3 2024-09-21T09:05:05.405 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.397+0000 7f8b19528800 20 add_watcher() i=4 2024-09-21T09:05:05.406 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.397+0000 7f8b19528800 20 add_watcher() i=5 2024-09-21T09:05:05.406 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.397+0000 7f8b19528800 20 add_watcher() i=6 2024-09-21T09:05:05.406 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.398+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94691776877328] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.406 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.398+0000 7f8b19528800 20 add_watcher() i=7 2024-09-21T09:05:05.406 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.398+0000 7f8b19528800 2 all 8 watchers are set, enabling cache 2024-09-21T09:05:05.406 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.398+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25b99600 con 0x561f25b82360 2024-09-21T09:05:05.406 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.398+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.406 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.398+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94691776880928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25b969f0 con 0x561f25b82360 2024-09-21T09:05:05.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.399+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94691776880928] v31'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.399+0000 7f89cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:05.408 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.399+0000 7f8b19528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:05:05.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.399+0000 7f8b19528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:05:05.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.400+0000 7f8b19528800 5 note: GC not initialized 2024-09-21T09:05:05.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.400+0000 7f89ca7e4640 20 reqs_thread_entry: start 2024-09-21T09:05:05.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.400+0000 7f8b19528800 20 init_complete bucket index max shards: 11 2024-09-21T09:05:05.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.400+0000 7f8b19528800 20 Filter name: none 2024-09-21T09:05:05.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.400+0000 7f893bfff640 20 reqs_thread_entry: start 2024-09-21T09:05:05.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.400+0000 7f8b19528800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T09:05:05.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.400+0000 7f8b19528800 20 rados->read ofs=0 len=0 2024-09-21T09:05:05.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.400+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25bcc8b0 con 0x561f25b86d70 2024-09-21T09:05:05.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.401+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv16 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.401+0000 7f8b19528800 20 rados_obj.operate() r=0 bl.length=473 2024-09-21T09:05:05.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.401+0000 7f8b19528800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T09:05:05.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.401+0000 7f8b19528800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:05.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.401+0000 7f8b19528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T09:05:05.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.401+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25bd3260 con 0x561f25b86d70 2024-09-21T09:05:05.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.402+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v31'17 uv17 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.402+0000 7f8b19528800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:05.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.402+0000 7f8b19528800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:05.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.402+0000 7f8b19528800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T09:05:05.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.402+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94691777129504 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561f25bce8c0 con 0x561f25b82360 2024-09-21T09:05:05.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.402+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== watch-notify(notify (1) cookie 94691776869296 notify 133143986211 ret 0) ==== 691+0+0 (crc 0 0 0) 0x561f25915e00 con 0x561f25b82360 2024-09-21T09:05:05.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.402+0000 7f89f8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986211 cookie 94691776869296 notifier 4924 bl.length()=649 2024-09-21T09:05:05.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.402+0000 7f89f8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T09:05:05.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.402+0000 7f89f8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T09:05:05.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.402+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(64 notify.4 [notify cookie 94691777129504 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.402+0000 7f89f8ff9640 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f89d8003ea0 con 0x561f25b82360 2024-09-21T09:05:05.410 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.402+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.402+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== watch-notify(notify_complete (2) cookie 94691777129504 notify 133143986211 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8b0c05b870 con 0x561f25b82360 2024-09-21T09:05:05.411 INFO:teuthology.orchestra.run.smithi178.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T09:05:03.575855Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T09:05:03.575846Z","tags":[],"group_ids":[]} 2024-09-21T09:05:05.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.403+0000 7f89cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:05:05.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.403+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94691776880928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25bd24c0 con 0x561f25b82360 2024-09-21T09:05:05.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.404+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94691776880928] v31'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.404+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94691776857952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25bd24c0 con 0x7f8b08027020 2024-09-21T09:05:05.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.405+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94691776857952] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x7f8b08027020 2024-09-21T09:05:05.413 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.405+0000 7f8b19528800 20 remove_watcher() i=0 2024-09-21T09:05:05.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.405+0000 7f8b19528800 2 removed watcher, disabling cache 2024-09-21T09:05:05.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.405+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94691776862336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25bd24c0 con 0x561f25b82360 2024-09-21T09:05:05.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.407+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94691776862336] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.407+0000 7f8b19528800 20 remove_watcher() i=1 2024-09-21T09:05:05.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.407+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94691776864432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25bd24c0 con 0x561f25b8b700 2024-09-21T09:05:05.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.408+0000 7f8b1521d640 1 -- 172.21.15.178:0/1661442385 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94691776864432] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0801b070 con 0x561f25b8b700 2024-09-21T09:05:05.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.408+0000 7f8b19528800 20 remove_watcher() i=2 2024-09-21T09:05:05.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.408+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94691776866752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25bca5d0 con 0x7f8b08027020 2024-09-21T09:05:05.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.408+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94691776866752] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x7f8b08027020 2024-09-21T09:05:05.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.408+0000 7f8b19528800 20 remove_watcher() i=3 2024-09-21T09:05:05.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.409+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94691776869296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25bca5d0 con 0x561f25b82360 2024-09-21T09:05:05.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.409+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94691776869296] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c057030 con 0x561f25b82360 2024-09-21T09:05:05.414 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.409+0000 7f8b19528800 20 remove_watcher() i=4 2024-09-21T09:05:05.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.409+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94691776874752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25bca5d0 con 0x561f25b86d70 2024-09-21T09:05:05.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.410+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94691776874752] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.410+0000 7f8b19528800 20 remove_watcher() i=5 2024-09-21T09:05:05.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.410+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94691776871552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25bca5d0 con 0x561f25b86d70 2024-09-21T09:05:05.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.411+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94691776871552] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.411+0000 7f8b19528800 20 remove_watcher() i=6 2024-09-21T09:05:05.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.411+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94691776877328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561f25bca5d0 con 0x561f25b86d70 2024-09-21T09:05:05.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.412+0000 7f8b15a1e640 1 -- 172.21.15.178:0/1661442385 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94691776877328] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10032030 con 0x561f25b86d70 2024-09-21T09:05:05.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.412+0000 7f8b19528800 20 remove_watcher() i=7 2024-09-21T09:05:05.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.412+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561f25b86d70 msgr2=0x561f25b89160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.412+0000 7f8b19528800 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561f25b86d70 0x561f25b89160 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.412+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561f25b82360 msgr2=0x561f25b84820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.412+0000 7f8b19528800 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561f25b82360 0x561f25b84820 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.412+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8b08027020 msgr2=0x7f8b0804c220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.412+0000 7f8b19528800 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f8b08027020 0x7f8b0804c220 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.412+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x561f25b8b700 msgr2=0x561f25b8dbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.412+0000 7f8b19528800 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x561f25b8b700 0x561f25b8dbc0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89e0036b40 msgr2=0x7f89e0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89e0036b40 0x7f89e0039000 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8b08011ff0 tx=0x7f8b08028000 comp rx=0 tx=0).stop 2024-09-21T09:05:05.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b6f490 msgr2=0x561f25b76940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b14a1c640 1 -- 172.21.15.178:0/1661442385 reap_dead start 2024-09-21T09:05:05.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b6f490 0x561f25b76940 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8b10005700 tx=0x7f8b1004cb50 comp rx=0 tx=0).stop 2024-09-21T09:05:05.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 shutdown_connections 2024-09-21T09:05:05.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 --2- 172.21.15.178:0/1661442385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b6f490 0x561f25b76940 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 >> 172.21.15.178:0/1661442385 conn(0x561f25b6b7f0 msgr2=0x561f25b698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 shutdown_connections 2024-09-21T09:05:05.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 -- 172.21.15.178:0/1661442385 wait complete. 2024-09-21T09:05:05.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 -- 172.21.15.178:0/3687438316 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89ec036b40 msgr2=0x7f89ec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 --2- 172.21.15.178:0/3687438316 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89ec036b40 0x7f89ec039000 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x561f25b4f4d0 tx=0x7f8b08012f20 comp rx=0 tx=0).stop 2024-09-21T09:05:05.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 -- 172.21.15.178:0/3687438316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b62820 msgr2=0x561f25b62c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 --2- 172.21.15.178:0/3687438316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b62820 0x561f25b62c40 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x561f25b48b30 tx=0x7f8b1000aec0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 -- 172.21.15.178:0/3687438316 shutdown_connections 2024-09-21T09:05:05.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 --2- 172.21.15.178:0/3687438316 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89ec036b40 0x7f89ec039000 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.419 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 --2- 172.21.15.178:0/3687438316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25b62820 0x561f25b62c40 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 -- 172.21.15.178:0/3687438316 >> 172.21.15.178:0/3687438316 conn(0x561f25b577b0 msgr2=0x561f25b5a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 -- 172.21.15.178:0/3687438316 shutdown_connections 2024-09-21T09:05:05.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 -- 172.21.15.178:0/3687438316 wait complete. 2024-09-21T09:05:05.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561f25b51360 msgr2=0x561f25b53750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561f25b51360 0x561f25b53750 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561f25b4c790 msgr2=0x561f25b4eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.413+0000 7f8b19528800 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561f25b4c790 0x561f25b4eb80 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.414+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89fc036b90 msgr2=0x7f89fc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.414+0000 7f8b19528800 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89fc036b90 0x7f89fc039050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c057000 tx=0x7f8b0c052000 comp rx=0 tx=0).stop 2024-09-21T09:05:05.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.414+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25a52880 msgr2=0x561f25b47730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:05:05.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.414+0000 7f8b19528800 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25a52880 0x561f25b47730 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x561f25a4e190 tx=0x7f8b08001250 comp rx=0 tx=0).stop 2024-09-21T09:05:05.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.414+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 shutdown_connections 2024-09-21T09:05:05.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.414+0000 7f8b19528800 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x561f25b51360 0x561f25b53750 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.414+0000 7f8b19528800 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x561f25b4c790 0x561f25b4eb80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.421 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.414+0000 7f8b19528800 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f89fc036b90 0x7f89fc039050 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.421 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.414+0000 7f8b19528800 1 --2- 172.21.15.178:0/2214094891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561f25a52880 0x561f25b47730 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:05:05.421 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.414+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 >> 172.21.15.178:0/2214094891 conn(0x561f25a48db0 msgr2=0x561f25b38e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:05:05.421 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.414+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 shutdown_connections 2024-09-21T09:05:05.421 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:05:05.414+0000 7f8b19528800 1 -- 172.21.15.178:0/2214094891 wait complete. 2024-09-21T09:05:05.424 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:05.424 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T09:05:03.575855Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T09:05:03.575846Z', 'tags': [], 'group_ids': []} 2024-09-21T09:05:05.424 ERROR:root:0 2024-09-21T09:05:05.424 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-21T09:05:05.430 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:05.431 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:05.434 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:05.434 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-21T09:05:05.439 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:05.440 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:05.443 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:05.443 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-21T09:05:05.451 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-21T09:05:05.451 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:05.454 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:05.455 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-21T09:05:05.461 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:05:05.462 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:05.465 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:05.465 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-21T09:05:05.472 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-21T09:05:05.472 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:05.476 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:05.476 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-21T09:05:05.483 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-21T09:05:05.484 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:05.487 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:05.487 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-21T09:05:05.493 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:05:05.493 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:05.496 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:05.497 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-21T09:05:05.502 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:05:05.502 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:05.505 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:05.506 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-21T09:05:05.512 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:05:05.512 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:05:05.516 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:05.516 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-21T09:05:05.519 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-21T09:05:05.520 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-21T09:05:05.524 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-21T09:05:05.535 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-21T09:05:05.539 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-21T09:05:05.539 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-21T09:05:05.543 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68ad48f1-b3da-4499-bba2-41066e92d255', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11', 'marker': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T09:05:05.529837Z', 'creation_time': '2024-09-21T09:05:05.527126Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-21T09:05:05.543 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-21T09:05:05.547 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68ad48f1-b3da-4499-bba2-41066e92d255', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11', 'marker': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T09:05:05.529837Z', 'creation_time': '2024-09-21T09:05:05.527126Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-21T09:05:05.552 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-21T09:05:05.556 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68ad48f1-b3da-4499-bba2-41066e92d255', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11', 'marker': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T09:05:05.529837Z', 'creation_time': '2024-09-21T09:05:05.527126Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-21T09:05:05.556 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-21T09:05:05.560 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx0000033d333d00e912294-0066ee8c41-4231-default', 'HostId': '4231-default-default'} 2024-09-21T09:05:05.564 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-21T09:05:05.571 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:05:05.571 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-21T09:05:05.579 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:05:05.627 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11'} 2024-09-21T09:05:05.637 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:05:05.639 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11'} 2024-09-21T09:05:05.650 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:05:05.650 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-21T09:05:05.659 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:05:05.665 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-21T09:05:05.671 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:05:05.672 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-21T09:05:05.676 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68ad48f1-b3da-4499-bba2-41066e92d255', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11', 'marker': '5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T09:05:05.643313Z', 'creation_time': '2024-09-21T09:05:05.527126Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-21T09:06:05.720 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-21T09:06:05.739 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-21T09:06:05.739 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-21T09:06:05.755 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-21T09:06:05.755 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-21T09:06:05.760 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-21T09:06:05.760 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-21T09:06:05.765 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-21T09:06:05.765 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-21T09:06:05.769 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-21T09:06:05.770 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-21T09:06:05.774 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-21T09:06:05.774 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-21T09:06:05.778 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-21T09:00:00.000000Z', 'epoch': 1726909200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-21T09:06:05.778 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-21T09:06:05.785 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:06:05.785 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-21T09:06:05.789 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-21T09:06:05.789 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-21T09:06:05.797 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:06:05.801 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-21T09:06:05.809 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:06:06.049 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-21T09:06:06.054 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000003a00145bce71b562-0066ee8c7e-4231-default', 'HostId': '4231-default-default'} 2024-09-21T09:06:06.156 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-21T09:06:06.161 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-21T09:06:06.166 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-21T09:06:06.170 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-21T09:06:06.238 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-21T09:06:06.270 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:06:06.271 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-21T09:06:06.276 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-21T09:06:06.276 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-21T09:06:06.282 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-21T09:06:06.292 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-21T09:06:06.296 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000001ce86e604baba8b2-0066ee8c7e-4231-default', 'HostId': '4231-default-default'} 2024-09-21T09:06:06.351 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-21T09:06:06.380 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:06:06.380 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T09:06:06.384 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000002ab02492f9a27a93-0066ee8c7e-4231-default', 'HostId': '4231-default-default'} 2024-09-21T09:06:06.384 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-21T09:06:06.387 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '7bec7bbe-ddde-41dc-a98a-89578467409a'}]}} 2024-09-21T09:06:06.388 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-21T09:06:06.398 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T09:06:06.399 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-21T09:06:06.402 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-21T09:06:06.402 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-21T09:06:06.406 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000009eff468f16e8429d-0066ee8c7e-4231-default', 'HostId': '4231-default-default'} 2024-09-21T09:06:06.407 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-21T09:06:06.410 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000dd75aa71ba3f0e9a-0066ee8c7e-4231-default', 'HostId': '4231-default-default'} 2024-09-21T09:06:06.419 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-21T09:06:06.423 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-21T09:06:06.423 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-21T09:06:06.426 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000086da373da55ac624-0066ee8c7e-4231-default', 'HostId': '4231-default-default'} 2024-09-21T09:06:06.427 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-21T09:06:06.430 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000007b4c6436bb5ee39d-0066ee8c7e-4231-default', 'HostId': '4231-default-default'} 2024-09-21T09:06:06.431 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-21T09:06:06.435 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-21T09:06:06.435 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-21T09:06:06.439 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000054643b1c2f3a08e6-0066ee8c7e-4231-default', 'HostId': '4231-default-default'} 2024-09-21T09:06:06.440 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-21T09:06:06.443 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000e483a6ddec75510e-0066ee8c7e-4231-default', 'HostId': '4231-default-default'} 2024-09-21T09:06:06.443 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-21T09:06:06.447 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000008c853b8fcc0001a8-0066ee8c7e-4231-default', 'HostId': '4231-default-default'} 2024-09-21T09:06:06.447 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-21T09:06:06.451 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000008316c3918aaa4e90-0066ee8c7e-4231-default', 'HostId': '4231-default-default'} 2024-09-21T09:06:06.451 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-21T09:06:06.461 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:06:06.461 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-21T09:06:06.464 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-21T09:06:06.465 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-21T09:06:06.470 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:06:06.470 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-21T09:06:06.473 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-21T09:06:06.474 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-21T09:06:06.479 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T09:06:06.484 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-21T09:06:06.494 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-21T09:06:06.494 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:06:06.495 INFO:tasks.rgw.client.0.smithi178.stdout:2024-09-21T09:06:06.493+0000 7f6693664640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 35305) UID: 0 2024-09-21T09:06:06.495 INFO:tasks.rgw.client.0.smithi178.stdout:2024-09-21T09:06:06.493+0000 7f6696ec4880 -1 shutting down 2024-09-21T09:06:11.735 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-21T09:06:12.595 INFO:tasks.rgw.client.0:Stopped 2024-09-21T09:06:12.596 DEBUG:teuthology.orchestra.run.smithi178:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-21T09:06:12.615 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/vault-root-token 2024-09-21T09:06:12.683 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-21T09:06:12.751 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-21T09:06:12.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-21T09:06:12.751 DEBUG:teuthology.orchestra.run.smithi178:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-21T09:06:12.838 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setuser ceph since I am not root 2024-09-21T09:06:12.838 INFO:teuthology.orchestra.run.smithi178.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T09:06:12.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.837+0000 7f4b2dbaf800 1 Processor -- start 2024-09-21T09:06:12.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.837+0000 7f4b2dbaf800 1 -- start start 2024-09-21T09:06:12.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.837+0000 7f4b2dbaf800 1 --2- >> v2:172.21.15.44:3300/0 conn(0x562e38d5c610 0x562e38ded670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.837+0000 7f4b2dbaf800 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e38ca7b30 con 0x562e38dedbb0 2024-09-21T09:06:12.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.837+0000 7f4b2dbaf800 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x562e38c89360 con 0x562e38d5c610 2024-09-21T09:06:12.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.838+0000 7f4b2b6a3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x562e38d5c610 0x562e38ded670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.838+0000 7f4b2b6a3640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x562e38d5c610 0x562e38ded670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:59184/0 (socket says 172.21.15.178:59184) 2024-09-21T09:06:12.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.838+0000 7f4b2aea2640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x562e38dedbb0 0x562e38deffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.178:52054/0 (socket says 172.21.15.178:52054) 2024-09-21T09:06:12.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.838+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/3911688719 learned_addr learned my addr 172.21.15.178:0/3911688719 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:06:12.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.838+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/3911688719 >> v1:172.21.15.44:6789/0 conn(0x562e38dedbb0 legacy=0x562e38deffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:12.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.838+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/3911688719 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e38cafe00 con 0x562e38d5c610 2024-09-21T09:06:12.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.840+0000 7f4b2b6a3640 1 --2- 172.21.15.178:0/3911688719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ded670 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c005fd0 tx=0x7f4b1c045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30e497c11bf7d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.840+0000 7f4b2a6a1640 1 -- 172.21.15.178:0/3911688719 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b1c04e600 con 0x562e38d5c610 2024-09-21T09:06:12.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.840+0000 7f4b2a6a1640 1 -- 172.21.15.178:0/3911688719 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1c04e7a0 con 0x562e38d5c610 2024-09-21T09:06:12.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.840+0000 7f4b2a6a1640 1 -- 172.21.15.178:0/3911688719 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b1c04eaa0 con 0x562e38d5c610 2024-09-21T09:06:12.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.841+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/3911688719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 msgr2=0x562e38ded670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:12.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.841+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/3911688719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ded670 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c005fd0 tx=0x7f4b1c045cf0 comp rx=0 tx=0).stop 2024-09-21T09:06:12.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.841+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/3911688719 shutdown_connections 2024-09-21T09:06:12.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.841+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/3911688719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ded670 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:12.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.841+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/3911688719 >> 172.21.15.178:0/3911688719 conn(0x562e38de2de0 msgr2=0x562e38de5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:12.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.841+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/3911688719 shutdown_connections 2024-09-21T09:06:12.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.841+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/3911688719 wait complete. 2024-09-21T09:06:12.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.855+0000 7f4b2dbaf800 1 Processor -- start 2024-09-21T09:06:12.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.855+0000 7f4b2dbaf800 1 -- start start 2024-09-21T09:06:12.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.856+0000 7f4b2dbaf800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ed9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.856+0000 7f4b2dbaf800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e38d34330 con 0x562e38d5c610 2024-09-21T09:06:12.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.856+0000 7f4b2b6a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ed9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.856+0000 7f4b2b6a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ed9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:59188/0 (socket says 172.21.15.178:59188) 2024-09-21T09:06:12.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.856+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2723432927 learned_addr learned my addr 172.21.15.178:0/2723432927 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:06:12.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.856+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2723432927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e38c81bc0 con 0x562e38d5c610 2024-09-21T09:06:12.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.857+0000 7f4b2b6a3640 1 --2- 172.21.15.178:0/2723432927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ed9a80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00a4b0 tx=0x7f4b1c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a7fe9921dc7a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.857+0000 7f4a1960a640 1 -- 172.21.15.178:0/2723432927 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b1c04ea80 con 0x562e38d5c610 2024-09-21T09:06:12.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.857+0000 7f4a1960a640 1 -- 172.21.15.178:0/2723432927 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1c066070 con 0x562e38d5c610 2024-09-21T09:06:12.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.857+0000 7f4a1960a640 1 -- 172.21.15.178:0/2723432927 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b1c04edc0 con 0x562e38d5c610 2024-09-21T09:06:12.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.857+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2723432927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 msgr2=0x562e38ed9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:12.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.857+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2723432927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ed9a80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00a4b0 tx=0x7f4b1c050000 comp rx=0 tx=0).stop 2024-09-21T09:06:12.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.857+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2723432927 shutdown_connections 2024-09-21T09:06:12.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.857+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2723432927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ed9a80 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:12.860 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.857+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2723432927 >> 172.21.15.178:0/2723432927 conn(0x562e38de2de0 msgr2=0x562e38ed5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:12.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.858+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2723432927 shutdown_connections 2024-09-21T09:06:12.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.858+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2723432927 wait complete. 2024-09-21T09:06:12.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.858+0000 7f4b2dbaf800 1 Processor -- start 2024-09-21T09:06:12.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.858+0000 7f4b2dbaf800 1 -- start start 2024-09-21T09:06:12.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.858+0000 7f4b2dbaf800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ee12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.858+0000 7f4b2dbaf800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e38df1990 con 0x562e38d5c610 2024-09-21T09:06:12.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.858+0000 7f4b2b6a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ee12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.858+0000 7f4b2b6a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ee12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:59192/0 (socket says 172.21.15.178:59192) 2024-09-21T09:06:12.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.858+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2180944542 learned_addr learned my addr 172.21.15.178:0/2180944542 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:06:12.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.859+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2180944542 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e38c95fe0 con 0x562e38d5c610 2024-09-21T09:06:12.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.859+0000 7f4b2b6a3640 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ee12f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00a4b0 tx=0x7f4b1c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.859+0000 7f4a17e07640 1 -- 172.21.15.178:0/2180944542 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b1c076470 con 0x562e38d5c610 2024-09-21T09:06:12.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.859+0000 7f4a17e07640 1 -- 172.21.15.178:0/2180944542 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1c071070 con 0x562e38d5c610 2024-09-21T09:06:12.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.859+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e38ee1830 con 0x562e38d5c610 2024-09-21T09:06:12.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.859+0000 7f4a17e07640 1 -- 172.21.15.178:0/2180944542 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b1c076740 con 0x562e38d5c610 2024-09-21T09:06:12.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.859+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e38ee1d50 con 0x562e38d5c610 2024-09-21T09:06:12.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.860+0000 7f4a17e07640 1 -- 172.21.15.178:0/2180944542 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4b1c06d420 con 0x562e38d5c610 2024-09-21T09:06:12.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.860+0000 7f4a17e07640 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4a10036b40 0x7f4a10039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.860+0000 7f4a17e07640 1 -- 172.21.15.178:0/2180944542 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f4b1c0915f0 con 0x562e38d5c610 2024-09-21T09:06:12.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.860+0000 7f4b2aea2640 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4a10036b40 0x7f4a10039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.860+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562e38dedbb0 0x562e38ee8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.860+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38ee88e0 con 0x562e38dedbb0 2024-09-21T09:06:12.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.860+0000 7f4b2bea4640 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562e38dedbb0 0x562e38ee8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.861+0000 7f4b2aea2640 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4a10036b40 0x7f4a10039000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4b14000f60 tx=0x7f4b14001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.861+0000 7f4b2bea4640 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562e38dedbb0 0x562e38ee8360 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.861+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2180944542 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b240083e0 con 0x562e38dedbb0 2024-09-21T09:06:12.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.861+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38ee5910 con 0x562e38dedbb0 2024-09-21T09:06:12.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.861+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2180944542 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b240083e0 con 0x562e38dedbb0 2024-09-21T09:06:12.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.862+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562e38eeac10 0x562e38eed000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.862+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:3 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38eed6f0 con 0x562e38eeac10 2024-09-21T09:06:12.865 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.862+0000 7f4b2b6a3640 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562e38eeac10 0x562e38eed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.862+0000 7f4b2b6a3640 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562e38eeac10 0x562e38eed000 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.863+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2180944542 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(3 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38eeac10 2024-09-21T09:06:12.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.863+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38ee9ab0 con 0x562e38dedbb0 2024-09-21T09:06:12.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.863+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2180944542 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b240083e0 con 0x562e38dedbb0 2024-09-21T09:06:12.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.863+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:5 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38ee9f50 con 0x562e38dedbb0 2024-09-21T09:06:12.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.864+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2180944542 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(5 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4b240083e0 con 0x562e38dedbb0 2024-09-21T09:06:12.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.864+0000 7f4b2dbaf800 1 Processor -- start 2024-09-21T09:06:12.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.864+0000 7f4b2dbaf800 1 -- start start 2024-09-21T09:06:12.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.864+0000 7f4b2dbaf800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38efc0c0 0x562e38efc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.867 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.864+0000 7f4b2dbaf800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e38c83580 con 0x562e38efc0c0 2024-09-21T09:06:12.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.864+0000 7f4b2bea4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38efc0c0 0x562e38efc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.864+0000 7f4b2bea4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38efc0c0 0x562e38efc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:59204/0 (socket says 172.21.15.178:59204) 2024-09-21T09:06:12.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.864+0000 7f4b2bea4640 1 -- 172.21.15.178:0/124923250 learned_addr learned my addr 172.21.15.178:0/124923250 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:06:12.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.865+0000 7f4b2bea4640 1 -- 172.21.15.178:0/124923250 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e38efca20 con 0x562e38efc0c0 2024-09-21T09:06:12.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.865+0000 7f4b2bea4640 1 --2- 172.21.15.178:0/124923250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38efc0c0 0x562e38efc4e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x562e38ee2510 tx=0x7f4b2400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.865+0000 7f4a15602640 1 -- 172.21.15.178:0/124923250 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b24007d00 con 0x562e38efc0c0 2024-09-21T09:06:12.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.865+0000 7f4a15602640 1 -- 172.21.15.178:0/124923250 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b2401e020 con 0x562e38efc0c0 2024-09-21T09:06:12.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.865+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/124923250 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e38efccb0 con 0x562e38efc0c0 2024-09-21T09:06:12.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.865+0000 7f4a15602640 1 -- 172.21.15.178:0/124923250 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b24019420 con 0x562e38efc0c0 2024-09-21T09:06:12.868 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.865+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/124923250 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e38eff990 con 0x562e38efc0c0 2024-09-21T09:06:12.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.866+0000 7f4a15602640 1 -- 172.21.15.178:0/124923250 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4b24016040 con 0x562e38efc0c0 2024-09-21T09:06:12.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.866+0000 7f4a15602640 1 --2- 172.21.15.178:0/124923250 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4a04036b90 0x7f4a04039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.866+0000 7f4a15602640 1 -- 172.21.15.178:0/124923250 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f4b2401f030 con 0x562e38efc0c0 2024-09-21T09:06:12.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.866+0000 7f4b2b6a3640 1 --2- 172.21.15.178:0/124923250 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4a04036b90 0x7f4a04039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.867+0000 7f4b2dbaf800 1 Processor -- start 2024-09-21T09:06:12.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.867+0000 7f4b2dbaf800 1 -- start start 2024-09-21T09:06:12.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.867+0000 7f4b2b6a3640 1 --2- 172.21.15.178:0/124923250 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4a04036b90 0x7f4a04039050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x562e38ee8d80 tx=0x7f4b1c07f910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.867+0000 7f4b2dbaf800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38f08d10 0x562e38f09110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.867+0000 7f4b2dbaf800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e38eda170 con 0x562e38f08d10 2024-09-21T09:06:12.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.867+0000 7f4b2bea4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38f08d10 0x562e38f09110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.867+0000 7f4b2bea4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38f08d10 0x562e38f09110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:59212/0 (socket says 172.21.15.178:59212) 2024-09-21T09:06:12.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.867+0000 7f4b2bea4640 1 -- 172.21.15.178:0/3887579691 learned_addr learned my addr 172.21.15.178:0/3887579691 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:06:12.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.867+0000 7f4b2bea4640 1 -- 172.21.15.178:0/3887579691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e38f096e0 con 0x562e38f08d10 2024-09-21T09:06:12.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.867+0000 7f4b2bea4640 1 --2- 172.21.15.178:0/3887579691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38f08d10 0x562e38f09110 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4b2404cf20 tx=0x7f4b24017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c431f9ec49748ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.872 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.868+0000 7f4a0effd640 1 -- 172.21.15.178:0/3887579691 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b2401d030 con 0x562e38f08d10 2024-09-21T09:06:12.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.868+0000 7f4a0effd640 1 -- 172.21.15.178:0/3887579691 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b24015e30 con 0x562e38f08d10 2024-09-21T09:06:12.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.868+0000 7f4a0effd640 1 -- 172.21.15.178:0/3887579691 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b24019960 con 0x562e38f08d10 2024-09-21T09:06:12.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.868+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/3887579691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38f08d10 msgr2=0x562e38f09110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:12.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.868+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/3887579691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38f08d10 0x562e38f09110 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4b2404cf20 tx=0x7f4b24017fa0 comp rx=0 tx=0).stop 2024-09-21T09:06:12.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.868+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/3887579691 shutdown_connections 2024-09-21T09:06:12.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.868+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/3887579691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38f08d10 0x562e38f09110 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:12.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.868+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/3887579691 >> 172.21.15.178:0/3887579691 conn(0x562e38f05070 msgr2=0x562e38f03170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:12.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.868+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/3887579691 shutdown_connections 2024-09-21T09:06:12.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.868+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/3887579691 wait complete. 2024-09-21T09:06:12.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.868+0000 7f4b2dbaf800 1 Processor -- start 2024-09-21T09:06:12.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.869+0000 7f4b2dbaf800 1 -- start start 2024-09-21T09:06:12.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.869+0000 7f4b2dbaf800 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38f08d10 0x562e38f10060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.869+0000 7f4b2dbaf800 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e38f09c60 con 0x562e38f08d10 2024-09-21T09:06:12.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.869+0000 7f4b2bea4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38f08d10 0x562e38f10060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.869+0000 7f4b2bea4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38f08d10 0x562e38f10060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.178:59216/0 (socket says 172.21.15.178:59216) 2024-09-21T09:06:12.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.869+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 learned_addr learned my addr 172.21.15.178:0/2282035329 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T09:06:12.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.869+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e38f105a0 con 0x562e38f08d10 2024-09-21T09:06:12.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.869+0000 7f4b2bea4640 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38f08d10 0x562e38f10060 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4b24048010 tx=0x7f4b2404ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.869+0000 7f4a0d7fa640 1 -- 172.21.15.178:0/2282035329 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b2403b070 con 0x562e38f08d10 2024-09-21T09:06:12.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.870+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e38f10830 con 0x562e38f08d10 2024-09-21T09:06:12.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.870+0000 7f4a0d7fa640 1 -- 172.21.15.178:0/2282035329 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b240153e0 con 0x562e38f08d10 2024-09-21T09:06:12.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.870+0000 7f4a0d7fa640 1 -- 172.21.15.178:0/2282035329 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b240179a0 con 0x562e38f08d10 2024-09-21T09:06:12.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.870+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e38f134e0 con 0x562e38f08d10 2024-09-21T09:06:12.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.870+0000 7f4a0d7fa640 1 -- 172.21.15.178:0/2282035329 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4b2402b350 con 0x562e38f08d10 2024-09-21T09:06:12.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.871+0000 7f4a0d7fa640 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f49f4036b40 0x7f49f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.880 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.871+0000 7f4a0d7fa640 1 -- 172.21.15.178:0/2282035329 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f4b24037ba0 con 0x562e38f08d10 2024-09-21T09:06:12.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.871+0000 7f4b2b6a3640 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f49f4036b40 0x7f49f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.871+0000 7f4b2b6a3640 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f49f4036b40 0x7f49f4039000 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c04ec10 tx=0x7f4b1c092000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.871+0000 7f4b2dbaf800 20 rados->read ofs=0 len=0 2024-09-21T09:06:12.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.871+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562e38f1bc10 0x562e38f1e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.871+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f1e820 con 0x562e38f1bc10 2024-09-21T09:06:12.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.871+0000 7f4b2aea2640 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562e38f1bc10 0x562e38f1e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.872+0000 7f4b2aea2640 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562e38f1bc10 0x562e38f1e0d0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.872+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b1400f610 con 0x562e38f1bc10 2024-09-21T09:06:12.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.872+0000 7f4b2dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:06:12.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.872+0000 7f4b2dbaf800 20 realm 2024-09-21T09:06:12.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.872+0000 7f4b2dbaf800 20 rados->read ofs=0 len=0 2024-09-21T09:06:12.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.872+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f1b060 con 0x562e38f1bc10 2024-09-21T09:06:12.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.872+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b1400f610 con 0x562e38f1bc10 2024-09-21T09:06:12.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.872+0000 7f4b2dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:06:12.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.872+0000 7f4b2dbaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T09:06:12.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.872+0000 7f4b2dbaf800 20 rados->read ofs=0 len=0 2024-09-21T09:06:12.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.872+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f1f310 con 0x562e38f1bc10 2024-09-21T09:06:12.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.873+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b1400f610 con 0x562e38f1bc10 2024-09-21T09:06:12.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.873+0000 7f4b2dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:06:12.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.873+0000 7f4b2dbaf800 20 rados->read ofs=0 len=0 2024-09-21T09:06:12.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.873+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f1fbe0 con 0x562e38f1bc10 2024-09-21T09:06:12.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.873+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b1400f610 con 0x562e38f1bc10 2024-09-21T09:06:12.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.873+0000 7f4b2dbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:06:12.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.873+0000 7f4b2dbaf800 20 rados->read ofs=0 len=0 2024-09-21T09:06:12.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.873+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562e38f20600 0x562e38f229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.873+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:5 5.1e 5:7ff8caf5:::zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f230e0 con 0x562e38f20600 2024-09-21T09:06:12.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.873+0000 7f4b2bea4640 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562e38f20600 0x562e38f229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.873+0000 7f4b2bea4640 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562e38f20600 0x562e38f229f0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.874+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== osd_op_reply(5 zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4b24055070 con 0x562e38f20600 2024-09-21T09:06:12.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.874+0000 7f4b2dbaf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T09:06:12.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.874+0000 7f4b2dbaf800 20 searching for the correct realm 2024-09-21T09:06:12.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.874+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562e38f250b0 0x562e38f27570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.874+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f250b0 2024-09-21T09:06:12.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.874+0000 7f4b2b6a3640 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562e38f250b0 0x562e38f27570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.874+0000 7f4b2b6a3640 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562e38f250b0 0x562e38f27570 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.875+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.875+0000 7f4b2b6a3640 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f4b1c06d040 0x7f4b1c091910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:12.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.875+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x7f4b1c06d040 2024-09-21T09:06:12.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.875+0000 7f4b2aea2640 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f4b1c06d040 0x7f4b1c091910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:12.883 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.875+0000 7f4b2aea2640 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f4b1c06d040 0x7f4b1c091910 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:12.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.875+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1400f610 con 0x7f4b1c06d040 2024-09-21T09:06:12.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.875+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f20600 2024-09-21T09:06:12.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.876+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b24055070 con 0x562e38f20600 2024-09-21T09:06:12.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.876+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f1bc10 2024-09-21T09:06:12.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.876+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1400f610 con 0x562e38f1bc10 2024-09-21T09:06:12.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.876+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f1bc10 2024-09-21T09:06:12.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.876+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1402b040 con 0x562e38f1bc10 2024-09-21T09:06:12.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.876+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f20600 2024-09-21T09:06:12.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.876+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b24055070 con 0x562e38f20600 2024-09-21T09:06:12.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.876+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f20600 2024-09-21T09:06:12.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.877+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b24055070 con 0x562e38f20600 2024-09-21T09:06:12.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.877+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x7f4b1c06d040 2024-09-21T09:06:12.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.877+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1402b040 con 0x7f4b1c06d040 2024-09-21T09:06:12.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.877+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f250b0 2024-09-21T09:06:12.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.877+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.877+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f1bc10 2024-09-21T09:06:12.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.877+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1402b040 con 0x562e38f1bc10 2024-09-21T09:06:12.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.877+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f20600 2024-09-21T09:06:12.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.878+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 5 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b24055070 con 0x562e38f20600 2024-09-21T09:06:12.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.878+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f1bc10 2024-09-21T09:06:12.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.878+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1402b040 con 0x562e38f1bc10 2024-09-21T09:06:12.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.878+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x7f4b1c06d040 2024-09-21T09:06:12.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.878+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4b1402b040 con 0x7f4b1c06d040 2024-09-21T09:06:12.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.878+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f250b0 2024-09-21T09:06:12.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.878+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.885 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.878+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f250b0 2024-09-21T09:06:12.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.879+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.886 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.879+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f20600 2024-09-21T09:06:12.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.879+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4b24055070 con 0x562e38f20600 2024-09-21T09:06:12.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.879+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f250b0 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.879+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.879+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f250b0 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.879+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.879+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f1bc10 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.880+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4b1402b040 con 0x562e38f1bc10 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.880+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f1bc10 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.880+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4b1402b040 con 0x562e38f1bc10 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.880+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f20600 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.880+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b24055070 con 0x562e38f20600 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.880+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f250b0 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.881+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.881+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x7f4b1c06d040 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.881+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1402b040 con 0x7f4b1c06d040 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.881+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f1bc10 2024-09-21T09:06:12.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.881+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1402b040 con 0x562e38f1bc10 2024-09-21T09:06:12.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.881+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f20600 2024-09-21T09:06:12.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.881+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=82b] v31'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f4b24055070 con 0x562e38f20600 2024-09-21T09:06:12.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.881+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f250b0 2024-09-21T09:06:12.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.882+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.882+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x7f4b1c06d040 2024-09-21T09:06:12.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.882+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1402b040 con 0x7f4b1c06d040 2024-09-21T09:06:12.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.882+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x7f4b1c06d040 2024-09-21T09:06:12.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.882+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1402b040 con 0x7f4b1c06d040 2024-09-21T09:06:12.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.882+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f250b0 2024-09-21T09:06:12.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.882+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.882+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f20600 2024-09-21T09:06:12.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x562e38f1bc10 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4b1402b040 con 0x562e38f1bc10 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562e38f27c40 con 0x7f4b1c06d040 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1402b040 con 0x7f4b1c06d040 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2dbaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2dbaf800 20 RGWRados::pool_iterate: got zone_info.5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2dbaf800 20 RGWRados::pool_iterate: got zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2dbaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2dbaf800 20 RGWRados::pool_iterate: got period_config.default 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2dbaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2dbaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2dbaf800 20 rados->read ofs=0 len=0 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f23aa0 con 0x562e38f1bc10 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.883+0000 7f4b2dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:06:12.895 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2dbaf800 20 rados->read ofs=0 len=0 2024-09-21T09:06:12.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f24340 con 0x562e38f1bc10 2024-09-21T09:06:12.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2dbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T09:06:12.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2dbaf800 20 rados->read ofs=0 len=0 2024-09-21T09:06:12.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:40 5.9 5:9769601d:::zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f236e0 con 0x562e38f1bc10 2024-09-21T09:06:12.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 15 ==== osd_op_reply(40 zonegroup_info.68ad48f1-b3da-4499-bba2-41066e92d255 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2dbaf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T09:06:12.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2dbaf800 20 zone default found 2024-09-21T09:06:12.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2dbaf800 4 Realm: () 2024-09-21T09:06:12.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2dbaf800 4 ZoneGroup: default (68ad48f1-b3da-4499-bba2-41066e92d255) 2024-09-21T09:06:12.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2dbaf800 4 Zone: default (5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee) 2024-09-21T09:06:12.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2dbaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T09:06:12.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2dbaf800 20 zonegroup default 2024-09-21T09:06:12.896 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2dbaf800 20 rados->read ofs=0 len=0 2024-09-21T09:06:12.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.884+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f28170 con 0x562e38f20600 2024-09-21T09:06:12.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.885+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 10 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.885+0000 7f4b2dbaf800 20 rados_obj.operate() r=0 bl.length=187 2024-09-21T09:06:12.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.885+0000 7f4b2dbaf800 20 rados->read ofs=0 len=0 2024-09-21T09:06:12.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.885+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2a440 con 0x562e38f250b0 2024-09-21T09:06:12.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.885+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.885+0000 7f4b2dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:06:12.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.885+0000 7f4b2dbaf800 20 rados->read ofs=0 len=0 2024-09-21T09:06:12.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.885+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2a810 con 0x562e38f250b0 2024-09-21T09:06:12.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.885+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.885+0000 7f4b2dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T09:06:12.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.885+0000 7f4b2dbaf800 20 started sync module instance, tier type = 2024-09-21T09:06:12.897 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.885+0000 7f4b2dbaf800 20 started zone id=5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee (name=default) with tier type = 2024-09-21T09:06:12.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.885+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f298d0 con 0x7f4b1c06d040 2024-09-21T09:06:12.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.886+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 8 ==== osd_op_reply(44 notify.0 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.886+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94756523908592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f298d0 con 0x7f4b1c06d040 2024-09-21T09:06:12.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.886+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2b2f0 con 0x562e38f1bc10 2024-09-21T09:06:12.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.887+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94756523908592] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.888+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 16 ==== osd_op_reply(46 notify.1 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.888+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94756523912672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f298d0 con 0x562e38f1bc10 2024-09-21T09:06:12.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.888+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2bd00 con 0x562e38f250b0 2024-09-21T09:06:12.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.889+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 12 ==== osd_op_reply(48 notify.2 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.889+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94756523915344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2c550 con 0x562e38f250b0 2024-09-21T09:06:12.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.889+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2d010 con 0x7f4b1c06d040 2024-09-21T09:06:12.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.889+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94756523912672] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.898 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.890+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 10 ==== osd_op_reply(50 notify.3 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.890+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94756523915344] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.890+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94756523920096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f29420 con 0x7f4b1c06d040 2024-09-21T09:06:12.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.890+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2d8b0 con 0x562e38f1bc10 2024-09-21T09:06:12.901 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.891+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94756523920096] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.891+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 18 ==== osd_op_reply(52 notify.4 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.891+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94756523917472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2d830 con 0x562e38f1bc10 2024-09-21T09:06:12.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.891+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2e2c0 con 0x562e38f20600 2024-09-21T09:06:12.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.892+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94756523917472] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.893+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 11 ==== osd_op_reply(54 notify.5 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.893+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94756523922784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2e2c0 con 0x562e38f20600 2024-09-21T09:06:12.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.893+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2ec80 con 0x562e38f20600 2024-09-21T09:06:12.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.894+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94756523922784] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.894+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 13 ==== osd_op_reply(56 notify.6 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.894+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94756523927984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2e2c0 con 0x562e38f20600 2024-09-21T09:06:12.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.894+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2f6d0 con 0x562e38f20600 2024-09-21T09:06:12.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.895+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94756523927984] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.895+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 15 ==== osd_op_reply(58 notify.7 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.895+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94756523930080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2f8b0 con 0x562e38f20600 2024-09-21T09:06:12.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.895+0000 7f4b2dbaf800 20 add_watcher() i=0 2024-09-21T09:06:12.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.895+0000 7f4b2dbaf800 20 add_watcher() i=1 2024-09-21T09:06:12.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.895+0000 7f4b2dbaf800 20 add_watcher() i=2 2024-09-21T09:06:12.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.895+0000 7f4b2dbaf800 20 add_watcher() i=3 2024-09-21T09:06:12.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.895+0000 7f4b2dbaf800 20 add_watcher() i=4 2024-09-21T09:06:12.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.895+0000 7f4b2dbaf800 20 add_watcher() i=5 2024-09-21T09:06:12.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.895+0000 7f4b2dbaf800 20 add_watcher() i=6 2024-09-21T09:06:12.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.896+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94756523930080] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.896+0000 7f4b2dbaf800 20 add_watcher() i=7 2024-09-21T09:06:12.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.896+0000 7f4b2dbaf800 2 all 8 watchers are set, enabling cache 2024-09-21T09:06:12.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.896+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f32c80 con 0x562e38f1bc10 2024-09-21T09:06:12.903 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.896+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.896+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94756523931552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f30070 con 0x562e38f1bc10 2024-09-21T09:06:12.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.897+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94756523931552] v31'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.897+0000 7f49e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:06:12.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.897+0000 7f4b2dbaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T09:06:12.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.897+0000 7f4b2dbaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T09:06:12.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.897+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3b480 con 0x562e38f1bc10 2024-09-21T09:06:12.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.899+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'39 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.899+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3bad0 con 0x562e38f20600 2024-09-21T09:06:12.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.900+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.900+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3bad0 con 0x562e38f250b0 2024-09-21T09:06:12.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.901+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.901+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3bf80 con 0x562e38f1bc10 2024-09-21T09:06:12.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.901+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'275 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.902+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3c370 con 0x7f4b1c06d040 2024-09-21T09:06:12.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.902+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'84 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.902+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3c370 con 0x562e38f250b0 2024-09-21T09:06:12.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.903+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'57 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.903+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3c940 con 0x562e38f1bc10 2024-09-21T09:06:12.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.905+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.906 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.905+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3c940 con 0x562e38f20600 2024-09-21T09:06:12.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.906+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.906+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3c940 con 0x7f4b1c06d040 2024-09-21T09:06:12.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.907+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.907+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3c940 con 0x562e38f250b0 2024-09-21T09:06:12.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.908+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.908+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3c940 con 0x7f4b1c06d040 2024-09-21T09:06:12.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.909+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'85 uv83 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.909+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3c940 con 0x562e38f20600 2024-09-21T09:06:12.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.910+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'41 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.911 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.910+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3c940 con 0x7f4b1c06d040 2024-09-21T09:06:12.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.910+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.910+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3c940 con 0x562e38f20600 2024-09-21T09:06:12.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.911+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.913 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.912+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3c940 con 0x562e38f1bc10 2024-09-21T09:06:12.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.913+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'276 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.914 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.913+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3c940 con 0x562e38f250b0 2024-09-21T09:06:12.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.914+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'77 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.916 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.914+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf70 con 0x7f4b1c06d040 2024-09-21T09:06:12.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.915+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'86 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.917 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.915+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x562e38f250b0 2024-09-21T09:06:12.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.916+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.918 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.916+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x562e38f1bc10 2024-09-21T09:06:12.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.917+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.919 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.917+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x562e38f1bc10 2024-09-21T09:06:12.920 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.919+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'277 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.921 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.919+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x562e38f250b0 2024-09-21T09:06:12.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.920+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'78 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.922 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.920+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x7f4b1c06d040 2024-09-21T09:06:12.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.921+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.921+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x562e38f250b0 2024-09-21T09:06:12.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.922+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.924 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.922+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x562e38f250b0 2024-09-21T09:06:12.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.923+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.923+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x562e38f250b0 2024-09-21T09:06:12.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.924+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.924+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x562e38f250b0 2024-09-21T09:06:12.926 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.925+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'58 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.926 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.925+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x562e38f20600 2024-09-21T09:06:12.928 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.926+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.928 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.926+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x562e38f250b0 2024-09-21T09:06:12.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.927+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.929 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.927+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x562e38f20600 2024-09-21T09:06:12.930 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.928+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'57 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.930 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.928+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x562e38f250b0 2024-09-21T09:06:12.931 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.929+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'79 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.931 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.929+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x562e38f20600 2024-09-21T09:06:12.932 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.930+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'63 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.932 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.930+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f3cf50 con 0x7f4b1c06d040 2024-09-21T09:06:12.934 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.932+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.934 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.932+0000 7f49e0fe1640 20 reqs_thread_entry: start 2024-09-21T09:06:12.934 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.932+0000 7f4b2dbaf800 20 init_complete bucket index max shards: 11 2024-09-21T09:06:12.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.932+0000 7f4b2dbaf800 20 Filter name: none 2024-09-21T09:06:12.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.932+0000 7f495a7fc640 20 reqs_thread_entry: start 2024-09-21T09:06:12.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.932+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-21T09:06:12.935 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.932+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.934+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 28 ==== osd_op_reply(94 gc.0 [call] v31'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.934+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.934+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 29 ==== osd_op_reply(95 gc.0 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.934+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.934+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f67e30 con 0x562e38f1bc10 2024-09-21T09:06:12.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.934+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 30 ==== osd_op_reply(96 gc.0 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.934+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:97 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.938 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.934+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 31 ==== osd_op_reply(97 gc.0 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.934+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.934+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:98 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.935+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 32 ==== osd_op_reply(98 gc.0 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.935+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.935+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:99 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.936+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 33 ==== osd_op_reply(99 gc.0 [call] v31'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.936+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-21T09:06:12.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.936+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:100 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f20600 2024-09-21T09:06:12.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.937+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 24 ==== osd_op_reply(100 gc.1 [call] v31'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.937+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:101 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f20600 2024-09-21T09:06:12.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.937+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 25 ==== osd_op_reply(101 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.937+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.937+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:102 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f67e30 con 0x562e38f20600 2024-09-21T09:06:12.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.938+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 26 ==== osd_op_reply(102 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.938+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:103 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f20600 2024-09-21T09:06:12.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.938+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 27 ==== osd_op_reply(103 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.938+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.938+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:104 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f20600 2024-09-21T09:06:12.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.938+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 28 ==== osd_op_reply(104 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.938+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.941 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.938+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:105 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f20600 2024-09-21T09:06:12.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.939+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 29 ==== osd_op_reply(105 gc.1 [call] v31'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.939+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-21T09:06:12.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.939+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:106 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.940+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 26 ==== osd_op_reply(106 gc.2 [call] v31'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.940+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:107 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.940+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 27 ==== osd_op_reply(107 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.943 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.940+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.940+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:108 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f67e30 con 0x562e38f250b0 2024-09-21T09:06:12.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.941+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 28 ==== osd_op_reply(108 gc.2 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.941+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:109 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.941+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 29 ==== osd_op_reply(109 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.941+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.941+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:110 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.941+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 30 ==== osd_op_reply(110 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.941+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.944 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.941+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:111 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.942+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 31 ==== osd_op_reply(111 gc.2 [call] v31'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.942+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-21T09:06:12.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.942+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:112 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.943+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 34 ==== osd_op_reply(112 gc.3 [call] v31'278 uv278 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.943+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:113 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.943+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 35 ==== osd_op_reply(113 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.943+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.943+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:114 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f67e30 con 0x562e38f1bc10 2024-09-21T09:06:12.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.943+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 36 ==== osd_op_reply(114 gc.3 [call out=24b] v0'0 uv278 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.946 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.943+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:115 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.944+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 37 ==== osd_op_reply(115 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.944+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.944+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:116 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.944+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 38 ==== osd_op_reply(116 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.944+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.947 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.944+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:117 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.945+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 39 ==== osd_op_reply(117 gc.3 [call] v31'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x562e38f1bc10 2024-09-21T09:06:12.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.945+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-21T09:06:12.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.945+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:118 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x7f4b1c06d040 2024-09-21T09:06:12.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.946+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 19 ==== osd_op_reply(118 gc.4 [call] v31'87 uv87 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.946+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:119 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x7f4b1c06d040 2024-09-21T09:06:12.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.946+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 20 ==== osd_op_reply(119 gc.4 [call out=15b] v0'0 uv87 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.946+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.946+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:120 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f67e30 con 0x7f4b1c06d040 2024-09-21T09:06:12.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.946+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 21 ==== osd_op_reply(120 gc.4 [call out=24b] v0'0 uv87 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.946+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:121 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x7f4b1c06d040 2024-09-21T09:06:12.949 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.947+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 22 ==== osd_op_reply(121 gc.4 [call out=15b] v0'0 uv87 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.947+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.947+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:122 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x7f4b1c06d040 2024-09-21T09:06:12.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.947+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 23 ==== osd_op_reply(122 gc.4 [call out=15b] v0'0 uv87 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.947+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.950 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.947+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:123 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x7f4b1c06d040 2024-09-21T09:06:12.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.948+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 24 ==== osd_op_reply(123 gc.4 [call] v31'88 uv88 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1403f040 con 0x7f4b1c06d040 2024-09-21T09:06:12.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.948+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-21T09:06:12.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.948+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:124 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.949+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 32 ==== osd_op_reply(124 gc.5 [call] v31'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.949+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:125 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.949+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 33 ==== osd_op_reply(125 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.949+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.949+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:126 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f67e30 con 0x562e38f250b0 2024-09-21T09:06:12.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.949+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 34 ==== osd_op_reply(126 gc.5 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.949+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:127 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.952 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.949+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 35 ==== osd_op_reply(127 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.949+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.949+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:128 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.950+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 36 ==== osd_op_reply(128 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.950+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.950+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:129 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.950+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 37 ==== osd_op_reply(129 gc.5 [call] v31'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.950+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-21T09:06:12.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.951+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:130 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.952+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 40 ==== osd_op_reply(130 gc.6 [call] v31'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.952+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:131 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.952+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 41 ==== osd_op_reply(131 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.952+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.952+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:132 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f67e30 con 0x562e38f1bc10 2024-09-21T09:06:12.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.952+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 42 ==== osd_op_reply(132 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.955 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.952+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:133 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.952+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 43 ==== osd_op_reply(133 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.952+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.952+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:134 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.953+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 44 ==== osd_op_reply(134 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.953+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.956 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.953+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:135 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f1bc10 2024-09-21T09:06:12.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.954+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 45 ==== osd_op_reply(135 gc.6 [call] v31'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.954+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-21T09:06:12.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.954+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:136 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f20600 2024-09-21T09:06:12.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.955+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 30 ==== osd_op_reply(136 gc.7 [call] v31'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.955+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:137 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f20600 2024-09-21T09:06:12.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.955+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 31 ==== osd_op_reply(137 gc.7 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.955+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.955+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:138 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f67e30 con 0x562e38f20600 2024-09-21T09:06:12.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.955+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 32 ==== osd_op_reply(138 gc.7 [call out=24b] v0'0 uv58 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.955+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:139 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f20600 2024-09-21T09:06:12.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.956+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 33 ==== osd_op_reply(139 gc.7 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.956+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.956+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:140 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f20600 2024-09-21T09:06:12.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.956+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 34 ==== osd_op_reply(140 gc.7 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.959 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.956+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.956+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:141 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f20600 2024-09-21T09:06:12.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.957+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 35 ==== osd_op_reply(141 gc.7 [call] v31'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.957+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-21T09:06:12.960 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.957+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:142 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x7f4b1c06d040 2024-09-21T09:06:12.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.958+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 25 ==== osd_op_reply(142 gc.8 [call] v31'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.958+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:143 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x7f4b1c06d040 2024-09-21T09:06:12.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.959+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 26 ==== osd_op_reply(143 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.959+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.961 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.959+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:144 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f67e30 con 0x7f4b1c06d040 2024-09-21T09:06:12.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.959+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 27 ==== osd_op_reply(144 gc.8 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.959+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:145 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x7f4b1c06d040 2024-09-21T09:06:12.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.959+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 28 ==== osd_op_reply(145 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.959+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.959+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:146 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x7f4b1c06d040 2024-09-21T09:06:12.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.959+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 29 ==== osd_op_reply(146 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.959+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.962 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.959+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:147 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x7f4b1c06d040 2024-09-21T09:06:12.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.960+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 30 ==== osd_op_reply(147 gc.8 [call] v31'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.960+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-21T09:06:12.963 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.960+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:148 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.962+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 38 ==== osd_op_reply(148 gc.9 [call] v31'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.962+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:149 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.962+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 39 ==== osd_op_reply(149 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.962+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.962+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:150 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f67e30 con 0x562e38f250b0 2024-09-21T09:06:12.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.962+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 40 ==== osd_op_reply(150 gc.9 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.962+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:151 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.962+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 41 ==== osd_op_reply(151 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.962+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.962+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:152 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.963+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 42 ==== osd_op_reply(152 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.963+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.965 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.963+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:153 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x562e38f250b0 2024-09-21T09:06:12.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.963+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 43 ==== osd_op_reply(153 gc.9 [call] v31'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.963+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-21T09:06:12.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.963+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:154 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x7f4b1c06d040 2024-09-21T09:06:12.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.964+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 31 ==== osd_op_reply(154 gc.10 [call] v31'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.964+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:155 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x7f4b1c06d040 2024-09-21T09:06:12.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 32 ==== osd_op_reply(155 gc.10 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:156 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f67e30 con 0x7f4b1c06d040 2024-09-21T09:06:12.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 33 ==== osd_op_reply(156 gc.10 [call out=24b] v0'0 uv89 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:157 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x7f4b1c06d040 2024-09-21T09:06:12.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 34 ==== osd_op_reply(157 gc.10 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:158 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f68e40 con 0x7f4b1c06d040 2024-09-21T09:06:12.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 35 ==== osd_op_reply(158 gc.10 [call out=1716b] v0'0 uv89 ondisk = 0) ==== 149+0+1716 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-21T09:06:12.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process iterating over entry tag='5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.13912154730310085038', time=2024-09-21T09:06:21.047441+0000, chain.objs.size()=7 2024-09-21T09:06:12.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_1 2024-09-21T09:06:12.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:159 3.25 3:a44d29dc:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f67140 con 0x562e38f1bc10 2024-09-21T09:06:12.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_2 2024-09-21T09:06:12.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:160 3.3c 3:3decefb0:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f6bfb0 con 0x7f4b1c06d040 2024-09-21T09:06:12.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_3 2024-09-21T09:06:12.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:161 3.19 3:9a7ef355:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f6e820 con 0x562e38f1bc10 2024-09-21T09:06:12.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_4 2024-09-21T09:06:12.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:162 3.28 3:1779cddd:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f71090 con 0x562e38f250b0 2024-09-21T09:06:12.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_5 2024-09-21T09:06:12.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:163 3.1f 3:fa44790d:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f73900 con 0x562e38f1bc10 2024-09-21T09:06:12.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.965+0000 7f4b2dbaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_6 2024-09-21T09:06:12.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.966+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:164 3.2b 3:d548fd53:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f76170 con 0x562e38f1bc10 2024-09-21T09:06:12.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.966+0000 7f4b2dbaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_7 2024-09-21T09:06:12.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.966+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:165 3.2f 3:f644b5f2:::5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f789e0 con 0x562e38f250b0 2024-09-21T09:06:12.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.968+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 44 ==== osd_op_reply(162 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_4 [call] v31'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.968+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 45 ==== osd_op_reply(165 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_7 [call] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.968+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 46 ==== osd_op_reply(163 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_5 [call] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.969+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 47 ==== osd_op_reply(164 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_6 [call] v31'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.969+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 48 ==== osd_op_reply(161 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_3 [call] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.969+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 49 ==== osd_op_reply(159 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_1 [call] v31'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.969+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 36 ==== osd_op_reply(160 5ba9a3a0-b0a1-459c-a1a0-62675c0cf1ee.4231.11__shadow_.8Swa8wkK-LRxNzHPnPF9S6vXIZOPPKE_2 [call] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.969+0000 7f4b2dbaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-21T09:06:12.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.969+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:166 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66b30 con 0x7f4b1c06d040 2024-09-21T09:06:12.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.970+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 37 ==== osd_op_reply(166 gc.10 [call] v31'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.970+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:167 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66b30 con 0x7f4b1c06d040 2024-09-21T09:06:12.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.971+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 38 ==== osd_op_reply(167 gc.10 [call] v31'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.971+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-21T09:06:12.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.971+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:168 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66b30 con 0x562e38f20600 2024-09-21T09:06:12.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.972+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 36 ==== osd_op_reply(168 gc.11 [call] v31'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.972+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:169 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66b30 con 0x562e38f20600 2024-09-21T09:06:12.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.972+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 37 ==== osd_op_reply(169 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.972+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.972+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:170 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f6fb80 con 0x562e38f20600 2024-09-21T09:06:12.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.973+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 38 ==== osd_op_reply(170 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.973+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:171 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66b30 con 0x562e38f20600 2024-09-21T09:06:12.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.973+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 39 ==== osd_op_reply(171 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.973+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.973+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:172 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66b30 con 0x562e38f20600 2024-09-21T09:06:12.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.973+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 40 ==== osd_op_reply(172 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.973+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.976 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.973+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:173 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:12.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.975+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 41 ==== osd_op_reply(173 gc.11 [call] v31'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.975+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-21T09:06:12.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.975+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:174 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:12.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.976+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 39 ==== osd_op_reply(174 gc.12 [call] v31'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.976+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:175 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:12.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.976+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 40 ==== osd_op_reply(175 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.976+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.976+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:176 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f6fb80 con 0x7f4b1c06d040 2024-09-21T09:06:12.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.976+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 41 ==== osd_op_reply(176 gc.12 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.976+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:177 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:12.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.976+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 42 ==== osd_op_reply(177 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.976+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.976+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:178 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:12.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.977+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 43 ==== osd_op_reply(178 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.977+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.977+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:179 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:12.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.977+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 44 ==== osd_op_reply(179 gc.12 [call] v31'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.977+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-21T09:06:12.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.977+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:180 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:12.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.979+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 42 ==== osd_op_reply(180 gc.13 [call] v31'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.979+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:181 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:12.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.979+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 43 ==== osd_op_reply(181 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.979+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.979+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:182 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f6fb80 con 0x562e38f20600 2024-09-21T09:06:12.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.979+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 44 ==== osd_op_reply(182 gc.13 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.979+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:183 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:12.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.980+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 45 ==== osd_op_reply(183 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.980+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.980+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:184 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:12.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.980+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 46 ==== osd_op_reply(184 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.980+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.980+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:185 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:12.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.982+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 47 ==== osd_op_reply(185 gc.13 [call] v31'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:12.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.982+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-21T09:06:12.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.982+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:186 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:12.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.983+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 50 ==== osd_op_reply(186 gc.14 [call] v31'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.983+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:187 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:12.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.983+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 51 ==== osd_op_reply(187 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.983+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.983+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:188 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f6fb80 con 0x562e38f1bc10 2024-09-21T09:06:12.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.983+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 52 ==== osd_op_reply(188 gc.14 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.983+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:189 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:12.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.983+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 53 ==== osd_op_reply(189 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.983+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.983+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:190 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:12.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.983+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 54 ==== osd_op_reply(190 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.984+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.986 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.984+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:191 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:12.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.984+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 55 ==== osd_op_reply(191 gc.14 [call] v31'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:12.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.984+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-21T09:06:12.987 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.984+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:192 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:12.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.986+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 46 ==== osd_op_reply(192 gc.15 [call] v31'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.986+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:193 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:12.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.986+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 47 ==== osd_op_reply(193 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.986+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.986+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:194 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:12.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.986+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 48 ==== osd_op_reply(194 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.986+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:195 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:12.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.987+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 49 ==== osd_op_reply(195 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.987+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.987+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:196 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:12.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.987+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 50 ==== osd_op_reply(196 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.987+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.987+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:197 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:12.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.988+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 51 ==== osd_op_reply(197 gc.15 [call] v31'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.993 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.988+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-21T09:06:12.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.988+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:198 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:12.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.989+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 45 ==== osd_op_reply(198 gc.16 [call] v31'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.989+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:199 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:12.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.989+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 46 ==== osd_op_reply(199 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.989+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.989+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:200 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:12.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.989+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 47 ==== osd_op_reply(200 gc.16 [call out=24b] v0'0 uv92 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.989+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:201 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:12.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.990+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 48 ==== osd_op_reply(201 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.990+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:12.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.990+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:202 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:12.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.990+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 49 ==== osd_op_reply(202 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.990+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.990+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:203 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:12.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.991+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 50 ==== osd_op_reply(203 gc.16 [call] v31'93 uv93 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:12.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.991+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-21T09:06:12.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.991+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:204 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:12.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.992+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 52 ==== osd_op_reply(204 gc.17 [call] v31'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.992+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:205 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:12.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.992+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 53 ==== osd_op_reply(205 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:12.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.992+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:12.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.992+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:206 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.992+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 54 ==== osd_op_reply(206 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.992+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:207 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.992+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 55 ==== osd_op_reply(207 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.992+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.992+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:208 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.993+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 56 ==== osd_op_reply(208 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.993+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.993+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:209 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.993+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 57 ==== osd_op_reply(209 gc.17 [call] v31'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.993+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-21T09:06:13.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.993+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:210 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:13.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.995+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 56 ==== osd_op_reply(210 gc.18 [call] v31'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.995+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:211 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:13.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.995+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 57 ==== osd_op_reply(211 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.995+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.995+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:212 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:13.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.995+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 58 ==== osd_op_reply(212 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.995+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:213 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:13.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.995+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 59 ==== osd_op_reply(213 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.995+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.995+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:214 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:13.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.996+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 60 ==== osd_op_reply(214 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.996+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.996+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:215 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:13.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.997+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 61 ==== osd_op_reply(215 gc.18 [call] v31'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.997+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-21T09:06:13.003 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.997+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:216 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:13.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.998+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 62 ==== osd_op_reply(216 gc.19 [call] v31'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.012 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.998+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:217 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:13.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.998+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 63 ==== osd_op_reply(217 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.998+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.998+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:218 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:13.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.998+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 64 ==== osd_op_reply(218 gc.19 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.998+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:219 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:13.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.998+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 65 ==== osd_op_reply(219 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.998+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.998+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:220 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:13.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.999+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 66 ==== osd_op_reply(220 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.999+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.999+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:221 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f1bc10 2024-09-21T09:06:13.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:12.999+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 67 ==== osd_op_reply(221 gc.19 [call] v31'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.000+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-21T09:06:13.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.000+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:222 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.001+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 58 ==== osd_op_reply(222 gc.20 [call] v31'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.001+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:223 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.001+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 59 ==== osd_op_reply(223 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.001+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.001+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:224 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.001+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 60 ==== osd_op_reply(224 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.001+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:225 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.001+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 61 ==== osd_op_reply(225 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.001+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.001+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:226 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.002+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 62 ==== osd_op_reply(226 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.002+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.002+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:227 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.003+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 63 ==== osd_op_reply(227 gc.20 [call] v31'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.003+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-21T09:06:13.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.003+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:228 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:13.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.004+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 51 ==== osd_op_reply(228 gc.21 [call] v31'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:13.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.004+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:229 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:13.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.004+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 52 ==== osd_op_reply(229 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:13.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.004+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.004+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:230 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:13.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.004+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 53 ==== osd_op_reply(230 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:13.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.004+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:231 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:13.015 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.004+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 54 ==== osd_op_reply(231 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:13.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.004+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.004+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:232 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:13.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.005+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 55 ==== osd_op_reply(232 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:13.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.005+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.005+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:233 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:13.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.006+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 56 ==== osd_op_reply(233 gc.21 [call] v31'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:13.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.006+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-21T09:06:13.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.006+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:234 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.007+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 64 ==== osd_op_reply(234 gc.22 [call] v31'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.007+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:235 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.007+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 65 ==== osd_op_reply(235 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.007+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.007+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:236 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.016 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.007+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 66 ==== osd_op_reply(236 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.007+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:237 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.007+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 67 ==== osd_op_reply(237 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.007+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.007+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:238 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.008+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 68 ==== osd_op_reply(238 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.008+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.008+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:239 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.009+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 69 ==== osd_op_reply(239 gc.22 [call] v31'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.009+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-21T09:06:13.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.009+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:240 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.009+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 70 ==== osd_op_reply(240 gc.23 [call] v31'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.017 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.009+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:241 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.010+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 71 ==== osd_op_reply(241 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.010+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.010+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:242 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.010+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 72 ==== osd_op_reply(242 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.010+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:243 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.010+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 73 ==== osd_op_reply(243 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.010+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.010+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:244 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.010+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 74 ==== osd_op_reply(244 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.010+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.018 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.010+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:245 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.011+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 75 ==== osd_op_reply(245 gc.23 [call] v31'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.022 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.011+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-21T09:06:13.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.011+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:246 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.012+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 76 ==== osd_op_reply(246 gc.24 [call] v31'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.012+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:247 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.012+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 77 ==== osd_op_reply(247 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.012+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.012+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:248 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.013+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 78 ==== osd_op_reply(248 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.013+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:249 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.013+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 79 ==== osd_op_reply(249 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.013+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.013+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:250 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.013+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 80 ==== osd_op_reply(250 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.023 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.013+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.013+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:251 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.014+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 81 ==== osd_op_reply(251 gc.24 [call] v31'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.014+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-21T09:06:13.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.014+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:252 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.015+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 82 ==== osd_op_reply(252 gc.25 [call] v31'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.015+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:253 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.015+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 83 ==== osd_op_reply(253 gc.25 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.015+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.015+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:254 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.015+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 84 ==== osd_op_reply(254 gc.25 [call out=24b] v0'0 uv61 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.015+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:255 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.016+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 85 ==== osd_op_reply(255 gc.25 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.024 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.016+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.016+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:256 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.016+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 86 ==== osd_op_reply(256 gc.25 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.016+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.016+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:257 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.017+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 87 ==== osd_op_reply(257 gc.25 [call] v31'62 uv62 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.017+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-21T09:06:13.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.017+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:258 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.018+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 48 ==== osd_op_reply(258 gc.26 [call] v31'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.018+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:259 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.019+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 49 ==== osd_op_reply(259 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.019+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.019+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:260 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.019+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 50 ==== osd_op_reply(260 gc.26 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.019+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:261 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.019+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 51 ==== osd_op_reply(261 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.019+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.019+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:262 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.019+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 52 ==== osd_op_reply(262 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.019+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.019+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:263 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.020+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 53 ==== osd_op_reply(263 gc.26 [call] v31'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.020+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-21T09:06:13.026 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.020+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:264 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.021+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 88 ==== osd_op_reply(264 gc.27 [call] v31'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.021+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:265 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.021+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 89 ==== osd_op_reply(265 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.021+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.021+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:266 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.022+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 90 ==== osd_op_reply(266 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.022+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:267 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.022+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 91 ==== osd_op_reply(267 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.022+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.022+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:268 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.022+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 92 ==== osd_op_reply(268 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.022+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.022+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:269 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.023+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 93 ==== osd_op_reply(269 gc.27 [call] v31'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.023+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-21T09:06:13.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.023+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:270 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.024+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 54 ==== osd_op_reply(270 gc.28 [call] v31'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.024+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:271 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.025+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 55 ==== osd_op_reply(271 gc.28 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.025+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.025+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:272 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f6fb80 con 0x562e38f20600 2024-09-21T09:06:13.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.025+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 56 ==== osd_op_reply(272 gc.28 [call out=24b] v0'0 uv60 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.025+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:273 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.025+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 57 ==== osd_op_reply(273 gc.28 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.025+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.025+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:274 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.026+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 58 ==== osd_op_reply(274 gc.28 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.026+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.026+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:275 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.027+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 59 ==== osd_op_reply(275 gc.28 [call] v31'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.027+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-21T09:06:13.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.027+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:276 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.028+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 94 ==== osd_op_reply(276 gc.29 [call] v31'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.028+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:277 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.028+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 95 ==== osd_op_reply(277 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.028+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.028+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:278 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.028+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 96 ==== osd_op_reply(278 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.028+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:279 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.029+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 97 ==== osd_op_reply(279 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.029+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.029+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:280 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.029+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 98 ==== osd_op_reply(280 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.029+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.029+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:281 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f250b0 2024-09-21T09:06:13.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.030+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 99 ==== osd_op_reply(281 gc.29 [call] v31'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.030+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-21T09:06:13.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.030+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:282 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.031+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 60 ==== osd_op_reply(282 gc.30 [call] v31'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.031+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:283 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.031+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 61 ==== osd_op_reply(283 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.031+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.031+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:284 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.032+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 62 ==== osd_op_reply(284 gc.30 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.032+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:285 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.032+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 63 ==== osd_op_reply(285 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.032+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.032+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:286 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.032+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 64 ==== osd_op_reply(286 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.032+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.032+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:287 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x562e38f20600 2024-09-21T09:06:13.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.033+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 65 ==== osd_op_reply(287 gc.30 [call] v31'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.033+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-21T09:06:13.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.033+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:288 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:13.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.035+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 57 ==== osd_op_reply(288 gc.31 [call] v31'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:13.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.035+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:289 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:13.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.035+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 58 ==== osd_op_reply(289 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:13.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.035+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.035+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:290 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f6fb80 con 0x7f4b1c06d040 2024-09-21T09:06:13.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.035+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 59 ==== osd_op_reply(290 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:13.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.035+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:291 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:13.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.035+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 60 ==== osd_op_reply(291 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:13.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.035+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T09:06:13.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.035+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:292 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:13.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.035+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 61 ==== osd_op_reply(292 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:13.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.035+0000 7f4b2dbaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T09:06:13.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.036+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:293 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66ae0 con 0x7f4b1c06d040 2024-09-21T09:06:13.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.037+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 62 ==== osd_op_reply(293 gc.31 [call] v31'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:13.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.037+0000 7f49e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T09:06:13.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.037+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94756523931552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f66360 con 0x562e38f1bc10 2024-09-21T09:06:13.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.038+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 68 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94756523931552] v31'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.038+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94756523908592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2f7a0 con 0x7f4b1c06d040 2024-09-21T09:06:13.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.039+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94756523908592] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:13.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.039+0000 7f4b2dbaf800 20 remove_watcher() i=0 2024-09-21T09:06:13.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.039+0000 7f4b2dbaf800 2 removed watcher, disabling cache 2024-09-21T09:06:13.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.039+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94756523912672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2f7a0 con 0x562e38f1bc10 2024-09-21T09:06:13.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.041+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 69 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94756523912672] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.041+0000 7f4b2dbaf800 20 remove_watcher() i=1 2024-09-21T09:06:13.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.041+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94756523915344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2ade0 con 0x562e38f250b0 2024-09-21T09:06:13.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.042+0000 7f4b2b6a3640 1 -- 172.21.15.178:0/2282035329 <== osd.3 v2:172.21.15.178:6808/24558189 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94756523915344] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1c056b20 con 0x562e38f250b0 2024-09-21T09:06:13.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.042+0000 7f4b2dbaf800 20 remove_watcher() i=2 2024-09-21T09:06:13.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.042+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94756523920096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2f7a0 con 0x7f4b1c06d040 2024-09-21T09:06:13.044 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.043+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.2 v2:172.21.15.178:6816/3267136144 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94756523920096] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x7f4b1c06d040 2024-09-21T09:06:13.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.043+0000 7f4b2dbaf800 20 remove_watcher() i=3 2024-09-21T09:06:13.045 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.043+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94756523917472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2b850 con 0x562e38f1bc10 2024-09-21T09:06:13.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.044+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 <== osd.1 v2:172.21.15.178:6800/627496675 70 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94756523917472] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1404c040 con 0x562e38f1bc10 2024-09-21T09:06:13.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.044+0000 7f4b2dbaf800 20 remove_watcher() i=4 2024-09-21T09:06:13.046 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.044+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94756523922784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2ade0 con 0x562e38f20600 2024-09-21T09:06:13.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.045+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 66 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94756523922784] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.045+0000 7f4b2dbaf800 20 remove_watcher() i=5 2024-09-21T09:06:13.047 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.045+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94756523927984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2f7a0 con 0x562e38f20600 2024-09-21T09:06:13.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.046+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 67 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94756523927984] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.046+0000 7f4b2dbaf800 20 remove_watcher() i=6 2024-09-21T09:06:13.048 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.046+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94756523930080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562e38f2b850 con 0x562e38f20600 2024-09-21T09:06:13.051 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.047+0000 7f4b2bea4640 1 -- 172.21.15.178:0/2282035329 <== osd.0 v2:172.21.15.44:6800/2732047064 68 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94756523930080] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b24068040 con 0x562e38f20600 2024-09-21T09:06:13.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.047+0000 7f4b2dbaf800 20 remove_watcher() i=7 2024-09-21T09:06:13.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.047+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562e38f20600 msgr2=0x562e38f229f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.047+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562e38f20600 0x562e38f229f0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.047+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562e38f1bc10 msgr2=0x562e38f1e0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.047+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562e38f1bc10 0x562e38f1e0d0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.047+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f4b1c06d040 msgr2=0x7f4b1c091910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.047+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7f4b1c06d040 0x7f4b1c091910 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.047+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562e38f250b0 msgr2=0x562e38f27570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.047+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x562e38f250b0 0x562e38f27570 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f49f4036b40 msgr2=0x7f49f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f49f4036b40 0x7f49f4039000 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c04ec10 tx=0x7f4b1c092000 comp rx=0 tx=0).stop 2024-09-21T09:06:13.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38f08d10 msgr2=0x562e38f10060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38f08d10 0x562e38f10060 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4b24048010 tx=0x7f4b2404ce80 comp rx=0 tx=0).stop 2024-09-21T09:06:13.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2aea2640 1 -- 172.21.15.178:0/2282035329 reap_dead start 2024-09-21T09:06:13.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 shutdown_connections 2024-09-21T09:06:13.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2282035329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38f08d10 0x562e38f10060 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 >> 172.21.15.178:0/2282035329 conn(0x562e38f05070 msgr2=0x562e38f03140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:13.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 shutdown_connections 2024-09-21T09:06:13.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2282035329 wait complete. 2024-09-21T09:06:13.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/124923250 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4a04036b90 msgr2=0x7f4a04039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/124923250 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4a04036b90 0x7f4a04039050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x562e38ee8d80 tx=0x7f4b1c07f910 comp rx=0 tx=0).stop 2024-09-21T09:06:13.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/124923250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38efc0c0 msgr2=0x562e38efc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/124923250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38efc0c0 0x562e38efc4e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x562e38ee2510 tx=0x7f4b2400aec0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/124923250 shutdown_connections 2024-09-21T09:06:13.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/124923250 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4a04036b90 0x7f4a04039050 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/124923250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38efc0c0 0x562e38efc4e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/124923250 >> 172.21.15.178:0/124923250 conn(0x562e38ef1050 msgr2=0x562e38ef3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:13.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/124923250 shutdown_connections 2024-09-21T09:06:13.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/124923250 wait complete. 2024-09-21T09:06:13.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562e38eeac10 msgr2=0x562e38eed000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562e38eeac10 0x562e38eed000 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562e38dedbb0 msgr2=0x562e38ee8360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.048+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562e38dedbb0 0x562e38ee8360 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.049+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4a10036b40 msgr2=0x7f4a10039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.049+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4a10036b40 0x7f4a10039000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4b14000f60 tx=0x7f4b14001370 comp rx=0 tx=0).stop 2024-09-21T09:06:13.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.049+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 msgr2=0x562e38ee12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.049+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ee12f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00a4b0 tx=0x7f4b1c003330 comp rx=0 tx=0).stop 2024-09-21T09:06:13.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.049+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 shutdown_connections 2024-09-21T09:06:13.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.049+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x562e38eeac10 0x562e38eed000 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.049+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x562e38dedbb0 0x562e38ee8360 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.049+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f4a10036b40 0x7f4a10039000 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.049+0000 7f4b2dbaf800 1 --2- 172.21.15.178:0/2180944542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e38d5c610 0x562e38ee12f0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.049+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 >> 172.21.15.178:0/2180944542 conn(0x562e38de2de0 msgr2=0x562e38ed3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:13.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.049+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 shutdown_connections 2024-09-21T09:06:13.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T09:06:13.049+0000 7f4b2dbaf800 1 -- 172.21.15.178:0/2180944542 wait complete. 2024-09-21T09:06:13.059 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T09:06:13.073 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T09:06:13.073 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:06:13.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.178+0000 7f2f9e8dd640 1 Processor -- start 2024-09-21T09:06:13.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.178+0000 7f2f9e8dd640 1 -- start start 2024-09-21T09:06:13.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.178+0000 7f2f9e8dd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f9812cca0 0x7f2f9812d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:13.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.178+0000 7f2f9e8dd640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9812d5c0 con 0x7f2f981290e0 2024-09-21T09:06:13.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.178+0000 7f2f9e8dd640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f2f9806e350 con 0x7f2f9812cca0 2024-09-21T09:06:13.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.178+0000 7f2f97fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f9812cca0 0x7f2f9812d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:13.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.178+0000 7f2f977fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2f981290e0 0x7f2f98129530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58250/0 (socket says 172.21.15.44:58250) 2024-09-21T09:06:13.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.178+0000 7f2f977fe640 1 -- 172.21.15.44:0/1692110395 learned_addr learned my addr 172.21.15.44:0/1692110395 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:13.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.179+0000 7f2f97fff640 1 -- 172.21.15.44:0/1692110395 >> v1:172.21.15.44:6789/0 conn(0x7f2f981290e0 legacy=0x7f2f98129530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.179+0000 7f2f97fff640 1 -- 172.21.15.44:0/1692110395 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f98071f70 con 0x7f2f9812cca0 2024-09-21T09:06:13.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.179+0000 7f2f97fff640 1 --2- 172.21.15.44:0/1692110395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f9812cca0 0x7f2f9812d080 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009720 tx=0x7f2f8802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db4625aa47ac87e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:13.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.179+0000 7f2f96ffd640 1 -- 172.21.15.44:0/1692110395 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f88037070 con 0x7f2f9812cca0 2024-09-21T09:06:13.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.179+0000 7f2f96ffd640 1 -- 172.21.15.44:0/1692110395 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f8802ad90 con 0x7f2f9812cca0 2024-09-21T09:06:13.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.179+0000 7f2f96ffd640 1 -- 172.21.15.44:0/1692110395 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f88032590 con 0x7f2f9812cca0 2024-09-21T09:06:13.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.180+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1692110395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f9812cca0 msgr2=0x7f2f9812d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.180+0000 7f2f9e8dd640 1 --2- 172.21.15.44:0/1692110395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f9812cca0 0x7f2f9812d080 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009720 tx=0x7f2f8802a110 comp rx=0 tx=0).stop 2024-09-21T09:06:13.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.180+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1692110395 shutdown_connections 2024-09-21T09:06:13.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.180+0000 7f2f9e8dd640 1 --2- 172.21.15.44:0/1692110395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f9812cca0 0x7f2f9812d080 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.180+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1692110395 >> 172.21.15.44:0/1692110395 conn(0x7f2f9809a890 msgr2=0x7f2f9809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:13.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.180+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1692110395 shutdown_connections 2024-09-21T09:06:13.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.180+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1692110395 wait complete. 2024-09-21T09:06:13.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.181+0000 7f2f9e8dd640 1 Processor -- start 2024-09-21T09:06:13.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.181+0000 7f2f9e8dd640 1 -- start start 2024-09-21T09:06:13.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.181+0000 7f2f9e8dd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f981290e0 0x7f2f9808afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:13.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.181+0000 7f2f9e8dd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2f98070e60 con 0x7f2f981290e0 2024-09-21T09:06:13.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.182+0000 7f2f97fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f981290e0 0x7f2f9808afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:13.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.182+0000 7f2f97fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f981290e0 0x7f2f9808afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53032/0 (socket says 172.21.15.44:53032) 2024-09-21T09:06:13.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.182+0000 7f2f97fff640 1 -- 172.21.15.44:0/1486765853 learned_addr learned my addr 172.21.15.44:0/1486765853 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:13.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.182+0000 7f2f97fff640 1 -- 172.21.15.44:0/1486765853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9808c510 con 0x7f2f981290e0 2024-09-21T09:06:13.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.182+0000 7f2f97fff640 1 --2- 172.21.15.44:0/1486765853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f981290e0 0x7f2f9808afc0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2f8802a150 tx=0x7f2f880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:13.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.182+0000 7f2f94ff9640 1 -- 172.21.15.44:0/1486765853 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f88041020 con 0x7f2f981290e0 2024-09-21T09:06:13.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.182+0000 7f2f94ff9640 1 -- 172.21.15.44:0/1486765853 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f8803d550 con 0x7f2f981290e0 2024-09-21T09:06:13.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.182+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1486765853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f981267e0 con 0x7f2f981290e0 2024-09-21T09:06:13.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.182+0000 7f2f94ff9640 1 -- 172.21.15.44:0/1486765853 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f88037040 con 0x7f2f981290e0 2024-09-21T09:06:13.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.182+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1486765853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f9808d700 con 0x7f2f981290e0 2024-09-21T09:06:13.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.183+0000 7f2f94ff9640 1 -- 172.21.15.44:0/1486765853 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2f88044020 con 0x7f2f981290e0 2024-09-21T09:06:13.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.183+0000 7f2f94ff9640 1 --2- 172.21.15.44:0/1486765853 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f840382a0 0x7f2f8403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:13.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.183+0000 7f2f94ff9640 1 -- 172.21.15.44:0/1486765853 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f2f8806c4f0 con 0x7f2f981290e0 2024-09-21T09:06:13.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.183+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1486765853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9808d500 con 0x7f2f981290e0 2024-09-21T09:06:13.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.184+0000 7f2f977fe640 1 --2- 172.21.15.44:0/1486765853 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f840382a0 0x7f2f8403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:13.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.184+0000 7f2f977fe640 1 --2- 172.21.15.44:0/1486765853 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f840382a0 0x7f2f8403a760 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c007fd0 tx=0x7f2f8c007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:13.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.188+0000 7f2f94ff9640 1 -- 172.21.15.44:0/1486765853 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2f8804b030 con 0x7f2f981290e0 2024-09-21T09:06:13.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.360+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1486765853 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f98096e60 con 0x7f2f840382a0 2024-09-21T09:06:13.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.376+0000 7f2f94ff9640 1 -- 172.21.15.44:0/1486765853 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665585 (secure 0 0 0) 0x7f2f98096e60 con 0x7f2f840382a0 2024-09-21T09:06:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:06:13.391 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-21T09:06:13.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.381+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1486765853 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f840382a0 msgr2=0x7f2f8403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.381+0000 7f2f9e8dd640 1 --2- 172.21.15.44:0/1486765853 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f840382a0 0x7f2f8403a760 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c007fd0 tx=0x7f2f8c007ac0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.381+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1486765853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f981290e0 msgr2=0x7f2f9808afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.381+0000 7f2f9e8dd640 1 --2- 172.21.15.44:0/1486765853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f981290e0 0x7f2f9808afc0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2f8802a150 tx=0x7f2f880046c0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.381+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1486765853 shutdown_connections 2024-09-21T09:06:13.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.381+0000 7f2f9e8dd640 1 --2- 172.21.15.44:0/1486765853 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f2f840382a0 0x7f2f8403a760 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.381+0000 7f2f9e8dd640 1 --2- 172.21.15.44:0/1486765853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f981290e0 0x7f2f9808afc0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.381+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1486765853 >> 172.21.15.44:0/1486765853 conn(0x7f2f9809a890 msgr2=0x7f2f98128980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:13.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.381+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1486765853 shutdown_connections 2024-09-21T09:06:13.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.381+0000 7f2f9e8dd640 1 -- 172.21.15.44:0/1486765853 wait complete. 2024-09-21T09:06:13.395 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-21T09:06:12.483951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4881,"num_read_kb":4462,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190416,"kb_used_data":53200,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377296944,"statfs":{"total":386547056640,"available":386352070656,"internally_reserved":0,"allocated":54476800,"data_stored":53330918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":140437271},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003770"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.693474+0000","last_change":"2024-09-21T09:03:38.283847+0000","last_active":"2024-09-21T09:05:05.693474+0000","last_peered":"2024-09-21T09:05:05.693474+0000","last_clean":"2024-09-21T09:05:05.693474+0000","last_became_active":"2024-09-21T09:03:38.283357+0000","last_became_peered":"2024-09-21T09:03:38.283357+0000","last_unstale":"2024-09-21T09:05:05.693474+0000","last_undegraded":"2024-09-21T09:05:05.693474+0000","last_fullsized":"2024-09-21T09:05:05.693474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:01.386955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'20","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.299232+0000","last_change":"2024-09-21T09:03:00.226390+0000","last_active":"2024-09-21T09:06:06.299232+0000","last_peered":"2024-09-21T09:06:06.299232+0000","last_clean":"2024-09-21T09:06:06.299232+0000","last_became_active":"2024-09-21T09:03:00.226067+0000","last_became_peered":"2024-09-21T09:03:00.226067+0000","last_unstale":"2024-09-21T09:06:06.299232+0000","last_undegraded":"2024-09-21T09:06:06.299232+0000","last_fullsized":"2024-09-21T09:06:06.299232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:19.763600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465423+0000","last_change":"2024-09-21T09:02:58.213108+0000","last_active":"2024-09-21T09:03:38.465423+0000","last_peered":"2024-09-21T09:03:38.465423+0000","last_clean":"2024-09-21T09:03:38.465423+0000","last_became_active":"2024-09-21T09:02:58.212828+0000","last_became_peered":"2024-09-21T09:02:58.212828+0000","last_unstale":"2024-09-21T09:03:38.465423+0000","last_undegraded":"2024-09-21T09:03:38.465423+0000","last_fullsized":"2024-09-21T09:03:38.465423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:25.409736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298796+0000","last_change":"2024-09-21T09:03:00.222612+0000","last_active":"2024-09-21T09:06:06.298796+0000","last_peered":"2024-09-21T09:06:06.298796+0000","last_clean":"2024-09-21T09:06:06.298796+0000","last_became_active":"2024-09-21T09:03:00.222333+0000","last_became_peered":"2024-09-21T09:03:00.222333+0000","last_unstale":"2024-09-21T09:06:06.298796+0000","last_undegraded":"2024-09-21T09:06:06.298796+0000","last_fullsized":"2024-09-21T09:06:06.298796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:22.752060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278836+0000","last_change":"2024-09-21T09:02:58.221389+0000","last_active":"2024-09-21T09:03:38.278836+0000","last_peered":"2024-09-21T09:03:38.278836+0000","last_clean":"2024-09-21T09:03:38.278836+0000","last_became_active":"2024-09-21T09:02:58.221214+0000","last_became_peered":"2024-09-21T09:02:58.221214+0000","last_unstale":"2024-09-21T09:03:38.278836+0000","last_undegraded":"2024-09-21T09:03:38.278836+0000","last_fullsized":"2024-09-21T09:03:38.278836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:59.331305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173989+0000","last_change":"2024-09-21T09:03:00.221728+0000","last_active":"2024-09-21T09:06:06.173989+0000","last_peered":"2024-09-21T09:06:06.173989+0000","last_clean":"2024-09-21T09:06:06.173989+0000","last_became_active":"2024-09-21T09:03:00.221451+0000","last_became_peered":"2024-09-21T09:03:00.221451+0000","last_unstale":"2024-09-21T09:06:06.173989+0000","last_undegraded":"2024-09-21T09:06:06.173989+0000","last_fullsized":"2024-09-21T09:06:06.173989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:36.553233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:57.452905+0000","last_change":"2024-09-21T09:02:58.208725+0000","last_active":"2024-09-21T09:04:57.452905+0000","last_peered":"2024-09-21T09:04:57.452905+0000","last_clean":"2024-09-21T09:04:57.452905+0000","last_became_active":"2024-09-21T09:02:58.207683+0000","last_became_peered":"2024-09-21T09:02:58.207683+0000","last_unstale":"2024-09-21T09:04:57.452905+0000","last_undegraded":"2024-09-21T09:04:57.452905+0000","last_fullsized":"2024-09-21T09:04:57.452905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:12.355792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'9","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.267454+0000","last_change":"2024-09-21T09:03:00.212574+0000","last_active":"2024-09-21T09:06:06.267454+0000","last_peered":"2024-09-21T09:06:06.267454+0000","last_clean":"2024-09-21T09:06:06.267454+0000","last_became_active":"2024-09-21T09:03:00.210589+0000","last_became_peered":"2024-09-21T09:03:00.210589+0000","last_unstale":"2024-09-21T09:06:06.267454+0000","last_undegraded":"2024-09-21T09:06:06.267454+0000","last_fullsized":"2024-09-21T09:06:06.267454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:11.555715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.253856+0000","last_change":"2024-09-21T09:02:58.224906+0000","last_active":"2024-09-21T09:06:06.253856+0000","last_peered":"2024-09-21T09:06:06.253856+0000","last_clean":"2024-09-21T09:06:06.253856+0000","last_became_active":"2024-09-21T09:02:58.224630+0000","last_became_peered":"2024-09-21T09:02:58.224630+0000","last_unstale":"2024-09-21T09:06:06.253856+0000","last_undegraded":"2024-09-21T09:06:06.253856+0000","last_fullsized":"2024-09-21T09:06:06.253856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:24.376659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'6","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298997+0000","last_change":"2024-09-21T09:03:00.223960+0000","last_active":"2024-09-21T09:06:06.298997+0000","last_peered":"2024-09-21T09:06:06.298997+0000","last_clean":"2024-09-21T09:06:06.298997+0000","last_became_active":"2024-09-21T09:03:00.217048+0000","last_became_peered":"2024-09-21T09:03:00.217048+0000","last_unstale":"2024-09-21T09:06:06.298997+0000","last_undegraded":"2024-09-21T09:06:06.298997+0000","last_fullsized":"2024-09-21T09:06:06.298997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:50.802476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.626681+0000","last_change":"2024-09-21T09:02:58.205801+0000","last_active":"2024-09-21T09:05:05.626681+0000","last_peered":"2024-09-21T09:05:05.626681+0000","last_clean":"2024-09-21T09:05:05.626681+0000","last_became_active":"2024-09-21T09:02:58.205515+0000","last_became_peered":"2024-09-21T09:02:58.205515+0000","last_unstale":"2024-09-21T09:05:05.626681+0000","last_undegraded":"2024-09-21T09:05:05.626681+0000","last_fullsized":"2024-09-21T09:05:05.626681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:14.606085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'14","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363415+0000","last_change":"2024-09-21T09:03:00.222211+0000","last_active":"2024-09-21T09:06:06.363415+0000","last_peered":"2024-09-21T09:06:06.363415+0000","last_clean":"2024-09-21T09:06:06.363415+0000","last_became_active":"2024-09-21T09:03:00.221117+0000","last_became_peered":"2024-09-21T09:03:00.221117+0000","last_unstale":"2024-09-21T09:06:06.363415+0000","last_undegraded":"2024-09-21T09:06:06.363415+0000","last_fullsized":"2024-09-21T09:06:06.363415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:45.284408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.248708+0000","last_change":"2024-09-21T09:02:58.211066+0000","last_active":"2024-09-21T09:06:06.248708+0000","last_peered":"2024-09-21T09:06:06.248708+0000","last_clean":"2024-09-21T09:06:06.248708+0000","last_became_active":"2024-09-21T09:02:58.210702+0000","last_became_peered":"2024-09-21T09:02:58.210702+0000","last_unstale":"2024-09-21T09:06:06.248708+0000","last_undegraded":"2024-09-21T09:06:06.248708+0000","last_fullsized":"2024-09-21T09:06:06.248708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:18.510636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'10","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363641+0000","last_change":"2024-09-21T09:03:00.221039+0000","last_active":"2024-09-21T09:06:06.363641+0000","last_peered":"2024-09-21T09:06:06.363641+0000","last_clean":"2024-09-21T09:06:06.363641+0000","last_became_active":"2024-09-21T09:03:00.220725+0000","last_became_peered":"2024-09-21T09:03:00.220725+0000","last_unstale":"2024-09-21T09:06:06.363641+0000","last_undegraded":"2024-09-21T09:06:06.363641+0000","last_fullsized":"2024-09-21T09:06:06.363641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:39.266159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.256624+0000","last_change":"2024-09-21T09:02:58.217016+0000","last_active":"2024-09-21T09:06:06.256624+0000","last_peered":"2024-09-21T09:06:06.256624+0000","last_clean":"2024-09-21T09:06:06.256624+0000","last_became_active":"2024-09-21T09:02:58.216712+0000","last_became_peered":"2024-09-21T09:02:58.216712+0000","last_unstale":"2024-09-21T09:06:06.256624+0000","last_undegraded":"2024-09-21T09:06:06.256624+0000","last_fullsized":"2024-09-21T09:06:06.256624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:52.024304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'14","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363418+0000","last_change":"2024-09-21T09:03:00.222904+0000","last_active":"2024-09-21T09:06:06.363418+0000","last_peered":"2024-09-21T09:06:06.363418+0000","last_clean":"2024-09-21T09:06:06.363418+0000","last_became_active":"2024-09-21T09:03:00.222593+0000","last_became_peered":"2024-09-21T09:03:00.222593+0000","last_unstale":"2024-09-21T09:06:06.363418+0000","last_undegraded":"2024-09-21T09:06:06.363418+0000","last_fullsized":"2024-09-21T09:06:06.363418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:47.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'11","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460587+0000","last_change":"2024-09-21T09:03:00.220191+0000","last_active":"2024-09-21T09:05:23.460587+0000","last_peered":"2024-09-21T09:05:23.460587+0000","last_clean":"2024-09-21T09:05:23.460587+0000","last_became_active":"2024-09-21T09:03:00.219923+0000","last_became_peered":"2024-09-21T09:03:00.219923+0000","last_unstale":"2024-09-21T09:05:23.460587+0000","last_undegraded":"2024-09-21T09:05:23.460587+0000","last_fullsized":"2024-09-21T09:05:23.460587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:09.508750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275945+0000","last_change":"2024-09-21T09:02:58.212942+0000","last_active":"2024-09-21T09:03:38.275945+0000","last_peered":"2024-09-21T09:03:38.275945+0000","last_clean":"2024-09-21T09:03:38.275945+0000","last_became_active":"2024-09-21T09:02:58.210936+0000","last_became_peered":"2024-09-21T09:02:58.210936+0000","last_unstale":"2024-09-21T09:03:38.275945+0000","last_undegraded":"2024-09-21T09:03:38.275945+0000","last_fullsized":"2024-09-21T09:03:38.275945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:08.728738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'8","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.072789+0000","last_change":"2024-09-21T09:03:00.225223+0000","last_active":"2024-09-21T09:04:22.072789+0000","last_peered":"2024-09-21T09:04:22.072789+0000","last_clean":"2024-09-21T09:04:22.072789+0000","last_became_active":"2024-09-21T09:03:00.224695+0000","last_became_peered":"2024-09-21T09:03:00.224695+0000","last_unstale":"2024-09-21T09:04:22.072789+0000","last_undegraded":"2024-09-21T09:04:22.072789+0000","last_fullsized":"2024-09-21T09:04:22.072789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:18.875227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.246956+0000","last_change":"2024-09-21T09:02:58.220090+0000","last_active":"2024-09-21T09:04:22.246956+0000","last_peered":"2024-09-21T09:04:22.246956+0000","last_clean":"2024-09-21T09:04:22.246956+0000","last_became_active":"2024-09-21T09:02:58.218643+0000","last_became_peered":"2024-09-21T09:02:58.218643+0000","last_unstale":"2024-09-21T09:04:22.246956+0000","last_undegraded":"2024-09-21T09:04:22.246956+0000","last_fullsized":"2024-09-21T09:04:22.246956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.813396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363139+0000","last_change":"2024-09-21T09:03:00.227634+0000","last_active":"2024-09-21T09:06:06.363139+0000","last_peered":"2024-09-21T09:06:06.363139+0000","last_clean":"2024-09-21T09:06:06.363139+0000","last_became_active":"2024-09-21T09:03:00.226738+0000","last_became_peered":"2024-09-21T09:03:00.226738+0000","last_unstale":"2024-09-21T09:06:06.363139+0000","last_undegraded":"2024-09-21T09:06:06.363139+0000","last_fullsized":"2024-09-21T09:06:06.363139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:24.661101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.043712+0000","last_change":"2024-09-21T09:02:58.208501+0000","last_active":"2024-09-21T09:06:06.043712+0000","last_peered":"2024-09-21T09:06:06.043712+0000","last_clean":"2024-09-21T09:06:06.043712+0000","last_became_active":"2024-09-21T09:02:58.208220+0000","last_became_peered":"2024-09-21T09:02:58.208220+0000","last_unstale":"2024-09-21T09:06:06.043712+0000","last_undegraded":"2024-09-21T09:06:06.043712+0000","last_fullsized":"2024-09-21T09:06:06.043712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:44.533015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'16","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260865+0000","last_change":"2024-09-21T09:03:00.216019+0000","last_active":"2024-09-21T09:06:06.260865+0000","last_peered":"2024-09-21T09:06:06.260865+0000","last_clean":"2024-09-21T09:06:06.260865+0000","last_became_active":"2024-09-21T09:03:00.215637+0000","last_became_peered":"2024-09-21T09:03:00.215637+0000","last_unstale":"2024-09-21T09:06:06.260865+0000","last_undegraded":"2024-09-21T09:06:06.260865+0000","last_fullsized":"2024-09-21T09:06:06.260865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.852495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275771+0000","last_change":"2024-09-21T09:02:58.206160+0000","last_active":"2024-09-21T09:03:38.275771+0000","last_peered":"2024-09-21T09:03:38.275771+0000","last_clean":"2024-09-21T09:03:38.275771+0000","last_became_active":"2024-09-21T09:02:58.204603+0000","last_became_peered":"2024-09-21T09:02:58.204603+0000","last_unstale":"2024-09-21T09:03:38.275771+0000","last_undegraded":"2024-09-21T09:03:38.275771+0000","last_fullsized":"2024-09-21T09:03:38.275771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:38.066496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.717096+0000","last_change":"2024-09-21T09:03:00.223258+0000","last_active":"2024-09-21T09:05:05.717096+0000","last_peered":"2024-09-21T09:05:05.717096+0000","last_clean":"2024-09-21T09:05:05.717096+0000","last_became_active":"2024-09-21T09:03:00.222972+0000","last_became_peered":"2024-09-21T09:03:00.222972+0000","last_unstale":"2024-09-21T09:05:05.717096+0000","last_undegraded":"2024-09-21T09:05:05.717096+0000","last_fullsized":"2024-09-21T09:05:05.717096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:32.562147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464762+0000","last_change":"2024-09-21T09:02:58.208852+0000","last_active":"2024-09-21T09:03:38.464762+0000","last_peered":"2024-09-21T09:03:38.464762+0000","last_clean":"2024-09-21T09:03:38.464762+0000","last_became_active":"2024-09-21T09:02:58.208383+0000","last_became_peered":"2024-09-21T09:02:58.208383+0000","last_unstale":"2024-09-21T09:03:38.464762+0000","last_undegraded":"2024-09-21T09:03:38.464762+0000","last_fullsized":"2024-09-21T09:03:38.464762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:07.674387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363227+0000","last_change":"2024-09-21T09:03:00.212288+0000","last_active":"2024-09-21T09:06:06.363227+0000","last_peered":"2024-09-21T09:06:06.363227+0000","last_clean":"2024-09-21T09:06:06.363227+0000","last_became_active":"2024-09-21T09:03:00.211942+0000","last_became_peered":"2024-09-21T09:03:00.211942+0000","last_unstale":"2024-09-21T09:06:06.363227+0000","last_undegraded":"2024-09-21T09:06:06.363227+0000","last_fullsized":"2024-09-21T09:06:06.363227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:53.039369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.753027+0000","last_change":"2024-09-21T09:02:58.214186+0000","last_active":"2024-09-21T09:03:38.753027+0000","last_peered":"2024-09-21T09:03:38.753027+0000","last_clean":"2024-09-21T09:03:38.753027+0000","last_became_active":"2024-09-21T09:02:58.213548+0000","last_became_peered":"2024-09-21T09:02:58.213548+0000","last_unstale":"2024-09-21T09:03:38.753027+0000","last_undegraded":"2024-09-21T09:03:38.753027+0000","last_fullsized":"2024-09-21T09:03:38.753027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:14.666195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.280442+0000","last_change":"2024-09-21T09:03:08.262655+0000","last_active":"2024-09-21T09:06:06.280442+0000","last_peered":"2024-09-21T09:06:06.280442+0000","last_clean":"2024-09-21T09:06:06.280442+0000","last_became_active":"2024-09-21T09:03:08.262362+0000","last_became_peered":"2024-09-21T09:03:08.262362+0000","last_unstale":"2024-09-21T09:06:06.280442+0000","last_undegraded":"2024-09-21T09:06:06.280442+0000","last_fullsized":"2024-09-21T09:06:06.280442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:23.685881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275829+0000","last_change":"2024-09-21T09:03:00.212668+0000","last_active":"2024-09-21T09:03:38.275829+0000","last_peered":"2024-09-21T09:03:38.275829+0000","last_clean":"2024-09-21T09:03:38.275829+0000","last_became_active":"2024-09-21T09:03:00.209346+0000","last_became_peered":"2024-09-21T09:03:00.209346+0000","last_unstale":"2024-09-21T09:03:38.275829+0000","last_undegraded":"2024-09-21T09:03:38.275829+0000","last_fullsized":"2024-09-21T09:03:38.275829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:35.918701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271768+0000","last_change":"2024-09-21T09:02:58.221478+0000","last_active":"2024-09-21T09:03:38.271768+0000","last_peered":"2024-09-21T09:03:38.271768+0000","last_clean":"2024-09-21T09:03:38.271768+0000","last_became_active":"2024-09-21T09:02:58.221187+0000","last_became_peered":"2024-09-21T09:02:58.221187+0000","last_unstale":"2024-09-21T09:03:38.271768+0000","last_undegraded":"2024-09-21T09:03:38.271768+0000","last_fullsized":"2024-09-21T09:03:38.271768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:43.391268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277937+0000","last_change":"2024-09-21T09:03:02.220660+0000","last_active":"2024-09-21T09:03:38.277937+0000","last_peered":"2024-09-21T09:03:38.277937+0000","last_clean":"2024-09-21T09:03:38.277937+0000","last_became_active":"2024-09-21T09:03:02.220370+0000","last_became_peered":"2024-09-21T09:03:02.220370+0000","last_unstale":"2024-09-21T09:03:38.277937+0000","last_undegraded":"2024-09-21T09:03:38.277937+0000","last_fullsized":"2024-09-21T09:03:38.277937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:00.166342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.351174+0000","last_change":"2024-09-21T09:03:04.243245+0000","last_active":"2024-09-21T09:05:04.351174+0000","last_peered":"2024-09-21T09:05:04.351174+0000","last_clean":"2024-09-21T09:05:04.351174+0000","last_became_active":"2024-09-21T09:03:04.242637+0000","last_became_peered":"2024-09-21T09:03:04.242637+0000","last_unstale":"2024-09-21T09:05:04.351174+0000","last_undegraded":"2024-09-21T09:05:04.351174+0000","last_fullsized":"2024-09-21T09:05:04.351174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:09.480974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274815+0000","last_change":"2024-09-21T09:03:06.247484+0000","last_active":"2024-09-21T09:03:38.274815+0000","last_peered":"2024-09-21T09:03:38.274815+0000","last_clean":"2024-09-21T09:03:38.274815+0000","last_became_active":"2024-09-21T09:03:06.247203+0000","last_became_peered":"2024-09-21T09:03:06.247203+0000","last_unstale":"2024-09-21T09:03:38.274815+0000","last_undegraded":"2024-09-21T09:03:38.274815+0000","last_fullsized":"2024-09-21T09:03:38.274815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:37.402801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.415271+0000","last_change":"2024-09-21T09:03:08.262677+0000","last_active":"2024-09-21T09:06:06.415271+0000","last_peered":"2024-09-21T09:06:06.415271+0000","last_clean":"2024-09-21T09:06:06.415271+0000","last_became_active":"2024-09-21T09:03:08.262384+0000","last_became_peered":"2024-09-21T09:03:08.262384+0000","last_unstale":"2024-09-21T09:06:06.415271+0000","last_undegraded":"2024-09-21T09:06:06.415271+0000","last_fullsized":"2024-09-21T09:06:06.415271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:38.859764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'8","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298988+0000","last_change":"2024-09-21T09:03:00.218848+0000","last_active":"2024-09-21T09:06:06.298988+0000","last_peered":"2024-09-21T09:06:06.298988+0000","last_clean":"2024-09-21T09:06:06.298988+0000","last_became_active":"2024-09-21T09:03:00.217658+0000","last_became_peered":"2024-09-21T09:03:00.217658+0000","last_unstale":"2024-09-21T09:06:06.298988+0000","last_undegraded":"2024-09-21T09:06:06.298988+0000","last_fullsized":"2024-09-21T09:06:06.298988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:04.690462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275111+0000","last_change":"2024-09-21T09:02:58.218614+0000","last_active":"2024-09-21T09:03:38.275111+0000","last_peered":"2024-09-21T09:03:38.275111+0000","last_clean":"2024-09-21T09:03:38.275111+0000","last_became_active":"2024-09-21T09:02:58.218086+0000","last_became_peered":"2024-09-21T09:02:58.218086+0000","last_unstale":"2024-09-21T09:03:38.275111+0000","last_undegraded":"2024-09-21T09:03:38.275111+0000","last_fullsized":"2024-09-21T09:03:38.275111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:03.460514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466155+0000","last_change":"2024-09-21T09:03:02.220885+0000","last_active":"2024-09-21T09:03:38.466155+0000","last_peered":"2024-09-21T09:03:38.466155+0000","last_clean":"2024-09-21T09:03:38.466155+0000","last_became_active":"2024-09-21T09:03:02.220557+0000","last_became_peered":"2024-09-21T09:03:02.220557+0000","last_unstale":"2024-09-21T09:03:38.466155+0000","last_undegraded":"2024-09-21T09:03:38.466155+0000","last_fullsized":"2024-09-21T09:03:38.466155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:27.649227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274937+0000","last_change":"2024-09-21T09:03:04.236337+0000","last_active":"2024-09-21T09:03:38.274937+0000","last_peered":"2024-09-21T09:03:38.274937+0000","last_clean":"2024-09-21T09:03:38.274937+0000","last_became_active":"2024-09-21T09:03:04.236037+0000","last_became_peered":"2024-09-21T09:03:04.236037+0000","last_unstale":"2024-09-21T09:03:38.274937+0000","last_undegraded":"2024-09-21T09:03:38.274937+0000","last_fullsized":"2024-09-21T09:03:38.274937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:06.028996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274949+0000","last_change":"2024-09-21T09:03:06.244177+0000","last_active":"2024-09-21T09:03:38.274949+0000","last_peered":"2024-09-21T09:03:38.274949+0000","last_clean":"2024-09-21T09:03:38.274949+0000","last_became_active":"2024-09-21T09:03:06.243901+0000","last_became_peered":"2024-09-21T09:03:06.243901+0000","last_unstale":"2024-09-21T09:03:38.274949+0000","last_undegraded":"2024-09-21T09:03:38.274949+0000","last_fullsized":"2024-09-21T09:03:38.274949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:03.746735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463546+0000","last_change":"2024-09-21T09:03:08.250364+0000","last_active":"2024-09-21T09:03:38.463546+0000","last_peered":"2024-09-21T09:03:38.463546+0000","last_clean":"2024-09-21T09:03:38.463546+0000","last_became_active":"2024-09-21T09:03:08.250029+0000","last_became_peered":"2024-09-21T09:03:08.250029+0000","last_unstale":"2024-09-21T09:03:38.463546+0000","last_undegraded":"2024-09-21T09:03:38.463546+0000","last_fullsized":"2024-09-21T09:03:38.463546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:58.888309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260917+0000","last_change":"2024-09-21T09:03:00.217928+0000","last_active":"2024-09-21T09:06:06.260917+0000","last_peered":"2024-09-21T09:06:06.260917+0000","last_clean":"2024-09-21T09:06:06.260917+0000","last_became_active":"2024-09-21T09:03:00.217633+0000","last_became_peered":"2024-09-21T09:03:00.217633+0000","last_unstale":"2024-09-21T09:06:06.260917+0000","last_undegraded":"2024-09-21T09:06:06.260917+0000","last_fullsized":"2024-09-21T09:06:06.260917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:20.929000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270779+0000","last_change":"2024-09-21T09:02:58.220432+0000","last_active":"2024-09-21T09:03:38.270779+0000","last_peered":"2024-09-21T09:03:38.270779+0000","last_clean":"2024-09-21T09:03:38.270779+0000","last_became_active":"2024-09-21T09:02:58.220133+0000","last_became_peered":"2024-09-21T09:02:58.220133+0000","last_unstale":"2024-09-21T09:03:38.270779+0000","last_undegraded":"2024-09-21T09:03:38.270779+0000","last_fullsized":"2024-09-21T09:03:38.270779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:53.075751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466206+0000","last_change":"2024-09-21T09:03:02.220223+0000","last_active":"2024-09-21T09:03:38.466206+0000","last_peered":"2024-09-21T09:03:38.466206+0000","last_clean":"2024-09-21T09:03:38.466206+0000","last_became_active":"2024-09-21T09:03:02.219457+0000","last_became_peered":"2024-09-21T09:03:02.219457+0000","last_unstale":"2024-09-21T09:03:38.466206+0000","last_undegraded":"2024-09-21T09:03:38.466206+0000","last_fullsized":"2024-09-21T09:03:38.466206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:02.648349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276650+0000","last_change":"2024-09-21T09:03:04.239498+0000","last_active":"2024-09-21T09:03:38.276650+0000","last_peered":"2024-09-21T09:03:38.276650+0000","last_clean":"2024-09-21T09:03:38.276650+0000","last_became_active":"2024-09-21T09:03:04.239187+0000","last_became_peered":"2024-09-21T09:03:04.239187+0000","last_unstale":"2024-09-21T09:03:38.276650+0000","last_undegraded":"2024-09-21T09:03:38.276650+0000","last_fullsized":"2024-09-21T09:03:38.276650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:25.074373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'282","reported_seq":384,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.469439+0000","last_change":"2024-09-21T09:03:06.248028+0000","last_active":"2024-09-21T09:06:06.469439+0000","last_peered":"2024-09-21T09:06:06.469439+0000","last_clean":"2024-09-21T09:06:06.469439+0000","last_became_active":"2024-09-21T09:03:06.247441+0000","last_became_peered":"2024-09-21T09:03:06.247441+0000","last_unstale":"2024-09-21T09:06:06.469439+0000","last_undegraded":"2024-09-21T09:06:06.469439+0000","last_fullsized":"2024-09-21T09:06:06.469439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:22.593231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'6","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.177765+0000","last_change":"2024-09-21T09:03:08.255550+0000","last_active":"2024-09-21T09:06:06.177765+0000","last_peered":"2024-09-21T09:06:06.177765+0000","last_clean":"2024-09-21T09:06:06.177765+0000","last_became_active":"2024-09-21T09:03:08.255274+0000","last_became_peered":"2024-09-21T09:03:08.255274+0000","last_unstale":"2024-09-21T09:06:06.177765+0000","last_undegraded":"2024-09-21T09:06:06.177765+0000","last_fullsized":"2024-09-21T09:06:06.177765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:12.962973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'4","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173759+0000","last_change":"2024-09-21T09:03:00.216751+0000","last_active":"2024-09-21T09:06:06.173759+0000","last_peered":"2024-09-21T09:06:06.173759+0000","last_clean":"2024-09-21T09:06:06.173759+0000","last_became_active":"2024-09-21T09:03:00.216382+0000","last_became_peered":"2024-09-21T09:03:00.216382+0000","last_unstale":"2024-09-21T09:06:06.173759+0000","last_undegraded":"2024-09-21T09:06:06.173759+0000","last_fullsized":"2024-09-21T09:06:06.173759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:06.215821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273477+0000","last_change":"2024-09-21T09:02:58.210831+0000","last_active":"2024-09-21T09:03:38.273477+0000","last_peered":"2024-09-21T09:03:38.273477+0000","last_clean":"2024-09-21T09:03:38.273477+0000","last_became_active":"2024-09-21T09:02:58.210560+0000","last_became_peered":"2024-09-21T09:02:58.210560+0000","last_unstale":"2024-09-21T09:03:38.273477+0000","last_undegraded":"2024-09-21T09:03:38.273477+0000","last_fullsized":"2024-09-21T09:03:38.273477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:12.355792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274957+0000","last_change":"2024-09-21T09:03:02.221778+0000","last_active":"2024-09-21T09:03:38.274957+0000","last_peered":"2024-09-21T09:03:38.274957+0000","last_clean":"2024-09-21T09:03:38.274957+0000","last_became_active":"2024-09-21T09:03:02.220551+0000","last_became_peered":"2024-09-21T09:03:02.220551+0000","last_unstale":"2024-09-21T09:03:38.274957+0000","last_undegraded":"2024-09-21T09:03:38.274957+0000","last_fullsized":"2024-09-21T09:03:38.274957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:46.255807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.346241+0000","last_change":"2024-09-21T09:03:04.234165+0000","last_active":"2024-09-21T09:05:04.346241+0000","last_peered":"2024-09-21T09:05:04.346241+0000","last_clean":"2024-09-21T09:05:04.346241+0000","last_became_active":"2024-09-21T09:03:04.233848+0000","last_became_peered":"2024-09-21T09:03:04.233848+0000","last_unstale":"2024-09-21T09:05:04.346241+0000","last_undegraded":"2024-09-21T09:05:04.346241+0000","last_fullsized":"2024-09-21T09:05:04.346241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:09.138690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'282","reported_seq":400,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.366462+0000","last_change":"2024-09-21T09:03:06.244195+0000","last_active":"2024-09-21T09:06:06.366462+0000","last_peered":"2024-09-21T09:06:06.366462+0000","last_clean":"2024-09-21T09:06:06.366462+0000","last_became_active":"2024-09-21T09:03:06.243576+0000","last_became_peered":"2024-09-21T09:03:06.243576+0000","last_unstale":"2024-09-21T09:06:06.366462+0000","last_undegraded":"2024-09-21T09:06:06.366462+0000","last_fullsized":"2024-09-21T09:06:06.366462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:31.080527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271245+0000","last_change":"2024-09-21T09:03:00.217801+0000","last_active":"2024-09-21T09:03:38.271245+0000","last_peered":"2024-09-21T09:03:38.271245+0000","last_clean":"2024-09-21T09:03:38.271245+0000","last_became_active":"2024-09-21T09:03:00.217545+0000","last_became_peered":"2024-09-21T09:03:00.217545+0000","last_unstale":"2024-09-21T09:03:38.271245+0000","last_undegraded":"2024-09-21T09:03:38.271245+0000","last_fullsized":"2024-09-21T09:03:38.271245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:43.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.281094+0000","last_change":"2024-09-21T09:02:58.209991+0000","last_active":"2024-09-21T09:03:38.281094+0000","last_peered":"2024-09-21T09:03:38.281094+0000","last_clean":"2024-09-21T09:03:38.281094+0000","last_became_active":"2024-09-21T09:02:58.209712+0000","last_became_peered":"2024-09-21T09:02:58.209712+0000","last_unstale":"2024-09-21T09:03:38.281094+0000","last_undegraded":"2024-09-21T09:03:38.281094+0000","last_fullsized":"2024-09-21T09:03:38.281094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:25.409736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"22'1","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.388071+0000","last_change":"2024-09-21T09:03:02.220925+0000","last_active":"2024-09-21T09:05:05.388071+0000","last_peered":"2024-09-21T09:05:05.388071+0000","last_clean":"2024-09-21T09:05:05.388071+0000","last_became_active":"2024-09-21T09:03:02.220629+0000","last_became_peered":"2024-09-21T09:03:02.220629+0000","last_unstale":"2024-09-21T09:05:05.388071+0000","last_undegraded":"2024-09-21T09:05:05.388071+0000","last_fullsized":"2024-09-21T09:05:05.388071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:32.066319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'40","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.355437+0000","last_change":"2024-09-21T09:03:04.232877+0000","last_active":"2024-09-21T09:05:04.355437+0000","last_peered":"2024-09-21T09:05:04.355437+0000","last_clean":"2024-09-21T09:05:04.355437+0000","last_became_active":"2024-09-21T09:03:04.232394+0000","last_became_peered":"2024-09-21T09:03:04.232394+0000","last_unstale":"2024-09-21T09:05:04.355437+0000","last_undegraded":"2024-09-21T09:05:04.355437+0000","last_fullsized":"2024-09-21T09:05:04.355437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:29.659990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464295+0000","last_change":"2024-09-21T09:03:06.244547+0000","last_active":"2024-09-21T09:03:38.464295+0000","last_peered":"2024-09-21T09:03:38.464295+0000","last_clean":"2024-09-21T09:03:38.464295+0000","last_became_active":"2024-09-21T09:03:06.244259+0000","last_became_peered":"2024-09-21T09:03:06.244259+0000","last_unstale":"2024-09-21T09:03:38.464295+0000","last_undegraded":"2024-09-21T09:03:38.464295+0000","last_fullsized":"2024-09-21T09:03:38.464295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:41.912327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.079455+0000","last_change":"2024-09-21T09:03:08.261530+0000","last_active":"2024-09-21T09:04:22.079455+0000","last_peered":"2024-09-21T09:04:22.079455+0000","last_clean":"2024-09-21T09:04:22.079455+0000","last_became_active":"2024-09-21T09:03:08.261035+0000","last_became_peered":"2024-09-21T09:03:08.261035+0000","last_unstale":"2024-09-21T09:04:22.079455+0000","last_undegraded":"2024-09-21T09:04:22.079455+0000","last_fullsized":"2024-09-21T09:04:22.079455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:03.684978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273196+0000","last_change":"2024-09-21T09:03:00.220087+0000","last_active":"2024-09-21T09:03:38.273196+0000","last_peered":"2024-09-21T09:03:38.273196+0000","last_clean":"2024-09-21T09:03:38.273196+0000","last_became_active":"2024-09-21T09:03:00.219765+0000","last_became_peered":"2024-09-21T09:03:00.219765+0000","last_unstale":"2024-09-21T09:03:38.273196+0000","last_undegraded":"2024-09-21T09:03:38.273196+0000","last_fullsized":"2024-09-21T09:03:38.273196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:52:42.557402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276119+0000","last_change":"2024-09-21T09:02:58.214776+0000","last_active":"2024-09-21T09:03:38.276119+0000","last_peered":"2024-09-21T09:03:38.276119+0000","last_clean":"2024-09-21T09:03:38.276119+0000","last_became_active":"2024-09-21T09:02:58.214392+0000","last_became_peered":"2024-09-21T09:02:58.214392+0000","last_unstale":"2024-09-21T09:03:38.276119+0000","last_undegraded":"2024-09-21T09:03:38.276119+0000","last_fullsized":"2024-09-21T09:03:38.276119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:24.399035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463904+0000","last_change":"2024-09-21T09:03:02.223499+0000","last_active":"2024-09-21T09:03:38.463904+0000","last_peered":"2024-09-21T09:03:38.463904+0000","last_clean":"2024-09-21T09:03:38.463904+0000","last_became_active":"2024-09-21T09:03:02.223123+0000","last_became_peered":"2024-09-21T09:03:02.223123+0000","last_unstale":"2024-09-21T09:03:38.463904+0000","last_undegraded":"2024-09-21T09:03:38.463904+0000","last_fullsized":"2024-09-21T09:03:38.463904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:16.103189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.336328+0000","last_change":"2024-09-21T09:03:04.242739+0000","last_active":"2024-09-21T09:05:04.336328+0000","last_peered":"2024-09-21T09:05:04.336328+0000","last_clean":"2024-09-21T09:05:04.336328+0000","last_became_active":"2024-09-21T09:03:04.242404+0000","last_became_peered":"2024-09-21T09:03:04.242404+0000","last_unstale":"2024-09-21T09:05:04.336328+0000","last_undegraded":"2024-09-21T09:05:04.336328+0000","last_fullsized":"2024-09-21T09:05:04.336328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:55.151013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463723+0000","last_change":"2024-09-21T09:03:06.248256+0000","last_active":"2024-09-21T09:03:38.463723+0000","last_peered":"2024-09-21T09:03:38.463723+0000","last_clean":"2024-09-21T09:03:38.463723+0000","last_became_active":"2024-09-21T09:03:06.247504+0000","last_became_peered":"2024-09-21T09:03:06.247504+0000","last_unstale":"2024-09-21T09:03:38.463723+0000","last_undegraded":"2024-09-21T09:03:38.463723+0000","last_fullsized":"2024-09-21T09:03:38.463723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:25.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'3","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:16.565423+0000","last_change":"2024-09-21T09:03:08.256372+0000","last_active":"2024-09-21T09:04:16.565423+0000","last_peered":"2024-09-21T09:04:16.565423+0000","last_clean":"2024-09-21T09:04:16.565423+0000","last_became_active":"2024-09-21T09:03:08.255814+0000","last_became_peered":"2024-09-21T09:03:08.255814+0000","last_unstale":"2024-09-21T09:04:16.565423+0000","last_undegraded":"2024-09-21T09:04:16.565423+0000","last_fullsized":"2024-09-21T09:04:16.565423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:46.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273220+0000","last_change":"2024-09-21T09:03:00.223110+0000","last_active":"2024-09-21T09:03:38.273220+0000","last_peered":"2024-09-21T09:03:38.273220+0000","last_clean":"2024-09-21T09:03:38.273220+0000","last_became_active":"2024-09-21T09:03:00.222650+0000","last_became_peered":"2024-09-21T09:03:00.222650+0000","last_unstale":"2024-09-21T09:03:38.273220+0000","last_undegraded":"2024-09-21T09:03:38.273220+0000","last_fullsized":"2024-09-21T09:03:38.273220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:12.697444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278305+0000","last_change":"2024-09-21T09:02:58.213931+0000","last_active":"2024-09-21T09:03:38.278305+0000","last_peered":"2024-09-21T09:03:38.278305+0000","last_clean":"2024-09-21T09:03:38.278305+0000","last_became_active":"2024-09-21T09:02:58.213652+0000","last_became_peered":"2024-09-21T09:02:58.213652+0000","last_unstale":"2024-09-21T09:03:38.278305+0000","last_undegraded":"2024-09-21T09:03:38.278305+0000","last_fullsized":"2024-09-21T09:03:38.278305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:27.612761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.282682+0000","last_change":"2024-09-21T09:03:38.281879+0000","last_active":"2024-09-21T09:03:38.282682+0000","last_peered":"2024-09-21T09:03:38.282682+0000","last_clean":"2024-09-21T09:03:38.282682+0000","last_became_active":"2024-09-21T09:03:38.281497+0000","last_became_peered":"2024-09-21T09:03:38.281497+0000","last_unstale":"2024-09-21T09:03:38.282682+0000","last_undegraded":"2024-09-21T09:03:38.282682+0000","last_fullsized":"2024-09-21T09:03:38.282682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:32.826730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.357293+0000","last_change":"2024-09-21T09:03:04.240985+0000","last_active":"2024-09-21T09:05:04.357293+0000","last_peered":"2024-09-21T09:05:04.357293+0000","last_clean":"2024-09-21T09:05:04.357293+0000","last_became_active":"2024-09-21T09:03:04.240144+0000","last_became_peered":"2024-09-21T09:03:04.240144+0000","last_unstale":"2024-09-21T09:05:04.357293+0000","last_undegraded":"2024-09-21T09:05:04.357293+0000","last_fullsized":"2024-09-21T09:05:04.357293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:09.558749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'282","reported_seq":347,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.478440+0000","last_change":"2024-09-21T09:03:06.251119+0000","last_active":"2024-09-21T09:06:06.478440+0000","last_peered":"2024-09-21T09:06:06.478440+0000","last_clean":"2024-09-21T09:06:06.478440+0000","last_became_active":"2024-09-21T09:03:06.250807+0000","last_became_peered":"2024-09-21T09:03:06.250807+0000","last_unstale":"2024-09-21T09:06:06.478440+0000","last_undegraded":"2024-09-21T09:06:06.478440+0000","last_fullsized":"2024-09-21T09:06:06.478440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:37.402801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465087+0000","last_change":"2024-09-21T09:03:08.250308+0000","last_active":"2024-09-21T09:03:38.465087+0000","last_peered":"2024-09-21T09:03:38.465087+0000","last_clean":"2024-09-21T09:03:38.465087+0000","last_became_active":"2024-09-21T09:03:08.250063+0000","last_became_peered":"2024-09-21T09:03:08.250063+0000","last_unstale":"2024-09-21T09:03:38.465087+0000","last_undegraded":"2024-09-21T09:03:38.465087+0000","last_fullsized":"2024-09-21T09:03:38.465087+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:16.323766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.082622+0000","last_change":"2024-09-21T09:03:00.217929+0000","last_active":"2024-09-21T09:06:06.082622+0000","last_peered":"2024-09-21T09:06:06.082622+0000","last_clean":"2024-09-21T09:06:06.082622+0000","last_became_active":"2024-09-21T09:03:00.216544+0000","last_became_peered":"2024-09-21T09:03:00.216544+0000","last_unstale":"2024-09-21T09:06:06.082622+0000","last_undegraded":"2024-09-21T09:06:06.082622+0000","last_fullsized":"2024-09-21T09:06:06.082622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.852495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.836403+0000","last_change":"2024-09-21T09:02:58.224993+0000","last_active":"2024-09-21T09:03:39.836403+0000","last_peered":"2024-09-21T09:03:39.836403+0000","last_clean":"2024-09-21T09:03:39.836403+0000","last_became_active":"2024-09-21T09:02:58.224675+0000","last_became_peered":"2024-09-21T09:02:58.224675+0000","last_unstale":"2024-09-21T09:03:39.836403+0000","last_undegraded":"2024-09-21T09:03:39.836403+0000","last_fullsized":"2024-09-21T09:03:39.836403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:29.937663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464221+0000","last_change":"2024-09-21T09:03:02.223199+0000","last_active":"2024-09-21T09:03:38.464221+0000","last_peered":"2024-09-21T09:03:38.464221+0000","last_clean":"2024-09-21T09:03:38.464221+0000","last_became_active":"2024-09-21T09:03:02.222904+0000","last_became_peered":"2024-09-21T09:03:02.222904+0000","last_unstale":"2024-09-21T09:03:38.464221+0000","last_undegraded":"2024-09-21T09:03:38.464221+0000","last_fullsized":"2024-09-21T09:03:38.464221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:23.601280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'56","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.359132+0000","last_change":"2024-09-21T09:03:04.241974+0000","last_active":"2024-09-21T09:05:04.359132+0000","last_peered":"2024-09-21T09:05:04.359132+0000","last_clean":"2024-09-21T09:05:04.359132+0000","last_became_active":"2024-09-21T09:03:04.241679+0000","last_became_peered":"2024-09-21T09:03:04.241679+0000","last_unstale":"2024-09-21T09:05:04.359132+0000","last_undegraded":"2024-09-21T09:05:04.359132+0000","last_fullsized":"2024-09-21T09:05:04.359132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:49.529992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463737+0000","last_change":"2024-09-21T09:03:06.249590+0000","last_active":"2024-09-21T09:03:38.463737+0000","last_peered":"2024-09-21T09:03:38.463737+0000","last_clean":"2024-09-21T09:03:38.463737+0000","last_became_active":"2024-09-21T09:03:06.249377+0000","last_became_peered":"2024-09-21T09:03:06.249377+0000","last_unstale":"2024-09-21T09:03:38.463737+0000","last_undegraded":"2024-09-21T09:03:38.463737+0000","last_fullsized":"2024-09-21T09:03:38.463737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:09.672283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'22","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.456034+0000","last_change":"2024-09-21T09:03:08.260431+0000","last_active":"2024-09-21T09:06:06.456034+0000","last_peered":"2024-09-21T09:06:06.456034+0000","last_clean":"2024-09-21T09:06:06.456034+0000","last_became_active":"2024-09-21T09:03:08.260071+0000","last_became_peered":"2024-09-21T09:03:08.260071+0000","last_unstale":"2024-09-21T09:06:06.456034+0000","last_undegraded":"2024-09-21T09:06:06.456034+0000","last_fullsized":"2024-09-21T09:06:06.456034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:44.917297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.301342+0000","last_change":"2024-09-21T09:03:00.223450+0000","last_active":"2024-09-21T09:03:39.301342+0000","last_peered":"2024-09-21T09:03:39.301342+0000","last_clean":"2024-09-21T09:03:39.301342+0000","last_became_active":"2024-09-21T09:03:00.223184+0000","last_became_peered":"2024-09-21T09:03:00.223184+0000","last_unstale":"2024-09-21T09:03:39.301342+0000","last_undegraded":"2024-09-21T09:03:39.301342+0000","last_fullsized":"2024-09-21T09:03:39.301342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:09.836796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464552+0000","last_change":"2024-09-21T09:02:58.216900+0000","last_active":"2024-09-21T09:03:38.464552+0000","last_peered":"2024-09-21T09:03:38.464552+0000","last_clean":"2024-09-21T09:03:38.464552+0000","last_became_active":"2024-09-21T09:02:58.216545+0000","last_became_peered":"2024-09-21T09:02:58.216545+0000","last_unstale":"2024-09-21T09:03:38.464552+0000","last_undegraded":"2024-09-21T09:03:38.464552+0000","last_fullsized":"2024-09-21T09:03:38.464552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:24.399035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274224+0000","last_change":"2024-09-21T09:03:02.221720+0000","last_active":"2024-09-21T09:03:38.274224+0000","last_peered":"2024-09-21T09:03:38.274224+0000","last_clean":"2024-09-21T09:03:38.274224+0000","last_became_active":"2024-09-21T09:03:02.221352+0000","last_became_peered":"2024-09-21T09:03:02.221352+0000","last_unstale":"2024-09-21T09:03:38.274224+0000","last_undegraded":"2024-09-21T09:03:38.274224+0000","last_fullsized":"2024-09-21T09:03:38.274224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:21.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'32","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.340441+0000","last_change":"2024-09-21T09:03:04.235060+0000","last_active":"2024-09-21T09:05:04.340441+0000","last_peered":"2024-09-21T09:05:04.340441+0000","last_clean":"2024-09-21T09:05:04.340441+0000","last_became_active":"2024-09-21T09:03:04.234750+0000","last_became_peered":"2024-09-21T09:03:04.234750+0000","last_unstale":"2024-09-21T09:05:04.340441+0000","last_undegraded":"2024-09-21T09:05:04.340441+0000","last_fullsized":"2024-09-21T09:05:04.340441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:38.551769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275928+0000","last_change":"2024-09-21T09:03:06.248717+0000","last_active":"2024-09-21T09:03:38.275928+0000","last_peered":"2024-09-21T09:03:38.275928+0000","last_clean":"2024-09-21T09:03:38.275928+0000","last_became_active":"2024-09-21T09:03:06.248453+0000","last_became_peered":"2024-09-21T09:03:06.248453+0000","last_unstale":"2024-09-21T09:03:38.275928+0000","last_undegraded":"2024-09-21T09:03:38.275928+0000","last_fullsized":"2024-09-21T09:03:38.275928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.976812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458033+0000","last_change":"2024-09-21T09:03:08.260732+0000","last_active":"2024-09-21T09:05:08.458033+0000","last_peered":"2024-09-21T09:05:08.458033+0000","last_clean":"2024-09-21T09:05:08.458033+0000","last_became_active":"2024-09-21T09:03:08.260016+0000","last_became_peered":"2024-09-21T09:03:08.260016+0000","last_unstale":"2024-09-21T09:05:08.458033+0000","last_undegraded":"2024-09-21T09:05:08.458033+0000","last_fullsized":"2024-09-21T09:05:08.458033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:07.434714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'10","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363142+0000","last_change":"2024-09-21T09:03:00.221963+0000","last_active":"2024-09-21T09:06:06.363142+0000","last_peered":"2024-09-21T09:06:06.363142+0000","last_clean":"2024-09-21T09:06:06.363142+0000","last_became_active":"2024-09-21T09:03:00.220384+0000","last_became_peered":"2024-09-21T09:03:00.220384+0000","last_unstale":"2024-09-21T09:06:06.363142+0000","last_undegraded":"2024-09-21T09:06:06.363142+0000","last_fullsized":"2024-09-21T09:06:06.363142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:49.615946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'6","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.843889+0000","last_change":"2024-09-21T09:02:58.214415+0000","last_active":"2024-09-21T09:03:39.843889+0000","last_peered":"2024-09-21T09:03:39.843889+0000","last_clean":"2024-09-21T09:03:39.843889+0000","last_became_active":"2024-09-21T09:02:58.213920+0000","last_became_peered":"2024-09-21T09:02:58.213920+0000","last_unstale":"2024-09-21T09:03:39.843889+0000","last_undegraded":"2024-09-21T09:03:39.843889+0000","last_fullsized":"2024-09-21T09:03:39.843889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:07:45.991079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466801+0000","last_change":"2024-09-21T09:03:02.220182+0000","last_active":"2024-09-21T09:03:38.466801+0000","last_peered":"2024-09-21T09:03:38.466801+0000","last_clean":"2024-09-21T09:03:38.466801+0000","last_became_active":"2024-09-21T09:03:02.217917+0000","last_became_peered":"2024-09-21T09:03:02.217917+0000","last_unstale":"2024-09-21T09:03:38.466801+0000","last_undegraded":"2024-09-21T09:03:38.466801+0000","last_fullsized":"2024-09-21T09:03:38.466801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:32.066319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'37","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.365768+0000","last_change":"2024-09-21T09:03:04.235643+0000","last_active":"2024-09-21T09:05:04.365768+0000","last_peered":"2024-09-21T09:05:04.365768+0000","last_clean":"2024-09-21T09:05:04.365768+0000","last_became_active":"2024-09-21T09:03:04.235199+0000","last_became_peered":"2024-09-21T09:03:04.235199+0000","last_unstale":"2024-09-21T09:05:04.365768+0000","last_undegraded":"2024-09-21T09:05:04.365768+0000","last_fullsized":"2024-09-21T09:05:04.365768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:18.113952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'282","reported_seq":402,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.460214+0000","last_change":"2024-09-21T09:03:06.246155+0000","last_active":"2024-09-21T09:06:06.460214+0000","last_peered":"2024-09-21T09:06:06.460214+0000","last_clean":"2024-09-21T09:06:06.460214+0000","last_became_active":"2024-09-21T09:03:06.245904+0000","last_became_peered":"2024-09-21T09:03:06.245904+0000","last_unstale":"2024-09-21T09:06:06.460214+0000","last_undegraded":"2024-09-21T09:06:06.460214+0000","last_fullsized":"2024-09-21T09:06:06.460214+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:51.831002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.454513+0000","last_change":"2024-09-21T09:03:08.253968+0000","last_active":"2024-09-21T09:05:12.454513+0000","last_peered":"2024-09-21T09:05:12.454513+0000","last_clean":"2024-09-21T09:05:12.454513+0000","last_became_active":"2024-09-21T09:03:08.253648+0000","last_became_peered":"2024-09-21T09:03:08.253648+0000","last_unstale":"2024-09-21T09:05:12.454513+0000","last_undegraded":"2024-09-21T09:05:12.454513+0000","last_fullsized":"2024-09-21T09:05:12.454513+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:56.641003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'5","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304375+0000","last_change":"2024-09-21T09:03:00.225003+0000","last_active":"2024-09-21T09:06:06.304375+0000","last_peered":"2024-09-21T09:06:06.304375+0000","last_clean":"2024-09-21T09:06:06.304375+0000","last_became_active":"2024-09-21T09:03:00.222983+0000","last_became_peered":"2024-09-21T09:03:00.222983+0000","last_unstale":"2024-09-21T09:06:06.304375+0000","last_undegraded":"2024-09-21T09:06:06.304375+0000","last_fullsized":"2024-09-21T09:06:06.304375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:24.133336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.838971+0000","last_change":"2024-09-21T09:02:58.222294+0000","last_active":"2024-09-21T09:03:39.838971+0000","last_peered":"2024-09-21T09:03:39.838971+0000","last_clean":"2024-09-21T09:03:39.838971+0000","last_became_active":"2024-09-21T09:02:58.221805+0000","last_became_peered":"2024-09-21T09:02:58.221805+0000","last_unstale":"2024-09-21T09:03:39.838971+0000","last_undegraded":"2024-09-21T09:03:39.838971+0000","last_fullsized":"2024-09-21T09:03:39.838971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:53.268716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'3","reported_seq":413,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.387757+0000","last_change":"2024-09-21T09:03:02.222283+0000","last_active":"2024-09-21T09:05:05.387757+0000","last_peered":"2024-09-21T09:05:05.387757+0000","last_clean":"2024-09-21T09:05:05.387757+0000","last_became_active":"2024-09-21T09:03:02.222002+0000","last_became_peered":"2024-09-21T09:03:02.222002+0000","last_unstale":"2024-09-21T09:05:05.387757+0000","last_undegraded":"2024-09-21T09:05:05.387757+0000","last_fullsized":"2024-09-21T09:05:05.387757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:32.909484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275507+0000","last_change":"2024-09-21T09:03:04.243079+0000","last_active":"2024-09-21T09:03:38.275507+0000","last_peered":"2024-09-21T09:03:38.275507+0000","last_clean":"2024-09-21T09:03:38.275507+0000","last_became_active":"2024-09-21T09:03:04.242702+0000","last_became_peered":"2024-09-21T09:03:04.242702+0000","last_unstale":"2024-09-21T09:03:38.275507+0000","last_undegraded":"2024-09-21T09:03:38.275507+0000","last_fullsized":"2024-09-21T09:03:38.275507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:02.620013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'282","reported_seq":464,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.417369+0000","last_change":"2024-09-21T09:03:06.249279+0000","last_active":"2024-09-21T09:06:06.417369+0000","last_peered":"2024-09-21T09:06:06.417369+0000","last_clean":"2024-09-21T09:06:06.417369+0000","last_became_active":"2024-09-21T09:03:06.248991+0000","last_became_peered":"2024-09-21T09:03:06.248991+0000","last_unstale":"2024-09-21T09:06:06.417369+0000","last_undegraded":"2024-09-21T09:06:06.417369+0000","last_fullsized":"2024-09-21T09:06:06.417369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.466336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.511263+0000","last_change":"2024-09-21T09:03:08.252929+0000","last_active":"2024-09-21T09:05:05.511263+0000","last_peered":"2024-09-21T09:05:05.511263+0000","last_clean":"2024-09-21T09:05:05.511263+0000","last_became_active":"2024-09-21T09:03:08.252549+0000","last_became_peered":"2024-09-21T09:03:08.252549+0000","last_unstale":"2024-09-21T09:05:05.511263+0000","last_undegraded":"2024-09-21T09:05:05.511263+0000","last_fullsized":"2024-09-21T09:05:05.511263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:41.286037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260844+0000","last_change":"2024-09-21T09:03:00.223988+0000","last_active":"2024-09-21T09:06:06.260844+0000","last_peered":"2024-09-21T09:06:06.260844+0000","last_clean":"2024-09-21T09:06:06.260844+0000","last_became_active":"2024-09-21T09:03:00.223719+0000","last_became_peered":"2024-09-21T09:03:00.223719+0000","last_unstale":"2024-09-21T09:06:06.260844+0000","last_undegraded":"2024-09-21T09:06:06.260844+0000","last_fullsized":"2024-09-21T09:06:06.260844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:03.610091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270492+0000","last_change":"2024-09-21T09:02:58.214335+0000","last_active":"2024-09-21T09:03:38.270492+0000","last_peered":"2024-09-21T09:03:38.270492+0000","last_clean":"2024-09-21T09:03:38.270492+0000","last_became_active":"2024-09-21T09:02:58.214074+0000","last_became_peered":"2024-09-21T09:02:58.214074+0000","last_unstale":"2024-09-21T09:03:38.270492+0000","last_undegraded":"2024-09-21T09:03:38.270492+0000","last_fullsized":"2024-09-21T09:03:38.270492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:11.076844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274721+0000","last_change":"2024-09-21T09:03:02.222570+0000","last_active":"2024-09-21T09:03:38.274721+0000","last_peered":"2024-09-21T09:03:38.274721+0000","last_clean":"2024-09-21T09:03:38.274721+0000","last_became_active":"2024-09-21T09:03:02.222095+0000","last_became_peered":"2024-09-21T09:03:02.222095+0000","last_unstale":"2024-09-21T09:03:38.274721+0000","last_undegraded":"2024-09-21T09:03:38.274721+0000","last_fullsized":"2024-09-21T09:03:38.274721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:31.855727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'38","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.352351+0000","last_change":"2024-09-21T09:03:04.236005+0000","last_active":"2024-09-21T09:05:04.352351+0000","last_peered":"2024-09-21T09:05:04.352351+0000","last_clean":"2024-09-21T09:05:04.352351+0000","last_became_active":"2024-09-21T09:03:04.235633+0000","last_became_peered":"2024-09-21T09:03:04.235633+0000","last_unstale":"2024-09-21T09:05:04.352351+0000","last_undegraded":"2024-09-21T09:05:04.352351+0000","last_fullsized":"2024-09-21T09:05:04.352351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:15.434978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275944+0000","last_change":"2024-09-21T09:03:06.248328+0000","last_active":"2024-09-21T09:03:38.275944+0000","last_peered":"2024-09-21T09:03:38.275944+0000","last_clean":"2024-09-21T09:03:38.275944+0000","last_became_active":"2024-09-21T09:03:06.247977+0000","last_became_peered":"2024-09-21T09:03:06.247977+0000","last_unstale":"2024-09-21T09:03:38.275944+0000","last_undegraded":"2024-09-21T09:03:38.275944+0000","last_fullsized":"2024-09-21T09:03:38.275944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:30.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.395329+0000","last_change":"2024-09-21T09:03:08.252270+0000","last_active":"2024-09-21T09:06:06.395329+0000","last_peered":"2024-09-21T09:06:06.395329+0000","last_clean":"2024-09-21T09:06:06.395329+0000","last_became_active":"2024-09-21T09:03:08.251985+0000","last_became_peered":"2024-09-21T09:03:08.251985+0000","last_unstale":"2024-09-21T09:06:06.395329+0000","last_undegraded":"2024-09-21T09:06:06.395329+0000","last_fullsized":"2024-09-21T09:06:06.395329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:21.302376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.082284+0000","last_change":"2024-09-21T09:03:00.221674+0000","last_active":"2024-09-21T09:06:06.082284+0000","last_peered":"2024-09-21T09:06:06.082284+0000","last_clean":"2024-09-21T09:06:06.082284+0000","last_became_active":"2024-09-21T09:03:00.219428+0000","last_became_peered":"2024-09-21T09:03:00.219428+0000","last_unstale":"2024-09-21T09:06:06.082284+0000","last_undegraded":"2024-09-21T09:06:06.082284+0000","last_fullsized":"2024-09-21T09:06:06.082284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:12.568235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":201,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273328+0000","last_change":"2024-09-21T09:02:44.107999+0000","last_active":"2024-09-21T09:03:38.273328+0000","last_peered":"2024-09-21T09:03:38.273328+0000","last_clean":"2024-09-21T09:03:38.273328+0000","last_became_active":"2024-09-21T09:02:44.107052+0000","last_became_peered":"2024-09-21T09:02:44.107052+0000","last_unstale":"2024-09-21T09:03:38.273328+0000","last_undegraded":"2024-09-21T09:03:38.273328+0000","last_fullsized":"2024-09-21T09:03:38.273328+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_clean_scrub_stamp":"2024-09-21T09:02:42.466256+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:10.291354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273506+0000","last_change":"2024-09-21T09:02:51.501401+0000","last_active":"2024-09-21T09:03:38.273506+0000","last_peered":"2024-09-21T09:03:38.273506+0000","last_clean":"2024-09-21T09:03:38.273506+0000","last_became_active":"2024-09-21T09:02:49.492504+0000","last_became_peered":"2024-09-21T09:02:49.492504+0000","last_unstale":"2024-09-21T09:03:38.273506+0000","last_undegraded":"2024-09-21T09:03:38.273506+0000","last_fullsized":"2024-09-21T09:03:38.273506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:33.286003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001229291,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271282+0000","last_change":"2024-09-21T09:02:58.222148+0000","last_active":"2024-09-21T09:03:38.271282+0000","last_peered":"2024-09-21T09:03:38.271282+0000","last_clean":"2024-09-21T09:03:38.271282+0000","last_became_active":"2024-09-21T09:02:58.221874+0000","last_became_peered":"2024-09-21T09:02:58.221874+0000","last_unstale":"2024-09-21T09:03:38.271282+0000","last_undegraded":"2024-09-21T09:03:38.271282+0000","last_fullsized":"2024-09-21T09:03:38.271282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:41.404620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.281164+0000","last_change":"2024-09-21T09:03:38.280004+0000","last_active":"2024-09-21T09:03:38.281164+0000","last_peered":"2024-09-21T09:03:38.281164+0000","last_clean":"2024-09-21T09:03:38.281164+0000","last_became_active":"2024-09-21T09:03:38.279694+0000","last_became_peered":"2024-09-21T09:03:38.279694+0000","last_unstale":"2024-09-21T09:03:38.281164+0000","last_undegraded":"2024-09-21T09:03:38.281164+0000","last_fullsized":"2024-09-21T09:03:38.281164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:16.786252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'76","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.363557+0000","last_change":"2024-09-21T09:03:04.240626+0000","last_active":"2024-09-21T09:05:04.363557+0000","last_peered":"2024-09-21T09:05:04.363557+0000","last_clean":"2024-09-21T09:05:04.363557+0000","last_became_active":"2024-09-21T09:03:04.240327+0000","last_became_peered":"2024-09-21T09:03:04.240327+0000","last_unstale":"2024-09-21T09:05:04.363557+0000","last_undegraded":"2024-09-21T09:05:04.363557+0000","last_fullsized":"2024-09-21T09:05:04.363557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:19.716984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465984+0000","last_change":"2024-09-21T09:03:06.247919+0000","last_active":"2024-09-21T09:03:38.465984+0000","last_peered":"2024-09-21T09:03:38.465984+0000","last_clean":"2024-09-21T09:03:38.465984+0000","last_became_active":"2024-09-21T09:03:06.247593+0000","last_became_peered":"2024-09-21T09:03:06.247593+0000","last_unstale":"2024-09-21T09:03:38.465984+0000","last_undegraded":"2024-09-21T09:03:38.465984+0000","last_fullsized":"2024-09-21T09:03:38.465984+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:56.554312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'83","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.373253+0000","last_change":"2024-09-21T09:03:08.251766+0000","last_active":"2024-09-21T09:06:06.373253+0000","last_peered":"2024-09-21T09:06:06.373253+0000","last_clean":"2024-09-21T09:06:06.373253+0000","last_became_active":"2024-09-21T09:03:08.251416+0000","last_became_peered":"2024-09-21T09:03:08.251416+0000","last_unstale":"2024-09-21T09:06:06.373253+0000","last_undegraded":"2024-09-21T09:06:06.373253+0000","last_fullsized":"2024-09-21T09:06:06.373253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:43.892525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.711324+0000","last_change":"2024-09-21T09:03:00.217299+0000","last_active":"2024-09-21T09:05:02.711324+0000","last_peered":"2024-09-21T09:05:02.711324+0000","last_clean":"2024-09-21T09:05:02.711324+0000","last_became_active":"2024-09-21T09:03:00.217018+0000","last_became_peered":"2024-09-21T09:03:00.217018+0000","last_unstale":"2024-09-21T09:05:02.711324+0000","last_undegraded":"2024-09-21T09:05:02.711324+0000","last_fullsized":"2024-09-21T09:05:02.711324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:26.810823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270854+0000","last_change":"2024-09-21T09:02:51.500609+0000","last_active":"2024-09-21T09:03:38.270854+0000","last_peered":"2024-09-21T09:03:38.270854+0000","last_clean":"2024-09-21T09:03:38.270854+0000","last_became_active":"2024-09-21T09:02:49.493239+0000","last_became_peered":"2024-09-21T09:02:49.493239+0000","last_unstale":"2024-09-21T09:03:38.270854+0000","last_undegraded":"2024-09-21T09:03:38.270854+0000","last_fullsized":"2024-09-21T09:03:38.270854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:46.489803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046437600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464127+0000","last_change":"2024-09-21T09:02:58.209258+0000","last_active":"2024-09-21T09:03:38.464127+0000","last_peered":"2024-09-21T09:03:38.464127+0000","last_clean":"2024-09-21T09:03:38.464127+0000","last_became_active":"2024-09-21T09:02:58.208819+0000","last_became_peered":"2024-09-21T09:02:58.208819+0000","last_unstale":"2024-09-21T09:03:38.464127+0000","last_undegraded":"2024-09-21T09:03:38.464127+0000","last_fullsized":"2024-09-21T09:03:38.464127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:08.728738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277167+0000","last_change":"2024-09-21T09:03:02.221203+0000","last_active":"2024-09-21T09:03:38.277167+0000","last_peered":"2024-09-21T09:03:38.277167+0000","last_clean":"2024-09-21T09:03:38.277167+0000","last_became_active":"2024-09-21T09:03:02.220903+0000","last_became_peered":"2024-09-21T09:03:02.220903+0000","last_unstale":"2024-09-21T09:03:38.277167+0000","last_undegraded":"2024-09-21T09:03:38.277167+0000","last_fullsized":"2024-09-21T09:03:38.277167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:54.934676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'273","reported_seq":475,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:02.304493+0000","last_change":"2024-09-21T09:03:04.240716+0000","last_active":"2024-09-21T09:06:02.304493+0000","last_peered":"2024-09-21T09:06:02.304493+0000","last_clean":"2024-09-21T09:06:02.304493+0000","last_became_active":"2024-09-21T09:03:04.240433+0000","last_became_peered":"2024-09-21T09:03:04.240433+0000","last_unstale":"2024-09-21T09:06:02.304493+0000","last_undegraded":"2024-09-21T09:06:02.304493+0000","last_fullsized":"2024-09-21T09:06:02.304493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:45.460299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277557+0000","last_change":"2024-09-21T09:03:06.248226+0000","last_active":"2024-09-21T09:03:38.277557+0000","last_peered":"2024-09-21T09:03:38.277557+0000","last_clean":"2024-09-21T09:03:38.277557+0000","last_became_active":"2024-09-21T09:03:06.247746+0000","last_became_peered":"2024-09-21T09:03:06.247746+0000","last_unstale":"2024-09-21T09:03:38.277557+0000","last_undegraded":"2024-09-21T09:03:38.277557+0000","last_fullsized":"2024-09-21T09:03:38.277557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:39.299058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.300471+0000","last_change":"2024-09-21T09:03:08.259029+0000","last_active":"2024-09-21T09:06:06.300471+0000","last_peered":"2024-09-21T09:06:06.300471+0000","last_clean":"2024-09-21T09:06:06.300471+0000","last_became_active":"2024-09-21T09:03:08.258104+0000","last_became_peered":"2024-09-21T09:03:08.258104+0000","last_unstale":"2024-09-21T09:06:06.300471+0000","last_undegraded":"2024-09-21T09:06:06.300471+0000","last_fullsized":"2024-09-21T09:06:06.300471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:58.888309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465869+0000","last_change":"2024-09-21T09:03:00.227553+0000","last_active":"2024-09-21T09:03:38.465869+0000","last_peered":"2024-09-21T09:03:38.465869+0000","last_clean":"2024-09-21T09:03:38.465869+0000","last_became_active":"2024-09-21T09:03:00.227191+0000","last_became_peered":"2024-09-21T09:03:00.227191+0000","last_unstale":"2024-09-21T09:03:38.465869+0000","last_undegraded":"2024-09-21T09:03:38.465869+0000","last_fullsized":"2024-09-21T09:03:38.465869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:51.194693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272617+0000","last_change":"2024-09-21T09:02:51.506704+0000","last_active":"2024-09-21T09:03:38.272617+0000","last_peered":"2024-09-21T09:03:38.272617+0000","last_clean":"2024-09-21T09:03:38.272617+0000","last_became_active":"2024-09-21T09:02:49.493605+0000","last_became_peered":"2024-09-21T09:02:49.493605+0000","last_unstale":"2024-09-21T09:03:38.272617+0000","last_undegraded":"2024-09-21T09:03:38.272617+0000","last_fullsized":"2024-09-21T09:03:38.272617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:33.820022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033020199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463162+0000","last_change":"2024-09-21T09:02:58.209627+0000","last_active":"2024-09-21T09:03:38.463162+0000","last_peered":"2024-09-21T09:03:38.463162+0000","last_clean":"2024-09-21T09:03:38.463162+0000","last_became_active":"2024-09-21T09:02:58.209343+0000","last_became_peered":"2024-09-21T09:02:58.209343+0000","last_unstale":"2024-09-21T09:03:38.463162+0000","last_undegraded":"2024-09-21T09:03:38.463162+0000","last_fullsized":"2024-09-21T09:03:38.463162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:14.606085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276272+0000","last_change":"2024-09-21T09:03:02.219332+0000","last_active":"2024-09-21T09:03:38.276272+0000","last_peered":"2024-09-21T09:03:38.276272+0000","last_clean":"2024-09-21T09:03:38.276272+0000","last_became_active":"2024-09-21T09:03:02.219067+0000","last_became_peered":"2024-09-21T09:03:02.219067+0000","last_unstale":"2024-09-21T09:03:38.276272+0000","last_undegraded":"2024-09-21T09:03:38.276272+0000","last_fullsized":"2024-09-21T09:03:38.276272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:05.617526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'17","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.268634+0000","last_change":"2024-09-21T09:03:04.231010+0000","last_active":"2024-09-21T09:06:06.268634+0000","last_peered":"2024-09-21T09:06:06.268634+0000","last_clean":"2024-09-21T09:06:06.268634+0000","last_became_active":"2024-09-21T09:03:04.230686+0000","last_became_peered":"2024-09-21T09:03:04.230686+0000","last_unstale":"2024-09-21T09:06:06.268634+0000","last_undegraded":"2024-09-21T09:06:06.268634+0000","last_fullsized":"2024-09-21T09:06:06.268634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:25.612043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466265+0000","last_change":"2024-09-21T09:03:06.248379+0000","last_active":"2024-09-21T09:03:38.466265+0000","last_peered":"2024-09-21T09:03:38.466265+0000","last_clean":"2024-09-21T09:03:38.466265+0000","last_became_active":"2024-09-21T09:03:06.248087+0000","last_became_peered":"2024-09-21T09:03:06.248087+0000","last_unstale":"2024-09-21T09:03:38.466265+0000","last_undegraded":"2024-09-21T09:03:38.466265+0000","last_fullsized":"2024-09-21T09:03:38.466265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:23.429533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271393+0000","last_change":"2024-09-21T09:03:08.259295+0000","last_active":"2024-09-21T09:03:38.271393+0000","last_peered":"2024-09-21T09:03:38.271393+0000","last_clean":"2024-09-21T09:03:38.271393+0000","last_became_active":"2024-09-21T09:03:08.258974+0000","last_became_peered":"2024-09-21T09:03:08.258974+0000","last_unstale":"2024-09-21T09:03:38.271393+0000","last_undegraded":"2024-09-21T09:03:38.271393+0000","last_fullsized":"2024-09-21T09:03:38.271393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:23.850104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'7","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.182044+0000","last_change":"2024-09-21T09:03:00.221607+0000","last_active":"2024-09-21T09:06:06.182044+0000","last_peered":"2024-09-21T09:06:06.182044+0000","last_clean":"2024-09-21T09:06:06.182044+0000","last_became_active":"2024-09-21T09:03:00.221080+0000","last_became_peered":"2024-09-21T09:03:00.221080+0000","last_unstale":"2024-09-21T09:06:06.182044+0000","last_undegraded":"2024-09-21T09:06:06.182044+0000","last_fullsized":"2024-09-21T09:06:06.182044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:53.039369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271511+0000","last_change":"2024-09-21T09:02:51.501105+0000","last_active":"2024-09-21T09:03:38.271511+0000","last_peered":"2024-09-21T09:03:38.271511+0000","last_clean":"2024-09-21T09:03:38.271511+0000","last_became_active":"2024-09-21T09:02:49.493348+0000","last_became_peered":"2024-09-21T09:02:49.493348+0000","last_unstale":"2024-09-21T09:03:38.271511+0000","last_undegraded":"2024-09-21T09:03:38.271511+0000","last_fullsized":"2024-09-21T09:03:38.271511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:12.805512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096028300000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.279362+0000","last_change":"2024-09-21T09:02:58.207996+0000","last_active":"2024-09-21T09:03:38.279362+0000","last_peered":"2024-09-21T09:03:38.279362+0000","last_clean":"2024-09-21T09:03:38.279362+0000","last_became_active":"2024-09-21T09:02:58.207236+0000","last_became_peered":"2024-09-21T09:02:58.207236+0000","last_unstale":"2024-09-21T09:03:38.279362+0000","last_undegraded":"2024-09-21T09:03:38.279362+0000","last_fullsized":"2024-09-21T09:03:38.279362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:38.066496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465166+0000","last_change":"2024-09-21T09:03:02.221735+0000","last_active":"2024-09-21T09:03:38.465166+0000","last_peered":"2024-09-21T09:03:38.465166+0000","last_clean":"2024-09-21T09:03:38.465166+0000","last_became_active":"2024-09-21T09:03:02.221310+0000","last_became_peered":"2024-09-21T09:03:02.221310+0000","last_unstale":"2024-09-21T09:03:38.465166+0000","last_undegraded":"2024-09-21T09:03:38.465166+0000","last_fullsized":"2024-09-21T09:03:38.465166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:07.127926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'13","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.727672+0000","last_change":"2024-09-21T09:03:04.243723+0000","last_active":"2024-09-21T09:06:05.727672+0000","last_peered":"2024-09-21T09:06:05.727672+0000","last_clean":"2024-09-21T09:06:05.727672+0000","last_became_active":"2024-09-21T09:03:04.243076+0000","last_became_peered":"2024-09-21T09:03:04.243076+0000","last_unstale":"2024-09-21T09:06:05.727672+0000","last_undegraded":"2024-09-21T09:06:05.727672+0000","last_fullsized":"2024-09-21T09:06:05.727672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:19.628532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276013+0000","last_change":"2024-09-21T09:03:06.250792+0000","last_active":"2024-09-21T09:03:38.276013+0000","last_peered":"2024-09-21T09:03:38.276013+0000","last_clean":"2024-09-21T09:03:38.276013+0000","last_became_active":"2024-09-21T09:03:06.250530+0000","last_became_peered":"2024-09-21T09:03:06.250530+0000","last_unstale":"2024-09-21T09:03:38.276013+0000","last_undegraded":"2024-09-21T09:03:38.276013+0000","last_fullsized":"2024-09-21T09:03:38.276013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:33.277141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.492123+0000","last_change":"2024-09-21T09:03:08.262588+0000","last_active":"2024-09-21T09:05:05.492123+0000","last_peered":"2024-09-21T09:05:05.492123+0000","last_clean":"2024-09-21T09:05:05.492123+0000","last_became_active":"2024-09-21T09:03:08.262240+0000","last_became_peered":"2024-09-21T09:03:08.262240+0000","last_unstale":"2024-09-21T09:05:05.492123+0000","last_undegraded":"2024-09-21T09:05:05.492123+0000","last_fullsized":"2024-09-21T09:05:05.492123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:11.429927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363318+0000","last_change":"2024-09-21T09:03:00.227032+0000","last_active":"2024-09-21T09:06:06.363318+0000","last_peered":"2024-09-21T09:06:06.363318+0000","last_clean":"2024-09-21T09:06:06.363318+0000","last_became_active":"2024-09-21T09:03:00.224297+0000","last_became_peered":"2024-09-21T09:03:00.224297+0000","last_unstale":"2024-09-21T09:06:06.363318+0000","last_undegraded":"2024-09-21T09:06:06.363318+0000","last_fullsized":"2024-09-21T09:06:06.363318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:20.245983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274931+0000","last_change":"2024-09-21T09:02:58.207055+0000","last_active":"2024-09-21T09:03:38.274931+0000","last_peered":"2024-09-21T09:03:38.274931+0000","last_clean":"2024-09-21T09:03:38.274931+0000","last_became_active":"2024-09-21T09:02:58.206718+0000","last_became_peered":"2024-09-21T09:02:58.206718+0000","last_unstale":"2024-09-21T09:03:38.274931+0000","last_undegraded":"2024-09-21T09:03:38.274931+0000","last_fullsized":"2024-09-21T09:03:38.274931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:08.728738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466210+0000","last_change":"2024-09-21T09:02:51.498275+0000","last_active":"2024-09-21T09:03:38.466210+0000","last_peered":"2024-09-21T09:03:38.466210+0000","last_clean":"2024-09-21T09:03:38.466210+0000","last_became_active":"2024-09-21T09:02:49.493509+0000","last_became_peered":"2024-09-21T09:02:49.493509+0000","last_unstale":"2024-09-21T09:03:38.466210+0000","last_undegraded":"2024-09-21T09:03:38.466210+0000","last_fullsized":"2024-09-21T09:03:38.466210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:48.460775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038981200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453822+0000","last_change":"2024-09-21T09:03:02.221871+0000","last_active":"2024-09-21T09:05:07.453822+0000","last_peered":"2024-09-21T09:05:07.453822+0000","last_clean":"2024-09-21T09:05:07.453822+0000","last_became_active":"2024-09-21T09:03:02.221309+0000","last_became_peered":"2024-09-21T09:03:02.221309+0000","last_unstale":"2024-09-21T09:05:07.453822+0000","last_undegraded":"2024-09-21T09:05:07.453822+0000","last_fullsized":"2024-09-21T09:05:07.453822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:23.063609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'61","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453751+0000","last_change":"2024-09-21T09:03:04.243555+0000","last_active":"2024-09-21T09:05:07.453751+0000","last_peered":"2024-09-21T09:05:07.453751+0000","last_clean":"2024-09-21T09:05:07.453751+0000","last_became_active":"2024-09-21T09:03:04.243228+0000","last_became_peered":"2024-09-21T09:03:04.243228+0000","last_unstale":"2024-09-21T09:05:07.453751+0000","last_undegraded":"2024-09-21T09:05:07.453751+0000","last_fullsized":"2024-09-21T09:05:07.453751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:28.764693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272915+0000","last_change":"2024-09-21T09:03:06.246855+0000","last_active":"2024-09-21T09:03:38.272915+0000","last_peered":"2024-09-21T09:03:38.272915+0000","last_clean":"2024-09-21T09:03:38.272915+0000","last_became_active":"2024-09-21T09:03:06.246598+0000","last_became_peered":"2024-09-21T09:03:06.246598+0000","last_unstale":"2024-09-21T09:03:38.272915+0000","last_undegraded":"2024-09-21T09:03:38.272915+0000","last_fullsized":"2024-09-21T09:03:38.272915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:13.435386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.657366+0000","last_change":"2024-09-21T09:03:08.251063+0000","last_active":"2024-09-21T09:05:05.657366+0000","last_peered":"2024-09-21T09:05:05.657366+0000","last_clean":"2024-09-21T09:05:05.657366+0000","last_became_active":"2024-09-21T09:03:08.250714+0000","last_became_peered":"2024-09-21T09:03:08.250714+0000","last_unstale":"2024-09-21T09:05:05.657366+0000","last_undegraded":"2024-09-21T09:05:05.657366+0000","last_fullsized":"2024-09-21T09:05:05.657366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:01.596559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'10","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173544+0000","last_change":"2024-09-21T09:03:38.286969+0000","last_active":"2024-09-21T09:06:06.173544+0000","last_peered":"2024-09-21T09:06:06.173544+0000","last_clean":"2024-09-21T09:06:06.173544+0000","last_became_active":"2024-09-21T09:03:38.282889+0000","last_became_peered":"2024-09-21T09:03:38.282889+0000","last_unstale":"2024-09-21T09:06:06.173544+0000","last_undegraded":"2024-09-21T09:06:06.173544+0000","last_fullsized":"2024-09-21T09:06:06.173544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:56.518385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.752145+0000","last_change":"2024-09-21T09:02:58.208957+0000","last_active":"2024-09-21T09:03:38.752145+0000","last_peered":"2024-09-21T09:03:38.752145+0000","last_clean":"2024-09-21T09:03:38.752145+0000","last_became_active":"2024-09-21T09:02:58.208569+0000","last_became_peered":"2024-09-21T09:02:58.208569+0000","last_unstale":"2024-09-21T09:03:38.752145+0000","last_undegraded":"2024-09-21T09:03:38.752145+0000","last_fullsized":"2024-09-21T09:03:38.752145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:43:46.150242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278210+0000","last_change":"2024-09-21T09:02:51.501475+0000","last_active":"2024-09-21T09:03:38.278210+0000","last_peered":"2024-09-21T09:03:38.278210+0000","last_clean":"2024-09-21T09:03:38.278210+0000","last_became_active":"2024-09-21T09:02:49.493469+0000","last_became_peered":"2024-09-21T09:02:49.493469+0000","last_unstale":"2024-09-21T09:03:38.278210+0000","last_undegraded":"2024-09-21T09:03:38.278210+0000","last_fullsized":"2024-09-21T09:03:38.278210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:23.397410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001228114,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271668+0000","last_change":"2024-09-21T09:03:02.218570+0000","last_active":"2024-09-21T09:03:38.271668+0000","last_peered":"2024-09-21T09:03:38.271668+0000","last_clean":"2024-09-21T09:03:38.271668+0000","last_became_active":"2024-09-21T09:03:02.218232+0000","last_became_peered":"2024-09-21T09:03:02.218232+0000","last_unstale":"2024-09-21T09:03:38.271668+0000","last_undegraded":"2024-09-21T09:03:38.271668+0000","last_fullsized":"2024-09-21T09:03:38.271668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:18.210878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273881+0000","last_change":"2024-09-21T09:03:04.241792+0000","last_active":"2024-09-21T09:03:38.273881+0000","last_peered":"2024-09-21T09:03:38.273881+0000","last_clean":"2024-09-21T09:03:38.273881+0000","last_became_active":"2024-09-21T09:03:04.241500+0000","last_became_peered":"2024-09-21T09:03:04.241500+0000","last_unstale":"2024-09-21T09:03:38.273881+0000","last_undegraded":"2024-09-21T09:03:38.273881+0000","last_fullsized":"2024-09-21T09:03:38.273881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:13.085591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'282","reported_seq":354,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:02.304345+0000","last_change":"2024-09-21T09:03:06.249606+0000","last_active":"2024-09-21T09:06:02.304345+0000","last_peered":"2024-09-21T09:06:02.304345+0000","last_clean":"2024-09-21T09:06:02.304345+0000","last_became_active":"2024-09-21T09:03:06.249303+0000","last_became_peered":"2024-09-21T09:03:06.249303+0000","last_unstale":"2024-09-21T09:06:02.304345+0000","last_undegraded":"2024-09-21T09:06:02.304345+0000","last_fullsized":"2024-09-21T09:06:02.304345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.216872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275702+0000","last_change":"2024-09-21T09:03:08.264861+0000","last_active":"2024-09-21T09:03:38.275702+0000","last_peered":"2024-09-21T09:03:38.275702+0000","last_clean":"2024-09-21T09:03:38.275702+0000","last_became_active":"2024-09-21T09:03:08.264322+0000","last_became_peered":"2024-09-21T09:03:08.264322+0000","last_unstale":"2024-09-21T09:03:38.275702+0000","last_undegraded":"2024-09-21T09:03:38.275702+0000","last_fullsized":"2024-09-21T09:03:38.275702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:40.391041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.280043+0000","last_change":"2024-09-21T09:03:38.277961+0000","last_active":"2024-09-21T09:03:38.280043+0000","last_peered":"2024-09-21T09:03:38.280043+0000","last_clean":"2024-09-21T09:03:38.280043+0000","last_became_active":"2024-09-21T09:03:38.277629+0000","last_became_peered":"2024-09-21T09:03:38.277629+0000","last_unstale":"2024-09-21T09:03:38.280043+0000","last_undegraded":"2024-09-21T09:03:38.280043+0000","last_fullsized":"2024-09-21T09:03:38.280043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:59:16.786827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.670946+0000","last_change":"2024-09-21T09:02:58.223891+0000","last_active":"2024-09-21T09:05:05.670946+0000","last_peered":"2024-09-21T09:05:05.670946+0000","last_clean":"2024-09-21T09:05:05.670946+0000","last_became_active":"2024-09-21T09:02:58.223652+0000","last_became_peered":"2024-09-21T09:02:58.223652+0000","last_unstale":"2024-09-21T09:05:05.670946+0000","last_undegraded":"2024-09-21T09:05:05.670946+0000","last_fullsized":"2024-09-21T09:05:05.670946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:51.491682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465258+0000","last_change":"2024-09-21T09:02:51.498192+0000","last_active":"2024-09-21T09:03:38.465258+0000","last_peered":"2024-09-21T09:03:38.465258+0000","last_clean":"2024-09-21T09:03:38.465258+0000","last_became_active":"2024-09-21T09:02:49.493144+0000","last_became_peered":"2024-09-21T09:02:49.493144+0000","last_unstale":"2024-09-21T09:03:38.465258+0000","last_undegraded":"2024-09-21T09:03:38.465258+0000","last_fullsized":"2024-09-21T09:03:38.465258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:04.340866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042500699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271170+0000","last_change":"2024-09-21T09:03:02.219747+0000","last_active":"2024-09-21T09:03:38.271170+0000","last_peered":"2024-09-21T09:03:38.271170+0000","last_clean":"2024-09-21T09:03:38.271170+0000","last_became_active":"2024-09-21T09:03:02.219133+0000","last_became_peered":"2024-09-21T09:03:02.219133+0000","last_unstale":"2024-09-21T09:03:38.271170+0000","last_undegraded":"2024-09-21T09:03:38.271170+0000","last_fullsized":"2024-09-21T09:03:38.271170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:11.438389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273948+0000","last_change":"2024-09-21T09:03:04.241801+0000","last_active":"2024-09-21T09:03:38.273948+0000","last_peered":"2024-09-21T09:03:38.273948+0000","last_clean":"2024-09-21T09:03:38.273948+0000","last_became_active":"2024-09-21T09:03:04.241256+0000","last_became_peered":"2024-09-21T09:03:04.241256+0000","last_unstale":"2024-09-21T09:03:38.273948+0000","last_undegraded":"2024-09-21T09:03:38.273948+0000","last_fullsized":"2024-09-21T09:03:38.273948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:52.487954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'282","reported_seq":428,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.456684+0000","last_change":"2024-09-21T09:03:06.244206+0000","last_active":"2024-09-21T09:06:06.456684+0000","last_peered":"2024-09-21T09:06:06.456684+0000","last_clean":"2024-09-21T09:06:06.456684+0000","last_became_active":"2024-09-21T09:03:06.243566+0000","last_became_peered":"2024-09-21T09:03:06.243566+0000","last_unstale":"2024-09-21T09:06:06.456684+0000","last_undegraded":"2024-09-21T09:06:06.456684+0000","last_fullsized":"2024-09-21T09:06:06.456684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:40.536244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274538+0000","last_change":"2024-09-21T09:03:08.262736+0000","last_active":"2024-09-21T09:03:38.274538+0000","last_peered":"2024-09-21T09:03:38.274538+0000","last_clean":"2024-09-21T09:03:38.274538+0000","last_became_active":"2024-09-21T09:03:08.262460+0000","last_became_peered":"2024-09-21T09:03:08.262460+0000","last_unstale":"2024-09-21T09:03:38.274538+0000","last_undegraded":"2024-09-21T09:03:38.274538+0000","last_fullsized":"2024-09-21T09:03:38.274538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:09.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'14","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.081970+0000","last_change":"2024-09-21T09:03:00.218617+0000","last_active":"2024-09-21T09:06:06.081970+0000","last_peered":"2024-09-21T09:06:06.081970+0000","last_clean":"2024-09-21T09:06:06.081970+0000","last_became_active":"2024-09-21T09:03:00.216782+0000","last_became_peered":"2024-09-21T09:03:00.216782+0000","last_unstale":"2024-09-21T09:06:06.081970+0000","last_undegraded":"2024-09-21T09:06:06.081970+0000","last_fullsized":"2024-09-21T09:06:06.081970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:30.927993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276170+0000","last_change":"2024-09-21T09:02:58.213576+0000","last_active":"2024-09-21T09:03:38.276170+0000","last_peered":"2024-09-21T09:03:38.276170+0000","last_clean":"2024-09-21T09:03:38.276170+0000","last_became_active":"2024-09-21T09:02:58.213293+0000","last_became_peered":"2024-09-21T09:02:58.213293+0000","last_unstale":"2024-09-21T09:03:38.276170+0000","last_undegraded":"2024-09-21T09:03:38.276170+0000","last_fullsized":"2024-09-21T09:03:38.276170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:52.024304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276092+0000","last_change":"2024-09-21T09:02:51.501161+0000","last_active":"2024-09-21T09:03:38.276092+0000","last_peered":"2024-09-21T09:03:38.276092+0000","last_clean":"2024-09-21T09:03:38.276092+0000","last_became_active":"2024-09-21T09:02:49.542160+0000","last_became_peered":"2024-09-21T09:02:49.542160+0000","last_unstale":"2024-09-21T09:03:38.276092+0000","last_undegraded":"2024-09-21T09:03:38.276092+0000","last_fullsized":"2024-09-21T09:03:38.276092+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:18.503834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099618800000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271683+0000","last_change":"2024-09-21T09:03:02.218497+0000","last_active":"2024-09-21T09:03:38.271683+0000","last_peered":"2024-09-21T09:03:38.271683+0000","last_clean":"2024-09-21T09:03:38.271683+0000","last_became_active":"2024-09-21T09:03:02.218138+0000","last_became_peered":"2024-09-21T09:03:02.218138+0000","last_unstale":"2024-09-21T09:03:38.271683+0000","last_undegraded":"2024-09-21T09:03:38.271683+0000","last_fullsized":"2024-09-21T09:03:38.271683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:08.671338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'83","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455214+0000","last_change":"2024-09-21T09:03:04.232064+0000","last_active":"2024-09-21T09:05:12.455214+0000","last_peered":"2024-09-21T09:05:12.455214+0000","last_clean":"2024-09-21T09:05:12.455214+0000","last_became_active":"2024-09-21T09:03:04.231708+0000","last_became_peered":"2024-09-21T09:03:04.231708+0000","last_unstale":"2024-09-21T09:05:12.455214+0000","last_undegraded":"2024-09-21T09:05:12.455214+0000","last_fullsized":"2024-09-21T09:05:12.455214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:03.027213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6027,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463881+0000","last_change":"2024-09-21T09:03:06.249786+0000","last_active":"2024-09-21T09:03:38.463881+0000","last_peered":"2024-09-21T09:03:38.463881+0000","last_clean":"2024-09-21T09:03:38.463881+0000","last_became_active":"2024-09-21T09:03:06.249474+0000","last_became_peered":"2024-09-21T09:03:06.249474+0000","last_unstale":"2024-09-21T09:03:38.463881+0000","last_undegraded":"2024-09-21T09:03:38.463881+0000","last_fullsized":"2024-09-21T09:03:38.463881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.466336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273844+0000","last_change":"2024-09-21T09:03:08.252824+0000","last_active":"2024-09-21T09:03:38.273844+0000","last_peered":"2024-09-21T09:03:38.273844+0000","last_clean":"2024-09-21T09:03:38.273844+0000","last_became_active":"2024-09-21T09:03:08.252363+0000","last_became_peered":"2024-09-21T09:03:08.252363+0000","last_unstale":"2024-09-21T09:03:38.273844+0000","last_undegraded":"2024-09-21T09:03:38.273844+0000","last_fullsized":"2024-09-21T09:03:38.273844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:05.753776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.850611+0000","last_change":"2024-09-21T09:03:08.256842+0000","last_active":"2024-09-21T09:03:39.850611+0000","last_peered":"2024-09-21T09:03:39.850611+0000","last_clean":"2024-09-21T09:03:39.850611+0000","last_became_active":"2024-09-21T09:03:08.256571+0000","last_became_peered":"2024-09-21T09:03:08.256571+0000","last_unstale":"2024-09-21T09:03:39.850611+0000","last_undegraded":"2024-09-21T09:03:39.850611+0000","last_fullsized":"2024-09-21T09:03:39.850611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:39.409841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'12","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.301323+0000","last_change":"2024-09-21T09:03:38.470029+0000","last_active":"2024-09-21T09:03:39.301323+0000","last_peered":"2024-09-21T09:03:39.301323+0000","last_clean":"2024-09-21T09:03:39.301323+0000","last_became_active":"2024-09-21T09:03:38.466274+0000","last_became_peered":"2024-09-21T09:03:38.466274+0000","last_unstale":"2024-09-21T09:03:39.301323+0000","last_undegraded":"2024-09-21T09:03:39.301323+0000","last_fullsized":"2024-09-21T09:03:39.301323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:38.626004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275410+0000","last_change":"2024-09-21T09:02:58.221038+0000","last_active":"2024-09-21T09:03:38.275410+0000","last_peered":"2024-09-21T09:03:38.275410+0000","last_clean":"2024-09-21T09:03:38.275410+0000","last_became_active":"2024-09-21T09:02:58.220716+0000","last_became_peered":"2024-09-21T09:02:58.220716+0000","last_unstale":"2024-09-21T09:03:38.275410+0000","last_undegraded":"2024-09-21T09:03:38.275410+0000","last_fullsized":"2024-09-21T09:03:38.275410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:36.863978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274326+0000","last_change":"2024-09-21T09:03:02.220312+0000","last_active":"2024-09-21T09:03:38.274326+0000","last_peered":"2024-09-21T09:03:38.274326+0000","last_clean":"2024-09-21T09:03:38.274326+0000","last_became_active":"2024-09-21T09:03:02.219652+0000","last_became_peered":"2024-09-21T09:03:02.219652+0000","last_unstale":"2024-09-21T09:03:38.274326+0000","last_undegraded":"2024-09-21T09:03:38.274326+0000","last_fullsized":"2024-09-21T09:03:38.274326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:42.719585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'32","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.356322+0000","last_change":"2024-09-21T09:03:04.241932+0000","last_active":"2024-09-21T09:05:04.356322+0000","last_peered":"2024-09-21T09:05:04.356322+0000","last_clean":"2024-09-21T09:05:04.356322+0000","last_became_active":"2024-09-21T09:03:04.241612+0000","last_became_peered":"2024-09-21T09:03:04.241612+0000","last_unstale":"2024-09-21T09:05:04.356322+0000","last_undegraded":"2024-09-21T09:05:04.356322+0000","last_fullsized":"2024-09-21T09:05:04.356322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:31.245640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271493+0000","last_change":"2024-09-21T09:03:06.251100+0000","last_active":"2024-09-21T09:03:38.271493+0000","last_peered":"2024-09-21T09:03:38.271493+0000","last_clean":"2024-09-21T09:03:38.271493+0000","last_became_active":"2024-09-21T09:03:06.250750+0000","last_became_peered":"2024-09-21T09:03:06.250750+0000","last_unstale":"2024-09-21T09:03:38.271493+0000","last_undegraded":"2024-09-21T09:03:38.271493+0000","last_fullsized":"2024-09-21T09:03:38.271493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:22.776215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'11","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.068447+0000","last_change":"2024-09-21T09:03:08.259980+0000","last_active":"2024-09-21T09:05:04.068447+0000","last_peered":"2024-09-21T09:05:04.068447+0000","last_clean":"2024-09-21T09:05:04.068447+0000","last_became_active":"2024-09-21T09:03:08.259602+0000","last_became_peered":"2024-09-21T09:03:08.259602+0000","last_unstale":"2024-09-21T09:05:04.068447+0000","last_undegraded":"2024-09-21T09:05:04.068447+0000","last_fullsized":"2024-09-21T09:05:04.068447+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:33:24.939446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.257843+0000","last_change":"2024-09-21T09:03:00.227394+0000","last_active":"2024-09-21T09:04:22.257843+0000","last_peered":"2024-09-21T09:04:22.257843+0000","last_clean":"2024-09-21T09:04:22.257843+0000","last_became_active":"2024-09-21T09:03:00.225811+0000","last_became_peered":"2024-09-21T09:03:00.225811+0000","last_unstale":"2024-09-21T09:04:22.257843+0000","last_undegraded":"2024-09-21T09:04:22.257843+0000","last_fullsized":"2024-09-21T09:04:22.257843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:51.194693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.281638+0000","last_change":"2024-09-21T09:03:38.280883+0000","last_active":"2024-09-21T09:03:38.281638+0000","last_peered":"2024-09-21T09:03:38.281638+0000","last_clean":"2024-09-21T09:03:38.281638+0000","last_became_active":"2024-09-21T09:03:38.280539+0000","last_became_peered":"2024-09-21T09:03:38.280539+0000","last_unstale":"2024-09-21T09:03:38.281638+0000","last_undegraded":"2024-09-21T09:03:38.281638+0000","last_fullsized":"2024-09-21T09:03:38.281638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:13.642910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278296+0000","last_change":"2024-09-21T09:03:02.223011+0000","last_active":"2024-09-21T09:03:38.278296+0000","last_peered":"2024-09-21T09:03:38.278296+0000","last_clean":"2024-09-21T09:03:38.278296+0000","last_became_active":"2024-09-21T09:03:02.222474+0000","last_became_peered":"2024-09-21T09:03:02.222474+0000","last_unstale":"2024-09-21T09:03:38.278296+0000","last_undegraded":"2024-09-21T09:03:38.278296+0000","last_fullsized":"2024-09-21T09:03:38.278296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:54.497438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'6","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.732315+0000","last_change":"2024-09-21T09:03:04.232760+0000","last_active":"2024-09-21T09:06:05.732315+0000","last_peered":"2024-09-21T09:06:05.732315+0000","last_clean":"2024-09-21T09:06:05.732315+0000","last_became_active":"2024-09-21T09:03:04.232474+0000","last_became_peered":"2024-09-21T09:03:04.232474+0000","last_unstale":"2024-09-21T09:06:05.732315+0000","last_undegraded":"2024-09-21T09:06:05.732315+0000","last_fullsized":"2024-09-21T09:06:05.732315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:11.420156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272717+0000","last_change":"2024-09-21T09:03:06.251118+0000","last_active":"2024-09-21T09:03:38.272717+0000","last_peered":"2024-09-21T09:03:38.272717+0000","last_clean":"2024-09-21T09:03:38.272717+0000","last_became_active":"2024-09-21T09:03:06.250773+0000","last_became_peered":"2024-09-21T09:03:06.250773+0000","last_unstale":"2024-09-21T09:03:38.272717+0000","last_undegraded":"2024-09-21T09:03:38.272717+0000","last_fullsized":"2024-09-21T09:03:38.272717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:30.352901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464626+0000","last_change":"2024-09-21T09:03:08.250971+0000","last_active":"2024-09-21T09:03:38.464626+0000","last_peered":"2024-09-21T09:03:38.464626+0000","last_clean":"2024-09-21T09:03:38.464626+0000","last_became_active":"2024-09-21T09:03:08.250617+0000","last_became_peered":"2024-09-21T09:03:08.250617+0000","last_unstale":"2024-09-21T09:03:38.464626+0000","last_undegraded":"2024-09-21T09:03:38.464626+0000","last_fullsized":"2024-09-21T09:03:38.464626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:54.090547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363198+0000","last_change":"2024-09-21T09:03:00.216088+0000","last_active":"2024-09-21T09:06:06.363198+0000","last_peered":"2024-09-21T09:06:06.363198+0000","last_clean":"2024-09-21T09:06:06.363198+0000","last_became_active":"2024-09-21T09:03:00.215591+0000","last_became_peered":"2024-09-21T09:03:00.215591+0000","last_unstale":"2024-09-21T09:06:06.363198+0000","last_undegraded":"2024-09-21T09:06:06.363198+0000","last_fullsized":"2024-09-21T09:06:06.363198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:32.562147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.251242+0000","last_change":"2024-09-21T09:02:58.218920+0000","last_active":"2024-09-21T09:06:06.251242+0000","last_peered":"2024-09-21T09:06:06.251242+0000","last_clean":"2024-09-21T09:06:06.251242+0000","last_became_active":"2024-09-21T09:02:58.217931+0000","last_became_peered":"2024-09-21T09:02:58.217931+0000","last_unstale":"2024-09-21T09:06:06.251242+0000","last_undegraded":"2024-09-21T09:06:06.251242+0000","last_fullsized":"2024-09-21T09:06:06.251242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:07.674387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272263+0000","last_change":"2024-09-21T09:03:02.219569+0000","last_active":"2024-09-21T09:03:38.272263+0000","last_peered":"2024-09-21T09:03:38.272263+0000","last_clean":"2024-09-21T09:03:38.272263+0000","last_became_active":"2024-09-21T09:03:02.219265+0000","last_became_peered":"2024-09-21T09:03:02.219265+0000","last_unstale":"2024-09-21T09:03:38.272263+0000","last_undegraded":"2024-09-21T09:03:38.272263+0000","last_fullsized":"2024-09-21T09:03:38.272263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:22.253418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'40","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.788569+0000","last_change":"2024-09-21T09:03:04.233795+0000","last_active":"2024-09-21T09:06:05.788569+0000","last_peered":"2024-09-21T09:06:05.788569+0000","last_clean":"2024-09-21T09:06:05.788569+0000","last_became_active":"2024-09-21T09:03:04.233393+0000","last_became_peered":"2024-09-21T09:03:04.233393+0000","last_unstale":"2024-09-21T09:06:05.788569+0000","last_undegraded":"2024-09-21T09:06:05.788569+0000","last_fullsized":"2024-09-21T09:06:05.788569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:49.815772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273436+0000","last_change":"2024-09-21T09:03:06.249268+0000","last_active":"2024-09-21T09:03:38.273436+0000","last_peered":"2024-09-21T09:03:38.273436+0000","last_clean":"2024-09-21T09:03:38.273436+0000","last_became_active":"2024-09-21T09:03:06.248954+0000","last_became_peered":"2024-09-21T09:03:06.248954+0000","last_unstale":"2024-09-21T09:03:38.273436+0000","last_undegraded":"2024-09-21T09:03:38.273436+0000","last_fullsized":"2024-09-21T09:03:38.273436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:09.672283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271808+0000","last_change":"2024-09-21T09:03:08.265248+0000","last_active":"2024-09-21T09:03:38.271808+0000","last_peered":"2024-09-21T09:03:38.271808+0000","last_clean":"2024-09-21T09:03:38.271808+0000","last_became_active":"2024-09-21T09:03:08.264778+0000","last_became_peered":"2024-09-21T09:03:08.264778+0000","last_unstale":"2024-09-21T09:03:38.271808+0000","last_undegraded":"2024-09-21T09:03:38.271808+0000","last_fullsized":"2024-09-21T09:03:38.271808+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:37.665220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271312+0000","last_change":"2024-09-21T09:03:00.218521+0000","last_active":"2024-09-21T09:03:38.271312+0000","last_peered":"2024-09-21T09:03:38.271312+0000","last_clean":"2024-09-21T09:03:38.271312+0000","last_became_active":"2024-09-21T09:03:00.218259+0000","last_became_peered":"2024-09-21T09:03:00.218259+0000","last_unstale":"2024-09-21T09:03:38.271312+0000","last_undegraded":"2024-09-21T09:03:38.271312+0000","last_fullsized":"2024-09-21T09:03:38.271312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:08.734463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.358977+0000","last_change":"2024-09-21T09:02:58.207817+0000","last_active":"2024-09-21T09:06:06.358977+0000","last_peered":"2024-09-21T09:06:06.358977+0000","last_clean":"2024-09-21T09:06:06.358977+0000","last_became_active":"2024-09-21T09:02:58.207533+0000","last_became_peered":"2024-09-21T09:02:58.207533+0000","last_unstale":"2024-09-21T09:06:06.358977+0000","last_undegraded":"2024-09-21T09:06:06.358977+0000","last_fullsized":"2024-09-21T09:06:06.358977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.813396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271267+0000","last_change":"2024-09-21T09:03:02.219788+0000","last_active":"2024-09-21T09:03:38.271267+0000","last_peered":"2024-09-21T09:03:38.271267+0000","last_clean":"2024-09-21T09:03:38.271267+0000","last_became_active":"2024-09-21T09:03:02.219509+0000","last_became_peered":"2024-09-21T09:03:02.219509+0000","last_unstale":"2024-09-21T09:03:38.271267+0000","last_undegraded":"2024-09-21T09:03:38.271267+0000","last_fullsized":"2024-09-21T09:03:38.271267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:16.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.342422+0000","last_change":"2024-09-21T09:03:04.234223+0000","last_active":"2024-09-21T09:05:04.342422+0000","last_peered":"2024-09-21T09:05:04.342422+0000","last_clean":"2024-09-21T09:05:04.342422+0000","last_became_active":"2024-09-21T09:03:04.233913+0000","last_became_peered":"2024-09-21T09:03:04.233913+0000","last_unstale":"2024-09-21T09:05:04.342422+0000","last_undegraded":"2024-09-21T09:05:04.342422+0000","last_fullsized":"2024-09-21T09:05:04.342422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:42.001541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.279968+0000","last_change":"2024-09-21T09:03:06.241090+0000","last_active":"2024-09-21T09:03:38.279968+0000","last_peered":"2024-09-21T09:03:38.279968+0000","last_clean":"2024-09-21T09:03:38.279968+0000","last_became_active":"2024-09-21T09:03:06.240791+0000","last_became_peered":"2024-09-21T09:03:06.240791+0000","last_unstale":"2024-09-21T09:03:38.279968+0000","last_undegraded":"2024-09-21T09:03:38.279968+0000","last_fullsized":"2024-09-21T09:03:38.279968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:15.100821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260935+0000","last_change":"2024-09-21T09:03:00.216592+0000","last_active":"2024-09-21T09:06:06.260935+0000","last_peered":"2024-09-21T09:06:06.260935+0000","last_clean":"2024-09-21T09:06:06.260935+0000","last_became_active":"2024-09-21T09:03:00.216319+0000","last_became_peered":"2024-09-21T09:03:00.216319+0000","last_unstale":"2024-09-21T09:06:06.260935+0000","last_undegraded":"2024-09-21T09:06:06.260935+0000","last_fullsized":"2024-09-21T09:06:06.260935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:47.869465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270661+0000","last_change":"2024-09-21T09:02:58.214752+0000","last_active":"2024-09-21T09:03:38.270661+0000","last_peered":"2024-09-21T09:03:38.270661+0000","last_clean":"2024-09-21T09:03:38.270661+0000","last_became_active":"2024-09-21T09:02:58.214494+0000","last_became_peered":"2024-09-21T09:02:58.214494+0000","last_unstale":"2024-09-21T09:03:38.270661+0000","last_undegraded":"2024-09-21T09:03:38.270661+0000","last_fullsized":"2024-09-21T09:03:38.270661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:10.892304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"31'4","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.368025+0000","last_change":"2024-09-21T09:03:02.222025+0000","last_active":"2024-09-21T09:05:05.368025+0000","last_peered":"2024-09-21T09:05:05.368025+0000","last_clean":"2024-09-21T09:05:05.368025+0000","last_became_active":"2024-09-21T09:03:02.221586+0000","last_became_peered":"2024-09-21T09:03:02.221586+0000","last_unstale":"2024-09-21T09:05:05.368025+0000","last_undegraded":"2024-09-21T09:05:05.368025+0000","last_fullsized":"2024-09-21T09:05:05.368025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:39.990777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'55","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:37.458245+0000","last_change":"2024-09-21T09:03:04.234015+0000","last_active":"2024-09-21T09:05:37.458245+0000","last_peered":"2024-09-21T09:05:37.458245+0000","last_clean":"2024-09-21T09:05:37.458245+0000","last_became_active":"2024-09-21T09:03:04.233734+0000","last_became_peered":"2024-09-21T09:03:04.233734+0000","last_unstale":"2024-09-21T09:05:37.458245+0000","last_undegraded":"2024-09-21T09:05:37.458245+0000","last_fullsized":"2024-09-21T09:05:37.458245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:48.554737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276740+0000","last_change":"2024-09-21T09:03:06.241254+0000","last_active":"2024-09-21T09:03:38.276740+0000","last_peered":"2024-09-21T09:03:38.276740+0000","last_clean":"2024-09-21T09:03:38.276740+0000","last_became_active":"2024-09-21T09:03:06.240975+0000","last_became_peered":"2024-09-21T09:03:06.240975+0000","last_unstale":"2024-09-21T09:03:38.276740+0000","last_undegraded":"2024-09-21T09:03:38.276740+0000","last_fullsized":"2024-09-21T09:03:38.276740+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:50.569967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'18","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.287382+0000","last_change":"2024-09-21T09:03:08.254283+0000","last_active":"2024-09-21T09:06:06.287382+0000","last_peered":"2024-09-21T09:06:06.287382+0000","last_clean":"2024-09-21T09:06:06.287382+0000","last_became_active":"2024-09-21T09:03:08.253904+0000","last_became_peered":"2024-09-21T09:03:08.253904+0000","last_unstale":"2024-09-21T09:06:06.287382+0000","last_undegraded":"2024-09-21T09:06:06.287382+0000","last_fullsized":"2024-09-21T09:06:06.287382+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:42.273122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'10","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173892+0000","last_change":"2024-09-21T09:03:00.216793+0000","last_active":"2024-09-21T09:06:06.173892+0000","last_peered":"2024-09-21T09:06:06.173892+0000","last_clean":"2024-09-21T09:06:06.173892+0000","last_became_active":"2024-09-21T09:03:00.216238+0000","last_became_peered":"2024-09-21T09:03:00.216238+0000","last_unstale":"2024-09-21T09:06:06.173892+0000","last_undegraded":"2024-09-21T09:06:06.173892+0000","last_fullsized":"2024-09-21T09:06:06.173892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:39.266159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456857+0000","last_change":"2024-09-21T09:02:58.207174+0000","last_active":"2024-09-21T09:05:22.456857+0000","last_peered":"2024-09-21T09:05:22.456857+0000","last_clean":"2024-09-21T09:05:22.456857+0000","last_became_active":"2024-09-21T09:02:58.206879+0000","last_became_peered":"2024-09-21T09:02:58.206879+0000","last_unstale":"2024-09-21T09:05:22.456857+0000","last_undegraded":"2024-09-21T09:05:22.456857+0000","last_fullsized":"2024-09-21T09:05:22.456857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:51.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.280797+0000","last_change":"2024-09-21T09:03:02.218652+0000","last_active":"2024-09-21T09:03:38.280797+0000","last_peered":"2024-09-21T09:03:38.280797+0000","last_clean":"2024-09-21T09:03:38.280797+0000","last_became_active":"2024-09-21T09:03:02.218381+0000","last_became_peered":"2024-09-21T09:03:02.218381+0000","last_unstale":"2024-09-21T09:03:38.280797+0000","last_undegraded":"2024-09-21T09:03:38.280797+0000","last_fullsized":"2024-09-21T09:03:38.280797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:00.802033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'37","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.343375+0000","last_change":"2024-09-21T09:03:04.241328+0000","last_active":"2024-09-21T09:05:04.343375+0000","last_peered":"2024-09-21T09:05:04.343375+0000","last_clean":"2024-09-21T09:05:04.343375+0000","last_became_active":"2024-09-21T09:03:04.240933+0000","last_became_peered":"2024-09-21T09:03:04.240933+0000","last_unstale":"2024-09-21T09:05:04.343375+0000","last_undegraded":"2024-09-21T09:05:04.343375+0000","last_fullsized":"2024-09-21T09:05:04.343375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:37.814664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277445+0000","last_change":"2024-09-21T09:03:06.247452+0000","last_active":"2024-09-21T09:03:38.277445+0000","last_peered":"2024-09-21T09:03:38.277445+0000","last_clean":"2024-09-21T09:03:38.277445+0000","last_became_active":"2024-09-21T09:03:06.247153+0000","last_became_peered":"2024-09-21T09:03:06.247153+0000","last_unstale":"2024-09-21T09:03:38.277445+0000","last_undegraded":"2024-09-21T09:03:38.277445+0000","last_fullsized":"2024-09-21T09:03:38.277445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:41.912327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.104216+0000","last_change":"2024-09-21T09:03:08.262999+0000","last_active":"2024-09-21T09:06:06.104216+0000","last_peered":"2024-09-21T09:06:06.104216+0000","last_clean":"2024-09-21T09:06:06.104216+0000","last_became_active":"2024-09-21T09:03:08.262680+0000","last_became_peered":"2024-09-21T09:03:08.262680+0000","last_unstale":"2024-09-21T09:06:06.104216+0000","last_undegraded":"2024-09-21T09:06:06.104216+0000","last_fullsized":"2024-09-21T09:06:06.104216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:50.139788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278824+0000","last_change":"2024-09-21T09:03:00.224630+0000","last_active":"2024-09-21T09:03:38.278824+0000","last_peered":"2024-09-21T09:03:38.278824+0000","last_clean":"2024-09-21T09:03:38.278824+0000","last_became_active":"2024-09-21T09:03:00.219653+0000","last_became_peered":"2024-09-21T09:03:00.219653+0000","last_unstale":"2024-09-21T09:03:38.278824+0000","last_undegraded":"2024-09-21T09:03:38.278824+0000","last_fullsized":"2024-09-21T09:03:38.278824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:46.305418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'3","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.062776+0000","last_change":"2024-09-21T09:02:58.202783+0000","last_active":"2024-09-21T09:04:22.062776+0000","last_peered":"2024-09-21T09:04:22.062776+0000","last_clean":"2024-09-21T09:04:22.062776+0000","last_became_active":"2024-09-21T09:02:58.202431+0000","last_became_peered":"2024-09-21T09:02:58.202431+0000","last_unstale":"2024-09-21T09:04:22.062776+0000","last_undegraded":"2024-09-21T09:04:22.062776+0000","last_fullsized":"2024-09-21T09:04:22.062776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:19.013606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276494+0000","last_change":"2024-09-21T09:03:02.221261+0000","last_active":"2024-09-21T09:03:38.276494+0000","last_peered":"2024-09-21T09:03:38.276494+0000","last_clean":"2024-09-21T09:03:38.276494+0000","last_became_active":"2024-09-21T09:03:02.220940+0000","last_became_peered":"2024-09-21T09:03:02.220940+0000","last_unstale":"2024-09-21T09:03:38.276494+0000","last_undegraded":"2024-09-21T09:03:38.276494+0000","last_fullsized":"2024-09-21T09:03:38.276494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:24.472177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.360394+0000","last_change":"2024-09-21T09:03:04.239297+0000","last_active":"2024-09-21T09:05:04.360394+0000","last_peered":"2024-09-21T09:05:04.360394+0000","last_clean":"2024-09-21T09:05:04.360394+0000","last_became_active":"2024-09-21T09:03:04.239023+0000","last_became_peered":"2024-09-21T09:03:04.239023+0000","last_unstale":"2024-09-21T09:05:04.360394+0000","last_undegraded":"2024-09-21T09:05:04.360394+0000","last_fullsized":"2024-09-21T09:05:04.360394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:11.019831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465048+0000","last_change":"2024-09-21T09:03:06.244208+0000","last_active":"2024-09-21T09:03:38.465048+0000","last_peered":"2024-09-21T09:03:38.465048+0000","last_clean":"2024-09-21T09:03:38.465048+0000","last_became_active":"2024-09-21T09:03:06.243451+0000","last_became_peered":"2024-09-21T09:03:06.243451+0000","last_unstale":"2024-09-21T09:03:38.465048+0000","last_undegraded":"2024-09-21T09:03:38.465048+0000","last_fullsized":"2024-09-21T09:03:38.465048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:57.268665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.713189+0000","last_change":"2024-09-21T09:03:08.260334+0000","last_active":"2024-09-21T09:05:05.713189+0000","last_peered":"2024-09-21T09:05:05.713189+0000","last_clean":"2024-09-21T09:05:05.713189+0000","last_became_active":"2024-09-21T09:03:08.260047+0000","last_became_peered":"2024-09-21T09:03:08.260047+0000","last_unstale":"2024-09-21T09:05:05.713189+0000","last_undegraded":"2024-09-21T09:05:05.713189+0000","last_fullsized":"2024-09-21T09:05:05.713189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:49.086371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'7","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.457562+0000","last_change":"2024-09-21T09:03:00.221676+0000","last_active":"2024-09-21T09:05:32.457562+0000","last_peered":"2024-09-21T09:05:32.457562+0000","last_clean":"2024-09-21T09:05:32.457562+0000","last_became_active":"2024-09-21T09:03:00.221332+0000","last_became_peered":"2024-09-21T09:03:00.221332+0000","last_unstale":"2024-09-21T09:05:32.457562+0000","last_undegraded":"2024-09-21T09:05:32.457562+0000","last_fullsized":"2024-09-21T09:05:32.457562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:09.836796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.752914+0000","last_change":"2024-09-21T09:02:58.210805+0000","last_active":"2024-09-21T09:03:38.752914+0000","last_peered":"2024-09-21T09:03:38.752914+0000","last_clean":"2024-09-21T09:03:38.752914+0000","last_became_active":"2024-09-21T09:02:58.210511+0000","last_became_peered":"2024-09-21T09:02:58.210511+0000","last_unstale":"2024-09-21T09:03:38.752914+0000","last_undegraded":"2024-09-21T09:03:38.752914+0000","last_fullsized":"2024-09-21T09:03:38.752914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:47.903446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277189+0000","last_change":"2024-09-21T09:03:02.219262+0000","last_active":"2024-09-21T09:03:38.277189+0000","last_peered":"2024-09-21T09:03:38.277189+0000","last_clean":"2024-09-21T09:03:38.277189+0000","last_became_active":"2024-09-21T09:03:02.218979+0000","last_became_peered":"2024-09-21T09:03:02.218979+0000","last_unstale":"2024-09-21T09:03:38.277189+0000","last_undegraded":"2024-09-21T09:03:38.277189+0000","last_fullsized":"2024-09-21T09:03:38.277189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:07.127926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.259516+0000","last_change":"2024-09-21T09:03:04.242314+0000","last_active":"2024-09-21T09:04:22.259516+0000","last_peered":"2024-09-21T09:04:22.259516+0000","last_clean":"2024-09-21T09:04:22.259516+0000","last_became_active":"2024-09-21T09:03:04.241974+0000","last_became_peered":"2024-09-21T09:03:04.241974+0000","last_unstale":"2024-09-21T09:04:22.259516+0000","last_undegraded":"2024-09-21T09:04:22.259516+0000","last_fullsized":"2024-09-21T09:04:22.259516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:52.828027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'282","reported_seq":416,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.368023+0000","last_change":"2024-09-21T09:03:06.244451+0000","last_active":"2024-09-21T09:06:06.368023+0000","last_peered":"2024-09-21T09:06:06.368023+0000","last_clean":"2024-09-21T09:06:06.368023+0000","last_became_active":"2024-09-21T09:03:06.244103+0000","last_became_peered":"2024-09-21T09:03:06.244103+0000","last_unstale":"2024-09-21T09:06:06.368023+0000","last_undegraded":"2024-09-21T09:06:06.368023+0000","last_fullsized":"2024-09-21T09:06:06.368023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:13.035061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"31'6","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.806010+0000","last_change":"2024-09-21T09:03:08.260304+0000","last_active":"2024-09-21T09:06:05.806010+0000","last_peered":"2024-09-21T09:06:05.806010+0000","last_clean":"2024-09-21T09:06:05.806010+0000","last_became_active":"2024-09-21T09:03:08.259638+0000","last_became_peered":"2024-09-21T09:03:08.259638+0000","last_unstale":"2024-09-21T09:06:05.806010+0000","last_undegraded":"2024-09-21T09:06:05.806010+0000","last_fullsized":"2024-09-21T09:06:05.806010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:33.635905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.258397+0000","last_change":"2024-09-21T09:03:00.220803+0000","last_active":"2024-09-21T09:04:22.258397+0000","last_peered":"2024-09-21T09:04:22.258397+0000","last_clean":"2024-09-21T09:04:22.258397+0000","last_became_active":"2024-09-21T09:03:00.220426+0000","last_became_peered":"2024-09-21T09:03:00.220426+0000","last_unstale":"2024-09-21T09:04:22.258397+0000","last_undegraded":"2024-09-21T09:04:22.258397+0000","last_fullsized":"2024-09-21T09:04:22.258397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:15.584421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275873+0000","last_change":"2024-09-21T09:02:58.207718+0000","last_active":"2024-09-21T09:03:38.275873+0000","last_peered":"2024-09-21T09:03:38.275873+0000","last_clean":"2024-09-21T09:03:38.275873+0000","last_became_active":"2024-09-21T09:02:58.207424+0000","last_became_peered":"2024-09-21T09:02:58.207424+0000","last_unstale":"2024-09-21T09:03:38.275873+0000","last_undegraded":"2024-09-21T09:03:38.275873+0000","last_fullsized":"2024-09-21T09:03:38.275873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:03.460514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.282215+0000","last_change":"2024-09-21T09:03:38.280977+0000","last_active":"2024-09-21T09:03:38.282215+0000","last_peered":"2024-09-21T09:03:38.282215+0000","last_clean":"2024-09-21T09:03:38.282215+0000","last_became_active":"2024-09-21T09:03:38.280616+0000","last_became_peered":"2024-09-21T09:03:38.280616+0000","last_unstale":"2024-09-21T09:03:38.282215+0000","last_undegraded":"2024-09-21T09:03:38.282215+0000","last_fullsized":"2024-09-21T09:03:38.282215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:02:41.978323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'38","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.458395+0000","last_change":"2024-09-21T09:03:04.234179+0000","last_active":"2024-09-21T09:05:32.458395+0000","last_peered":"2024-09-21T09:05:32.458395+0000","last_clean":"2024-09-21T09:05:32.458395+0000","last_became_active":"2024-09-21T09:03:04.233878+0000","last_became_peered":"2024-09-21T09:03:04.233878+0000","last_unstale":"2024-09-21T09:05:32.458395+0000","last_undegraded":"2024-09-21T09:05:32.458395+0000","last_fullsized":"2024-09-21T09:05:32.458395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:11.019831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463002+0000","last_change":"2024-09-21T09:03:06.248010+0000","last_active":"2024-09-21T09:03:38.463002+0000","last_peered":"2024-09-21T09:03:38.463002+0000","last_clean":"2024-09-21T09:03:38.463002+0000","last_became_active":"2024-09-21T09:03:06.247609+0000","last_became_peered":"2024-09-21T09:03:06.247609+0000","last_unstale":"2024-09-21T09:03:38.463002+0000","last_undegraded":"2024-09-21T09:03:38.463002+0000","last_fullsized":"2024-09-21T09:03:38.463002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:03.746735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276162+0000","last_change":"2024-09-21T09:03:08.256301+0000","last_active":"2024-09-21T09:03:38.276162+0000","last_peered":"2024-09-21T09:03:38.276162+0000","last_clean":"2024-09-21T09:03:38.276162+0000","last_became_active":"2024-09-21T09:03:08.255717+0000","last_became_peered":"2024-09-21T09:03:08.255717+0000","last_unstale":"2024-09-21T09:03:38.276162+0000","last_undegraded":"2024-09-21T09:03:38.276162+0000","last_fullsized":"2024-09-21T09:03:38.276162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:09:51.274693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'10","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.176725+0000","last_change":"2024-09-21T09:03:00.216086+0000","last_active":"2024-09-21T09:06:06.176725+0000","last_peered":"2024-09-21T09:06:06.176725+0000","last_clean":"2024-09-21T09:06:06.176725+0000","last_became_active":"2024-09-21T09:03:00.215804+0000","last_became_peered":"2024-09-21T09:03:00.215804+0000","last_unstale":"2024-09-21T09:06:06.176725+0000","last_undegraded":"2024-09-21T09:06:06.176725+0000","last_fullsized":"2024-09-21T09:06:06.176725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:43.259240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278524+0000","last_change":"2024-09-21T09:02:58.221563+0000","last_active":"2024-09-21T09:03:38.278524+0000","last_peered":"2024-09-21T09:03:38.278524+0000","last_clean":"2024-09-21T09:03:38.278524+0000","last_became_active":"2024-09-21T09:02:58.221286+0000","last_became_peered":"2024-09-21T09:02:58.221286+0000","last_unstale":"2024-09-21T09:03:38.278524+0000","last_undegraded":"2024-09-21T09:03:38.278524+0000","last_fullsized":"2024-09-21T09:03:38.278524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:01.926039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.279861+0000","last_change":"2024-09-21T09:03:02.225192+0000","last_active":"2024-09-21T09:03:38.279861+0000","last_peered":"2024-09-21T09:03:38.279861+0000","last_clean":"2024-09-21T09:03:38.279861+0000","last_became_active":"2024-09-21T09:03:02.224879+0000","last_became_peered":"2024-09-21T09:03:02.224879+0000","last_unstale":"2024-09-21T09:03:38.279861+0000","last_undegraded":"2024-09-21T09:03:38.279861+0000","last_fullsized":"2024-09-21T09:03:38.279861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:58.107921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.335448+0000","last_change":"2024-09-21T09:03:04.239378+0000","last_active":"2024-09-21T09:05:04.335448+0000","last_peered":"2024-09-21T09:05:04.335448+0000","last_clean":"2024-09-21T09:05:04.335448+0000","last_became_active":"2024-09-21T09:03:04.239112+0000","last_became_peered":"2024-09-21T09:03:04.239112+0000","last_unstale":"2024-09-21T09:05:04.335448+0000","last_undegraded":"2024-09-21T09:05:04.335448+0000","last_fullsized":"2024-09-21T09:05:04.335448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:28.337671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270452+0000","last_change":"2024-09-21T09:03:06.251033+0000","last_active":"2024-09-21T09:03:38.270452+0000","last_peered":"2024-09-21T09:03:38.270452+0000","last_clean":"2024-09-21T09:03:38.270452+0000","last_became_active":"2024-09-21T09:03:06.250729+0000","last_became_peered":"2024-09-21T09:03:06.250729+0000","last_unstale":"2024-09-21T09:03:38.270452+0000","last_undegraded":"2024-09-21T09:03:38.270452+0000","last_fullsized":"2024-09-21T09:03:38.270452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:49.094483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274381+0000","last_change":"2024-09-21T09:03:08.264701+0000","last_active":"2024-09-21T09:03:38.274381+0000","last_peered":"2024-09-21T09:03:38.274381+0000","last_clean":"2024-09-21T09:03:38.274381+0000","last_became_active":"2024-09-21T09:03:08.264160+0000","last_became_peered":"2024-09-21T09:03:08.264160+0000","last_unstale":"2024-09-21T09:03:38.274381+0000","last_undegraded":"2024-09-21T09:03:38.274381+0000","last_fullsized":"2024-09-21T09:03:38.274381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:11.297538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298677+0000","last_change":"2024-09-21T09:03:00.208934+0000","last_active":"2024-09-21T09:06:06.298677+0000","last_peered":"2024-09-21T09:06:06.298677+0000","last_clean":"2024-09-21T09:06:06.298677+0000","last_became_active":"2024-09-21T09:03:00.208673+0000","last_became_peered":"2024-09-21T09:03:00.208673+0000","last_unstale":"2024-09-21T09:06:06.298677+0000","last_undegraded":"2024-09-21T09:06:06.298677+0000","last_fullsized":"2024-09-21T09:06:06.298677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:08:35.801498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465585+0000","last_change":"2024-09-21T09:02:58.213090+0000","last_active":"2024-09-21T09:03:38.465585+0000","last_peered":"2024-09-21T09:03:38.465585+0000","last_clean":"2024-09-21T09:03:38.465585+0000","last_became_active":"2024-09-21T09:02:58.212751+0000","last_became_peered":"2024-09-21T09:02:58.212751+0000","last_unstale":"2024-09-21T09:03:38.465585+0000","last_undegraded":"2024-09-21T09:03:38.465585+0000","last_fullsized":"2024-09-21T09:03:38.465585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:42:59.411200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275293+0000","last_change":"2024-09-21T09:03:02.223254+0000","last_active":"2024-09-21T09:03:38.275293+0000","last_peered":"2024-09-21T09:03:38.275293+0000","last_clean":"2024-09-21T09:03:38.275293+0000","last_became_active":"2024-09-21T09:03:02.222965+0000","last_became_peered":"2024-09-21T09:03:02.222965+0000","last_unstale":"2024-09-21T09:03:38.275293+0000","last_undegraded":"2024-09-21T09:03:38.275293+0000","last_fullsized":"2024-09-21T09:03:38.275293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:51.746643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'26","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.358187+0000","last_change":"2024-09-21T09:03:04.244000+0000","last_active":"2024-09-21T09:05:04.358187+0000","last_peered":"2024-09-21T09:05:04.358187+0000","last_clean":"2024-09-21T09:05:04.358187+0000","last_became_active":"2024-09-21T09:03:04.243686+0000","last_became_peered":"2024-09-21T09:03:04.243686+0000","last_unstale":"2024-09-21T09:05:04.358187+0000","last_undegraded":"2024-09-21T09:05:04.358187+0000","last_fullsized":"2024-09-21T09:05:04.358187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:23.844395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271117+0000","last_change":"2024-09-21T09:03:06.250256+0000","last_active":"2024-09-21T09:03:38.271117+0000","last_peered":"2024-09-21T09:03:38.271117+0000","last_clean":"2024-09-21T09:03:38.271117+0000","last_became_active":"2024-09-21T09:03:06.249959+0000","last_became_peered":"2024-09-21T09:03:06.249959+0000","last_unstale":"2024-09-21T09:03:38.271117+0000","last_undegraded":"2024-09-21T09:03:38.271117+0000","last_fullsized":"2024-09-21T09:03:38.271117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:36:47.765082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'6","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.714631+0000","last_change":"2024-09-21T09:03:08.264668+0000","last_active":"2024-09-21T09:05:05.714631+0000","last_peered":"2024-09-21T09:05:05.714631+0000","last_clean":"2024-09-21T09:05:05.714631+0000","last_became_active":"2024-09-21T09:03:08.264395+0000","last_became_peered":"2024-09-21T09:03:08.264395+0000","last_unstale":"2024-09-21T09:05:05.714631+0000","last_undegraded":"2024-09-21T09:05:05.714631+0000","last_fullsized":"2024-09-21T09:05:05.714631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:33.997831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'14","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.176335+0000","last_change":"2024-09-21T09:03:00.216032+0000","last_active":"2024-09-21T09:06:06.176335+0000","last_peered":"2024-09-21T09:06:06.176335+0000","last_clean":"2024-09-21T09:06:06.176335+0000","last_became_active":"2024-09-21T09:03:00.215748+0000","last_became_peered":"2024-09-21T09:03:00.215748+0000","last_unstale":"2024-09-21T09:06:06.176335+0000","last_undegraded":"2024-09-21T09:06:06.176335+0000","last_fullsized":"2024-09-21T09:06:06.176335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:26.084899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453896+0000","last_change":"2024-09-21T09:02:58.204247+0000","last_active":"2024-09-21T09:05:02.453896+0000","last_peered":"2024-09-21T09:05:02.453896+0000","last_clean":"2024-09-21T09:05:02.453896+0000","last_became_active":"2024-09-21T09:02:58.203973+0000","last_became_peered":"2024-09-21T09:02:58.203973+0000","last_unstale":"2024-09-21T09:05:02.453896+0000","last_undegraded":"2024-09-21T09:05:02.453896+0000","last_fullsized":"2024-09-21T09:05:02.453896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:07.674387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'2","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:03.073883+0000","last_change":"2024-09-21T09:03:02.221130+0000","last_active":"2024-09-21T09:05:03.073883+0000","last_peered":"2024-09-21T09:05:03.073883+0000","last_clean":"2024-09-21T09:05:03.073883+0000","last_became_active":"2024-09-21T09:03:02.220801+0000","last_became_peered":"2024-09-21T09:03:02.220801+0000","last_unstale":"2024-09-21T09:05:03.073883+0000","last_undegraded":"2024-09-21T09:05:03.073883+0000","last_fullsized":"2024-09-21T09:05:03.073883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:02.648349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.733362+0000","last_change":"2024-09-21T09:03:04.241567+0000","last_active":"2024-09-21T09:06:05.733362+0000","last_peered":"2024-09-21T09:06:05.733362+0000","last_clean":"2024-09-21T09:06:05.733362+0000","last_became_active":"2024-09-21T09:03:04.240857+0000","last_became_peered":"2024-09-21T09:03:04.240857+0000","last_unstale":"2024-09-21T09:06:05.733362+0000","last_undegraded":"2024-09-21T09:06:05.733362+0000","last_fullsized":"2024-09-21T09:06:05.733362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:48.722144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464241+0000","last_change":"2024-09-21T09:03:06.248388+0000","last_active":"2024-09-21T09:03:38.464241+0000","last_peered":"2024-09-21T09:03:38.464241+0000","last_clean":"2024-09-21T09:03:38.464241+0000","last_became_active":"2024-09-21T09:03:06.248030+0000","last_became_peered":"2024-09-21T09:03:06.248030+0000","last_unstale":"2024-09-21T09:03:38.464241+0000","last_undegraded":"2024-09-21T09:03:38.464241+0000","last_fullsized":"2024-09-21T09:03:38.464241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.216872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'4","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.370491+0000","last_change":"2024-09-21T09:03:08.264618+0000","last_active":"2024-09-21T09:05:04.370491+0000","last_peered":"2024-09-21T09:05:04.370491+0000","last_clean":"2024-09-21T09:05:04.370491+0000","last_became_active":"2024-09-21T09:03:08.264304+0000","last_became_peered":"2024-09-21T09:03:08.264304+0000","last_unstale":"2024-09-21T09:05:04.370491+0000","last_undegraded":"2024-09-21T09:05:04.370491+0000","last_fullsized":"2024-09-21T09:05:04.370491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:59.938730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'22","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.084081+0000","last_change":"2024-09-21T09:03:00.226200+0000","last_active":"2024-09-21T09:06:06.084081+0000","last_peered":"2024-09-21T09:06:06.084081+0000","last_clean":"2024-09-21T09:06:06.084081+0000","last_became_active":"2024-09-21T09:03:00.225936+0000","last_became_peered":"2024-09-21T09:03:00.225936+0000","last_unstale":"2024-09-21T09:06:06.084081+0000","last_undegraded":"2024-09-21T09:06:06.084081+0000","last_fullsized":"2024-09-21T09:06:06.084081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:56.100485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272693+0000","last_change":"2024-09-21T09:02:58.206450+0000","last_active":"2024-09-21T09:03:38.272693+0000","last_peered":"2024-09-21T09:03:38.272693+0000","last_clean":"2024-09-21T09:03:38.272693+0000","last_became_active":"2024-09-21T09:02:58.206163+0000","last_became_peered":"2024-09-21T09:02:58.206163+0000","last_unstale":"2024-09-21T09:03:38.272693+0000","last_undegraded":"2024-09-21T09:03:38.272693+0000","last_fullsized":"2024-09-21T09:03:38.272693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:19.013606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'5","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304064+0000","last_change":"2024-09-21T09:03:00.221286+0000","last_active":"2024-09-21T09:06:06.304064+0000","last_peered":"2024-09-21T09:06:06.304064+0000","last_clean":"2024-09-21T09:06:06.304064+0000","last_became_active":"2024-09-21T09:03:00.220860+0000","last_became_peered":"2024-09-21T09:03:00.220860+0000","last_unstale":"2024-09-21T09:06:06.304064+0000","last_undegraded":"2024-09-21T09:06:06.304064+0000","last_fullsized":"2024-09-21T09:06:06.304064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:47.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.245757+0000","last_change":"2024-09-21T09:02:58.202869+0000","last_active":"2024-09-21T09:06:06.245757+0000","last_peered":"2024-09-21T09:06:06.245757+0000","last_clean":"2024-09-21T09:06:06.245757+0000","last_became_active":"2024-09-21T09:02:58.202579+0000","last_became_peered":"2024-09-21T09:02:58.202579+0000","last_unstale":"2024-09-21T09:06:06.245757+0000","last_undegraded":"2024-09-21T09:06:06.245757+0000","last_fullsized":"2024-09-21T09:06:06.245757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:51.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'3","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304856+0000","last_change":"2024-09-21T09:03:00.221384+0000","last_active":"2024-09-21T09:06:06.304856+0000","last_peered":"2024-09-21T09:06:06.304856+0000","last_clean":"2024-09-21T09:06:06.304856+0000","last_became_active":"2024-09-21T09:03:00.219281+0000","last_became_peered":"2024-09-21T09:03:00.219281+0000","last_unstale":"2024-09-21T09:06:06.304856+0000","last_undegraded":"2024-09-21T09:06:06.304856+0000","last_fullsized":"2024-09-21T09:06:06.304856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:53.670241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271976+0000","last_change":"2024-09-21T09:02:58.223127+0000","last_active":"2024-09-21T09:03:38.271976+0000","last_peered":"2024-09-21T09:03:38.271976+0000","last_clean":"2024-09-21T09:03:38.271976+0000","last_became_active":"2024-09-21T09:02:58.222856+0000","last_became_peered":"2024-09-21T09:02:58.222856+0000","last_unstale":"2024-09-21T09:03:38.271976+0000","last_undegraded":"2024-09-21T09:03:38.271976+0000","last_fullsized":"2024-09-21T09:03:38.271976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:55.695152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466314+0000","last_change":"2024-09-21T09:03:00.221392+0000","last_active":"2024-09-21T09:03:38.466314+0000","last_peered":"2024-09-21T09:03:38.466314+0000","last_clean":"2024-09-21T09:03:38.466314+0000","last_became_active":"2024-09-21T09:03:00.220755+0000","last_became_peered":"2024-09-21T09:03:00.220755+0000","last_unstale":"2024-09-21T09:03:38.466314+0000","last_undegraded":"2024-09-21T09:03:38.466314+0000","last_fullsized":"2024-09-21T09:03:38.466314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:52:42.557402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464613+0000","last_change":"2024-09-21T09:02:58.208737+0000","last_active":"2024-09-21T09:03:38.464613+0000","last_peered":"2024-09-21T09:03:38.464613+0000","last_clean":"2024-09-21T09:03:38.464613+0000","last_became_active":"2024-09-21T09:02:58.208329+0000","last_became_peered":"2024-09-21T09:02:58.208329+0000","last_unstale":"2024-09-21T09:03:38.464613+0000","last_undegraded":"2024-09-21T09:03:38.464613+0000","last_fullsized":"2024-09-21T09:03:38.464613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:57.584638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'16","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260871+0000","last_change":"2024-09-21T09:03:00.216032+0000","last_active":"2024-09-21T09:06:06.260871+0000","last_peered":"2024-09-21T09:06:06.260871+0000","last_clean":"2024-09-21T09:06:06.260871+0000","last_became_active":"2024-09-21T09:03:00.215554+0000","last_became_peered":"2024-09-21T09:03:00.215554+0000","last_unstale":"2024-09-21T09:06:06.260871+0000","last_undegraded":"2024-09-21T09:06:06.260871+0000","last_fullsized":"2024-09-21T09:06:06.260871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:18.875227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.752662+0000","last_change":"2024-09-21T09:02:58.202254+0000","last_active":"2024-09-21T09:03:38.752662+0000","last_peered":"2024-09-21T09:03:38.752662+0000","last_clean":"2024-09-21T09:03:38.752662+0000","last_became_active":"2024-09-21T09:02:58.201482+0000","last_became_peered":"2024-09-21T09:02:58.201482+0000","last_unstale":"2024-09-21T09:03:38.752662+0000","last_undegraded":"2024-09-21T09:03:38.752662+0000","last_fullsized":"2024-09-21T09:03:38.752662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.813396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'11","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.370735+0000","last_change":"2024-09-21T09:03:00.224630+0000","last_active":"2024-09-21T09:06:06.370735+0000","last_peered":"2024-09-21T09:06:06.370735+0000","last_clean":"2024-09-21T09:06:06.370735+0000","last_became_active":"2024-09-21T09:03:00.223740+0000","last_became_peered":"2024-09-21T09:03:00.223740+0000","last_unstale":"2024-09-21T09:06:06.370735+0000","last_undegraded":"2024-09-21T09:06:06.370735+0000","last_fullsized":"2024-09-21T09:06:06.370735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:58.794598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.454567+0000","last_change":"2024-09-21T09:02:58.210714+0000","last_active":"2024-09-21T09:05:07.454567+0000","last_peered":"2024-09-21T09:05:07.454567+0000","last_clean":"2024-09-21T09:05:07.454567+0000","last_became_active":"2024-09-21T09:02:58.210442+0000","last_became_peered":"2024-09-21T09:02:58.210442+0000","last_unstale":"2024-09-21T09:05:07.454567+0000","last_undegraded":"2024-09-21T09:05:07.454567+0000","last_fullsized":"2024-09-21T09:05:07.454567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:57.584638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'14","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.717387+0000","last_change":"2024-09-21T09:03:00.216820+0000","last_active":"2024-09-21T09:05:05.717387+0000","last_peered":"2024-09-21T09:05:05.717387+0000","last_clean":"2024-09-21T09:05:05.717387+0000","last_became_active":"2024-09-21T09:03:00.216462+0000","last_became_peered":"2024-09-21T09:03:00.216462+0000","last_unstale":"2024-09-21T09:05:05.717387+0000","last_undegraded":"2024-09-21T09:05:05.717387+0000","last_fullsized":"2024-09-21T09:05:05.717387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:43.259240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.833842+0000","last_change":"2024-09-21T09:02:58.220184+0000","last_active":"2024-09-21T09:03:39.833842+0000","last_peered":"2024-09-21T09:03:39.833842+0000","last_clean":"2024-09-21T09:03:39.833842+0000","last_became_active":"2024-09-21T09:02:58.218407+0000","last_became_peered":"2024-09-21T09:02:58.218407+0000","last_unstale":"2024-09-21T09:03:39.833842+0000","last_undegraded":"2024-09-21T09:03:39.833842+0000","last_fullsized":"2024-09-21T09:03:39.833842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:44.533015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.299204+0000","last_change":"2024-09-21T09:03:00.213244+0000","last_active":"2024-09-21T09:06:06.299204+0000","last_peered":"2024-09-21T09:06:06.299204+0000","last_clean":"2024-09-21T09:06:06.299204+0000","last_became_active":"2024-09-21T09:03:00.212503+0000","last_became_peered":"2024-09-21T09:03:00.212503+0000","last_unstale":"2024-09-21T09:06:06.299204+0000","last_undegraded":"2024-09-21T09:06:06.299204+0000","last_fullsized":"2024-09-21T09:06:06.299204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:52.154699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465557+0000","last_change":"2024-09-21T09:02:58.202455+0000","last_active":"2024-09-21T09:03:38.465557+0000","last_peered":"2024-09-21T09:03:38.465557+0000","last_clean":"2024-09-21T09:03:38.465557+0000","last_became_active":"2024-09-21T09:02:58.201812+0000","last_became_peered":"2024-09-21T09:02:58.201812+0000","last_unstale":"2024-09-21T09:03:38.465557+0000","last_undegraded":"2024-09-21T09:03:38.465557+0000","last_fullsized":"2024-09-21T09:03:38.465557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:33.880917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'6","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.853327+0000","last_change":"2024-09-21T09:03:00.225519+0000","last_active":"2024-09-21T09:03:39.853327+0000","last_peered":"2024-09-21T09:03:39.853327+0000","last_clean":"2024-09-21T09:03:39.853327+0000","last_became_active":"2024-09-21T09:03:00.224456+0000","last_became_peered":"2024-09-21T09:03:00.224456+0000","last_unstale":"2024-09-21T09:03:39.853327+0000","last_undegraded":"2024-09-21T09:03:39.853327+0000","last_fullsized":"2024-09-21T09:03:39.853327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:22.464742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458069+0000","last_change":"2024-09-21T09:02:58.222445+0000","last_active":"2024-09-21T09:05:08.458069+0000","last_peered":"2024-09-21T09:05:08.458069+0000","last_clean":"2024-09-21T09:05:08.458069+0000","last_became_active":"2024-09-21T09:02:58.222191+0000","last_became_peered":"2024-09-21T09:02:58.222191+0000","last_unstale":"2024-09-21T09:05:08.458069+0000","last_undegraded":"2024-09-21T09:05:08.458069+0000","last_fullsized":"2024-09-21T09:05:08.458069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:50.343858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":13,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'6","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363119+0000","last_change":"2024-09-21T09:03:00.220918+0000","last_active":"2024-09-21T09:06:06.363119+0000","last_peered":"2024-09-21T09:06:06.363119+0000","last_clean":"2024-09-21T09:06:06.363119+0000","last_became_active":"2024-09-21T09:03:00.220639+0000","last_became_peered":"2024-09-21T09:03:00.220639+0000","last_unstale":"2024-09-21T09:06:06.363119+0000","last_undegraded":"2024-09-21T09:06:06.363119+0000","last_fullsized":"2024-09-21T09:06:06.363119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:26.629707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463882+0000","last_change":"2024-09-21T09:02:58.208759+0000","last_active":"2024-09-21T09:03:38.463882+0000","last_peered":"2024-09-21T09:03:38.463882+0000","last_clean":"2024-09-21T09:03:38.463882+0000","last_became_active":"2024-09-21T09:02:58.208346+0000","last_became_peered":"2024-09-21T09:02:58.208346+0000","last_unstale":"2024-09-21T09:03:38.463882+0000","last_undegraded":"2024-09-21T09:03:38.463882+0000","last_fullsized":"2024-09-21T09:03:38.463882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:44.533015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.711493+0000","last_change":"2024-09-21T09:03:00.223002+0000","last_active":"2024-09-21T09:05:02.711493+0000","last_peered":"2024-09-21T09:05:02.711493+0000","last_clean":"2024-09-21T09:05:02.711493+0000","last_became_active":"2024-09-21T09:03:00.222651+0000","last_became_peered":"2024-09-21T09:03:00.222651+0000","last_unstale":"2024-09-21T09:05:02.711493+0000","last_undegraded":"2024-09-21T09:05:02.711493+0000","last_fullsized":"2024-09-21T09:05:02.711493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:24.133336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274353+0000","last_change":"2024-09-21T09:02:58.209919+0000","last_active":"2024-09-21T09:03:38.274353+0000","last_peered":"2024-09-21T09:03:38.274353+0000","last_clean":"2024-09-21T09:03:38.274353+0000","last_became_active":"2024-09-21T09:02:58.208495+0000","last_became_peered":"2024-09-21T09:02:58.208495+0000","last_unstale":"2024-09-21T09:03:38.274353+0000","last_undegraded":"2024-09-21T09:03:38.274353+0000","last_fullsized":"2024-09-21T09:03:38.274353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:14.606085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'4","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275450+0000","last_change":"2024-09-21T09:03:00.222862+0000","last_active":"2024-09-21T09:03:38.275450+0000","last_peered":"2024-09-21T09:03:38.275450+0000","last_clean":"2024-09-21T09:03:38.275450+0000","last_became_active":"2024-09-21T09:03:00.222343+0000","last_became_peered":"2024-09-21T09:03:00.222343+0000","last_unstale":"2024-09-21T09:03:38.275450+0000","last_undegraded":"2024-09-21T09:03:38.275450+0000","last_fullsized":"2024-09-21T09:03:38.275450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:06.215821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455383+0000","last_change":"2024-09-21T09:02:58.210097+0000","last_active":"2024-09-21T09:05:12.455383+0000","last_peered":"2024-09-21T09:05:12.455383+0000","last_clean":"2024-09-21T09:05:12.455383+0000","last_became_active":"2024-09-21T09:02:58.208630+0000","last_became_peered":"2024-09-21T09:02:58.208630+0000","last_unstale":"2024-09-21T09:05:12.455383+0000","last_undegraded":"2024-09-21T09:05:12.455383+0000","last_fullsized":"2024-09-21T09:05:12.455383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.754217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'18","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.853440+0000","last_change":"2024-09-21T09:03:38.286564+0000","last_active":"2024-09-21T09:03:39.853440+0000","last_peered":"2024-09-21T09:03:39.853440+0000","last_clean":"2024-09-21T09:03:39.853440+0000","last_became_active":"2024-09-21T09:03:38.282951+0000","last_became_peered":"2024-09-21T09:03:38.282951+0000","last_unstale":"2024-09-21T09:03:39.853440+0000","last_undegraded":"2024-09-21T09:03:39.853440+0000","last_fullsized":"2024-09-21T09:03:39.853440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:00.987047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.063131+0000","last_change":"2024-09-21T09:02:58.214989+0000","last_active":"2024-09-21T09:06:06.063131+0000","last_peered":"2024-09-21T09:06:06.063131+0000","last_clean":"2024-09-21T09:06:06.063131+0000","last_became_active":"2024-09-21T09:02:58.214717+0000","last_became_peered":"2024-09-21T09:02:58.214717+0000","last_unstale":"2024-09-21T09:06:06.063131+0000","last_undegraded":"2024-09-21T09:06:06.063131+0000","last_fullsized":"2024-09-21T09:06:06.063131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:03.101113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.456132+0000","last_change":"2024-09-21T09:03:00.227362+0000","last_active":"2024-09-21T09:05:17.456132+0000","last_peered":"2024-09-21T09:05:17.456132+0000","last_clean":"2024-09-21T09:05:17.456132+0000","last_became_active":"2024-09-21T09:03:00.226411+0000","last_became_peered":"2024-09-21T09:03:00.226411+0000","last_unstale":"2024-09-21T09:05:17.456132+0000","last_undegraded":"2024-09-21T09:05:17.456132+0000","last_fullsized":"2024-09-21T09:05:17.456132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:47.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.753111+0000","last_change":"2024-09-21T09:02:58.224258+0000","last_active":"2024-09-21T09:03:38.753111+0000","last_peered":"2024-09-21T09:03:38.753111+0000","last_clean":"2024-09-21T09:03:38.753111+0000","last_became_active":"2024-09-21T09:02:58.224058+0000","last_became_peered":"2024-09-21T09:02:58.224058+0000","last_unstale":"2024-09-21T09:03:38.753111+0000","last_undegraded":"2024-09-21T09:03:38.753111+0000","last_fullsized":"2024-09-21T09:03:38.753111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:40.099948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.080511+0000","last_change":"2024-09-21T09:03:00.220552+0000","last_active":"2024-09-21T09:06:06.080511+0000","last_peered":"2024-09-21T09:06:06.080511+0000","last_clean":"2024-09-21T09:06:06.080511+0000","last_became_active":"2024-09-21T09:03:00.218422+0000","last_became_peered":"2024-09-21T09:03:00.218422+0000","last_unstale":"2024-09-21T09:06:06.080511+0000","last_undegraded":"2024-09-21T09:06:06.080511+0000","last_fullsized":"2024-09-21T09:06:06.080511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:11.245837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275596+0000","last_change":"2024-09-21T09:02:58.219338+0000","last_active":"2024-09-21T09:03:38.275596+0000","last_peered":"2024-09-21T09:03:38.275596+0000","last_clean":"2024-09-21T09:03:38.275596+0000","last_became_active":"2024-09-21T09:02:58.218299+0000","last_became_peered":"2024-09-21T09:02:58.218299+0000","last_unstale":"2024-09-21T09:03:38.275596+0000","last_undegraded":"2024-09-21T09:03:38.275596+0000","last_fullsized":"2024-09-21T09:03:38.275596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:52.024304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'11","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455220+0000","last_change":"2024-09-21T09:03:00.213716+0000","last_active":"2024-09-21T09:05:12.455220+0000","last_peered":"2024-09-21T09:05:12.455220+0000","last_clean":"2024-09-21T09:05:12.455220+0000","last_became_active":"2024-09-21T09:03:00.212838+0000","last_became_peered":"2024-09-21T09:03:00.212838+0000","last_unstale":"2024-09-21T09:05:12.455220+0000","last_undegraded":"2024-09-21T09:05:12.455220+0000","last_fullsized":"2024-09-21T09:05:12.455220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:30.357859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.460059+0000","last_change":"2024-09-21T09:02:58.219134+0000","last_active":"2024-09-21T09:05:18.460059+0000","last_peered":"2024-09-21T09:05:18.460059+0000","last_clean":"2024-09-21T09:05:18.460059+0000","last_became_active":"2024-09-21T09:02:58.218776+0000","last_became_peered":"2024-09-21T09:02:58.218776+0000","last_unstale":"2024-09-21T09:05:18.460059+0000","last_undegraded":"2024-09-21T09:05:18.460059+0000","last_fullsized":"2024-09-21T09:05:18.460059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:24.476268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271062+0000","last_change":"2024-09-21T09:02:58.219078+0000","last_active":"2024-09-21T09:03:38.271062+0000","last_peered":"2024-09-21T09:03:38.271062+0000","last_clean":"2024-09-21T09:03:38.271062+0000","last_became_active":"2024-09-21T09:02:58.218757+0000","last_became_peered":"2024-09-21T09:02:58.218757+0000","last_unstale":"2024-09-21T09:03:38.271062+0000","last_undegraded":"2024-09-21T09:03:38.271062+0000","last_fullsized":"2024-09-21T09:03:38.271062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:37:41.056206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'6","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.299232+0000","last_change":"2024-09-21T09:03:00.216883+0000","last_active":"2024-09-21T09:06:06.299232+0000","last_peered":"2024-09-21T09:06:06.299232+0000","last_clean":"2024-09-21T09:06:06.299232+0000","last_became_active":"2024-09-21T09:03:00.216424+0000","last_became_peered":"2024-09-21T09:03:00.216424+0000","last_unstale":"2024-09-21T09:06:06.299232+0000","last_undegraded":"2024-09-21T09:06:06.299232+0000","last_fullsized":"2024-09-21T09:06:06.299232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:50.802476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463675+0000","last_change":"2024-09-21T09:02:58.209061+0000","last_active":"2024-09-21T09:03:38.463675+0000","last_peered":"2024-09-21T09:03:38.463675+0000","last_clean":"2024-09-21T09:03:38.463675+0000","last_became_active":"2024-09-21T09:02:58.208437+0000","last_became_peered":"2024-09-21T09:02:58.208437+0000","last_unstale":"2024-09-21T09:03:38.463675+0000","last_undegraded":"2024-09-21T09:03:38.463675+0000","last_fullsized":"2024-09-21T09:03:38.463675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:12.355792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'3","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.089579+0000","last_change":"2024-09-21T09:03:00.219307+0000","last_active":"2024-09-21T09:06:06.089579+0000","last_peered":"2024-09-21T09:06:06.089579+0000","last_clean":"2024-09-21T09:06:06.089579+0000","last_became_active":"2024-09-21T09:03:00.219010+0000","last_became_peered":"2024-09-21T09:03:00.219010+0000","last_unstale":"2024-09-21T09:06:06.089579+0000","last_undegraded":"2024-09-21T09:06:06.089579+0000","last_fullsized":"2024-09-21T09:06:06.089579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:19.412009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673005,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40392,"kb_used_data":13368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331448,"statfs":{"total":96636764160,"available":96595402752,"internally_reserved":0,"allocated":13688832,"data_stored":13360568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36796,"kb_used_data":9772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":10006528,"data_stored":9752500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61028,"kb_used_data":17364,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94310812,"statfs":{"total":96636764160,"available":96574271488,"internally_reserved":0,"allocated":17780736,"data_stored":17500718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52200,"kb_used_data":12696,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319640,"statfs":{"total":96636764160,"available":96583311360,"internally_reserved":0,"allocated":13000704,"data_stored":12717132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:06:13.405 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:06:13.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.533+0000 7fd1096d2640 1 Processor -- start 2024-09-21T09:06:13.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.533+0000 7fd1096d2640 1 -- start start 2024-09-21T09:06:13.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.533+0000 7fd1096d2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd10409bd50 0x7fd10409c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:13.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.533+0000 7fd1096d2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd10409d3b0 con 0x7fd10409c670 2024-09-21T09:06:13.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.533+0000 7fd1096d2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd104098230 con 0x7fd10409bd50 2024-09-21T09:06:13.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.534+0000 7fd102ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd10409bd50 0x7fd10409c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:13.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.534+0000 7fd1027fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd10409c670 0x7fd1040990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58264/0 (socket says 172.21.15.44:58264) 2024-09-21T09:06:13.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.534+0000 7fd1027fc640 1 -- 172.21.15.44:0/1534017355 learned_addr learned my addr 172.21.15.44:0/1534017355 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:13.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.534+0000 7fd102ffd640 1 -- 172.21.15.44:0/1534017355 >> v1:172.21.15.44:6789/0 conn(0x7fd10409c670 legacy=0x7fd1040990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.534+0000 7fd102ffd640 1 -- 172.21.15.44:0/1534017355 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1040983e0 con 0x7fd10409bd50 2024-09-21T09:06:13.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.535+0000 7fd102ffd640 1 --2- 172.21.15.44:0/1534017355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd10409bd50 0x7fd10409c130 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009720 tx=0x7fd0f402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f99a10b9fd3ceaa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:13.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.535+0000 7fd101ffb640 1 -- 172.21.15.44:0/1534017355 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f4037070 con 0x7fd10409bd50 2024-09-21T09:06:13.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.535+0000 7fd101ffb640 1 -- 172.21.15.44:0/1534017355 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f402ad90 con 0x7fd10409bd50 2024-09-21T09:06:13.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.535+0000 7fd101ffb640 1 -- 172.21.15.44:0/1534017355 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f4032590 con 0x7fd10409bd50 2024-09-21T09:06:13.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.535+0000 7fd1096d2640 1 -- 172.21.15.44:0/1534017355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd10409bd50 msgr2=0x7fd10409c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.535+0000 7fd1096d2640 1 --2- 172.21.15.44:0/1534017355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd10409bd50 0x7fd10409c130 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009720 tx=0x7fd0f402a110 comp rx=0 tx=0).stop 2024-09-21T09:06:13.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.535+0000 7fd1096d2640 1 -- 172.21.15.44:0/1534017355 shutdown_connections 2024-09-21T09:06:13.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.535+0000 7fd1096d2640 1 --2- 172.21.15.44:0/1534017355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd10409bd50 0x7fd10409c130 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.535+0000 7fd1096d2640 1 -- 172.21.15.44:0/1534017355 >> 172.21.15.44:0/1534017355 conn(0x7fd10406d4a0 msgr2=0x7fd10406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:13.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.535+0000 7fd1096d2640 1 -- 172.21.15.44:0/1534017355 shutdown_connections 2024-09-21T09:06:13.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.535+0000 7fd1096d2640 1 -- 172.21.15.44:0/1534017355 wait complete. 2024-09-21T09:06:13.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.536+0000 7fd1096d2640 1 Processor -- start 2024-09-21T09:06:13.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.536+0000 7fd1096d2640 1 -- start start 2024-09-21T09:06:13.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.537+0000 7fd1096d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd10409bd50 0x7fd104093570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:13.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.537+0000 7fd1096d2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd104099b90 con 0x7fd10409bd50 2024-09-21T09:06:13.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.537+0000 7fd102ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd10409bd50 0x7fd104093570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:13.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.537+0000 7fd102ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd10409bd50 0x7fd104093570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53054/0 (socket says 172.21.15.44:53054) 2024-09-21T09:06:13.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.537+0000 7fd102ffd640 1 -- 172.21.15.44:0/3196122274 learned_addr learned my addr 172.21.15.44:0/3196122274 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:13.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.537+0000 7fd102ffd640 1 -- 172.21.15.44:0/3196122274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd104094eb0 con 0x7fd10409bd50 2024-09-21T09:06:13.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.537+0000 7fd102ffd640 1 --2- 172.21.15.44:0/3196122274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd10409bd50 0x7fd104093570 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009840 tx=0x7fd0f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:13.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.537+0000 7fd0eb7fe640 1 -- 172.21.15.44:0/3196122274 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f4041070 con 0x7fd10409bd50 2024-09-21T09:06:13.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.537+0000 7fd0eb7fe640 1 -- 172.21.15.44:0/3196122274 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f403c460 con 0x7fd10409bd50 2024-09-21T09:06:13.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.537+0000 7fd1096d2640 1 -- 172.21.15.44:0/3196122274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd104095590 con 0x7fd10409bd50 2024-09-21T09:06:13.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.537+0000 7fd0eb7fe640 1 -- 172.21.15.44:0/3196122274 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f4037040 con 0x7fd10409bd50 2024-09-21T09:06:13.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.538+0000 7fd1096d2640 1 -- 172.21.15.44:0/3196122274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1040961c0 con 0x7fd10409bd50 2024-09-21T09:06:13.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.538+0000 7fd0eb7fe640 1 -- 172.21.15.44:0/3196122274 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd0f4044070 con 0x7fd10409bd50 2024-09-21T09:06:13.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.538+0000 7fd1096d2640 1 -- 172.21.15.44:0/3196122274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd10409a130 con 0x7fd10409bd50 2024-09-21T09:06:13.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.539+0000 7fd0eb7fe640 1 --2- 172.21.15.44:0/3196122274 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0f00382a0 0x7fd0f003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:13.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.539+0000 7fd0eb7fe640 1 -- 172.21.15.44:0/3196122274 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fd0f406c510 con 0x7fd10409bd50 2024-09-21T09:06:13.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.539+0000 7fd1027fc640 1 --2- 172.21.15.44:0/3196122274 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0f00382a0 0x7fd0f003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:13.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.539+0000 7fd1027fc640 1 --2- 172.21.15.44:0/3196122274 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0f00382a0 0x7fd0f003a760 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8007fd0 tx=0x7fd0f8007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:13.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.543+0000 7fd0eb7fe640 1 -- 172.21.15.44:0/3196122274 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd1040961c0 con 0x7fd10409bd50 2024-09-21T09:06:13.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.718+0000 7fd1096d2640 1 -- 172.21.15.44:0/3196122274 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd10409d020 con 0x7fd0f00382a0 2024-09-21T09:06:13.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.733+0000 7fd0eb7fe640 1 -- 172.21.15.44:0/3196122274 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665585 (secure 0 0 0) 0x7fd10409d020 con 0x7fd0f00382a0 2024-09-21T09:06:13.742 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:06:13.747 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-21T09:06:13.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.738+0000 7fd1096d2640 1 -- 172.21.15.44:0/3196122274 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0f00382a0 msgr2=0x7fd0f003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.738+0000 7fd1096d2640 1 --2- 172.21.15.44:0/3196122274 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0f00382a0 0x7fd0f003a760 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8007fd0 tx=0x7fd0f8007ac0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.738+0000 7fd1096d2640 1 -- 172.21.15.44:0/3196122274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd10409bd50 msgr2=0x7fd104093570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.738+0000 7fd1096d2640 1 --2- 172.21.15.44:0/3196122274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd10409bd50 0x7fd104093570 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009840 tx=0x7fd0f40046c0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.738+0000 7fd1096d2640 1 -- 172.21.15.44:0/3196122274 shutdown_connections 2024-09-21T09:06:13.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.738+0000 7fd1096d2640 1 --2- 172.21.15.44:0/3196122274 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd0f00382a0 0x7fd0f003a760 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.738+0000 7fd1096d2640 1 --2- 172.21.15.44:0/3196122274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd10409bd50 0x7fd104093570 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.738+0000 7fd1096d2640 1 -- 172.21.15.44:0/3196122274 >> 172.21.15.44:0/3196122274 conn(0x7fd10406d4a0 msgr2=0x7fd10409eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:13.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.738+0000 7fd1096d2640 1 -- 172.21.15.44:0/3196122274 shutdown_connections 2024-09-21T09:06:13.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.738+0000 7fd1096d2640 1 -- 172.21.15.44:0/3196122274 wait complete. 2024-09-21T09:06:13.750 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-21T09:06:12.483951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4881,"num_read_kb":4462,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190416,"kb_used_data":53200,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377296944,"statfs":{"total":386547056640,"available":386352070656,"internally_reserved":0,"allocated":54476800,"data_stored":53330918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":140437271},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003770"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.693474+0000","last_change":"2024-09-21T09:03:38.283847+0000","last_active":"2024-09-21T09:05:05.693474+0000","last_peered":"2024-09-21T09:05:05.693474+0000","last_clean":"2024-09-21T09:05:05.693474+0000","last_became_active":"2024-09-21T09:03:38.283357+0000","last_became_peered":"2024-09-21T09:03:38.283357+0000","last_unstale":"2024-09-21T09:05:05.693474+0000","last_undegraded":"2024-09-21T09:05:05.693474+0000","last_fullsized":"2024-09-21T09:05:05.693474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:01.386955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'20","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.299232+0000","last_change":"2024-09-21T09:03:00.226390+0000","last_active":"2024-09-21T09:06:06.299232+0000","last_peered":"2024-09-21T09:06:06.299232+0000","last_clean":"2024-09-21T09:06:06.299232+0000","last_became_active":"2024-09-21T09:03:00.226067+0000","last_became_peered":"2024-09-21T09:03:00.226067+0000","last_unstale":"2024-09-21T09:06:06.299232+0000","last_undegraded":"2024-09-21T09:06:06.299232+0000","last_fullsized":"2024-09-21T09:06:06.299232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:19.763600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465423+0000","last_change":"2024-09-21T09:02:58.213108+0000","last_active":"2024-09-21T09:03:38.465423+0000","last_peered":"2024-09-21T09:03:38.465423+0000","last_clean":"2024-09-21T09:03:38.465423+0000","last_became_active":"2024-09-21T09:02:58.212828+0000","last_became_peered":"2024-09-21T09:02:58.212828+0000","last_unstale":"2024-09-21T09:03:38.465423+0000","last_undegraded":"2024-09-21T09:03:38.465423+0000","last_fullsized":"2024-09-21T09:03:38.465423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:25.409736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298796+0000","last_change":"2024-09-21T09:03:00.222612+0000","last_active":"2024-09-21T09:06:06.298796+0000","last_peered":"2024-09-21T09:06:06.298796+0000","last_clean":"2024-09-21T09:06:06.298796+0000","last_became_active":"2024-09-21T09:03:00.222333+0000","last_became_peered":"2024-09-21T09:03:00.222333+0000","last_unstale":"2024-09-21T09:06:06.298796+0000","last_undegraded":"2024-09-21T09:06:06.298796+0000","last_fullsized":"2024-09-21T09:06:06.298796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:22.752060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278836+0000","last_change":"2024-09-21T09:02:58.221389+0000","last_active":"2024-09-21T09:03:38.278836+0000","last_peered":"2024-09-21T09:03:38.278836+0000","last_clean":"2024-09-21T09:03:38.278836+0000","last_became_active":"2024-09-21T09:02:58.221214+0000","last_became_peered":"2024-09-21T09:02:58.221214+0000","last_unstale":"2024-09-21T09:03:38.278836+0000","last_undegraded":"2024-09-21T09:03:38.278836+0000","last_fullsized":"2024-09-21T09:03:38.278836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:59.331305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173989+0000","last_change":"2024-09-21T09:03:00.221728+0000","last_active":"2024-09-21T09:06:06.173989+0000","last_peered":"2024-09-21T09:06:06.173989+0000","last_clean":"2024-09-21T09:06:06.173989+0000","last_became_active":"2024-09-21T09:03:00.221451+0000","last_became_peered":"2024-09-21T09:03:00.221451+0000","last_unstale":"2024-09-21T09:06:06.173989+0000","last_undegraded":"2024-09-21T09:06:06.173989+0000","last_fullsized":"2024-09-21T09:06:06.173989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:36.553233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:57.452905+0000","last_change":"2024-09-21T09:02:58.208725+0000","last_active":"2024-09-21T09:04:57.452905+0000","last_peered":"2024-09-21T09:04:57.452905+0000","last_clean":"2024-09-21T09:04:57.452905+0000","last_became_active":"2024-09-21T09:02:58.207683+0000","last_became_peered":"2024-09-21T09:02:58.207683+0000","last_unstale":"2024-09-21T09:04:57.452905+0000","last_undegraded":"2024-09-21T09:04:57.452905+0000","last_fullsized":"2024-09-21T09:04:57.452905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:12.355792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'9","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.267454+0000","last_change":"2024-09-21T09:03:00.212574+0000","last_active":"2024-09-21T09:06:06.267454+0000","last_peered":"2024-09-21T09:06:06.267454+0000","last_clean":"2024-09-21T09:06:06.267454+0000","last_became_active":"2024-09-21T09:03:00.210589+0000","last_became_peered":"2024-09-21T09:03:00.210589+0000","last_unstale":"2024-09-21T09:06:06.267454+0000","last_undegraded":"2024-09-21T09:06:06.267454+0000","last_fullsized":"2024-09-21T09:06:06.267454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:11.555715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.253856+0000","last_change":"2024-09-21T09:02:58.224906+0000","last_active":"2024-09-21T09:06:06.253856+0000","last_peered":"2024-09-21T09:06:06.253856+0000","last_clean":"2024-09-21T09:06:06.253856+0000","last_became_active":"2024-09-21T09:02:58.224630+0000","last_became_peered":"2024-09-21T09:02:58.224630+0000","last_unstale":"2024-09-21T09:06:06.253856+0000","last_undegraded":"2024-09-21T09:06:06.253856+0000","last_fullsized":"2024-09-21T09:06:06.253856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:24.376659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'6","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298997+0000","last_change":"2024-09-21T09:03:00.223960+0000","last_active":"2024-09-21T09:06:06.298997+0000","last_peered":"2024-09-21T09:06:06.298997+0000","last_clean":"2024-09-21T09:06:06.298997+0000","last_became_active":"2024-09-21T09:03:00.217048+0000","last_became_peered":"2024-09-21T09:03:00.217048+0000","last_unstale":"2024-09-21T09:06:06.298997+0000","last_undegraded":"2024-09-21T09:06:06.298997+0000","last_fullsized":"2024-09-21T09:06:06.298997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:50.802476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.626681+0000","last_change":"2024-09-21T09:02:58.205801+0000","last_active":"2024-09-21T09:05:05.626681+0000","last_peered":"2024-09-21T09:05:05.626681+0000","last_clean":"2024-09-21T09:05:05.626681+0000","last_became_active":"2024-09-21T09:02:58.205515+0000","last_became_peered":"2024-09-21T09:02:58.205515+0000","last_unstale":"2024-09-21T09:05:05.626681+0000","last_undegraded":"2024-09-21T09:05:05.626681+0000","last_fullsized":"2024-09-21T09:05:05.626681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:14.606085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'14","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363415+0000","last_change":"2024-09-21T09:03:00.222211+0000","last_active":"2024-09-21T09:06:06.363415+0000","last_peered":"2024-09-21T09:06:06.363415+0000","last_clean":"2024-09-21T09:06:06.363415+0000","last_became_active":"2024-09-21T09:03:00.221117+0000","last_became_peered":"2024-09-21T09:03:00.221117+0000","last_unstale":"2024-09-21T09:06:06.363415+0000","last_undegraded":"2024-09-21T09:06:06.363415+0000","last_fullsized":"2024-09-21T09:06:06.363415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:45.284408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.248708+0000","last_change":"2024-09-21T09:02:58.211066+0000","last_active":"2024-09-21T09:06:06.248708+0000","last_peered":"2024-09-21T09:06:06.248708+0000","last_clean":"2024-09-21T09:06:06.248708+0000","last_became_active":"2024-09-21T09:02:58.210702+0000","last_became_peered":"2024-09-21T09:02:58.210702+0000","last_unstale":"2024-09-21T09:06:06.248708+0000","last_undegraded":"2024-09-21T09:06:06.248708+0000","last_fullsized":"2024-09-21T09:06:06.248708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:18.510636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'10","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363641+0000","last_change":"2024-09-21T09:03:00.221039+0000","last_active":"2024-09-21T09:06:06.363641+0000","last_peered":"2024-09-21T09:06:06.363641+0000","last_clean":"2024-09-21T09:06:06.363641+0000","last_became_active":"2024-09-21T09:03:00.220725+0000","last_became_peered":"2024-09-21T09:03:00.220725+0000","last_unstale":"2024-09-21T09:06:06.363641+0000","last_undegraded":"2024-09-21T09:06:06.363641+0000","last_fullsized":"2024-09-21T09:06:06.363641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:39.266159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.256624+0000","last_change":"2024-09-21T09:02:58.217016+0000","last_active":"2024-09-21T09:06:06.256624+0000","last_peered":"2024-09-21T09:06:06.256624+0000","last_clean":"2024-09-21T09:06:06.256624+0000","last_became_active":"2024-09-21T09:02:58.216712+0000","last_became_peered":"2024-09-21T09:02:58.216712+0000","last_unstale":"2024-09-21T09:06:06.256624+0000","last_undegraded":"2024-09-21T09:06:06.256624+0000","last_fullsized":"2024-09-21T09:06:06.256624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:52.024304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'14","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363418+0000","last_change":"2024-09-21T09:03:00.222904+0000","last_active":"2024-09-21T09:06:06.363418+0000","last_peered":"2024-09-21T09:06:06.363418+0000","last_clean":"2024-09-21T09:06:06.363418+0000","last_became_active":"2024-09-21T09:03:00.222593+0000","last_became_peered":"2024-09-21T09:03:00.222593+0000","last_unstale":"2024-09-21T09:06:06.363418+0000","last_undegraded":"2024-09-21T09:06:06.363418+0000","last_fullsized":"2024-09-21T09:06:06.363418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:47.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'11","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460587+0000","last_change":"2024-09-21T09:03:00.220191+0000","last_active":"2024-09-21T09:05:23.460587+0000","last_peered":"2024-09-21T09:05:23.460587+0000","last_clean":"2024-09-21T09:05:23.460587+0000","last_became_active":"2024-09-21T09:03:00.219923+0000","last_became_peered":"2024-09-21T09:03:00.219923+0000","last_unstale":"2024-09-21T09:05:23.460587+0000","last_undegraded":"2024-09-21T09:05:23.460587+0000","last_fullsized":"2024-09-21T09:05:23.460587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:09.508750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275945+0000","last_change":"2024-09-21T09:02:58.212942+0000","last_active":"2024-09-21T09:03:38.275945+0000","last_peered":"2024-09-21T09:03:38.275945+0000","last_clean":"2024-09-21T09:03:38.275945+0000","last_became_active":"2024-09-21T09:02:58.210936+0000","last_became_peered":"2024-09-21T09:02:58.210936+0000","last_unstale":"2024-09-21T09:03:38.275945+0000","last_undegraded":"2024-09-21T09:03:38.275945+0000","last_fullsized":"2024-09-21T09:03:38.275945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:08.728738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'8","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.072789+0000","last_change":"2024-09-21T09:03:00.225223+0000","last_active":"2024-09-21T09:04:22.072789+0000","last_peered":"2024-09-21T09:04:22.072789+0000","last_clean":"2024-09-21T09:04:22.072789+0000","last_became_active":"2024-09-21T09:03:00.224695+0000","last_became_peered":"2024-09-21T09:03:00.224695+0000","last_unstale":"2024-09-21T09:04:22.072789+0000","last_undegraded":"2024-09-21T09:04:22.072789+0000","last_fullsized":"2024-09-21T09:04:22.072789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:18.875227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.246956+0000","last_change":"2024-09-21T09:02:58.220090+0000","last_active":"2024-09-21T09:04:22.246956+0000","last_peered":"2024-09-21T09:04:22.246956+0000","last_clean":"2024-09-21T09:04:22.246956+0000","last_became_active":"2024-09-21T09:02:58.218643+0000","last_became_peered":"2024-09-21T09:02:58.218643+0000","last_unstale":"2024-09-21T09:04:22.246956+0000","last_undegraded":"2024-09-21T09:04:22.246956+0000","last_fullsized":"2024-09-21T09:04:22.246956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.813396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363139+0000","last_change":"2024-09-21T09:03:00.227634+0000","last_active":"2024-09-21T09:06:06.363139+0000","last_peered":"2024-09-21T09:06:06.363139+0000","last_clean":"2024-09-21T09:06:06.363139+0000","last_became_active":"2024-09-21T09:03:00.226738+0000","last_became_peered":"2024-09-21T09:03:00.226738+0000","last_unstale":"2024-09-21T09:06:06.363139+0000","last_undegraded":"2024-09-21T09:06:06.363139+0000","last_fullsized":"2024-09-21T09:06:06.363139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:24.661101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.043712+0000","last_change":"2024-09-21T09:02:58.208501+0000","last_active":"2024-09-21T09:06:06.043712+0000","last_peered":"2024-09-21T09:06:06.043712+0000","last_clean":"2024-09-21T09:06:06.043712+0000","last_became_active":"2024-09-21T09:02:58.208220+0000","last_became_peered":"2024-09-21T09:02:58.208220+0000","last_unstale":"2024-09-21T09:06:06.043712+0000","last_undegraded":"2024-09-21T09:06:06.043712+0000","last_fullsized":"2024-09-21T09:06:06.043712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:44.533015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'16","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260865+0000","last_change":"2024-09-21T09:03:00.216019+0000","last_active":"2024-09-21T09:06:06.260865+0000","last_peered":"2024-09-21T09:06:06.260865+0000","last_clean":"2024-09-21T09:06:06.260865+0000","last_became_active":"2024-09-21T09:03:00.215637+0000","last_became_peered":"2024-09-21T09:03:00.215637+0000","last_unstale":"2024-09-21T09:06:06.260865+0000","last_undegraded":"2024-09-21T09:06:06.260865+0000","last_fullsized":"2024-09-21T09:06:06.260865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.852495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275771+0000","last_change":"2024-09-21T09:02:58.206160+0000","last_active":"2024-09-21T09:03:38.275771+0000","last_peered":"2024-09-21T09:03:38.275771+0000","last_clean":"2024-09-21T09:03:38.275771+0000","last_became_active":"2024-09-21T09:02:58.204603+0000","last_became_peered":"2024-09-21T09:02:58.204603+0000","last_unstale":"2024-09-21T09:03:38.275771+0000","last_undegraded":"2024-09-21T09:03:38.275771+0000","last_fullsized":"2024-09-21T09:03:38.275771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:38.066496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.717096+0000","last_change":"2024-09-21T09:03:00.223258+0000","last_active":"2024-09-21T09:05:05.717096+0000","last_peered":"2024-09-21T09:05:05.717096+0000","last_clean":"2024-09-21T09:05:05.717096+0000","last_became_active":"2024-09-21T09:03:00.222972+0000","last_became_peered":"2024-09-21T09:03:00.222972+0000","last_unstale":"2024-09-21T09:05:05.717096+0000","last_undegraded":"2024-09-21T09:05:05.717096+0000","last_fullsized":"2024-09-21T09:05:05.717096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:32.562147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464762+0000","last_change":"2024-09-21T09:02:58.208852+0000","last_active":"2024-09-21T09:03:38.464762+0000","last_peered":"2024-09-21T09:03:38.464762+0000","last_clean":"2024-09-21T09:03:38.464762+0000","last_became_active":"2024-09-21T09:02:58.208383+0000","last_became_peered":"2024-09-21T09:02:58.208383+0000","last_unstale":"2024-09-21T09:03:38.464762+0000","last_undegraded":"2024-09-21T09:03:38.464762+0000","last_fullsized":"2024-09-21T09:03:38.464762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:07.674387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363227+0000","last_change":"2024-09-21T09:03:00.212288+0000","last_active":"2024-09-21T09:06:06.363227+0000","last_peered":"2024-09-21T09:06:06.363227+0000","last_clean":"2024-09-21T09:06:06.363227+0000","last_became_active":"2024-09-21T09:03:00.211942+0000","last_became_peered":"2024-09-21T09:03:00.211942+0000","last_unstale":"2024-09-21T09:06:06.363227+0000","last_undegraded":"2024-09-21T09:06:06.363227+0000","last_fullsized":"2024-09-21T09:06:06.363227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:53.039369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.753027+0000","last_change":"2024-09-21T09:02:58.214186+0000","last_active":"2024-09-21T09:03:38.753027+0000","last_peered":"2024-09-21T09:03:38.753027+0000","last_clean":"2024-09-21T09:03:38.753027+0000","last_became_active":"2024-09-21T09:02:58.213548+0000","last_became_peered":"2024-09-21T09:02:58.213548+0000","last_unstale":"2024-09-21T09:03:38.753027+0000","last_undegraded":"2024-09-21T09:03:38.753027+0000","last_fullsized":"2024-09-21T09:03:38.753027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:14.666195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.280442+0000","last_change":"2024-09-21T09:03:08.262655+0000","last_active":"2024-09-21T09:06:06.280442+0000","last_peered":"2024-09-21T09:06:06.280442+0000","last_clean":"2024-09-21T09:06:06.280442+0000","last_became_active":"2024-09-21T09:03:08.262362+0000","last_became_peered":"2024-09-21T09:03:08.262362+0000","last_unstale":"2024-09-21T09:06:06.280442+0000","last_undegraded":"2024-09-21T09:06:06.280442+0000","last_fullsized":"2024-09-21T09:06:06.280442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:23.685881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275829+0000","last_change":"2024-09-21T09:03:00.212668+0000","last_active":"2024-09-21T09:03:38.275829+0000","last_peered":"2024-09-21T09:03:38.275829+0000","last_clean":"2024-09-21T09:03:38.275829+0000","last_became_active":"2024-09-21T09:03:00.209346+0000","last_became_peered":"2024-09-21T09:03:00.209346+0000","last_unstale":"2024-09-21T09:03:38.275829+0000","last_undegraded":"2024-09-21T09:03:38.275829+0000","last_fullsized":"2024-09-21T09:03:38.275829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:35.918701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271768+0000","last_change":"2024-09-21T09:02:58.221478+0000","last_active":"2024-09-21T09:03:38.271768+0000","last_peered":"2024-09-21T09:03:38.271768+0000","last_clean":"2024-09-21T09:03:38.271768+0000","last_became_active":"2024-09-21T09:02:58.221187+0000","last_became_peered":"2024-09-21T09:02:58.221187+0000","last_unstale":"2024-09-21T09:03:38.271768+0000","last_undegraded":"2024-09-21T09:03:38.271768+0000","last_fullsized":"2024-09-21T09:03:38.271768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:43.391268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277937+0000","last_change":"2024-09-21T09:03:02.220660+0000","last_active":"2024-09-21T09:03:38.277937+0000","last_peered":"2024-09-21T09:03:38.277937+0000","last_clean":"2024-09-21T09:03:38.277937+0000","last_became_active":"2024-09-21T09:03:02.220370+0000","last_became_peered":"2024-09-21T09:03:02.220370+0000","last_unstale":"2024-09-21T09:03:38.277937+0000","last_undegraded":"2024-09-21T09:03:38.277937+0000","last_fullsized":"2024-09-21T09:03:38.277937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:00.166342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.351174+0000","last_change":"2024-09-21T09:03:04.243245+0000","last_active":"2024-09-21T09:05:04.351174+0000","last_peered":"2024-09-21T09:05:04.351174+0000","last_clean":"2024-09-21T09:05:04.351174+0000","last_became_active":"2024-09-21T09:03:04.242637+0000","last_became_peered":"2024-09-21T09:03:04.242637+0000","last_unstale":"2024-09-21T09:05:04.351174+0000","last_undegraded":"2024-09-21T09:05:04.351174+0000","last_fullsized":"2024-09-21T09:05:04.351174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:09.480974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274815+0000","last_change":"2024-09-21T09:03:06.247484+0000","last_active":"2024-09-21T09:03:38.274815+0000","last_peered":"2024-09-21T09:03:38.274815+0000","last_clean":"2024-09-21T09:03:38.274815+0000","last_became_active":"2024-09-21T09:03:06.247203+0000","last_became_peered":"2024-09-21T09:03:06.247203+0000","last_unstale":"2024-09-21T09:03:38.274815+0000","last_undegraded":"2024-09-21T09:03:38.274815+0000","last_fullsized":"2024-09-21T09:03:38.274815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:37.402801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.415271+0000","last_change":"2024-09-21T09:03:08.262677+0000","last_active":"2024-09-21T09:06:06.415271+0000","last_peered":"2024-09-21T09:06:06.415271+0000","last_clean":"2024-09-21T09:06:06.415271+0000","last_became_active":"2024-09-21T09:03:08.262384+0000","last_became_peered":"2024-09-21T09:03:08.262384+0000","last_unstale":"2024-09-21T09:06:06.415271+0000","last_undegraded":"2024-09-21T09:06:06.415271+0000","last_fullsized":"2024-09-21T09:06:06.415271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:38.859764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'8","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298988+0000","last_change":"2024-09-21T09:03:00.218848+0000","last_active":"2024-09-21T09:06:06.298988+0000","last_peered":"2024-09-21T09:06:06.298988+0000","last_clean":"2024-09-21T09:06:06.298988+0000","last_became_active":"2024-09-21T09:03:00.217658+0000","last_became_peered":"2024-09-21T09:03:00.217658+0000","last_unstale":"2024-09-21T09:06:06.298988+0000","last_undegraded":"2024-09-21T09:06:06.298988+0000","last_fullsized":"2024-09-21T09:06:06.298988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:04.690462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275111+0000","last_change":"2024-09-21T09:02:58.218614+0000","last_active":"2024-09-21T09:03:38.275111+0000","last_peered":"2024-09-21T09:03:38.275111+0000","last_clean":"2024-09-21T09:03:38.275111+0000","last_became_active":"2024-09-21T09:02:58.218086+0000","last_became_peered":"2024-09-21T09:02:58.218086+0000","last_unstale":"2024-09-21T09:03:38.275111+0000","last_undegraded":"2024-09-21T09:03:38.275111+0000","last_fullsized":"2024-09-21T09:03:38.275111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:03.460514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466155+0000","last_change":"2024-09-21T09:03:02.220885+0000","last_active":"2024-09-21T09:03:38.466155+0000","last_peered":"2024-09-21T09:03:38.466155+0000","last_clean":"2024-09-21T09:03:38.466155+0000","last_became_active":"2024-09-21T09:03:02.220557+0000","last_became_peered":"2024-09-21T09:03:02.220557+0000","last_unstale":"2024-09-21T09:03:38.466155+0000","last_undegraded":"2024-09-21T09:03:38.466155+0000","last_fullsized":"2024-09-21T09:03:38.466155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:27.649227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274937+0000","last_change":"2024-09-21T09:03:04.236337+0000","last_active":"2024-09-21T09:03:38.274937+0000","last_peered":"2024-09-21T09:03:38.274937+0000","last_clean":"2024-09-21T09:03:38.274937+0000","last_became_active":"2024-09-21T09:03:04.236037+0000","last_became_peered":"2024-09-21T09:03:04.236037+0000","last_unstale":"2024-09-21T09:03:38.274937+0000","last_undegraded":"2024-09-21T09:03:38.274937+0000","last_fullsized":"2024-09-21T09:03:38.274937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:06.028996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274949+0000","last_change":"2024-09-21T09:03:06.244177+0000","last_active":"2024-09-21T09:03:38.274949+0000","last_peered":"2024-09-21T09:03:38.274949+0000","last_clean":"2024-09-21T09:03:38.274949+0000","last_became_active":"2024-09-21T09:03:06.243901+0000","last_became_peered":"2024-09-21T09:03:06.243901+0000","last_unstale":"2024-09-21T09:03:38.274949+0000","last_undegraded":"2024-09-21T09:03:38.274949+0000","last_fullsized":"2024-09-21T09:03:38.274949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:03.746735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463546+0000","last_change":"2024-09-21T09:03:08.250364+0000","last_active":"2024-09-21T09:03:38.463546+0000","last_peered":"2024-09-21T09:03:38.463546+0000","last_clean":"2024-09-21T09:03:38.463546+0000","last_became_active":"2024-09-21T09:03:08.250029+0000","last_became_peered":"2024-09-21T09:03:08.250029+0000","last_unstale":"2024-09-21T09:03:38.463546+0000","last_undegraded":"2024-09-21T09:03:38.463546+0000","last_fullsized":"2024-09-21T09:03:38.463546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:58.888309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260917+0000","last_change":"2024-09-21T09:03:00.217928+0000","last_active":"2024-09-21T09:06:06.260917+0000","last_peered":"2024-09-21T09:06:06.260917+0000","last_clean":"2024-09-21T09:06:06.260917+0000","last_became_active":"2024-09-21T09:03:00.217633+0000","last_became_peered":"2024-09-21T09:03:00.217633+0000","last_unstale":"2024-09-21T09:06:06.260917+0000","last_undegraded":"2024-09-21T09:06:06.260917+0000","last_fullsized":"2024-09-21T09:06:06.260917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:20.929000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270779+0000","last_change":"2024-09-21T09:02:58.220432+0000","last_active":"2024-09-21T09:03:38.270779+0000","last_peered":"2024-09-21T09:03:38.270779+0000","last_clean":"2024-09-21T09:03:38.270779+0000","last_became_active":"2024-09-21T09:02:58.220133+0000","last_became_peered":"2024-09-21T09:02:58.220133+0000","last_unstale":"2024-09-21T09:03:38.270779+0000","last_undegraded":"2024-09-21T09:03:38.270779+0000","last_fullsized":"2024-09-21T09:03:38.270779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:53.075751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466206+0000","last_change":"2024-09-21T09:03:02.220223+0000","last_active":"2024-09-21T09:03:38.466206+0000","last_peered":"2024-09-21T09:03:38.466206+0000","last_clean":"2024-09-21T09:03:38.466206+0000","last_became_active":"2024-09-21T09:03:02.219457+0000","last_became_peered":"2024-09-21T09:03:02.219457+0000","last_unstale":"2024-09-21T09:03:38.466206+0000","last_undegraded":"2024-09-21T09:03:38.466206+0000","last_fullsized":"2024-09-21T09:03:38.466206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:02.648349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276650+0000","last_change":"2024-09-21T09:03:04.239498+0000","last_active":"2024-09-21T09:03:38.276650+0000","last_peered":"2024-09-21T09:03:38.276650+0000","last_clean":"2024-09-21T09:03:38.276650+0000","last_became_active":"2024-09-21T09:03:04.239187+0000","last_became_peered":"2024-09-21T09:03:04.239187+0000","last_unstale":"2024-09-21T09:03:38.276650+0000","last_undegraded":"2024-09-21T09:03:38.276650+0000","last_fullsized":"2024-09-21T09:03:38.276650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:25.074373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'282","reported_seq":384,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.469439+0000","last_change":"2024-09-21T09:03:06.248028+0000","last_active":"2024-09-21T09:06:06.469439+0000","last_peered":"2024-09-21T09:06:06.469439+0000","last_clean":"2024-09-21T09:06:06.469439+0000","last_became_active":"2024-09-21T09:03:06.247441+0000","last_became_peered":"2024-09-21T09:03:06.247441+0000","last_unstale":"2024-09-21T09:06:06.469439+0000","last_undegraded":"2024-09-21T09:06:06.469439+0000","last_fullsized":"2024-09-21T09:06:06.469439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:22.593231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'6","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.177765+0000","last_change":"2024-09-21T09:03:08.255550+0000","last_active":"2024-09-21T09:06:06.177765+0000","last_peered":"2024-09-21T09:06:06.177765+0000","last_clean":"2024-09-21T09:06:06.177765+0000","last_became_active":"2024-09-21T09:03:08.255274+0000","last_became_peered":"2024-09-21T09:03:08.255274+0000","last_unstale":"2024-09-21T09:06:06.177765+0000","last_undegraded":"2024-09-21T09:06:06.177765+0000","last_fullsized":"2024-09-21T09:06:06.177765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:12.962973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'4","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173759+0000","last_change":"2024-09-21T09:03:00.216751+0000","last_active":"2024-09-21T09:06:06.173759+0000","last_peered":"2024-09-21T09:06:06.173759+0000","last_clean":"2024-09-21T09:06:06.173759+0000","last_became_active":"2024-09-21T09:03:00.216382+0000","last_became_peered":"2024-09-21T09:03:00.216382+0000","last_unstale":"2024-09-21T09:06:06.173759+0000","last_undegraded":"2024-09-21T09:06:06.173759+0000","last_fullsized":"2024-09-21T09:06:06.173759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:06.215821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273477+0000","last_change":"2024-09-21T09:02:58.210831+0000","last_active":"2024-09-21T09:03:38.273477+0000","last_peered":"2024-09-21T09:03:38.273477+0000","last_clean":"2024-09-21T09:03:38.273477+0000","last_became_active":"2024-09-21T09:02:58.210560+0000","last_became_peered":"2024-09-21T09:02:58.210560+0000","last_unstale":"2024-09-21T09:03:38.273477+0000","last_undegraded":"2024-09-21T09:03:38.273477+0000","last_fullsized":"2024-09-21T09:03:38.273477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:12.355792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274957+0000","last_change":"2024-09-21T09:03:02.221778+0000","last_active":"2024-09-21T09:03:38.274957+0000","last_peered":"2024-09-21T09:03:38.274957+0000","last_clean":"2024-09-21T09:03:38.274957+0000","last_became_active":"2024-09-21T09:03:02.220551+0000","last_became_peered":"2024-09-21T09:03:02.220551+0000","last_unstale":"2024-09-21T09:03:38.274957+0000","last_undegraded":"2024-09-21T09:03:38.274957+0000","last_fullsized":"2024-09-21T09:03:38.274957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:46.255807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.346241+0000","last_change":"2024-09-21T09:03:04.234165+0000","last_active":"2024-09-21T09:05:04.346241+0000","last_peered":"2024-09-21T09:05:04.346241+0000","last_clean":"2024-09-21T09:05:04.346241+0000","last_became_active":"2024-09-21T09:03:04.233848+0000","last_became_peered":"2024-09-21T09:03:04.233848+0000","last_unstale":"2024-09-21T09:05:04.346241+0000","last_undegraded":"2024-09-21T09:05:04.346241+0000","last_fullsized":"2024-09-21T09:05:04.346241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:09.138690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'282","reported_seq":400,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.366462+0000","last_change":"2024-09-21T09:03:06.244195+0000","last_active":"2024-09-21T09:06:06.366462+0000","last_peered":"2024-09-21T09:06:06.366462+0000","last_clean":"2024-09-21T09:06:06.366462+0000","last_became_active":"2024-09-21T09:03:06.243576+0000","last_became_peered":"2024-09-21T09:03:06.243576+0000","last_unstale":"2024-09-21T09:06:06.366462+0000","last_undegraded":"2024-09-21T09:06:06.366462+0000","last_fullsized":"2024-09-21T09:06:06.366462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:31.080527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271245+0000","last_change":"2024-09-21T09:03:00.217801+0000","last_active":"2024-09-21T09:03:38.271245+0000","last_peered":"2024-09-21T09:03:38.271245+0000","last_clean":"2024-09-21T09:03:38.271245+0000","last_became_active":"2024-09-21T09:03:00.217545+0000","last_became_peered":"2024-09-21T09:03:00.217545+0000","last_unstale":"2024-09-21T09:03:38.271245+0000","last_undegraded":"2024-09-21T09:03:38.271245+0000","last_fullsized":"2024-09-21T09:03:38.271245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:43.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.281094+0000","last_change":"2024-09-21T09:02:58.209991+0000","last_active":"2024-09-21T09:03:38.281094+0000","last_peered":"2024-09-21T09:03:38.281094+0000","last_clean":"2024-09-21T09:03:38.281094+0000","last_became_active":"2024-09-21T09:02:58.209712+0000","last_became_peered":"2024-09-21T09:02:58.209712+0000","last_unstale":"2024-09-21T09:03:38.281094+0000","last_undegraded":"2024-09-21T09:03:38.281094+0000","last_fullsized":"2024-09-21T09:03:38.281094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:25.409736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"22'1","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.388071+0000","last_change":"2024-09-21T09:03:02.220925+0000","last_active":"2024-09-21T09:05:05.388071+0000","last_peered":"2024-09-21T09:05:05.388071+0000","last_clean":"2024-09-21T09:05:05.388071+0000","last_became_active":"2024-09-21T09:03:02.220629+0000","last_became_peered":"2024-09-21T09:03:02.220629+0000","last_unstale":"2024-09-21T09:05:05.388071+0000","last_undegraded":"2024-09-21T09:05:05.388071+0000","last_fullsized":"2024-09-21T09:05:05.388071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:32.066319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'40","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.355437+0000","last_change":"2024-09-21T09:03:04.232877+0000","last_active":"2024-09-21T09:05:04.355437+0000","last_peered":"2024-09-21T09:05:04.355437+0000","last_clean":"2024-09-21T09:05:04.355437+0000","last_became_active":"2024-09-21T09:03:04.232394+0000","last_became_peered":"2024-09-21T09:03:04.232394+0000","last_unstale":"2024-09-21T09:05:04.355437+0000","last_undegraded":"2024-09-21T09:05:04.355437+0000","last_fullsized":"2024-09-21T09:05:04.355437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:29.659990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464295+0000","last_change":"2024-09-21T09:03:06.244547+0000","last_active":"2024-09-21T09:03:38.464295+0000","last_peered":"2024-09-21T09:03:38.464295+0000","last_clean":"2024-09-21T09:03:38.464295+0000","last_became_active":"2024-09-21T09:03:06.244259+0000","last_became_peered":"2024-09-21T09:03:06.244259+0000","last_unstale":"2024-09-21T09:03:38.464295+0000","last_undegraded":"2024-09-21T09:03:38.464295+0000","last_fullsized":"2024-09-21T09:03:38.464295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:41.912327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.079455+0000","last_change":"2024-09-21T09:03:08.261530+0000","last_active":"2024-09-21T09:04:22.079455+0000","last_peered":"2024-09-21T09:04:22.079455+0000","last_clean":"2024-09-21T09:04:22.079455+0000","last_became_active":"2024-09-21T09:03:08.261035+0000","last_became_peered":"2024-09-21T09:03:08.261035+0000","last_unstale":"2024-09-21T09:04:22.079455+0000","last_undegraded":"2024-09-21T09:04:22.079455+0000","last_fullsized":"2024-09-21T09:04:22.079455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:03.684978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273196+0000","last_change":"2024-09-21T09:03:00.220087+0000","last_active":"2024-09-21T09:03:38.273196+0000","last_peered":"2024-09-21T09:03:38.273196+0000","last_clean":"2024-09-21T09:03:38.273196+0000","last_became_active":"2024-09-21T09:03:00.219765+0000","last_became_peered":"2024-09-21T09:03:00.219765+0000","last_unstale":"2024-09-21T09:03:38.273196+0000","last_undegraded":"2024-09-21T09:03:38.273196+0000","last_fullsized":"2024-09-21T09:03:38.273196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:52:42.557402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276119+0000","last_change":"2024-09-21T09:02:58.214776+0000","last_active":"2024-09-21T09:03:38.276119+0000","last_peered":"2024-09-21T09:03:38.276119+0000","last_clean":"2024-09-21T09:03:38.276119+0000","last_became_active":"2024-09-21T09:02:58.214392+0000","last_became_peered":"2024-09-21T09:02:58.214392+0000","last_unstale":"2024-09-21T09:03:38.276119+0000","last_undegraded":"2024-09-21T09:03:38.276119+0000","last_fullsized":"2024-09-21T09:03:38.276119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:24.399035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463904+0000","last_change":"2024-09-21T09:03:02.223499+0000","last_active":"2024-09-21T09:03:38.463904+0000","last_peered":"2024-09-21T09:03:38.463904+0000","last_clean":"2024-09-21T09:03:38.463904+0000","last_became_active":"2024-09-21T09:03:02.223123+0000","last_became_peered":"2024-09-21T09:03:02.223123+0000","last_unstale":"2024-09-21T09:03:38.463904+0000","last_undegraded":"2024-09-21T09:03:38.463904+0000","last_fullsized":"2024-09-21T09:03:38.463904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:16.103189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.336328+0000","last_change":"2024-09-21T09:03:04.242739+0000","last_active":"2024-09-21T09:05:04.336328+0000","last_peered":"2024-09-21T09:05:04.336328+0000","last_clean":"2024-09-21T09:05:04.336328+0000","last_became_active":"2024-09-21T09:03:04.242404+0000","last_became_peered":"2024-09-21T09:03:04.242404+0000","last_unstale":"2024-09-21T09:05:04.336328+0000","last_undegraded":"2024-09-21T09:05:04.336328+0000","last_fullsized":"2024-09-21T09:05:04.336328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:55.151013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463723+0000","last_change":"2024-09-21T09:03:06.248256+0000","last_active":"2024-09-21T09:03:38.463723+0000","last_peered":"2024-09-21T09:03:38.463723+0000","last_clean":"2024-09-21T09:03:38.463723+0000","last_became_active":"2024-09-21T09:03:06.247504+0000","last_became_peered":"2024-09-21T09:03:06.247504+0000","last_unstale":"2024-09-21T09:03:38.463723+0000","last_undegraded":"2024-09-21T09:03:38.463723+0000","last_fullsized":"2024-09-21T09:03:38.463723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:25.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'3","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:16.565423+0000","last_change":"2024-09-21T09:03:08.256372+0000","last_active":"2024-09-21T09:04:16.565423+0000","last_peered":"2024-09-21T09:04:16.565423+0000","last_clean":"2024-09-21T09:04:16.565423+0000","last_became_active":"2024-09-21T09:03:08.255814+0000","last_became_peered":"2024-09-21T09:03:08.255814+0000","last_unstale":"2024-09-21T09:04:16.565423+0000","last_undegraded":"2024-09-21T09:04:16.565423+0000","last_fullsized":"2024-09-21T09:04:16.565423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:46.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273220+0000","last_change":"2024-09-21T09:03:00.223110+0000","last_active":"2024-09-21T09:03:38.273220+0000","last_peered":"2024-09-21T09:03:38.273220+0000","last_clean":"2024-09-21T09:03:38.273220+0000","last_became_active":"2024-09-21T09:03:00.222650+0000","last_became_peered":"2024-09-21T09:03:00.222650+0000","last_unstale":"2024-09-21T09:03:38.273220+0000","last_undegraded":"2024-09-21T09:03:38.273220+0000","last_fullsized":"2024-09-21T09:03:38.273220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:12.697444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278305+0000","last_change":"2024-09-21T09:02:58.213931+0000","last_active":"2024-09-21T09:03:38.278305+0000","last_peered":"2024-09-21T09:03:38.278305+0000","last_clean":"2024-09-21T09:03:38.278305+0000","last_became_active":"2024-09-21T09:02:58.213652+0000","last_became_peered":"2024-09-21T09:02:58.213652+0000","last_unstale":"2024-09-21T09:03:38.278305+0000","last_undegraded":"2024-09-21T09:03:38.278305+0000","last_fullsized":"2024-09-21T09:03:38.278305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:27.612761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.282682+0000","last_change":"2024-09-21T09:03:38.281879+0000","last_active":"2024-09-21T09:03:38.282682+0000","last_peered":"2024-09-21T09:03:38.282682+0000","last_clean":"2024-09-21T09:03:38.282682+0000","last_became_active":"2024-09-21T09:03:38.281497+0000","last_became_peered":"2024-09-21T09:03:38.281497+0000","last_unstale":"2024-09-21T09:03:38.282682+0000","last_undegraded":"2024-09-21T09:03:38.282682+0000","last_fullsized":"2024-09-21T09:03:38.282682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:32.826730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.357293+0000","last_change":"2024-09-21T09:03:04.240985+0000","last_active":"2024-09-21T09:05:04.357293+0000","last_peered":"2024-09-21T09:05:04.357293+0000","last_clean":"2024-09-21T09:05:04.357293+0000","last_became_active":"2024-09-21T09:03:04.240144+0000","last_became_peered":"2024-09-21T09:03:04.240144+0000","last_unstale":"2024-09-21T09:05:04.357293+0000","last_undegraded":"2024-09-21T09:05:04.357293+0000","last_fullsized":"2024-09-21T09:05:04.357293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:09.558749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'282","reported_seq":347,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.478440+0000","last_change":"2024-09-21T09:03:06.251119+0000","last_active":"2024-09-21T09:06:06.478440+0000","last_peered":"2024-09-21T09:06:06.478440+0000","last_clean":"2024-09-21T09:06:06.478440+0000","last_became_active":"2024-09-21T09:03:06.250807+0000","last_became_peered":"2024-09-21T09:03:06.250807+0000","last_unstale":"2024-09-21T09:06:06.478440+0000","last_undegraded":"2024-09-21T09:06:06.478440+0000","last_fullsized":"2024-09-21T09:06:06.478440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:37.402801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465087+0000","last_change":"2024-09-21T09:03:08.250308+0000","last_active":"2024-09-21T09:03:38.465087+0000","last_peered":"2024-09-21T09:03:38.465087+0000","last_clean":"2024-09-21T09:03:38.465087+0000","last_became_active":"2024-09-21T09:03:08.250063+0000","last_became_peered":"2024-09-21T09:03:08.250063+0000","last_unstale":"2024-09-21T09:03:38.465087+0000","last_undegraded":"2024-09-21T09:03:38.465087+0000","last_fullsized":"2024-09-21T09:03:38.465087+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:16.323766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.082622+0000","last_change":"2024-09-21T09:03:00.217929+0000","last_active":"2024-09-21T09:06:06.082622+0000","last_peered":"2024-09-21T09:06:06.082622+0000","last_clean":"2024-09-21T09:06:06.082622+0000","last_became_active":"2024-09-21T09:03:00.216544+0000","last_became_peered":"2024-09-21T09:03:00.216544+0000","last_unstale":"2024-09-21T09:06:06.082622+0000","last_undegraded":"2024-09-21T09:06:06.082622+0000","last_fullsized":"2024-09-21T09:06:06.082622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.852495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.836403+0000","last_change":"2024-09-21T09:02:58.224993+0000","last_active":"2024-09-21T09:03:39.836403+0000","last_peered":"2024-09-21T09:03:39.836403+0000","last_clean":"2024-09-21T09:03:39.836403+0000","last_became_active":"2024-09-21T09:02:58.224675+0000","last_became_peered":"2024-09-21T09:02:58.224675+0000","last_unstale":"2024-09-21T09:03:39.836403+0000","last_undegraded":"2024-09-21T09:03:39.836403+0000","last_fullsized":"2024-09-21T09:03:39.836403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:29.937663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464221+0000","last_change":"2024-09-21T09:03:02.223199+0000","last_active":"2024-09-21T09:03:38.464221+0000","last_peered":"2024-09-21T09:03:38.464221+0000","last_clean":"2024-09-21T09:03:38.464221+0000","last_became_active":"2024-09-21T09:03:02.222904+0000","last_became_peered":"2024-09-21T09:03:02.222904+0000","last_unstale":"2024-09-21T09:03:38.464221+0000","last_undegraded":"2024-09-21T09:03:38.464221+0000","last_fullsized":"2024-09-21T09:03:38.464221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:23.601280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'56","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.359132+0000","last_change":"2024-09-21T09:03:04.241974+0000","last_active":"2024-09-21T09:05:04.359132+0000","last_peered":"2024-09-21T09:05:04.359132+0000","last_clean":"2024-09-21T09:05:04.359132+0000","last_became_active":"2024-09-21T09:03:04.241679+0000","last_became_peered":"2024-09-21T09:03:04.241679+0000","last_unstale":"2024-09-21T09:05:04.359132+0000","last_undegraded":"2024-09-21T09:05:04.359132+0000","last_fullsized":"2024-09-21T09:05:04.359132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:49.529992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463737+0000","last_change":"2024-09-21T09:03:06.249590+0000","last_active":"2024-09-21T09:03:38.463737+0000","last_peered":"2024-09-21T09:03:38.463737+0000","last_clean":"2024-09-21T09:03:38.463737+0000","last_became_active":"2024-09-21T09:03:06.249377+0000","last_became_peered":"2024-09-21T09:03:06.249377+0000","last_unstale":"2024-09-21T09:03:38.463737+0000","last_undegraded":"2024-09-21T09:03:38.463737+0000","last_fullsized":"2024-09-21T09:03:38.463737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:09.672283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'22","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.456034+0000","last_change":"2024-09-21T09:03:08.260431+0000","last_active":"2024-09-21T09:06:06.456034+0000","last_peered":"2024-09-21T09:06:06.456034+0000","last_clean":"2024-09-21T09:06:06.456034+0000","last_became_active":"2024-09-21T09:03:08.260071+0000","last_became_peered":"2024-09-21T09:03:08.260071+0000","last_unstale":"2024-09-21T09:06:06.456034+0000","last_undegraded":"2024-09-21T09:06:06.456034+0000","last_fullsized":"2024-09-21T09:06:06.456034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:44.917297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.301342+0000","last_change":"2024-09-21T09:03:00.223450+0000","last_active":"2024-09-21T09:03:39.301342+0000","last_peered":"2024-09-21T09:03:39.301342+0000","last_clean":"2024-09-21T09:03:39.301342+0000","last_became_active":"2024-09-21T09:03:00.223184+0000","last_became_peered":"2024-09-21T09:03:00.223184+0000","last_unstale":"2024-09-21T09:03:39.301342+0000","last_undegraded":"2024-09-21T09:03:39.301342+0000","last_fullsized":"2024-09-21T09:03:39.301342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:09.836796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464552+0000","last_change":"2024-09-21T09:02:58.216900+0000","last_active":"2024-09-21T09:03:38.464552+0000","last_peered":"2024-09-21T09:03:38.464552+0000","last_clean":"2024-09-21T09:03:38.464552+0000","last_became_active":"2024-09-21T09:02:58.216545+0000","last_became_peered":"2024-09-21T09:02:58.216545+0000","last_unstale":"2024-09-21T09:03:38.464552+0000","last_undegraded":"2024-09-21T09:03:38.464552+0000","last_fullsized":"2024-09-21T09:03:38.464552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:24.399035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274224+0000","last_change":"2024-09-21T09:03:02.221720+0000","last_active":"2024-09-21T09:03:38.274224+0000","last_peered":"2024-09-21T09:03:38.274224+0000","last_clean":"2024-09-21T09:03:38.274224+0000","last_became_active":"2024-09-21T09:03:02.221352+0000","last_became_peered":"2024-09-21T09:03:02.221352+0000","last_unstale":"2024-09-21T09:03:38.274224+0000","last_undegraded":"2024-09-21T09:03:38.274224+0000","last_fullsized":"2024-09-21T09:03:38.274224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:21.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'32","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.340441+0000","last_change":"2024-09-21T09:03:04.235060+0000","last_active":"2024-09-21T09:05:04.340441+0000","last_peered":"2024-09-21T09:05:04.340441+0000","last_clean":"2024-09-21T09:05:04.340441+0000","last_became_active":"2024-09-21T09:03:04.234750+0000","last_became_peered":"2024-09-21T09:03:04.234750+0000","last_unstale":"2024-09-21T09:05:04.340441+0000","last_undegraded":"2024-09-21T09:05:04.340441+0000","last_fullsized":"2024-09-21T09:05:04.340441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:38.551769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275928+0000","last_change":"2024-09-21T09:03:06.248717+0000","last_active":"2024-09-21T09:03:38.275928+0000","last_peered":"2024-09-21T09:03:38.275928+0000","last_clean":"2024-09-21T09:03:38.275928+0000","last_became_active":"2024-09-21T09:03:06.248453+0000","last_became_peered":"2024-09-21T09:03:06.248453+0000","last_unstale":"2024-09-21T09:03:38.275928+0000","last_undegraded":"2024-09-21T09:03:38.275928+0000","last_fullsized":"2024-09-21T09:03:38.275928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.976812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458033+0000","last_change":"2024-09-21T09:03:08.260732+0000","last_active":"2024-09-21T09:05:08.458033+0000","last_peered":"2024-09-21T09:05:08.458033+0000","last_clean":"2024-09-21T09:05:08.458033+0000","last_became_active":"2024-09-21T09:03:08.260016+0000","last_became_peered":"2024-09-21T09:03:08.260016+0000","last_unstale":"2024-09-21T09:05:08.458033+0000","last_undegraded":"2024-09-21T09:05:08.458033+0000","last_fullsized":"2024-09-21T09:05:08.458033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:07.434714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'10","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363142+0000","last_change":"2024-09-21T09:03:00.221963+0000","last_active":"2024-09-21T09:06:06.363142+0000","last_peered":"2024-09-21T09:06:06.363142+0000","last_clean":"2024-09-21T09:06:06.363142+0000","last_became_active":"2024-09-21T09:03:00.220384+0000","last_became_peered":"2024-09-21T09:03:00.220384+0000","last_unstale":"2024-09-21T09:06:06.363142+0000","last_undegraded":"2024-09-21T09:06:06.363142+0000","last_fullsized":"2024-09-21T09:06:06.363142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:49.615946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'6","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.843889+0000","last_change":"2024-09-21T09:02:58.214415+0000","last_active":"2024-09-21T09:03:39.843889+0000","last_peered":"2024-09-21T09:03:39.843889+0000","last_clean":"2024-09-21T09:03:39.843889+0000","last_became_active":"2024-09-21T09:02:58.213920+0000","last_became_peered":"2024-09-21T09:02:58.213920+0000","last_unstale":"2024-09-21T09:03:39.843889+0000","last_undegraded":"2024-09-21T09:03:39.843889+0000","last_fullsized":"2024-09-21T09:03:39.843889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:07:45.991079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466801+0000","last_change":"2024-09-21T09:03:02.220182+0000","last_active":"2024-09-21T09:03:38.466801+0000","last_peered":"2024-09-21T09:03:38.466801+0000","last_clean":"2024-09-21T09:03:38.466801+0000","last_became_active":"2024-09-21T09:03:02.217917+0000","last_became_peered":"2024-09-21T09:03:02.217917+0000","last_unstale":"2024-09-21T09:03:38.466801+0000","last_undegraded":"2024-09-21T09:03:38.466801+0000","last_fullsized":"2024-09-21T09:03:38.466801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:32.066319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'37","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.365768+0000","last_change":"2024-09-21T09:03:04.235643+0000","last_active":"2024-09-21T09:05:04.365768+0000","last_peered":"2024-09-21T09:05:04.365768+0000","last_clean":"2024-09-21T09:05:04.365768+0000","last_became_active":"2024-09-21T09:03:04.235199+0000","last_became_peered":"2024-09-21T09:03:04.235199+0000","last_unstale":"2024-09-21T09:05:04.365768+0000","last_undegraded":"2024-09-21T09:05:04.365768+0000","last_fullsized":"2024-09-21T09:05:04.365768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:18.113952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'282","reported_seq":402,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.460214+0000","last_change":"2024-09-21T09:03:06.246155+0000","last_active":"2024-09-21T09:06:06.460214+0000","last_peered":"2024-09-21T09:06:06.460214+0000","last_clean":"2024-09-21T09:06:06.460214+0000","last_became_active":"2024-09-21T09:03:06.245904+0000","last_became_peered":"2024-09-21T09:03:06.245904+0000","last_unstale":"2024-09-21T09:06:06.460214+0000","last_undegraded":"2024-09-21T09:06:06.460214+0000","last_fullsized":"2024-09-21T09:06:06.460214+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:51.831002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.454513+0000","last_change":"2024-09-21T09:03:08.253968+0000","last_active":"2024-09-21T09:05:12.454513+0000","last_peered":"2024-09-21T09:05:12.454513+0000","last_clean":"2024-09-21T09:05:12.454513+0000","last_became_active":"2024-09-21T09:03:08.253648+0000","last_became_peered":"2024-09-21T09:03:08.253648+0000","last_unstale":"2024-09-21T09:05:12.454513+0000","last_undegraded":"2024-09-21T09:05:12.454513+0000","last_fullsized":"2024-09-21T09:05:12.454513+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:56.641003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'5","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304375+0000","last_change":"2024-09-21T09:03:00.225003+0000","last_active":"2024-09-21T09:06:06.304375+0000","last_peered":"2024-09-21T09:06:06.304375+0000","last_clean":"2024-09-21T09:06:06.304375+0000","last_became_active":"2024-09-21T09:03:00.222983+0000","last_became_peered":"2024-09-21T09:03:00.222983+0000","last_unstale":"2024-09-21T09:06:06.304375+0000","last_undegraded":"2024-09-21T09:06:06.304375+0000","last_fullsized":"2024-09-21T09:06:06.304375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:24.133336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.838971+0000","last_change":"2024-09-21T09:02:58.222294+0000","last_active":"2024-09-21T09:03:39.838971+0000","last_peered":"2024-09-21T09:03:39.838971+0000","last_clean":"2024-09-21T09:03:39.838971+0000","last_became_active":"2024-09-21T09:02:58.221805+0000","last_became_peered":"2024-09-21T09:02:58.221805+0000","last_unstale":"2024-09-21T09:03:39.838971+0000","last_undegraded":"2024-09-21T09:03:39.838971+0000","last_fullsized":"2024-09-21T09:03:39.838971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:53.268716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'3","reported_seq":413,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.387757+0000","last_change":"2024-09-21T09:03:02.222283+0000","last_active":"2024-09-21T09:05:05.387757+0000","last_peered":"2024-09-21T09:05:05.387757+0000","last_clean":"2024-09-21T09:05:05.387757+0000","last_became_active":"2024-09-21T09:03:02.222002+0000","last_became_peered":"2024-09-21T09:03:02.222002+0000","last_unstale":"2024-09-21T09:05:05.387757+0000","last_undegraded":"2024-09-21T09:05:05.387757+0000","last_fullsized":"2024-09-21T09:05:05.387757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:32.909484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275507+0000","last_change":"2024-09-21T09:03:04.243079+0000","last_active":"2024-09-21T09:03:38.275507+0000","last_peered":"2024-09-21T09:03:38.275507+0000","last_clean":"2024-09-21T09:03:38.275507+0000","last_became_active":"2024-09-21T09:03:04.242702+0000","last_became_peered":"2024-09-21T09:03:04.242702+0000","last_unstale":"2024-09-21T09:03:38.275507+0000","last_undegraded":"2024-09-21T09:03:38.275507+0000","last_fullsized":"2024-09-21T09:03:38.275507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:02.620013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'282","reported_seq":464,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.417369+0000","last_change":"2024-09-21T09:03:06.249279+0000","last_active":"2024-09-21T09:06:06.417369+0000","last_peered":"2024-09-21T09:06:06.417369+0000","last_clean":"2024-09-21T09:06:06.417369+0000","last_became_active":"2024-09-21T09:03:06.248991+0000","last_became_peered":"2024-09-21T09:03:06.248991+0000","last_unstale":"2024-09-21T09:06:06.417369+0000","last_undegraded":"2024-09-21T09:06:06.417369+0000","last_fullsized":"2024-09-21T09:06:06.417369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.466336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.511263+0000","last_change":"2024-09-21T09:03:08.252929+0000","last_active":"2024-09-21T09:05:05.511263+0000","last_peered":"2024-09-21T09:05:05.511263+0000","last_clean":"2024-09-21T09:05:05.511263+0000","last_became_active":"2024-09-21T09:03:08.252549+0000","last_became_peered":"2024-09-21T09:03:08.252549+0000","last_unstale":"2024-09-21T09:05:05.511263+0000","last_undegraded":"2024-09-21T09:05:05.511263+0000","last_fullsized":"2024-09-21T09:05:05.511263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:41.286037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260844+0000","last_change":"2024-09-21T09:03:00.223988+0000","last_active":"2024-09-21T09:06:06.260844+0000","last_peered":"2024-09-21T09:06:06.260844+0000","last_clean":"2024-09-21T09:06:06.260844+0000","last_became_active":"2024-09-21T09:03:00.223719+0000","last_became_peered":"2024-09-21T09:03:00.223719+0000","last_unstale":"2024-09-21T09:06:06.260844+0000","last_undegraded":"2024-09-21T09:06:06.260844+0000","last_fullsized":"2024-09-21T09:06:06.260844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:03.610091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270492+0000","last_change":"2024-09-21T09:02:58.214335+0000","last_active":"2024-09-21T09:03:38.270492+0000","last_peered":"2024-09-21T09:03:38.270492+0000","last_clean":"2024-09-21T09:03:38.270492+0000","last_became_active":"2024-09-21T09:02:58.214074+0000","last_became_peered":"2024-09-21T09:02:58.214074+0000","last_unstale":"2024-09-21T09:03:38.270492+0000","last_undegraded":"2024-09-21T09:03:38.270492+0000","last_fullsized":"2024-09-21T09:03:38.270492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:11.076844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274721+0000","last_change":"2024-09-21T09:03:02.222570+0000","last_active":"2024-09-21T09:03:38.274721+0000","last_peered":"2024-09-21T09:03:38.274721+0000","last_clean":"2024-09-21T09:03:38.274721+0000","last_became_active":"2024-09-21T09:03:02.222095+0000","last_became_peered":"2024-09-21T09:03:02.222095+0000","last_unstale":"2024-09-21T09:03:38.274721+0000","last_undegraded":"2024-09-21T09:03:38.274721+0000","last_fullsized":"2024-09-21T09:03:38.274721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:31.855727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'38","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.352351+0000","last_change":"2024-09-21T09:03:04.236005+0000","last_active":"2024-09-21T09:05:04.352351+0000","last_peered":"2024-09-21T09:05:04.352351+0000","last_clean":"2024-09-21T09:05:04.352351+0000","last_became_active":"2024-09-21T09:03:04.235633+0000","last_became_peered":"2024-09-21T09:03:04.235633+0000","last_unstale":"2024-09-21T09:05:04.352351+0000","last_undegraded":"2024-09-21T09:05:04.352351+0000","last_fullsized":"2024-09-21T09:05:04.352351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:15.434978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275944+0000","last_change":"2024-09-21T09:03:06.248328+0000","last_active":"2024-09-21T09:03:38.275944+0000","last_peered":"2024-09-21T09:03:38.275944+0000","last_clean":"2024-09-21T09:03:38.275944+0000","last_became_active":"2024-09-21T09:03:06.247977+0000","last_became_peered":"2024-09-21T09:03:06.247977+0000","last_unstale":"2024-09-21T09:03:38.275944+0000","last_undegraded":"2024-09-21T09:03:38.275944+0000","last_fullsized":"2024-09-21T09:03:38.275944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:30.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.395329+0000","last_change":"2024-09-21T09:03:08.252270+0000","last_active":"2024-09-21T09:06:06.395329+0000","last_peered":"2024-09-21T09:06:06.395329+0000","last_clean":"2024-09-21T09:06:06.395329+0000","last_became_active":"2024-09-21T09:03:08.251985+0000","last_became_peered":"2024-09-21T09:03:08.251985+0000","last_unstale":"2024-09-21T09:06:06.395329+0000","last_undegraded":"2024-09-21T09:06:06.395329+0000","last_fullsized":"2024-09-21T09:06:06.395329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:21.302376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.082284+0000","last_change":"2024-09-21T09:03:00.221674+0000","last_active":"2024-09-21T09:06:06.082284+0000","last_peered":"2024-09-21T09:06:06.082284+0000","last_clean":"2024-09-21T09:06:06.082284+0000","last_became_active":"2024-09-21T09:03:00.219428+0000","last_became_peered":"2024-09-21T09:03:00.219428+0000","last_unstale":"2024-09-21T09:06:06.082284+0000","last_undegraded":"2024-09-21T09:06:06.082284+0000","last_fullsized":"2024-09-21T09:06:06.082284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:12.568235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":201,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273328+0000","last_change":"2024-09-21T09:02:44.107999+0000","last_active":"2024-09-21T09:03:38.273328+0000","last_peered":"2024-09-21T09:03:38.273328+0000","last_clean":"2024-09-21T09:03:38.273328+0000","last_became_active":"2024-09-21T09:02:44.107052+0000","last_became_peered":"2024-09-21T09:02:44.107052+0000","last_unstale":"2024-09-21T09:03:38.273328+0000","last_undegraded":"2024-09-21T09:03:38.273328+0000","last_fullsized":"2024-09-21T09:03:38.273328+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_clean_scrub_stamp":"2024-09-21T09:02:42.466256+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:10.291354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273506+0000","last_change":"2024-09-21T09:02:51.501401+0000","last_active":"2024-09-21T09:03:38.273506+0000","last_peered":"2024-09-21T09:03:38.273506+0000","last_clean":"2024-09-21T09:03:38.273506+0000","last_became_active":"2024-09-21T09:02:49.492504+0000","last_became_peered":"2024-09-21T09:02:49.492504+0000","last_unstale":"2024-09-21T09:03:38.273506+0000","last_undegraded":"2024-09-21T09:03:38.273506+0000","last_fullsized":"2024-09-21T09:03:38.273506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:33.286003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001229291,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271282+0000","last_change":"2024-09-21T09:02:58.222148+0000","last_active":"2024-09-21T09:03:38.271282+0000","last_peered":"2024-09-21T09:03:38.271282+0000","last_clean":"2024-09-21T09:03:38.271282+0000","last_became_active":"2024-09-21T09:02:58.221874+0000","last_became_peered":"2024-09-21T09:02:58.221874+0000","last_unstale":"2024-09-21T09:03:38.271282+0000","last_undegraded":"2024-09-21T09:03:38.271282+0000","last_fullsized":"2024-09-21T09:03:38.271282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:41.404620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.281164+0000","last_change":"2024-09-21T09:03:38.280004+0000","last_active":"2024-09-21T09:03:38.281164+0000","last_peered":"2024-09-21T09:03:38.281164+0000","last_clean":"2024-09-21T09:03:38.281164+0000","last_became_active":"2024-09-21T09:03:38.279694+0000","last_became_peered":"2024-09-21T09:03:38.279694+0000","last_unstale":"2024-09-21T09:03:38.281164+0000","last_undegraded":"2024-09-21T09:03:38.281164+0000","last_fullsized":"2024-09-21T09:03:38.281164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:16.786252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'76","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.363557+0000","last_change":"2024-09-21T09:03:04.240626+0000","last_active":"2024-09-21T09:05:04.363557+0000","last_peered":"2024-09-21T09:05:04.363557+0000","last_clean":"2024-09-21T09:05:04.363557+0000","last_became_active":"2024-09-21T09:03:04.240327+0000","last_became_peered":"2024-09-21T09:03:04.240327+0000","last_unstale":"2024-09-21T09:05:04.363557+0000","last_undegraded":"2024-09-21T09:05:04.363557+0000","last_fullsized":"2024-09-21T09:05:04.363557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:19.716984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465984+0000","last_change":"2024-09-21T09:03:06.247919+0000","last_active":"2024-09-21T09:03:38.465984+0000","last_peered":"2024-09-21T09:03:38.465984+0000","last_clean":"2024-09-21T09:03:38.465984+0000","last_became_active":"2024-09-21T09:03:06.247593+0000","last_became_peered":"2024-09-21T09:03:06.247593+0000","last_unstale":"2024-09-21T09:03:38.465984+0000","last_undegraded":"2024-09-21T09:03:38.465984+0000","last_fullsized":"2024-09-21T09:03:38.465984+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:56.554312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'83","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.373253+0000","last_change":"2024-09-21T09:03:08.251766+0000","last_active":"2024-09-21T09:06:06.373253+0000","last_peered":"2024-09-21T09:06:06.373253+0000","last_clean":"2024-09-21T09:06:06.373253+0000","last_became_active":"2024-09-21T09:03:08.251416+0000","last_became_peered":"2024-09-21T09:03:08.251416+0000","last_unstale":"2024-09-21T09:06:06.373253+0000","last_undegraded":"2024-09-21T09:06:06.373253+0000","last_fullsized":"2024-09-21T09:06:06.373253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:43.892525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.711324+0000","last_change":"2024-09-21T09:03:00.217299+0000","last_active":"2024-09-21T09:05:02.711324+0000","last_peered":"2024-09-21T09:05:02.711324+0000","last_clean":"2024-09-21T09:05:02.711324+0000","last_became_active":"2024-09-21T09:03:00.217018+0000","last_became_peered":"2024-09-21T09:03:00.217018+0000","last_unstale":"2024-09-21T09:05:02.711324+0000","last_undegraded":"2024-09-21T09:05:02.711324+0000","last_fullsized":"2024-09-21T09:05:02.711324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:26.810823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270854+0000","last_change":"2024-09-21T09:02:51.500609+0000","last_active":"2024-09-21T09:03:38.270854+0000","last_peered":"2024-09-21T09:03:38.270854+0000","last_clean":"2024-09-21T09:03:38.270854+0000","last_became_active":"2024-09-21T09:02:49.493239+0000","last_became_peered":"2024-09-21T09:02:49.493239+0000","last_unstale":"2024-09-21T09:03:38.270854+0000","last_undegraded":"2024-09-21T09:03:38.270854+0000","last_fullsized":"2024-09-21T09:03:38.270854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:46.489803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046437600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464127+0000","last_change":"2024-09-21T09:02:58.209258+0000","last_active":"2024-09-21T09:03:38.464127+0000","last_peered":"2024-09-21T09:03:38.464127+0000","last_clean":"2024-09-21T09:03:38.464127+0000","last_became_active":"2024-09-21T09:02:58.208819+0000","last_became_peered":"2024-09-21T09:02:58.208819+0000","last_unstale":"2024-09-21T09:03:38.464127+0000","last_undegraded":"2024-09-21T09:03:38.464127+0000","last_fullsized":"2024-09-21T09:03:38.464127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:08.728738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277167+0000","last_change":"2024-09-21T09:03:02.221203+0000","last_active":"2024-09-21T09:03:38.277167+0000","last_peered":"2024-09-21T09:03:38.277167+0000","last_clean":"2024-09-21T09:03:38.277167+0000","last_became_active":"2024-09-21T09:03:02.220903+0000","last_became_peered":"2024-09-21T09:03:02.220903+0000","last_unstale":"2024-09-21T09:03:38.277167+0000","last_undegraded":"2024-09-21T09:03:38.277167+0000","last_fullsized":"2024-09-21T09:03:38.277167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:54.934676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'273","reported_seq":475,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:02.304493+0000","last_change":"2024-09-21T09:03:04.240716+0000","last_active":"2024-09-21T09:06:02.304493+0000","last_peered":"2024-09-21T09:06:02.304493+0000","last_clean":"2024-09-21T09:06:02.304493+0000","last_became_active":"2024-09-21T09:03:04.240433+0000","last_became_peered":"2024-09-21T09:03:04.240433+0000","last_unstale":"2024-09-21T09:06:02.304493+0000","last_undegraded":"2024-09-21T09:06:02.304493+0000","last_fullsized":"2024-09-21T09:06:02.304493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:45.460299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277557+0000","last_change":"2024-09-21T09:03:06.248226+0000","last_active":"2024-09-21T09:03:38.277557+0000","last_peered":"2024-09-21T09:03:38.277557+0000","last_clean":"2024-09-21T09:03:38.277557+0000","last_became_active":"2024-09-21T09:03:06.247746+0000","last_became_peered":"2024-09-21T09:03:06.247746+0000","last_unstale":"2024-09-21T09:03:38.277557+0000","last_undegraded":"2024-09-21T09:03:38.277557+0000","last_fullsized":"2024-09-21T09:03:38.277557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:39.299058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.300471+0000","last_change":"2024-09-21T09:03:08.259029+0000","last_active":"2024-09-21T09:06:06.300471+0000","last_peered":"2024-09-21T09:06:06.300471+0000","last_clean":"2024-09-21T09:06:06.300471+0000","last_became_active":"2024-09-21T09:03:08.258104+0000","last_became_peered":"2024-09-21T09:03:08.258104+0000","last_unstale":"2024-09-21T09:06:06.300471+0000","last_undegraded":"2024-09-21T09:06:06.300471+0000","last_fullsized":"2024-09-21T09:06:06.300471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:58.888309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465869+0000","last_change":"2024-09-21T09:03:00.227553+0000","last_active":"2024-09-21T09:03:38.465869+0000","last_peered":"2024-09-21T09:03:38.465869+0000","last_clean":"2024-09-21T09:03:38.465869+0000","last_became_active":"2024-09-21T09:03:00.227191+0000","last_became_peered":"2024-09-21T09:03:00.227191+0000","last_unstale":"2024-09-21T09:03:38.465869+0000","last_undegraded":"2024-09-21T09:03:38.465869+0000","last_fullsized":"2024-09-21T09:03:38.465869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:51.194693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272617+0000","last_change":"2024-09-21T09:02:51.506704+0000","last_active":"2024-09-21T09:03:38.272617+0000","last_peered":"2024-09-21T09:03:38.272617+0000","last_clean":"2024-09-21T09:03:38.272617+0000","last_became_active":"2024-09-21T09:02:49.493605+0000","last_became_peered":"2024-09-21T09:02:49.493605+0000","last_unstale":"2024-09-21T09:03:38.272617+0000","last_undegraded":"2024-09-21T09:03:38.272617+0000","last_fullsized":"2024-09-21T09:03:38.272617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:33.820022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033020199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463162+0000","last_change":"2024-09-21T09:02:58.209627+0000","last_active":"2024-09-21T09:03:38.463162+0000","last_peered":"2024-09-21T09:03:38.463162+0000","last_clean":"2024-09-21T09:03:38.463162+0000","last_became_active":"2024-09-21T09:02:58.209343+0000","last_became_peered":"2024-09-21T09:02:58.209343+0000","last_unstale":"2024-09-21T09:03:38.463162+0000","last_undegraded":"2024-09-21T09:03:38.463162+0000","last_fullsized":"2024-09-21T09:03:38.463162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:14.606085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276272+0000","last_change":"2024-09-21T09:03:02.219332+0000","last_active":"2024-09-21T09:03:38.276272+0000","last_peered":"2024-09-21T09:03:38.276272+0000","last_clean":"2024-09-21T09:03:38.276272+0000","last_became_active":"2024-09-21T09:03:02.219067+0000","last_became_peered":"2024-09-21T09:03:02.219067+0000","last_unstale":"2024-09-21T09:03:38.276272+0000","last_undegraded":"2024-09-21T09:03:38.276272+0000","last_fullsized":"2024-09-21T09:03:38.276272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:05.617526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'17","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.268634+0000","last_change":"2024-09-21T09:03:04.231010+0000","last_active":"2024-09-21T09:06:06.268634+0000","last_peered":"2024-09-21T09:06:06.268634+0000","last_clean":"2024-09-21T09:06:06.268634+0000","last_became_active":"2024-09-21T09:03:04.230686+0000","last_became_peered":"2024-09-21T09:03:04.230686+0000","last_unstale":"2024-09-21T09:06:06.268634+0000","last_undegraded":"2024-09-21T09:06:06.268634+0000","last_fullsized":"2024-09-21T09:06:06.268634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:25.612043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466265+0000","last_change":"2024-09-21T09:03:06.248379+0000","last_active":"2024-09-21T09:03:38.466265+0000","last_peered":"2024-09-21T09:03:38.466265+0000","last_clean":"2024-09-21T09:03:38.466265+0000","last_became_active":"2024-09-21T09:03:06.248087+0000","last_became_peered":"2024-09-21T09:03:06.248087+0000","last_unstale":"2024-09-21T09:03:38.466265+0000","last_undegraded":"2024-09-21T09:03:38.466265+0000","last_fullsized":"2024-09-21T09:03:38.466265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:23.429533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271393+0000","last_change":"2024-09-21T09:03:08.259295+0000","last_active":"2024-09-21T09:03:38.271393+0000","last_peered":"2024-09-21T09:03:38.271393+0000","last_clean":"2024-09-21T09:03:38.271393+0000","last_became_active":"2024-09-21T09:03:08.258974+0000","last_became_peered":"2024-09-21T09:03:08.258974+0000","last_unstale":"2024-09-21T09:03:38.271393+0000","last_undegraded":"2024-09-21T09:03:38.271393+0000","last_fullsized":"2024-09-21T09:03:38.271393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:23.850104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'7","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.182044+0000","last_change":"2024-09-21T09:03:00.221607+0000","last_active":"2024-09-21T09:06:06.182044+0000","last_peered":"2024-09-21T09:06:06.182044+0000","last_clean":"2024-09-21T09:06:06.182044+0000","last_became_active":"2024-09-21T09:03:00.221080+0000","last_became_peered":"2024-09-21T09:03:00.221080+0000","last_unstale":"2024-09-21T09:06:06.182044+0000","last_undegraded":"2024-09-21T09:06:06.182044+0000","last_fullsized":"2024-09-21T09:06:06.182044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:53.039369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271511+0000","last_change":"2024-09-21T09:02:51.501105+0000","last_active":"2024-09-21T09:03:38.271511+0000","last_peered":"2024-09-21T09:03:38.271511+0000","last_clean":"2024-09-21T09:03:38.271511+0000","last_became_active":"2024-09-21T09:02:49.493348+0000","last_became_peered":"2024-09-21T09:02:49.493348+0000","last_unstale":"2024-09-21T09:03:38.271511+0000","last_undegraded":"2024-09-21T09:03:38.271511+0000","last_fullsized":"2024-09-21T09:03:38.271511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:12.805512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096028300000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.279362+0000","last_change":"2024-09-21T09:02:58.207996+0000","last_active":"2024-09-21T09:03:38.279362+0000","last_peered":"2024-09-21T09:03:38.279362+0000","last_clean":"2024-09-21T09:03:38.279362+0000","last_became_active":"2024-09-21T09:02:58.207236+0000","last_became_peered":"2024-09-21T09:02:58.207236+0000","last_unstale":"2024-09-21T09:03:38.279362+0000","last_undegraded":"2024-09-21T09:03:38.279362+0000","last_fullsized":"2024-09-21T09:03:38.279362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:38.066496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465166+0000","last_change":"2024-09-21T09:03:02.221735+0000","last_active":"2024-09-21T09:03:38.465166+0000","last_peered":"2024-09-21T09:03:38.465166+0000","last_clean":"2024-09-21T09:03:38.465166+0000","last_became_active":"2024-09-21T09:03:02.221310+0000","last_became_peered":"2024-09-21T09:03:02.221310+0000","last_unstale":"2024-09-21T09:03:38.465166+0000","last_undegraded":"2024-09-21T09:03:38.465166+0000","last_fullsized":"2024-09-21T09:03:38.465166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:07.127926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'13","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.727672+0000","last_change":"2024-09-21T09:03:04.243723+0000","last_active":"2024-09-21T09:06:05.727672+0000","last_peered":"2024-09-21T09:06:05.727672+0000","last_clean":"2024-09-21T09:06:05.727672+0000","last_became_active":"2024-09-21T09:03:04.243076+0000","last_became_peered":"2024-09-21T09:03:04.243076+0000","last_unstale":"2024-09-21T09:06:05.727672+0000","last_undegraded":"2024-09-21T09:06:05.727672+0000","last_fullsized":"2024-09-21T09:06:05.727672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:19.628532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276013+0000","last_change":"2024-09-21T09:03:06.250792+0000","last_active":"2024-09-21T09:03:38.276013+0000","last_peered":"2024-09-21T09:03:38.276013+0000","last_clean":"2024-09-21T09:03:38.276013+0000","last_became_active":"2024-09-21T09:03:06.250530+0000","last_became_peered":"2024-09-21T09:03:06.250530+0000","last_unstale":"2024-09-21T09:03:38.276013+0000","last_undegraded":"2024-09-21T09:03:38.276013+0000","last_fullsized":"2024-09-21T09:03:38.276013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:33.277141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.492123+0000","last_change":"2024-09-21T09:03:08.262588+0000","last_active":"2024-09-21T09:05:05.492123+0000","last_peered":"2024-09-21T09:05:05.492123+0000","last_clean":"2024-09-21T09:05:05.492123+0000","last_became_active":"2024-09-21T09:03:08.262240+0000","last_became_peered":"2024-09-21T09:03:08.262240+0000","last_unstale":"2024-09-21T09:05:05.492123+0000","last_undegraded":"2024-09-21T09:05:05.492123+0000","last_fullsized":"2024-09-21T09:05:05.492123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:11.429927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363318+0000","last_change":"2024-09-21T09:03:00.227032+0000","last_active":"2024-09-21T09:06:06.363318+0000","last_peered":"2024-09-21T09:06:06.363318+0000","last_clean":"2024-09-21T09:06:06.363318+0000","last_became_active":"2024-09-21T09:03:00.224297+0000","last_became_peered":"2024-09-21T09:03:00.224297+0000","last_unstale":"2024-09-21T09:06:06.363318+0000","last_undegraded":"2024-09-21T09:06:06.363318+0000","last_fullsized":"2024-09-21T09:06:06.363318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:20.245983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274931+0000","last_change":"2024-09-21T09:02:58.207055+0000","last_active":"2024-09-21T09:03:38.274931+0000","last_peered":"2024-09-21T09:03:38.274931+0000","last_clean":"2024-09-21T09:03:38.274931+0000","last_became_active":"2024-09-21T09:02:58.206718+0000","last_became_peered":"2024-09-21T09:02:58.206718+0000","last_unstale":"2024-09-21T09:03:38.274931+0000","last_undegraded":"2024-09-21T09:03:38.274931+0000","last_fullsized":"2024-09-21T09:03:38.274931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:08.728738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466210+0000","last_change":"2024-09-21T09:02:51.498275+0000","last_active":"2024-09-21T09:03:38.466210+0000","last_peered":"2024-09-21T09:03:38.466210+0000","last_clean":"2024-09-21T09:03:38.466210+0000","last_became_active":"2024-09-21T09:02:49.493509+0000","last_became_peered":"2024-09-21T09:02:49.493509+0000","last_unstale":"2024-09-21T09:03:38.466210+0000","last_undegraded":"2024-09-21T09:03:38.466210+0000","last_fullsized":"2024-09-21T09:03:38.466210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:48.460775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038981200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453822+0000","last_change":"2024-09-21T09:03:02.221871+0000","last_active":"2024-09-21T09:05:07.453822+0000","last_peered":"2024-09-21T09:05:07.453822+0000","last_clean":"2024-09-21T09:05:07.453822+0000","last_became_active":"2024-09-21T09:03:02.221309+0000","last_became_peered":"2024-09-21T09:03:02.221309+0000","last_unstale":"2024-09-21T09:05:07.453822+0000","last_undegraded":"2024-09-21T09:05:07.453822+0000","last_fullsized":"2024-09-21T09:05:07.453822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:23.063609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'61","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453751+0000","last_change":"2024-09-21T09:03:04.243555+0000","last_active":"2024-09-21T09:05:07.453751+0000","last_peered":"2024-09-21T09:05:07.453751+0000","last_clean":"2024-09-21T09:05:07.453751+0000","last_became_active":"2024-09-21T09:03:04.243228+0000","last_became_peered":"2024-09-21T09:03:04.243228+0000","last_unstale":"2024-09-21T09:05:07.453751+0000","last_undegraded":"2024-09-21T09:05:07.453751+0000","last_fullsized":"2024-09-21T09:05:07.453751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:28.764693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272915+0000","last_change":"2024-09-21T09:03:06.246855+0000","last_active":"2024-09-21T09:03:38.272915+0000","last_peered":"2024-09-21T09:03:38.272915+0000","last_clean":"2024-09-21T09:03:38.272915+0000","last_became_active":"2024-09-21T09:03:06.246598+0000","last_became_peered":"2024-09-21T09:03:06.246598+0000","last_unstale":"2024-09-21T09:03:38.272915+0000","last_undegraded":"2024-09-21T09:03:38.272915+0000","last_fullsized":"2024-09-21T09:03:38.272915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:13.435386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.657366+0000","last_change":"2024-09-21T09:03:08.251063+0000","last_active":"2024-09-21T09:05:05.657366+0000","last_peered":"2024-09-21T09:05:05.657366+0000","last_clean":"2024-09-21T09:05:05.657366+0000","last_became_active":"2024-09-21T09:03:08.250714+0000","last_became_peered":"2024-09-21T09:03:08.250714+0000","last_unstale":"2024-09-21T09:05:05.657366+0000","last_undegraded":"2024-09-21T09:05:05.657366+0000","last_fullsized":"2024-09-21T09:05:05.657366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:01.596559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'10","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173544+0000","last_change":"2024-09-21T09:03:38.286969+0000","last_active":"2024-09-21T09:06:06.173544+0000","last_peered":"2024-09-21T09:06:06.173544+0000","last_clean":"2024-09-21T09:06:06.173544+0000","last_became_active":"2024-09-21T09:03:38.282889+0000","last_became_peered":"2024-09-21T09:03:38.282889+0000","last_unstale":"2024-09-21T09:06:06.173544+0000","last_undegraded":"2024-09-21T09:06:06.173544+0000","last_fullsized":"2024-09-21T09:06:06.173544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:56.518385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.752145+0000","last_change":"2024-09-21T09:02:58.208957+0000","last_active":"2024-09-21T09:03:38.752145+0000","last_peered":"2024-09-21T09:03:38.752145+0000","last_clean":"2024-09-21T09:03:38.752145+0000","last_became_active":"2024-09-21T09:02:58.208569+0000","last_became_peered":"2024-09-21T09:02:58.208569+0000","last_unstale":"2024-09-21T09:03:38.752145+0000","last_undegraded":"2024-09-21T09:03:38.752145+0000","last_fullsized":"2024-09-21T09:03:38.752145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:43:46.150242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278210+0000","last_change":"2024-09-21T09:02:51.501475+0000","last_active":"2024-09-21T09:03:38.278210+0000","last_peered":"2024-09-21T09:03:38.278210+0000","last_clean":"2024-09-21T09:03:38.278210+0000","last_became_active":"2024-09-21T09:02:49.493469+0000","last_became_peered":"2024-09-21T09:02:49.493469+0000","last_unstale":"2024-09-21T09:03:38.278210+0000","last_undegraded":"2024-09-21T09:03:38.278210+0000","last_fullsized":"2024-09-21T09:03:38.278210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:23.397410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001228114,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271668+0000","last_change":"2024-09-21T09:03:02.218570+0000","last_active":"2024-09-21T09:03:38.271668+0000","last_peered":"2024-09-21T09:03:38.271668+0000","last_clean":"2024-09-21T09:03:38.271668+0000","last_became_active":"2024-09-21T09:03:02.218232+0000","last_became_peered":"2024-09-21T09:03:02.218232+0000","last_unstale":"2024-09-21T09:03:38.271668+0000","last_undegraded":"2024-09-21T09:03:38.271668+0000","last_fullsized":"2024-09-21T09:03:38.271668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:18.210878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273881+0000","last_change":"2024-09-21T09:03:04.241792+0000","last_active":"2024-09-21T09:03:38.273881+0000","last_peered":"2024-09-21T09:03:38.273881+0000","last_clean":"2024-09-21T09:03:38.273881+0000","last_became_active":"2024-09-21T09:03:04.241500+0000","last_became_peered":"2024-09-21T09:03:04.241500+0000","last_unstale":"2024-09-21T09:03:38.273881+0000","last_undegraded":"2024-09-21T09:03:38.273881+0000","last_fullsized":"2024-09-21T09:03:38.273881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:13.085591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'282","reported_seq":354,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:02.304345+0000","last_change":"2024-09-21T09:03:06.249606+0000","last_active":"2024-09-21T09:06:02.304345+0000","last_peered":"2024-09-21T09:06:02.304345+0000","last_clean":"2024-09-21T09:06:02.304345+0000","last_became_active":"2024-09-21T09:03:06.249303+0000","last_became_peered":"2024-09-21T09:03:06.249303+0000","last_unstale":"2024-09-21T09:06:02.304345+0000","last_undegraded":"2024-09-21T09:06:02.304345+0000","last_fullsized":"2024-09-21T09:06:02.304345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.216872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275702+0000","last_change":"2024-09-21T09:03:08.264861+0000","last_active":"2024-09-21T09:03:38.275702+0000","last_peered":"2024-09-21T09:03:38.275702+0000","last_clean":"2024-09-21T09:03:38.275702+0000","last_became_active":"2024-09-21T09:03:08.264322+0000","last_became_peered":"2024-09-21T09:03:08.264322+0000","last_unstale":"2024-09-21T09:03:38.275702+0000","last_undegraded":"2024-09-21T09:03:38.275702+0000","last_fullsized":"2024-09-21T09:03:38.275702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:40.391041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.280043+0000","last_change":"2024-09-21T09:03:38.277961+0000","last_active":"2024-09-21T09:03:38.280043+0000","last_peered":"2024-09-21T09:03:38.280043+0000","last_clean":"2024-09-21T09:03:38.280043+0000","last_became_active":"2024-09-21T09:03:38.277629+0000","last_became_peered":"2024-09-21T09:03:38.277629+0000","last_unstale":"2024-09-21T09:03:38.280043+0000","last_undegraded":"2024-09-21T09:03:38.280043+0000","last_fullsized":"2024-09-21T09:03:38.280043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:59:16.786827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.670946+0000","last_change":"2024-09-21T09:02:58.223891+0000","last_active":"2024-09-21T09:05:05.670946+0000","last_peered":"2024-09-21T09:05:05.670946+0000","last_clean":"2024-09-21T09:05:05.670946+0000","last_became_active":"2024-09-21T09:02:58.223652+0000","last_became_peered":"2024-09-21T09:02:58.223652+0000","last_unstale":"2024-09-21T09:05:05.670946+0000","last_undegraded":"2024-09-21T09:05:05.670946+0000","last_fullsized":"2024-09-21T09:05:05.670946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:51.491682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465258+0000","last_change":"2024-09-21T09:02:51.498192+0000","last_active":"2024-09-21T09:03:38.465258+0000","last_peered":"2024-09-21T09:03:38.465258+0000","last_clean":"2024-09-21T09:03:38.465258+0000","last_became_active":"2024-09-21T09:02:49.493144+0000","last_became_peered":"2024-09-21T09:02:49.493144+0000","last_unstale":"2024-09-21T09:03:38.465258+0000","last_undegraded":"2024-09-21T09:03:38.465258+0000","last_fullsized":"2024-09-21T09:03:38.465258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:04.340866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042500699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271170+0000","last_change":"2024-09-21T09:03:02.219747+0000","last_active":"2024-09-21T09:03:38.271170+0000","last_peered":"2024-09-21T09:03:38.271170+0000","last_clean":"2024-09-21T09:03:38.271170+0000","last_became_active":"2024-09-21T09:03:02.219133+0000","last_became_peered":"2024-09-21T09:03:02.219133+0000","last_unstale":"2024-09-21T09:03:38.271170+0000","last_undegraded":"2024-09-21T09:03:38.271170+0000","last_fullsized":"2024-09-21T09:03:38.271170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:11.438389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273948+0000","last_change":"2024-09-21T09:03:04.241801+0000","last_active":"2024-09-21T09:03:38.273948+0000","last_peered":"2024-09-21T09:03:38.273948+0000","last_clean":"2024-09-21T09:03:38.273948+0000","last_became_active":"2024-09-21T09:03:04.241256+0000","last_became_peered":"2024-09-21T09:03:04.241256+0000","last_unstale":"2024-09-21T09:03:38.273948+0000","last_undegraded":"2024-09-21T09:03:38.273948+0000","last_fullsized":"2024-09-21T09:03:38.273948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:52.487954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'282","reported_seq":428,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.456684+0000","last_change":"2024-09-21T09:03:06.244206+0000","last_active":"2024-09-21T09:06:06.456684+0000","last_peered":"2024-09-21T09:06:06.456684+0000","last_clean":"2024-09-21T09:06:06.456684+0000","last_became_active":"2024-09-21T09:03:06.243566+0000","last_became_peered":"2024-09-21T09:03:06.243566+0000","last_unstale":"2024-09-21T09:06:06.456684+0000","last_undegraded":"2024-09-21T09:06:06.456684+0000","last_fullsized":"2024-09-21T09:06:06.456684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:40.536244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274538+0000","last_change":"2024-09-21T09:03:08.262736+0000","last_active":"2024-09-21T09:03:38.274538+0000","last_peered":"2024-09-21T09:03:38.274538+0000","last_clean":"2024-09-21T09:03:38.274538+0000","last_became_active":"2024-09-21T09:03:08.262460+0000","last_became_peered":"2024-09-21T09:03:08.262460+0000","last_unstale":"2024-09-21T09:03:38.274538+0000","last_undegraded":"2024-09-21T09:03:38.274538+0000","last_fullsized":"2024-09-21T09:03:38.274538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:09.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'14","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.081970+0000","last_change":"2024-09-21T09:03:00.218617+0000","last_active":"2024-09-21T09:06:06.081970+0000","last_peered":"2024-09-21T09:06:06.081970+0000","last_clean":"2024-09-21T09:06:06.081970+0000","last_became_active":"2024-09-21T09:03:00.216782+0000","last_became_peered":"2024-09-21T09:03:00.216782+0000","last_unstale":"2024-09-21T09:06:06.081970+0000","last_undegraded":"2024-09-21T09:06:06.081970+0000","last_fullsized":"2024-09-21T09:06:06.081970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:30.927993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276170+0000","last_change":"2024-09-21T09:02:58.213576+0000","last_active":"2024-09-21T09:03:38.276170+0000","last_peered":"2024-09-21T09:03:38.276170+0000","last_clean":"2024-09-21T09:03:38.276170+0000","last_became_active":"2024-09-21T09:02:58.213293+0000","last_became_peered":"2024-09-21T09:02:58.213293+0000","last_unstale":"2024-09-21T09:03:38.276170+0000","last_undegraded":"2024-09-21T09:03:38.276170+0000","last_fullsized":"2024-09-21T09:03:38.276170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:52.024304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276092+0000","last_change":"2024-09-21T09:02:51.501161+0000","last_active":"2024-09-21T09:03:38.276092+0000","last_peered":"2024-09-21T09:03:38.276092+0000","last_clean":"2024-09-21T09:03:38.276092+0000","last_became_active":"2024-09-21T09:02:49.542160+0000","last_became_peered":"2024-09-21T09:02:49.542160+0000","last_unstale":"2024-09-21T09:03:38.276092+0000","last_undegraded":"2024-09-21T09:03:38.276092+0000","last_fullsized":"2024-09-21T09:03:38.276092+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:18.503834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099618800000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271683+0000","last_change":"2024-09-21T09:03:02.218497+0000","last_active":"2024-09-21T09:03:38.271683+0000","last_peered":"2024-09-21T09:03:38.271683+0000","last_clean":"2024-09-21T09:03:38.271683+0000","last_became_active":"2024-09-21T09:03:02.218138+0000","last_became_peered":"2024-09-21T09:03:02.218138+0000","last_unstale":"2024-09-21T09:03:38.271683+0000","last_undegraded":"2024-09-21T09:03:38.271683+0000","last_fullsized":"2024-09-21T09:03:38.271683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:08.671338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'83","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455214+0000","last_change":"2024-09-21T09:03:04.232064+0000","last_active":"2024-09-21T09:05:12.455214+0000","last_peered":"2024-09-21T09:05:12.455214+0000","last_clean":"2024-09-21T09:05:12.455214+0000","last_became_active":"2024-09-21T09:03:04.231708+0000","last_became_peered":"2024-09-21T09:03:04.231708+0000","last_unstale":"2024-09-21T09:05:12.455214+0000","last_undegraded":"2024-09-21T09:05:12.455214+0000","last_fullsized":"2024-09-21T09:05:12.455214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:03.027213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6027,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463881+0000","last_change":"2024-09-21T09:03:06.249786+0000","last_active":"2024-09-21T09:03:38.463881+0000","last_peered":"2024-09-21T09:03:38.463881+0000","last_clean":"2024-09-21T09:03:38.463881+0000","last_became_active":"2024-09-21T09:03:06.249474+0000","last_became_peered":"2024-09-21T09:03:06.249474+0000","last_unstale":"2024-09-21T09:03:38.463881+0000","last_undegraded":"2024-09-21T09:03:38.463881+0000","last_fullsized":"2024-09-21T09:03:38.463881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.466336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273844+0000","last_change":"2024-09-21T09:03:08.252824+0000","last_active":"2024-09-21T09:03:38.273844+0000","last_peered":"2024-09-21T09:03:38.273844+0000","last_clean":"2024-09-21T09:03:38.273844+0000","last_became_active":"2024-09-21T09:03:08.252363+0000","last_became_peered":"2024-09-21T09:03:08.252363+0000","last_unstale":"2024-09-21T09:03:38.273844+0000","last_undegraded":"2024-09-21T09:03:38.273844+0000","last_fullsized":"2024-09-21T09:03:38.273844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:05.753776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.850611+0000","last_change":"2024-09-21T09:03:08.256842+0000","last_active":"2024-09-21T09:03:39.850611+0000","last_peered":"2024-09-21T09:03:39.850611+0000","last_clean":"2024-09-21T09:03:39.850611+0000","last_became_active":"2024-09-21T09:03:08.256571+0000","last_became_peered":"2024-09-21T09:03:08.256571+0000","last_unstale":"2024-09-21T09:03:39.850611+0000","last_undegraded":"2024-09-21T09:03:39.850611+0000","last_fullsized":"2024-09-21T09:03:39.850611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:39.409841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'12","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.301323+0000","last_change":"2024-09-21T09:03:38.470029+0000","last_active":"2024-09-21T09:03:39.301323+0000","last_peered":"2024-09-21T09:03:39.301323+0000","last_clean":"2024-09-21T09:03:39.301323+0000","last_became_active":"2024-09-21T09:03:38.466274+0000","last_became_peered":"2024-09-21T09:03:38.466274+0000","last_unstale":"2024-09-21T09:03:39.301323+0000","last_undegraded":"2024-09-21T09:03:39.301323+0000","last_fullsized":"2024-09-21T09:03:39.301323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:38.626004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275410+0000","last_change":"2024-09-21T09:02:58.221038+0000","last_active":"2024-09-21T09:03:38.275410+0000","last_peered":"2024-09-21T09:03:38.275410+0000","last_clean":"2024-09-21T09:03:38.275410+0000","last_became_active":"2024-09-21T09:02:58.220716+0000","last_became_peered":"2024-09-21T09:02:58.220716+0000","last_unstale":"2024-09-21T09:03:38.275410+0000","last_undegraded":"2024-09-21T09:03:38.275410+0000","last_fullsized":"2024-09-21T09:03:38.275410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:36.863978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274326+0000","last_change":"2024-09-21T09:03:02.220312+0000","last_active":"2024-09-21T09:03:38.274326+0000","last_peered":"2024-09-21T09:03:38.274326+0000","last_clean":"2024-09-21T09:03:38.274326+0000","last_became_active":"2024-09-21T09:03:02.219652+0000","last_became_peered":"2024-09-21T09:03:02.219652+0000","last_unstale":"2024-09-21T09:03:38.274326+0000","last_undegraded":"2024-09-21T09:03:38.274326+0000","last_fullsized":"2024-09-21T09:03:38.274326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:42.719585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'32","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.356322+0000","last_change":"2024-09-21T09:03:04.241932+0000","last_active":"2024-09-21T09:05:04.356322+0000","last_peered":"2024-09-21T09:05:04.356322+0000","last_clean":"2024-09-21T09:05:04.356322+0000","last_became_active":"2024-09-21T09:03:04.241612+0000","last_became_peered":"2024-09-21T09:03:04.241612+0000","last_unstale":"2024-09-21T09:05:04.356322+0000","last_undegraded":"2024-09-21T09:05:04.356322+0000","last_fullsized":"2024-09-21T09:05:04.356322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:31.245640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271493+0000","last_change":"2024-09-21T09:03:06.251100+0000","last_active":"2024-09-21T09:03:38.271493+0000","last_peered":"2024-09-21T09:03:38.271493+0000","last_clean":"2024-09-21T09:03:38.271493+0000","last_became_active":"2024-09-21T09:03:06.250750+0000","last_became_peered":"2024-09-21T09:03:06.250750+0000","last_unstale":"2024-09-21T09:03:38.271493+0000","last_undegraded":"2024-09-21T09:03:38.271493+0000","last_fullsized":"2024-09-21T09:03:38.271493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:22.776215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'11","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.068447+0000","last_change":"2024-09-21T09:03:08.259980+0000","last_active":"2024-09-21T09:05:04.068447+0000","last_peered":"2024-09-21T09:05:04.068447+0000","last_clean":"2024-09-21T09:05:04.068447+0000","last_became_active":"2024-09-21T09:03:08.259602+0000","last_became_peered":"2024-09-21T09:03:08.259602+0000","last_unstale":"2024-09-21T09:05:04.068447+0000","last_undegraded":"2024-09-21T09:05:04.068447+0000","last_fullsized":"2024-09-21T09:05:04.068447+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:33:24.939446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.257843+0000","last_change":"2024-09-21T09:03:00.227394+0000","last_active":"2024-09-21T09:04:22.257843+0000","last_peered":"2024-09-21T09:04:22.257843+0000","last_clean":"2024-09-21T09:04:22.257843+0000","last_became_active":"2024-09-21T09:03:00.225811+0000","last_became_peered":"2024-09-21T09:03:00.225811+0000","last_unstale":"2024-09-21T09:04:22.257843+0000","last_undegraded":"2024-09-21T09:04:22.257843+0000","last_fullsized":"2024-09-21T09:04:22.257843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:51.194693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.281638+0000","last_change":"2024-09-21T09:03:38.280883+0000","last_active":"2024-09-21T09:03:38.281638+0000","last_peered":"2024-09-21T09:03:38.281638+0000","last_clean":"2024-09-21T09:03:38.281638+0000","last_became_active":"2024-09-21T09:03:38.280539+0000","last_became_peered":"2024-09-21T09:03:38.280539+0000","last_unstale":"2024-09-21T09:03:38.281638+0000","last_undegraded":"2024-09-21T09:03:38.281638+0000","last_fullsized":"2024-09-21T09:03:38.281638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:13.642910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278296+0000","last_change":"2024-09-21T09:03:02.223011+0000","last_active":"2024-09-21T09:03:38.278296+0000","last_peered":"2024-09-21T09:03:38.278296+0000","last_clean":"2024-09-21T09:03:38.278296+0000","last_became_active":"2024-09-21T09:03:02.222474+0000","last_became_peered":"2024-09-21T09:03:02.222474+0000","last_unstale":"2024-09-21T09:03:38.278296+0000","last_undegraded":"2024-09-21T09:03:38.278296+0000","last_fullsized":"2024-09-21T09:03:38.278296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:54.497438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'6","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.732315+0000","last_change":"2024-09-21T09:03:04.232760+0000","last_active":"2024-09-21T09:06:05.732315+0000","last_peered":"2024-09-21T09:06:05.732315+0000","last_clean":"2024-09-21T09:06:05.732315+0000","last_became_active":"2024-09-21T09:03:04.232474+0000","last_became_peered":"2024-09-21T09:03:04.232474+0000","last_unstale":"2024-09-21T09:06:05.732315+0000","last_undegraded":"2024-09-21T09:06:05.732315+0000","last_fullsized":"2024-09-21T09:06:05.732315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:11.420156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272717+0000","last_change":"2024-09-21T09:03:06.251118+0000","last_active":"2024-09-21T09:03:38.272717+0000","last_peered":"2024-09-21T09:03:38.272717+0000","last_clean":"2024-09-21T09:03:38.272717+0000","last_became_active":"2024-09-21T09:03:06.250773+0000","last_became_peered":"2024-09-21T09:03:06.250773+0000","last_unstale":"2024-09-21T09:03:38.272717+0000","last_undegraded":"2024-09-21T09:03:38.272717+0000","last_fullsized":"2024-09-21T09:03:38.272717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:30.352901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464626+0000","last_change":"2024-09-21T09:03:08.250971+0000","last_active":"2024-09-21T09:03:38.464626+0000","last_peered":"2024-09-21T09:03:38.464626+0000","last_clean":"2024-09-21T09:03:38.464626+0000","last_became_active":"2024-09-21T09:03:08.250617+0000","last_became_peered":"2024-09-21T09:03:08.250617+0000","last_unstale":"2024-09-21T09:03:38.464626+0000","last_undegraded":"2024-09-21T09:03:38.464626+0000","last_fullsized":"2024-09-21T09:03:38.464626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:54.090547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363198+0000","last_change":"2024-09-21T09:03:00.216088+0000","last_active":"2024-09-21T09:06:06.363198+0000","last_peered":"2024-09-21T09:06:06.363198+0000","last_clean":"2024-09-21T09:06:06.363198+0000","last_became_active":"2024-09-21T09:03:00.215591+0000","last_became_peered":"2024-09-21T09:03:00.215591+0000","last_unstale":"2024-09-21T09:06:06.363198+0000","last_undegraded":"2024-09-21T09:06:06.363198+0000","last_fullsized":"2024-09-21T09:06:06.363198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:32.562147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.251242+0000","last_change":"2024-09-21T09:02:58.218920+0000","last_active":"2024-09-21T09:06:06.251242+0000","last_peered":"2024-09-21T09:06:06.251242+0000","last_clean":"2024-09-21T09:06:06.251242+0000","last_became_active":"2024-09-21T09:02:58.217931+0000","last_became_peered":"2024-09-21T09:02:58.217931+0000","last_unstale":"2024-09-21T09:06:06.251242+0000","last_undegraded":"2024-09-21T09:06:06.251242+0000","last_fullsized":"2024-09-21T09:06:06.251242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:07.674387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272263+0000","last_change":"2024-09-21T09:03:02.219569+0000","last_active":"2024-09-21T09:03:38.272263+0000","last_peered":"2024-09-21T09:03:38.272263+0000","last_clean":"2024-09-21T09:03:38.272263+0000","last_became_active":"2024-09-21T09:03:02.219265+0000","last_became_peered":"2024-09-21T09:03:02.219265+0000","last_unstale":"2024-09-21T09:03:38.272263+0000","last_undegraded":"2024-09-21T09:03:38.272263+0000","last_fullsized":"2024-09-21T09:03:38.272263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:22.253418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'40","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.788569+0000","last_change":"2024-09-21T09:03:04.233795+0000","last_active":"2024-09-21T09:06:05.788569+0000","last_peered":"2024-09-21T09:06:05.788569+0000","last_clean":"2024-09-21T09:06:05.788569+0000","last_became_active":"2024-09-21T09:03:04.233393+0000","last_became_peered":"2024-09-21T09:03:04.233393+0000","last_unstale":"2024-09-21T09:06:05.788569+0000","last_undegraded":"2024-09-21T09:06:05.788569+0000","last_fullsized":"2024-09-21T09:06:05.788569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:49.815772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273436+0000","last_change":"2024-09-21T09:03:06.249268+0000","last_active":"2024-09-21T09:03:38.273436+0000","last_peered":"2024-09-21T09:03:38.273436+0000","last_clean":"2024-09-21T09:03:38.273436+0000","last_became_active":"2024-09-21T09:03:06.248954+0000","last_became_peered":"2024-09-21T09:03:06.248954+0000","last_unstale":"2024-09-21T09:03:38.273436+0000","last_undegraded":"2024-09-21T09:03:38.273436+0000","last_fullsized":"2024-09-21T09:03:38.273436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:09.672283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271808+0000","last_change":"2024-09-21T09:03:08.265248+0000","last_active":"2024-09-21T09:03:38.271808+0000","last_peered":"2024-09-21T09:03:38.271808+0000","last_clean":"2024-09-21T09:03:38.271808+0000","last_became_active":"2024-09-21T09:03:08.264778+0000","last_became_peered":"2024-09-21T09:03:08.264778+0000","last_unstale":"2024-09-21T09:03:38.271808+0000","last_undegraded":"2024-09-21T09:03:38.271808+0000","last_fullsized":"2024-09-21T09:03:38.271808+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:37.665220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271312+0000","last_change":"2024-09-21T09:03:00.218521+0000","last_active":"2024-09-21T09:03:38.271312+0000","last_peered":"2024-09-21T09:03:38.271312+0000","last_clean":"2024-09-21T09:03:38.271312+0000","last_became_active":"2024-09-21T09:03:00.218259+0000","last_became_peered":"2024-09-21T09:03:00.218259+0000","last_unstale":"2024-09-21T09:03:38.271312+0000","last_undegraded":"2024-09-21T09:03:38.271312+0000","last_fullsized":"2024-09-21T09:03:38.271312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:08.734463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.358977+0000","last_change":"2024-09-21T09:02:58.207817+0000","last_active":"2024-09-21T09:06:06.358977+0000","last_peered":"2024-09-21T09:06:06.358977+0000","last_clean":"2024-09-21T09:06:06.358977+0000","last_became_active":"2024-09-21T09:02:58.207533+0000","last_became_peered":"2024-09-21T09:02:58.207533+0000","last_unstale":"2024-09-21T09:06:06.358977+0000","last_undegraded":"2024-09-21T09:06:06.358977+0000","last_fullsized":"2024-09-21T09:06:06.358977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.813396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271267+0000","last_change":"2024-09-21T09:03:02.219788+0000","last_active":"2024-09-21T09:03:38.271267+0000","last_peered":"2024-09-21T09:03:38.271267+0000","last_clean":"2024-09-21T09:03:38.271267+0000","last_became_active":"2024-09-21T09:03:02.219509+0000","last_became_peered":"2024-09-21T09:03:02.219509+0000","last_unstale":"2024-09-21T09:03:38.271267+0000","last_undegraded":"2024-09-21T09:03:38.271267+0000","last_fullsized":"2024-09-21T09:03:38.271267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:16.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.342422+0000","last_change":"2024-09-21T09:03:04.234223+0000","last_active":"2024-09-21T09:05:04.342422+0000","last_peered":"2024-09-21T09:05:04.342422+0000","last_clean":"2024-09-21T09:05:04.342422+0000","last_became_active":"2024-09-21T09:03:04.233913+0000","last_became_peered":"2024-09-21T09:03:04.233913+0000","last_unstale":"2024-09-21T09:05:04.342422+0000","last_undegraded":"2024-09-21T09:05:04.342422+0000","last_fullsized":"2024-09-21T09:05:04.342422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:42.001541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.279968+0000","last_change":"2024-09-21T09:03:06.241090+0000","last_active":"2024-09-21T09:03:38.279968+0000","last_peered":"2024-09-21T09:03:38.279968+0000","last_clean":"2024-09-21T09:03:38.279968+0000","last_became_active":"2024-09-21T09:03:06.240791+0000","last_became_peered":"2024-09-21T09:03:06.240791+0000","last_unstale":"2024-09-21T09:03:38.279968+0000","last_undegraded":"2024-09-21T09:03:38.279968+0000","last_fullsized":"2024-09-21T09:03:38.279968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:15.100821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260935+0000","last_change":"2024-09-21T09:03:00.216592+0000","last_active":"2024-09-21T09:06:06.260935+0000","last_peered":"2024-09-21T09:06:06.260935+0000","last_clean":"2024-09-21T09:06:06.260935+0000","last_became_active":"2024-09-21T09:03:00.216319+0000","last_became_peered":"2024-09-21T09:03:00.216319+0000","last_unstale":"2024-09-21T09:06:06.260935+0000","last_undegraded":"2024-09-21T09:06:06.260935+0000","last_fullsized":"2024-09-21T09:06:06.260935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:47.869465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270661+0000","last_change":"2024-09-21T09:02:58.214752+0000","last_active":"2024-09-21T09:03:38.270661+0000","last_peered":"2024-09-21T09:03:38.270661+0000","last_clean":"2024-09-21T09:03:38.270661+0000","last_became_active":"2024-09-21T09:02:58.214494+0000","last_became_peered":"2024-09-21T09:02:58.214494+0000","last_unstale":"2024-09-21T09:03:38.270661+0000","last_undegraded":"2024-09-21T09:03:38.270661+0000","last_fullsized":"2024-09-21T09:03:38.270661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:10.892304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"31'4","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.368025+0000","last_change":"2024-09-21T09:03:02.222025+0000","last_active":"2024-09-21T09:05:05.368025+0000","last_peered":"2024-09-21T09:05:05.368025+0000","last_clean":"2024-09-21T09:05:05.368025+0000","last_became_active":"2024-09-21T09:03:02.221586+0000","last_became_peered":"2024-09-21T09:03:02.221586+0000","last_unstale":"2024-09-21T09:05:05.368025+0000","last_undegraded":"2024-09-21T09:05:05.368025+0000","last_fullsized":"2024-09-21T09:05:05.368025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:39.990777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'55","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:37.458245+0000","last_change":"2024-09-21T09:03:04.234015+0000","last_active":"2024-09-21T09:05:37.458245+0000","last_peered":"2024-09-21T09:05:37.458245+0000","last_clean":"2024-09-21T09:05:37.458245+0000","last_became_active":"2024-09-21T09:03:04.233734+0000","last_became_peered":"2024-09-21T09:03:04.233734+0000","last_unstale":"2024-09-21T09:05:37.458245+0000","last_undegraded":"2024-09-21T09:05:37.458245+0000","last_fullsized":"2024-09-21T09:05:37.458245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:48.554737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276740+0000","last_change":"2024-09-21T09:03:06.241254+0000","last_active":"2024-09-21T09:03:38.276740+0000","last_peered":"2024-09-21T09:03:38.276740+0000","last_clean":"2024-09-21T09:03:38.276740+0000","last_became_active":"2024-09-21T09:03:06.240975+0000","last_became_peered":"2024-09-21T09:03:06.240975+0000","last_unstale":"2024-09-21T09:03:38.276740+0000","last_undegraded":"2024-09-21T09:03:38.276740+0000","last_fullsized":"2024-09-21T09:03:38.276740+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:50.569967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'18","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.287382+0000","last_change":"2024-09-21T09:03:08.254283+0000","last_active":"2024-09-21T09:06:06.287382+0000","last_peered":"2024-09-21T09:06:06.287382+0000","last_clean":"2024-09-21T09:06:06.287382+0000","last_became_active":"2024-09-21T09:03:08.253904+0000","last_became_peered":"2024-09-21T09:03:08.253904+0000","last_unstale":"2024-09-21T09:06:06.287382+0000","last_undegraded":"2024-09-21T09:06:06.287382+0000","last_fullsized":"2024-09-21T09:06:06.287382+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:42.273122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'10","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173892+0000","last_change":"2024-09-21T09:03:00.216793+0000","last_active":"2024-09-21T09:06:06.173892+0000","last_peered":"2024-09-21T09:06:06.173892+0000","last_clean":"2024-09-21T09:06:06.173892+0000","last_became_active":"2024-09-21T09:03:00.216238+0000","last_became_peered":"2024-09-21T09:03:00.216238+0000","last_unstale":"2024-09-21T09:06:06.173892+0000","last_undegraded":"2024-09-21T09:06:06.173892+0000","last_fullsized":"2024-09-21T09:06:06.173892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:39.266159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456857+0000","last_change":"2024-09-21T09:02:58.207174+0000","last_active":"2024-09-21T09:05:22.456857+0000","last_peered":"2024-09-21T09:05:22.456857+0000","last_clean":"2024-09-21T09:05:22.456857+0000","last_became_active":"2024-09-21T09:02:58.206879+0000","last_became_peered":"2024-09-21T09:02:58.206879+0000","last_unstale":"2024-09-21T09:05:22.456857+0000","last_undegraded":"2024-09-21T09:05:22.456857+0000","last_fullsized":"2024-09-21T09:05:22.456857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:51.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.280797+0000","last_change":"2024-09-21T09:03:02.218652+0000","last_active":"2024-09-21T09:03:38.280797+0000","last_peered":"2024-09-21T09:03:38.280797+0000","last_clean":"2024-09-21T09:03:38.280797+0000","last_became_active":"2024-09-21T09:03:02.218381+0000","last_became_peered":"2024-09-21T09:03:02.218381+0000","last_unstale":"2024-09-21T09:03:38.280797+0000","last_undegraded":"2024-09-21T09:03:38.280797+0000","last_fullsized":"2024-09-21T09:03:38.280797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:00.802033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'37","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.343375+0000","last_change":"2024-09-21T09:03:04.241328+0000","last_active":"2024-09-21T09:05:04.343375+0000","last_peered":"2024-09-21T09:05:04.343375+0000","last_clean":"2024-09-21T09:05:04.343375+0000","last_became_active":"2024-09-21T09:03:04.240933+0000","last_became_peered":"2024-09-21T09:03:04.240933+0000","last_unstale":"2024-09-21T09:05:04.343375+0000","last_undegraded":"2024-09-21T09:05:04.343375+0000","last_fullsized":"2024-09-21T09:05:04.343375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:37.814664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277445+0000","last_change":"2024-09-21T09:03:06.247452+0000","last_active":"2024-09-21T09:03:38.277445+0000","last_peered":"2024-09-21T09:03:38.277445+0000","last_clean":"2024-09-21T09:03:38.277445+0000","last_became_active":"2024-09-21T09:03:06.247153+0000","last_became_peered":"2024-09-21T09:03:06.247153+0000","last_unstale":"2024-09-21T09:03:38.277445+0000","last_undegraded":"2024-09-21T09:03:38.277445+0000","last_fullsized":"2024-09-21T09:03:38.277445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:41.912327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.104216+0000","last_change":"2024-09-21T09:03:08.262999+0000","last_active":"2024-09-21T09:06:06.104216+0000","last_peered":"2024-09-21T09:06:06.104216+0000","last_clean":"2024-09-21T09:06:06.104216+0000","last_became_active":"2024-09-21T09:03:08.262680+0000","last_became_peered":"2024-09-21T09:03:08.262680+0000","last_unstale":"2024-09-21T09:06:06.104216+0000","last_undegraded":"2024-09-21T09:06:06.104216+0000","last_fullsized":"2024-09-21T09:06:06.104216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:50.139788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278824+0000","last_change":"2024-09-21T09:03:00.224630+0000","last_active":"2024-09-21T09:03:38.278824+0000","last_peered":"2024-09-21T09:03:38.278824+0000","last_clean":"2024-09-21T09:03:38.278824+0000","last_became_active":"2024-09-21T09:03:00.219653+0000","last_became_peered":"2024-09-21T09:03:00.219653+0000","last_unstale":"2024-09-21T09:03:38.278824+0000","last_undegraded":"2024-09-21T09:03:38.278824+0000","last_fullsized":"2024-09-21T09:03:38.278824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:46.305418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'3","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.062776+0000","last_change":"2024-09-21T09:02:58.202783+0000","last_active":"2024-09-21T09:04:22.062776+0000","last_peered":"2024-09-21T09:04:22.062776+0000","last_clean":"2024-09-21T09:04:22.062776+0000","last_became_active":"2024-09-21T09:02:58.202431+0000","last_became_peered":"2024-09-21T09:02:58.202431+0000","last_unstale":"2024-09-21T09:04:22.062776+0000","last_undegraded":"2024-09-21T09:04:22.062776+0000","last_fullsized":"2024-09-21T09:04:22.062776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:19.013606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276494+0000","last_change":"2024-09-21T09:03:02.221261+0000","last_active":"2024-09-21T09:03:38.276494+0000","last_peered":"2024-09-21T09:03:38.276494+0000","last_clean":"2024-09-21T09:03:38.276494+0000","last_became_active":"2024-09-21T09:03:02.220940+0000","last_became_peered":"2024-09-21T09:03:02.220940+0000","last_unstale":"2024-09-21T09:03:38.276494+0000","last_undegraded":"2024-09-21T09:03:38.276494+0000","last_fullsized":"2024-09-21T09:03:38.276494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:24.472177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.360394+0000","last_change":"2024-09-21T09:03:04.239297+0000","last_active":"2024-09-21T09:05:04.360394+0000","last_peered":"2024-09-21T09:05:04.360394+0000","last_clean":"2024-09-21T09:05:04.360394+0000","last_became_active":"2024-09-21T09:03:04.239023+0000","last_became_peered":"2024-09-21T09:03:04.239023+0000","last_unstale":"2024-09-21T09:05:04.360394+0000","last_undegraded":"2024-09-21T09:05:04.360394+0000","last_fullsized":"2024-09-21T09:05:04.360394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:11.019831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465048+0000","last_change":"2024-09-21T09:03:06.244208+0000","last_active":"2024-09-21T09:03:38.465048+0000","last_peered":"2024-09-21T09:03:38.465048+0000","last_clean":"2024-09-21T09:03:38.465048+0000","last_became_active":"2024-09-21T09:03:06.243451+0000","last_became_peered":"2024-09-21T09:03:06.243451+0000","last_unstale":"2024-09-21T09:03:38.465048+0000","last_undegraded":"2024-09-21T09:03:38.465048+0000","last_fullsized":"2024-09-21T09:03:38.465048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:57.268665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.713189+0000","last_change":"2024-09-21T09:03:08.260334+0000","last_active":"2024-09-21T09:05:05.713189+0000","last_peered":"2024-09-21T09:05:05.713189+0000","last_clean":"2024-09-21T09:05:05.713189+0000","last_became_active":"2024-09-21T09:03:08.260047+0000","last_became_peered":"2024-09-21T09:03:08.260047+0000","last_unstale":"2024-09-21T09:05:05.713189+0000","last_undegraded":"2024-09-21T09:05:05.713189+0000","last_fullsized":"2024-09-21T09:05:05.713189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:49.086371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'7","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.457562+0000","last_change":"2024-09-21T09:03:00.221676+0000","last_active":"2024-09-21T09:05:32.457562+0000","last_peered":"2024-09-21T09:05:32.457562+0000","last_clean":"2024-09-21T09:05:32.457562+0000","last_became_active":"2024-09-21T09:03:00.221332+0000","last_became_peered":"2024-09-21T09:03:00.221332+0000","last_unstale":"2024-09-21T09:05:32.457562+0000","last_undegraded":"2024-09-21T09:05:32.457562+0000","last_fullsized":"2024-09-21T09:05:32.457562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:09.836796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.752914+0000","last_change":"2024-09-21T09:02:58.210805+0000","last_active":"2024-09-21T09:03:38.752914+0000","last_peered":"2024-09-21T09:03:38.752914+0000","last_clean":"2024-09-21T09:03:38.752914+0000","last_became_active":"2024-09-21T09:02:58.210511+0000","last_became_peered":"2024-09-21T09:02:58.210511+0000","last_unstale":"2024-09-21T09:03:38.752914+0000","last_undegraded":"2024-09-21T09:03:38.752914+0000","last_fullsized":"2024-09-21T09:03:38.752914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:47.903446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277189+0000","last_change":"2024-09-21T09:03:02.219262+0000","last_active":"2024-09-21T09:03:38.277189+0000","last_peered":"2024-09-21T09:03:38.277189+0000","last_clean":"2024-09-21T09:03:38.277189+0000","last_became_active":"2024-09-21T09:03:02.218979+0000","last_became_peered":"2024-09-21T09:03:02.218979+0000","last_unstale":"2024-09-21T09:03:38.277189+0000","last_undegraded":"2024-09-21T09:03:38.277189+0000","last_fullsized":"2024-09-21T09:03:38.277189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:07.127926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.259516+0000","last_change":"2024-09-21T09:03:04.242314+0000","last_active":"2024-09-21T09:04:22.259516+0000","last_peered":"2024-09-21T09:04:22.259516+0000","last_clean":"2024-09-21T09:04:22.259516+0000","last_became_active":"2024-09-21T09:03:04.241974+0000","last_became_peered":"2024-09-21T09:03:04.241974+0000","last_unstale":"2024-09-21T09:04:22.259516+0000","last_undegraded":"2024-09-21T09:04:22.259516+0000","last_fullsized":"2024-09-21T09:04:22.259516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:52.828027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'282","reported_seq":416,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.368023+0000","last_change":"2024-09-21T09:03:06.244451+0000","last_active":"2024-09-21T09:06:06.368023+0000","last_peered":"2024-09-21T09:06:06.368023+0000","last_clean":"2024-09-21T09:06:06.368023+0000","last_became_active":"2024-09-21T09:03:06.244103+0000","last_became_peered":"2024-09-21T09:03:06.244103+0000","last_unstale":"2024-09-21T09:06:06.368023+0000","last_undegraded":"2024-09-21T09:06:06.368023+0000","last_fullsized":"2024-09-21T09:06:06.368023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:13.035061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"31'6","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.806010+0000","last_change":"2024-09-21T09:03:08.260304+0000","last_active":"2024-09-21T09:06:05.806010+0000","last_peered":"2024-09-21T09:06:05.806010+0000","last_clean":"2024-09-21T09:06:05.806010+0000","last_became_active":"2024-09-21T09:03:08.259638+0000","last_became_peered":"2024-09-21T09:03:08.259638+0000","last_unstale":"2024-09-21T09:06:05.806010+0000","last_undegraded":"2024-09-21T09:06:05.806010+0000","last_fullsized":"2024-09-21T09:06:05.806010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:33.635905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.258397+0000","last_change":"2024-09-21T09:03:00.220803+0000","last_active":"2024-09-21T09:04:22.258397+0000","last_peered":"2024-09-21T09:04:22.258397+0000","last_clean":"2024-09-21T09:04:22.258397+0000","last_became_active":"2024-09-21T09:03:00.220426+0000","last_became_peered":"2024-09-21T09:03:00.220426+0000","last_unstale":"2024-09-21T09:04:22.258397+0000","last_undegraded":"2024-09-21T09:04:22.258397+0000","last_fullsized":"2024-09-21T09:04:22.258397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:15.584421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275873+0000","last_change":"2024-09-21T09:02:58.207718+0000","last_active":"2024-09-21T09:03:38.275873+0000","last_peered":"2024-09-21T09:03:38.275873+0000","last_clean":"2024-09-21T09:03:38.275873+0000","last_became_active":"2024-09-21T09:02:58.207424+0000","last_became_peered":"2024-09-21T09:02:58.207424+0000","last_unstale":"2024-09-21T09:03:38.275873+0000","last_undegraded":"2024-09-21T09:03:38.275873+0000","last_fullsized":"2024-09-21T09:03:38.275873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:03.460514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.282215+0000","last_change":"2024-09-21T09:03:38.280977+0000","last_active":"2024-09-21T09:03:38.282215+0000","last_peered":"2024-09-21T09:03:38.282215+0000","last_clean":"2024-09-21T09:03:38.282215+0000","last_became_active":"2024-09-21T09:03:38.280616+0000","last_became_peered":"2024-09-21T09:03:38.280616+0000","last_unstale":"2024-09-21T09:03:38.282215+0000","last_undegraded":"2024-09-21T09:03:38.282215+0000","last_fullsized":"2024-09-21T09:03:38.282215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:02:41.978323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'38","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.458395+0000","last_change":"2024-09-21T09:03:04.234179+0000","last_active":"2024-09-21T09:05:32.458395+0000","last_peered":"2024-09-21T09:05:32.458395+0000","last_clean":"2024-09-21T09:05:32.458395+0000","last_became_active":"2024-09-21T09:03:04.233878+0000","last_became_peered":"2024-09-21T09:03:04.233878+0000","last_unstale":"2024-09-21T09:05:32.458395+0000","last_undegraded":"2024-09-21T09:05:32.458395+0000","last_fullsized":"2024-09-21T09:05:32.458395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:11.019831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463002+0000","last_change":"2024-09-21T09:03:06.248010+0000","last_active":"2024-09-21T09:03:38.463002+0000","last_peered":"2024-09-21T09:03:38.463002+0000","last_clean":"2024-09-21T09:03:38.463002+0000","last_became_active":"2024-09-21T09:03:06.247609+0000","last_became_peered":"2024-09-21T09:03:06.247609+0000","last_unstale":"2024-09-21T09:03:38.463002+0000","last_undegraded":"2024-09-21T09:03:38.463002+0000","last_fullsized":"2024-09-21T09:03:38.463002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:03.746735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276162+0000","last_change":"2024-09-21T09:03:08.256301+0000","last_active":"2024-09-21T09:03:38.276162+0000","last_peered":"2024-09-21T09:03:38.276162+0000","last_clean":"2024-09-21T09:03:38.276162+0000","last_became_active":"2024-09-21T09:03:08.255717+0000","last_became_peered":"2024-09-21T09:03:08.255717+0000","last_unstale":"2024-09-21T09:03:38.276162+0000","last_undegraded":"2024-09-21T09:03:38.276162+0000","last_fullsized":"2024-09-21T09:03:38.276162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:09:51.274693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'10","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.176725+0000","last_change":"2024-09-21T09:03:00.216086+0000","last_active":"2024-09-21T09:06:06.176725+0000","last_peered":"2024-09-21T09:06:06.176725+0000","last_clean":"2024-09-21T09:06:06.176725+0000","last_became_active":"2024-09-21T09:03:00.215804+0000","last_became_peered":"2024-09-21T09:03:00.215804+0000","last_unstale":"2024-09-21T09:06:06.176725+0000","last_undegraded":"2024-09-21T09:06:06.176725+0000","last_fullsized":"2024-09-21T09:06:06.176725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:43.259240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278524+0000","last_change":"2024-09-21T09:02:58.221563+0000","last_active":"2024-09-21T09:03:38.278524+0000","last_peered":"2024-09-21T09:03:38.278524+0000","last_clean":"2024-09-21T09:03:38.278524+0000","last_became_active":"2024-09-21T09:02:58.221286+0000","last_became_peered":"2024-09-21T09:02:58.221286+0000","last_unstale":"2024-09-21T09:03:38.278524+0000","last_undegraded":"2024-09-21T09:03:38.278524+0000","last_fullsized":"2024-09-21T09:03:38.278524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:01.926039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.279861+0000","last_change":"2024-09-21T09:03:02.225192+0000","last_active":"2024-09-21T09:03:38.279861+0000","last_peered":"2024-09-21T09:03:38.279861+0000","last_clean":"2024-09-21T09:03:38.279861+0000","last_became_active":"2024-09-21T09:03:02.224879+0000","last_became_peered":"2024-09-21T09:03:02.224879+0000","last_unstale":"2024-09-21T09:03:38.279861+0000","last_undegraded":"2024-09-21T09:03:38.279861+0000","last_fullsized":"2024-09-21T09:03:38.279861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:58.107921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.335448+0000","last_change":"2024-09-21T09:03:04.239378+0000","last_active":"2024-09-21T09:05:04.335448+0000","last_peered":"2024-09-21T09:05:04.335448+0000","last_clean":"2024-09-21T09:05:04.335448+0000","last_became_active":"2024-09-21T09:03:04.239112+0000","last_became_peered":"2024-09-21T09:03:04.239112+0000","last_unstale":"2024-09-21T09:05:04.335448+0000","last_undegraded":"2024-09-21T09:05:04.335448+0000","last_fullsized":"2024-09-21T09:05:04.335448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:28.337671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270452+0000","last_change":"2024-09-21T09:03:06.251033+0000","last_active":"2024-09-21T09:03:38.270452+0000","last_peered":"2024-09-21T09:03:38.270452+0000","last_clean":"2024-09-21T09:03:38.270452+0000","last_became_active":"2024-09-21T09:03:06.250729+0000","last_became_peered":"2024-09-21T09:03:06.250729+0000","last_unstale":"2024-09-21T09:03:38.270452+0000","last_undegraded":"2024-09-21T09:03:38.270452+0000","last_fullsized":"2024-09-21T09:03:38.270452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:49.094483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274381+0000","last_change":"2024-09-21T09:03:08.264701+0000","last_active":"2024-09-21T09:03:38.274381+0000","last_peered":"2024-09-21T09:03:38.274381+0000","last_clean":"2024-09-21T09:03:38.274381+0000","last_became_active":"2024-09-21T09:03:08.264160+0000","last_became_peered":"2024-09-21T09:03:08.264160+0000","last_unstale":"2024-09-21T09:03:38.274381+0000","last_undegraded":"2024-09-21T09:03:38.274381+0000","last_fullsized":"2024-09-21T09:03:38.274381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:11.297538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298677+0000","last_change":"2024-09-21T09:03:00.208934+0000","last_active":"2024-09-21T09:06:06.298677+0000","last_peered":"2024-09-21T09:06:06.298677+0000","last_clean":"2024-09-21T09:06:06.298677+0000","last_became_active":"2024-09-21T09:03:00.208673+0000","last_became_peered":"2024-09-21T09:03:00.208673+0000","last_unstale":"2024-09-21T09:06:06.298677+0000","last_undegraded":"2024-09-21T09:06:06.298677+0000","last_fullsized":"2024-09-21T09:06:06.298677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:08:35.801498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465585+0000","last_change":"2024-09-21T09:02:58.213090+0000","last_active":"2024-09-21T09:03:38.465585+0000","last_peered":"2024-09-21T09:03:38.465585+0000","last_clean":"2024-09-21T09:03:38.465585+0000","last_became_active":"2024-09-21T09:02:58.212751+0000","last_became_peered":"2024-09-21T09:02:58.212751+0000","last_unstale":"2024-09-21T09:03:38.465585+0000","last_undegraded":"2024-09-21T09:03:38.465585+0000","last_fullsized":"2024-09-21T09:03:38.465585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:42:59.411200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275293+0000","last_change":"2024-09-21T09:03:02.223254+0000","last_active":"2024-09-21T09:03:38.275293+0000","last_peered":"2024-09-21T09:03:38.275293+0000","last_clean":"2024-09-21T09:03:38.275293+0000","last_became_active":"2024-09-21T09:03:02.222965+0000","last_became_peered":"2024-09-21T09:03:02.222965+0000","last_unstale":"2024-09-21T09:03:38.275293+0000","last_undegraded":"2024-09-21T09:03:38.275293+0000","last_fullsized":"2024-09-21T09:03:38.275293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:51.746643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'26","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.358187+0000","last_change":"2024-09-21T09:03:04.244000+0000","last_active":"2024-09-21T09:05:04.358187+0000","last_peered":"2024-09-21T09:05:04.358187+0000","last_clean":"2024-09-21T09:05:04.358187+0000","last_became_active":"2024-09-21T09:03:04.243686+0000","last_became_peered":"2024-09-21T09:03:04.243686+0000","last_unstale":"2024-09-21T09:05:04.358187+0000","last_undegraded":"2024-09-21T09:05:04.358187+0000","last_fullsized":"2024-09-21T09:05:04.358187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:23.844395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271117+0000","last_change":"2024-09-21T09:03:06.250256+0000","last_active":"2024-09-21T09:03:38.271117+0000","last_peered":"2024-09-21T09:03:38.271117+0000","last_clean":"2024-09-21T09:03:38.271117+0000","last_became_active":"2024-09-21T09:03:06.249959+0000","last_became_peered":"2024-09-21T09:03:06.249959+0000","last_unstale":"2024-09-21T09:03:38.271117+0000","last_undegraded":"2024-09-21T09:03:38.271117+0000","last_fullsized":"2024-09-21T09:03:38.271117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:36:47.765082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'6","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.714631+0000","last_change":"2024-09-21T09:03:08.264668+0000","last_active":"2024-09-21T09:05:05.714631+0000","last_peered":"2024-09-21T09:05:05.714631+0000","last_clean":"2024-09-21T09:05:05.714631+0000","last_became_active":"2024-09-21T09:03:08.264395+0000","last_became_peered":"2024-09-21T09:03:08.264395+0000","last_unstale":"2024-09-21T09:05:05.714631+0000","last_undegraded":"2024-09-21T09:05:05.714631+0000","last_fullsized":"2024-09-21T09:05:05.714631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:33.997831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'14","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.176335+0000","last_change":"2024-09-21T09:03:00.216032+0000","last_active":"2024-09-21T09:06:06.176335+0000","last_peered":"2024-09-21T09:06:06.176335+0000","last_clean":"2024-09-21T09:06:06.176335+0000","last_became_active":"2024-09-21T09:03:00.215748+0000","last_became_peered":"2024-09-21T09:03:00.215748+0000","last_unstale":"2024-09-21T09:06:06.176335+0000","last_undegraded":"2024-09-21T09:06:06.176335+0000","last_fullsized":"2024-09-21T09:06:06.176335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:26.084899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453896+0000","last_change":"2024-09-21T09:02:58.204247+0000","last_active":"2024-09-21T09:05:02.453896+0000","last_peered":"2024-09-21T09:05:02.453896+0000","last_clean":"2024-09-21T09:05:02.453896+0000","last_became_active":"2024-09-21T09:02:58.203973+0000","last_became_peered":"2024-09-21T09:02:58.203973+0000","last_unstale":"2024-09-21T09:05:02.453896+0000","last_undegraded":"2024-09-21T09:05:02.453896+0000","last_fullsized":"2024-09-21T09:05:02.453896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:07.674387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'2","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:03.073883+0000","last_change":"2024-09-21T09:03:02.221130+0000","last_active":"2024-09-21T09:05:03.073883+0000","last_peered":"2024-09-21T09:05:03.073883+0000","last_clean":"2024-09-21T09:05:03.073883+0000","last_became_active":"2024-09-21T09:03:02.220801+0000","last_became_peered":"2024-09-21T09:03:02.220801+0000","last_unstale":"2024-09-21T09:05:03.073883+0000","last_undegraded":"2024-09-21T09:05:03.073883+0000","last_fullsized":"2024-09-21T09:05:03.073883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:02.648349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.733362+0000","last_change":"2024-09-21T09:03:04.241567+0000","last_active":"2024-09-21T09:06:05.733362+0000","last_peered":"2024-09-21T09:06:05.733362+0000","last_clean":"2024-09-21T09:06:05.733362+0000","last_became_active":"2024-09-21T09:03:04.240857+0000","last_became_peered":"2024-09-21T09:03:04.240857+0000","last_unstale":"2024-09-21T09:06:05.733362+0000","last_undegraded":"2024-09-21T09:06:05.733362+0000","last_fullsized":"2024-09-21T09:06:05.733362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:48.722144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464241+0000","last_change":"2024-09-21T09:03:06.248388+0000","last_active":"2024-09-21T09:03:38.464241+0000","last_peered":"2024-09-21T09:03:38.464241+0000","last_clean":"2024-09-21T09:03:38.464241+0000","last_became_active":"2024-09-21T09:03:06.248030+0000","last_became_peered":"2024-09-21T09:03:06.248030+0000","last_unstale":"2024-09-21T09:03:38.464241+0000","last_undegraded":"2024-09-21T09:03:38.464241+0000","last_fullsized":"2024-09-21T09:03:38.464241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.216872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'4","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.370491+0000","last_change":"2024-09-21T09:03:08.264618+0000","last_active":"2024-09-21T09:05:04.370491+0000","last_peered":"2024-09-21T09:05:04.370491+0000","last_clean":"2024-09-21T09:05:04.370491+0000","last_became_active":"2024-09-21T09:03:08.264304+0000","last_became_peered":"2024-09-21T09:03:08.264304+0000","last_unstale":"2024-09-21T09:05:04.370491+0000","last_undegraded":"2024-09-21T09:05:04.370491+0000","last_fullsized":"2024-09-21T09:05:04.370491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:59.938730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'22","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.084081+0000","last_change":"2024-09-21T09:03:00.226200+0000","last_active":"2024-09-21T09:06:06.084081+0000","last_peered":"2024-09-21T09:06:06.084081+0000","last_clean":"2024-09-21T09:06:06.084081+0000","last_became_active":"2024-09-21T09:03:00.225936+0000","last_became_peered":"2024-09-21T09:03:00.225936+0000","last_unstale":"2024-09-21T09:06:06.084081+0000","last_undegraded":"2024-09-21T09:06:06.084081+0000","last_fullsized":"2024-09-21T09:06:06.084081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:56.100485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272693+0000","last_change":"2024-09-21T09:02:58.206450+0000","last_active":"2024-09-21T09:03:38.272693+0000","last_peered":"2024-09-21T09:03:38.272693+0000","last_clean":"2024-09-21T09:03:38.272693+0000","last_became_active":"2024-09-21T09:02:58.206163+0000","last_became_peered":"2024-09-21T09:02:58.206163+0000","last_unstale":"2024-09-21T09:03:38.272693+0000","last_undegraded":"2024-09-21T09:03:38.272693+0000","last_fullsized":"2024-09-21T09:03:38.272693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:19.013606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'5","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304064+0000","last_change":"2024-09-21T09:03:00.221286+0000","last_active":"2024-09-21T09:06:06.304064+0000","last_peered":"2024-09-21T09:06:06.304064+0000","last_clean":"2024-09-21T09:06:06.304064+0000","last_became_active":"2024-09-21T09:03:00.220860+0000","last_became_peered":"2024-09-21T09:03:00.220860+0000","last_unstale":"2024-09-21T09:06:06.304064+0000","last_undegraded":"2024-09-21T09:06:06.304064+0000","last_fullsized":"2024-09-21T09:06:06.304064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:47.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.245757+0000","last_change":"2024-09-21T09:02:58.202869+0000","last_active":"2024-09-21T09:06:06.245757+0000","last_peered":"2024-09-21T09:06:06.245757+0000","last_clean":"2024-09-21T09:06:06.245757+0000","last_became_active":"2024-09-21T09:02:58.202579+0000","last_became_peered":"2024-09-21T09:02:58.202579+0000","last_unstale":"2024-09-21T09:06:06.245757+0000","last_undegraded":"2024-09-21T09:06:06.245757+0000","last_fullsized":"2024-09-21T09:06:06.245757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:51.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'3","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304856+0000","last_change":"2024-09-21T09:03:00.221384+0000","last_active":"2024-09-21T09:06:06.304856+0000","last_peered":"2024-09-21T09:06:06.304856+0000","last_clean":"2024-09-21T09:06:06.304856+0000","last_became_active":"2024-09-21T09:03:00.219281+0000","last_became_peered":"2024-09-21T09:03:00.219281+0000","last_unstale":"2024-09-21T09:06:06.304856+0000","last_undegraded":"2024-09-21T09:06:06.304856+0000","last_fullsized":"2024-09-21T09:06:06.304856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:53.670241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271976+0000","last_change":"2024-09-21T09:02:58.223127+0000","last_active":"2024-09-21T09:03:38.271976+0000","last_peered":"2024-09-21T09:03:38.271976+0000","last_clean":"2024-09-21T09:03:38.271976+0000","last_became_active":"2024-09-21T09:02:58.222856+0000","last_became_peered":"2024-09-21T09:02:58.222856+0000","last_unstale":"2024-09-21T09:03:38.271976+0000","last_undegraded":"2024-09-21T09:03:38.271976+0000","last_fullsized":"2024-09-21T09:03:38.271976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:55.695152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466314+0000","last_change":"2024-09-21T09:03:00.221392+0000","last_active":"2024-09-21T09:03:38.466314+0000","last_peered":"2024-09-21T09:03:38.466314+0000","last_clean":"2024-09-21T09:03:38.466314+0000","last_became_active":"2024-09-21T09:03:00.220755+0000","last_became_peered":"2024-09-21T09:03:00.220755+0000","last_unstale":"2024-09-21T09:03:38.466314+0000","last_undegraded":"2024-09-21T09:03:38.466314+0000","last_fullsized":"2024-09-21T09:03:38.466314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:52:42.557402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464613+0000","last_change":"2024-09-21T09:02:58.208737+0000","last_active":"2024-09-21T09:03:38.464613+0000","last_peered":"2024-09-21T09:03:38.464613+0000","last_clean":"2024-09-21T09:03:38.464613+0000","last_became_active":"2024-09-21T09:02:58.208329+0000","last_became_peered":"2024-09-21T09:02:58.208329+0000","last_unstale":"2024-09-21T09:03:38.464613+0000","last_undegraded":"2024-09-21T09:03:38.464613+0000","last_fullsized":"2024-09-21T09:03:38.464613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:57.584638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'16","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260871+0000","last_change":"2024-09-21T09:03:00.216032+0000","last_active":"2024-09-21T09:06:06.260871+0000","last_peered":"2024-09-21T09:06:06.260871+0000","last_clean":"2024-09-21T09:06:06.260871+0000","last_became_active":"2024-09-21T09:03:00.215554+0000","last_became_peered":"2024-09-21T09:03:00.215554+0000","last_unstale":"2024-09-21T09:06:06.260871+0000","last_undegraded":"2024-09-21T09:06:06.260871+0000","last_fullsized":"2024-09-21T09:06:06.260871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:18.875227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.752662+0000","last_change":"2024-09-21T09:02:58.202254+0000","last_active":"2024-09-21T09:03:38.752662+0000","last_peered":"2024-09-21T09:03:38.752662+0000","last_clean":"2024-09-21T09:03:38.752662+0000","last_became_active":"2024-09-21T09:02:58.201482+0000","last_became_peered":"2024-09-21T09:02:58.201482+0000","last_unstale":"2024-09-21T09:03:38.752662+0000","last_undegraded":"2024-09-21T09:03:38.752662+0000","last_fullsized":"2024-09-21T09:03:38.752662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.813396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'11","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.370735+0000","last_change":"2024-09-21T09:03:00.224630+0000","last_active":"2024-09-21T09:06:06.370735+0000","last_peered":"2024-09-21T09:06:06.370735+0000","last_clean":"2024-09-21T09:06:06.370735+0000","last_became_active":"2024-09-21T09:03:00.223740+0000","last_became_peered":"2024-09-21T09:03:00.223740+0000","last_unstale":"2024-09-21T09:06:06.370735+0000","last_undegraded":"2024-09-21T09:06:06.370735+0000","last_fullsized":"2024-09-21T09:06:06.370735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:58.794598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.454567+0000","last_change":"2024-09-21T09:02:58.210714+0000","last_active":"2024-09-21T09:05:07.454567+0000","last_peered":"2024-09-21T09:05:07.454567+0000","last_clean":"2024-09-21T09:05:07.454567+0000","last_became_active":"2024-09-21T09:02:58.210442+0000","last_became_peered":"2024-09-21T09:02:58.210442+0000","last_unstale":"2024-09-21T09:05:07.454567+0000","last_undegraded":"2024-09-21T09:05:07.454567+0000","last_fullsized":"2024-09-21T09:05:07.454567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:57.584638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'14","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.717387+0000","last_change":"2024-09-21T09:03:00.216820+0000","last_active":"2024-09-21T09:05:05.717387+0000","last_peered":"2024-09-21T09:05:05.717387+0000","last_clean":"2024-09-21T09:05:05.717387+0000","last_became_active":"2024-09-21T09:03:00.216462+0000","last_became_peered":"2024-09-21T09:03:00.216462+0000","last_unstale":"2024-09-21T09:05:05.717387+0000","last_undegraded":"2024-09-21T09:05:05.717387+0000","last_fullsized":"2024-09-21T09:05:05.717387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:43.259240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.833842+0000","last_change":"2024-09-21T09:02:58.220184+0000","last_active":"2024-09-21T09:03:39.833842+0000","last_peered":"2024-09-21T09:03:39.833842+0000","last_clean":"2024-09-21T09:03:39.833842+0000","last_became_active":"2024-09-21T09:02:58.218407+0000","last_became_peered":"2024-09-21T09:02:58.218407+0000","last_unstale":"2024-09-21T09:03:39.833842+0000","last_undegraded":"2024-09-21T09:03:39.833842+0000","last_fullsized":"2024-09-21T09:03:39.833842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:44.533015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.299204+0000","last_change":"2024-09-21T09:03:00.213244+0000","last_active":"2024-09-21T09:06:06.299204+0000","last_peered":"2024-09-21T09:06:06.299204+0000","last_clean":"2024-09-21T09:06:06.299204+0000","last_became_active":"2024-09-21T09:03:00.212503+0000","last_became_peered":"2024-09-21T09:03:00.212503+0000","last_unstale":"2024-09-21T09:06:06.299204+0000","last_undegraded":"2024-09-21T09:06:06.299204+0000","last_fullsized":"2024-09-21T09:06:06.299204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:52.154699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465557+0000","last_change":"2024-09-21T09:02:58.202455+0000","last_active":"2024-09-21T09:03:38.465557+0000","last_peered":"2024-09-21T09:03:38.465557+0000","last_clean":"2024-09-21T09:03:38.465557+0000","last_became_active":"2024-09-21T09:02:58.201812+0000","last_became_peered":"2024-09-21T09:02:58.201812+0000","last_unstale":"2024-09-21T09:03:38.465557+0000","last_undegraded":"2024-09-21T09:03:38.465557+0000","last_fullsized":"2024-09-21T09:03:38.465557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:33.880917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'6","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.853327+0000","last_change":"2024-09-21T09:03:00.225519+0000","last_active":"2024-09-21T09:03:39.853327+0000","last_peered":"2024-09-21T09:03:39.853327+0000","last_clean":"2024-09-21T09:03:39.853327+0000","last_became_active":"2024-09-21T09:03:00.224456+0000","last_became_peered":"2024-09-21T09:03:00.224456+0000","last_unstale":"2024-09-21T09:03:39.853327+0000","last_undegraded":"2024-09-21T09:03:39.853327+0000","last_fullsized":"2024-09-21T09:03:39.853327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:22.464742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458069+0000","last_change":"2024-09-21T09:02:58.222445+0000","last_active":"2024-09-21T09:05:08.458069+0000","last_peered":"2024-09-21T09:05:08.458069+0000","last_clean":"2024-09-21T09:05:08.458069+0000","last_became_active":"2024-09-21T09:02:58.222191+0000","last_became_peered":"2024-09-21T09:02:58.222191+0000","last_unstale":"2024-09-21T09:05:08.458069+0000","last_undegraded":"2024-09-21T09:05:08.458069+0000","last_fullsized":"2024-09-21T09:05:08.458069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:50.343858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":13,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'6","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363119+0000","last_change":"2024-09-21T09:03:00.220918+0000","last_active":"2024-09-21T09:06:06.363119+0000","last_peered":"2024-09-21T09:06:06.363119+0000","last_clean":"2024-09-21T09:06:06.363119+0000","last_became_active":"2024-09-21T09:03:00.220639+0000","last_became_peered":"2024-09-21T09:03:00.220639+0000","last_unstale":"2024-09-21T09:06:06.363119+0000","last_undegraded":"2024-09-21T09:06:06.363119+0000","last_fullsized":"2024-09-21T09:06:06.363119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:26.629707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463882+0000","last_change":"2024-09-21T09:02:58.208759+0000","last_active":"2024-09-21T09:03:38.463882+0000","last_peered":"2024-09-21T09:03:38.463882+0000","last_clean":"2024-09-21T09:03:38.463882+0000","last_became_active":"2024-09-21T09:02:58.208346+0000","last_became_peered":"2024-09-21T09:02:58.208346+0000","last_unstale":"2024-09-21T09:03:38.463882+0000","last_undegraded":"2024-09-21T09:03:38.463882+0000","last_fullsized":"2024-09-21T09:03:38.463882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:44.533015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.711493+0000","last_change":"2024-09-21T09:03:00.223002+0000","last_active":"2024-09-21T09:05:02.711493+0000","last_peered":"2024-09-21T09:05:02.711493+0000","last_clean":"2024-09-21T09:05:02.711493+0000","last_became_active":"2024-09-21T09:03:00.222651+0000","last_became_peered":"2024-09-21T09:03:00.222651+0000","last_unstale":"2024-09-21T09:05:02.711493+0000","last_undegraded":"2024-09-21T09:05:02.711493+0000","last_fullsized":"2024-09-21T09:05:02.711493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:24.133336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274353+0000","last_change":"2024-09-21T09:02:58.209919+0000","last_active":"2024-09-21T09:03:38.274353+0000","last_peered":"2024-09-21T09:03:38.274353+0000","last_clean":"2024-09-21T09:03:38.274353+0000","last_became_active":"2024-09-21T09:02:58.208495+0000","last_became_peered":"2024-09-21T09:02:58.208495+0000","last_unstale":"2024-09-21T09:03:38.274353+0000","last_undegraded":"2024-09-21T09:03:38.274353+0000","last_fullsized":"2024-09-21T09:03:38.274353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:14.606085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'4","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275450+0000","last_change":"2024-09-21T09:03:00.222862+0000","last_active":"2024-09-21T09:03:38.275450+0000","last_peered":"2024-09-21T09:03:38.275450+0000","last_clean":"2024-09-21T09:03:38.275450+0000","last_became_active":"2024-09-21T09:03:00.222343+0000","last_became_peered":"2024-09-21T09:03:00.222343+0000","last_unstale":"2024-09-21T09:03:38.275450+0000","last_undegraded":"2024-09-21T09:03:38.275450+0000","last_fullsized":"2024-09-21T09:03:38.275450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:06.215821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455383+0000","last_change":"2024-09-21T09:02:58.210097+0000","last_active":"2024-09-21T09:05:12.455383+0000","last_peered":"2024-09-21T09:05:12.455383+0000","last_clean":"2024-09-21T09:05:12.455383+0000","last_became_active":"2024-09-21T09:02:58.208630+0000","last_became_peered":"2024-09-21T09:02:58.208630+0000","last_unstale":"2024-09-21T09:05:12.455383+0000","last_undegraded":"2024-09-21T09:05:12.455383+0000","last_fullsized":"2024-09-21T09:05:12.455383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.754217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'18","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.853440+0000","last_change":"2024-09-21T09:03:38.286564+0000","last_active":"2024-09-21T09:03:39.853440+0000","last_peered":"2024-09-21T09:03:39.853440+0000","last_clean":"2024-09-21T09:03:39.853440+0000","last_became_active":"2024-09-21T09:03:38.282951+0000","last_became_peered":"2024-09-21T09:03:38.282951+0000","last_unstale":"2024-09-21T09:03:39.853440+0000","last_undegraded":"2024-09-21T09:03:39.853440+0000","last_fullsized":"2024-09-21T09:03:39.853440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:00.987047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.063131+0000","last_change":"2024-09-21T09:02:58.214989+0000","last_active":"2024-09-21T09:06:06.063131+0000","last_peered":"2024-09-21T09:06:06.063131+0000","last_clean":"2024-09-21T09:06:06.063131+0000","last_became_active":"2024-09-21T09:02:58.214717+0000","last_became_peered":"2024-09-21T09:02:58.214717+0000","last_unstale":"2024-09-21T09:06:06.063131+0000","last_undegraded":"2024-09-21T09:06:06.063131+0000","last_fullsized":"2024-09-21T09:06:06.063131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:03.101113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.456132+0000","last_change":"2024-09-21T09:03:00.227362+0000","last_active":"2024-09-21T09:05:17.456132+0000","last_peered":"2024-09-21T09:05:17.456132+0000","last_clean":"2024-09-21T09:05:17.456132+0000","last_became_active":"2024-09-21T09:03:00.226411+0000","last_became_peered":"2024-09-21T09:03:00.226411+0000","last_unstale":"2024-09-21T09:05:17.456132+0000","last_undegraded":"2024-09-21T09:05:17.456132+0000","last_fullsized":"2024-09-21T09:05:17.456132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:47.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.753111+0000","last_change":"2024-09-21T09:02:58.224258+0000","last_active":"2024-09-21T09:03:38.753111+0000","last_peered":"2024-09-21T09:03:38.753111+0000","last_clean":"2024-09-21T09:03:38.753111+0000","last_became_active":"2024-09-21T09:02:58.224058+0000","last_became_peered":"2024-09-21T09:02:58.224058+0000","last_unstale":"2024-09-21T09:03:38.753111+0000","last_undegraded":"2024-09-21T09:03:38.753111+0000","last_fullsized":"2024-09-21T09:03:38.753111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:40.099948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.080511+0000","last_change":"2024-09-21T09:03:00.220552+0000","last_active":"2024-09-21T09:06:06.080511+0000","last_peered":"2024-09-21T09:06:06.080511+0000","last_clean":"2024-09-21T09:06:06.080511+0000","last_became_active":"2024-09-21T09:03:00.218422+0000","last_became_peered":"2024-09-21T09:03:00.218422+0000","last_unstale":"2024-09-21T09:06:06.080511+0000","last_undegraded":"2024-09-21T09:06:06.080511+0000","last_fullsized":"2024-09-21T09:06:06.080511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:11.245837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275596+0000","last_change":"2024-09-21T09:02:58.219338+0000","last_active":"2024-09-21T09:03:38.275596+0000","last_peered":"2024-09-21T09:03:38.275596+0000","last_clean":"2024-09-21T09:03:38.275596+0000","last_became_active":"2024-09-21T09:02:58.218299+0000","last_became_peered":"2024-09-21T09:02:58.218299+0000","last_unstale":"2024-09-21T09:03:38.275596+0000","last_undegraded":"2024-09-21T09:03:38.275596+0000","last_fullsized":"2024-09-21T09:03:38.275596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:52.024304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'11","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455220+0000","last_change":"2024-09-21T09:03:00.213716+0000","last_active":"2024-09-21T09:05:12.455220+0000","last_peered":"2024-09-21T09:05:12.455220+0000","last_clean":"2024-09-21T09:05:12.455220+0000","last_became_active":"2024-09-21T09:03:00.212838+0000","last_became_peered":"2024-09-21T09:03:00.212838+0000","last_unstale":"2024-09-21T09:05:12.455220+0000","last_undegraded":"2024-09-21T09:05:12.455220+0000","last_fullsized":"2024-09-21T09:05:12.455220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:30.357859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.460059+0000","last_change":"2024-09-21T09:02:58.219134+0000","last_active":"2024-09-21T09:05:18.460059+0000","last_peered":"2024-09-21T09:05:18.460059+0000","last_clean":"2024-09-21T09:05:18.460059+0000","last_became_active":"2024-09-21T09:02:58.218776+0000","last_became_peered":"2024-09-21T09:02:58.218776+0000","last_unstale":"2024-09-21T09:05:18.460059+0000","last_undegraded":"2024-09-21T09:05:18.460059+0000","last_fullsized":"2024-09-21T09:05:18.460059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:24.476268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271062+0000","last_change":"2024-09-21T09:02:58.219078+0000","last_active":"2024-09-21T09:03:38.271062+0000","last_peered":"2024-09-21T09:03:38.271062+0000","last_clean":"2024-09-21T09:03:38.271062+0000","last_became_active":"2024-09-21T09:02:58.218757+0000","last_became_peered":"2024-09-21T09:02:58.218757+0000","last_unstale":"2024-09-21T09:03:38.271062+0000","last_undegraded":"2024-09-21T09:03:38.271062+0000","last_fullsized":"2024-09-21T09:03:38.271062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:37:41.056206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'6","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.299232+0000","last_change":"2024-09-21T09:03:00.216883+0000","last_active":"2024-09-21T09:06:06.299232+0000","last_peered":"2024-09-21T09:06:06.299232+0000","last_clean":"2024-09-21T09:06:06.299232+0000","last_became_active":"2024-09-21T09:03:00.216424+0000","last_became_peered":"2024-09-21T09:03:00.216424+0000","last_unstale":"2024-09-21T09:06:06.299232+0000","last_undegraded":"2024-09-21T09:06:06.299232+0000","last_fullsized":"2024-09-21T09:06:06.299232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:50.802476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463675+0000","last_change":"2024-09-21T09:02:58.209061+0000","last_active":"2024-09-21T09:03:38.463675+0000","last_peered":"2024-09-21T09:03:38.463675+0000","last_clean":"2024-09-21T09:03:38.463675+0000","last_became_active":"2024-09-21T09:02:58.208437+0000","last_became_peered":"2024-09-21T09:02:58.208437+0000","last_unstale":"2024-09-21T09:03:38.463675+0000","last_undegraded":"2024-09-21T09:03:38.463675+0000","last_fullsized":"2024-09-21T09:03:38.463675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:12.355792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'3","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.089579+0000","last_change":"2024-09-21T09:03:00.219307+0000","last_active":"2024-09-21T09:06:06.089579+0000","last_peered":"2024-09-21T09:06:06.089579+0000","last_clean":"2024-09-21T09:06:06.089579+0000","last_became_active":"2024-09-21T09:03:00.219010+0000","last_became_peered":"2024-09-21T09:03:00.219010+0000","last_unstale":"2024-09-21T09:06:06.089579+0000","last_undegraded":"2024-09-21T09:06:06.089579+0000","last_fullsized":"2024-09-21T09:06:06.089579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:19.412009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673005,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40392,"kb_used_data":13368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331448,"statfs":{"total":96636764160,"available":96595402752,"internally_reserved":0,"allocated":13688832,"data_stored":13360568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36796,"kb_used_data":9772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":10006528,"data_stored":9752500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61028,"kb_used_data":17364,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94310812,"statfs":{"total":96636764160,"available":96574271488,"internally_reserved":0,"allocated":17780736,"data_stored":17500718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52200,"kb_used_data":12696,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319640,"statfs":{"total":96636764160,"available":96583311360,"internally_reserved":0,"allocated":13000704,"data_stored":12717132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:06:13.760 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T09:06:13.760 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:06:13.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.890+0000 7f11222ba640 1 Processor -- start 2024-09-21T09:06:13.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.890+0000 7f11222ba640 1 -- start start 2024-09-21T09:06:13.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.890+0000 7f11222ba640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f111c096a10 0x7f111c06e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:13.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.890+0000 7f11222ba640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f111c0702f0 con 0x7f111c096630 2024-09-21T09:06:13.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.890+0000 7f11222ba640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f111c096e20 con 0x7f111c096a10 2024-09-21T09:06:13.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.890+0000 7f111bfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f111c096630 0x7f111c06d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58272/0 (socket says 172.21.15.44:58272) 2024-09-21T09:06:13.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.890+0000 7f111bfff640 1 -- 172.21.15.44:0/417923875 learned_addr learned my addr 172.21.15.44:0/417923875 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:13.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.890+0000 7f111b7fe640 1 --2- 172.21.15.44:0/417923875 >> v2:172.21.15.44:3300/0 conn(0x7f111c096a10 0x7f111c06e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:13.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.890+0000 7f111affd640 1 -- 172.21.15.44:0/417923875 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3571768240 0 0) 0x7f111c0702f0 con 0x7f111c096630 2024-09-21T09:06:13.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.890+0000 7f111affd640 1 -- 172.21.15.44:0/417923875 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1104003520 con 0x7f111c096630 2024-09-21T09:06:13.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.891+0000 7f111b7fe640 1 -- 172.21.15.44:0/417923875 >> v1:172.21.15.44:6789/0 conn(0x7f111c096630 legacy=0x7f111c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.891+0000 7f111b7fe640 1 -- 172.21.15.44:0/417923875 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c06f1f0 con 0x7f111c096a10 2024-09-21T09:06:13.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.891+0000 7f111b7fe640 1 --2- 172.21.15.44:0/417923875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f111c096a10 0x7f111c06e020 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1110009720 tx=0x7f111002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc729ad45e79dea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:13.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.891+0000 7f111affd640 1 -- 172.21.15.44:0/417923875 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1110037070 con 0x7f111c096a10 2024-09-21T09:06:13.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.891+0000 7f111affd640 1 -- 172.21.15.44:0/417923875 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f111002ad90 con 0x7f111c096a10 2024-09-21T09:06:13.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.891+0000 7f111affd640 1 -- 172.21.15.44:0/417923875 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1110032590 con 0x7f111c096a10 2024-09-21T09:06:13.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.892+0000 7f11222ba640 1 -- 172.21.15.44:0/417923875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f111c096a10 msgr2=0x7f111c06e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:13.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.892+0000 7f11222ba640 1 --2- 172.21.15.44:0/417923875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f111c096a10 0x7f111c06e020 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1110009720 tx=0x7f111002a110 comp rx=0 tx=0).stop 2024-09-21T09:06:13.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.892+0000 7f11222ba640 1 -- 172.21.15.44:0/417923875 shutdown_connections 2024-09-21T09:06:13.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.892+0000 7f11222ba640 1 --2- 172.21.15.44:0/417923875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f111c096a10 0x7f111c06e020 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:13.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.892+0000 7f11222ba640 1 -- 172.21.15.44:0/417923875 >> 172.21.15.44:0/417923875 conn(0x7f111c09a890 msgr2=0x7f111c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:13.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.892+0000 7f11222ba640 1 -- 172.21.15.44:0/417923875 shutdown_connections 2024-09-21T09:06:13.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.892+0000 7f11222ba640 1 -- 172.21.15.44:0/417923875 wait complete. 2024-09-21T09:06:13.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.893+0000 7f11222ba640 1 Processor -- start 2024-09-21T09:06:13.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.893+0000 7f11222ba640 1 -- start start 2024-09-21T09:06:13.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.894+0000 7f11222ba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f111c096630 0x7f111c126ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:13.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.894+0000 7f11222ba640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f111c06e6e0 con 0x7f111c096630 2024-09-21T09:06:13.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.894+0000 7f111bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f111c096630 0x7f111c126ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:13.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.894+0000 7f111bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f111c096630 0x7f111c126ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53072/0 (socket says 172.21.15.44:53072) 2024-09-21T09:06:13.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.894+0000 7f111bfff640 1 -- 172.21.15.44:0/4103225458 learned_addr learned my addr 172.21.15.44:0/4103225458 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:13.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.894+0000 7f111bfff640 1 -- 172.21.15.44:0/4103225458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c08c400 con 0x7f111c096630 2024-09-21T09:06:13.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.894+0000 7f111bfff640 1 --2- 172.21.15.44:0/4103225458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f111c096630 0x7f111c126ab0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f110c00c480 tx=0x7f110c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:13.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.894+0000 7f1118ff9640 1 -- 172.21.15.44:0/4103225458 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f110c017070 con 0x7f111c096630 2024-09-21T09:06:13.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.894+0000 7f1118ff9640 1 -- 172.21.15.44:0/4103225458 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f110c005c10 con 0x7f111c096630 2024-09-21T09:06:13.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.894+0000 7f11222ba640 1 -- 172.21.15.44:0/4103225458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111c072ea0 con 0x7f111c096630 2024-09-21T09:06:13.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.894+0000 7f1118ff9640 1 -- 172.21.15.44:0/4103225458 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f110c007070 con 0x7f111c096630 2024-09-21T09:06:13.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.894+0000 7f11222ba640 1 -- 172.21.15.44:0/4103225458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f111c095e20 con 0x7f111c096630 2024-09-21T09:06:13.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.895+0000 7f1118ff9640 1 -- 172.21.15.44:0/4103225458 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f110c01a070 con 0x7f111c096630 2024-09-21T09:06:13.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.895+0000 7f11222ba640 1 -- 172.21.15.44:0/4103225458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f111c06d080 con 0x7f111c096630 2024-09-21T09:06:13.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.895+0000 7f1118ff9640 1 --2- 172.21.15.44:0/4103225458 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f11080382a0 0x7f110803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:13.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.895+0000 7f1118ff9640 1 -- 172.21.15.44:0/4103225458 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f110c04af90 con 0x7f111c096630 2024-09-21T09:06:13.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.896+0000 7f111b7fe640 1 --2- 172.21.15.44:0/4103225458 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f11080382a0 0x7f110803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:13.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.896+0000 7f111b7fe640 1 --2- 172.21.15.44:0/4103225458 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f11080382a0 0x7f110803a760 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1110034000 tx=0x7f111002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:13.900+0000 7f1118ff9640 1 -- 172.21.15.44:0/4103225458 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f111c08c400 con 0x7f111c096630 2024-09-21T09:06:14.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.072+0000 7f11222ba640 1 -- 172.21.15.44:0/4103225458 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f111c0008d0 con 0x7f11080382a0 2024-09-21T09:06:14.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.087+0000 7f1118ff9640 1 -- 172.21.15.44:0/4103225458 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665585 (secure 0 0 0) 0x7f111c0008d0 con 0x7f11080382a0 2024-09-21T09:06:14.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:06:14.101 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-21T09:06:14.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.092+0000 7f11222ba640 1 -- 172.21.15.44:0/4103225458 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f11080382a0 msgr2=0x7f110803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:14.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.092+0000 7f11222ba640 1 --2- 172.21.15.44:0/4103225458 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f11080382a0 0x7f110803a760 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1110034000 tx=0x7f111002e000 comp rx=0 tx=0).stop 2024-09-21T09:06:14.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.092+0000 7f11222ba640 1 -- 172.21.15.44:0/4103225458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f111c096630 msgr2=0x7f111c126ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:14.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.092+0000 7f11222ba640 1 --2- 172.21.15.44:0/4103225458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f111c096630 0x7f111c126ab0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f110c00c480 tx=0x7f110c00c940 comp rx=0 tx=0).stop 2024-09-21T09:06:14.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.092+0000 7f11222ba640 1 -- 172.21.15.44:0/4103225458 shutdown_connections 2024-09-21T09:06:14.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.092+0000 7f11222ba640 1 --2- 172.21.15.44:0/4103225458 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f11080382a0 0x7f110803a760 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:14.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.092+0000 7f11222ba640 1 --2- 172.21.15.44:0/4103225458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f111c096630 0x7f111c126ab0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:14.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.092+0000 7f11222ba640 1 -- 172.21.15.44:0/4103225458 >> 172.21.15.44:0/4103225458 conn(0x7f111c09a890 msgr2=0x7f111c097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:14.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.092+0000 7f11222ba640 1 -- 172.21.15.44:0/4103225458 shutdown_connections 2024-09-21T09:06:14.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.092+0000 7f11222ba640 1 -- 172.21.15.44:0/4103225458 wait complete. 2024-09-21T09:06:14.104 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-21T09:06:12.483951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4881,"num_read_kb":4462,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190416,"kb_used_data":53200,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377296944,"statfs":{"total":386547056640,"available":386352070656,"internally_reserved":0,"allocated":54476800,"data_stored":53330918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":140437271},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003770"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.693474+0000","last_change":"2024-09-21T09:03:38.283847+0000","last_active":"2024-09-21T09:05:05.693474+0000","last_peered":"2024-09-21T09:05:05.693474+0000","last_clean":"2024-09-21T09:05:05.693474+0000","last_became_active":"2024-09-21T09:03:38.283357+0000","last_became_peered":"2024-09-21T09:03:38.283357+0000","last_unstale":"2024-09-21T09:05:05.693474+0000","last_undegraded":"2024-09-21T09:05:05.693474+0000","last_fullsized":"2024-09-21T09:05:05.693474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:01.386955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'20","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.299232+0000","last_change":"2024-09-21T09:03:00.226390+0000","last_active":"2024-09-21T09:06:06.299232+0000","last_peered":"2024-09-21T09:06:06.299232+0000","last_clean":"2024-09-21T09:06:06.299232+0000","last_became_active":"2024-09-21T09:03:00.226067+0000","last_became_peered":"2024-09-21T09:03:00.226067+0000","last_unstale":"2024-09-21T09:06:06.299232+0000","last_undegraded":"2024-09-21T09:06:06.299232+0000","last_fullsized":"2024-09-21T09:06:06.299232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:19.763600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465423+0000","last_change":"2024-09-21T09:02:58.213108+0000","last_active":"2024-09-21T09:03:38.465423+0000","last_peered":"2024-09-21T09:03:38.465423+0000","last_clean":"2024-09-21T09:03:38.465423+0000","last_became_active":"2024-09-21T09:02:58.212828+0000","last_became_peered":"2024-09-21T09:02:58.212828+0000","last_unstale":"2024-09-21T09:03:38.465423+0000","last_undegraded":"2024-09-21T09:03:38.465423+0000","last_fullsized":"2024-09-21T09:03:38.465423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:25.409736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298796+0000","last_change":"2024-09-21T09:03:00.222612+0000","last_active":"2024-09-21T09:06:06.298796+0000","last_peered":"2024-09-21T09:06:06.298796+0000","last_clean":"2024-09-21T09:06:06.298796+0000","last_became_active":"2024-09-21T09:03:00.222333+0000","last_became_peered":"2024-09-21T09:03:00.222333+0000","last_unstale":"2024-09-21T09:06:06.298796+0000","last_undegraded":"2024-09-21T09:06:06.298796+0000","last_fullsized":"2024-09-21T09:06:06.298796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:22.752060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278836+0000","last_change":"2024-09-21T09:02:58.221389+0000","last_active":"2024-09-21T09:03:38.278836+0000","last_peered":"2024-09-21T09:03:38.278836+0000","last_clean":"2024-09-21T09:03:38.278836+0000","last_became_active":"2024-09-21T09:02:58.221214+0000","last_became_peered":"2024-09-21T09:02:58.221214+0000","last_unstale":"2024-09-21T09:03:38.278836+0000","last_undegraded":"2024-09-21T09:03:38.278836+0000","last_fullsized":"2024-09-21T09:03:38.278836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:59.331305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173989+0000","last_change":"2024-09-21T09:03:00.221728+0000","last_active":"2024-09-21T09:06:06.173989+0000","last_peered":"2024-09-21T09:06:06.173989+0000","last_clean":"2024-09-21T09:06:06.173989+0000","last_became_active":"2024-09-21T09:03:00.221451+0000","last_became_peered":"2024-09-21T09:03:00.221451+0000","last_unstale":"2024-09-21T09:06:06.173989+0000","last_undegraded":"2024-09-21T09:06:06.173989+0000","last_fullsized":"2024-09-21T09:06:06.173989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:36.553233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:57.452905+0000","last_change":"2024-09-21T09:02:58.208725+0000","last_active":"2024-09-21T09:04:57.452905+0000","last_peered":"2024-09-21T09:04:57.452905+0000","last_clean":"2024-09-21T09:04:57.452905+0000","last_became_active":"2024-09-21T09:02:58.207683+0000","last_became_peered":"2024-09-21T09:02:58.207683+0000","last_unstale":"2024-09-21T09:04:57.452905+0000","last_undegraded":"2024-09-21T09:04:57.452905+0000","last_fullsized":"2024-09-21T09:04:57.452905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:12.355792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'9","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.267454+0000","last_change":"2024-09-21T09:03:00.212574+0000","last_active":"2024-09-21T09:06:06.267454+0000","last_peered":"2024-09-21T09:06:06.267454+0000","last_clean":"2024-09-21T09:06:06.267454+0000","last_became_active":"2024-09-21T09:03:00.210589+0000","last_became_peered":"2024-09-21T09:03:00.210589+0000","last_unstale":"2024-09-21T09:06:06.267454+0000","last_undegraded":"2024-09-21T09:06:06.267454+0000","last_fullsized":"2024-09-21T09:06:06.267454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:11.555715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.253856+0000","last_change":"2024-09-21T09:02:58.224906+0000","last_active":"2024-09-21T09:06:06.253856+0000","last_peered":"2024-09-21T09:06:06.253856+0000","last_clean":"2024-09-21T09:06:06.253856+0000","last_became_active":"2024-09-21T09:02:58.224630+0000","last_became_peered":"2024-09-21T09:02:58.224630+0000","last_unstale":"2024-09-21T09:06:06.253856+0000","last_undegraded":"2024-09-21T09:06:06.253856+0000","last_fullsized":"2024-09-21T09:06:06.253856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:24.376659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'6","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298997+0000","last_change":"2024-09-21T09:03:00.223960+0000","last_active":"2024-09-21T09:06:06.298997+0000","last_peered":"2024-09-21T09:06:06.298997+0000","last_clean":"2024-09-21T09:06:06.298997+0000","last_became_active":"2024-09-21T09:03:00.217048+0000","last_became_peered":"2024-09-21T09:03:00.217048+0000","last_unstale":"2024-09-21T09:06:06.298997+0000","last_undegraded":"2024-09-21T09:06:06.298997+0000","last_fullsized":"2024-09-21T09:06:06.298997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:50.802476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.626681+0000","last_change":"2024-09-21T09:02:58.205801+0000","last_active":"2024-09-21T09:05:05.626681+0000","last_peered":"2024-09-21T09:05:05.626681+0000","last_clean":"2024-09-21T09:05:05.626681+0000","last_became_active":"2024-09-21T09:02:58.205515+0000","last_became_peered":"2024-09-21T09:02:58.205515+0000","last_unstale":"2024-09-21T09:05:05.626681+0000","last_undegraded":"2024-09-21T09:05:05.626681+0000","last_fullsized":"2024-09-21T09:05:05.626681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:14.606085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'14","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363415+0000","last_change":"2024-09-21T09:03:00.222211+0000","last_active":"2024-09-21T09:06:06.363415+0000","last_peered":"2024-09-21T09:06:06.363415+0000","last_clean":"2024-09-21T09:06:06.363415+0000","last_became_active":"2024-09-21T09:03:00.221117+0000","last_became_peered":"2024-09-21T09:03:00.221117+0000","last_unstale":"2024-09-21T09:06:06.363415+0000","last_undegraded":"2024-09-21T09:06:06.363415+0000","last_fullsized":"2024-09-21T09:06:06.363415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:45.284408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.248708+0000","last_change":"2024-09-21T09:02:58.211066+0000","last_active":"2024-09-21T09:06:06.248708+0000","last_peered":"2024-09-21T09:06:06.248708+0000","last_clean":"2024-09-21T09:06:06.248708+0000","last_became_active":"2024-09-21T09:02:58.210702+0000","last_became_peered":"2024-09-21T09:02:58.210702+0000","last_unstale":"2024-09-21T09:06:06.248708+0000","last_undegraded":"2024-09-21T09:06:06.248708+0000","last_fullsized":"2024-09-21T09:06:06.248708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:18.510636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'10","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363641+0000","last_change":"2024-09-21T09:03:00.221039+0000","last_active":"2024-09-21T09:06:06.363641+0000","last_peered":"2024-09-21T09:06:06.363641+0000","last_clean":"2024-09-21T09:06:06.363641+0000","last_became_active":"2024-09-21T09:03:00.220725+0000","last_became_peered":"2024-09-21T09:03:00.220725+0000","last_unstale":"2024-09-21T09:06:06.363641+0000","last_undegraded":"2024-09-21T09:06:06.363641+0000","last_fullsized":"2024-09-21T09:06:06.363641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:39.266159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.256624+0000","last_change":"2024-09-21T09:02:58.217016+0000","last_active":"2024-09-21T09:06:06.256624+0000","last_peered":"2024-09-21T09:06:06.256624+0000","last_clean":"2024-09-21T09:06:06.256624+0000","last_became_active":"2024-09-21T09:02:58.216712+0000","last_became_peered":"2024-09-21T09:02:58.216712+0000","last_unstale":"2024-09-21T09:06:06.256624+0000","last_undegraded":"2024-09-21T09:06:06.256624+0000","last_fullsized":"2024-09-21T09:06:06.256624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:52.024304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'14","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363418+0000","last_change":"2024-09-21T09:03:00.222904+0000","last_active":"2024-09-21T09:06:06.363418+0000","last_peered":"2024-09-21T09:06:06.363418+0000","last_clean":"2024-09-21T09:06:06.363418+0000","last_became_active":"2024-09-21T09:03:00.222593+0000","last_became_peered":"2024-09-21T09:03:00.222593+0000","last_unstale":"2024-09-21T09:06:06.363418+0000","last_undegraded":"2024-09-21T09:06:06.363418+0000","last_fullsized":"2024-09-21T09:06:06.363418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:47.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'11","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460587+0000","last_change":"2024-09-21T09:03:00.220191+0000","last_active":"2024-09-21T09:05:23.460587+0000","last_peered":"2024-09-21T09:05:23.460587+0000","last_clean":"2024-09-21T09:05:23.460587+0000","last_became_active":"2024-09-21T09:03:00.219923+0000","last_became_peered":"2024-09-21T09:03:00.219923+0000","last_unstale":"2024-09-21T09:05:23.460587+0000","last_undegraded":"2024-09-21T09:05:23.460587+0000","last_fullsized":"2024-09-21T09:05:23.460587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:09.508750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275945+0000","last_change":"2024-09-21T09:02:58.212942+0000","last_active":"2024-09-21T09:03:38.275945+0000","last_peered":"2024-09-21T09:03:38.275945+0000","last_clean":"2024-09-21T09:03:38.275945+0000","last_became_active":"2024-09-21T09:02:58.210936+0000","last_became_peered":"2024-09-21T09:02:58.210936+0000","last_unstale":"2024-09-21T09:03:38.275945+0000","last_undegraded":"2024-09-21T09:03:38.275945+0000","last_fullsized":"2024-09-21T09:03:38.275945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:08.728738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'8","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.072789+0000","last_change":"2024-09-21T09:03:00.225223+0000","last_active":"2024-09-21T09:04:22.072789+0000","last_peered":"2024-09-21T09:04:22.072789+0000","last_clean":"2024-09-21T09:04:22.072789+0000","last_became_active":"2024-09-21T09:03:00.224695+0000","last_became_peered":"2024-09-21T09:03:00.224695+0000","last_unstale":"2024-09-21T09:04:22.072789+0000","last_undegraded":"2024-09-21T09:04:22.072789+0000","last_fullsized":"2024-09-21T09:04:22.072789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:18.875227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.246956+0000","last_change":"2024-09-21T09:02:58.220090+0000","last_active":"2024-09-21T09:04:22.246956+0000","last_peered":"2024-09-21T09:04:22.246956+0000","last_clean":"2024-09-21T09:04:22.246956+0000","last_became_active":"2024-09-21T09:02:58.218643+0000","last_became_peered":"2024-09-21T09:02:58.218643+0000","last_unstale":"2024-09-21T09:04:22.246956+0000","last_undegraded":"2024-09-21T09:04:22.246956+0000","last_fullsized":"2024-09-21T09:04:22.246956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.813396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363139+0000","last_change":"2024-09-21T09:03:00.227634+0000","last_active":"2024-09-21T09:06:06.363139+0000","last_peered":"2024-09-21T09:06:06.363139+0000","last_clean":"2024-09-21T09:06:06.363139+0000","last_became_active":"2024-09-21T09:03:00.226738+0000","last_became_peered":"2024-09-21T09:03:00.226738+0000","last_unstale":"2024-09-21T09:06:06.363139+0000","last_undegraded":"2024-09-21T09:06:06.363139+0000","last_fullsized":"2024-09-21T09:06:06.363139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:24.661101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.043712+0000","last_change":"2024-09-21T09:02:58.208501+0000","last_active":"2024-09-21T09:06:06.043712+0000","last_peered":"2024-09-21T09:06:06.043712+0000","last_clean":"2024-09-21T09:06:06.043712+0000","last_became_active":"2024-09-21T09:02:58.208220+0000","last_became_peered":"2024-09-21T09:02:58.208220+0000","last_unstale":"2024-09-21T09:06:06.043712+0000","last_undegraded":"2024-09-21T09:06:06.043712+0000","last_fullsized":"2024-09-21T09:06:06.043712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:44.533015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'16","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260865+0000","last_change":"2024-09-21T09:03:00.216019+0000","last_active":"2024-09-21T09:06:06.260865+0000","last_peered":"2024-09-21T09:06:06.260865+0000","last_clean":"2024-09-21T09:06:06.260865+0000","last_became_active":"2024-09-21T09:03:00.215637+0000","last_became_peered":"2024-09-21T09:03:00.215637+0000","last_unstale":"2024-09-21T09:06:06.260865+0000","last_undegraded":"2024-09-21T09:06:06.260865+0000","last_fullsized":"2024-09-21T09:06:06.260865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.852495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275771+0000","last_change":"2024-09-21T09:02:58.206160+0000","last_active":"2024-09-21T09:03:38.275771+0000","last_peered":"2024-09-21T09:03:38.275771+0000","last_clean":"2024-09-21T09:03:38.275771+0000","last_became_active":"2024-09-21T09:02:58.204603+0000","last_became_peered":"2024-09-21T09:02:58.204603+0000","last_unstale":"2024-09-21T09:03:38.275771+0000","last_undegraded":"2024-09-21T09:03:38.275771+0000","last_fullsized":"2024-09-21T09:03:38.275771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:38.066496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.717096+0000","last_change":"2024-09-21T09:03:00.223258+0000","last_active":"2024-09-21T09:05:05.717096+0000","last_peered":"2024-09-21T09:05:05.717096+0000","last_clean":"2024-09-21T09:05:05.717096+0000","last_became_active":"2024-09-21T09:03:00.222972+0000","last_became_peered":"2024-09-21T09:03:00.222972+0000","last_unstale":"2024-09-21T09:05:05.717096+0000","last_undegraded":"2024-09-21T09:05:05.717096+0000","last_fullsized":"2024-09-21T09:05:05.717096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:32.562147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464762+0000","last_change":"2024-09-21T09:02:58.208852+0000","last_active":"2024-09-21T09:03:38.464762+0000","last_peered":"2024-09-21T09:03:38.464762+0000","last_clean":"2024-09-21T09:03:38.464762+0000","last_became_active":"2024-09-21T09:02:58.208383+0000","last_became_peered":"2024-09-21T09:02:58.208383+0000","last_unstale":"2024-09-21T09:03:38.464762+0000","last_undegraded":"2024-09-21T09:03:38.464762+0000","last_fullsized":"2024-09-21T09:03:38.464762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:07.674387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363227+0000","last_change":"2024-09-21T09:03:00.212288+0000","last_active":"2024-09-21T09:06:06.363227+0000","last_peered":"2024-09-21T09:06:06.363227+0000","last_clean":"2024-09-21T09:06:06.363227+0000","last_became_active":"2024-09-21T09:03:00.211942+0000","last_became_peered":"2024-09-21T09:03:00.211942+0000","last_unstale":"2024-09-21T09:06:06.363227+0000","last_undegraded":"2024-09-21T09:06:06.363227+0000","last_fullsized":"2024-09-21T09:06:06.363227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:53.039369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.753027+0000","last_change":"2024-09-21T09:02:58.214186+0000","last_active":"2024-09-21T09:03:38.753027+0000","last_peered":"2024-09-21T09:03:38.753027+0000","last_clean":"2024-09-21T09:03:38.753027+0000","last_became_active":"2024-09-21T09:02:58.213548+0000","last_became_peered":"2024-09-21T09:02:58.213548+0000","last_unstale":"2024-09-21T09:03:38.753027+0000","last_undegraded":"2024-09-21T09:03:38.753027+0000","last_fullsized":"2024-09-21T09:03:38.753027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:14.666195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.280442+0000","last_change":"2024-09-21T09:03:08.262655+0000","last_active":"2024-09-21T09:06:06.280442+0000","last_peered":"2024-09-21T09:06:06.280442+0000","last_clean":"2024-09-21T09:06:06.280442+0000","last_became_active":"2024-09-21T09:03:08.262362+0000","last_became_peered":"2024-09-21T09:03:08.262362+0000","last_unstale":"2024-09-21T09:06:06.280442+0000","last_undegraded":"2024-09-21T09:06:06.280442+0000","last_fullsized":"2024-09-21T09:06:06.280442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:23.685881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275829+0000","last_change":"2024-09-21T09:03:00.212668+0000","last_active":"2024-09-21T09:03:38.275829+0000","last_peered":"2024-09-21T09:03:38.275829+0000","last_clean":"2024-09-21T09:03:38.275829+0000","last_became_active":"2024-09-21T09:03:00.209346+0000","last_became_peered":"2024-09-21T09:03:00.209346+0000","last_unstale":"2024-09-21T09:03:38.275829+0000","last_undegraded":"2024-09-21T09:03:38.275829+0000","last_fullsized":"2024-09-21T09:03:38.275829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:35.918701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271768+0000","last_change":"2024-09-21T09:02:58.221478+0000","last_active":"2024-09-21T09:03:38.271768+0000","last_peered":"2024-09-21T09:03:38.271768+0000","last_clean":"2024-09-21T09:03:38.271768+0000","last_became_active":"2024-09-21T09:02:58.221187+0000","last_became_peered":"2024-09-21T09:02:58.221187+0000","last_unstale":"2024-09-21T09:03:38.271768+0000","last_undegraded":"2024-09-21T09:03:38.271768+0000","last_fullsized":"2024-09-21T09:03:38.271768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:43.391268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277937+0000","last_change":"2024-09-21T09:03:02.220660+0000","last_active":"2024-09-21T09:03:38.277937+0000","last_peered":"2024-09-21T09:03:38.277937+0000","last_clean":"2024-09-21T09:03:38.277937+0000","last_became_active":"2024-09-21T09:03:02.220370+0000","last_became_peered":"2024-09-21T09:03:02.220370+0000","last_unstale":"2024-09-21T09:03:38.277937+0000","last_undegraded":"2024-09-21T09:03:38.277937+0000","last_fullsized":"2024-09-21T09:03:38.277937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:00.166342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.351174+0000","last_change":"2024-09-21T09:03:04.243245+0000","last_active":"2024-09-21T09:05:04.351174+0000","last_peered":"2024-09-21T09:05:04.351174+0000","last_clean":"2024-09-21T09:05:04.351174+0000","last_became_active":"2024-09-21T09:03:04.242637+0000","last_became_peered":"2024-09-21T09:03:04.242637+0000","last_unstale":"2024-09-21T09:05:04.351174+0000","last_undegraded":"2024-09-21T09:05:04.351174+0000","last_fullsized":"2024-09-21T09:05:04.351174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:09.480974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274815+0000","last_change":"2024-09-21T09:03:06.247484+0000","last_active":"2024-09-21T09:03:38.274815+0000","last_peered":"2024-09-21T09:03:38.274815+0000","last_clean":"2024-09-21T09:03:38.274815+0000","last_became_active":"2024-09-21T09:03:06.247203+0000","last_became_peered":"2024-09-21T09:03:06.247203+0000","last_unstale":"2024-09-21T09:03:38.274815+0000","last_undegraded":"2024-09-21T09:03:38.274815+0000","last_fullsized":"2024-09-21T09:03:38.274815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:37.402801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.415271+0000","last_change":"2024-09-21T09:03:08.262677+0000","last_active":"2024-09-21T09:06:06.415271+0000","last_peered":"2024-09-21T09:06:06.415271+0000","last_clean":"2024-09-21T09:06:06.415271+0000","last_became_active":"2024-09-21T09:03:08.262384+0000","last_became_peered":"2024-09-21T09:03:08.262384+0000","last_unstale":"2024-09-21T09:06:06.415271+0000","last_undegraded":"2024-09-21T09:06:06.415271+0000","last_fullsized":"2024-09-21T09:06:06.415271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:38.859764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'8","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298988+0000","last_change":"2024-09-21T09:03:00.218848+0000","last_active":"2024-09-21T09:06:06.298988+0000","last_peered":"2024-09-21T09:06:06.298988+0000","last_clean":"2024-09-21T09:06:06.298988+0000","last_became_active":"2024-09-21T09:03:00.217658+0000","last_became_peered":"2024-09-21T09:03:00.217658+0000","last_unstale":"2024-09-21T09:06:06.298988+0000","last_undegraded":"2024-09-21T09:06:06.298988+0000","last_fullsized":"2024-09-21T09:06:06.298988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:04.690462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275111+0000","last_change":"2024-09-21T09:02:58.218614+0000","last_active":"2024-09-21T09:03:38.275111+0000","last_peered":"2024-09-21T09:03:38.275111+0000","last_clean":"2024-09-21T09:03:38.275111+0000","last_became_active":"2024-09-21T09:02:58.218086+0000","last_became_peered":"2024-09-21T09:02:58.218086+0000","last_unstale":"2024-09-21T09:03:38.275111+0000","last_undegraded":"2024-09-21T09:03:38.275111+0000","last_fullsized":"2024-09-21T09:03:38.275111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:03.460514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466155+0000","last_change":"2024-09-21T09:03:02.220885+0000","last_active":"2024-09-21T09:03:38.466155+0000","last_peered":"2024-09-21T09:03:38.466155+0000","last_clean":"2024-09-21T09:03:38.466155+0000","last_became_active":"2024-09-21T09:03:02.220557+0000","last_became_peered":"2024-09-21T09:03:02.220557+0000","last_unstale":"2024-09-21T09:03:38.466155+0000","last_undegraded":"2024-09-21T09:03:38.466155+0000","last_fullsized":"2024-09-21T09:03:38.466155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:27.649227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274937+0000","last_change":"2024-09-21T09:03:04.236337+0000","last_active":"2024-09-21T09:03:38.274937+0000","last_peered":"2024-09-21T09:03:38.274937+0000","last_clean":"2024-09-21T09:03:38.274937+0000","last_became_active":"2024-09-21T09:03:04.236037+0000","last_became_peered":"2024-09-21T09:03:04.236037+0000","last_unstale":"2024-09-21T09:03:38.274937+0000","last_undegraded":"2024-09-21T09:03:38.274937+0000","last_fullsized":"2024-09-21T09:03:38.274937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:06.028996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274949+0000","last_change":"2024-09-21T09:03:06.244177+0000","last_active":"2024-09-21T09:03:38.274949+0000","last_peered":"2024-09-21T09:03:38.274949+0000","last_clean":"2024-09-21T09:03:38.274949+0000","last_became_active":"2024-09-21T09:03:06.243901+0000","last_became_peered":"2024-09-21T09:03:06.243901+0000","last_unstale":"2024-09-21T09:03:38.274949+0000","last_undegraded":"2024-09-21T09:03:38.274949+0000","last_fullsized":"2024-09-21T09:03:38.274949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:03.746735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463546+0000","last_change":"2024-09-21T09:03:08.250364+0000","last_active":"2024-09-21T09:03:38.463546+0000","last_peered":"2024-09-21T09:03:38.463546+0000","last_clean":"2024-09-21T09:03:38.463546+0000","last_became_active":"2024-09-21T09:03:08.250029+0000","last_became_peered":"2024-09-21T09:03:08.250029+0000","last_unstale":"2024-09-21T09:03:38.463546+0000","last_undegraded":"2024-09-21T09:03:38.463546+0000","last_fullsized":"2024-09-21T09:03:38.463546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:58.888309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260917+0000","last_change":"2024-09-21T09:03:00.217928+0000","last_active":"2024-09-21T09:06:06.260917+0000","last_peered":"2024-09-21T09:06:06.260917+0000","last_clean":"2024-09-21T09:06:06.260917+0000","last_became_active":"2024-09-21T09:03:00.217633+0000","last_became_peered":"2024-09-21T09:03:00.217633+0000","last_unstale":"2024-09-21T09:06:06.260917+0000","last_undegraded":"2024-09-21T09:06:06.260917+0000","last_fullsized":"2024-09-21T09:06:06.260917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:20.929000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270779+0000","last_change":"2024-09-21T09:02:58.220432+0000","last_active":"2024-09-21T09:03:38.270779+0000","last_peered":"2024-09-21T09:03:38.270779+0000","last_clean":"2024-09-21T09:03:38.270779+0000","last_became_active":"2024-09-21T09:02:58.220133+0000","last_became_peered":"2024-09-21T09:02:58.220133+0000","last_unstale":"2024-09-21T09:03:38.270779+0000","last_undegraded":"2024-09-21T09:03:38.270779+0000","last_fullsized":"2024-09-21T09:03:38.270779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:53.075751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466206+0000","last_change":"2024-09-21T09:03:02.220223+0000","last_active":"2024-09-21T09:03:38.466206+0000","last_peered":"2024-09-21T09:03:38.466206+0000","last_clean":"2024-09-21T09:03:38.466206+0000","last_became_active":"2024-09-21T09:03:02.219457+0000","last_became_peered":"2024-09-21T09:03:02.219457+0000","last_unstale":"2024-09-21T09:03:38.466206+0000","last_undegraded":"2024-09-21T09:03:38.466206+0000","last_fullsized":"2024-09-21T09:03:38.466206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:02.648349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276650+0000","last_change":"2024-09-21T09:03:04.239498+0000","last_active":"2024-09-21T09:03:38.276650+0000","last_peered":"2024-09-21T09:03:38.276650+0000","last_clean":"2024-09-21T09:03:38.276650+0000","last_became_active":"2024-09-21T09:03:04.239187+0000","last_became_peered":"2024-09-21T09:03:04.239187+0000","last_unstale":"2024-09-21T09:03:38.276650+0000","last_undegraded":"2024-09-21T09:03:38.276650+0000","last_fullsized":"2024-09-21T09:03:38.276650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:25.074373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'282","reported_seq":384,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.469439+0000","last_change":"2024-09-21T09:03:06.248028+0000","last_active":"2024-09-21T09:06:06.469439+0000","last_peered":"2024-09-21T09:06:06.469439+0000","last_clean":"2024-09-21T09:06:06.469439+0000","last_became_active":"2024-09-21T09:03:06.247441+0000","last_became_peered":"2024-09-21T09:03:06.247441+0000","last_unstale":"2024-09-21T09:06:06.469439+0000","last_undegraded":"2024-09-21T09:06:06.469439+0000","last_fullsized":"2024-09-21T09:06:06.469439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:22.593231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'6","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.177765+0000","last_change":"2024-09-21T09:03:08.255550+0000","last_active":"2024-09-21T09:06:06.177765+0000","last_peered":"2024-09-21T09:06:06.177765+0000","last_clean":"2024-09-21T09:06:06.177765+0000","last_became_active":"2024-09-21T09:03:08.255274+0000","last_became_peered":"2024-09-21T09:03:08.255274+0000","last_unstale":"2024-09-21T09:06:06.177765+0000","last_undegraded":"2024-09-21T09:06:06.177765+0000","last_fullsized":"2024-09-21T09:06:06.177765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:12.962973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'4","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173759+0000","last_change":"2024-09-21T09:03:00.216751+0000","last_active":"2024-09-21T09:06:06.173759+0000","last_peered":"2024-09-21T09:06:06.173759+0000","last_clean":"2024-09-21T09:06:06.173759+0000","last_became_active":"2024-09-21T09:03:00.216382+0000","last_became_peered":"2024-09-21T09:03:00.216382+0000","last_unstale":"2024-09-21T09:06:06.173759+0000","last_undegraded":"2024-09-21T09:06:06.173759+0000","last_fullsized":"2024-09-21T09:06:06.173759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:06.215821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273477+0000","last_change":"2024-09-21T09:02:58.210831+0000","last_active":"2024-09-21T09:03:38.273477+0000","last_peered":"2024-09-21T09:03:38.273477+0000","last_clean":"2024-09-21T09:03:38.273477+0000","last_became_active":"2024-09-21T09:02:58.210560+0000","last_became_peered":"2024-09-21T09:02:58.210560+0000","last_unstale":"2024-09-21T09:03:38.273477+0000","last_undegraded":"2024-09-21T09:03:38.273477+0000","last_fullsized":"2024-09-21T09:03:38.273477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:12.355792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274957+0000","last_change":"2024-09-21T09:03:02.221778+0000","last_active":"2024-09-21T09:03:38.274957+0000","last_peered":"2024-09-21T09:03:38.274957+0000","last_clean":"2024-09-21T09:03:38.274957+0000","last_became_active":"2024-09-21T09:03:02.220551+0000","last_became_peered":"2024-09-21T09:03:02.220551+0000","last_unstale":"2024-09-21T09:03:38.274957+0000","last_undegraded":"2024-09-21T09:03:38.274957+0000","last_fullsized":"2024-09-21T09:03:38.274957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:46.255807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.346241+0000","last_change":"2024-09-21T09:03:04.234165+0000","last_active":"2024-09-21T09:05:04.346241+0000","last_peered":"2024-09-21T09:05:04.346241+0000","last_clean":"2024-09-21T09:05:04.346241+0000","last_became_active":"2024-09-21T09:03:04.233848+0000","last_became_peered":"2024-09-21T09:03:04.233848+0000","last_unstale":"2024-09-21T09:05:04.346241+0000","last_undegraded":"2024-09-21T09:05:04.346241+0000","last_fullsized":"2024-09-21T09:05:04.346241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:09.138690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'282","reported_seq":400,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.366462+0000","last_change":"2024-09-21T09:03:06.244195+0000","last_active":"2024-09-21T09:06:06.366462+0000","last_peered":"2024-09-21T09:06:06.366462+0000","last_clean":"2024-09-21T09:06:06.366462+0000","last_became_active":"2024-09-21T09:03:06.243576+0000","last_became_peered":"2024-09-21T09:03:06.243576+0000","last_unstale":"2024-09-21T09:06:06.366462+0000","last_undegraded":"2024-09-21T09:06:06.366462+0000","last_fullsized":"2024-09-21T09:06:06.366462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:31.080527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271245+0000","last_change":"2024-09-21T09:03:00.217801+0000","last_active":"2024-09-21T09:03:38.271245+0000","last_peered":"2024-09-21T09:03:38.271245+0000","last_clean":"2024-09-21T09:03:38.271245+0000","last_became_active":"2024-09-21T09:03:00.217545+0000","last_became_peered":"2024-09-21T09:03:00.217545+0000","last_unstale":"2024-09-21T09:03:38.271245+0000","last_undegraded":"2024-09-21T09:03:38.271245+0000","last_fullsized":"2024-09-21T09:03:38.271245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:43.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.281094+0000","last_change":"2024-09-21T09:02:58.209991+0000","last_active":"2024-09-21T09:03:38.281094+0000","last_peered":"2024-09-21T09:03:38.281094+0000","last_clean":"2024-09-21T09:03:38.281094+0000","last_became_active":"2024-09-21T09:02:58.209712+0000","last_became_peered":"2024-09-21T09:02:58.209712+0000","last_unstale":"2024-09-21T09:03:38.281094+0000","last_undegraded":"2024-09-21T09:03:38.281094+0000","last_fullsized":"2024-09-21T09:03:38.281094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:25.409736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"22'1","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.388071+0000","last_change":"2024-09-21T09:03:02.220925+0000","last_active":"2024-09-21T09:05:05.388071+0000","last_peered":"2024-09-21T09:05:05.388071+0000","last_clean":"2024-09-21T09:05:05.388071+0000","last_became_active":"2024-09-21T09:03:02.220629+0000","last_became_peered":"2024-09-21T09:03:02.220629+0000","last_unstale":"2024-09-21T09:05:05.388071+0000","last_undegraded":"2024-09-21T09:05:05.388071+0000","last_fullsized":"2024-09-21T09:05:05.388071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:32.066319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'40","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.355437+0000","last_change":"2024-09-21T09:03:04.232877+0000","last_active":"2024-09-21T09:05:04.355437+0000","last_peered":"2024-09-21T09:05:04.355437+0000","last_clean":"2024-09-21T09:05:04.355437+0000","last_became_active":"2024-09-21T09:03:04.232394+0000","last_became_peered":"2024-09-21T09:03:04.232394+0000","last_unstale":"2024-09-21T09:05:04.355437+0000","last_undegraded":"2024-09-21T09:05:04.355437+0000","last_fullsized":"2024-09-21T09:05:04.355437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:29.659990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464295+0000","last_change":"2024-09-21T09:03:06.244547+0000","last_active":"2024-09-21T09:03:38.464295+0000","last_peered":"2024-09-21T09:03:38.464295+0000","last_clean":"2024-09-21T09:03:38.464295+0000","last_became_active":"2024-09-21T09:03:06.244259+0000","last_became_peered":"2024-09-21T09:03:06.244259+0000","last_unstale":"2024-09-21T09:03:38.464295+0000","last_undegraded":"2024-09-21T09:03:38.464295+0000","last_fullsized":"2024-09-21T09:03:38.464295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:41.912327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.079455+0000","last_change":"2024-09-21T09:03:08.261530+0000","last_active":"2024-09-21T09:04:22.079455+0000","last_peered":"2024-09-21T09:04:22.079455+0000","last_clean":"2024-09-21T09:04:22.079455+0000","last_became_active":"2024-09-21T09:03:08.261035+0000","last_became_peered":"2024-09-21T09:03:08.261035+0000","last_unstale":"2024-09-21T09:04:22.079455+0000","last_undegraded":"2024-09-21T09:04:22.079455+0000","last_fullsized":"2024-09-21T09:04:22.079455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:03.684978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273196+0000","last_change":"2024-09-21T09:03:00.220087+0000","last_active":"2024-09-21T09:03:38.273196+0000","last_peered":"2024-09-21T09:03:38.273196+0000","last_clean":"2024-09-21T09:03:38.273196+0000","last_became_active":"2024-09-21T09:03:00.219765+0000","last_became_peered":"2024-09-21T09:03:00.219765+0000","last_unstale":"2024-09-21T09:03:38.273196+0000","last_undegraded":"2024-09-21T09:03:38.273196+0000","last_fullsized":"2024-09-21T09:03:38.273196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:52:42.557402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276119+0000","last_change":"2024-09-21T09:02:58.214776+0000","last_active":"2024-09-21T09:03:38.276119+0000","last_peered":"2024-09-21T09:03:38.276119+0000","last_clean":"2024-09-21T09:03:38.276119+0000","last_became_active":"2024-09-21T09:02:58.214392+0000","last_became_peered":"2024-09-21T09:02:58.214392+0000","last_unstale":"2024-09-21T09:03:38.276119+0000","last_undegraded":"2024-09-21T09:03:38.276119+0000","last_fullsized":"2024-09-21T09:03:38.276119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:24.399035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463904+0000","last_change":"2024-09-21T09:03:02.223499+0000","last_active":"2024-09-21T09:03:38.463904+0000","last_peered":"2024-09-21T09:03:38.463904+0000","last_clean":"2024-09-21T09:03:38.463904+0000","last_became_active":"2024-09-21T09:03:02.223123+0000","last_became_peered":"2024-09-21T09:03:02.223123+0000","last_unstale":"2024-09-21T09:03:38.463904+0000","last_undegraded":"2024-09-21T09:03:38.463904+0000","last_fullsized":"2024-09-21T09:03:38.463904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:16.103189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.336328+0000","last_change":"2024-09-21T09:03:04.242739+0000","last_active":"2024-09-21T09:05:04.336328+0000","last_peered":"2024-09-21T09:05:04.336328+0000","last_clean":"2024-09-21T09:05:04.336328+0000","last_became_active":"2024-09-21T09:03:04.242404+0000","last_became_peered":"2024-09-21T09:03:04.242404+0000","last_unstale":"2024-09-21T09:05:04.336328+0000","last_undegraded":"2024-09-21T09:05:04.336328+0000","last_fullsized":"2024-09-21T09:05:04.336328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:55.151013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463723+0000","last_change":"2024-09-21T09:03:06.248256+0000","last_active":"2024-09-21T09:03:38.463723+0000","last_peered":"2024-09-21T09:03:38.463723+0000","last_clean":"2024-09-21T09:03:38.463723+0000","last_became_active":"2024-09-21T09:03:06.247504+0000","last_became_peered":"2024-09-21T09:03:06.247504+0000","last_unstale":"2024-09-21T09:03:38.463723+0000","last_undegraded":"2024-09-21T09:03:38.463723+0000","last_fullsized":"2024-09-21T09:03:38.463723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:25.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'3","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:16.565423+0000","last_change":"2024-09-21T09:03:08.256372+0000","last_active":"2024-09-21T09:04:16.565423+0000","last_peered":"2024-09-21T09:04:16.565423+0000","last_clean":"2024-09-21T09:04:16.565423+0000","last_became_active":"2024-09-21T09:03:08.255814+0000","last_became_peered":"2024-09-21T09:03:08.255814+0000","last_unstale":"2024-09-21T09:04:16.565423+0000","last_undegraded":"2024-09-21T09:04:16.565423+0000","last_fullsized":"2024-09-21T09:04:16.565423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:46.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273220+0000","last_change":"2024-09-21T09:03:00.223110+0000","last_active":"2024-09-21T09:03:38.273220+0000","last_peered":"2024-09-21T09:03:38.273220+0000","last_clean":"2024-09-21T09:03:38.273220+0000","last_became_active":"2024-09-21T09:03:00.222650+0000","last_became_peered":"2024-09-21T09:03:00.222650+0000","last_unstale":"2024-09-21T09:03:38.273220+0000","last_undegraded":"2024-09-21T09:03:38.273220+0000","last_fullsized":"2024-09-21T09:03:38.273220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:12.697444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278305+0000","last_change":"2024-09-21T09:02:58.213931+0000","last_active":"2024-09-21T09:03:38.278305+0000","last_peered":"2024-09-21T09:03:38.278305+0000","last_clean":"2024-09-21T09:03:38.278305+0000","last_became_active":"2024-09-21T09:02:58.213652+0000","last_became_peered":"2024-09-21T09:02:58.213652+0000","last_unstale":"2024-09-21T09:03:38.278305+0000","last_undegraded":"2024-09-21T09:03:38.278305+0000","last_fullsized":"2024-09-21T09:03:38.278305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:27.612761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.282682+0000","last_change":"2024-09-21T09:03:38.281879+0000","last_active":"2024-09-21T09:03:38.282682+0000","last_peered":"2024-09-21T09:03:38.282682+0000","last_clean":"2024-09-21T09:03:38.282682+0000","last_became_active":"2024-09-21T09:03:38.281497+0000","last_became_peered":"2024-09-21T09:03:38.281497+0000","last_unstale":"2024-09-21T09:03:38.282682+0000","last_undegraded":"2024-09-21T09:03:38.282682+0000","last_fullsized":"2024-09-21T09:03:38.282682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:32.826730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.357293+0000","last_change":"2024-09-21T09:03:04.240985+0000","last_active":"2024-09-21T09:05:04.357293+0000","last_peered":"2024-09-21T09:05:04.357293+0000","last_clean":"2024-09-21T09:05:04.357293+0000","last_became_active":"2024-09-21T09:03:04.240144+0000","last_became_peered":"2024-09-21T09:03:04.240144+0000","last_unstale":"2024-09-21T09:05:04.357293+0000","last_undegraded":"2024-09-21T09:05:04.357293+0000","last_fullsized":"2024-09-21T09:05:04.357293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:09.558749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'282","reported_seq":347,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.478440+0000","last_change":"2024-09-21T09:03:06.251119+0000","last_active":"2024-09-21T09:06:06.478440+0000","last_peered":"2024-09-21T09:06:06.478440+0000","last_clean":"2024-09-21T09:06:06.478440+0000","last_became_active":"2024-09-21T09:03:06.250807+0000","last_became_peered":"2024-09-21T09:03:06.250807+0000","last_unstale":"2024-09-21T09:06:06.478440+0000","last_undegraded":"2024-09-21T09:06:06.478440+0000","last_fullsized":"2024-09-21T09:06:06.478440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:37.402801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465087+0000","last_change":"2024-09-21T09:03:08.250308+0000","last_active":"2024-09-21T09:03:38.465087+0000","last_peered":"2024-09-21T09:03:38.465087+0000","last_clean":"2024-09-21T09:03:38.465087+0000","last_became_active":"2024-09-21T09:03:08.250063+0000","last_became_peered":"2024-09-21T09:03:08.250063+0000","last_unstale":"2024-09-21T09:03:38.465087+0000","last_undegraded":"2024-09-21T09:03:38.465087+0000","last_fullsized":"2024-09-21T09:03:38.465087+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:16.323766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.082622+0000","last_change":"2024-09-21T09:03:00.217929+0000","last_active":"2024-09-21T09:06:06.082622+0000","last_peered":"2024-09-21T09:06:06.082622+0000","last_clean":"2024-09-21T09:06:06.082622+0000","last_became_active":"2024-09-21T09:03:00.216544+0000","last_became_peered":"2024-09-21T09:03:00.216544+0000","last_unstale":"2024-09-21T09:06:06.082622+0000","last_undegraded":"2024-09-21T09:06:06.082622+0000","last_fullsized":"2024-09-21T09:06:06.082622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.852495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.836403+0000","last_change":"2024-09-21T09:02:58.224993+0000","last_active":"2024-09-21T09:03:39.836403+0000","last_peered":"2024-09-21T09:03:39.836403+0000","last_clean":"2024-09-21T09:03:39.836403+0000","last_became_active":"2024-09-21T09:02:58.224675+0000","last_became_peered":"2024-09-21T09:02:58.224675+0000","last_unstale":"2024-09-21T09:03:39.836403+0000","last_undegraded":"2024-09-21T09:03:39.836403+0000","last_fullsized":"2024-09-21T09:03:39.836403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:29.937663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464221+0000","last_change":"2024-09-21T09:03:02.223199+0000","last_active":"2024-09-21T09:03:38.464221+0000","last_peered":"2024-09-21T09:03:38.464221+0000","last_clean":"2024-09-21T09:03:38.464221+0000","last_became_active":"2024-09-21T09:03:02.222904+0000","last_became_peered":"2024-09-21T09:03:02.222904+0000","last_unstale":"2024-09-21T09:03:38.464221+0000","last_undegraded":"2024-09-21T09:03:38.464221+0000","last_fullsized":"2024-09-21T09:03:38.464221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:23.601280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'56","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.359132+0000","last_change":"2024-09-21T09:03:04.241974+0000","last_active":"2024-09-21T09:05:04.359132+0000","last_peered":"2024-09-21T09:05:04.359132+0000","last_clean":"2024-09-21T09:05:04.359132+0000","last_became_active":"2024-09-21T09:03:04.241679+0000","last_became_peered":"2024-09-21T09:03:04.241679+0000","last_unstale":"2024-09-21T09:05:04.359132+0000","last_undegraded":"2024-09-21T09:05:04.359132+0000","last_fullsized":"2024-09-21T09:05:04.359132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:49.529992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463737+0000","last_change":"2024-09-21T09:03:06.249590+0000","last_active":"2024-09-21T09:03:38.463737+0000","last_peered":"2024-09-21T09:03:38.463737+0000","last_clean":"2024-09-21T09:03:38.463737+0000","last_became_active":"2024-09-21T09:03:06.249377+0000","last_became_peered":"2024-09-21T09:03:06.249377+0000","last_unstale":"2024-09-21T09:03:38.463737+0000","last_undegraded":"2024-09-21T09:03:38.463737+0000","last_fullsized":"2024-09-21T09:03:38.463737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:09.672283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'22","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.456034+0000","last_change":"2024-09-21T09:03:08.260431+0000","last_active":"2024-09-21T09:06:06.456034+0000","last_peered":"2024-09-21T09:06:06.456034+0000","last_clean":"2024-09-21T09:06:06.456034+0000","last_became_active":"2024-09-21T09:03:08.260071+0000","last_became_peered":"2024-09-21T09:03:08.260071+0000","last_unstale":"2024-09-21T09:06:06.456034+0000","last_undegraded":"2024-09-21T09:06:06.456034+0000","last_fullsized":"2024-09-21T09:06:06.456034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:44.917297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.301342+0000","last_change":"2024-09-21T09:03:00.223450+0000","last_active":"2024-09-21T09:03:39.301342+0000","last_peered":"2024-09-21T09:03:39.301342+0000","last_clean":"2024-09-21T09:03:39.301342+0000","last_became_active":"2024-09-21T09:03:00.223184+0000","last_became_peered":"2024-09-21T09:03:00.223184+0000","last_unstale":"2024-09-21T09:03:39.301342+0000","last_undegraded":"2024-09-21T09:03:39.301342+0000","last_fullsized":"2024-09-21T09:03:39.301342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:09.836796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464552+0000","last_change":"2024-09-21T09:02:58.216900+0000","last_active":"2024-09-21T09:03:38.464552+0000","last_peered":"2024-09-21T09:03:38.464552+0000","last_clean":"2024-09-21T09:03:38.464552+0000","last_became_active":"2024-09-21T09:02:58.216545+0000","last_became_peered":"2024-09-21T09:02:58.216545+0000","last_unstale":"2024-09-21T09:03:38.464552+0000","last_undegraded":"2024-09-21T09:03:38.464552+0000","last_fullsized":"2024-09-21T09:03:38.464552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:24.399035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274224+0000","last_change":"2024-09-21T09:03:02.221720+0000","last_active":"2024-09-21T09:03:38.274224+0000","last_peered":"2024-09-21T09:03:38.274224+0000","last_clean":"2024-09-21T09:03:38.274224+0000","last_became_active":"2024-09-21T09:03:02.221352+0000","last_became_peered":"2024-09-21T09:03:02.221352+0000","last_unstale":"2024-09-21T09:03:38.274224+0000","last_undegraded":"2024-09-21T09:03:38.274224+0000","last_fullsized":"2024-09-21T09:03:38.274224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:21.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'32","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.340441+0000","last_change":"2024-09-21T09:03:04.235060+0000","last_active":"2024-09-21T09:05:04.340441+0000","last_peered":"2024-09-21T09:05:04.340441+0000","last_clean":"2024-09-21T09:05:04.340441+0000","last_became_active":"2024-09-21T09:03:04.234750+0000","last_became_peered":"2024-09-21T09:03:04.234750+0000","last_unstale":"2024-09-21T09:05:04.340441+0000","last_undegraded":"2024-09-21T09:05:04.340441+0000","last_fullsized":"2024-09-21T09:05:04.340441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:38.551769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275928+0000","last_change":"2024-09-21T09:03:06.248717+0000","last_active":"2024-09-21T09:03:38.275928+0000","last_peered":"2024-09-21T09:03:38.275928+0000","last_clean":"2024-09-21T09:03:38.275928+0000","last_became_active":"2024-09-21T09:03:06.248453+0000","last_became_peered":"2024-09-21T09:03:06.248453+0000","last_unstale":"2024-09-21T09:03:38.275928+0000","last_undegraded":"2024-09-21T09:03:38.275928+0000","last_fullsized":"2024-09-21T09:03:38.275928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.976812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458033+0000","last_change":"2024-09-21T09:03:08.260732+0000","last_active":"2024-09-21T09:05:08.458033+0000","last_peered":"2024-09-21T09:05:08.458033+0000","last_clean":"2024-09-21T09:05:08.458033+0000","last_became_active":"2024-09-21T09:03:08.260016+0000","last_became_peered":"2024-09-21T09:03:08.260016+0000","last_unstale":"2024-09-21T09:05:08.458033+0000","last_undegraded":"2024-09-21T09:05:08.458033+0000","last_fullsized":"2024-09-21T09:05:08.458033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:07.434714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'10","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363142+0000","last_change":"2024-09-21T09:03:00.221963+0000","last_active":"2024-09-21T09:06:06.363142+0000","last_peered":"2024-09-21T09:06:06.363142+0000","last_clean":"2024-09-21T09:06:06.363142+0000","last_became_active":"2024-09-21T09:03:00.220384+0000","last_became_peered":"2024-09-21T09:03:00.220384+0000","last_unstale":"2024-09-21T09:06:06.363142+0000","last_undegraded":"2024-09-21T09:06:06.363142+0000","last_fullsized":"2024-09-21T09:06:06.363142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:49.615946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'6","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.843889+0000","last_change":"2024-09-21T09:02:58.214415+0000","last_active":"2024-09-21T09:03:39.843889+0000","last_peered":"2024-09-21T09:03:39.843889+0000","last_clean":"2024-09-21T09:03:39.843889+0000","last_became_active":"2024-09-21T09:02:58.213920+0000","last_became_peered":"2024-09-21T09:02:58.213920+0000","last_unstale":"2024-09-21T09:03:39.843889+0000","last_undegraded":"2024-09-21T09:03:39.843889+0000","last_fullsized":"2024-09-21T09:03:39.843889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:07:45.991079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466801+0000","last_change":"2024-09-21T09:03:02.220182+0000","last_active":"2024-09-21T09:03:38.466801+0000","last_peered":"2024-09-21T09:03:38.466801+0000","last_clean":"2024-09-21T09:03:38.466801+0000","last_became_active":"2024-09-21T09:03:02.217917+0000","last_became_peered":"2024-09-21T09:03:02.217917+0000","last_unstale":"2024-09-21T09:03:38.466801+0000","last_undegraded":"2024-09-21T09:03:38.466801+0000","last_fullsized":"2024-09-21T09:03:38.466801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:32.066319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'37","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.365768+0000","last_change":"2024-09-21T09:03:04.235643+0000","last_active":"2024-09-21T09:05:04.365768+0000","last_peered":"2024-09-21T09:05:04.365768+0000","last_clean":"2024-09-21T09:05:04.365768+0000","last_became_active":"2024-09-21T09:03:04.235199+0000","last_became_peered":"2024-09-21T09:03:04.235199+0000","last_unstale":"2024-09-21T09:05:04.365768+0000","last_undegraded":"2024-09-21T09:05:04.365768+0000","last_fullsized":"2024-09-21T09:05:04.365768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:18.113952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'282","reported_seq":402,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.460214+0000","last_change":"2024-09-21T09:03:06.246155+0000","last_active":"2024-09-21T09:06:06.460214+0000","last_peered":"2024-09-21T09:06:06.460214+0000","last_clean":"2024-09-21T09:06:06.460214+0000","last_became_active":"2024-09-21T09:03:06.245904+0000","last_became_peered":"2024-09-21T09:03:06.245904+0000","last_unstale":"2024-09-21T09:06:06.460214+0000","last_undegraded":"2024-09-21T09:06:06.460214+0000","last_fullsized":"2024-09-21T09:06:06.460214+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:51.831002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.454513+0000","last_change":"2024-09-21T09:03:08.253968+0000","last_active":"2024-09-21T09:05:12.454513+0000","last_peered":"2024-09-21T09:05:12.454513+0000","last_clean":"2024-09-21T09:05:12.454513+0000","last_became_active":"2024-09-21T09:03:08.253648+0000","last_became_peered":"2024-09-21T09:03:08.253648+0000","last_unstale":"2024-09-21T09:05:12.454513+0000","last_undegraded":"2024-09-21T09:05:12.454513+0000","last_fullsized":"2024-09-21T09:05:12.454513+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:56.641003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'5","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304375+0000","last_change":"2024-09-21T09:03:00.225003+0000","last_active":"2024-09-21T09:06:06.304375+0000","last_peered":"2024-09-21T09:06:06.304375+0000","last_clean":"2024-09-21T09:06:06.304375+0000","last_became_active":"2024-09-21T09:03:00.222983+0000","last_became_peered":"2024-09-21T09:03:00.222983+0000","last_unstale":"2024-09-21T09:06:06.304375+0000","last_undegraded":"2024-09-21T09:06:06.304375+0000","last_fullsized":"2024-09-21T09:06:06.304375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:24.133336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.838971+0000","last_change":"2024-09-21T09:02:58.222294+0000","last_active":"2024-09-21T09:03:39.838971+0000","last_peered":"2024-09-21T09:03:39.838971+0000","last_clean":"2024-09-21T09:03:39.838971+0000","last_became_active":"2024-09-21T09:02:58.221805+0000","last_became_peered":"2024-09-21T09:02:58.221805+0000","last_unstale":"2024-09-21T09:03:39.838971+0000","last_undegraded":"2024-09-21T09:03:39.838971+0000","last_fullsized":"2024-09-21T09:03:39.838971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:53.268716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'3","reported_seq":413,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.387757+0000","last_change":"2024-09-21T09:03:02.222283+0000","last_active":"2024-09-21T09:05:05.387757+0000","last_peered":"2024-09-21T09:05:05.387757+0000","last_clean":"2024-09-21T09:05:05.387757+0000","last_became_active":"2024-09-21T09:03:02.222002+0000","last_became_peered":"2024-09-21T09:03:02.222002+0000","last_unstale":"2024-09-21T09:05:05.387757+0000","last_undegraded":"2024-09-21T09:05:05.387757+0000","last_fullsized":"2024-09-21T09:05:05.387757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:32.909484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275507+0000","last_change":"2024-09-21T09:03:04.243079+0000","last_active":"2024-09-21T09:03:38.275507+0000","last_peered":"2024-09-21T09:03:38.275507+0000","last_clean":"2024-09-21T09:03:38.275507+0000","last_became_active":"2024-09-21T09:03:04.242702+0000","last_became_peered":"2024-09-21T09:03:04.242702+0000","last_unstale":"2024-09-21T09:03:38.275507+0000","last_undegraded":"2024-09-21T09:03:38.275507+0000","last_fullsized":"2024-09-21T09:03:38.275507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:02.620013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'282","reported_seq":464,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.417369+0000","last_change":"2024-09-21T09:03:06.249279+0000","last_active":"2024-09-21T09:06:06.417369+0000","last_peered":"2024-09-21T09:06:06.417369+0000","last_clean":"2024-09-21T09:06:06.417369+0000","last_became_active":"2024-09-21T09:03:06.248991+0000","last_became_peered":"2024-09-21T09:03:06.248991+0000","last_unstale":"2024-09-21T09:06:06.417369+0000","last_undegraded":"2024-09-21T09:06:06.417369+0000","last_fullsized":"2024-09-21T09:06:06.417369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.466336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.511263+0000","last_change":"2024-09-21T09:03:08.252929+0000","last_active":"2024-09-21T09:05:05.511263+0000","last_peered":"2024-09-21T09:05:05.511263+0000","last_clean":"2024-09-21T09:05:05.511263+0000","last_became_active":"2024-09-21T09:03:08.252549+0000","last_became_peered":"2024-09-21T09:03:08.252549+0000","last_unstale":"2024-09-21T09:05:05.511263+0000","last_undegraded":"2024-09-21T09:05:05.511263+0000","last_fullsized":"2024-09-21T09:05:05.511263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:41.286037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260844+0000","last_change":"2024-09-21T09:03:00.223988+0000","last_active":"2024-09-21T09:06:06.260844+0000","last_peered":"2024-09-21T09:06:06.260844+0000","last_clean":"2024-09-21T09:06:06.260844+0000","last_became_active":"2024-09-21T09:03:00.223719+0000","last_became_peered":"2024-09-21T09:03:00.223719+0000","last_unstale":"2024-09-21T09:06:06.260844+0000","last_undegraded":"2024-09-21T09:06:06.260844+0000","last_fullsized":"2024-09-21T09:06:06.260844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:03.610091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270492+0000","last_change":"2024-09-21T09:02:58.214335+0000","last_active":"2024-09-21T09:03:38.270492+0000","last_peered":"2024-09-21T09:03:38.270492+0000","last_clean":"2024-09-21T09:03:38.270492+0000","last_became_active":"2024-09-21T09:02:58.214074+0000","last_became_peered":"2024-09-21T09:02:58.214074+0000","last_unstale":"2024-09-21T09:03:38.270492+0000","last_undegraded":"2024-09-21T09:03:38.270492+0000","last_fullsized":"2024-09-21T09:03:38.270492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:11.076844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274721+0000","last_change":"2024-09-21T09:03:02.222570+0000","last_active":"2024-09-21T09:03:38.274721+0000","last_peered":"2024-09-21T09:03:38.274721+0000","last_clean":"2024-09-21T09:03:38.274721+0000","last_became_active":"2024-09-21T09:03:02.222095+0000","last_became_peered":"2024-09-21T09:03:02.222095+0000","last_unstale":"2024-09-21T09:03:38.274721+0000","last_undegraded":"2024-09-21T09:03:38.274721+0000","last_fullsized":"2024-09-21T09:03:38.274721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:31.855727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'38","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.352351+0000","last_change":"2024-09-21T09:03:04.236005+0000","last_active":"2024-09-21T09:05:04.352351+0000","last_peered":"2024-09-21T09:05:04.352351+0000","last_clean":"2024-09-21T09:05:04.352351+0000","last_became_active":"2024-09-21T09:03:04.235633+0000","last_became_peered":"2024-09-21T09:03:04.235633+0000","last_unstale":"2024-09-21T09:05:04.352351+0000","last_undegraded":"2024-09-21T09:05:04.352351+0000","last_fullsized":"2024-09-21T09:05:04.352351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:15.434978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275944+0000","last_change":"2024-09-21T09:03:06.248328+0000","last_active":"2024-09-21T09:03:38.275944+0000","last_peered":"2024-09-21T09:03:38.275944+0000","last_clean":"2024-09-21T09:03:38.275944+0000","last_became_active":"2024-09-21T09:03:06.247977+0000","last_became_peered":"2024-09-21T09:03:06.247977+0000","last_unstale":"2024-09-21T09:03:38.275944+0000","last_undegraded":"2024-09-21T09:03:38.275944+0000","last_fullsized":"2024-09-21T09:03:38.275944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:30.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.395329+0000","last_change":"2024-09-21T09:03:08.252270+0000","last_active":"2024-09-21T09:06:06.395329+0000","last_peered":"2024-09-21T09:06:06.395329+0000","last_clean":"2024-09-21T09:06:06.395329+0000","last_became_active":"2024-09-21T09:03:08.251985+0000","last_became_peered":"2024-09-21T09:03:08.251985+0000","last_unstale":"2024-09-21T09:06:06.395329+0000","last_undegraded":"2024-09-21T09:06:06.395329+0000","last_fullsized":"2024-09-21T09:06:06.395329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:21.302376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.082284+0000","last_change":"2024-09-21T09:03:00.221674+0000","last_active":"2024-09-21T09:06:06.082284+0000","last_peered":"2024-09-21T09:06:06.082284+0000","last_clean":"2024-09-21T09:06:06.082284+0000","last_became_active":"2024-09-21T09:03:00.219428+0000","last_became_peered":"2024-09-21T09:03:00.219428+0000","last_unstale":"2024-09-21T09:06:06.082284+0000","last_undegraded":"2024-09-21T09:06:06.082284+0000","last_fullsized":"2024-09-21T09:06:06.082284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:12.568235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":201,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273328+0000","last_change":"2024-09-21T09:02:44.107999+0000","last_active":"2024-09-21T09:03:38.273328+0000","last_peered":"2024-09-21T09:03:38.273328+0000","last_clean":"2024-09-21T09:03:38.273328+0000","last_became_active":"2024-09-21T09:02:44.107052+0000","last_became_peered":"2024-09-21T09:02:44.107052+0000","last_unstale":"2024-09-21T09:03:38.273328+0000","last_undegraded":"2024-09-21T09:03:38.273328+0000","last_fullsized":"2024-09-21T09:03:38.273328+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_clean_scrub_stamp":"2024-09-21T09:02:42.466256+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:10.291354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273506+0000","last_change":"2024-09-21T09:02:51.501401+0000","last_active":"2024-09-21T09:03:38.273506+0000","last_peered":"2024-09-21T09:03:38.273506+0000","last_clean":"2024-09-21T09:03:38.273506+0000","last_became_active":"2024-09-21T09:02:49.492504+0000","last_became_peered":"2024-09-21T09:02:49.492504+0000","last_unstale":"2024-09-21T09:03:38.273506+0000","last_undegraded":"2024-09-21T09:03:38.273506+0000","last_fullsized":"2024-09-21T09:03:38.273506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:33.286003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001229291,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271282+0000","last_change":"2024-09-21T09:02:58.222148+0000","last_active":"2024-09-21T09:03:38.271282+0000","last_peered":"2024-09-21T09:03:38.271282+0000","last_clean":"2024-09-21T09:03:38.271282+0000","last_became_active":"2024-09-21T09:02:58.221874+0000","last_became_peered":"2024-09-21T09:02:58.221874+0000","last_unstale":"2024-09-21T09:03:38.271282+0000","last_undegraded":"2024-09-21T09:03:38.271282+0000","last_fullsized":"2024-09-21T09:03:38.271282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:41.404620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.281164+0000","last_change":"2024-09-21T09:03:38.280004+0000","last_active":"2024-09-21T09:03:38.281164+0000","last_peered":"2024-09-21T09:03:38.281164+0000","last_clean":"2024-09-21T09:03:38.281164+0000","last_became_active":"2024-09-21T09:03:38.279694+0000","last_became_peered":"2024-09-21T09:03:38.279694+0000","last_unstale":"2024-09-21T09:03:38.281164+0000","last_undegraded":"2024-09-21T09:03:38.281164+0000","last_fullsized":"2024-09-21T09:03:38.281164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:16.786252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'76","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.363557+0000","last_change":"2024-09-21T09:03:04.240626+0000","last_active":"2024-09-21T09:05:04.363557+0000","last_peered":"2024-09-21T09:05:04.363557+0000","last_clean":"2024-09-21T09:05:04.363557+0000","last_became_active":"2024-09-21T09:03:04.240327+0000","last_became_peered":"2024-09-21T09:03:04.240327+0000","last_unstale":"2024-09-21T09:05:04.363557+0000","last_undegraded":"2024-09-21T09:05:04.363557+0000","last_fullsized":"2024-09-21T09:05:04.363557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:19.716984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465984+0000","last_change":"2024-09-21T09:03:06.247919+0000","last_active":"2024-09-21T09:03:38.465984+0000","last_peered":"2024-09-21T09:03:38.465984+0000","last_clean":"2024-09-21T09:03:38.465984+0000","last_became_active":"2024-09-21T09:03:06.247593+0000","last_became_peered":"2024-09-21T09:03:06.247593+0000","last_unstale":"2024-09-21T09:03:38.465984+0000","last_undegraded":"2024-09-21T09:03:38.465984+0000","last_fullsized":"2024-09-21T09:03:38.465984+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:56.554312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'83","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.373253+0000","last_change":"2024-09-21T09:03:08.251766+0000","last_active":"2024-09-21T09:06:06.373253+0000","last_peered":"2024-09-21T09:06:06.373253+0000","last_clean":"2024-09-21T09:06:06.373253+0000","last_became_active":"2024-09-21T09:03:08.251416+0000","last_became_peered":"2024-09-21T09:03:08.251416+0000","last_unstale":"2024-09-21T09:06:06.373253+0000","last_undegraded":"2024-09-21T09:06:06.373253+0000","last_fullsized":"2024-09-21T09:06:06.373253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:43.892525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.711324+0000","last_change":"2024-09-21T09:03:00.217299+0000","last_active":"2024-09-21T09:05:02.711324+0000","last_peered":"2024-09-21T09:05:02.711324+0000","last_clean":"2024-09-21T09:05:02.711324+0000","last_became_active":"2024-09-21T09:03:00.217018+0000","last_became_peered":"2024-09-21T09:03:00.217018+0000","last_unstale":"2024-09-21T09:05:02.711324+0000","last_undegraded":"2024-09-21T09:05:02.711324+0000","last_fullsized":"2024-09-21T09:05:02.711324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:26.810823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270854+0000","last_change":"2024-09-21T09:02:51.500609+0000","last_active":"2024-09-21T09:03:38.270854+0000","last_peered":"2024-09-21T09:03:38.270854+0000","last_clean":"2024-09-21T09:03:38.270854+0000","last_became_active":"2024-09-21T09:02:49.493239+0000","last_became_peered":"2024-09-21T09:02:49.493239+0000","last_unstale":"2024-09-21T09:03:38.270854+0000","last_undegraded":"2024-09-21T09:03:38.270854+0000","last_fullsized":"2024-09-21T09:03:38.270854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:46.489803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046437600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464127+0000","last_change":"2024-09-21T09:02:58.209258+0000","last_active":"2024-09-21T09:03:38.464127+0000","last_peered":"2024-09-21T09:03:38.464127+0000","last_clean":"2024-09-21T09:03:38.464127+0000","last_became_active":"2024-09-21T09:02:58.208819+0000","last_became_peered":"2024-09-21T09:02:58.208819+0000","last_unstale":"2024-09-21T09:03:38.464127+0000","last_undegraded":"2024-09-21T09:03:38.464127+0000","last_fullsized":"2024-09-21T09:03:38.464127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:08.728738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277167+0000","last_change":"2024-09-21T09:03:02.221203+0000","last_active":"2024-09-21T09:03:38.277167+0000","last_peered":"2024-09-21T09:03:38.277167+0000","last_clean":"2024-09-21T09:03:38.277167+0000","last_became_active":"2024-09-21T09:03:02.220903+0000","last_became_peered":"2024-09-21T09:03:02.220903+0000","last_unstale":"2024-09-21T09:03:38.277167+0000","last_undegraded":"2024-09-21T09:03:38.277167+0000","last_fullsized":"2024-09-21T09:03:38.277167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:54.934676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'273","reported_seq":475,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:02.304493+0000","last_change":"2024-09-21T09:03:04.240716+0000","last_active":"2024-09-21T09:06:02.304493+0000","last_peered":"2024-09-21T09:06:02.304493+0000","last_clean":"2024-09-21T09:06:02.304493+0000","last_became_active":"2024-09-21T09:03:04.240433+0000","last_became_peered":"2024-09-21T09:03:04.240433+0000","last_unstale":"2024-09-21T09:06:02.304493+0000","last_undegraded":"2024-09-21T09:06:02.304493+0000","last_fullsized":"2024-09-21T09:06:02.304493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:45.460299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277557+0000","last_change":"2024-09-21T09:03:06.248226+0000","last_active":"2024-09-21T09:03:38.277557+0000","last_peered":"2024-09-21T09:03:38.277557+0000","last_clean":"2024-09-21T09:03:38.277557+0000","last_became_active":"2024-09-21T09:03:06.247746+0000","last_became_peered":"2024-09-21T09:03:06.247746+0000","last_unstale":"2024-09-21T09:03:38.277557+0000","last_undegraded":"2024-09-21T09:03:38.277557+0000","last_fullsized":"2024-09-21T09:03:38.277557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:39.299058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.300471+0000","last_change":"2024-09-21T09:03:08.259029+0000","last_active":"2024-09-21T09:06:06.300471+0000","last_peered":"2024-09-21T09:06:06.300471+0000","last_clean":"2024-09-21T09:06:06.300471+0000","last_became_active":"2024-09-21T09:03:08.258104+0000","last_became_peered":"2024-09-21T09:03:08.258104+0000","last_unstale":"2024-09-21T09:06:06.300471+0000","last_undegraded":"2024-09-21T09:06:06.300471+0000","last_fullsized":"2024-09-21T09:06:06.300471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:58.888309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465869+0000","last_change":"2024-09-21T09:03:00.227553+0000","last_active":"2024-09-21T09:03:38.465869+0000","last_peered":"2024-09-21T09:03:38.465869+0000","last_clean":"2024-09-21T09:03:38.465869+0000","last_became_active":"2024-09-21T09:03:00.227191+0000","last_became_peered":"2024-09-21T09:03:00.227191+0000","last_unstale":"2024-09-21T09:03:38.465869+0000","last_undegraded":"2024-09-21T09:03:38.465869+0000","last_fullsized":"2024-09-21T09:03:38.465869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:51.194693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272617+0000","last_change":"2024-09-21T09:02:51.506704+0000","last_active":"2024-09-21T09:03:38.272617+0000","last_peered":"2024-09-21T09:03:38.272617+0000","last_clean":"2024-09-21T09:03:38.272617+0000","last_became_active":"2024-09-21T09:02:49.493605+0000","last_became_peered":"2024-09-21T09:02:49.493605+0000","last_unstale":"2024-09-21T09:03:38.272617+0000","last_undegraded":"2024-09-21T09:03:38.272617+0000","last_fullsized":"2024-09-21T09:03:38.272617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:33.820022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033020199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463162+0000","last_change":"2024-09-21T09:02:58.209627+0000","last_active":"2024-09-21T09:03:38.463162+0000","last_peered":"2024-09-21T09:03:38.463162+0000","last_clean":"2024-09-21T09:03:38.463162+0000","last_became_active":"2024-09-21T09:02:58.209343+0000","last_became_peered":"2024-09-21T09:02:58.209343+0000","last_unstale":"2024-09-21T09:03:38.463162+0000","last_undegraded":"2024-09-21T09:03:38.463162+0000","last_fullsized":"2024-09-21T09:03:38.463162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:14.606085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276272+0000","last_change":"2024-09-21T09:03:02.219332+0000","last_active":"2024-09-21T09:03:38.276272+0000","last_peered":"2024-09-21T09:03:38.276272+0000","last_clean":"2024-09-21T09:03:38.276272+0000","last_became_active":"2024-09-21T09:03:02.219067+0000","last_became_peered":"2024-09-21T09:03:02.219067+0000","last_unstale":"2024-09-21T09:03:38.276272+0000","last_undegraded":"2024-09-21T09:03:38.276272+0000","last_fullsized":"2024-09-21T09:03:38.276272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:05.617526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'17","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.268634+0000","last_change":"2024-09-21T09:03:04.231010+0000","last_active":"2024-09-21T09:06:06.268634+0000","last_peered":"2024-09-21T09:06:06.268634+0000","last_clean":"2024-09-21T09:06:06.268634+0000","last_became_active":"2024-09-21T09:03:04.230686+0000","last_became_peered":"2024-09-21T09:03:04.230686+0000","last_unstale":"2024-09-21T09:06:06.268634+0000","last_undegraded":"2024-09-21T09:06:06.268634+0000","last_fullsized":"2024-09-21T09:06:06.268634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:25.612043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466265+0000","last_change":"2024-09-21T09:03:06.248379+0000","last_active":"2024-09-21T09:03:38.466265+0000","last_peered":"2024-09-21T09:03:38.466265+0000","last_clean":"2024-09-21T09:03:38.466265+0000","last_became_active":"2024-09-21T09:03:06.248087+0000","last_became_peered":"2024-09-21T09:03:06.248087+0000","last_unstale":"2024-09-21T09:03:38.466265+0000","last_undegraded":"2024-09-21T09:03:38.466265+0000","last_fullsized":"2024-09-21T09:03:38.466265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:23.429533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271393+0000","last_change":"2024-09-21T09:03:08.259295+0000","last_active":"2024-09-21T09:03:38.271393+0000","last_peered":"2024-09-21T09:03:38.271393+0000","last_clean":"2024-09-21T09:03:38.271393+0000","last_became_active":"2024-09-21T09:03:08.258974+0000","last_became_peered":"2024-09-21T09:03:08.258974+0000","last_unstale":"2024-09-21T09:03:38.271393+0000","last_undegraded":"2024-09-21T09:03:38.271393+0000","last_fullsized":"2024-09-21T09:03:38.271393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:23.850104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'7","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.182044+0000","last_change":"2024-09-21T09:03:00.221607+0000","last_active":"2024-09-21T09:06:06.182044+0000","last_peered":"2024-09-21T09:06:06.182044+0000","last_clean":"2024-09-21T09:06:06.182044+0000","last_became_active":"2024-09-21T09:03:00.221080+0000","last_became_peered":"2024-09-21T09:03:00.221080+0000","last_unstale":"2024-09-21T09:06:06.182044+0000","last_undegraded":"2024-09-21T09:06:06.182044+0000","last_fullsized":"2024-09-21T09:06:06.182044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:53.039369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271511+0000","last_change":"2024-09-21T09:02:51.501105+0000","last_active":"2024-09-21T09:03:38.271511+0000","last_peered":"2024-09-21T09:03:38.271511+0000","last_clean":"2024-09-21T09:03:38.271511+0000","last_became_active":"2024-09-21T09:02:49.493348+0000","last_became_peered":"2024-09-21T09:02:49.493348+0000","last_unstale":"2024-09-21T09:03:38.271511+0000","last_undegraded":"2024-09-21T09:03:38.271511+0000","last_fullsized":"2024-09-21T09:03:38.271511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:12.805512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096028300000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.279362+0000","last_change":"2024-09-21T09:02:58.207996+0000","last_active":"2024-09-21T09:03:38.279362+0000","last_peered":"2024-09-21T09:03:38.279362+0000","last_clean":"2024-09-21T09:03:38.279362+0000","last_became_active":"2024-09-21T09:02:58.207236+0000","last_became_peered":"2024-09-21T09:02:58.207236+0000","last_unstale":"2024-09-21T09:03:38.279362+0000","last_undegraded":"2024-09-21T09:03:38.279362+0000","last_fullsized":"2024-09-21T09:03:38.279362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:38.066496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465166+0000","last_change":"2024-09-21T09:03:02.221735+0000","last_active":"2024-09-21T09:03:38.465166+0000","last_peered":"2024-09-21T09:03:38.465166+0000","last_clean":"2024-09-21T09:03:38.465166+0000","last_became_active":"2024-09-21T09:03:02.221310+0000","last_became_peered":"2024-09-21T09:03:02.221310+0000","last_unstale":"2024-09-21T09:03:38.465166+0000","last_undegraded":"2024-09-21T09:03:38.465166+0000","last_fullsized":"2024-09-21T09:03:38.465166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:07.127926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'13","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.727672+0000","last_change":"2024-09-21T09:03:04.243723+0000","last_active":"2024-09-21T09:06:05.727672+0000","last_peered":"2024-09-21T09:06:05.727672+0000","last_clean":"2024-09-21T09:06:05.727672+0000","last_became_active":"2024-09-21T09:03:04.243076+0000","last_became_peered":"2024-09-21T09:03:04.243076+0000","last_unstale":"2024-09-21T09:06:05.727672+0000","last_undegraded":"2024-09-21T09:06:05.727672+0000","last_fullsized":"2024-09-21T09:06:05.727672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:19.628532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276013+0000","last_change":"2024-09-21T09:03:06.250792+0000","last_active":"2024-09-21T09:03:38.276013+0000","last_peered":"2024-09-21T09:03:38.276013+0000","last_clean":"2024-09-21T09:03:38.276013+0000","last_became_active":"2024-09-21T09:03:06.250530+0000","last_became_peered":"2024-09-21T09:03:06.250530+0000","last_unstale":"2024-09-21T09:03:38.276013+0000","last_undegraded":"2024-09-21T09:03:38.276013+0000","last_fullsized":"2024-09-21T09:03:38.276013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:33.277141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.492123+0000","last_change":"2024-09-21T09:03:08.262588+0000","last_active":"2024-09-21T09:05:05.492123+0000","last_peered":"2024-09-21T09:05:05.492123+0000","last_clean":"2024-09-21T09:05:05.492123+0000","last_became_active":"2024-09-21T09:03:08.262240+0000","last_became_peered":"2024-09-21T09:03:08.262240+0000","last_unstale":"2024-09-21T09:05:05.492123+0000","last_undegraded":"2024-09-21T09:05:05.492123+0000","last_fullsized":"2024-09-21T09:05:05.492123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:11.429927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363318+0000","last_change":"2024-09-21T09:03:00.227032+0000","last_active":"2024-09-21T09:06:06.363318+0000","last_peered":"2024-09-21T09:06:06.363318+0000","last_clean":"2024-09-21T09:06:06.363318+0000","last_became_active":"2024-09-21T09:03:00.224297+0000","last_became_peered":"2024-09-21T09:03:00.224297+0000","last_unstale":"2024-09-21T09:06:06.363318+0000","last_undegraded":"2024-09-21T09:06:06.363318+0000","last_fullsized":"2024-09-21T09:06:06.363318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:20.245983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274931+0000","last_change":"2024-09-21T09:02:58.207055+0000","last_active":"2024-09-21T09:03:38.274931+0000","last_peered":"2024-09-21T09:03:38.274931+0000","last_clean":"2024-09-21T09:03:38.274931+0000","last_became_active":"2024-09-21T09:02:58.206718+0000","last_became_peered":"2024-09-21T09:02:58.206718+0000","last_unstale":"2024-09-21T09:03:38.274931+0000","last_undegraded":"2024-09-21T09:03:38.274931+0000","last_fullsized":"2024-09-21T09:03:38.274931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:08.728738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466210+0000","last_change":"2024-09-21T09:02:51.498275+0000","last_active":"2024-09-21T09:03:38.466210+0000","last_peered":"2024-09-21T09:03:38.466210+0000","last_clean":"2024-09-21T09:03:38.466210+0000","last_became_active":"2024-09-21T09:02:49.493509+0000","last_became_peered":"2024-09-21T09:02:49.493509+0000","last_unstale":"2024-09-21T09:03:38.466210+0000","last_undegraded":"2024-09-21T09:03:38.466210+0000","last_fullsized":"2024-09-21T09:03:38.466210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:48.460775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038981200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453822+0000","last_change":"2024-09-21T09:03:02.221871+0000","last_active":"2024-09-21T09:05:07.453822+0000","last_peered":"2024-09-21T09:05:07.453822+0000","last_clean":"2024-09-21T09:05:07.453822+0000","last_became_active":"2024-09-21T09:03:02.221309+0000","last_became_peered":"2024-09-21T09:03:02.221309+0000","last_unstale":"2024-09-21T09:05:07.453822+0000","last_undegraded":"2024-09-21T09:05:07.453822+0000","last_fullsized":"2024-09-21T09:05:07.453822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:23.063609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'61","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453751+0000","last_change":"2024-09-21T09:03:04.243555+0000","last_active":"2024-09-21T09:05:07.453751+0000","last_peered":"2024-09-21T09:05:07.453751+0000","last_clean":"2024-09-21T09:05:07.453751+0000","last_became_active":"2024-09-21T09:03:04.243228+0000","last_became_peered":"2024-09-21T09:03:04.243228+0000","last_unstale":"2024-09-21T09:05:07.453751+0000","last_undegraded":"2024-09-21T09:05:07.453751+0000","last_fullsized":"2024-09-21T09:05:07.453751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:28.764693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272915+0000","last_change":"2024-09-21T09:03:06.246855+0000","last_active":"2024-09-21T09:03:38.272915+0000","last_peered":"2024-09-21T09:03:38.272915+0000","last_clean":"2024-09-21T09:03:38.272915+0000","last_became_active":"2024-09-21T09:03:06.246598+0000","last_became_peered":"2024-09-21T09:03:06.246598+0000","last_unstale":"2024-09-21T09:03:38.272915+0000","last_undegraded":"2024-09-21T09:03:38.272915+0000","last_fullsized":"2024-09-21T09:03:38.272915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:13.435386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.657366+0000","last_change":"2024-09-21T09:03:08.251063+0000","last_active":"2024-09-21T09:05:05.657366+0000","last_peered":"2024-09-21T09:05:05.657366+0000","last_clean":"2024-09-21T09:05:05.657366+0000","last_became_active":"2024-09-21T09:03:08.250714+0000","last_became_peered":"2024-09-21T09:03:08.250714+0000","last_unstale":"2024-09-21T09:05:05.657366+0000","last_undegraded":"2024-09-21T09:05:05.657366+0000","last_fullsized":"2024-09-21T09:05:05.657366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:01.596559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'10","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173544+0000","last_change":"2024-09-21T09:03:38.286969+0000","last_active":"2024-09-21T09:06:06.173544+0000","last_peered":"2024-09-21T09:06:06.173544+0000","last_clean":"2024-09-21T09:06:06.173544+0000","last_became_active":"2024-09-21T09:03:38.282889+0000","last_became_peered":"2024-09-21T09:03:38.282889+0000","last_unstale":"2024-09-21T09:06:06.173544+0000","last_undegraded":"2024-09-21T09:06:06.173544+0000","last_fullsized":"2024-09-21T09:06:06.173544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:56.518385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.752145+0000","last_change":"2024-09-21T09:02:58.208957+0000","last_active":"2024-09-21T09:03:38.752145+0000","last_peered":"2024-09-21T09:03:38.752145+0000","last_clean":"2024-09-21T09:03:38.752145+0000","last_became_active":"2024-09-21T09:02:58.208569+0000","last_became_peered":"2024-09-21T09:02:58.208569+0000","last_unstale":"2024-09-21T09:03:38.752145+0000","last_undegraded":"2024-09-21T09:03:38.752145+0000","last_fullsized":"2024-09-21T09:03:38.752145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:43:46.150242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278210+0000","last_change":"2024-09-21T09:02:51.501475+0000","last_active":"2024-09-21T09:03:38.278210+0000","last_peered":"2024-09-21T09:03:38.278210+0000","last_clean":"2024-09-21T09:03:38.278210+0000","last_became_active":"2024-09-21T09:02:49.493469+0000","last_became_peered":"2024-09-21T09:02:49.493469+0000","last_unstale":"2024-09-21T09:03:38.278210+0000","last_undegraded":"2024-09-21T09:03:38.278210+0000","last_fullsized":"2024-09-21T09:03:38.278210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:23.397410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001228114,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271668+0000","last_change":"2024-09-21T09:03:02.218570+0000","last_active":"2024-09-21T09:03:38.271668+0000","last_peered":"2024-09-21T09:03:38.271668+0000","last_clean":"2024-09-21T09:03:38.271668+0000","last_became_active":"2024-09-21T09:03:02.218232+0000","last_became_peered":"2024-09-21T09:03:02.218232+0000","last_unstale":"2024-09-21T09:03:38.271668+0000","last_undegraded":"2024-09-21T09:03:38.271668+0000","last_fullsized":"2024-09-21T09:03:38.271668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:18.210878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273881+0000","last_change":"2024-09-21T09:03:04.241792+0000","last_active":"2024-09-21T09:03:38.273881+0000","last_peered":"2024-09-21T09:03:38.273881+0000","last_clean":"2024-09-21T09:03:38.273881+0000","last_became_active":"2024-09-21T09:03:04.241500+0000","last_became_peered":"2024-09-21T09:03:04.241500+0000","last_unstale":"2024-09-21T09:03:38.273881+0000","last_undegraded":"2024-09-21T09:03:38.273881+0000","last_fullsized":"2024-09-21T09:03:38.273881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:13.085591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'282","reported_seq":354,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:02.304345+0000","last_change":"2024-09-21T09:03:06.249606+0000","last_active":"2024-09-21T09:06:02.304345+0000","last_peered":"2024-09-21T09:06:02.304345+0000","last_clean":"2024-09-21T09:06:02.304345+0000","last_became_active":"2024-09-21T09:03:06.249303+0000","last_became_peered":"2024-09-21T09:03:06.249303+0000","last_unstale":"2024-09-21T09:06:02.304345+0000","last_undegraded":"2024-09-21T09:06:02.304345+0000","last_fullsized":"2024-09-21T09:06:02.304345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.216872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275702+0000","last_change":"2024-09-21T09:03:08.264861+0000","last_active":"2024-09-21T09:03:38.275702+0000","last_peered":"2024-09-21T09:03:38.275702+0000","last_clean":"2024-09-21T09:03:38.275702+0000","last_became_active":"2024-09-21T09:03:08.264322+0000","last_became_peered":"2024-09-21T09:03:08.264322+0000","last_unstale":"2024-09-21T09:03:38.275702+0000","last_undegraded":"2024-09-21T09:03:38.275702+0000","last_fullsized":"2024-09-21T09:03:38.275702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:40.391041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.280043+0000","last_change":"2024-09-21T09:03:38.277961+0000","last_active":"2024-09-21T09:03:38.280043+0000","last_peered":"2024-09-21T09:03:38.280043+0000","last_clean":"2024-09-21T09:03:38.280043+0000","last_became_active":"2024-09-21T09:03:38.277629+0000","last_became_peered":"2024-09-21T09:03:38.277629+0000","last_unstale":"2024-09-21T09:03:38.280043+0000","last_undegraded":"2024-09-21T09:03:38.280043+0000","last_fullsized":"2024-09-21T09:03:38.280043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:59:16.786827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.670946+0000","last_change":"2024-09-21T09:02:58.223891+0000","last_active":"2024-09-21T09:05:05.670946+0000","last_peered":"2024-09-21T09:05:05.670946+0000","last_clean":"2024-09-21T09:05:05.670946+0000","last_became_active":"2024-09-21T09:02:58.223652+0000","last_became_peered":"2024-09-21T09:02:58.223652+0000","last_unstale":"2024-09-21T09:05:05.670946+0000","last_undegraded":"2024-09-21T09:05:05.670946+0000","last_fullsized":"2024-09-21T09:05:05.670946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:51.491682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465258+0000","last_change":"2024-09-21T09:02:51.498192+0000","last_active":"2024-09-21T09:03:38.465258+0000","last_peered":"2024-09-21T09:03:38.465258+0000","last_clean":"2024-09-21T09:03:38.465258+0000","last_became_active":"2024-09-21T09:02:49.493144+0000","last_became_peered":"2024-09-21T09:02:49.493144+0000","last_unstale":"2024-09-21T09:03:38.465258+0000","last_undegraded":"2024-09-21T09:03:38.465258+0000","last_fullsized":"2024-09-21T09:03:38.465258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:04.340866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042500699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271170+0000","last_change":"2024-09-21T09:03:02.219747+0000","last_active":"2024-09-21T09:03:38.271170+0000","last_peered":"2024-09-21T09:03:38.271170+0000","last_clean":"2024-09-21T09:03:38.271170+0000","last_became_active":"2024-09-21T09:03:02.219133+0000","last_became_peered":"2024-09-21T09:03:02.219133+0000","last_unstale":"2024-09-21T09:03:38.271170+0000","last_undegraded":"2024-09-21T09:03:38.271170+0000","last_fullsized":"2024-09-21T09:03:38.271170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:11.438389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273948+0000","last_change":"2024-09-21T09:03:04.241801+0000","last_active":"2024-09-21T09:03:38.273948+0000","last_peered":"2024-09-21T09:03:38.273948+0000","last_clean":"2024-09-21T09:03:38.273948+0000","last_became_active":"2024-09-21T09:03:04.241256+0000","last_became_peered":"2024-09-21T09:03:04.241256+0000","last_unstale":"2024-09-21T09:03:38.273948+0000","last_undegraded":"2024-09-21T09:03:38.273948+0000","last_fullsized":"2024-09-21T09:03:38.273948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:52.487954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'282","reported_seq":428,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.456684+0000","last_change":"2024-09-21T09:03:06.244206+0000","last_active":"2024-09-21T09:06:06.456684+0000","last_peered":"2024-09-21T09:06:06.456684+0000","last_clean":"2024-09-21T09:06:06.456684+0000","last_became_active":"2024-09-21T09:03:06.243566+0000","last_became_peered":"2024-09-21T09:03:06.243566+0000","last_unstale":"2024-09-21T09:06:06.456684+0000","last_undegraded":"2024-09-21T09:06:06.456684+0000","last_fullsized":"2024-09-21T09:06:06.456684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:40.536244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274538+0000","last_change":"2024-09-21T09:03:08.262736+0000","last_active":"2024-09-21T09:03:38.274538+0000","last_peered":"2024-09-21T09:03:38.274538+0000","last_clean":"2024-09-21T09:03:38.274538+0000","last_became_active":"2024-09-21T09:03:08.262460+0000","last_became_peered":"2024-09-21T09:03:08.262460+0000","last_unstale":"2024-09-21T09:03:38.274538+0000","last_undegraded":"2024-09-21T09:03:38.274538+0000","last_fullsized":"2024-09-21T09:03:38.274538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:09.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'14","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.081970+0000","last_change":"2024-09-21T09:03:00.218617+0000","last_active":"2024-09-21T09:06:06.081970+0000","last_peered":"2024-09-21T09:06:06.081970+0000","last_clean":"2024-09-21T09:06:06.081970+0000","last_became_active":"2024-09-21T09:03:00.216782+0000","last_became_peered":"2024-09-21T09:03:00.216782+0000","last_unstale":"2024-09-21T09:06:06.081970+0000","last_undegraded":"2024-09-21T09:06:06.081970+0000","last_fullsized":"2024-09-21T09:06:06.081970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:30.927993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276170+0000","last_change":"2024-09-21T09:02:58.213576+0000","last_active":"2024-09-21T09:03:38.276170+0000","last_peered":"2024-09-21T09:03:38.276170+0000","last_clean":"2024-09-21T09:03:38.276170+0000","last_became_active":"2024-09-21T09:02:58.213293+0000","last_became_peered":"2024-09-21T09:02:58.213293+0000","last_unstale":"2024-09-21T09:03:38.276170+0000","last_undegraded":"2024-09-21T09:03:38.276170+0000","last_fullsized":"2024-09-21T09:03:38.276170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:52.024304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276092+0000","last_change":"2024-09-21T09:02:51.501161+0000","last_active":"2024-09-21T09:03:38.276092+0000","last_peered":"2024-09-21T09:03:38.276092+0000","last_clean":"2024-09-21T09:03:38.276092+0000","last_became_active":"2024-09-21T09:02:49.542160+0000","last_became_peered":"2024-09-21T09:02:49.542160+0000","last_unstale":"2024-09-21T09:03:38.276092+0000","last_undegraded":"2024-09-21T09:03:38.276092+0000","last_fullsized":"2024-09-21T09:03:38.276092+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:18.503834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099618800000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271683+0000","last_change":"2024-09-21T09:03:02.218497+0000","last_active":"2024-09-21T09:03:38.271683+0000","last_peered":"2024-09-21T09:03:38.271683+0000","last_clean":"2024-09-21T09:03:38.271683+0000","last_became_active":"2024-09-21T09:03:02.218138+0000","last_became_peered":"2024-09-21T09:03:02.218138+0000","last_unstale":"2024-09-21T09:03:38.271683+0000","last_undegraded":"2024-09-21T09:03:38.271683+0000","last_fullsized":"2024-09-21T09:03:38.271683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:08.671338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'83","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455214+0000","last_change":"2024-09-21T09:03:04.232064+0000","last_active":"2024-09-21T09:05:12.455214+0000","last_peered":"2024-09-21T09:05:12.455214+0000","last_clean":"2024-09-21T09:05:12.455214+0000","last_became_active":"2024-09-21T09:03:04.231708+0000","last_became_peered":"2024-09-21T09:03:04.231708+0000","last_unstale":"2024-09-21T09:05:12.455214+0000","last_undegraded":"2024-09-21T09:05:12.455214+0000","last_fullsized":"2024-09-21T09:05:12.455214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:03.027213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6027,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463881+0000","last_change":"2024-09-21T09:03:06.249786+0000","last_active":"2024-09-21T09:03:38.463881+0000","last_peered":"2024-09-21T09:03:38.463881+0000","last_clean":"2024-09-21T09:03:38.463881+0000","last_became_active":"2024-09-21T09:03:06.249474+0000","last_became_peered":"2024-09-21T09:03:06.249474+0000","last_unstale":"2024-09-21T09:03:38.463881+0000","last_undegraded":"2024-09-21T09:03:38.463881+0000","last_fullsized":"2024-09-21T09:03:38.463881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.466336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273844+0000","last_change":"2024-09-21T09:03:08.252824+0000","last_active":"2024-09-21T09:03:38.273844+0000","last_peered":"2024-09-21T09:03:38.273844+0000","last_clean":"2024-09-21T09:03:38.273844+0000","last_became_active":"2024-09-21T09:03:08.252363+0000","last_became_peered":"2024-09-21T09:03:08.252363+0000","last_unstale":"2024-09-21T09:03:38.273844+0000","last_undegraded":"2024-09-21T09:03:38.273844+0000","last_fullsized":"2024-09-21T09:03:38.273844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:05.753776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.850611+0000","last_change":"2024-09-21T09:03:08.256842+0000","last_active":"2024-09-21T09:03:39.850611+0000","last_peered":"2024-09-21T09:03:39.850611+0000","last_clean":"2024-09-21T09:03:39.850611+0000","last_became_active":"2024-09-21T09:03:08.256571+0000","last_became_peered":"2024-09-21T09:03:08.256571+0000","last_unstale":"2024-09-21T09:03:39.850611+0000","last_undegraded":"2024-09-21T09:03:39.850611+0000","last_fullsized":"2024-09-21T09:03:39.850611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:39.409841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'12","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.301323+0000","last_change":"2024-09-21T09:03:38.470029+0000","last_active":"2024-09-21T09:03:39.301323+0000","last_peered":"2024-09-21T09:03:39.301323+0000","last_clean":"2024-09-21T09:03:39.301323+0000","last_became_active":"2024-09-21T09:03:38.466274+0000","last_became_peered":"2024-09-21T09:03:38.466274+0000","last_unstale":"2024-09-21T09:03:39.301323+0000","last_undegraded":"2024-09-21T09:03:39.301323+0000","last_fullsized":"2024-09-21T09:03:39.301323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:38.626004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275410+0000","last_change":"2024-09-21T09:02:58.221038+0000","last_active":"2024-09-21T09:03:38.275410+0000","last_peered":"2024-09-21T09:03:38.275410+0000","last_clean":"2024-09-21T09:03:38.275410+0000","last_became_active":"2024-09-21T09:02:58.220716+0000","last_became_peered":"2024-09-21T09:02:58.220716+0000","last_unstale":"2024-09-21T09:03:38.275410+0000","last_undegraded":"2024-09-21T09:03:38.275410+0000","last_fullsized":"2024-09-21T09:03:38.275410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:36.863978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274326+0000","last_change":"2024-09-21T09:03:02.220312+0000","last_active":"2024-09-21T09:03:38.274326+0000","last_peered":"2024-09-21T09:03:38.274326+0000","last_clean":"2024-09-21T09:03:38.274326+0000","last_became_active":"2024-09-21T09:03:02.219652+0000","last_became_peered":"2024-09-21T09:03:02.219652+0000","last_unstale":"2024-09-21T09:03:38.274326+0000","last_undegraded":"2024-09-21T09:03:38.274326+0000","last_fullsized":"2024-09-21T09:03:38.274326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:42.719585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'32","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.356322+0000","last_change":"2024-09-21T09:03:04.241932+0000","last_active":"2024-09-21T09:05:04.356322+0000","last_peered":"2024-09-21T09:05:04.356322+0000","last_clean":"2024-09-21T09:05:04.356322+0000","last_became_active":"2024-09-21T09:03:04.241612+0000","last_became_peered":"2024-09-21T09:03:04.241612+0000","last_unstale":"2024-09-21T09:05:04.356322+0000","last_undegraded":"2024-09-21T09:05:04.356322+0000","last_fullsized":"2024-09-21T09:05:04.356322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:31.245640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271493+0000","last_change":"2024-09-21T09:03:06.251100+0000","last_active":"2024-09-21T09:03:38.271493+0000","last_peered":"2024-09-21T09:03:38.271493+0000","last_clean":"2024-09-21T09:03:38.271493+0000","last_became_active":"2024-09-21T09:03:06.250750+0000","last_became_peered":"2024-09-21T09:03:06.250750+0000","last_unstale":"2024-09-21T09:03:38.271493+0000","last_undegraded":"2024-09-21T09:03:38.271493+0000","last_fullsized":"2024-09-21T09:03:38.271493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:22.776215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'11","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.068447+0000","last_change":"2024-09-21T09:03:08.259980+0000","last_active":"2024-09-21T09:05:04.068447+0000","last_peered":"2024-09-21T09:05:04.068447+0000","last_clean":"2024-09-21T09:05:04.068447+0000","last_became_active":"2024-09-21T09:03:08.259602+0000","last_became_peered":"2024-09-21T09:03:08.259602+0000","last_unstale":"2024-09-21T09:05:04.068447+0000","last_undegraded":"2024-09-21T09:05:04.068447+0000","last_fullsized":"2024-09-21T09:05:04.068447+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:33:24.939446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.257843+0000","last_change":"2024-09-21T09:03:00.227394+0000","last_active":"2024-09-21T09:04:22.257843+0000","last_peered":"2024-09-21T09:04:22.257843+0000","last_clean":"2024-09-21T09:04:22.257843+0000","last_became_active":"2024-09-21T09:03:00.225811+0000","last_became_peered":"2024-09-21T09:03:00.225811+0000","last_unstale":"2024-09-21T09:04:22.257843+0000","last_undegraded":"2024-09-21T09:04:22.257843+0000","last_fullsized":"2024-09-21T09:04:22.257843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:51.194693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.281638+0000","last_change":"2024-09-21T09:03:38.280883+0000","last_active":"2024-09-21T09:03:38.281638+0000","last_peered":"2024-09-21T09:03:38.281638+0000","last_clean":"2024-09-21T09:03:38.281638+0000","last_became_active":"2024-09-21T09:03:38.280539+0000","last_became_peered":"2024-09-21T09:03:38.280539+0000","last_unstale":"2024-09-21T09:03:38.281638+0000","last_undegraded":"2024-09-21T09:03:38.281638+0000","last_fullsized":"2024-09-21T09:03:38.281638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:13.642910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278296+0000","last_change":"2024-09-21T09:03:02.223011+0000","last_active":"2024-09-21T09:03:38.278296+0000","last_peered":"2024-09-21T09:03:38.278296+0000","last_clean":"2024-09-21T09:03:38.278296+0000","last_became_active":"2024-09-21T09:03:02.222474+0000","last_became_peered":"2024-09-21T09:03:02.222474+0000","last_unstale":"2024-09-21T09:03:38.278296+0000","last_undegraded":"2024-09-21T09:03:38.278296+0000","last_fullsized":"2024-09-21T09:03:38.278296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:54.497438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'6","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.732315+0000","last_change":"2024-09-21T09:03:04.232760+0000","last_active":"2024-09-21T09:06:05.732315+0000","last_peered":"2024-09-21T09:06:05.732315+0000","last_clean":"2024-09-21T09:06:05.732315+0000","last_became_active":"2024-09-21T09:03:04.232474+0000","last_became_peered":"2024-09-21T09:03:04.232474+0000","last_unstale":"2024-09-21T09:06:05.732315+0000","last_undegraded":"2024-09-21T09:06:05.732315+0000","last_fullsized":"2024-09-21T09:06:05.732315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:11.420156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272717+0000","last_change":"2024-09-21T09:03:06.251118+0000","last_active":"2024-09-21T09:03:38.272717+0000","last_peered":"2024-09-21T09:03:38.272717+0000","last_clean":"2024-09-21T09:03:38.272717+0000","last_became_active":"2024-09-21T09:03:06.250773+0000","last_became_peered":"2024-09-21T09:03:06.250773+0000","last_unstale":"2024-09-21T09:03:38.272717+0000","last_undegraded":"2024-09-21T09:03:38.272717+0000","last_fullsized":"2024-09-21T09:03:38.272717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:30.352901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464626+0000","last_change":"2024-09-21T09:03:08.250971+0000","last_active":"2024-09-21T09:03:38.464626+0000","last_peered":"2024-09-21T09:03:38.464626+0000","last_clean":"2024-09-21T09:03:38.464626+0000","last_became_active":"2024-09-21T09:03:08.250617+0000","last_became_peered":"2024-09-21T09:03:08.250617+0000","last_unstale":"2024-09-21T09:03:38.464626+0000","last_undegraded":"2024-09-21T09:03:38.464626+0000","last_fullsized":"2024-09-21T09:03:38.464626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:54.090547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363198+0000","last_change":"2024-09-21T09:03:00.216088+0000","last_active":"2024-09-21T09:06:06.363198+0000","last_peered":"2024-09-21T09:06:06.363198+0000","last_clean":"2024-09-21T09:06:06.363198+0000","last_became_active":"2024-09-21T09:03:00.215591+0000","last_became_peered":"2024-09-21T09:03:00.215591+0000","last_unstale":"2024-09-21T09:06:06.363198+0000","last_undegraded":"2024-09-21T09:06:06.363198+0000","last_fullsized":"2024-09-21T09:06:06.363198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:32.562147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.251242+0000","last_change":"2024-09-21T09:02:58.218920+0000","last_active":"2024-09-21T09:06:06.251242+0000","last_peered":"2024-09-21T09:06:06.251242+0000","last_clean":"2024-09-21T09:06:06.251242+0000","last_became_active":"2024-09-21T09:02:58.217931+0000","last_became_peered":"2024-09-21T09:02:58.217931+0000","last_unstale":"2024-09-21T09:06:06.251242+0000","last_undegraded":"2024-09-21T09:06:06.251242+0000","last_fullsized":"2024-09-21T09:06:06.251242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:07.674387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272263+0000","last_change":"2024-09-21T09:03:02.219569+0000","last_active":"2024-09-21T09:03:38.272263+0000","last_peered":"2024-09-21T09:03:38.272263+0000","last_clean":"2024-09-21T09:03:38.272263+0000","last_became_active":"2024-09-21T09:03:02.219265+0000","last_became_peered":"2024-09-21T09:03:02.219265+0000","last_unstale":"2024-09-21T09:03:38.272263+0000","last_undegraded":"2024-09-21T09:03:38.272263+0000","last_fullsized":"2024-09-21T09:03:38.272263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:22.253418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'40","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.788569+0000","last_change":"2024-09-21T09:03:04.233795+0000","last_active":"2024-09-21T09:06:05.788569+0000","last_peered":"2024-09-21T09:06:05.788569+0000","last_clean":"2024-09-21T09:06:05.788569+0000","last_became_active":"2024-09-21T09:03:04.233393+0000","last_became_peered":"2024-09-21T09:03:04.233393+0000","last_unstale":"2024-09-21T09:06:05.788569+0000","last_undegraded":"2024-09-21T09:06:05.788569+0000","last_fullsized":"2024-09-21T09:06:05.788569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:49.815772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273436+0000","last_change":"2024-09-21T09:03:06.249268+0000","last_active":"2024-09-21T09:03:38.273436+0000","last_peered":"2024-09-21T09:03:38.273436+0000","last_clean":"2024-09-21T09:03:38.273436+0000","last_became_active":"2024-09-21T09:03:06.248954+0000","last_became_peered":"2024-09-21T09:03:06.248954+0000","last_unstale":"2024-09-21T09:03:38.273436+0000","last_undegraded":"2024-09-21T09:03:38.273436+0000","last_fullsized":"2024-09-21T09:03:38.273436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:09.672283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271808+0000","last_change":"2024-09-21T09:03:08.265248+0000","last_active":"2024-09-21T09:03:38.271808+0000","last_peered":"2024-09-21T09:03:38.271808+0000","last_clean":"2024-09-21T09:03:38.271808+0000","last_became_active":"2024-09-21T09:03:08.264778+0000","last_became_peered":"2024-09-21T09:03:08.264778+0000","last_unstale":"2024-09-21T09:03:38.271808+0000","last_undegraded":"2024-09-21T09:03:38.271808+0000","last_fullsized":"2024-09-21T09:03:38.271808+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:37.665220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271312+0000","last_change":"2024-09-21T09:03:00.218521+0000","last_active":"2024-09-21T09:03:38.271312+0000","last_peered":"2024-09-21T09:03:38.271312+0000","last_clean":"2024-09-21T09:03:38.271312+0000","last_became_active":"2024-09-21T09:03:00.218259+0000","last_became_peered":"2024-09-21T09:03:00.218259+0000","last_unstale":"2024-09-21T09:03:38.271312+0000","last_undegraded":"2024-09-21T09:03:38.271312+0000","last_fullsized":"2024-09-21T09:03:38.271312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:08.734463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.358977+0000","last_change":"2024-09-21T09:02:58.207817+0000","last_active":"2024-09-21T09:06:06.358977+0000","last_peered":"2024-09-21T09:06:06.358977+0000","last_clean":"2024-09-21T09:06:06.358977+0000","last_became_active":"2024-09-21T09:02:58.207533+0000","last_became_peered":"2024-09-21T09:02:58.207533+0000","last_unstale":"2024-09-21T09:06:06.358977+0000","last_undegraded":"2024-09-21T09:06:06.358977+0000","last_fullsized":"2024-09-21T09:06:06.358977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.813396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271267+0000","last_change":"2024-09-21T09:03:02.219788+0000","last_active":"2024-09-21T09:03:38.271267+0000","last_peered":"2024-09-21T09:03:38.271267+0000","last_clean":"2024-09-21T09:03:38.271267+0000","last_became_active":"2024-09-21T09:03:02.219509+0000","last_became_peered":"2024-09-21T09:03:02.219509+0000","last_unstale":"2024-09-21T09:03:38.271267+0000","last_undegraded":"2024-09-21T09:03:38.271267+0000","last_fullsized":"2024-09-21T09:03:38.271267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:16.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.342422+0000","last_change":"2024-09-21T09:03:04.234223+0000","last_active":"2024-09-21T09:05:04.342422+0000","last_peered":"2024-09-21T09:05:04.342422+0000","last_clean":"2024-09-21T09:05:04.342422+0000","last_became_active":"2024-09-21T09:03:04.233913+0000","last_became_peered":"2024-09-21T09:03:04.233913+0000","last_unstale":"2024-09-21T09:05:04.342422+0000","last_undegraded":"2024-09-21T09:05:04.342422+0000","last_fullsized":"2024-09-21T09:05:04.342422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:42.001541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.279968+0000","last_change":"2024-09-21T09:03:06.241090+0000","last_active":"2024-09-21T09:03:38.279968+0000","last_peered":"2024-09-21T09:03:38.279968+0000","last_clean":"2024-09-21T09:03:38.279968+0000","last_became_active":"2024-09-21T09:03:06.240791+0000","last_became_peered":"2024-09-21T09:03:06.240791+0000","last_unstale":"2024-09-21T09:03:38.279968+0000","last_undegraded":"2024-09-21T09:03:38.279968+0000","last_fullsized":"2024-09-21T09:03:38.279968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:15.100821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260935+0000","last_change":"2024-09-21T09:03:00.216592+0000","last_active":"2024-09-21T09:06:06.260935+0000","last_peered":"2024-09-21T09:06:06.260935+0000","last_clean":"2024-09-21T09:06:06.260935+0000","last_became_active":"2024-09-21T09:03:00.216319+0000","last_became_peered":"2024-09-21T09:03:00.216319+0000","last_unstale":"2024-09-21T09:06:06.260935+0000","last_undegraded":"2024-09-21T09:06:06.260935+0000","last_fullsized":"2024-09-21T09:06:06.260935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:47.869465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270661+0000","last_change":"2024-09-21T09:02:58.214752+0000","last_active":"2024-09-21T09:03:38.270661+0000","last_peered":"2024-09-21T09:03:38.270661+0000","last_clean":"2024-09-21T09:03:38.270661+0000","last_became_active":"2024-09-21T09:02:58.214494+0000","last_became_peered":"2024-09-21T09:02:58.214494+0000","last_unstale":"2024-09-21T09:03:38.270661+0000","last_undegraded":"2024-09-21T09:03:38.270661+0000","last_fullsized":"2024-09-21T09:03:38.270661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:10.892304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"31'4","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.368025+0000","last_change":"2024-09-21T09:03:02.222025+0000","last_active":"2024-09-21T09:05:05.368025+0000","last_peered":"2024-09-21T09:05:05.368025+0000","last_clean":"2024-09-21T09:05:05.368025+0000","last_became_active":"2024-09-21T09:03:02.221586+0000","last_became_peered":"2024-09-21T09:03:02.221586+0000","last_unstale":"2024-09-21T09:05:05.368025+0000","last_undegraded":"2024-09-21T09:05:05.368025+0000","last_fullsized":"2024-09-21T09:05:05.368025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:39.990777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'55","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:37.458245+0000","last_change":"2024-09-21T09:03:04.234015+0000","last_active":"2024-09-21T09:05:37.458245+0000","last_peered":"2024-09-21T09:05:37.458245+0000","last_clean":"2024-09-21T09:05:37.458245+0000","last_became_active":"2024-09-21T09:03:04.233734+0000","last_became_peered":"2024-09-21T09:03:04.233734+0000","last_unstale":"2024-09-21T09:05:37.458245+0000","last_undegraded":"2024-09-21T09:05:37.458245+0000","last_fullsized":"2024-09-21T09:05:37.458245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:48.554737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276740+0000","last_change":"2024-09-21T09:03:06.241254+0000","last_active":"2024-09-21T09:03:38.276740+0000","last_peered":"2024-09-21T09:03:38.276740+0000","last_clean":"2024-09-21T09:03:38.276740+0000","last_became_active":"2024-09-21T09:03:06.240975+0000","last_became_peered":"2024-09-21T09:03:06.240975+0000","last_unstale":"2024-09-21T09:03:38.276740+0000","last_undegraded":"2024-09-21T09:03:38.276740+0000","last_fullsized":"2024-09-21T09:03:38.276740+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:50.569967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'18","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.287382+0000","last_change":"2024-09-21T09:03:08.254283+0000","last_active":"2024-09-21T09:06:06.287382+0000","last_peered":"2024-09-21T09:06:06.287382+0000","last_clean":"2024-09-21T09:06:06.287382+0000","last_became_active":"2024-09-21T09:03:08.253904+0000","last_became_peered":"2024-09-21T09:03:08.253904+0000","last_unstale":"2024-09-21T09:06:06.287382+0000","last_undegraded":"2024-09-21T09:06:06.287382+0000","last_fullsized":"2024-09-21T09:06:06.287382+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:42.273122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'10","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173892+0000","last_change":"2024-09-21T09:03:00.216793+0000","last_active":"2024-09-21T09:06:06.173892+0000","last_peered":"2024-09-21T09:06:06.173892+0000","last_clean":"2024-09-21T09:06:06.173892+0000","last_became_active":"2024-09-21T09:03:00.216238+0000","last_became_peered":"2024-09-21T09:03:00.216238+0000","last_unstale":"2024-09-21T09:06:06.173892+0000","last_undegraded":"2024-09-21T09:06:06.173892+0000","last_fullsized":"2024-09-21T09:06:06.173892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:39.266159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456857+0000","last_change":"2024-09-21T09:02:58.207174+0000","last_active":"2024-09-21T09:05:22.456857+0000","last_peered":"2024-09-21T09:05:22.456857+0000","last_clean":"2024-09-21T09:05:22.456857+0000","last_became_active":"2024-09-21T09:02:58.206879+0000","last_became_peered":"2024-09-21T09:02:58.206879+0000","last_unstale":"2024-09-21T09:05:22.456857+0000","last_undegraded":"2024-09-21T09:05:22.456857+0000","last_fullsized":"2024-09-21T09:05:22.456857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:51.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.280797+0000","last_change":"2024-09-21T09:03:02.218652+0000","last_active":"2024-09-21T09:03:38.280797+0000","last_peered":"2024-09-21T09:03:38.280797+0000","last_clean":"2024-09-21T09:03:38.280797+0000","last_became_active":"2024-09-21T09:03:02.218381+0000","last_became_peered":"2024-09-21T09:03:02.218381+0000","last_unstale":"2024-09-21T09:03:38.280797+0000","last_undegraded":"2024-09-21T09:03:38.280797+0000","last_fullsized":"2024-09-21T09:03:38.280797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:00.802033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'37","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.343375+0000","last_change":"2024-09-21T09:03:04.241328+0000","last_active":"2024-09-21T09:05:04.343375+0000","last_peered":"2024-09-21T09:05:04.343375+0000","last_clean":"2024-09-21T09:05:04.343375+0000","last_became_active":"2024-09-21T09:03:04.240933+0000","last_became_peered":"2024-09-21T09:03:04.240933+0000","last_unstale":"2024-09-21T09:05:04.343375+0000","last_undegraded":"2024-09-21T09:05:04.343375+0000","last_fullsized":"2024-09-21T09:05:04.343375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:37.814664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277445+0000","last_change":"2024-09-21T09:03:06.247452+0000","last_active":"2024-09-21T09:03:38.277445+0000","last_peered":"2024-09-21T09:03:38.277445+0000","last_clean":"2024-09-21T09:03:38.277445+0000","last_became_active":"2024-09-21T09:03:06.247153+0000","last_became_peered":"2024-09-21T09:03:06.247153+0000","last_unstale":"2024-09-21T09:03:38.277445+0000","last_undegraded":"2024-09-21T09:03:38.277445+0000","last_fullsized":"2024-09-21T09:03:38.277445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:41.912327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.104216+0000","last_change":"2024-09-21T09:03:08.262999+0000","last_active":"2024-09-21T09:06:06.104216+0000","last_peered":"2024-09-21T09:06:06.104216+0000","last_clean":"2024-09-21T09:06:06.104216+0000","last_became_active":"2024-09-21T09:03:08.262680+0000","last_became_peered":"2024-09-21T09:03:08.262680+0000","last_unstale":"2024-09-21T09:06:06.104216+0000","last_undegraded":"2024-09-21T09:06:06.104216+0000","last_fullsized":"2024-09-21T09:06:06.104216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:50.139788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278824+0000","last_change":"2024-09-21T09:03:00.224630+0000","last_active":"2024-09-21T09:03:38.278824+0000","last_peered":"2024-09-21T09:03:38.278824+0000","last_clean":"2024-09-21T09:03:38.278824+0000","last_became_active":"2024-09-21T09:03:00.219653+0000","last_became_peered":"2024-09-21T09:03:00.219653+0000","last_unstale":"2024-09-21T09:03:38.278824+0000","last_undegraded":"2024-09-21T09:03:38.278824+0000","last_fullsized":"2024-09-21T09:03:38.278824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:46.305418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'3","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.062776+0000","last_change":"2024-09-21T09:02:58.202783+0000","last_active":"2024-09-21T09:04:22.062776+0000","last_peered":"2024-09-21T09:04:22.062776+0000","last_clean":"2024-09-21T09:04:22.062776+0000","last_became_active":"2024-09-21T09:02:58.202431+0000","last_became_peered":"2024-09-21T09:02:58.202431+0000","last_unstale":"2024-09-21T09:04:22.062776+0000","last_undegraded":"2024-09-21T09:04:22.062776+0000","last_fullsized":"2024-09-21T09:04:22.062776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:19.013606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276494+0000","last_change":"2024-09-21T09:03:02.221261+0000","last_active":"2024-09-21T09:03:38.276494+0000","last_peered":"2024-09-21T09:03:38.276494+0000","last_clean":"2024-09-21T09:03:38.276494+0000","last_became_active":"2024-09-21T09:03:02.220940+0000","last_became_peered":"2024-09-21T09:03:02.220940+0000","last_unstale":"2024-09-21T09:03:38.276494+0000","last_undegraded":"2024-09-21T09:03:38.276494+0000","last_fullsized":"2024-09-21T09:03:38.276494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:24.472177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.360394+0000","last_change":"2024-09-21T09:03:04.239297+0000","last_active":"2024-09-21T09:05:04.360394+0000","last_peered":"2024-09-21T09:05:04.360394+0000","last_clean":"2024-09-21T09:05:04.360394+0000","last_became_active":"2024-09-21T09:03:04.239023+0000","last_became_peered":"2024-09-21T09:03:04.239023+0000","last_unstale":"2024-09-21T09:05:04.360394+0000","last_undegraded":"2024-09-21T09:05:04.360394+0000","last_fullsized":"2024-09-21T09:05:04.360394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:11.019831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465048+0000","last_change":"2024-09-21T09:03:06.244208+0000","last_active":"2024-09-21T09:03:38.465048+0000","last_peered":"2024-09-21T09:03:38.465048+0000","last_clean":"2024-09-21T09:03:38.465048+0000","last_became_active":"2024-09-21T09:03:06.243451+0000","last_became_peered":"2024-09-21T09:03:06.243451+0000","last_unstale":"2024-09-21T09:03:38.465048+0000","last_undegraded":"2024-09-21T09:03:38.465048+0000","last_fullsized":"2024-09-21T09:03:38.465048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:57.268665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.713189+0000","last_change":"2024-09-21T09:03:08.260334+0000","last_active":"2024-09-21T09:05:05.713189+0000","last_peered":"2024-09-21T09:05:05.713189+0000","last_clean":"2024-09-21T09:05:05.713189+0000","last_became_active":"2024-09-21T09:03:08.260047+0000","last_became_peered":"2024-09-21T09:03:08.260047+0000","last_unstale":"2024-09-21T09:05:05.713189+0000","last_undegraded":"2024-09-21T09:05:05.713189+0000","last_fullsized":"2024-09-21T09:05:05.713189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:49.086371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'7","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.457562+0000","last_change":"2024-09-21T09:03:00.221676+0000","last_active":"2024-09-21T09:05:32.457562+0000","last_peered":"2024-09-21T09:05:32.457562+0000","last_clean":"2024-09-21T09:05:32.457562+0000","last_became_active":"2024-09-21T09:03:00.221332+0000","last_became_peered":"2024-09-21T09:03:00.221332+0000","last_unstale":"2024-09-21T09:05:32.457562+0000","last_undegraded":"2024-09-21T09:05:32.457562+0000","last_fullsized":"2024-09-21T09:05:32.457562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:09.836796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.752914+0000","last_change":"2024-09-21T09:02:58.210805+0000","last_active":"2024-09-21T09:03:38.752914+0000","last_peered":"2024-09-21T09:03:38.752914+0000","last_clean":"2024-09-21T09:03:38.752914+0000","last_became_active":"2024-09-21T09:02:58.210511+0000","last_became_peered":"2024-09-21T09:02:58.210511+0000","last_unstale":"2024-09-21T09:03:38.752914+0000","last_undegraded":"2024-09-21T09:03:38.752914+0000","last_fullsized":"2024-09-21T09:03:38.752914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:47.903446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277189+0000","last_change":"2024-09-21T09:03:02.219262+0000","last_active":"2024-09-21T09:03:38.277189+0000","last_peered":"2024-09-21T09:03:38.277189+0000","last_clean":"2024-09-21T09:03:38.277189+0000","last_became_active":"2024-09-21T09:03:02.218979+0000","last_became_peered":"2024-09-21T09:03:02.218979+0000","last_unstale":"2024-09-21T09:03:38.277189+0000","last_undegraded":"2024-09-21T09:03:38.277189+0000","last_fullsized":"2024-09-21T09:03:38.277189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:07.127926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.259516+0000","last_change":"2024-09-21T09:03:04.242314+0000","last_active":"2024-09-21T09:04:22.259516+0000","last_peered":"2024-09-21T09:04:22.259516+0000","last_clean":"2024-09-21T09:04:22.259516+0000","last_became_active":"2024-09-21T09:03:04.241974+0000","last_became_peered":"2024-09-21T09:03:04.241974+0000","last_unstale":"2024-09-21T09:04:22.259516+0000","last_undegraded":"2024-09-21T09:04:22.259516+0000","last_fullsized":"2024-09-21T09:04:22.259516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:52.828027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'282","reported_seq":416,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.368023+0000","last_change":"2024-09-21T09:03:06.244451+0000","last_active":"2024-09-21T09:06:06.368023+0000","last_peered":"2024-09-21T09:06:06.368023+0000","last_clean":"2024-09-21T09:06:06.368023+0000","last_became_active":"2024-09-21T09:03:06.244103+0000","last_became_peered":"2024-09-21T09:03:06.244103+0000","last_unstale":"2024-09-21T09:06:06.368023+0000","last_undegraded":"2024-09-21T09:06:06.368023+0000","last_fullsized":"2024-09-21T09:06:06.368023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:13.035061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"31'6","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.806010+0000","last_change":"2024-09-21T09:03:08.260304+0000","last_active":"2024-09-21T09:06:05.806010+0000","last_peered":"2024-09-21T09:06:05.806010+0000","last_clean":"2024-09-21T09:06:05.806010+0000","last_became_active":"2024-09-21T09:03:08.259638+0000","last_became_peered":"2024-09-21T09:03:08.259638+0000","last_unstale":"2024-09-21T09:06:05.806010+0000","last_undegraded":"2024-09-21T09:06:05.806010+0000","last_fullsized":"2024-09-21T09:06:05.806010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:33.635905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.258397+0000","last_change":"2024-09-21T09:03:00.220803+0000","last_active":"2024-09-21T09:04:22.258397+0000","last_peered":"2024-09-21T09:04:22.258397+0000","last_clean":"2024-09-21T09:04:22.258397+0000","last_became_active":"2024-09-21T09:03:00.220426+0000","last_became_peered":"2024-09-21T09:03:00.220426+0000","last_unstale":"2024-09-21T09:04:22.258397+0000","last_undegraded":"2024-09-21T09:04:22.258397+0000","last_fullsized":"2024-09-21T09:04:22.258397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:15.584421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275873+0000","last_change":"2024-09-21T09:02:58.207718+0000","last_active":"2024-09-21T09:03:38.275873+0000","last_peered":"2024-09-21T09:03:38.275873+0000","last_clean":"2024-09-21T09:03:38.275873+0000","last_became_active":"2024-09-21T09:02:58.207424+0000","last_became_peered":"2024-09-21T09:02:58.207424+0000","last_unstale":"2024-09-21T09:03:38.275873+0000","last_undegraded":"2024-09-21T09:03:38.275873+0000","last_fullsized":"2024-09-21T09:03:38.275873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:03.460514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.282215+0000","last_change":"2024-09-21T09:03:38.280977+0000","last_active":"2024-09-21T09:03:38.282215+0000","last_peered":"2024-09-21T09:03:38.282215+0000","last_clean":"2024-09-21T09:03:38.282215+0000","last_became_active":"2024-09-21T09:03:38.280616+0000","last_became_peered":"2024-09-21T09:03:38.280616+0000","last_unstale":"2024-09-21T09:03:38.282215+0000","last_undegraded":"2024-09-21T09:03:38.282215+0000","last_fullsized":"2024-09-21T09:03:38.282215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:02:41.978323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'38","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.458395+0000","last_change":"2024-09-21T09:03:04.234179+0000","last_active":"2024-09-21T09:05:32.458395+0000","last_peered":"2024-09-21T09:05:32.458395+0000","last_clean":"2024-09-21T09:05:32.458395+0000","last_became_active":"2024-09-21T09:03:04.233878+0000","last_became_peered":"2024-09-21T09:03:04.233878+0000","last_unstale":"2024-09-21T09:05:32.458395+0000","last_undegraded":"2024-09-21T09:05:32.458395+0000","last_fullsized":"2024-09-21T09:05:32.458395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:11.019831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463002+0000","last_change":"2024-09-21T09:03:06.248010+0000","last_active":"2024-09-21T09:03:38.463002+0000","last_peered":"2024-09-21T09:03:38.463002+0000","last_clean":"2024-09-21T09:03:38.463002+0000","last_became_active":"2024-09-21T09:03:06.247609+0000","last_became_peered":"2024-09-21T09:03:06.247609+0000","last_unstale":"2024-09-21T09:03:38.463002+0000","last_undegraded":"2024-09-21T09:03:38.463002+0000","last_fullsized":"2024-09-21T09:03:38.463002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:03.746735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276162+0000","last_change":"2024-09-21T09:03:08.256301+0000","last_active":"2024-09-21T09:03:38.276162+0000","last_peered":"2024-09-21T09:03:38.276162+0000","last_clean":"2024-09-21T09:03:38.276162+0000","last_became_active":"2024-09-21T09:03:08.255717+0000","last_became_peered":"2024-09-21T09:03:08.255717+0000","last_unstale":"2024-09-21T09:03:38.276162+0000","last_undegraded":"2024-09-21T09:03:38.276162+0000","last_fullsized":"2024-09-21T09:03:38.276162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:09:51.274693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'10","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.176725+0000","last_change":"2024-09-21T09:03:00.216086+0000","last_active":"2024-09-21T09:06:06.176725+0000","last_peered":"2024-09-21T09:06:06.176725+0000","last_clean":"2024-09-21T09:06:06.176725+0000","last_became_active":"2024-09-21T09:03:00.215804+0000","last_became_peered":"2024-09-21T09:03:00.215804+0000","last_unstale":"2024-09-21T09:06:06.176725+0000","last_undegraded":"2024-09-21T09:06:06.176725+0000","last_fullsized":"2024-09-21T09:06:06.176725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:43.259240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278524+0000","last_change":"2024-09-21T09:02:58.221563+0000","last_active":"2024-09-21T09:03:38.278524+0000","last_peered":"2024-09-21T09:03:38.278524+0000","last_clean":"2024-09-21T09:03:38.278524+0000","last_became_active":"2024-09-21T09:02:58.221286+0000","last_became_peered":"2024-09-21T09:02:58.221286+0000","last_unstale":"2024-09-21T09:03:38.278524+0000","last_undegraded":"2024-09-21T09:03:38.278524+0000","last_fullsized":"2024-09-21T09:03:38.278524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:01.926039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.279861+0000","last_change":"2024-09-21T09:03:02.225192+0000","last_active":"2024-09-21T09:03:38.279861+0000","last_peered":"2024-09-21T09:03:38.279861+0000","last_clean":"2024-09-21T09:03:38.279861+0000","last_became_active":"2024-09-21T09:03:02.224879+0000","last_became_peered":"2024-09-21T09:03:02.224879+0000","last_unstale":"2024-09-21T09:03:38.279861+0000","last_undegraded":"2024-09-21T09:03:38.279861+0000","last_fullsized":"2024-09-21T09:03:38.279861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:58.107921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.335448+0000","last_change":"2024-09-21T09:03:04.239378+0000","last_active":"2024-09-21T09:05:04.335448+0000","last_peered":"2024-09-21T09:05:04.335448+0000","last_clean":"2024-09-21T09:05:04.335448+0000","last_became_active":"2024-09-21T09:03:04.239112+0000","last_became_peered":"2024-09-21T09:03:04.239112+0000","last_unstale":"2024-09-21T09:05:04.335448+0000","last_undegraded":"2024-09-21T09:05:04.335448+0000","last_fullsized":"2024-09-21T09:05:04.335448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:28.337671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270452+0000","last_change":"2024-09-21T09:03:06.251033+0000","last_active":"2024-09-21T09:03:38.270452+0000","last_peered":"2024-09-21T09:03:38.270452+0000","last_clean":"2024-09-21T09:03:38.270452+0000","last_became_active":"2024-09-21T09:03:06.250729+0000","last_became_peered":"2024-09-21T09:03:06.250729+0000","last_unstale":"2024-09-21T09:03:38.270452+0000","last_undegraded":"2024-09-21T09:03:38.270452+0000","last_fullsized":"2024-09-21T09:03:38.270452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:49.094483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274381+0000","last_change":"2024-09-21T09:03:08.264701+0000","last_active":"2024-09-21T09:03:38.274381+0000","last_peered":"2024-09-21T09:03:38.274381+0000","last_clean":"2024-09-21T09:03:38.274381+0000","last_became_active":"2024-09-21T09:03:08.264160+0000","last_became_peered":"2024-09-21T09:03:08.264160+0000","last_unstale":"2024-09-21T09:03:38.274381+0000","last_undegraded":"2024-09-21T09:03:38.274381+0000","last_fullsized":"2024-09-21T09:03:38.274381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:11.297538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298677+0000","last_change":"2024-09-21T09:03:00.208934+0000","last_active":"2024-09-21T09:06:06.298677+0000","last_peered":"2024-09-21T09:06:06.298677+0000","last_clean":"2024-09-21T09:06:06.298677+0000","last_became_active":"2024-09-21T09:03:00.208673+0000","last_became_peered":"2024-09-21T09:03:00.208673+0000","last_unstale":"2024-09-21T09:06:06.298677+0000","last_undegraded":"2024-09-21T09:06:06.298677+0000","last_fullsized":"2024-09-21T09:06:06.298677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:08:35.801498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465585+0000","last_change":"2024-09-21T09:02:58.213090+0000","last_active":"2024-09-21T09:03:38.465585+0000","last_peered":"2024-09-21T09:03:38.465585+0000","last_clean":"2024-09-21T09:03:38.465585+0000","last_became_active":"2024-09-21T09:02:58.212751+0000","last_became_peered":"2024-09-21T09:02:58.212751+0000","last_unstale":"2024-09-21T09:03:38.465585+0000","last_undegraded":"2024-09-21T09:03:38.465585+0000","last_fullsized":"2024-09-21T09:03:38.465585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:42:59.411200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275293+0000","last_change":"2024-09-21T09:03:02.223254+0000","last_active":"2024-09-21T09:03:38.275293+0000","last_peered":"2024-09-21T09:03:38.275293+0000","last_clean":"2024-09-21T09:03:38.275293+0000","last_became_active":"2024-09-21T09:03:02.222965+0000","last_became_peered":"2024-09-21T09:03:02.222965+0000","last_unstale":"2024-09-21T09:03:38.275293+0000","last_undegraded":"2024-09-21T09:03:38.275293+0000","last_fullsized":"2024-09-21T09:03:38.275293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:51.746643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'26","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.358187+0000","last_change":"2024-09-21T09:03:04.244000+0000","last_active":"2024-09-21T09:05:04.358187+0000","last_peered":"2024-09-21T09:05:04.358187+0000","last_clean":"2024-09-21T09:05:04.358187+0000","last_became_active":"2024-09-21T09:03:04.243686+0000","last_became_peered":"2024-09-21T09:03:04.243686+0000","last_unstale":"2024-09-21T09:05:04.358187+0000","last_undegraded":"2024-09-21T09:05:04.358187+0000","last_fullsized":"2024-09-21T09:05:04.358187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:23.844395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271117+0000","last_change":"2024-09-21T09:03:06.250256+0000","last_active":"2024-09-21T09:03:38.271117+0000","last_peered":"2024-09-21T09:03:38.271117+0000","last_clean":"2024-09-21T09:03:38.271117+0000","last_became_active":"2024-09-21T09:03:06.249959+0000","last_became_peered":"2024-09-21T09:03:06.249959+0000","last_unstale":"2024-09-21T09:03:38.271117+0000","last_undegraded":"2024-09-21T09:03:38.271117+0000","last_fullsized":"2024-09-21T09:03:38.271117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:36:47.765082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'6","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.714631+0000","last_change":"2024-09-21T09:03:08.264668+0000","last_active":"2024-09-21T09:05:05.714631+0000","last_peered":"2024-09-21T09:05:05.714631+0000","last_clean":"2024-09-21T09:05:05.714631+0000","last_became_active":"2024-09-21T09:03:08.264395+0000","last_became_peered":"2024-09-21T09:03:08.264395+0000","last_unstale":"2024-09-21T09:05:05.714631+0000","last_undegraded":"2024-09-21T09:05:05.714631+0000","last_fullsized":"2024-09-21T09:05:05.714631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:33.997831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'14","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.176335+0000","last_change":"2024-09-21T09:03:00.216032+0000","last_active":"2024-09-21T09:06:06.176335+0000","last_peered":"2024-09-21T09:06:06.176335+0000","last_clean":"2024-09-21T09:06:06.176335+0000","last_became_active":"2024-09-21T09:03:00.215748+0000","last_became_peered":"2024-09-21T09:03:00.215748+0000","last_unstale":"2024-09-21T09:06:06.176335+0000","last_undegraded":"2024-09-21T09:06:06.176335+0000","last_fullsized":"2024-09-21T09:06:06.176335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:26.084899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453896+0000","last_change":"2024-09-21T09:02:58.204247+0000","last_active":"2024-09-21T09:05:02.453896+0000","last_peered":"2024-09-21T09:05:02.453896+0000","last_clean":"2024-09-21T09:05:02.453896+0000","last_became_active":"2024-09-21T09:02:58.203973+0000","last_became_peered":"2024-09-21T09:02:58.203973+0000","last_unstale":"2024-09-21T09:05:02.453896+0000","last_undegraded":"2024-09-21T09:05:02.453896+0000","last_fullsized":"2024-09-21T09:05:02.453896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:07.674387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'2","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:03.073883+0000","last_change":"2024-09-21T09:03:02.221130+0000","last_active":"2024-09-21T09:05:03.073883+0000","last_peered":"2024-09-21T09:05:03.073883+0000","last_clean":"2024-09-21T09:05:03.073883+0000","last_became_active":"2024-09-21T09:03:02.220801+0000","last_became_peered":"2024-09-21T09:03:02.220801+0000","last_unstale":"2024-09-21T09:05:03.073883+0000","last_undegraded":"2024-09-21T09:05:03.073883+0000","last_fullsized":"2024-09-21T09:05:03.073883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:02.648349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.733362+0000","last_change":"2024-09-21T09:03:04.241567+0000","last_active":"2024-09-21T09:06:05.733362+0000","last_peered":"2024-09-21T09:06:05.733362+0000","last_clean":"2024-09-21T09:06:05.733362+0000","last_became_active":"2024-09-21T09:03:04.240857+0000","last_became_peered":"2024-09-21T09:03:04.240857+0000","last_unstale":"2024-09-21T09:06:05.733362+0000","last_undegraded":"2024-09-21T09:06:05.733362+0000","last_fullsized":"2024-09-21T09:06:05.733362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:48.722144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464241+0000","last_change":"2024-09-21T09:03:06.248388+0000","last_active":"2024-09-21T09:03:38.464241+0000","last_peered":"2024-09-21T09:03:38.464241+0000","last_clean":"2024-09-21T09:03:38.464241+0000","last_became_active":"2024-09-21T09:03:06.248030+0000","last_became_peered":"2024-09-21T09:03:06.248030+0000","last_unstale":"2024-09-21T09:03:38.464241+0000","last_undegraded":"2024-09-21T09:03:38.464241+0000","last_fullsized":"2024-09-21T09:03:38.464241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.216872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'4","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.370491+0000","last_change":"2024-09-21T09:03:08.264618+0000","last_active":"2024-09-21T09:05:04.370491+0000","last_peered":"2024-09-21T09:05:04.370491+0000","last_clean":"2024-09-21T09:05:04.370491+0000","last_became_active":"2024-09-21T09:03:08.264304+0000","last_became_peered":"2024-09-21T09:03:08.264304+0000","last_unstale":"2024-09-21T09:05:04.370491+0000","last_undegraded":"2024-09-21T09:05:04.370491+0000","last_fullsized":"2024-09-21T09:05:04.370491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:59.938730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'22","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.084081+0000","last_change":"2024-09-21T09:03:00.226200+0000","last_active":"2024-09-21T09:06:06.084081+0000","last_peered":"2024-09-21T09:06:06.084081+0000","last_clean":"2024-09-21T09:06:06.084081+0000","last_became_active":"2024-09-21T09:03:00.225936+0000","last_became_peered":"2024-09-21T09:03:00.225936+0000","last_unstale":"2024-09-21T09:06:06.084081+0000","last_undegraded":"2024-09-21T09:06:06.084081+0000","last_fullsized":"2024-09-21T09:06:06.084081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:56.100485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272693+0000","last_change":"2024-09-21T09:02:58.206450+0000","last_active":"2024-09-21T09:03:38.272693+0000","last_peered":"2024-09-21T09:03:38.272693+0000","last_clean":"2024-09-21T09:03:38.272693+0000","last_became_active":"2024-09-21T09:02:58.206163+0000","last_became_peered":"2024-09-21T09:02:58.206163+0000","last_unstale":"2024-09-21T09:03:38.272693+0000","last_undegraded":"2024-09-21T09:03:38.272693+0000","last_fullsized":"2024-09-21T09:03:38.272693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:19.013606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'5","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304064+0000","last_change":"2024-09-21T09:03:00.221286+0000","last_active":"2024-09-21T09:06:06.304064+0000","last_peered":"2024-09-21T09:06:06.304064+0000","last_clean":"2024-09-21T09:06:06.304064+0000","last_became_active":"2024-09-21T09:03:00.220860+0000","last_became_peered":"2024-09-21T09:03:00.220860+0000","last_unstale":"2024-09-21T09:06:06.304064+0000","last_undegraded":"2024-09-21T09:06:06.304064+0000","last_fullsized":"2024-09-21T09:06:06.304064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:47.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.245757+0000","last_change":"2024-09-21T09:02:58.202869+0000","last_active":"2024-09-21T09:06:06.245757+0000","last_peered":"2024-09-21T09:06:06.245757+0000","last_clean":"2024-09-21T09:06:06.245757+0000","last_became_active":"2024-09-21T09:02:58.202579+0000","last_became_peered":"2024-09-21T09:02:58.202579+0000","last_unstale":"2024-09-21T09:06:06.245757+0000","last_undegraded":"2024-09-21T09:06:06.245757+0000","last_fullsized":"2024-09-21T09:06:06.245757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:51.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'3","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304856+0000","last_change":"2024-09-21T09:03:00.221384+0000","last_active":"2024-09-21T09:06:06.304856+0000","last_peered":"2024-09-21T09:06:06.304856+0000","last_clean":"2024-09-21T09:06:06.304856+0000","last_became_active":"2024-09-21T09:03:00.219281+0000","last_became_peered":"2024-09-21T09:03:00.219281+0000","last_unstale":"2024-09-21T09:06:06.304856+0000","last_undegraded":"2024-09-21T09:06:06.304856+0000","last_fullsized":"2024-09-21T09:06:06.304856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:53.670241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271976+0000","last_change":"2024-09-21T09:02:58.223127+0000","last_active":"2024-09-21T09:03:38.271976+0000","last_peered":"2024-09-21T09:03:38.271976+0000","last_clean":"2024-09-21T09:03:38.271976+0000","last_became_active":"2024-09-21T09:02:58.222856+0000","last_became_peered":"2024-09-21T09:02:58.222856+0000","last_unstale":"2024-09-21T09:03:38.271976+0000","last_undegraded":"2024-09-21T09:03:38.271976+0000","last_fullsized":"2024-09-21T09:03:38.271976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:55.695152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466314+0000","last_change":"2024-09-21T09:03:00.221392+0000","last_active":"2024-09-21T09:03:38.466314+0000","last_peered":"2024-09-21T09:03:38.466314+0000","last_clean":"2024-09-21T09:03:38.466314+0000","last_became_active":"2024-09-21T09:03:00.220755+0000","last_became_peered":"2024-09-21T09:03:00.220755+0000","last_unstale":"2024-09-21T09:03:38.466314+0000","last_undegraded":"2024-09-21T09:03:38.466314+0000","last_fullsized":"2024-09-21T09:03:38.466314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:52:42.557402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464613+0000","last_change":"2024-09-21T09:02:58.208737+0000","last_active":"2024-09-21T09:03:38.464613+0000","last_peered":"2024-09-21T09:03:38.464613+0000","last_clean":"2024-09-21T09:03:38.464613+0000","last_became_active":"2024-09-21T09:02:58.208329+0000","last_became_peered":"2024-09-21T09:02:58.208329+0000","last_unstale":"2024-09-21T09:03:38.464613+0000","last_undegraded":"2024-09-21T09:03:38.464613+0000","last_fullsized":"2024-09-21T09:03:38.464613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:57.584638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'16","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260871+0000","last_change":"2024-09-21T09:03:00.216032+0000","last_active":"2024-09-21T09:06:06.260871+0000","last_peered":"2024-09-21T09:06:06.260871+0000","last_clean":"2024-09-21T09:06:06.260871+0000","last_became_active":"2024-09-21T09:03:00.215554+0000","last_became_peered":"2024-09-21T09:03:00.215554+0000","last_unstale":"2024-09-21T09:06:06.260871+0000","last_undegraded":"2024-09-21T09:06:06.260871+0000","last_fullsized":"2024-09-21T09:06:06.260871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:18.875227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.752662+0000","last_change":"2024-09-21T09:02:58.202254+0000","last_active":"2024-09-21T09:03:38.752662+0000","last_peered":"2024-09-21T09:03:38.752662+0000","last_clean":"2024-09-21T09:03:38.752662+0000","last_became_active":"2024-09-21T09:02:58.201482+0000","last_became_peered":"2024-09-21T09:02:58.201482+0000","last_unstale":"2024-09-21T09:03:38.752662+0000","last_undegraded":"2024-09-21T09:03:38.752662+0000","last_fullsized":"2024-09-21T09:03:38.752662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.813396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'11","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.370735+0000","last_change":"2024-09-21T09:03:00.224630+0000","last_active":"2024-09-21T09:06:06.370735+0000","last_peered":"2024-09-21T09:06:06.370735+0000","last_clean":"2024-09-21T09:06:06.370735+0000","last_became_active":"2024-09-21T09:03:00.223740+0000","last_became_peered":"2024-09-21T09:03:00.223740+0000","last_unstale":"2024-09-21T09:06:06.370735+0000","last_undegraded":"2024-09-21T09:06:06.370735+0000","last_fullsized":"2024-09-21T09:06:06.370735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:58.794598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.454567+0000","last_change":"2024-09-21T09:02:58.210714+0000","last_active":"2024-09-21T09:05:07.454567+0000","last_peered":"2024-09-21T09:05:07.454567+0000","last_clean":"2024-09-21T09:05:07.454567+0000","last_became_active":"2024-09-21T09:02:58.210442+0000","last_became_peered":"2024-09-21T09:02:58.210442+0000","last_unstale":"2024-09-21T09:05:07.454567+0000","last_undegraded":"2024-09-21T09:05:07.454567+0000","last_fullsized":"2024-09-21T09:05:07.454567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:57.584638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'14","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.717387+0000","last_change":"2024-09-21T09:03:00.216820+0000","last_active":"2024-09-21T09:05:05.717387+0000","last_peered":"2024-09-21T09:05:05.717387+0000","last_clean":"2024-09-21T09:05:05.717387+0000","last_became_active":"2024-09-21T09:03:00.216462+0000","last_became_peered":"2024-09-21T09:03:00.216462+0000","last_unstale":"2024-09-21T09:05:05.717387+0000","last_undegraded":"2024-09-21T09:05:05.717387+0000","last_fullsized":"2024-09-21T09:05:05.717387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:43.259240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.833842+0000","last_change":"2024-09-21T09:02:58.220184+0000","last_active":"2024-09-21T09:03:39.833842+0000","last_peered":"2024-09-21T09:03:39.833842+0000","last_clean":"2024-09-21T09:03:39.833842+0000","last_became_active":"2024-09-21T09:02:58.218407+0000","last_became_peered":"2024-09-21T09:02:58.218407+0000","last_unstale":"2024-09-21T09:03:39.833842+0000","last_undegraded":"2024-09-21T09:03:39.833842+0000","last_fullsized":"2024-09-21T09:03:39.833842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:44.533015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.299204+0000","last_change":"2024-09-21T09:03:00.213244+0000","last_active":"2024-09-21T09:06:06.299204+0000","last_peered":"2024-09-21T09:06:06.299204+0000","last_clean":"2024-09-21T09:06:06.299204+0000","last_became_active":"2024-09-21T09:03:00.212503+0000","last_became_peered":"2024-09-21T09:03:00.212503+0000","last_unstale":"2024-09-21T09:06:06.299204+0000","last_undegraded":"2024-09-21T09:06:06.299204+0000","last_fullsized":"2024-09-21T09:06:06.299204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:52.154699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465557+0000","last_change":"2024-09-21T09:02:58.202455+0000","last_active":"2024-09-21T09:03:38.465557+0000","last_peered":"2024-09-21T09:03:38.465557+0000","last_clean":"2024-09-21T09:03:38.465557+0000","last_became_active":"2024-09-21T09:02:58.201812+0000","last_became_peered":"2024-09-21T09:02:58.201812+0000","last_unstale":"2024-09-21T09:03:38.465557+0000","last_undegraded":"2024-09-21T09:03:38.465557+0000","last_fullsized":"2024-09-21T09:03:38.465557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:33.880917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'6","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.853327+0000","last_change":"2024-09-21T09:03:00.225519+0000","last_active":"2024-09-21T09:03:39.853327+0000","last_peered":"2024-09-21T09:03:39.853327+0000","last_clean":"2024-09-21T09:03:39.853327+0000","last_became_active":"2024-09-21T09:03:00.224456+0000","last_became_peered":"2024-09-21T09:03:00.224456+0000","last_unstale":"2024-09-21T09:03:39.853327+0000","last_undegraded":"2024-09-21T09:03:39.853327+0000","last_fullsized":"2024-09-21T09:03:39.853327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:22.464742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458069+0000","last_change":"2024-09-21T09:02:58.222445+0000","last_active":"2024-09-21T09:05:08.458069+0000","last_peered":"2024-09-21T09:05:08.458069+0000","last_clean":"2024-09-21T09:05:08.458069+0000","last_became_active":"2024-09-21T09:02:58.222191+0000","last_became_peered":"2024-09-21T09:02:58.222191+0000","last_unstale":"2024-09-21T09:05:08.458069+0000","last_undegraded":"2024-09-21T09:05:08.458069+0000","last_fullsized":"2024-09-21T09:05:08.458069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:50.343858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":13,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'6","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363119+0000","last_change":"2024-09-21T09:03:00.220918+0000","last_active":"2024-09-21T09:06:06.363119+0000","last_peered":"2024-09-21T09:06:06.363119+0000","last_clean":"2024-09-21T09:06:06.363119+0000","last_became_active":"2024-09-21T09:03:00.220639+0000","last_became_peered":"2024-09-21T09:03:00.220639+0000","last_unstale":"2024-09-21T09:06:06.363119+0000","last_undegraded":"2024-09-21T09:06:06.363119+0000","last_fullsized":"2024-09-21T09:06:06.363119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:26.629707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463882+0000","last_change":"2024-09-21T09:02:58.208759+0000","last_active":"2024-09-21T09:03:38.463882+0000","last_peered":"2024-09-21T09:03:38.463882+0000","last_clean":"2024-09-21T09:03:38.463882+0000","last_became_active":"2024-09-21T09:02:58.208346+0000","last_became_peered":"2024-09-21T09:02:58.208346+0000","last_unstale":"2024-09-21T09:03:38.463882+0000","last_undegraded":"2024-09-21T09:03:38.463882+0000","last_fullsized":"2024-09-21T09:03:38.463882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:44.533015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.711493+0000","last_change":"2024-09-21T09:03:00.223002+0000","last_active":"2024-09-21T09:05:02.711493+0000","last_peered":"2024-09-21T09:05:02.711493+0000","last_clean":"2024-09-21T09:05:02.711493+0000","last_became_active":"2024-09-21T09:03:00.222651+0000","last_became_peered":"2024-09-21T09:03:00.222651+0000","last_unstale":"2024-09-21T09:05:02.711493+0000","last_undegraded":"2024-09-21T09:05:02.711493+0000","last_fullsized":"2024-09-21T09:05:02.711493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:24.133336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274353+0000","last_change":"2024-09-21T09:02:58.209919+0000","last_active":"2024-09-21T09:03:38.274353+0000","last_peered":"2024-09-21T09:03:38.274353+0000","last_clean":"2024-09-21T09:03:38.274353+0000","last_became_active":"2024-09-21T09:02:58.208495+0000","last_became_peered":"2024-09-21T09:02:58.208495+0000","last_unstale":"2024-09-21T09:03:38.274353+0000","last_undegraded":"2024-09-21T09:03:38.274353+0000","last_fullsized":"2024-09-21T09:03:38.274353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:14.606085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'4","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275450+0000","last_change":"2024-09-21T09:03:00.222862+0000","last_active":"2024-09-21T09:03:38.275450+0000","last_peered":"2024-09-21T09:03:38.275450+0000","last_clean":"2024-09-21T09:03:38.275450+0000","last_became_active":"2024-09-21T09:03:00.222343+0000","last_became_peered":"2024-09-21T09:03:00.222343+0000","last_unstale":"2024-09-21T09:03:38.275450+0000","last_undegraded":"2024-09-21T09:03:38.275450+0000","last_fullsized":"2024-09-21T09:03:38.275450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:06.215821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455383+0000","last_change":"2024-09-21T09:02:58.210097+0000","last_active":"2024-09-21T09:05:12.455383+0000","last_peered":"2024-09-21T09:05:12.455383+0000","last_clean":"2024-09-21T09:05:12.455383+0000","last_became_active":"2024-09-21T09:02:58.208630+0000","last_became_peered":"2024-09-21T09:02:58.208630+0000","last_unstale":"2024-09-21T09:05:12.455383+0000","last_undegraded":"2024-09-21T09:05:12.455383+0000","last_fullsized":"2024-09-21T09:05:12.455383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.754217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'18","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.853440+0000","last_change":"2024-09-21T09:03:38.286564+0000","last_active":"2024-09-21T09:03:39.853440+0000","last_peered":"2024-09-21T09:03:39.853440+0000","last_clean":"2024-09-21T09:03:39.853440+0000","last_became_active":"2024-09-21T09:03:38.282951+0000","last_became_peered":"2024-09-21T09:03:38.282951+0000","last_unstale":"2024-09-21T09:03:39.853440+0000","last_undegraded":"2024-09-21T09:03:39.853440+0000","last_fullsized":"2024-09-21T09:03:39.853440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:00.987047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.063131+0000","last_change":"2024-09-21T09:02:58.214989+0000","last_active":"2024-09-21T09:06:06.063131+0000","last_peered":"2024-09-21T09:06:06.063131+0000","last_clean":"2024-09-21T09:06:06.063131+0000","last_became_active":"2024-09-21T09:02:58.214717+0000","last_became_peered":"2024-09-21T09:02:58.214717+0000","last_unstale":"2024-09-21T09:06:06.063131+0000","last_undegraded":"2024-09-21T09:06:06.063131+0000","last_fullsized":"2024-09-21T09:06:06.063131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:03.101113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.456132+0000","last_change":"2024-09-21T09:03:00.227362+0000","last_active":"2024-09-21T09:05:17.456132+0000","last_peered":"2024-09-21T09:05:17.456132+0000","last_clean":"2024-09-21T09:05:17.456132+0000","last_became_active":"2024-09-21T09:03:00.226411+0000","last_became_peered":"2024-09-21T09:03:00.226411+0000","last_unstale":"2024-09-21T09:05:17.456132+0000","last_undegraded":"2024-09-21T09:05:17.456132+0000","last_fullsized":"2024-09-21T09:05:17.456132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:47.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.753111+0000","last_change":"2024-09-21T09:02:58.224258+0000","last_active":"2024-09-21T09:03:38.753111+0000","last_peered":"2024-09-21T09:03:38.753111+0000","last_clean":"2024-09-21T09:03:38.753111+0000","last_became_active":"2024-09-21T09:02:58.224058+0000","last_became_peered":"2024-09-21T09:02:58.224058+0000","last_unstale":"2024-09-21T09:03:38.753111+0000","last_undegraded":"2024-09-21T09:03:38.753111+0000","last_fullsized":"2024-09-21T09:03:38.753111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:40.099948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.080511+0000","last_change":"2024-09-21T09:03:00.220552+0000","last_active":"2024-09-21T09:06:06.080511+0000","last_peered":"2024-09-21T09:06:06.080511+0000","last_clean":"2024-09-21T09:06:06.080511+0000","last_became_active":"2024-09-21T09:03:00.218422+0000","last_became_peered":"2024-09-21T09:03:00.218422+0000","last_unstale":"2024-09-21T09:06:06.080511+0000","last_undegraded":"2024-09-21T09:06:06.080511+0000","last_fullsized":"2024-09-21T09:06:06.080511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:11.245837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275596+0000","last_change":"2024-09-21T09:02:58.219338+0000","last_active":"2024-09-21T09:03:38.275596+0000","last_peered":"2024-09-21T09:03:38.275596+0000","last_clean":"2024-09-21T09:03:38.275596+0000","last_became_active":"2024-09-21T09:02:58.218299+0000","last_became_peered":"2024-09-21T09:02:58.218299+0000","last_unstale":"2024-09-21T09:03:38.275596+0000","last_undegraded":"2024-09-21T09:03:38.275596+0000","last_fullsized":"2024-09-21T09:03:38.275596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:52.024304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'11","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455220+0000","last_change":"2024-09-21T09:03:00.213716+0000","last_active":"2024-09-21T09:05:12.455220+0000","last_peered":"2024-09-21T09:05:12.455220+0000","last_clean":"2024-09-21T09:05:12.455220+0000","last_became_active":"2024-09-21T09:03:00.212838+0000","last_became_peered":"2024-09-21T09:03:00.212838+0000","last_unstale":"2024-09-21T09:05:12.455220+0000","last_undegraded":"2024-09-21T09:05:12.455220+0000","last_fullsized":"2024-09-21T09:05:12.455220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:30.357859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.460059+0000","last_change":"2024-09-21T09:02:58.219134+0000","last_active":"2024-09-21T09:05:18.460059+0000","last_peered":"2024-09-21T09:05:18.460059+0000","last_clean":"2024-09-21T09:05:18.460059+0000","last_became_active":"2024-09-21T09:02:58.218776+0000","last_became_peered":"2024-09-21T09:02:58.218776+0000","last_unstale":"2024-09-21T09:05:18.460059+0000","last_undegraded":"2024-09-21T09:05:18.460059+0000","last_fullsized":"2024-09-21T09:05:18.460059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:24.476268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271062+0000","last_change":"2024-09-21T09:02:58.219078+0000","last_active":"2024-09-21T09:03:38.271062+0000","last_peered":"2024-09-21T09:03:38.271062+0000","last_clean":"2024-09-21T09:03:38.271062+0000","last_became_active":"2024-09-21T09:02:58.218757+0000","last_became_peered":"2024-09-21T09:02:58.218757+0000","last_unstale":"2024-09-21T09:03:38.271062+0000","last_undegraded":"2024-09-21T09:03:38.271062+0000","last_fullsized":"2024-09-21T09:03:38.271062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:37:41.056206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'6","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.299232+0000","last_change":"2024-09-21T09:03:00.216883+0000","last_active":"2024-09-21T09:06:06.299232+0000","last_peered":"2024-09-21T09:06:06.299232+0000","last_clean":"2024-09-21T09:06:06.299232+0000","last_became_active":"2024-09-21T09:03:00.216424+0000","last_became_peered":"2024-09-21T09:03:00.216424+0000","last_unstale":"2024-09-21T09:06:06.299232+0000","last_undegraded":"2024-09-21T09:06:06.299232+0000","last_fullsized":"2024-09-21T09:06:06.299232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:50.802476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463675+0000","last_change":"2024-09-21T09:02:58.209061+0000","last_active":"2024-09-21T09:03:38.463675+0000","last_peered":"2024-09-21T09:03:38.463675+0000","last_clean":"2024-09-21T09:03:38.463675+0000","last_became_active":"2024-09-21T09:02:58.208437+0000","last_became_peered":"2024-09-21T09:02:58.208437+0000","last_unstale":"2024-09-21T09:03:38.463675+0000","last_undegraded":"2024-09-21T09:03:38.463675+0000","last_fullsized":"2024-09-21T09:03:38.463675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:12.355792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'3","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.089579+0000","last_change":"2024-09-21T09:03:00.219307+0000","last_active":"2024-09-21T09:06:06.089579+0000","last_peered":"2024-09-21T09:06:06.089579+0000","last_clean":"2024-09-21T09:06:06.089579+0000","last_became_active":"2024-09-21T09:03:00.219010+0000","last_became_peered":"2024-09-21T09:03:00.219010+0000","last_unstale":"2024-09-21T09:06:06.089579+0000","last_undegraded":"2024-09-21T09:06:06.089579+0000","last_fullsized":"2024-09-21T09:06:06.089579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:19.412009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673005,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40392,"kb_used_data":13368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331448,"statfs":{"total":96636764160,"available":96595402752,"internally_reserved":0,"allocated":13688832,"data_stored":13360568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36796,"kb_used_data":9772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":10006528,"data_stored":9752500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61028,"kb_used_data":17364,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94310812,"statfs":{"total":96636764160,"available":96574271488,"internally_reserved":0,"allocated":17780736,"data_stored":17500718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52200,"kb_used_data":12696,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319640,"statfs":{"total":96636764160,"available":96583311360,"internally_reserved":0,"allocated":13000704,"data_stored":12717132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:06:14.113 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T09:06:14.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.244+0000 7f012c7be640 1 Processor -- start 2024-09-21T09:06:14.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.244+0000 7f012c7be640 1 -- start start 2024-09-21T09:06:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.245+0000 7f012c7be640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0124096630 0x7f0124096a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.245+0000 7f012c7be640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01240702f0 con 0x7f012406d910 2024-09-21T09:06:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.245+0000 7f012c7be640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f012406f1f0 con 0x7f0124096630 2024-09-21T09:06:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.245+0000 7f012a55a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0124096630 0x7f0124096a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.245+0000 7f0129d59640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f012406d910 0x7f012406dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58284/0 (socket says 172.21.15.44:58284) 2024-09-21T09:06:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.245+0000 7f0129d59640 1 -- 172.21.15.44:0/3798962978 learned_addr learned my addr 172.21.15.44:0/3798962978 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.245+0000 7f012a55a640 1 -- 172.21.15.44:0/3798962978 >> v1:172.21.15.44:6789/0 conn(0x7f012406d910 legacy=0x7f012406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.245+0000 7f012a55a640 1 -- 172.21.15.44:0/3798962978 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012406fb80 con 0x7f0124096630 2024-09-21T09:06:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.245+0000 7f0129558640 1 -- 172.21.15.44:0/3798962978 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4268897062 0 0) 0x7f01240702f0 con 0x7f012406d910 2024-09-21T09:06:14.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.246+0000 7f012a55a640 1 --2- 172.21.15.44:0/3798962978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0124096630 0x7f0124096a10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f0120009720 tx=0x7f012002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e6378c16fa02d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:14.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.246+0000 7f0129558640 1 -- 172.21.15.44:0/3798962978 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0120037070 con 0x7f0124096630 2024-09-21T09:06:14.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.246+0000 7f0129558640 1 -- 172.21.15.44:0/3798962978 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012002ad90 con 0x7f0124096630 2024-09-21T09:06:14.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.246+0000 7f0129558640 1 -- 172.21.15.44:0/3798962978 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0120032590 con 0x7f0124096630 2024-09-21T09:06:14.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.246+0000 7f012c7be640 1 -- 172.21.15.44:0/3798962978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0124096630 msgr2=0x7f0124096a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:14.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.246+0000 7f012c7be640 1 --2- 172.21.15.44:0/3798962978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0124096630 0x7f0124096a10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f0120009720 tx=0x7f012002a110 comp rx=0 tx=0).stop 2024-09-21T09:06:14.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.246+0000 7f012c7be640 1 -- 172.21.15.44:0/3798962978 shutdown_connections 2024-09-21T09:06:14.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.246+0000 7f012c7be640 1 --2- 172.21.15.44:0/3798962978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0124096630 0x7f0124096a10 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:14.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.247+0000 7f012c7be640 1 -- 172.21.15.44:0/3798962978 >> 172.21.15.44:0/3798962978 conn(0x7f012409a890 msgr2=0x7f012409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:14.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.247+0000 7f012c7be640 1 -- 172.21.15.44:0/3798962978 shutdown_connections 2024-09-21T09:06:14.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.247+0000 7f012c7be640 1 -- 172.21.15.44:0/3798962978 wait complete. 2024-09-21T09:06:14.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.247+0000 7f012c7be640 1 Processor -- start 2024-09-21T09:06:14.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.247+0000 7f012c7be640 1 -- start start 2024-09-21T09:06:14.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.248+0000 7f012c7be640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012406d910 0x7f0124121a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:14.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.248+0000 7f012c7be640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f012406d410 con 0x7f012406d910 2024-09-21T09:06:14.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.248+0000 7f012a55a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012406d910 0x7f0124121a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:14.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.248+0000 7f012a55a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012406d910 0x7f0124121a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53094/0 (socket says 172.21.15.44:53094) 2024-09-21T09:06:14.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.248+0000 7f012a55a640 1 -- 172.21.15.44:0/1523544463 learned_addr learned my addr 172.21.15.44:0/1523544463 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:14.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.248+0000 7f012a55a640 1 -- 172.21.15.44:0/1523544463 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01241251a0 con 0x7f012406d910 2024-09-21T09:06:14.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.248+0000 7f012a55a640 1 --2- 172.21.15.44:0/1523544463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012406d910 0x7f0124121a80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0120009720 tx=0x7f01200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:14.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.248+0000 7f011affd640 1 -- 172.21.15.44:0/1523544463 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0120037050 con 0x7f012406d910 2024-09-21T09:06:14.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.248+0000 7f011affd640 1 -- 172.21.15.44:0/1523544463 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0120038040 con 0x7f012406d910 2024-09-21T09:06:14.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.248+0000 7f012c7be640 1 -- 172.21.15.44:0/1523544463 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01241247a0 con 0x7f012406d910 2024-09-21T09:06:14.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.248+0000 7f011affd640 1 -- 172.21.15.44:0/1523544463 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01200042f0 con 0x7f012406d910 2024-09-21T09:06:14.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.249+0000 7f012c7be640 1 -- 172.21.15.44:0/1523544463 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01241221a0 con 0x7f012406d910 2024-09-21T09:06:14.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.249+0000 7f011affd640 1 -- 172.21.15.44:0/1523544463 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0120003610 con 0x7f012406d910 2024-09-21T09:06:14.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.249+0000 7f012c7be640 1 -- 172.21.15.44:0/1523544463 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0124072ea0 con 0x7f012406d910 2024-09-21T09:06:14.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.249+0000 7f011affd640 1 --2- 172.21.15.44:0/1523544463 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f01080382a0 0x7f010803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:14.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.250+0000 7f011affd640 1 -- 172.21.15.44:0/1523544463 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f012006c560 con 0x7f012406d910 2024-09-21T09:06:14.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.250+0000 7f0129d59640 1 --2- 172.21.15.44:0/1523544463 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f01080382a0 0x7f010803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:14.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.250+0000 7f0129d59640 1 --2- 172.21.15.44:0/1523544463 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f01080382a0 0x7f010803a760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0114000c00 tx=0x7f0114007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:14.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.254+0000 7f011affd640 1 -- 172.21.15.44:0/1523544463 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0124072ea0 con 0x7f012406d910 2024-09-21T09:06:14.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.430+0000 7f012c7be640 1 -- 172.21.15.44:0/1523544463 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0124124520 con 0x7f012406d910 2024-09-21T09:06:14.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.432+0000 7f011affd640 1 -- 172.21.15.44:0/1523544463 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+21322 (secure 0 0 0) 0x7f012003b360 con 0x7f012406d910 2024-09-21T09:06:14.434 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:06:14.434 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"fsid":"7bec7bbe-ddde-41dc-a98a-89578467409a","created":"2024-09-21T09:02:32.212507+0000","modified":"2024-09-21T09:03:38.267088+0000","last_up_change":"2024-09-21T09:02:42.466256+0000","last_in_change":"2024-09-21T09:02:33.337232+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T09:02:42.466115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T09:02:47.895676+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-21T09:02:57.071051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.440000057220459,"score_stable":1.440000057220459,"optimal_score":1,"raw_score_acting":1.440000057220459,"raw_score_stable":1.440000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-21T09:02:58.542096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-21T09:03:00.537481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-21T09:03:02.321328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-21T09:03:04.275636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-21T09:03:06.343166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1fc5de68-f422-48c9-94eb-866cf7bdc692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6801","nonce":2732047064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6803","nonce":2732047064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6807","nonce":2732047064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2732047064},{"type":"v1","addr":"172.21.15.44:6805","nonce":2732047064}]},"public_addr":"172.21.15.44:6801/2732047064","cluster_addr":"172.21.15.44:6803/2732047064","heartbeat_back_addr":"172.21.15.44:6807/2732047064","heartbeat_front_addr":"172.21.15.44:6805/2732047064","state":["exists","up"]},{"osd":1,"uuid":"46978fe3-3a88-4346-8b7e-9a782c5d9510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6801","nonce":627496675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6803","nonce":627496675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6807","nonce":627496675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":627496675},{"type":"v1","addr":"172.21.15.178:6805","nonce":627496675}]},"public_addr":"172.21.15.178:6801/627496675","cluster_addr":"172.21.15.178:6803/627496675","heartbeat_back_addr":"172.21.15.178:6807/627496675","heartbeat_front_addr":"172.21.15.178:6805/627496675","state":["exists","up"]},{"osd":2,"uuid":"eedae05b-7cc6-4b8f-9dce-c736c32d3c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6817","nonce":3267136144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6819","nonce":3267136144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6823","nonce":3267136144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3267136144},{"type":"v1","addr":"172.21.15.178:6821","nonce":3267136144}]},"public_addr":"172.21.15.178:6817/3267136144","cluster_addr":"172.21.15.178:6819/3267136144","heartbeat_back_addr":"172.21.15.178:6823/3267136144","heartbeat_front_addr":"172.21.15.178:6821/3267136144","state":["exists","up"]},{"osd":3,"uuid":"45264942-4fad-46c1-85f7-67b9a1bbb25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6809","nonce":24558189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6811","nonce":24558189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6815","nonce":24558189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":24558189},{"type":"v1","addr":"172.21.15.178:6813","nonce":24558189}]},"public_addr":"172.21.15.178:6809/24558189","cluster_addr":"172.21.15.178:6811/24558189","heartbeat_back_addr":"172.21.15.178:6815/24558189","heartbeat_front_addr":"172.21.15.178:6813/24558189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:39.589581+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:39.642924+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:40.386523+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:02:40.580469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.3f","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.3","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.2b","mappings":[{"from":1,"to":2}]},{"pgid":"5.4","mappings":[{"from":0,"to":2}]},{"pgid":"5.b","mappings":[{"from":0,"to":2}]},{"pgid":"5.1a","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:06:14.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.434+0000 7f012c7be640 1 -- 172.21.15.44:0/1523544463 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f01080382a0 msgr2=0x7f010803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:14.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.434+0000 7f012c7be640 1 --2- 172.21.15.44:0/1523544463 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f01080382a0 0x7f010803a760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0114000c00 tx=0x7f0114007910 comp rx=0 tx=0).stop 2024-09-21T09:06:14.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.434+0000 7f012c7be640 1 -- 172.21.15.44:0/1523544463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012406d910 msgr2=0x7f0124121a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:14.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.434+0000 7f012c7be640 1 --2- 172.21.15.44:0/1523544463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012406d910 0x7f0124121a80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0120009720 tx=0x7f01200046c0 comp rx=0 tx=0).stop 2024-09-21T09:06:14.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.434+0000 7f012c7be640 1 -- 172.21.15.44:0/1523544463 shutdown_connections 2024-09-21T09:06:14.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.434+0000 7f012c7be640 1 --2- 172.21.15.44:0/1523544463 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f01080382a0 0x7f010803a760 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:14.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.434+0000 7f012c7be640 1 --2- 172.21.15.44:0/1523544463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012406d910 0x7f0124121a80 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:14.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.434+0000 7f012c7be640 1 -- 172.21.15.44:0/1523544463 >> 172.21.15.44:0/1523544463 conn(0x7f012409a890 msgr2=0x7f01240717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:14.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.434+0000 7f012c7be640 1 -- 172.21.15.44:0/1523544463 shutdown_connections 2024-09-21T09:06:14.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:14.434+0000 7f012c7be640 1 -- 172.21.15.44:0/1523544463 wait complete. 2024-09-21T09:06:15.447 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T09:06:15.447 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T09:06:15.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.564+0000 7fecb59d6640 1 Processor -- start 2024-09-21T09:06:15.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.564+0000 7fecb59d6640 1 -- start start 2024-09-21T09:06:15.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.564+0000 7fecb59d6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fecb006e620 0x7fecb006ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:15.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.564+0000 7fecb59d6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecb006e1d0 con 0x7fecb0121a50 2024-09-21T09:06:15.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.564+0000 7fecb59d6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fecb006f950 con 0x7fecb006e620 2024-09-21T09:06:15.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.565+0000 7fecaeffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fecb006e620 0x7fecb006ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:15.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.565+0000 7fecae7fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fecb0121a50 0x7fecb0121e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58290/0 (socket says 172.21.15.44:58290) 2024-09-21T09:06:15.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.565+0000 7fecae7fc640 1 -- 172.21.15.44:0/2762280493 learned_addr learned my addr 172.21.15.44:0/2762280493 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:15.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.565+0000 7fecaeffd640 1 -- 172.21.15.44:0/2762280493 >> v1:172.21.15.44:6789/0 conn(0x7fecb0121a50 legacy=0x7fecb0121e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:15.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.565+0000 7fecadffb640 1 -- 172.21.15.44:0/2762280493 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685390797 0 0) 0x7fecb006e1d0 con 0x7fecb0121a50 2024-09-21T09:06:15.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.565+0000 7fecaeffd640 1 -- 172.21.15.44:0/2762280493 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb00989a0 con 0x7fecb006e620 2024-09-21T09:06:15.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.566+0000 7fecaeffd640 1 --2- 172.21.15.44:0/2762280493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecb006e620 0x7fecb006ea00 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7feca0009720 tx=0x7feca002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846dc8027518724 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:15.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.566+0000 7fecadffb640 1 -- 172.21.15.44:0/2762280493 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca0037070 con 0x7fecb006e620 2024-09-21T09:06:15.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.566+0000 7fecadffb640 1 -- 172.21.15.44:0/2762280493 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca002ad90 con 0x7fecb006e620 2024-09-21T09:06:15.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.566+0000 7fecadffb640 1 -- 172.21.15.44:0/2762280493 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca0032590 con 0x7fecb006e620 2024-09-21T09:06:15.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.566+0000 7fecb59d6640 1 -- 172.21.15.44:0/2762280493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecb006e620 msgr2=0x7fecb006ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:15.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.566+0000 7fecb59d6640 1 --2- 172.21.15.44:0/2762280493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecb006e620 0x7fecb006ea00 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7feca0009720 tx=0x7feca002a110 comp rx=0 tx=0).stop 2024-09-21T09:06:15.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.566+0000 7fecb59d6640 1 -- 172.21.15.44:0/2762280493 shutdown_connections 2024-09-21T09:06:15.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.566+0000 7fecb59d6640 1 --2- 172.21.15.44:0/2762280493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecb006e620 0x7fecb006ea00 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:15.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.566+0000 7fecb59d6640 1 -- 172.21.15.44:0/2762280493 >> 172.21.15.44:0/2762280493 conn(0x7fecb00998b0 msgr2=0x7fecb0099cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:15.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.566+0000 7fecb59d6640 1 -- 172.21.15.44:0/2762280493 shutdown_connections 2024-09-21T09:06:15.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.566+0000 7fecb59d6640 1 -- 172.21.15.44:0/2762280493 wait complete. 2024-09-21T09:06:15.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.567+0000 7fecb59d6640 1 Processor -- start 2024-09-21T09:06:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.568+0000 7fecb59d6640 1 -- start start 2024-09-21T09:06:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.568+0000 7fecb59d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecb006e620 0x7fecb01c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.568+0000 7fecb59d6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fecb0070730 con 0x7fecb006e620 2024-09-21T09:06:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.568+0000 7fecaeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecb006e620 0x7fecb01c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.568+0000 7fecaeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecb006e620 0x7fecb01c3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53110/0 (socket says 172.21.15.44:53110) 2024-09-21T09:06:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.568+0000 7fecaeffd640 1 -- 172.21.15.44:0/176235160 learned_addr learned my addr 172.21.15.44:0/176235160 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.568+0000 7fecaeffd640 1 -- 172.21.15.44:0/176235160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb0125d80 con 0x7fecb006e620 2024-09-21T09:06:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.568+0000 7fecaeffd640 1 --2- 172.21.15.44:0/176235160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecb006e620 0x7fecb01c3490 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7feca0009720 tx=0x7feca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.569+0000 7fec97fff640 1 -- 172.21.15.44:0/176235160 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca0041070 con 0x7fecb006e620 2024-09-21T09:06:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.569+0000 7fec97fff640 1 -- 172.21.15.44:0/176235160 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca003c460 con 0x7fecb006e620 2024-09-21T09:06:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.569+0000 7fec97fff640 1 -- 172.21.15.44:0/176235160 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca0037040 con 0x7fecb006e620 2024-09-21T09:06:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.569+0000 7fecb59d6640 1 -- 172.21.15.44:0/176235160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb0090900 con 0x7fecb006e620 2024-09-21T09:06:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.569+0000 7fecb59d6640 1 -- 172.21.15.44:0/176235160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb01c39d0 con 0x7fecb006e620 2024-09-21T09:06:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.570+0000 7fecb59d6640 1 -- 172.21.15.44:0/176235160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fecb006ea00 con 0x7fecb006e620 2024-09-21T09:06:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.570+0000 7fec97fff640 1 -- 172.21.15.44:0/176235160 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feca0044070 con 0x7fecb006e620 2024-09-21T09:06:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.570+0000 7fec97fff640 1 --2- 172.21.15.44:0/176235160 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fec9c0382a0 0x7fec9c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.570+0000 7fec97fff640 1 -- 172.21.15.44:0/176235160 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7feca006c680 con 0x7fecb006e620 2024-09-21T09:06:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.570+0000 7fec97fff640 1 --2- 172.21.15.44:0/176235160 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x7fec9c044100 0x7fec9c0465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.570+0000 7fec97fff640 1 -- 172.21.15.44:0/176235160 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feca002ad90 con 0x7fec9c044100 2024-09-21T09:06:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.570+0000 7fec97fff640 1 -- 172.21.15.44:0/176235160 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7feca0073050 con 0x7fecb006e620 2024-09-21T09:06:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.570+0000 7fecaf7fe640 1 --2- 172.21.15.44:0/176235160 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x7fec9c044100 0x7fec9c0465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.570+0000 7fecae7fc640 1 --2- 172.21.15.44:0/176235160 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fec9c0382a0 0x7fec9c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.570+0000 7fecaf7fe640 1 --2- 172.21.15.44:0/176235160 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x7fec9c044100 0x7fec9c0465a0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:15.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.571+0000 7fecae7fc640 1 --2- 172.21.15.44:0/176235160 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fec9c0382a0 0x7fec9c03a760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7feca4000f80 tx=0x7feca4007c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:15.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.571+0000 7fec97fff640 1 -- 172.21.15.44:0/176235160 <== osd.0 v2:172.21.15.44:6800/2732047064 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feca002ad90 con 0x7fec9c044100 2024-09-21T09:06:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.584+0000 7fecb59d6640 1 -- 172.21.15.44:0/176235160 --> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fecb0121a50 con 0x7fec9c044100 2024-09-21T09:06:15.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.584+0000 7fec97fff640 1 -- 172.21.15.44:0/176235160 <== osd.0 v2:172.21.15.44:6800/2732047064 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fecb0121a50 con 0x7fec9c044100 2024-09-21T09:06:15.586 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-21T09:06:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T09:06:15.586 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-21T09:06:15.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.584+0000 7fecb59d6640 1 -- 172.21.15.44:0/176235160 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x7fec9c044100 msgr2=0x7fec9c0465a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:15.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.584+0000 7fecb59d6640 1 --2- 172.21.15.44:0/176235160 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x7fec9c044100 0x7fec9c0465a0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:15.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.584+0000 7fecb59d6640 1 -- 172.21.15.44:0/176235160 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fec9c0382a0 msgr2=0x7fec9c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:15.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.584+0000 7fecb59d6640 1 --2- 172.21.15.44:0/176235160 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fec9c0382a0 0x7fec9c03a760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7feca4000f80 tx=0x7feca4007c90 comp rx=0 tx=0).stop 2024-09-21T09:06:15.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.585+0000 7fecb59d6640 1 -- 172.21.15.44:0/176235160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecb006e620 msgr2=0x7fecb01c3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:15.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.585+0000 7fecb59d6640 1 --2- 172.21.15.44:0/176235160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecb006e620 0x7fecb01c3490 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7feca0009720 tx=0x7feca00046c0 comp rx=0 tx=0).stop 2024-09-21T09:06:15.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.585+0000 7fecb59d6640 1 -- 172.21.15.44:0/176235160 shutdown_connections 2024-09-21T09:06:15.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.585+0000 7fecb59d6640 1 --2- 172.21.15.44:0/176235160 >> [v2:172.21.15.44:6800/2732047064,v1:172.21.15.44:6801/2732047064] conn(0x7fec9c044100 0x7fec9c0465a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:15.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.585+0000 7fecb59d6640 1 --2- 172.21.15.44:0/176235160 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fec9c0382a0 0x7fec9c03a760 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:15.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.585+0000 7fecb59d6640 1 --2- 172.21.15.44:0/176235160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecb006e620 0x7fecb01c3490 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:15.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.585+0000 7fecb59d6640 1 -- 172.21.15.44:0/176235160 >> 172.21.15.44:0/176235160 conn(0x7fecb00998b0 msgr2=0x7fecb006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:15.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.585+0000 7fecb59d6640 1 -- 172.21.15.44:0/176235160 shutdown_connections 2024-09-21T09:06:15.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.585+0000 7fecb59d6640 1 -- 172.21.15.44:0/176235160 wait complete. 2024-09-21T09:06:15.597 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T09:06:15.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.697+0000 7f0ed4aba640 1 Processor -- start 2024-09-21T09:06:15.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.697+0000 7f0ed4aba640 1 -- start start 2024-09-21T09:06:15.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.697+0000 7f0ed4aba640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0ed012f1e0 0x7f0ed0133a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:15.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.697+0000 7f0ed4aba640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ed006e9a0 con 0x7f0ed012e6f0 2024-09-21T09:06:15.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.697+0000 7f0ed4aba640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0ed012f5f0 con 0x7f0ed012f1e0 2024-09-21T09:06:15.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.697+0000 7f0ec7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0ed012f1e0 0x7f0ed0133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:15.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.698+0000 7f0ece59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0ed012e6f0 0x7f0ed012ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58304/0 (socket says 172.21.15.44:58304) 2024-09-21T09:06:15.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.698+0000 7f0ece59c640 1 -- 172.21.15.44:0/1213711538 learned_addr learned my addr 172.21.15.44:0/1213711538 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:15.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.698+0000 7f0ec7fff640 1 -- 172.21.15.44:0/1213711538 >> v1:172.21.15.44:6789/0 conn(0x7f0ed012e6f0 legacy=0x7f0ed012ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:15.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.698+0000 7f0ecdd9b640 1 -- 172.21.15.44:0/1213711538 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1359027463 0 0) 0x7f0ed006e9a0 con 0x7f0ed012e6f0 2024-09-21T09:06:15.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.698+0000 7f0ec7fff640 1 -- 172.21.15.44:0/1213711538 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed0134fc0 con 0x7f0ed012f1e0 2024-09-21T09:06:15.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.699+0000 7f0ec7fff640 1 --2- 172.21.15.44:0/1213711538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed012f1e0 0x7f0ed0133a70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009720 tx=0x7f0eb802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11db5038e372af72 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:15.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.699+0000 7f0ecdd9b640 1 -- 172.21.15.44:0/1213711538 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb8037070 con 0x7f0ed012f1e0 2024-09-21T09:06:15.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.699+0000 7f0ecdd9b640 1 -- 172.21.15.44:0/1213711538 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb802ad90 con 0x7f0ed012f1e0 2024-09-21T09:06:15.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.699+0000 7f0ecdd9b640 1 -- 172.21.15.44:0/1213711538 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb8032590 con 0x7f0ed012f1e0 2024-09-21T09:06:15.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.699+0000 7f0ed4aba640 1 -- 172.21.15.44:0/1213711538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed012f1e0 msgr2=0x7f0ed0133a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:15.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.699+0000 7f0ed4aba640 1 --2- 172.21.15.44:0/1213711538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed012f1e0 0x7f0ed0133a70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009720 tx=0x7f0eb802a110 comp rx=0 tx=0).stop 2024-09-21T09:06:15.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.699+0000 7f0ed4aba640 1 -- 172.21.15.44:0/1213711538 shutdown_connections 2024-09-21T09:06:15.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.699+0000 7f0ed4aba640 1 --2- 172.21.15.44:0/1213711538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed012f1e0 0x7f0ed0133a70 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:15.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.699+0000 7f0ed4aba640 1 -- 172.21.15.44:0/1213711538 >> 172.21.15.44:0/1213711538 conn(0x7f0ed009f020 msgr2=0x7f0ed009f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:15.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.699+0000 7f0ed4aba640 1 -- 172.21.15.44:0/1213711538 shutdown_connections 2024-09-21T09:06:15.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.699+0000 7f0ed4aba640 1 -- 172.21.15.44:0/1213711538 wait complete. 2024-09-21T09:06:15.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.700+0000 7f0ed4aba640 1 Processor -- start 2024-09-21T09:06:15.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.700+0000 7f0ed4aba640 1 -- start start 2024-09-21T09:06:15.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.701+0000 7f0ed4aba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed012e6f0 0x7f0ed0131b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:15.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.701+0000 7f0ed4aba640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed0134340 con 0x7f0ed012e6f0 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.701+0000 7f0ece59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed012e6f0 0x7f0ed0131b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.701+0000 7f0ece59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed012e6f0 0x7f0ed0131b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53122/0 (socket says 172.21.15.44:53122) 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.701+0000 7f0ece59c640 1 -- 172.21.15.44:0/3398967994 learned_addr learned my addr 172.21.15.44:0/3398967994 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.701+0000 7f0ece59c640 1 -- 172.21.15.44:0/3398967994 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed0128e60 con 0x7f0ed012e6f0 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.701+0000 7f0ece59c640 1 --2- 172.21.15.44:0/3398967994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed012e6f0 0x7f0ed0131b50 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000c370 tx=0x7f0ec000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.701+0000 7f0ec6ffd640 1 -- 172.21.15.44:0/3398967994 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ec0007410 con 0x7f0ed012e6f0 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.701+0000 7f0ed4aba640 1 -- 172.21.15.44:0/3398967994 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed01249e0 con 0x7f0ed012e6f0 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.701+0000 7f0ec6ffd640 1 -- 172.21.15.44:0/3398967994 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec00075d0 con 0x7f0ed012e6f0 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.701+0000 7f0ec6ffd640 1 -- 172.21.15.44:0/3398967994 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ec0004950 con 0x7f0ed012e6f0 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.701+0000 7f0ed4aba640 1 -- 172.21.15.44:0/3398967994 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed0132090 con 0x7f0ed012e6f0 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.702+0000 7f0ec6ffd640 1 -- 172.21.15.44:0/3398967994 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0ec0011070 con 0x7f0ed012e6f0 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.702+0000 7f0ec6ffd640 1 --2- 172.21.15.44:0/3398967994 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0eb0038250 0x7f0eb003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.702+0000 7f0ec6ffd640 1 -- 172.21.15.44:0/3398967994 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f0ec004b810 con 0x7f0ed012e6f0 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.702+0000 7f0ed4aba640 1 -- 172.21.15.44:0/3398967994 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed0128b80 con 0x7f0ed012e6f0 2024-09-21T09:06:15.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.703+0000 7f0ec7fff640 1 --2- 172.21.15.44:0/3398967994 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0eb0038250 0x7f0eb003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:15.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.703+0000 7f0ec7fff640 1 --2- 172.21.15.44:0/3398967994 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0eb0038250 0x7f0eb003a710 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8034000 tx=0x7f0eb802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:15.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.707+0000 7f0ec6ffd640 1 -- 172.21.15.44:0/3398967994 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0ed0128e60 con 0x7f0ed012e6f0 2024-09-21T09:06:15.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.883+0000 7f0ed4aba640 1 -- 172.21.15.44:0/3398967994 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f0ed012ead0 con 0x7f0eb0038250 2024-09-21T09:06:15.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.884+0000 7f0ec6ffd640 1 -- 172.21.15.44:0/3398967994 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0ed012ead0 con 0x7f0eb0038250 2024-09-21T09:06:15.886 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T09:06:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.886+0000 7f0ed4aba640 1 -- 172.21.15.44:0/3398967994 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0eb0038250 msgr2=0x7f0eb003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.886+0000 7f0ed4aba640 1 --2- 172.21.15.44:0/3398967994 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0eb0038250 0x7f0eb003a710 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8034000 tx=0x7f0eb802e000 comp rx=0 tx=0).stop 2024-09-21T09:06:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.886+0000 7f0ed4aba640 1 -- 172.21.15.44:0/3398967994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed012e6f0 msgr2=0x7f0ed0131b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.886+0000 7f0ed4aba640 1 --2- 172.21.15.44:0/3398967994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed012e6f0 0x7f0ed0131b50 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000c370 tx=0x7f0ec000c830 comp rx=0 tx=0).stop 2024-09-21T09:06:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.886+0000 7f0ed4aba640 1 -- 172.21.15.44:0/3398967994 shutdown_connections 2024-09-21T09:06:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.886+0000 7f0ed4aba640 1 --2- 172.21.15.44:0/3398967994 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0eb0038250 0x7f0eb003a710 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.886+0000 7f0ed4aba640 1 --2- 172.21.15.44:0/3398967994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed012e6f0 0x7f0ed0131b50 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.886+0000 7f0ed4aba640 1 -- 172.21.15.44:0/3398967994 >> 172.21.15.44:0/3398967994 conn(0x7f0ed009f020 msgr2=0x7f0ed00973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.887+0000 7f0ed4aba640 1 -- 172.21.15.44:0/3398967994 shutdown_connections 2024-09-21T09:06:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:15.887+0000 7f0ed4aba640 1 -- 172.21.15.44:0/3398967994 wait complete. 2024-09-21T09:06:15.899 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T09:06:15.899 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T09:06:16.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.002+0000 7f6aea798640 1 Processor -- start 2024-09-21T09:06:16.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.002+0000 7f6aea798640 1 -- start start 2024-09-21T09:06:16.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.002+0000 7f6aea798640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ae4093b70 0x7f6ae40955a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.002+0000 7f6aea798640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ae4096960 con 0x7f6ae4095ae0 2024-09-21T09:06:16.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.002+0000 7f6aea798640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f6ae4093f50 con 0x7f6ae4093b70 2024-09-21T09:06:16.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.003+0000 7f6ae3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ae4093b70 0x7f6ae40955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.003+0000 7f6ae37fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6ae4095ae0 0x7f6ae4095ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58312/0 (socket says 172.21.15.44:58312) 2024-09-21T09:06:16.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.003+0000 7f6ae37fe640 1 -- 172.21.15.44:0/1666267007 learned_addr learned my addr 172.21.15.44:0/1666267007 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:16.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.003+0000 7f6ae3fff640 1 -- 172.21.15.44:0/1666267007 >> v1:172.21.15.44:6789/0 conn(0x7f6ae4095ae0 legacy=0x7f6ae4095ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.003+0000 7f6ae2ffd640 1 -- 172.21.15.44:0/1666267007 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776549527 0 0) 0x7f6ae4096960 con 0x7f6ae4095ae0 2024-09-21T09:06:16.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.003+0000 7f6ae3fff640 1 -- 172.21.15.44:0/1666267007 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae4074dc0 con 0x7f6ae4093b70 2024-09-21T09:06:16.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.004+0000 7f6ae3fff640 1 --2- 172.21.15.44:0/1666267007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4093b70 0x7f6ae40955a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009720 tx=0x7f6ad402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b6aef56257a265 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.004+0000 7f6ae2ffd640 1 -- 172.21.15.44:0/1666267007 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad4037070 con 0x7f6ae4093b70 2024-09-21T09:06:16.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.004+0000 7f6ae2ffd640 1 -- 172.21.15.44:0/1666267007 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad402ad90 con 0x7f6ae4093b70 2024-09-21T09:06:16.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.004+0000 7f6ae2ffd640 1 -- 172.21.15.44:0/1666267007 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad4032590 con 0x7f6ae4093b70 2024-09-21T09:06:16.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.004+0000 7f6aea798640 1 -- 172.21.15.44:0/1666267007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4093b70 msgr2=0x7f6ae40955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.004+0000 7f6aea798640 1 --2- 172.21.15.44:0/1666267007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4093b70 0x7f6ae40955a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009720 tx=0x7f6ad402a110 comp rx=0 tx=0).stop 2024-09-21T09:06:16.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.004+0000 7f6aea798640 1 -- 172.21.15.44:0/1666267007 shutdown_connections 2024-09-21T09:06:16.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.004+0000 7f6aea798640 1 --2- 172.21.15.44:0/1666267007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4093b70 0x7f6ae40955a0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.004+0000 7f6aea798640 1 -- 172.21.15.44:0/1666267007 >> 172.21.15.44:0/1666267007 conn(0x7f6ae409b5c0 msgr2=0x7f6ae409b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:16.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.004+0000 7f6aea798640 1 -- 172.21.15.44:0/1666267007 shutdown_connections 2024-09-21T09:06:16.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.004+0000 7f6aea798640 1 -- 172.21.15.44:0/1666267007 wait complete. 2024-09-21T09:06:16.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.005+0000 7f6aea798640 1 Processor -- start 2024-09-21T09:06:16.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.005+0000 7f6aea798640 1 -- start start 2024-09-21T09:06:16.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.006+0000 7f6aea798640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4093b70 0x7f6ae4122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.006+0000 7f6aea798640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae4134460 con 0x7f6ae4093b70 2024-09-21T09:06:16.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.006+0000 7f6ae3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4093b70 0x7f6ae4122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.006+0000 7f6ae3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4093b70 0x7f6ae4122a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53146/0 (socket says 172.21.15.44:53146) 2024-09-21T09:06:16.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.006+0000 7f6ae3fff640 1 -- 172.21.15.44:0/2525393620 learned_addr learned my addr 172.21.15.44:0/2525393620 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:16.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.006+0000 7f6ae3fff640 1 -- 172.21.15.44:0/2525393620 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae41247d0 con 0x7f6ae4093b70 2024-09-21T09:06:16.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.006+0000 7f6ae3fff640 1 --2- 172.21.15.44:0/2525393620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4093b70 0x7f6ae4122a20 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4035040 tx=0x7f6ad40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.006+0000 7f6ae0ff9640 1 -- 172.21.15.44:0/2525393620 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad4037040 con 0x7f6ae4093b70 2024-09-21T09:06:16.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.006+0000 7f6ae0ff9640 1 -- 172.21.15.44:0/2525393620 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad4004160 con 0x7f6ae4093b70 2024-09-21T09:06:16.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.006+0000 7f6aea798640 1 -- 172.21.15.44:0/2525393620 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae40970b0 con 0x7f6ae4093b70 2024-09-21T09:06:16.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.006+0000 7f6ae0ff9640 1 -- 172.21.15.44:0/2525393620 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad4004440 con 0x7f6ae4093b70 2024-09-21T09:06:16.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.006+0000 7f6aea798640 1 -- 172.21.15.44:0/2525393620 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae4125640 con 0x7f6ae4093b70 2024-09-21T09:06:16.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.007+0000 7f6aea798640 1 -- 172.21.15.44:0/2525393620 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ae40955a0 con 0x7f6ae4093b70 2024-09-21T09:06:16.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.007+0000 7f6ae0ff9640 1 -- 172.21.15.44:0/2525393620 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6ad4003610 con 0x7f6ae4093b70 2024-09-21T09:06:16.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.008+0000 7f6ae0ff9640 1 --2- 172.21.15.44:0/2525393620 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ad00382a0 0x7f6ad003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.008+0000 7f6ae0ff9640 1 -- 172.21.15.44:0/2525393620 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f6ad406ccd0 con 0x7f6ae4093b70 2024-09-21T09:06:16.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.008+0000 7f6ae0ff9640 1 --2- 172.21.15.44:0/2525393620 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x7f6ad00440a0 0x7f6ad0046540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.008+0000 7f6ae0ff9640 1 -- 172.21.15.44:0/2525393620 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ad4044ec0 con 0x7f6ad00440a0 2024-09-21T09:06:16.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.008+0000 7f6ae0ff9640 1 -- 172.21.15.44:0/2525393620 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6ad406f320 con 0x7f6ae4093b70 2024-09-21T09:06:16.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.008+0000 7f6ae37fe640 1 --2- 172.21.15.44:0/2525393620 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ad00382a0 0x7f6ad003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.008+0000 7f6ae8d35640 1 --2- 172.21.15.44:0/2525393620 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x7f6ad00440a0 0x7f6ad0046540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.009+0000 7f6ae37fe640 1 --2- 172.21.15.44:0/2525393620 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ad00382a0 0x7f6ad003a760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8000c00 tx=0x7f6ad8007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.009+0000 7f6ae8d35640 1 --2- 172.21.15.44:0/2525393620 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x7f6ad00440a0 0x7f6ad0046540 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.010+0000 7f6ae0ff9640 1 -- 172.21.15.44:0/2525393620 <== osd.1 v2:172.21.15.178:6800/627496675 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ad4044ec0 con 0x7f6ad00440a0 2024-09-21T09:06:16.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.022+0000 7f6aea798640 1 -- 172.21.15.44:0/2525393620 --> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6ae4095ae0 con 0x7f6ad00440a0 2024-09-21T09:06:16.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.023+0000 7f6ae0ff9640 1 -- 172.21.15.44:0/2525393620 <== osd.1 v2:172.21.15.178:6800/627496675 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6ae4095ae0 con 0x7f6ad00440a0 2024-09-21T09:06:16.024 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-21T09:06:16.025 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T09:06:16.025 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-21T09:06:16.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.023+0000 7f6aea798640 1 -- 172.21.15.44:0/2525393620 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x7f6ad00440a0 msgr2=0x7f6ad0046540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.023+0000 7f6aea798640 1 --2- 172.21.15.44:0/2525393620 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x7f6ad00440a0 0x7f6ad0046540 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.023+0000 7f6aea798640 1 -- 172.21.15.44:0/2525393620 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ad00382a0 msgr2=0x7f6ad003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.023+0000 7f6aea798640 1 --2- 172.21.15.44:0/2525393620 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ad00382a0 0x7f6ad003a760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8000c00 tx=0x7f6ad8007970 comp rx=0 tx=0).stop 2024-09-21T09:06:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.023+0000 7f6aea798640 1 -- 172.21.15.44:0/2525393620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4093b70 msgr2=0x7f6ae4122a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.023+0000 7f6aea798640 1 --2- 172.21.15.44:0/2525393620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4093b70 0x7f6ae4122a20 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4035040 tx=0x7f6ad40046c0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.023+0000 7f6aea798640 1 -- 172.21.15.44:0/2525393620 shutdown_connections 2024-09-21T09:06:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.023+0000 7f6aea798640 1 --2- 172.21.15.44:0/2525393620 >> [v2:172.21.15.178:6800/627496675,v1:172.21.15.178:6801/627496675] conn(0x7f6ad00440a0 0x7f6ad0046540 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.023+0000 7f6aea798640 1 --2- 172.21.15.44:0/2525393620 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f6ad00382a0 0x7f6ad003a760 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.023+0000 7f6aea798640 1 --2- 172.21.15.44:0/2525393620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4093b70 0x7f6ae4122a20 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.023+0000 7f6aea798640 1 -- 172.21.15.44:0/2525393620 >> 172.21.15.44:0/2525393620 conn(0x7f6ae409b5c0 msgr2=0x7f6ae40982b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.023+0000 7f6aea798640 1 -- 172.21.15.44:0/2525393620 shutdown_connections 2024-09-21T09:06:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.023+0000 7f6aea798640 1 -- 172.21.15.44:0/2525393620 wait complete. 2024-09-21T09:06:16.035 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T09:06:16.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.135+0000 7fa2848a5640 1 Processor -- start 2024-09-21T09:06:16.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.135+0000 7fa2848a5640 1 -- start start 2024-09-21T09:06:16.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.136+0000 7fa2848a5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa28012cca0 0x7fa28012d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.136+0000 7fa2848a5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa28012d5c0 con 0x7fa2801290e0 2024-09-21T09:06:16.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.136+0000 7fa2848a5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fa28006e350 con 0x7fa28012cca0 2024-09-21T09:06:16.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.136+0000 7fa27e59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa28012cca0 0x7fa28012d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.136+0000 7fa27dd9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa2801290e0 0x7fa280129530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58322/0 (socket says 172.21.15.44:58322) 2024-09-21T09:06:16.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.136+0000 7fa27dd9b640 1 -- 172.21.15.44:0/4247863760 learned_addr learned my addr 172.21.15.44:0/4247863760 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:16.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.136+0000 7fa27e59c640 1 -- 172.21.15.44:0/4247863760 >> v1:172.21.15.44:6789/0 conn(0x7fa2801290e0 legacy=0x7fa280129530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.136+0000 7fa27e59c640 1 -- 172.21.15.44:0/4247863760 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa280071f70 con 0x7fa28012cca0 2024-09-21T09:06:16.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.136+0000 7fa27d59a640 1 -- 172.21.15.44:0/4247863760 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441307678 0 0) 0x7fa28012d5c0 con 0x7fa2801290e0 2024-09-21T09:06:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.137+0000 7fa27e59c640 1 --2- 172.21.15.44:0/4247863760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa28012cca0 0x7fa28012d080 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa270009720 tx=0x7fa27002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6ada1f4e83eaae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.137+0000 7fa27d59a640 1 -- 172.21.15.44:0/4247863760 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa270037070 con 0x7fa28012cca0 2024-09-21T09:06:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.137+0000 7fa27d59a640 1 -- 172.21.15.44:0/4247863760 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27002ad90 con 0x7fa28012cca0 2024-09-21T09:06:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.137+0000 7fa27d59a640 1 -- 172.21.15.44:0/4247863760 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa270032590 con 0x7fa28012cca0 2024-09-21T09:06:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.138+0000 7fa2848a5640 1 -- 172.21.15.44:0/4247863760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa28012cca0 msgr2=0x7fa28012d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.138+0000 7fa2848a5640 1 --2- 172.21.15.44:0/4247863760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa28012cca0 0x7fa28012d080 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa270009720 tx=0x7fa27002a110 comp rx=0 tx=0).stop 2024-09-21T09:06:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.138+0000 7fa2848a5640 1 -- 172.21.15.44:0/4247863760 shutdown_connections 2024-09-21T09:06:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.138+0000 7fa2848a5640 1 --2- 172.21.15.44:0/4247863760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa28012cca0 0x7fa28012d080 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.138+0000 7fa2848a5640 1 -- 172.21.15.44:0/4247863760 >> 172.21.15.44:0/4247863760 conn(0x7fa28009a890 msgr2=0x7fa28009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.138+0000 7fa2848a5640 1 -- 172.21.15.44:0/4247863760 shutdown_connections 2024-09-21T09:06:16.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.138+0000 7fa2848a5640 1 -- 172.21.15.44:0/4247863760 wait complete. 2024-09-21T09:06:16.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.139+0000 7fa2848a5640 1 Processor -- start 2024-09-21T09:06:16.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.139+0000 7fa2848a5640 1 -- start start 2024-09-21T09:06:16.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.139+0000 7fa2848a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2801290e0 0x7fa28008afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.139+0000 7fa2848a5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa280070e60 con 0x7fa2801290e0 2024-09-21T09:06:16.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.140+0000 7fa27e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2801290e0 0x7fa28008afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.140+0000 7fa27e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2801290e0 0x7fa28008afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53156/0 (socket says 172.21.15.44:53156) 2024-09-21T09:06:16.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.140+0000 7fa27e59c640 1 -- 172.21.15.44:0/1511284656 learned_addr learned my addr 172.21.15.44:0/1511284656 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:16.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.140+0000 7fa27e59c640 1 -- 172.21.15.44:0/1511284656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28008c3f0 con 0x7fa2801290e0 2024-09-21T09:06:16.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.140+0000 7fa27e59c640 1 --2- 172.21.15.44:0/1511284656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2801290e0 0x7fa28008afc0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa270009840 tx=0x7fa2700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.140+0000 7fa26effd640 1 -- 172.21.15.44:0/1511284656 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa270041070 con 0x7fa2801290e0 2024-09-21T09:06:16.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.140+0000 7fa26effd640 1 -- 172.21.15.44:0/1511284656 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27003c460 con 0x7fa2801290e0 2024-09-21T09:06:16.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.140+0000 7fa26effd640 1 -- 172.21.15.44:0/1511284656 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa270037040 con 0x7fa2801290e0 2024-09-21T09:06:16.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.140+0000 7fa2848a5640 1 -- 172.21.15.44:0/1511284656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2801265a0 con 0x7fa2801290e0 2024-09-21T09:06:16.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.140+0000 7fa2848a5640 1 -- 172.21.15.44:0/1511284656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa28008d500 con 0x7fa2801290e0 2024-09-21T09:06:16.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.141+0000 7fa26effd640 1 -- 172.21.15.44:0/1511284656 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa270044070 con 0x7fa2801290e0 2024-09-21T09:06:16.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.141+0000 7fa2848a5640 1 -- 172.21.15.44:0/1511284656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa28008e010 con 0x7fa2801290e0 2024-09-21T09:06:16.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.142+0000 7fa26effd640 1 --2- 172.21.15.44:0/1511284656 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa2600382a0 0x7fa26003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.142+0000 7fa26effd640 1 -- 172.21.15.44:0/1511284656 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fa27006c980 con 0x7fa2801290e0 2024-09-21T09:06:16.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.142+0000 7fa27dd9b640 1 --2- 172.21.15.44:0/1511284656 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa2600382a0 0x7fa26003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.142+0000 7fa27dd9b640 1 --2- 172.21.15.44:0/1511284656 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa2600382a0 0x7fa26003a760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa274000c00 tx=0x7fa274007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.146+0000 7fa26effd640 1 -- 172.21.15.44:0/1511284656 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa27003a520 con 0x7fa2801290e0 2024-09-21T09:06:16.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.323+0000 7fa2848a5640 1 -- 172.21.15.44:0/1511284656 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fa28008c870 con 0x7fa2600382a0 2024-09-21T09:06:16.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.324+0000 7fa26effd640 1 -- 172.21.15.44:0/1511284656 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa28008c870 con 0x7fa2600382a0 2024-09-21T09:06:16.325 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T09:06:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.326+0000 7fa2848a5640 1 -- 172.21.15.44:0/1511284656 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa2600382a0 msgr2=0x7fa26003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.326+0000 7fa2848a5640 1 --2- 172.21.15.44:0/1511284656 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa2600382a0 0x7fa26003a760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa274000c00 tx=0x7fa274007a40 comp rx=0 tx=0).stop 2024-09-21T09:06:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.326+0000 7fa2848a5640 1 -- 172.21.15.44:0/1511284656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2801290e0 msgr2=0x7fa28008afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.326+0000 7fa2848a5640 1 --2- 172.21.15.44:0/1511284656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2801290e0 0x7fa28008afc0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa270009840 tx=0x7fa2700046c0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.326+0000 7fa2848a5640 1 -- 172.21.15.44:0/1511284656 shutdown_connections 2024-09-21T09:06:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.326+0000 7fa2848a5640 1 --2- 172.21.15.44:0/1511284656 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fa2600382a0 0x7fa26003a760 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.326+0000 7fa2848a5640 1 --2- 172.21.15.44:0/1511284656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2801290e0 0x7fa28008afc0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.326+0000 7fa2848a5640 1 -- 172.21.15.44:0/1511284656 >> 172.21.15.44:0/1511284656 conn(0x7fa28009a890 msgr2=0x7fa280128980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.326+0000 7fa2848a5640 1 -- 172.21.15.44:0/1511284656 shutdown_connections 2024-09-21T09:06:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.326+0000 7fa2848a5640 1 -- 172.21.15.44:0/1511284656 wait complete. 2024-09-21T09:06:16.339 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T09:06:16.339 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T09:06:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.443+0000 7fb41521e640 1 Processor -- start 2024-09-21T09:06:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.443+0000 7fb41521e640 1 -- start start 2024-09-21T09:06:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.444+0000 7fb41521e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb4100995d0 0x7fb410099c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.444+0000 7fb41521e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb410098a60 con 0x7fb41009a1c0 2024-09-21T09:06:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.444+0000 7fb41521e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb4100992c0 con 0x7fb4100995d0 2024-09-21T09:06:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.444+0000 7fb40ed9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb4100995d0 0x7fb410099c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.444+0000 7fb40e59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb41009a1c0 0x7fb41009be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58334/0 (socket says 172.21.15.44:58334) 2024-09-21T09:06:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.444+0000 7fb40e59c640 1 -- 172.21.15.44:0/3910523079 learned_addr learned my addr 172.21.15.44:0/3910523079 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.444+0000 7fb40ed9d640 1 -- 172.21.15.44:0/3910523079 >> v1:172.21.15.44:6789/0 conn(0x7fb41009a1c0 legacy=0x7fb41009be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.444+0000 7fb40dd9b640 1 -- 172.21.15.44:0/3910523079 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2244112708 0 0) 0x7fb410098a60 con 0x7fb41009a1c0 2024-09-21T09:06:16.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.444+0000 7fb40ed9d640 1 -- 172.21.15.44:0/3910523079 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41009a5d0 con 0x7fb4100995d0 2024-09-21T09:06:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.445+0000 7fb40ed9d640 1 --2- 172.21.15.44:0/3910523079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4100995d0 0x7fb410099c80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb400009720 tx=0x7fb40002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f83373481663ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.445+0000 7fb40dd9b640 1 -- 172.21.15.44:0/3910523079 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb400037070 con 0x7fb4100995d0 2024-09-21T09:06:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.445+0000 7fb40dd9b640 1 -- 172.21.15.44:0/3910523079 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb40002ad90 con 0x7fb4100995d0 2024-09-21T09:06:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.445+0000 7fb40dd9b640 1 -- 172.21.15.44:0/3910523079 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb400032590 con 0x7fb4100995d0 2024-09-21T09:06:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.445+0000 7fb41521e640 1 -- 172.21.15.44:0/3910523079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4100995d0 msgr2=0x7fb410099c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.445+0000 7fb41521e640 1 --2- 172.21.15.44:0/3910523079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4100995d0 0x7fb410099c80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb400009720 tx=0x7fb40002a110 comp rx=0 tx=0).stop 2024-09-21T09:06:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.445+0000 7fb41521e640 1 -- 172.21.15.44:0/3910523079 shutdown_connections 2024-09-21T09:06:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.445+0000 7fb41521e640 1 --2- 172.21.15.44:0/3910523079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4100995d0 0x7fb410099c80 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.445+0000 7fb41521e640 1 -- 172.21.15.44:0/3910523079 >> 172.21.15.44:0/3910523079 conn(0x7fb41006d4b0 msgr2=0x7fb41006d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.446+0000 7fb41521e640 1 -- 172.21.15.44:0/3910523079 shutdown_connections 2024-09-21T09:06:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.446+0000 7fb41521e640 1 -- 172.21.15.44:0/3910523079 wait complete. 2024-09-21T09:06:16.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.447+0000 7fb41521e640 1 Processor -- start 2024-09-21T09:06:16.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.447+0000 7fb41521e640 1 -- start start 2024-09-21T09:06:16.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.447+0000 7fb41521e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4100995d0 0x7fb4101b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.447+0000 7fb41521e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb41009c950 con 0x7fb4100995d0 2024-09-21T09:06:16.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.447+0000 7fb40ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4100995d0 0x7fb4101b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.447+0000 7fb40ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4100995d0 0x7fb4101b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53168/0 (socket says 172.21.15.44:53168) 2024-09-21T09:06:16.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.447+0000 7fb40ed9d640 1 -- 172.21.15.44:0/3704041097 learned_addr learned my addr 172.21.15.44:0/3704041097 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:16.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.447+0000 7fb40ed9d640 1 -- 172.21.15.44:0/3704041097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41008bd40 con 0x7fb4100995d0 2024-09-21T09:06:16.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.448+0000 7fb40ed9d640 1 --2- 172.21.15.44:0/3704041097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4100995d0 0x7fb4101b3280 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb400009720 tx=0x7fb4000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.448+0000 7fb3f77fe640 1 -- 172.21.15.44:0/3704041097 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb400041070 con 0x7fb4100995d0 2024-09-21T09:06:16.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.448+0000 7fb3f77fe640 1 -- 172.21.15.44:0/3704041097 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb40003c460 con 0x7fb4100995d0 2024-09-21T09:06:16.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.448+0000 7fb41521e640 1 -- 172.21.15.44:0/3704041097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb41008c190 con 0x7fb4100995d0 2024-09-21T09:06:16.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.448+0000 7fb3f77fe640 1 -- 172.21.15.44:0/3704041097 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb400037040 con 0x7fb4100995d0 2024-09-21T09:06:16.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.448+0000 7fb41521e640 1 -- 172.21.15.44:0/3704041097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4101b37c0 con 0x7fb4100995d0 2024-09-21T09:06:16.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.448+0000 7fb41521e640 1 -- 172.21.15.44:0/3704041097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb4101b43e0 con 0x7fb4100995d0 2024-09-21T09:06:16.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.449+0000 7fb3f77fe640 1 -- 172.21.15.44:0/3704041097 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb400044070 con 0x7fb4100995d0 2024-09-21T09:06:16.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.449+0000 7fb3f77fe640 1 --2- 172.21.15.44:0/3704041097 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb3fc0382a0 0x7fb3fc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.449+0000 7fb3f77fe640 1 -- 172.21.15.44:0/3704041097 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fb40006c480 con 0x7fb4100995d0 2024-09-21T09:06:16.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.449+0000 7fb3f77fe640 1 --2- 172.21.15.44:0/3704041097 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb3fc0440a0 0x7fb3fc046540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.449+0000 7fb3f77fe640 1 -- 172.21.15.44:0/3704041097 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb40002ad90 con 0x7fb3fc0440a0 2024-09-21T09:06:16.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.449+0000 7fb3f77fe640 1 -- 172.21.15.44:0/3704041097 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb400073050 con 0x7fb4100995d0 2024-09-21T09:06:16.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.449+0000 7fb40e59c640 1 --2- 172.21.15.44:0/3704041097 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb3fc0382a0 0x7fb3fc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.449+0000 7fb40f59e640 1 --2- 172.21.15.44:0/3704041097 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb3fc0440a0 0x7fb3fc046540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.450+0000 7fb40f59e640 1 --2- 172.21.15.44:0/3704041097 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb3fc0440a0 0x7fb3fc046540 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.450+0000 7fb40e59c640 1 --2- 172.21.15.44:0/3704041097 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb3fc0382a0 0x7fb3fc03a760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb404000c00 tx=0x7fb404007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.451+0000 7fb3f77fe640 1 -- 172.21.15.44:0/3704041097 <== osd.2 v2:172.21.15.178:6816/3267136144 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb40002ad90 con 0x7fb3fc0440a0 2024-09-21T09:06:16.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.463+0000 7fb41521e640 1 -- 172.21.15.44:0/3704041097 --> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb410099c80 con 0x7fb3fc0440a0 2024-09-21T09:06:16.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.464+0000 7fb3f77fe640 1 -- 172.21.15.44:0/3704041097 <== osd.2 v2:172.21.15.178:6816/3267136144 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb410099c80 con 0x7fb3fc0440a0 2024-09-21T09:06:16.465 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-21T09:06:16.465 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T09:06:16.465 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-21T09:06:16.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.464+0000 7fb41521e640 1 -- 172.21.15.44:0/3704041097 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb3fc0440a0 msgr2=0x7fb3fc046540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.464+0000 7fb41521e640 1 --2- 172.21.15.44:0/3704041097 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb3fc0440a0 0x7fb3fc046540 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.464+0000 7fb41521e640 1 -- 172.21.15.44:0/3704041097 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb3fc0382a0 msgr2=0x7fb3fc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.464+0000 7fb41521e640 1 --2- 172.21.15.44:0/3704041097 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb3fc0382a0 0x7fb3fc03a760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb404000c00 tx=0x7fb404007970 comp rx=0 tx=0).stop 2024-09-21T09:06:16.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.464+0000 7fb41521e640 1 -- 172.21.15.44:0/3704041097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4100995d0 msgr2=0x7fb4101b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.464+0000 7fb41521e640 1 --2- 172.21.15.44:0/3704041097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4100995d0 0x7fb4101b3280 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb400009720 tx=0x7fb4000046c0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.464+0000 7fb41521e640 1 -- 172.21.15.44:0/3704041097 shutdown_connections 2024-09-21T09:06:16.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.464+0000 7fb41521e640 1 --2- 172.21.15.44:0/3704041097 >> [v2:172.21.15.178:6816/3267136144,v1:172.21.15.178:6817/3267136144] conn(0x7fb3fc0440a0 0x7fb3fc046540 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.464+0000 7fb41521e640 1 --2- 172.21.15.44:0/3704041097 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb3fc0382a0 0x7fb3fc03a760 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.464+0000 7fb41521e640 1 --2- 172.21.15.44:0/3704041097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4100995d0 0x7fb4101b3280 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.464+0000 7fb41521e640 1 -- 172.21.15.44:0/3704041097 >> 172.21.15.44:0/3704041097 conn(0x7fb41006d4b0 msgr2=0x7fb41009ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:16.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.464+0000 7fb41521e640 1 -- 172.21.15.44:0/3704041097 shutdown_connections 2024-09-21T09:06:16.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.464+0000 7fb41521e640 1 -- 172.21.15.44:0/3704041097 wait complete. 2024-09-21T09:06:16.476 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T09:06:16.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.576+0000 7f19b4303640 1 Processor -- start 2024-09-21T09:06:16.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.576+0000 7f19b4303640 1 -- start start 2024-09-21T09:06:16.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.577+0000 7f19b4303640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f19ac06eda0 0x7f19ac06f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.577+0000 7f19b4303640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19ac06eba0 con 0x7f19ac06f6c0 2024-09-21T09:06:16.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.577+0000 7f19b4303640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f19ac06d2f0 con 0x7f19ac06eda0 2024-09-21T09:06:16.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.577+0000 7f19b209f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f19ac06eda0 0x7f19ac06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.577+0000 7f19b189e640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f19ac06f6c0 0x7f19ac121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58348/0 (socket says 172.21.15.44:58348) 2024-09-21T09:06:16.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.577+0000 7f19b189e640 1 -- 172.21.15.44:0/1475462496 learned_addr learned my addr 172.21.15.44:0/1475462496 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:16.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.577+0000 7f19b209f640 1 -- 172.21.15.44:0/1475462496 >> v1:172.21.15.44:6789/0 conn(0x7f19ac06f6c0 legacy=0x7f19ac121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.577+0000 7f19b209f640 1 -- 172.21.15.44:0/1475462496 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ac070d50 con 0x7f19ac06eda0 2024-09-21T09:06:16.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.578+0000 7f19b209f640 1 --2- 172.21.15.44:0/1475462496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19ac06eda0 0x7f19ac06f180 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f199c009d90 tx=0x7f199c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b8ba4c96bdbae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.578+0000 7f19b109d640 1 -- 172.21.15.44:0/1475462496 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f199c007670 con 0x7f19ac06eda0 2024-09-21T09:06:16.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.578+0000 7f19b109d640 1 -- 172.21.15.44:0/1475462496 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f199c007810 con 0x7f19ac06eda0 2024-09-21T09:06:16.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.578+0000 7f19b109d640 1 -- 172.21.15.44:0/1475462496 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f199c007b10 con 0x7f19ac06eda0 2024-09-21T09:06:16.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.578+0000 7f19b4303640 1 -- 172.21.15.44:0/1475462496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19ac06eda0 msgr2=0x7f19ac06f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.578+0000 7f19b4303640 1 --2- 172.21.15.44:0/1475462496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19ac06eda0 0x7f19ac06f180 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f199c009d90 tx=0x7f199c02a6f0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.579+0000 7f19b4303640 1 -- 172.21.15.44:0/1475462496 shutdown_connections 2024-09-21T09:06:16.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.579+0000 7f19b4303640 1 --2- 172.21.15.44:0/1475462496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19ac06eda0 0x7f19ac06f180 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.579+0000 7f19b4303640 1 -- 172.21.15.44:0/1475462496 >> 172.21.15.44:0/1475462496 conn(0x7f19ac09a890 msgr2=0x7f19ac09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:16.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.579+0000 7f19b4303640 1 -- 172.21.15.44:0/1475462496 shutdown_connections 2024-09-21T09:06:16.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.579+0000 7f19b4303640 1 -- 172.21.15.44:0/1475462496 wait complete. 2024-09-21T09:06:16.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.579+0000 7f19b4303640 1 Processor -- start 2024-09-21T09:06:16.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.579+0000 7f19b4303640 1 -- start start 2024-09-21T09:06:16.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.580+0000 7f19b4303640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19ac06eda0 0x7f19ac08bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.580+0000 7f19b4303640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac122160 con 0x7f19ac06eda0 2024-09-21T09:06:16.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.580+0000 7f19b209f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19ac06eda0 0x7f19ac08bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.580+0000 7f19b209f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19ac06eda0 0x7f19ac08bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53192/0 (socket says 172.21.15.44:53192) 2024-09-21T09:06:16.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.580+0000 7f19b209f640 1 -- 172.21.15.44:0/1508779828 learned_addr learned my addr 172.21.15.44:0/1508779828 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:16.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.580+0000 7f19b209f640 1 -- 172.21.15.44:0/1508779828 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ac08d8e0 con 0x7f19ac06eda0 2024-09-21T09:06:16.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.580+0000 7f19b209f640 1 --2- 172.21.15.44:0/1508779828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19ac06eda0 0x7f19ac08bca0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f199c009eb0 tx=0x7f199c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.580+0000 7f19aaffd640 1 -- 172.21.15.44:0/1508779828 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f199c040070 con 0x7f19ac06eda0 2024-09-21T09:06:16.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.581+0000 7f19aaffd640 1 -- 172.21.15.44:0/1508779828 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f199c0079c0 con 0x7f19ac06eda0 2024-09-21T09:06:16.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.581+0000 7f19aaffd640 1 -- 172.21.15.44:0/1508779828 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f199c007670 con 0x7f19ac06eda0 2024-09-21T09:06:16.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.581+0000 7f19b4303640 1 -- 172.21.15.44:0/1508779828 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ac08c1e0 con 0x7f19ac06eda0 2024-09-21T09:06:16.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.581+0000 7f19b4303640 1 -- 172.21.15.44:0/1508779828 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ac08c6b0 con 0x7f19ac06eda0 2024-09-21T09:06:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.581+0000 7f19aaffd640 1 -- 172.21.15.44:0/1508779828 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f199c039040 con 0x7f19ac06eda0 2024-09-21T09:06:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.581+0000 7f19b4303640 1 -- 172.21.15.44:0/1508779828 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ac122670 con 0x7f19ac06eda0 2024-09-21T09:06:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.582+0000 7f19aaffd640 1 --2- 172.21.15.44:0/1508779828 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f19980381b0 0x7f199803a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.582+0000 7f19aaffd640 1 -- 172.21.15.44:0/1508779828 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f199c06d830 con 0x7f19ac06eda0 2024-09-21T09:06:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.582+0000 7f19b189e640 1 --2- 172.21.15.44:0/1508779828 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f19980381b0 0x7f199803a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.582+0000 7f19b189e640 1 --2- 172.21.15.44:0/1508779828 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f19980381b0 0x7f199803a670 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f19a0000f60 tx=0x7f19a0007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.586+0000 7f19aaffd640 1 -- 172.21.15.44:0/1508779828 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f199c0443c0 con 0x7f19ac06eda0 2024-09-21T09:06:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.761+0000 7f19b4303640 1 -- 172.21.15.44:0/1508779828 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f19ac08e140 con 0x7f19980381b0 2024-09-21T09:06:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.762+0000 7f19aaffd640 1 -- 172.21.15.44:0/1508779828 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f19ac08e140 con 0x7f19980381b0 2024-09-21T09:06:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T09:06:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.764+0000 7f19b4303640 1 -- 172.21.15.44:0/1508779828 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f19980381b0 msgr2=0x7f199803a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.764+0000 7f19b4303640 1 --2- 172.21.15.44:0/1508779828 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f19980381b0 0x7f199803a670 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f19a0000f60 tx=0x7f19a0007a80 comp rx=0 tx=0).stop 2024-09-21T09:06:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.764+0000 7f19b4303640 1 -- 172.21.15.44:0/1508779828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19ac06eda0 msgr2=0x7f19ac08bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.764+0000 7f19b4303640 1 --2- 172.21.15.44:0/1508779828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19ac06eda0 0x7f19ac08bca0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f199c009eb0 tx=0x7f199c004a40 comp rx=0 tx=0).stop 2024-09-21T09:06:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.764+0000 7f19b4303640 1 -- 172.21.15.44:0/1508779828 shutdown_connections 2024-09-21T09:06:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.764+0000 7f19b4303640 1 --2- 172.21.15.44:0/1508779828 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f19980381b0 0x7f199803a670 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.764+0000 7f19b4303640 1 --2- 172.21.15.44:0/1508779828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19ac06eda0 0x7f19ac08bca0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.764+0000 7f19b4303640 1 -- 172.21.15.44:0/1508779828 >> 172.21.15.44:0/1508779828 conn(0x7f19ac09a890 msgr2=0x7f19ac1293b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.764+0000 7f19b4303640 1 -- 172.21.15.44:0/1508779828 shutdown_connections 2024-09-21T09:06:16.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.764+0000 7f19b4303640 1 -- 172.21.15.44:0/1508779828 wait complete. 2024-09-21T09:06:16.776 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T09:06:16.777 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T09:06:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.880+0000 7f13a5e27640 1 Processor -- start 2024-09-21T09:06:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.880+0000 7f13a5e27640 1 -- start start 2024-09-21T09:06:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.881+0000 7f13a5e27640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f13a006f4b0 0x7f13a006f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.881+0000 7f13a5e27640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13a0071100 con 0x7f13a006fdd0 2024-09-21T09:06:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.881+0000 7f13a5e27640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f13a0072440 con 0x7f13a006f4b0 2024-09-21T09:06:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.881+0000 7f139f7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f13a006f4b0 0x7f13a006f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.881+0000 7f139effd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f13a006fdd0 0x7f13a0130c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58356/0 (socket says 172.21.15.44:58356) 2024-09-21T09:06:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.881+0000 7f139effd640 1 -- 172.21.15.44:0/3339900238 learned_addr learned my addr 172.21.15.44:0/3339900238 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.881+0000 7f139e7fc640 1 -- 172.21.15.44:0/3339900238 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1953654515 0 0) 0x7f13a0071100 con 0x7f13a006fdd0 2024-09-21T09:06:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.881+0000 7f139e7fc640 1 -- 172.21.15.44:0/3339900238 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1388003520 con 0x7f13a006fdd0 2024-09-21T09:06:16.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.881+0000 7f139f7fe640 1 -- 172.21.15.44:0/3339900238 >> v1:172.21.15.44:6789/0 conn(0x7f13a006fdd0 legacy=0x7f13a0130c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.881+0000 7f139f7fe640 1 -- 172.21.15.44:0/3339900238 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a0071580 con 0x7f13a006f4b0 2024-09-21T09:06:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.882+0000 7f139f7fe640 1 --2- 172.21.15.44:0/3339900238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13a006f4b0 0x7f13a006f890 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1390009720 tx=0x7f139002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720b212da9339ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.882+0000 7f139e7fc640 1 -- 172.21.15.44:0/3339900238 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1390037070 con 0x7f13a006f4b0 2024-09-21T09:06:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.882+0000 7f139e7fc640 1 -- 172.21.15.44:0/3339900238 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f139002ad90 con 0x7f13a006f4b0 2024-09-21T09:06:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.882+0000 7f139e7fc640 1 -- 172.21.15.44:0/3339900238 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1390032590 con 0x7f13a006f4b0 2024-09-21T09:06:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.882+0000 7f13a5e27640 1 -- 172.21.15.44:0/3339900238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13a006f4b0 msgr2=0x7f13a006f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.882+0000 7f13a5e27640 1 --2- 172.21.15.44:0/3339900238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13a006f4b0 0x7f13a006f890 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1390009720 tx=0x7f139002a110 comp rx=0 tx=0).stop 2024-09-21T09:06:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.882+0000 7f13a5e27640 1 -- 172.21.15.44:0/3339900238 shutdown_connections 2024-09-21T09:06:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.882+0000 7f13a5e27640 1 --2- 172.21.15.44:0/3339900238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13a006f4b0 0x7f13a006f890 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.882+0000 7f13a5e27640 1 -- 172.21.15.44:0/3339900238 >> 172.21.15.44:0/3339900238 conn(0x7f13a009ca00 msgr2=0x7f13a009ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.883+0000 7f13a5e27640 1 -- 172.21.15.44:0/3339900238 shutdown_connections 2024-09-21T09:06:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.883+0000 7f13a5e27640 1 -- 172.21.15.44:0/3339900238 wait complete. 2024-09-21T09:06:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.883+0000 7f13a5e27640 1 Processor -- start 2024-09-21T09:06:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.884+0000 7f13a5e27640 1 -- start start 2024-09-21T09:06:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.884+0000 7f13a5e27640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13a006f4b0 0x7f13a0129c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.884+0000 7f13a5e27640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f13a0070450 con 0x7f13a006f4b0 2024-09-21T09:06:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.884+0000 7f139f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13a006f4b0 0x7f13a0129c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.884+0000 7f139f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13a006f4b0 0x7f13a0129c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53210/0 (socket says 172.21.15.44:53210) 2024-09-21T09:06:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.884+0000 7f139f7fe640 1 -- 172.21.15.44:0/2504915539 learned_addr learned my addr 172.21.15.44:0/2504915539 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.884+0000 7f139f7fe640 1 -- 172.21.15.44:0/2504915539 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a012c8b0 con 0x7f13a006f4b0 2024-09-21T09:06:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.884+0000 7f139f7fe640 1 --2- 172.21.15.44:0/2504915539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13a006f4b0 0x7f13a0129c50 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f1390000c00 tx=0x7f13900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.884+0000 7f1387fff640 1 -- 172.21.15.44:0/2504915539 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1390041070 con 0x7f13a006f4b0 2024-09-21T09:06:16.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.885+0000 7f1387fff640 1 -- 172.21.15.44:0/2504915539 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f139003c460 con 0x7f13a006f4b0 2024-09-21T09:06:16.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.885+0000 7f13a5e27640 1 -- 172.21.15.44:0/2504915539 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a012cae0 con 0x7f13a006f4b0 2024-09-21T09:06:16.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.885+0000 7f1387fff640 1 -- 172.21.15.44:0/2504915539 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1390037040 con 0x7f13a006f4b0 2024-09-21T09:06:16.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.885+0000 7f13a5e27640 1 -- 172.21.15.44:0/2504915539 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a012a370 con 0x7f13a006f4b0 2024-09-21T09:06:16.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.885+0000 7f1387fff640 1 -- 172.21.15.44:0/2504915539 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1390044070 con 0x7f13a006f4b0 2024-09-21T09:06:16.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.886+0000 7f1387fff640 1 --2- 172.21.15.44:0/2504915539 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f138c0382a0 0x7f138c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.886+0000 7f13a5e27640 1 -- 172.21.15.44:0/2504915539 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f13a0072660 con 0x7f13a006f4b0 2024-09-21T09:06:16.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.886+0000 7f1387fff640 1 -- 172.21.15.44:0/2504915539 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f139006c2e0 con 0x7f13a006f4b0 2024-09-21T09:06:16.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.886+0000 7f1387fff640 1 --2- 172.21.15.44:0/2504915539 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x7f138c044080 0x7f138c046520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:16.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.886+0000 7f1387fff640 1 -- 172.21.15.44:0/2504915539 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f139002ad90 con 0x7f138c044080 2024-09-21T09:06:16.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.886+0000 7f1387fff640 1 -- 172.21.15.44:0/2504915539 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f13900453b0 con 0x7f13a006f4b0 2024-09-21T09:06:16.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.886+0000 7f139effd640 1 --2- 172.21.15.44:0/2504915539 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f138c0382a0 0x7f138c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.886+0000 7f139ffff640 1 --2- 172.21.15.44:0/2504915539 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x7f138c044080 0x7f138c046520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:16.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.887+0000 7f139ffff640 1 --2- 172.21.15.44:0/2504915539 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x7f138c044080 0x7f138c046520 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.887+0000 7f139effd640 1 --2- 172.21.15.44:0/2504915539 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f138c0382a0 0x7f138c03a760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f13940011e0 tx=0x7f1394007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:16.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.887+0000 7f1387fff640 1 -- 172.21.15.44:0/2504915539 <== osd.3 v2:172.21.15.178:6808/24558189 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f139002ad90 con 0x7f138c044080 2024-09-21T09:06:16.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.900+0000 7f13a5e27640 1 -- 172.21.15.44:0/2504915539 --> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f13a0132310 con 0x7f138c044080 2024-09-21T09:06:16.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.900+0000 7f1387fff640 1 -- 172.21.15.44:0/2504915539 <== osd.3 v2:172.21.15.178:6808/24558189 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f13a0132310 con 0x7f138c044080 2024-09-21T09:06:16.902 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-21T09:06:16.902 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T09:06:16.902 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-21T09:06:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.901+0000 7f13a5e27640 1 -- 172.21.15.44:0/2504915539 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x7f138c044080 msgr2=0x7f138c046520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.901+0000 7f13a5e27640 1 --2- 172.21.15.44:0/2504915539 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x7f138c044080 0x7f138c046520 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.901+0000 7f13a5e27640 1 -- 172.21.15.44:0/2504915539 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f138c0382a0 msgr2=0x7f138c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.901+0000 7f13a5e27640 1 --2- 172.21.15.44:0/2504915539 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f138c0382a0 0x7f138c03a760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f13940011e0 tx=0x7f1394007970 comp rx=0 tx=0).stop 2024-09-21T09:06:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.901+0000 7f13a5e27640 1 -- 172.21.15.44:0/2504915539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13a006f4b0 msgr2=0x7f13a0129c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.901+0000 7f13a5e27640 1 --2- 172.21.15.44:0/2504915539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13a006f4b0 0x7f13a0129c50 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f1390000c00 tx=0x7f13900046c0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.901+0000 7f13a5e27640 1 -- 172.21.15.44:0/2504915539 shutdown_connections 2024-09-21T09:06:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.901+0000 7f13a5e27640 1 --2- 172.21.15.44:0/2504915539 >> [v2:172.21.15.178:6808/24558189,v1:172.21.15.178:6809/24558189] conn(0x7f138c044080 0x7f138c046520 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.901+0000 7f13a5e27640 1 --2- 172.21.15.44:0/2504915539 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f138c0382a0 0x7f138c03a760 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.901+0000 7f13a5e27640 1 --2- 172.21.15.44:0/2504915539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13a006f4b0 0x7f13a0129c50 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.901+0000 7f13a5e27640 1 -- 172.21.15.44:0/2504915539 >> 172.21.15.44:0/2504915539 conn(0x7f13a009ca00 msgr2=0x7f13a0099500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.901+0000 7f13a5e27640 1 -- 172.21.15.44:0/2504915539 shutdown_connections 2024-09-21T09:06:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:16.901+0000 7f13a5e27640 1 -- 172.21.15.44:0/2504915539 wait complete. 2024-09-21T09:06:16.913 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T09:06:17.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.013+0000 7fd40d053640 1 Processor -- start 2024-09-21T09:06:17.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.013+0000 7fd40d053640 1 -- start start 2024-09-21T09:06:17.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.013+0000 7fd40d053640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd40812e940 0x7fd408130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:17.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.013+0000 7fd40d053640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40806eba0 con 0x7fd40806eda0 2024-09-21T09:06:17.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.013+0000 7fd40d053640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd40806d2f0 con 0x7fd40812e940 2024-09-21T09:06:17.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.013+0000 7fd40659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd40812e940 0x7fd408130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:17.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.013+0000 7fd406d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd40806eda0 0x7fd40806f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58364/0 (socket says 172.21.15.44:58364) 2024-09-21T09:06:17.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.013+0000 7fd40659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd40812e940 0x7fd408130d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53214/0 (socket says 172.21.15.44:53214) 2024-09-21T09:06:17.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.013+0000 7fd406d9d640 1 -- 172.21.15.44:0/1149536411 learned_addr learned my addr 172.21.15.44:0/1149536411 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:17.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.014+0000 7fd40659c640 1 -- 172.21.15.44:0/1149536411 >> v1:172.21.15.44:6789/0 conn(0x7fd40806eda0 legacy=0x7fd40806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:17.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.014+0000 7fd40659c640 1 -- 172.21.15.44:0/1149536411 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd408070d50 con 0x7fd40812e940 2024-09-21T09:06:17.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.014+0000 7fd405d9b640 1 -- 172.21.15.44:0/1149536411 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3154988077 0 0) 0x7fd40806eba0 con 0x7fd40806eda0 2024-09-21T09:06:17.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.014+0000 7fd40659c640 1 --2- 172.21.15.44:0/1149536411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd40812e940 0x7fd408130d30 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009720 tx=0x7fd3fc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5591da725ef4e69 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:17.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.015+0000 7fd405d9b640 1 -- 172.21.15.44:0/1149536411 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3fc037070 con 0x7fd40812e940 2024-09-21T09:06:17.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.015+0000 7fd405d9b640 1 -- 172.21.15.44:0/1149536411 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3fc02ae20 con 0x7fd40812e940 2024-09-21T09:06:17.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.015+0000 7fd405d9b640 1 -- 172.21.15.44:0/1149536411 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3fc032590 con 0x7fd40812e940 2024-09-21T09:06:17.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.015+0000 7fd40d053640 1 -- 172.21.15.44:0/1149536411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd40812e940 msgr2=0x7fd408130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:17.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.015+0000 7fd40d053640 1 --2- 172.21.15.44:0/1149536411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd40812e940 0x7fd408130d30 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009720 tx=0x7fd3fc02a1a0 comp rx=0 tx=0).stop 2024-09-21T09:06:17.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.015+0000 7fd40d053640 1 -- 172.21.15.44:0/1149536411 shutdown_connections 2024-09-21T09:06:17.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.015+0000 7fd40d053640 1 --2- 172.21.15.44:0/1149536411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd40812e940 0x7fd408130d30 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:17.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.015+0000 7fd40d053640 1 -- 172.21.15.44:0/1149536411 >> 172.21.15.44:0/1149536411 conn(0x7fd40809a890 msgr2=0x7fd40809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:17.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.015+0000 7fd40d053640 1 -- 172.21.15.44:0/1149536411 shutdown_connections 2024-09-21T09:06:17.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.015+0000 7fd40d053640 1 -- 172.21.15.44:0/1149536411 wait complete. 2024-09-21T09:06:17.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.016+0000 7fd40d053640 1 Processor -- start 2024-09-21T09:06:17.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.016+0000 7fd40d053640 1 -- start start 2024-09-21T09:06:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.017+0000 7fd40d053640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd40806eda0 0x7fd40806d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.017+0000 7fd40d053640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd40806fcd0 con 0x7fd40806eda0 2024-09-21T09:06:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.017+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd40806eda0 0x7fd40806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.017+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd40806eda0 0x7fd40806d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53222/0 (socket says 172.21.15.44:53222) 2024-09-21T09:06:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.017+0000 7fd406d9d640 1 -- 172.21.15.44:0/4121751026 learned_addr learned my addr 172.21.15.44:0/4121751026 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.017+0000 7fd406d9d640 1 -- 172.21.15.44:0/4121751026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4081273e0 con 0x7fd40806eda0 2024-09-21T09:06:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.017+0000 7fd406d9d640 1 --2- 172.21.15.44:0/4121751026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd40806eda0 0x7fd40806d910 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800c420 tx=0x7fd3f800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.017+0000 7fd3ef7fe640 1 -- 172.21.15.44:0/4121751026 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3f8018070 con 0x7fd40806eda0 2024-09-21T09:06:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.017+0000 7fd3ef7fe640 1 -- 172.21.15.44:0/4121751026 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f80074d0 con 0x7fd40806eda0 2024-09-21T09:06:17.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.017+0000 7fd40d053640 1 -- 172.21.15.44:0/4121751026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40812b860 con 0x7fd40806eda0 2024-09-21T09:06:17.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.017+0000 7fd3ef7fe640 1 -- 172.21.15.44:0/4121751026 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3f8004950 con 0x7fd40806eda0 2024-09-21T09:06:17.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.017+0000 7fd40d053640 1 -- 172.21.15.44:0/4121751026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd408128060 con 0x7fd40806eda0 2024-09-21T09:06:17.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.018+0000 7fd3ef7fe640 1 -- 172.21.15.44:0/4121751026 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd3f801b070 con 0x7fd40806eda0 2024-09-21T09:06:17.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.018+0000 7fd40d053640 1 -- 172.21.15.44:0/4121751026 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd40806f180 con 0x7fd40806eda0 2024-09-21T09:06:17.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.019+0000 7fd3ef7fe640 1 --2- 172.21.15.44:0/4121751026 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd3f40382a0 0x7fd3f403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:17.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.019+0000 7fd3ef7fe640 1 -- 172.21.15.44:0/4121751026 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fd3f804af70 con 0x7fd40806eda0 2024-09-21T09:06:17.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.019+0000 7fd40659c640 1 --2- 172.21.15.44:0/4121751026 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd3f40382a0 0x7fd3f403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:17.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.019+0000 7fd40659c640 1 --2- 172.21.15.44:0/4121751026 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd3f40382a0 0x7fd3f403a760 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc034000 tx=0x7fd3fc02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:17.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.023+0000 7fd3ef7fe640 1 -- 172.21.15.44:0/4121751026 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd3f8011960 con 0x7fd40806eda0 2024-09-21T09:06:17.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.198+0000 7fd40d053640 1 -- 172.21.15.44:0/4121751026 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fd4081282f0 con 0x7fd3f40382a0 2024-09-21T09:06:17.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.198+0000 7fd3ef7fe640 1 -- 172.21.15.44:0/4121751026 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd4081282f0 con 0x7fd3f40382a0 2024-09-21T09:06:17.200 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T09:06:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.200+0000 7fd40d053640 1 -- 172.21.15.44:0/4121751026 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd3f40382a0 msgr2=0x7fd3f403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.200+0000 7fd40d053640 1 --2- 172.21.15.44:0/4121751026 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd3f40382a0 0x7fd3f403a760 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc034000 tx=0x7fd3fc02e000 comp rx=0 tx=0).stop 2024-09-21T09:06:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.200+0000 7fd40d053640 1 -- 172.21.15.44:0/4121751026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd40806eda0 msgr2=0x7fd40806d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.200+0000 7fd40d053640 1 --2- 172.21.15.44:0/4121751026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd40806eda0 0x7fd40806d910 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800c420 tx=0x7fd3f800c8e0 comp rx=0 tx=0).stop 2024-09-21T09:06:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.200+0000 7fd40d053640 1 -- 172.21.15.44:0/4121751026 shutdown_connections 2024-09-21T09:06:17.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.200+0000 7fd40d053640 1 --2- 172.21.15.44:0/4121751026 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fd3f40382a0 0x7fd3f403a760 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:17.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.200+0000 7fd40d053640 1 --2- 172.21.15.44:0/4121751026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd40806eda0 0x7fd40806d910 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:17.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.200+0000 7fd40d053640 1 -- 172.21.15.44:0/4121751026 >> 172.21.15.44:0/4121751026 conn(0x7fd40809a890 msgr2=0x7fd408097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:17.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.200+0000 7fd40d053640 1 -- 172.21.15.44:0/4121751026 shutdown_connections 2024-09-21T09:06:17.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.200+0000 7fd40d053640 1 -- 172.21.15.44:0/4121751026 wait complete. 2024-09-21T09:06:17.212 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:06:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.311+0000 7f39f7a0e640 1 Processor -- start 2024-09-21T09:06:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.312+0000 7f39f7a0e640 1 -- start start 2024-09-21T09:06:17.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.312+0000 7f39f7a0e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f39f012f9d0 0x7f39f0131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:17.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.312+0000 7f39f7a0e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f0071f70 con 0x7f39f012cca0 2024-09-21T09:06:17.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.312+0000 7f39f7a0e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f39f006e350 con 0x7f39f012f9d0 2024-09-21T09:06:17.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.312+0000 7f39f4fa9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f39f012f9d0 0x7f39f0131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:17.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.312+0000 7f39f57aa640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f39f012cca0 0x7f39f012d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58366/0 (socket says 172.21.15.44:58366) 2024-09-21T09:06:17.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.312+0000 7f39f4fa9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f39f012f9d0 0x7f39f0131dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53230/0 (socket says 172.21.15.44:53230) 2024-09-21T09:06:17.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.312+0000 7f39f57aa640 1 -- 172.21.15.44:0/863318357 learned_addr learned my addr 172.21.15.44:0/863318357 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:17.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.312+0000 7f39f4fa9640 1 -- 172.21.15.44:0/863318357 >> v1:172.21.15.44:6789/0 conn(0x7f39f012cca0 legacy=0x7f39f012d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:17.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.313+0000 7f39e7fff640 1 -- 172.21.15.44:0/863318357 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2827475211 0 0) 0x7f39f0071f70 con 0x7f39f012cca0 2024-09-21T09:06:17.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.313+0000 7f39f4fa9640 1 -- 172.21.15.44:0/863318357 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f00715c0 con 0x7f39f012f9d0 2024-09-21T09:06:17.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.313+0000 7f39f4fa9640 1 --2- 172.21.15.44:0/863318357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39f012f9d0 0x7f39f0131dc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009720 tx=0x7f39e002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ce49b055591009 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:17.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.313+0000 7f39e7fff640 1 -- 172.21.15.44:0/863318357 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39e0037070 con 0x7f39f012f9d0 2024-09-21T09:06:17.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.313+0000 7f39e7fff640 1 -- 172.21.15.44:0/863318357 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e002ad90 con 0x7f39f012f9d0 2024-09-21T09:06:17.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.313+0000 7f39e7fff640 1 -- 172.21.15.44:0/863318357 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39e0032590 con 0x7f39f012f9d0 2024-09-21T09:06:17.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.314+0000 7f39f7a0e640 1 -- 172.21.15.44:0/863318357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39f012f9d0 msgr2=0x7f39f0131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:17.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.314+0000 7f39f7a0e640 1 --2- 172.21.15.44:0/863318357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39f012f9d0 0x7f39f0131dc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009720 tx=0x7f39e002a110 comp rx=0 tx=0).stop 2024-09-21T09:06:17.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.314+0000 7f39f7a0e640 1 -- 172.21.15.44:0/863318357 shutdown_connections 2024-09-21T09:06:17.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.314+0000 7f39f7a0e640 1 --2- 172.21.15.44:0/863318357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39f012f9d0 0x7f39f0131dc0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:17.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.314+0000 7f39f7a0e640 1 -- 172.21.15.44:0/863318357 >> 172.21.15.44:0/863318357 conn(0x7f39f009a890 msgr2=0x7f39f009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:17.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.314+0000 7f39f7a0e640 1 -- 172.21.15.44:0/863318357 shutdown_connections 2024-09-21T09:06:17.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.314+0000 7f39f7a0e640 1 -- 172.21.15.44:0/863318357 wait complete. 2024-09-21T09:06:17.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.315+0000 7f39f7a0e640 1 Processor -- start 2024-09-21T09:06:17.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.315+0000 7f39f7a0e640 1 -- start start 2024-09-21T09:06:17.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.315+0000 7f39f7a0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39f012cca0 0x7f39f0122110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:17.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.315+0000 7f39f7a0e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f39f012ca50 con 0x7f39f012cca0 2024-09-21T09:06:17.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.315+0000 7f39f57aa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39f012cca0 0x7f39f0122110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:17.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.315+0000 7f39f57aa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39f012cca0 0x7f39f0122110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53236/0 (socket says 172.21.15.44:53236) 2024-09-21T09:06:17.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.315+0000 7f39f57aa640 1 -- 172.21.15.44:0/1641192446 learned_addr learned my addr 172.21.15.44:0/1641192446 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:17.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.316+0000 7f39f57aa640 1 -- 172.21.15.44:0/1641192446 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f01243f0 con 0x7f39f012cca0 2024-09-21T09:06:17.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.316+0000 7f39f57aa640 1 --2- 172.21.15.44:0/1641192446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39f012cca0 0x7f39f0122110 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00c370 tx=0x7f39ec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:17.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.316+0000 7f39e5ffb640 1 -- 172.21.15.44:0/1641192446 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ec007410 con 0x7f39f012cca0 2024-09-21T09:06:17.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.316+0000 7f39e5ffb640 1 -- 172.21.15.44:0/1641192446 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ec0075d0 con 0x7f39f012cca0 2024-09-21T09:06:17.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.316+0000 7f39e5ffb640 1 -- 172.21.15.44:0/1641192446 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ec004950 con 0x7f39f012cca0 2024-09-21T09:06:17.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.316+0000 7f39f7a0e640 1 -- 172.21.15.44:0/1641192446 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f01235e0 con 0x7f39f012cca0 2024-09-21T09:06:17.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.316+0000 7f39f7a0e640 1 -- 172.21.15.44:0/1641192446 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f0124ef0 con 0x7f39f012cca0 2024-09-21T09:06:17.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.317+0000 7f39e5ffb640 1 -- 172.21.15.44:0/1641192446 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f39ec011070 con 0x7f39f012cca0 2024-09-21T09:06:17.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.317+0000 7f39e5ffb640 1 --2- 172.21.15.44:0/1641192446 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f39d40382a0 0x7f39d403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:17.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.317+0000 7f39e5ffb640 1 -- 172.21.15.44:0/1641192446 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f39ec04b850 con 0x7f39f012cca0 2024-09-21T09:06:17.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.317+0000 7f39f7a0e640 1 -- 172.21.15.44:0/1641192446 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f012e200 con 0x7f39f012cca0 2024-09-21T09:06:17.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.317+0000 7f39f4fa9640 1 --2- 172.21.15.44:0/1641192446 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f39d40382a0 0x7f39d403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:17.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.318+0000 7f39f4fa9640 1 --2- 172.21.15.44:0/1641192446 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f39d40382a0 0x7f39d403a760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009720 tx=0x7f39e002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:17.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.322+0000 7f39e5ffb640 1 -- 172.21.15.44:0/1641192446 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f39ec01cbd0 con 0x7f39f012cca0 2024-09-21T09:06:17.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-21T09:06:17.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.495+0000 7f39f7a0e640 1 -- 172.21.15.44:0/1641192446 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39f006e510 con 0x7f39d40382a0 2024-09-21T09:06:17.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.511+0000 7f39e5ffb640 1 -- 172.21.15.44:0/1641192446 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665553 (secure 0 0 0) 0x7f39f006e510 con 0x7f39d40382a0 2024-09-21T09:06:17.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:06:17.524 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-21T09:06:17.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.516+0000 7f39f7a0e640 1 -- 172.21.15.44:0/1641192446 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f39d40382a0 msgr2=0x7f39d403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:17.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.516+0000 7f39f7a0e640 1 --2- 172.21.15.44:0/1641192446 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f39d40382a0 0x7f39d403a760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009720 tx=0x7f39e002e000 comp rx=0 tx=0).stop 2024-09-21T09:06:17.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.516+0000 7f39f7a0e640 1 -- 172.21.15.44:0/1641192446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39f012cca0 msgr2=0x7f39f0122110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:17.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.516+0000 7f39f7a0e640 1 --2- 172.21.15.44:0/1641192446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39f012cca0 0x7f39f0122110 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00c370 tx=0x7f39ec00c830 comp rx=0 tx=0).stop 2024-09-21T09:06:17.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.516+0000 7f39f7a0e640 1 -- 172.21.15.44:0/1641192446 shutdown_connections 2024-09-21T09:06:17.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.516+0000 7f39f7a0e640 1 --2- 172.21.15.44:0/1641192446 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f39d40382a0 0x7f39d403a760 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:17.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.516+0000 7f39f7a0e640 1 --2- 172.21.15.44:0/1641192446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39f012cca0 0x7f39f0122110 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:17.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.516+0000 7f39f7a0e640 1 -- 172.21.15.44:0/1641192446 >> 172.21.15.44:0/1641192446 conn(0x7f39f009a890 msgr2=0x7f39f012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:17.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.516+0000 7f39f7a0e640 1 -- 172.21.15.44:0/1641192446 shutdown_connections 2024-09-21T09:06:17.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:17.516+0000 7f39f7a0e640 1 -- 172.21.15.44:0/1641192446 wait complete. 2024-09-21T09:06:17.528 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-21T09:06:16.485379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":21578633,"num_objects":227,"num_object_clones":0,"num_object_copies":454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4955,"num_read_kb":4537,"num_write":2132,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4520,"ondisk_log_size":4520,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177500,"kb_used_data":40280,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377309860,"statfs":{"total":386547056640,"available":386365296640,"internally_reserved":0,"allocated":41246720,"data_stored":40106423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":140437271},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20977512,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":571,"num_read_kb":527,"num_write":410,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003967"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.693474+0000","last_change":"2024-09-21T09:03:38.283847+0000","last_active":"2024-09-21T09:05:05.693474+0000","last_peered":"2024-09-21T09:05:05.693474+0000","last_clean":"2024-09-21T09:05:05.693474+0000","last_became_active":"2024-09-21T09:03:38.283357+0000","last_became_peered":"2024-09-21T09:03:38.283357+0000","last_unstale":"2024-09-21T09:05:05.693474+0000","last_undegraded":"2024-09-21T09:05:05.693474+0000","last_fullsized":"2024-09-21T09:05:05.693474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:01.386955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'20","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.299232+0000","last_change":"2024-09-21T09:03:00.226390+0000","last_active":"2024-09-21T09:06:06.299232+0000","last_peered":"2024-09-21T09:06:06.299232+0000","last_clean":"2024-09-21T09:06:06.299232+0000","last_became_active":"2024-09-21T09:03:00.226067+0000","last_became_peered":"2024-09-21T09:03:00.226067+0000","last_unstale":"2024-09-21T09:06:06.299232+0000","last_undegraded":"2024-09-21T09:06:06.299232+0000","last_fullsized":"2024-09-21T09:06:06.299232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:19.763600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465423+0000","last_change":"2024-09-21T09:02:58.213108+0000","last_active":"2024-09-21T09:03:38.465423+0000","last_peered":"2024-09-21T09:03:38.465423+0000","last_clean":"2024-09-21T09:03:38.465423+0000","last_became_active":"2024-09-21T09:02:58.212828+0000","last_became_peered":"2024-09-21T09:02:58.212828+0000","last_unstale":"2024-09-21T09:03:38.465423+0000","last_undegraded":"2024-09-21T09:03:38.465423+0000","last_fullsized":"2024-09-21T09:03:38.465423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:25.409736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298796+0000","last_change":"2024-09-21T09:03:00.222612+0000","last_active":"2024-09-21T09:06:06.298796+0000","last_peered":"2024-09-21T09:06:06.298796+0000","last_clean":"2024-09-21T09:06:06.298796+0000","last_became_active":"2024-09-21T09:03:00.222333+0000","last_became_peered":"2024-09-21T09:03:00.222333+0000","last_unstale":"2024-09-21T09:06:06.298796+0000","last_undegraded":"2024-09-21T09:06:06.298796+0000","last_fullsized":"2024-09-21T09:06:06.298796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:22.752060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278836+0000","last_change":"2024-09-21T09:02:58.221389+0000","last_active":"2024-09-21T09:03:38.278836+0000","last_peered":"2024-09-21T09:03:38.278836+0000","last_clean":"2024-09-21T09:03:38.278836+0000","last_became_active":"2024-09-21T09:02:58.221214+0000","last_became_peered":"2024-09-21T09:02:58.221214+0000","last_unstale":"2024-09-21T09:03:38.278836+0000","last_undegraded":"2024-09-21T09:03:38.278836+0000","last_fullsized":"2024-09-21T09:03:38.278836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:59.331305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173989+0000","last_change":"2024-09-21T09:03:00.221728+0000","last_active":"2024-09-21T09:06:06.173989+0000","last_peered":"2024-09-21T09:06:06.173989+0000","last_clean":"2024-09-21T09:06:06.173989+0000","last_became_active":"2024-09-21T09:03:00.221451+0000","last_became_peered":"2024-09-21T09:03:00.221451+0000","last_unstale":"2024-09-21T09:06:06.173989+0000","last_undegraded":"2024-09-21T09:06:06.173989+0000","last_fullsized":"2024-09-21T09:06:06.173989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:36.553233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:57.452905+0000","last_change":"2024-09-21T09:02:58.208725+0000","last_active":"2024-09-21T09:04:57.452905+0000","last_peered":"2024-09-21T09:04:57.452905+0000","last_clean":"2024-09-21T09:04:57.452905+0000","last_became_active":"2024-09-21T09:02:58.207683+0000","last_became_peered":"2024-09-21T09:02:58.207683+0000","last_unstale":"2024-09-21T09:04:57.452905+0000","last_undegraded":"2024-09-21T09:04:57.452905+0000","last_fullsized":"2024-09-21T09:04:57.452905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:12.355792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'9","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.267454+0000","last_change":"2024-09-21T09:03:00.212574+0000","last_active":"2024-09-21T09:06:06.267454+0000","last_peered":"2024-09-21T09:06:06.267454+0000","last_clean":"2024-09-21T09:06:06.267454+0000","last_became_active":"2024-09-21T09:03:00.210589+0000","last_became_peered":"2024-09-21T09:03:00.210589+0000","last_unstale":"2024-09-21T09:06:06.267454+0000","last_undegraded":"2024-09-21T09:06:06.267454+0000","last_fullsized":"2024-09-21T09:06:06.267454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:11.555715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.253856+0000","last_change":"2024-09-21T09:02:58.224906+0000","last_active":"2024-09-21T09:06:06.253856+0000","last_peered":"2024-09-21T09:06:06.253856+0000","last_clean":"2024-09-21T09:06:06.253856+0000","last_became_active":"2024-09-21T09:02:58.224630+0000","last_became_peered":"2024-09-21T09:02:58.224630+0000","last_unstale":"2024-09-21T09:06:06.253856+0000","last_undegraded":"2024-09-21T09:06:06.253856+0000","last_fullsized":"2024-09-21T09:06:06.253856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:24.376659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'6","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298997+0000","last_change":"2024-09-21T09:03:00.223960+0000","last_active":"2024-09-21T09:06:06.298997+0000","last_peered":"2024-09-21T09:06:06.298997+0000","last_clean":"2024-09-21T09:06:06.298997+0000","last_became_active":"2024-09-21T09:03:00.217048+0000","last_became_peered":"2024-09-21T09:03:00.217048+0000","last_unstale":"2024-09-21T09:06:06.298997+0000","last_undegraded":"2024-09-21T09:06:06.298997+0000","last_fullsized":"2024-09-21T09:06:06.298997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:50.802476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.626681+0000","last_change":"2024-09-21T09:02:58.205801+0000","last_active":"2024-09-21T09:05:05.626681+0000","last_peered":"2024-09-21T09:05:05.626681+0000","last_clean":"2024-09-21T09:05:05.626681+0000","last_became_active":"2024-09-21T09:02:58.205515+0000","last_became_peered":"2024-09-21T09:02:58.205515+0000","last_unstale":"2024-09-21T09:05:05.626681+0000","last_undegraded":"2024-09-21T09:05:05.626681+0000","last_fullsized":"2024-09-21T09:05:05.626681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:14.606085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'14","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363415+0000","last_change":"2024-09-21T09:03:00.222211+0000","last_active":"2024-09-21T09:06:06.363415+0000","last_peered":"2024-09-21T09:06:06.363415+0000","last_clean":"2024-09-21T09:06:06.363415+0000","last_became_active":"2024-09-21T09:03:00.221117+0000","last_became_peered":"2024-09-21T09:03:00.221117+0000","last_unstale":"2024-09-21T09:06:06.363415+0000","last_undegraded":"2024-09-21T09:06:06.363415+0000","last_fullsized":"2024-09-21T09:06:06.363415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:45.284408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.248708+0000","last_change":"2024-09-21T09:02:58.211066+0000","last_active":"2024-09-21T09:06:06.248708+0000","last_peered":"2024-09-21T09:06:06.248708+0000","last_clean":"2024-09-21T09:06:06.248708+0000","last_became_active":"2024-09-21T09:02:58.210702+0000","last_became_peered":"2024-09-21T09:02:58.210702+0000","last_unstale":"2024-09-21T09:06:06.248708+0000","last_undegraded":"2024-09-21T09:06:06.248708+0000","last_fullsized":"2024-09-21T09:06:06.248708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:18.510636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'10","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363641+0000","last_change":"2024-09-21T09:03:00.221039+0000","last_active":"2024-09-21T09:06:06.363641+0000","last_peered":"2024-09-21T09:06:06.363641+0000","last_clean":"2024-09-21T09:06:06.363641+0000","last_became_active":"2024-09-21T09:03:00.220725+0000","last_became_peered":"2024-09-21T09:03:00.220725+0000","last_unstale":"2024-09-21T09:06:06.363641+0000","last_undegraded":"2024-09-21T09:06:06.363641+0000","last_fullsized":"2024-09-21T09:06:06.363641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:39.266159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.256624+0000","last_change":"2024-09-21T09:02:58.217016+0000","last_active":"2024-09-21T09:06:06.256624+0000","last_peered":"2024-09-21T09:06:06.256624+0000","last_clean":"2024-09-21T09:06:06.256624+0000","last_became_active":"2024-09-21T09:02:58.216712+0000","last_became_peered":"2024-09-21T09:02:58.216712+0000","last_unstale":"2024-09-21T09:06:06.256624+0000","last_undegraded":"2024-09-21T09:06:06.256624+0000","last_fullsized":"2024-09-21T09:06:06.256624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:52.024304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'14","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363418+0000","last_change":"2024-09-21T09:03:00.222904+0000","last_active":"2024-09-21T09:06:06.363418+0000","last_peered":"2024-09-21T09:06:06.363418+0000","last_clean":"2024-09-21T09:06:06.363418+0000","last_became_active":"2024-09-21T09:03:00.222593+0000","last_became_peered":"2024-09-21T09:03:00.222593+0000","last_unstale":"2024-09-21T09:06:06.363418+0000","last_undegraded":"2024-09-21T09:06:06.363418+0000","last_fullsized":"2024-09-21T09:06:06.363418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:47.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'11","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460587+0000","last_change":"2024-09-21T09:03:00.220191+0000","last_active":"2024-09-21T09:05:23.460587+0000","last_peered":"2024-09-21T09:05:23.460587+0000","last_clean":"2024-09-21T09:05:23.460587+0000","last_became_active":"2024-09-21T09:03:00.219923+0000","last_became_peered":"2024-09-21T09:03:00.219923+0000","last_unstale":"2024-09-21T09:05:23.460587+0000","last_undegraded":"2024-09-21T09:05:23.460587+0000","last_fullsized":"2024-09-21T09:05:23.460587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:09.508750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275945+0000","last_change":"2024-09-21T09:02:58.212942+0000","last_active":"2024-09-21T09:03:38.275945+0000","last_peered":"2024-09-21T09:03:38.275945+0000","last_clean":"2024-09-21T09:03:38.275945+0000","last_became_active":"2024-09-21T09:02:58.210936+0000","last_became_peered":"2024-09-21T09:02:58.210936+0000","last_unstale":"2024-09-21T09:03:38.275945+0000","last_undegraded":"2024-09-21T09:03:38.275945+0000","last_fullsized":"2024-09-21T09:03:38.275945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:08.728738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'8","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.072789+0000","last_change":"2024-09-21T09:03:00.225223+0000","last_active":"2024-09-21T09:04:22.072789+0000","last_peered":"2024-09-21T09:04:22.072789+0000","last_clean":"2024-09-21T09:04:22.072789+0000","last_became_active":"2024-09-21T09:03:00.224695+0000","last_became_peered":"2024-09-21T09:03:00.224695+0000","last_unstale":"2024-09-21T09:04:22.072789+0000","last_undegraded":"2024-09-21T09:04:22.072789+0000","last_fullsized":"2024-09-21T09:04:22.072789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:18.875227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.246956+0000","last_change":"2024-09-21T09:02:58.220090+0000","last_active":"2024-09-21T09:04:22.246956+0000","last_peered":"2024-09-21T09:04:22.246956+0000","last_clean":"2024-09-21T09:04:22.246956+0000","last_became_active":"2024-09-21T09:02:58.218643+0000","last_became_peered":"2024-09-21T09:02:58.218643+0000","last_unstale":"2024-09-21T09:04:22.246956+0000","last_undegraded":"2024-09-21T09:04:22.246956+0000","last_fullsized":"2024-09-21T09:04:22.246956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.813396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363139+0000","last_change":"2024-09-21T09:03:00.227634+0000","last_active":"2024-09-21T09:06:06.363139+0000","last_peered":"2024-09-21T09:06:06.363139+0000","last_clean":"2024-09-21T09:06:06.363139+0000","last_became_active":"2024-09-21T09:03:00.226738+0000","last_became_peered":"2024-09-21T09:03:00.226738+0000","last_unstale":"2024-09-21T09:06:06.363139+0000","last_undegraded":"2024-09-21T09:06:06.363139+0000","last_fullsized":"2024-09-21T09:06:06.363139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:24.661101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.043712+0000","last_change":"2024-09-21T09:02:58.208501+0000","last_active":"2024-09-21T09:06:06.043712+0000","last_peered":"2024-09-21T09:06:06.043712+0000","last_clean":"2024-09-21T09:06:06.043712+0000","last_became_active":"2024-09-21T09:02:58.208220+0000","last_became_peered":"2024-09-21T09:02:58.208220+0000","last_unstale":"2024-09-21T09:06:06.043712+0000","last_undegraded":"2024-09-21T09:06:06.043712+0000","last_fullsized":"2024-09-21T09:06:06.043712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:44.533015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'16","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260865+0000","last_change":"2024-09-21T09:03:00.216019+0000","last_active":"2024-09-21T09:06:06.260865+0000","last_peered":"2024-09-21T09:06:06.260865+0000","last_clean":"2024-09-21T09:06:06.260865+0000","last_became_active":"2024-09-21T09:03:00.215637+0000","last_became_peered":"2024-09-21T09:03:00.215637+0000","last_unstale":"2024-09-21T09:06:06.260865+0000","last_undegraded":"2024-09-21T09:06:06.260865+0000","last_fullsized":"2024-09-21T09:06:06.260865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.852495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275771+0000","last_change":"2024-09-21T09:02:58.206160+0000","last_active":"2024-09-21T09:03:38.275771+0000","last_peered":"2024-09-21T09:03:38.275771+0000","last_clean":"2024-09-21T09:03:38.275771+0000","last_became_active":"2024-09-21T09:02:58.204603+0000","last_became_peered":"2024-09-21T09:02:58.204603+0000","last_unstale":"2024-09-21T09:03:38.275771+0000","last_undegraded":"2024-09-21T09:03:38.275771+0000","last_fullsized":"2024-09-21T09:03:38.275771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:38.066496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.717096+0000","last_change":"2024-09-21T09:03:00.223258+0000","last_active":"2024-09-21T09:05:05.717096+0000","last_peered":"2024-09-21T09:05:05.717096+0000","last_clean":"2024-09-21T09:05:05.717096+0000","last_became_active":"2024-09-21T09:03:00.222972+0000","last_became_peered":"2024-09-21T09:03:00.222972+0000","last_unstale":"2024-09-21T09:05:05.717096+0000","last_undegraded":"2024-09-21T09:05:05.717096+0000","last_fullsized":"2024-09-21T09:05:05.717096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:32.562147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464762+0000","last_change":"2024-09-21T09:02:58.208852+0000","last_active":"2024-09-21T09:03:38.464762+0000","last_peered":"2024-09-21T09:03:38.464762+0000","last_clean":"2024-09-21T09:03:38.464762+0000","last_became_active":"2024-09-21T09:02:58.208383+0000","last_became_peered":"2024-09-21T09:02:58.208383+0000","last_unstale":"2024-09-21T09:03:38.464762+0000","last_undegraded":"2024-09-21T09:03:38.464762+0000","last_fullsized":"2024-09-21T09:03:38.464762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:07.674387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363227+0000","last_change":"2024-09-21T09:03:00.212288+0000","last_active":"2024-09-21T09:06:06.363227+0000","last_peered":"2024-09-21T09:06:06.363227+0000","last_clean":"2024-09-21T09:06:06.363227+0000","last_became_active":"2024-09-21T09:03:00.211942+0000","last_became_peered":"2024-09-21T09:03:00.211942+0000","last_unstale":"2024-09-21T09:06:06.363227+0000","last_undegraded":"2024-09-21T09:06:06.363227+0000","last_fullsized":"2024-09-21T09:06:06.363227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:53.039369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.753027+0000","last_change":"2024-09-21T09:02:58.214186+0000","last_active":"2024-09-21T09:03:38.753027+0000","last_peered":"2024-09-21T09:03:38.753027+0000","last_clean":"2024-09-21T09:03:38.753027+0000","last_became_active":"2024-09-21T09:02:58.213548+0000","last_became_peered":"2024-09-21T09:02:58.213548+0000","last_unstale":"2024-09-21T09:03:38.753027+0000","last_undegraded":"2024-09-21T09:03:38.753027+0000","last_fullsized":"2024-09-21T09:03:38.753027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:14.666195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.280442+0000","last_change":"2024-09-21T09:03:08.262655+0000","last_active":"2024-09-21T09:06:06.280442+0000","last_peered":"2024-09-21T09:06:06.280442+0000","last_clean":"2024-09-21T09:06:06.280442+0000","last_became_active":"2024-09-21T09:03:08.262362+0000","last_became_peered":"2024-09-21T09:03:08.262362+0000","last_unstale":"2024-09-21T09:06:06.280442+0000","last_undegraded":"2024-09-21T09:06:06.280442+0000","last_fullsized":"2024-09-21T09:06:06.280442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:23.685881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275829+0000","last_change":"2024-09-21T09:03:00.212668+0000","last_active":"2024-09-21T09:03:38.275829+0000","last_peered":"2024-09-21T09:03:38.275829+0000","last_clean":"2024-09-21T09:03:38.275829+0000","last_became_active":"2024-09-21T09:03:00.209346+0000","last_became_peered":"2024-09-21T09:03:00.209346+0000","last_unstale":"2024-09-21T09:03:38.275829+0000","last_undegraded":"2024-09-21T09:03:38.275829+0000","last_fullsized":"2024-09-21T09:03:38.275829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:35.918701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271768+0000","last_change":"2024-09-21T09:02:58.221478+0000","last_active":"2024-09-21T09:03:38.271768+0000","last_peered":"2024-09-21T09:03:38.271768+0000","last_clean":"2024-09-21T09:03:38.271768+0000","last_became_active":"2024-09-21T09:02:58.221187+0000","last_became_peered":"2024-09-21T09:02:58.221187+0000","last_unstale":"2024-09-21T09:03:38.271768+0000","last_undegraded":"2024-09-21T09:03:38.271768+0000","last_fullsized":"2024-09-21T09:03:38.271768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:43.391268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277937+0000","last_change":"2024-09-21T09:03:02.220660+0000","last_active":"2024-09-21T09:03:38.277937+0000","last_peered":"2024-09-21T09:03:38.277937+0000","last_clean":"2024-09-21T09:03:38.277937+0000","last_became_active":"2024-09-21T09:03:02.220370+0000","last_became_peered":"2024-09-21T09:03:02.220370+0000","last_unstale":"2024-09-21T09:03:38.277937+0000","last_undegraded":"2024-09-21T09:03:38.277937+0000","last_fullsized":"2024-09-21T09:03:38.277937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:00.166342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'33","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.993840+0000","last_change":"2024-09-21T09:03:04.243245+0000","last_active":"2024-09-21T09:06:12.993840+0000","last_peered":"2024-09-21T09:06:12.993840+0000","last_clean":"2024-09-21T09:06:12.993840+0000","last_became_active":"2024-09-21T09:03:04.242637+0000","last_became_peered":"2024-09-21T09:03:04.242637+0000","last_unstale":"2024-09-21T09:06:12.993840+0000","last_undegraded":"2024-09-21T09:06:12.993840+0000","last_fullsized":"2024-09-21T09:06:12.993840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:09.480974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274815+0000","last_change":"2024-09-21T09:03:06.247484+0000","last_active":"2024-09-21T09:03:38.274815+0000","last_peered":"2024-09-21T09:03:38.274815+0000","last_clean":"2024-09-21T09:03:38.274815+0000","last_became_active":"2024-09-21T09:03:06.247203+0000","last_became_peered":"2024-09-21T09:03:06.247203+0000","last_unstale":"2024-09-21T09:03:38.274815+0000","last_undegraded":"2024-09-21T09:03:38.274815+0000","last_fullsized":"2024-09-21T09:03:38.274815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:37.402801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.415271+0000","last_change":"2024-09-21T09:03:08.262677+0000","last_active":"2024-09-21T09:06:06.415271+0000","last_peered":"2024-09-21T09:06:06.415271+0000","last_clean":"2024-09-21T09:06:06.415271+0000","last_became_active":"2024-09-21T09:03:08.262384+0000","last_became_peered":"2024-09-21T09:03:08.262384+0000","last_unstale":"2024-09-21T09:06:06.415271+0000","last_undegraded":"2024-09-21T09:06:06.415271+0000","last_fullsized":"2024-09-21T09:06:06.415271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:38.859764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'8","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298988+0000","last_change":"2024-09-21T09:03:00.218848+0000","last_active":"2024-09-21T09:06:06.298988+0000","last_peered":"2024-09-21T09:06:06.298988+0000","last_clean":"2024-09-21T09:06:06.298988+0000","last_became_active":"2024-09-21T09:03:00.217658+0000","last_became_peered":"2024-09-21T09:03:00.217658+0000","last_unstale":"2024-09-21T09:06:06.298988+0000","last_undegraded":"2024-09-21T09:06:06.298988+0000","last_fullsized":"2024-09-21T09:06:06.298988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:04.690462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275111+0000","last_change":"2024-09-21T09:02:58.218614+0000","last_active":"2024-09-21T09:03:38.275111+0000","last_peered":"2024-09-21T09:03:38.275111+0000","last_clean":"2024-09-21T09:03:38.275111+0000","last_became_active":"2024-09-21T09:02:58.218086+0000","last_became_peered":"2024-09-21T09:02:58.218086+0000","last_unstale":"2024-09-21T09:03:38.275111+0000","last_undegraded":"2024-09-21T09:03:38.275111+0000","last_fullsized":"2024-09-21T09:03:38.275111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:03.460514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466155+0000","last_change":"2024-09-21T09:03:02.220885+0000","last_active":"2024-09-21T09:03:38.466155+0000","last_peered":"2024-09-21T09:03:38.466155+0000","last_clean":"2024-09-21T09:03:38.466155+0000","last_became_active":"2024-09-21T09:03:02.220557+0000","last_became_peered":"2024-09-21T09:03:02.220557+0000","last_unstale":"2024-09-21T09:03:38.466155+0000","last_undegraded":"2024-09-21T09:03:38.466155+0000","last_fullsized":"2024-09-21T09:03:38.466155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:27.649227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274937+0000","last_change":"2024-09-21T09:03:04.236337+0000","last_active":"2024-09-21T09:03:38.274937+0000","last_peered":"2024-09-21T09:03:38.274937+0000","last_clean":"2024-09-21T09:03:38.274937+0000","last_became_active":"2024-09-21T09:03:04.236037+0000","last_became_peered":"2024-09-21T09:03:04.236037+0000","last_unstale":"2024-09-21T09:03:38.274937+0000","last_undegraded":"2024-09-21T09:03:38.274937+0000","last_fullsized":"2024-09-21T09:03:38.274937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:06.028996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274949+0000","last_change":"2024-09-21T09:03:06.244177+0000","last_active":"2024-09-21T09:03:38.274949+0000","last_peered":"2024-09-21T09:03:38.274949+0000","last_clean":"2024-09-21T09:03:38.274949+0000","last_became_active":"2024-09-21T09:03:06.243901+0000","last_became_peered":"2024-09-21T09:03:06.243901+0000","last_unstale":"2024-09-21T09:03:38.274949+0000","last_undegraded":"2024-09-21T09:03:38.274949+0000","last_fullsized":"2024-09-21T09:03:38.274949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:03.746735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463546+0000","last_change":"2024-09-21T09:03:08.250364+0000","last_active":"2024-09-21T09:03:38.463546+0000","last_peered":"2024-09-21T09:03:38.463546+0000","last_clean":"2024-09-21T09:03:38.463546+0000","last_became_active":"2024-09-21T09:03:08.250029+0000","last_became_peered":"2024-09-21T09:03:08.250029+0000","last_unstale":"2024-09-21T09:03:38.463546+0000","last_undegraded":"2024-09-21T09:03:38.463546+0000","last_fullsized":"2024-09-21T09:03:38.463546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:58.888309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260917+0000","last_change":"2024-09-21T09:03:00.217928+0000","last_active":"2024-09-21T09:06:06.260917+0000","last_peered":"2024-09-21T09:06:06.260917+0000","last_clean":"2024-09-21T09:06:06.260917+0000","last_became_active":"2024-09-21T09:03:00.217633+0000","last_became_peered":"2024-09-21T09:03:00.217633+0000","last_unstale":"2024-09-21T09:06:06.260917+0000","last_undegraded":"2024-09-21T09:06:06.260917+0000","last_fullsized":"2024-09-21T09:06:06.260917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:20.929000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270779+0000","last_change":"2024-09-21T09:02:58.220432+0000","last_active":"2024-09-21T09:03:38.270779+0000","last_peered":"2024-09-21T09:03:38.270779+0000","last_clean":"2024-09-21T09:03:38.270779+0000","last_became_active":"2024-09-21T09:02:58.220133+0000","last_became_peered":"2024-09-21T09:02:58.220133+0000","last_unstale":"2024-09-21T09:03:38.270779+0000","last_undegraded":"2024-09-21T09:03:38.270779+0000","last_fullsized":"2024-09-21T09:03:38.270779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:53.075751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466206+0000","last_change":"2024-09-21T09:03:02.220223+0000","last_active":"2024-09-21T09:03:38.466206+0000","last_peered":"2024-09-21T09:03:38.466206+0000","last_clean":"2024-09-21T09:03:38.466206+0000","last_became_active":"2024-09-21T09:03:02.219457+0000","last_became_peered":"2024-09-21T09:03:02.219457+0000","last_unstale":"2024-09-21T09:03:38.466206+0000","last_undegraded":"2024-09-21T09:03:38.466206+0000","last_fullsized":"2024-09-21T09:03:38.466206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:02.648349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276650+0000","last_change":"2024-09-21T09:03:04.239498+0000","last_active":"2024-09-21T09:03:38.276650+0000","last_peered":"2024-09-21T09:03:38.276650+0000","last_clean":"2024-09-21T09:03:38.276650+0000","last_became_active":"2024-09-21T09:03:04.239187+0000","last_became_peered":"2024-09-21T09:03:04.239187+0000","last_unstale":"2024-09-21T09:03:38.276650+0000","last_undegraded":"2024-09-21T09:03:38.276650+0000","last_fullsized":"2024-09-21T09:03:38.276650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:25.074373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'285","reported_seq":387,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.891353+0000","last_change":"2024-09-21T09:03:06.248028+0000","last_active":"2024-09-21T09:06:12.891353+0000","last_peered":"2024-09-21T09:06:12.891353+0000","last_clean":"2024-09-21T09:06:12.891353+0000","last_became_active":"2024-09-21T09:03:06.247441+0000","last_became_peered":"2024-09-21T09:03:06.247441+0000","last_unstale":"2024-09-21T09:06:12.891353+0000","last_undegraded":"2024-09-21T09:06:12.891353+0000","last_fullsized":"2024-09-21T09:06:12.891353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:22.593231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'6","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.177765+0000","last_change":"2024-09-21T09:03:08.255550+0000","last_active":"2024-09-21T09:06:06.177765+0000","last_peered":"2024-09-21T09:06:06.177765+0000","last_clean":"2024-09-21T09:06:06.177765+0000","last_became_active":"2024-09-21T09:03:08.255274+0000","last_became_peered":"2024-09-21T09:03:08.255274+0000","last_unstale":"2024-09-21T09:06:06.177765+0000","last_undegraded":"2024-09-21T09:06:06.177765+0000","last_fullsized":"2024-09-21T09:06:06.177765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:12.962973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'4","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173759+0000","last_change":"2024-09-21T09:03:00.216751+0000","last_active":"2024-09-21T09:06:06.173759+0000","last_peered":"2024-09-21T09:06:06.173759+0000","last_clean":"2024-09-21T09:06:06.173759+0000","last_became_active":"2024-09-21T09:03:00.216382+0000","last_became_peered":"2024-09-21T09:03:00.216382+0000","last_unstale":"2024-09-21T09:06:06.173759+0000","last_undegraded":"2024-09-21T09:06:06.173759+0000","last_fullsized":"2024-09-21T09:06:06.173759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:06.215821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273477+0000","last_change":"2024-09-21T09:02:58.210831+0000","last_active":"2024-09-21T09:03:38.273477+0000","last_peered":"2024-09-21T09:03:38.273477+0000","last_clean":"2024-09-21T09:03:38.273477+0000","last_became_active":"2024-09-21T09:02:58.210560+0000","last_became_peered":"2024-09-21T09:02:58.210560+0000","last_unstale":"2024-09-21T09:03:38.273477+0000","last_undegraded":"2024-09-21T09:03:38.273477+0000","last_fullsized":"2024-09-21T09:03:38.273477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:12.355792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274957+0000","last_change":"2024-09-21T09:03:02.221778+0000","last_active":"2024-09-21T09:03:38.274957+0000","last_peered":"2024-09-21T09:03:38.274957+0000","last_clean":"2024-09-21T09:03:38.274957+0000","last_became_active":"2024-09-21T09:03:02.220551+0000","last_became_peered":"2024-09-21T09:03:02.220551+0000","last_unstale":"2024-09-21T09:03:38.274957+0000","last_undegraded":"2024-09-21T09:03:38.274957+0000","last_fullsized":"2024-09-21T09:03:38.274957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:46.255807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.346241+0000","last_change":"2024-09-21T09:03:04.234165+0000","last_active":"2024-09-21T09:05:04.346241+0000","last_peered":"2024-09-21T09:05:04.346241+0000","last_clean":"2024-09-21T09:05:04.346241+0000","last_became_active":"2024-09-21T09:03:04.233848+0000","last_became_peered":"2024-09-21T09:03:04.233848+0000","last_unstale":"2024-09-21T09:05:04.346241+0000","last_undegraded":"2024-09-21T09:05:04.346241+0000","last_fullsized":"2024-09-21T09:05:04.346241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:09.138690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'282","reported_seq":400,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.366462+0000","last_change":"2024-09-21T09:03:06.244195+0000","last_active":"2024-09-21T09:06:06.366462+0000","last_peered":"2024-09-21T09:06:06.366462+0000","last_clean":"2024-09-21T09:06:06.366462+0000","last_became_active":"2024-09-21T09:03:06.243576+0000","last_became_peered":"2024-09-21T09:03:06.243576+0000","last_unstale":"2024-09-21T09:06:06.366462+0000","last_undegraded":"2024-09-21T09:06:06.366462+0000","last_fullsized":"2024-09-21T09:06:06.366462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:31.080527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271245+0000","last_change":"2024-09-21T09:03:00.217801+0000","last_active":"2024-09-21T09:03:38.271245+0000","last_peered":"2024-09-21T09:03:38.271245+0000","last_clean":"2024-09-21T09:03:38.271245+0000","last_became_active":"2024-09-21T09:03:00.217545+0000","last_became_peered":"2024-09-21T09:03:00.217545+0000","last_unstale":"2024-09-21T09:03:38.271245+0000","last_undegraded":"2024-09-21T09:03:38.271245+0000","last_fullsized":"2024-09-21T09:03:38.271245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:43.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.281094+0000","last_change":"2024-09-21T09:02:58.209991+0000","last_active":"2024-09-21T09:03:38.281094+0000","last_peered":"2024-09-21T09:03:38.281094+0000","last_clean":"2024-09-21T09:03:38.281094+0000","last_became_active":"2024-09-21T09:02:58.209712+0000","last_became_peered":"2024-09-21T09:02:58.209712+0000","last_unstale":"2024-09-21T09:03:38.281094+0000","last_undegraded":"2024-09-21T09:03:38.281094+0000","last_fullsized":"2024-09-21T09:03:38.281094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:25.409736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"22'1","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.388071+0000","last_change":"2024-09-21T09:03:02.220925+0000","last_active":"2024-09-21T09:05:05.388071+0000","last_peered":"2024-09-21T09:05:05.388071+0000","last_clean":"2024-09-21T09:05:05.388071+0000","last_became_active":"2024-09-21T09:03:02.220629+0000","last_became_peered":"2024-09-21T09:03:02.220629+0000","last_unstale":"2024-09-21T09:05:05.388071+0000","last_undegraded":"2024-09-21T09:05:05.388071+0000","last_fullsized":"2024-09-21T09:05:05.388071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:32.066319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'40","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.355437+0000","last_change":"2024-09-21T09:03:04.232877+0000","last_active":"2024-09-21T09:05:04.355437+0000","last_peered":"2024-09-21T09:05:04.355437+0000","last_clean":"2024-09-21T09:05:04.355437+0000","last_became_active":"2024-09-21T09:03:04.232394+0000","last_became_peered":"2024-09-21T09:03:04.232394+0000","last_unstale":"2024-09-21T09:05:04.355437+0000","last_undegraded":"2024-09-21T09:05:04.355437+0000","last_fullsized":"2024-09-21T09:05:04.355437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:29.659990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464295+0000","last_change":"2024-09-21T09:03:06.244547+0000","last_active":"2024-09-21T09:03:38.464295+0000","last_peered":"2024-09-21T09:03:38.464295+0000","last_clean":"2024-09-21T09:03:38.464295+0000","last_became_active":"2024-09-21T09:03:06.244259+0000","last_became_peered":"2024-09-21T09:03:06.244259+0000","last_unstale":"2024-09-21T09:03:38.464295+0000","last_undegraded":"2024-09-21T09:03:38.464295+0000","last_fullsized":"2024-09-21T09:03:38.464295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:41.912327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.079455+0000","last_change":"2024-09-21T09:03:08.261530+0000","last_active":"2024-09-21T09:04:22.079455+0000","last_peered":"2024-09-21T09:04:22.079455+0000","last_clean":"2024-09-21T09:04:22.079455+0000","last_became_active":"2024-09-21T09:03:08.261035+0000","last_became_peered":"2024-09-21T09:03:08.261035+0000","last_unstale":"2024-09-21T09:04:22.079455+0000","last_undegraded":"2024-09-21T09:04:22.079455+0000","last_fullsized":"2024-09-21T09:04:22.079455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:03.684978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273196+0000","last_change":"2024-09-21T09:03:00.220087+0000","last_active":"2024-09-21T09:03:38.273196+0000","last_peered":"2024-09-21T09:03:38.273196+0000","last_clean":"2024-09-21T09:03:38.273196+0000","last_became_active":"2024-09-21T09:03:00.219765+0000","last_became_peered":"2024-09-21T09:03:00.219765+0000","last_unstale":"2024-09-21T09:03:38.273196+0000","last_undegraded":"2024-09-21T09:03:38.273196+0000","last_fullsized":"2024-09-21T09:03:38.273196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:52:42.557402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276119+0000","last_change":"2024-09-21T09:02:58.214776+0000","last_active":"2024-09-21T09:03:38.276119+0000","last_peered":"2024-09-21T09:03:38.276119+0000","last_clean":"2024-09-21T09:03:38.276119+0000","last_became_active":"2024-09-21T09:02:58.214392+0000","last_became_peered":"2024-09-21T09:02:58.214392+0000","last_unstale":"2024-09-21T09:03:38.276119+0000","last_undegraded":"2024-09-21T09:03:38.276119+0000","last_fullsized":"2024-09-21T09:03:38.276119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:24.399035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463904+0000","last_change":"2024-09-21T09:03:02.223499+0000","last_active":"2024-09-21T09:03:38.463904+0000","last_peered":"2024-09-21T09:03:38.463904+0000","last_clean":"2024-09-21T09:03:38.463904+0000","last_became_active":"2024-09-21T09:03:02.223123+0000","last_became_peered":"2024-09-21T09:03:02.223123+0000","last_unstale":"2024-09-21T09:03:38.463904+0000","last_undegraded":"2024-09-21T09:03:38.463904+0000","last_fullsized":"2024-09-21T09:03:38.463904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:16.103189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'34","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.942306+0000","last_change":"2024-09-21T09:03:04.242739+0000","last_active":"2024-09-21T09:06:12.942306+0000","last_peered":"2024-09-21T09:06:12.942306+0000","last_clean":"2024-09-21T09:06:12.942306+0000","last_became_active":"2024-09-21T09:03:04.242404+0000","last_became_peered":"2024-09-21T09:03:04.242404+0000","last_unstale":"2024-09-21T09:06:12.942306+0000","last_undegraded":"2024-09-21T09:06:12.942306+0000","last_fullsized":"2024-09-21T09:06:12.942306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:55.151013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463723+0000","last_change":"2024-09-21T09:03:06.248256+0000","last_active":"2024-09-21T09:03:38.463723+0000","last_peered":"2024-09-21T09:03:38.463723+0000","last_clean":"2024-09-21T09:03:38.463723+0000","last_became_active":"2024-09-21T09:03:06.247504+0000","last_became_peered":"2024-09-21T09:03:06.247504+0000","last_unstale":"2024-09-21T09:03:38.463723+0000","last_undegraded":"2024-09-21T09:03:38.463723+0000","last_fullsized":"2024-09-21T09:03:38.463723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:25.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'3","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:16.565423+0000","last_change":"2024-09-21T09:03:08.256372+0000","last_active":"2024-09-21T09:04:16.565423+0000","last_peered":"2024-09-21T09:04:16.565423+0000","last_clean":"2024-09-21T09:04:16.565423+0000","last_became_active":"2024-09-21T09:03:08.255814+0000","last_became_peered":"2024-09-21T09:03:08.255814+0000","last_unstale":"2024-09-21T09:04:16.565423+0000","last_undegraded":"2024-09-21T09:04:16.565423+0000","last_fullsized":"2024-09-21T09:04:16.565423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:46.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273220+0000","last_change":"2024-09-21T09:03:00.223110+0000","last_active":"2024-09-21T09:03:38.273220+0000","last_peered":"2024-09-21T09:03:38.273220+0000","last_clean":"2024-09-21T09:03:38.273220+0000","last_became_active":"2024-09-21T09:03:00.222650+0000","last_became_peered":"2024-09-21T09:03:00.222650+0000","last_unstale":"2024-09-21T09:03:38.273220+0000","last_undegraded":"2024-09-21T09:03:38.273220+0000","last_fullsized":"2024-09-21T09:03:38.273220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:12.697444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278305+0000","last_change":"2024-09-21T09:02:58.213931+0000","last_active":"2024-09-21T09:03:38.278305+0000","last_peered":"2024-09-21T09:03:38.278305+0000","last_clean":"2024-09-21T09:03:38.278305+0000","last_became_active":"2024-09-21T09:02:58.213652+0000","last_became_peered":"2024-09-21T09:02:58.213652+0000","last_unstale":"2024-09-21T09:03:38.278305+0000","last_undegraded":"2024-09-21T09:03:38.278305+0000","last_fullsized":"2024-09-21T09:03:38.278305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:27.612761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.282682+0000","last_change":"2024-09-21T09:03:38.281879+0000","last_active":"2024-09-21T09:03:38.282682+0000","last_peered":"2024-09-21T09:03:38.282682+0000","last_clean":"2024-09-21T09:03:38.282682+0000","last_became_active":"2024-09-21T09:03:38.281497+0000","last_became_peered":"2024-09-21T09:03:38.281497+0000","last_unstale":"2024-09-21T09:03:38.282682+0000","last_undegraded":"2024-09-21T09:03:38.282682+0000","last_fullsized":"2024-09-21T09:03:38.282682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:32.826730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"31'39","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:13.011672+0000","last_change":"2024-09-21T09:03:04.240985+0000","last_active":"2024-09-21T09:06:13.011672+0000","last_peered":"2024-09-21T09:06:13.011672+0000","last_clean":"2024-09-21T09:06:13.011672+0000","last_became_active":"2024-09-21T09:03:04.240144+0000","last_became_peered":"2024-09-21T09:03:04.240144+0000","last_unstale":"2024-09-21T09:06:13.011672+0000","last_undegraded":"2024-09-21T09:06:13.011672+0000","last_fullsized":"2024-09-21T09:06:13.011672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:09.558749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'282","reported_seq":347,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.478440+0000","last_change":"2024-09-21T09:03:06.251119+0000","last_active":"2024-09-21T09:06:06.478440+0000","last_peered":"2024-09-21T09:06:06.478440+0000","last_clean":"2024-09-21T09:06:06.478440+0000","last_became_active":"2024-09-21T09:03:06.250807+0000","last_became_peered":"2024-09-21T09:03:06.250807+0000","last_unstale":"2024-09-21T09:06:06.478440+0000","last_undegraded":"2024-09-21T09:06:06.478440+0000","last_fullsized":"2024-09-21T09:06:06.478440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:37.402801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465087+0000","last_change":"2024-09-21T09:03:08.250308+0000","last_active":"2024-09-21T09:03:38.465087+0000","last_peered":"2024-09-21T09:03:38.465087+0000","last_clean":"2024-09-21T09:03:38.465087+0000","last_became_active":"2024-09-21T09:03:08.250063+0000","last_became_peered":"2024-09-21T09:03:08.250063+0000","last_unstale":"2024-09-21T09:03:38.465087+0000","last_undegraded":"2024-09-21T09:03:38.465087+0000","last_fullsized":"2024-09-21T09:03:38.465087+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:16.323766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.082622+0000","last_change":"2024-09-21T09:03:00.217929+0000","last_active":"2024-09-21T09:06:06.082622+0000","last_peered":"2024-09-21T09:06:06.082622+0000","last_clean":"2024-09-21T09:06:06.082622+0000","last_became_active":"2024-09-21T09:03:00.216544+0000","last_became_peered":"2024-09-21T09:03:00.216544+0000","last_unstale":"2024-09-21T09:06:06.082622+0000","last_undegraded":"2024-09-21T09:06:06.082622+0000","last_fullsized":"2024-09-21T09:06:06.082622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.852495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.836403+0000","last_change":"2024-09-21T09:02:58.224993+0000","last_active":"2024-09-21T09:03:39.836403+0000","last_peered":"2024-09-21T09:03:39.836403+0000","last_clean":"2024-09-21T09:03:39.836403+0000","last_became_active":"2024-09-21T09:02:58.224675+0000","last_became_peered":"2024-09-21T09:02:58.224675+0000","last_unstale":"2024-09-21T09:03:39.836403+0000","last_undegraded":"2024-09-21T09:03:39.836403+0000","last_fullsized":"2024-09-21T09:03:39.836403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:29.937663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464221+0000","last_change":"2024-09-21T09:03:02.223199+0000","last_active":"2024-09-21T09:03:38.464221+0000","last_peered":"2024-09-21T09:03:38.464221+0000","last_clean":"2024-09-21T09:03:38.464221+0000","last_became_active":"2024-09-21T09:03:02.222904+0000","last_became_peered":"2024-09-21T09:03:02.222904+0000","last_unstale":"2024-09-21T09:03:38.464221+0000","last_undegraded":"2024-09-21T09:03:38.464221+0000","last_fullsized":"2024-09-21T09:03:38.464221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:23.601280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'62","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:13.017143+0000","last_change":"2024-09-21T09:03:04.241974+0000","last_active":"2024-09-21T09:06:13.017143+0000","last_peered":"2024-09-21T09:06:13.017143+0000","last_clean":"2024-09-21T09:06:13.017143+0000","last_became_active":"2024-09-21T09:03:04.241679+0000","last_became_peered":"2024-09-21T09:03:04.241679+0000","last_unstale":"2024-09-21T09:06:13.017143+0000","last_undegraded":"2024-09-21T09:06:13.017143+0000","last_fullsized":"2024-09-21T09:06:13.017143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:49.529992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463737+0000","last_change":"2024-09-21T09:03:06.249590+0000","last_active":"2024-09-21T09:03:38.463737+0000","last_peered":"2024-09-21T09:03:38.463737+0000","last_clean":"2024-09-21T09:03:38.463737+0000","last_became_active":"2024-09-21T09:03:06.249377+0000","last_became_peered":"2024-09-21T09:03:06.249377+0000","last_unstale":"2024-09-21T09:03:38.463737+0000","last_undegraded":"2024-09-21T09:03:38.463737+0000","last_fullsized":"2024-09-21T09:03:38.463737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:09.672283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'22","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.456034+0000","last_change":"2024-09-21T09:03:08.260431+0000","last_active":"2024-09-21T09:06:06.456034+0000","last_peered":"2024-09-21T09:06:06.456034+0000","last_clean":"2024-09-21T09:06:06.456034+0000","last_became_active":"2024-09-21T09:03:08.260071+0000","last_became_peered":"2024-09-21T09:03:08.260071+0000","last_unstale":"2024-09-21T09:06:06.456034+0000","last_undegraded":"2024-09-21T09:06:06.456034+0000","last_fullsized":"2024-09-21T09:06:06.456034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:44.917297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.301342+0000","last_change":"2024-09-21T09:03:00.223450+0000","last_active":"2024-09-21T09:03:39.301342+0000","last_peered":"2024-09-21T09:03:39.301342+0000","last_clean":"2024-09-21T09:03:39.301342+0000","last_became_active":"2024-09-21T09:03:00.223184+0000","last_became_peered":"2024-09-21T09:03:00.223184+0000","last_unstale":"2024-09-21T09:03:39.301342+0000","last_undegraded":"2024-09-21T09:03:39.301342+0000","last_fullsized":"2024-09-21T09:03:39.301342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:09.836796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464552+0000","last_change":"2024-09-21T09:02:58.216900+0000","last_active":"2024-09-21T09:03:38.464552+0000","last_peered":"2024-09-21T09:03:38.464552+0000","last_clean":"2024-09-21T09:03:38.464552+0000","last_became_active":"2024-09-21T09:02:58.216545+0000","last_became_peered":"2024-09-21T09:02:58.216545+0000","last_unstale":"2024-09-21T09:03:38.464552+0000","last_undegraded":"2024-09-21T09:03:38.464552+0000","last_fullsized":"2024-09-21T09:03:38.464552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:24.399035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274224+0000","last_change":"2024-09-21T09:03:02.221720+0000","last_active":"2024-09-21T09:03:38.274224+0000","last_peered":"2024-09-21T09:03:38.274224+0000","last_clean":"2024-09-21T09:03:38.274224+0000","last_became_active":"2024-09-21T09:03:02.221352+0000","last_became_peered":"2024-09-21T09:03:02.221352+0000","last_unstale":"2024-09-21T09:03:38.274224+0000","last_undegraded":"2024-09-21T09:03:38.274224+0000","last_fullsized":"2024-09-21T09:03:38.274224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:21.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'32","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.340441+0000","last_change":"2024-09-21T09:03:04.235060+0000","last_active":"2024-09-21T09:05:04.340441+0000","last_peered":"2024-09-21T09:05:04.340441+0000","last_clean":"2024-09-21T09:05:04.340441+0000","last_became_active":"2024-09-21T09:03:04.234750+0000","last_became_peered":"2024-09-21T09:03:04.234750+0000","last_unstale":"2024-09-21T09:05:04.340441+0000","last_undegraded":"2024-09-21T09:05:04.340441+0000","last_fullsized":"2024-09-21T09:05:04.340441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:38.551769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275928+0000","last_change":"2024-09-21T09:03:06.248717+0000","last_active":"2024-09-21T09:03:38.275928+0000","last_peered":"2024-09-21T09:03:38.275928+0000","last_clean":"2024-09-21T09:03:38.275928+0000","last_became_active":"2024-09-21T09:03:06.248453+0000","last_became_peered":"2024-09-21T09:03:06.248453+0000","last_unstale":"2024-09-21T09:03:38.275928+0000","last_undegraded":"2024-09-21T09:03:38.275928+0000","last_fullsized":"2024-09-21T09:03:38.275928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.976812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458033+0000","last_change":"2024-09-21T09:03:08.260732+0000","last_active":"2024-09-21T09:05:08.458033+0000","last_peered":"2024-09-21T09:05:08.458033+0000","last_clean":"2024-09-21T09:05:08.458033+0000","last_became_active":"2024-09-21T09:03:08.260016+0000","last_became_peered":"2024-09-21T09:03:08.260016+0000","last_unstale":"2024-09-21T09:05:08.458033+0000","last_undegraded":"2024-09-21T09:05:08.458033+0000","last_fullsized":"2024-09-21T09:05:08.458033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:07.434714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'10","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363142+0000","last_change":"2024-09-21T09:03:00.221963+0000","last_active":"2024-09-21T09:06:06.363142+0000","last_peered":"2024-09-21T09:06:06.363142+0000","last_clean":"2024-09-21T09:06:06.363142+0000","last_became_active":"2024-09-21T09:03:00.220384+0000","last_became_peered":"2024-09-21T09:03:00.220384+0000","last_unstale":"2024-09-21T09:06:06.363142+0000","last_undegraded":"2024-09-21T09:06:06.363142+0000","last_fullsized":"2024-09-21T09:06:06.363142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:49.615946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'6","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.843889+0000","last_change":"2024-09-21T09:02:58.214415+0000","last_active":"2024-09-21T09:03:39.843889+0000","last_peered":"2024-09-21T09:03:39.843889+0000","last_clean":"2024-09-21T09:03:39.843889+0000","last_became_active":"2024-09-21T09:02:58.213920+0000","last_became_peered":"2024-09-21T09:02:58.213920+0000","last_unstale":"2024-09-21T09:03:39.843889+0000","last_undegraded":"2024-09-21T09:03:39.843889+0000","last_fullsized":"2024-09-21T09:03:39.843889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:07:45.991079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466801+0000","last_change":"2024-09-21T09:03:02.220182+0000","last_active":"2024-09-21T09:03:38.466801+0000","last_peered":"2024-09-21T09:03:38.466801+0000","last_clean":"2024-09-21T09:03:38.466801+0000","last_became_active":"2024-09-21T09:03:02.217917+0000","last_became_peered":"2024-09-21T09:03:02.217917+0000","last_unstale":"2024-09-21T09:03:38.466801+0000","last_undegraded":"2024-09-21T09:03:38.466801+0000","last_fullsized":"2024-09-21T09:03:38.466801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:32.066319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'37","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.365768+0000","last_change":"2024-09-21T09:03:04.235643+0000","last_active":"2024-09-21T09:05:04.365768+0000","last_peered":"2024-09-21T09:05:04.365768+0000","last_clean":"2024-09-21T09:05:04.365768+0000","last_became_active":"2024-09-21T09:03:04.235199+0000","last_became_peered":"2024-09-21T09:03:04.235199+0000","last_unstale":"2024-09-21T09:05:04.365768+0000","last_undegraded":"2024-09-21T09:05:04.365768+0000","last_fullsized":"2024-09-21T09:05:04.365768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:18.113952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'282","reported_seq":402,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.460214+0000","last_change":"2024-09-21T09:03:06.246155+0000","last_active":"2024-09-21T09:06:06.460214+0000","last_peered":"2024-09-21T09:06:06.460214+0000","last_clean":"2024-09-21T09:06:06.460214+0000","last_became_active":"2024-09-21T09:03:06.245904+0000","last_became_peered":"2024-09-21T09:03:06.245904+0000","last_unstale":"2024-09-21T09:06:06.460214+0000","last_undegraded":"2024-09-21T09:06:06.460214+0000","last_fullsized":"2024-09-21T09:06:06.460214+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:51.831002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.454513+0000","last_change":"2024-09-21T09:03:08.253968+0000","last_active":"2024-09-21T09:05:12.454513+0000","last_peered":"2024-09-21T09:05:12.454513+0000","last_clean":"2024-09-21T09:05:12.454513+0000","last_became_active":"2024-09-21T09:03:08.253648+0000","last_became_peered":"2024-09-21T09:03:08.253648+0000","last_unstale":"2024-09-21T09:05:12.454513+0000","last_undegraded":"2024-09-21T09:05:12.454513+0000","last_fullsized":"2024-09-21T09:05:12.454513+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:56.641003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'5","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304375+0000","last_change":"2024-09-21T09:03:00.225003+0000","last_active":"2024-09-21T09:06:06.304375+0000","last_peered":"2024-09-21T09:06:06.304375+0000","last_clean":"2024-09-21T09:06:06.304375+0000","last_became_active":"2024-09-21T09:03:00.222983+0000","last_became_peered":"2024-09-21T09:03:00.222983+0000","last_unstale":"2024-09-21T09:06:06.304375+0000","last_undegraded":"2024-09-21T09:06:06.304375+0000","last_fullsized":"2024-09-21T09:06:06.304375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:24.133336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.838971+0000","last_change":"2024-09-21T09:02:58.222294+0000","last_active":"2024-09-21T09:03:39.838971+0000","last_peered":"2024-09-21T09:03:39.838971+0000","last_clean":"2024-09-21T09:03:39.838971+0000","last_became_active":"2024-09-21T09:02:58.221805+0000","last_became_peered":"2024-09-21T09:02:58.221805+0000","last_unstale":"2024-09-21T09:03:39.838971+0000","last_undegraded":"2024-09-21T09:03:39.838971+0000","last_fullsized":"2024-09-21T09:03:39.838971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:53.268716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'3","reported_seq":413,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.387757+0000","last_change":"2024-09-21T09:03:02.222283+0000","last_active":"2024-09-21T09:05:05.387757+0000","last_peered":"2024-09-21T09:05:05.387757+0000","last_clean":"2024-09-21T09:05:05.387757+0000","last_became_active":"2024-09-21T09:03:02.222002+0000","last_became_peered":"2024-09-21T09:03:02.222002+0000","last_unstale":"2024-09-21T09:05:05.387757+0000","last_undegraded":"2024-09-21T09:05:05.387757+0000","last_fullsized":"2024-09-21T09:05:05.387757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:32.909484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275507+0000","last_change":"2024-09-21T09:03:04.243079+0000","last_active":"2024-09-21T09:03:38.275507+0000","last_peered":"2024-09-21T09:03:38.275507+0000","last_clean":"2024-09-21T09:03:38.275507+0000","last_became_active":"2024-09-21T09:03:04.242702+0000","last_became_peered":"2024-09-21T09:03:04.242702+0000","last_unstale":"2024-09-21T09:03:38.275507+0000","last_undegraded":"2024-09-21T09:03:38.275507+0000","last_fullsized":"2024-09-21T09:03:38.275507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:02.620013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'282","reported_seq":464,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.417369+0000","last_change":"2024-09-21T09:03:06.249279+0000","last_active":"2024-09-21T09:06:06.417369+0000","last_peered":"2024-09-21T09:06:06.417369+0000","last_clean":"2024-09-21T09:06:06.417369+0000","last_became_active":"2024-09-21T09:03:06.248991+0000","last_became_peered":"2024-09-21T09:03:06.248991+0000","last_unstale":"2024-09-21T09:06:06.417369+0000","last_undegraded":"2024-09-21T09:06:06.417369+0000","last_fullsized":"2024-09-21T09:06:06.417369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.466336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.511263+0000","last_change":"2024-09-21T09:03:08.252929+0000","last_active":"2024-09-21T09:05:05.511263+0000","last_peered":"2024-09-21T09:05:05.511263+0000","last_clean":"2024-09-21T09:05:05.511263+0000","last_became_active":"2024-09-21T09:03:08.252549+0000","last_became_peered":"2024-09-21T09:03:08.252549+0000","last_unstale":"2024-09-21T09:05:05.511263+0000","last_undegraded":"2024-09-21T09:05:05.511263+0000","last_fullsized":"2024-09-21T09:05:05.511263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:41.286037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260844+0000","last_change":"2024-09-21T09:03:00.223988+0000","last_active":"2024-09-21T09:06:06.260844+0000","last_peered":"2024-09-21T09:06:06.260844+0000","last_clean":"2024-09-21T09:06:06.260844+0000","last_became_active":"2024-09-21T09:03:00.223719+0000","last_became_peered":"2024-09-21T09:03:00.223719+0000","last_unstale":"2024-09-21T09:06:06.260844+0000","last_undegraded":"2024-09-21T09:06:06.260844+0000","last_fullsized":"2024-09-21T09:06:06.260844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:03.610091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270492+0000","last_change":"2024-09-21T09:02:58.214335+0000","last_active":"2024-09-21T09:03:38.270492+0000","last_peered":"2024-09-21T09:03:38.270492+0000","last_clean":"2024-09-21T09:03:38.270492+0000","last_became_active":"2024-09-21T09:02:58.214074+0000","last_became_peered":"2024-09-21T09:02:58.214074+0000","last_unstale":"2024-09-21T09:03:38.270492+0000","last_undegraded":"2024-09-21T09:03:38.270492+0000","last_fullsized":"2024-09-21T09:03:38.270492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:11.076844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274721+0000","last_change":"2024-09-21T09:03:02.222570+0000","last_active":"2024-09-21T09:03:38.274721+0000","last_peered":"2024-09-21T09:03:38.274721+0000","last_clean":"2024-09-21T09:03:38.274721+0000","last_became_active":"2024-09-21T09:03:02.222095+0000","last_became_peered":"2024-09-21T09:03:02.222095+0000","last_unstale":"2024-09-21T09:03:38.274721+0000","last_undegraded":"2024-09-21T09:03:38.274721+0000","last_fullsized":"2024-09-21T09:03:38.274721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:31.855727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'38","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.352351+0000","last_change":"2024-09-21T09:03:04.236005+0000","last_active":"2024-09-21T09:05:04.352351+0000","last_peered":"2024-09-21T09:05:04.352351+0000","last_clean":"2024-09-21T09:05:04.352351+0000","last_became_active":"2024-09-21T09:03:04.235633+0000","last_became_peered":"2024-09-21T09:03:04.235633+0000","last_unstale":"2024-09-21T09:05:04.352351+0000","last_undegraded":"2024-09-21T09:05:04.352351+0000","last_fullsized":"2024-09-21T09:05:04.352351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:15.434978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275944+0000","last_change":"2024-09-21T09:03:06.248328+0000","last_active":"2024-09-21T09:03:38.275944+0000","last_peered":"2024-09-21T09:03:38.275944+0000","last_clean":"2024-09-21T09:03:38.275944+0000","last_became_active":"2024-09-21T09:03:06.247977+0000","last_became_peered":"2024-09-21T09:03:06.247977+0000","last_unstale":"2024-09-21T09:03:38.275944+0000","last_undegraded":"2024-09-21T09:03:38.275944+0000","last_fullsized":"2024-09-21T09:03:38.275944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:30.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.395329+0000","last_change":"2024-09-21T09:03:08.252270+0000","last_active":"2024-09-21T09:06:06.395329+0000","last_peered":"2024-09-21T09:06:06.395329+0000","last_clean":"2024-09-21T09:06:06.395329+0000","last_became_active":"2024-09-21T09:03:08.251985+0000","last_became_peered":"2024-09-21T09:03:08.251985+0000","last_unstale":"2024-09-21T09:06:06.395329+0000","last_undegraded":"2024-09-21T09:06:06.395329+0000","last_fullsized":"2024-09-21T09:06:06.395329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:21.302376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.082284+0000","last_change":"2024-09-21T09:03:00.221674+0000","last_active":"2024-09-21T09:06:06.082284+0000","last_peered":"2024-09-21T09:06:06.082284+0000","last_clean":"2024-09-21T09:06:06.082284+0000","last_became_active":"2024-09-21T09:03:00.219428+0000","last_became_peered":"2024-09-21T09:03:00.219428+0000","last_unstale":"2024-09-21T09:06:06.082284+0000","last_undegraded":"2024-09-21T09:06:06.082284+0000","last_fullsized":"2024-09-21T09:06:06.082284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:12.568235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":201,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273328+0000","last_change":"2024-09-21T09:02:44.107999+0000","last_active":"2024-09-21T09:03:38.273328+0000","last_peered":"2024-09-21T09:03:38.273328+0000","last_clean":"2024-09-21T09:03:38.273328+0000","last_became_active":"2024-09-21T09:02:44.107052+0000","last_became_peered":"2024-09-21T09:02:44.107052+0000","last_unstale":"2024-09-21T09:03:38.273328+0000","last_undegraded":"2024-09-21T09:03:38.273328+0000","last_fullsized":"2024-09-21T09:03:38.273328+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_clean_scrub_stamp":"2024-09-21T09:02:42.466256+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:10.291354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273506+0000","last_change":"2024-09-21T09:02:51.501401+0000","last_active":"2024-09-21T09:03:38.273506+0000","last_peered":"2024-09-21T09:03:38.273506+0000","last_clean":"2024-09-21T09:03:38.273506+0000","last_became_active":"2024-09-21T09:02:49.492504+0000","last_became_peered":"2024-09-21T09:02:49.492504+0000","last_unstale":"2024-09-21T09:03:38.273506+0000","last_undegraded":"2024-09-21T09:03:38.273506+0000","last_fullsized":"2024-09-21T09:03:38.273506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:33.286003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001229291,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271282+0000","last_change":"2024-09-21T09:02:58.222148+0000","last_active":"2024-09-21T09:03:38.271282+0000","last_peered":"2024-09-21T09:03:38.271282+0000","last_clean":"2024-09-21T09:03:38.271282+0000","last_became_active":"2024-09-21T09:02:58.221874+0000","last_became_peered":"2024-09-21T09:02:58.221874+0000","last_unstale":"2024-09-21T09:03:38.271282+0000","last_undegraded":"2024-09-21T09:03:38.271282+0000","last_fullsized":"2024-09-21T09:03:38.271282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:41.404620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.281164+0000","last_change":"2024-09-21T09:03:38.280004+0000","last_active":"2024-09-21T09:03:38.281164+0000","last_peered":"2024-09-21T09:03:38.281164+0000","last_clean":"2024-09-21T09:03:38.281164+0000","last_became_active":"2024-09-21T09:03:38.279694+0000","last_became_peered":"2024-09-21T09:03:38.279694+0000","last_unstale":"2024-09-21T09:03:38.281164+0000","last_undegraded":"2024-09-21T09:03:38.281164+0000","last_fullsized":"2024-09-21T09:03:38.281164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:16.786252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'85","reported_seq":166,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:13.030185+0000","last_change":"2024-09-21T09:03:04.240626+0000","last_active":"2024-09-21T09:06:13.030185+0000","last_peered":"2024-09-21T09:06:13.030185+0000","last_clean":"2024-09-21T09:06:13.030185+0000","last_became_active":"2024-09-21T09:03:04.240327+0000","last_became_peered":"2024-09-21T09:03:04.240327+0000","last_unstale":"2024-09-21T09:06:13.030185+0000","last_undegraded":"2024-09-21T09:06:13.030185+0000","last_fullsized":"2024-09-21T09:06:13.030185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:19.716984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465984+0000","last_change":"2024-09-21T09:03:06.247919+0000","last_active":"2024-09-21T09:03:38.465984+0000","last_peered":"2024-09-21T09:03:38.465984+0000","last_clean":"2024-09-21T09:03:38.465984+0000","last_became_active":"2024-09-21T09:03:06.247593+0000","last_became_peered":"2024-09-21T09:03:06.247593+0000","last_unstale":"2024-09-21T09:03:38.465984+0000","last_undegraded":"2024-09-21T09:03:38.465984+0000","last_fullsized":"2024-09-21T09:03:38.465984+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:56.554312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'83","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.373253+0000","last_change":"2024-09-21T09:03:08.251766+0000","last_active":"2024-09-21T09:06:06.373253+0000","last_peered":"2024-09-21T09:06:06.373253+0000","last_clean":"2024-09-21T09:06:06.373253+0000","last_became_active":"2024-09-21T09:03:08.251416+0000","last_became_peered":"2024-09-21T09:03:08.251416+0000","last_unstale":"2024-09-21T09:06:06.373253+0000","last_undegraded":"2024-09-21T09:06:06.373253+0000","last_fullsized":"2024-09-21T09:06:06.373253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:43.892525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.711324+0000","last_change":"2024-09-21T09:03:00.217299+0000","last_active":"2024-09-21T09:05:02.711324+0000","last_peered":"2024-09-21T09:05:02.711324+0000","last_clean":"2024-09-21T09:05:02.711324+0000","last_became_active":"2024-09-21T09:03:00.217018+0000","last_became_peered":"2024-09-21T09:03:00.217018+0000","last_unstale":"2024-09-21T09:05:02.711324+0000","last_undegraded":"2024-09-21T09:05:02.711324+0000","last_fullsized":"2024-09-21T09:05:02.711324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:26.810823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270854+0000","last_change":"2024-09-21T09:02:51.500609+0000","last_active":"2024-09-21T09:03:38.270854+0000","last_peered":"2024-09-21T09:03:38.270854+0000","last_clean":"2024-09-21T09:03:38.270854+0000","last_became_active":"2024-09-21T09:02:49.493239+0000","last_became_peered":"2024-09-21T09:02:49.493239+0000","last_unstale":"2024-09-21T09:03:38.270854+0000","last_undegraded":"2024-09-21T09:03:38.270854+0000","last_fullsized":"2024-09-21T09:03:38.270854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:46.489803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046437600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464127+0000","last_change":"2024-09-21T09:02:58.209258+0000","last_active":"2024-09-21T09:03:38.464127+0000","last_peered":"2024-09-21T09:03:38.464127+0000","last_clean":"2024-09-21T09:03:38.464127+0000","last_became_active":"2024-09-21T09:02:58.208819+0000","last_became_peered":"2024-09-21T09:02:58.208819+0000","last_unstale":"2024-09-21T09:03:38.464127+0000","last_undegraded":"2024-09-21T09:03:38.464127+0000","last_fullsized":"2024-09-21T09:03:38.464127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:08.728738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277167+0000","last_change":"2024-09-21T09:03:02.221203+0000","last_active":"2024-09-21T09:03:38.277167+0000","last_peered":"2024-09-21T09:03:38.277167+0000","last_clean":"2024-09-21T09:03:38.277167+0000","last_became_active":"2024-09-21T09:03:02.220903+0000","last_became_peered":"2024-09-21T09:03:02.220903+0000","last_unstale":"2024-09-21T09:03:38.277167+0000","last_undegraded":"2024-09-21T09:03:38.277167+0000","last_fullsized":"2024-09-21T09:03:38.277167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:54.934676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'273","reported_seq":475,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:02.304493+0000","last_change":"2024-09-21T09:03:04.240716+0000","last_active":"2024-09-21T09:06:02.304493+0000","last_peered":"2024-09-21T09:06:02.304493+0000","last_clean":"2024-09-21T09:06:02.304493+0000","last_became_active":"2024-09-21T09:03:04.240433+0000","last_became_peered":"2024-09-21T09:03:04.240433+0000","last_unstale":"2024-09-21T09:06:02.304493+0000","last_undegraded":"2024-09-21T09:06:02.304493+0000","last_fullsized":"2024-09-21T09:06:02.304493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:45.460299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277557+0000","last_change":"2024-09-21T09:03:06.248226+0000","last_active":"2024-09-21T09:03:38.277557+0000","last_peered":"2024-09-21T09:03:38.277557+0000","last_clean":"2024-09-21T09:03:38.277557+0000","last_became_active":"2024-09-21T09:03:06.247746+0000","last_became_peered":"2024-09-21T09:03:06.247746+0000","last_unstale":"2024-09-21T09:03:38.277557+0000","last_undegraded":"2024-09-21T09:03:38.277557+0000","last_fullsized":"2024-09-21T09:03:38.277557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:39.299058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.300471+0000","last_change":"2024-09-21T09:03:08.259029+0000","last_active":"2024-09-21T09:06:06.300471+0000","last_peered":"2024-09-21T09:06:06.300471+0000","last_clean":"2024-09-21T09:06:06.300471+0000","last_became_active":"2024-09-21T09:03:08.258104+0000","last_became_peered":"2024-09-21T09:03:08.258104+0000","last_unstale":"2024-09-21T09:06:06.300471+0000","last_undegraded":"2024-09-21T09:06:06.300471+0000","last_fullsized":"2024-09-21T09:06:06.300471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:58.888309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465869+0000","last_change":"2024-09-21T09:03:00.227553+0000","last_active":"2024-09-21T09:03:38.465869+0000","last_peered":"2024-09-21T09:03:38.465869+0000","last_clean":"2024-09-21T09:03:38.465869+0000","last_became_active":"2024-09-21T09:03:00.227191+0000","last_became_peered":"2024-09-21T09:03:00.227191+0000","last_unstale":"2024-09-21T09:03:38.465869+0000","last_undegraded":"2024-09-21T09:03:38.465869+0000","last_fullsized":"2024-09-21T09:03:38.465869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:51.194693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272617+0000","last_change":"2024-09-21T09:02:51.506704+0000","last_active":"2024-09-21T09:03:38.272617+0000","last_peered":"2024-09-21T09:03:38.272617+0000","last_clean":"2024-09-21T09:03:38.272617+0000","last_became_active":"2024-09-21T09:02:49.493605+0000","last_became_peered":"2024-09-21T09:02:49.493605+0000","last_unstale":"2024-09-21T09:03:38.272617+0000","last_undegraded":"2024-09-21T09:03:38.272617+0000","last_fullsized":"2024-09-21T09:03:38.272617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:33.820022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033020199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463162+0000","last_change":"2024-09-21T09:02:58.209627+0000","last_active":"2024-09-21T09:03:38.463162+0000","last_peered":"2024-09-21T09:03:38.463162+0000","last_clean":"2024-09-21T09:03:38.463162+0000","last_became_active":"2024-09-21T09:02:58.209343+0000","last_became_peered":"2024-09-21T09:02:58.209343+0000","last_unstale":"2024-09-21T09:03:38.463162+0000","last_undegraded":"2024-09-21T09:03:38.463162+0000","last_fullsized":"2024-09-21T09:03:38.463162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:14.606085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276272+0000","last_change":"2024-09-21T09:03:02.219332+0000","last_active":"2024-09-21T09:03:38.276272+0000","last_peered":"2024-09-21T09:03:38.276272+0000","last_clean":"2024-09-21T09:03:38.276272+0000","last_became_active":"2024-09-21T09:03:02.219067+0000","last_became_peered":"2024-09-21T09:03:02.219067+0000","last_unstale":"2024-09-21T09:03:38.276272+0000","last_undegraded":"2024-09-21T09:03:38.276272+0000","last_fullsized":"2024-09-21T09:03:38.276272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:05.617526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'17","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.268634+0000","last_change":"2024-09-21T09:03:04.231010+0000","last_active":"2024-09-21T09:06:06.268634+0000","last_peered":"2024-09-21T09:06:06.268634+0000","last_clean":"2024-09-21T09:06:06.268634+0000","last_became_active":"2024-09-21T09:03:04.230686+0000","last_became_peered":"2024-09-21T09:03:04.230686+0000","last_unstale":"2024-09-21T09:06:06.268634+0000","last_undegraded":"2024-09-21T09:06:06.268634+0000","last_fullsized":"2024-09-21T09:06:06.268634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:25.612043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466265+0000","last_change":"2024-09-21T09:03:06.248379+0000","last_active":"2024-09-21T09:03:38.466265+0000","last_peered":"2024-09-21T09:03:38.466265+0000","last_clean":"2024-09-21T09:03:38.466265+0000","last_became_active":"2024-09-21T09:03:06.248087+0000","last_became_peered":"2024-09-21T09:03:06.248087+0000","last_unstale":"2024-09-21T09:03:38.466265+0000","last_undegraded":"2024-09-21T09:03:38.466265+0000","last_fullsized":"2024-09-21T09:03:38.466265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:23.429533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271393+0000","last_change":"2024-09-21T09:03:08.259295+0000","last_active":"2024-09-21T09:03:38.271393+0000","last_peered":"2024-09-21T09:03:38.271393+0000","last_clean":"2024-09-21T09:03:38.271393+0000","last_became_active":"2024-09-21T09:03:08.258974+0000","last_became_peered":"2024-09-21T09:03:08.258974+0000","last_unstale":"2024-09-21T09:03:38.271393+0000","last_undegraded":"2024-09-21T09:03:38.271393+0000","last_fullsized":"2024-09-21T09:03:38.271393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:23.850104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'7","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.182044+0000","last_change":"2024-09-21T09:03:00.221607+0000","last_active":"2024-09-21T09:06:06.182044+0000","last_peered":"2024-09-21T09:06:06.182044+0000","last_clean":"2024-09-21T09:06:06.182044+0000","last_became_active":"2024-09-21T09:03:00.221080+0000","last_became_peered":"2024-09-21T09:03:00.221080+0000","last_unstale":"2024-09-21T09:06:06.182044+0000","last_undegraded":"2024-09-21T09:06:06.182044+0000","last_fullsized":"2024-09-21T09:06:06.182044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:53.039369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271511+0000","last_change":"2024-09-21T09:02:51.501105+0000","last_active":"2024-09-21T09:03:38.271511+0000","last_peered":"2024-09-21T09:03:38.271511+0000","last_clean":"2024-09-21T09:03:38.271511+0000","last_became_active":"2024-09-21T09:02:49.493348+0000","last_became_peered":"2024-09-21T09:02:49.493348+0000","last_unstale":"2024-09-21T09:03:38.271511+0000","last_undegraded":"2024-09-21T09:03:38.271511+0000","last_fullsized":"2024-09-21T09:03:38.271511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:12.805512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096028300000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.279362+0000","last_change":"2024-09-21T09:02:58.207996+0000","last_active":"2024-09-21T09:03:38.279362+0000","last_peered":"2024-09-21T09:03:38.279362+0000","last_clean":"2024-09-21T09:03:38.279362+0000","last_became_active":"2024-09-21T09:02:58.207236+0000","last_became_peered":"2024-09-21T09:02:58.207236+0000","last_unstale":"2024-09-21T09:03:38.279362+0000","last_undegraded":"2024-09-21T09:03:38.279362+0000","last_fullsized":"2024-09-21T09:03:38.279362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:38.066496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465166+0000","last_change":"2024-09-21T09:03:02.221735+0000","last_active":"2024-09-21T09:03:38.465166+0000","last_peered":"2024-09-21T09:03:38.465166+0000","last_clean":"2024-09-21T09:03:38.465166+0000","last_became_active":"2024-09-21T09:03:02.221310+0000","last_became_peered":"2024-09-21T09:03:02.221310+0000","last_unstale":"2024-09-21T09:03:38.465166+0000","last_undegraded":"2024-09-21T09:03:38.465166+0000","last_fullsized":"2024-09-21T09:03:38.465166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:07.127926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'13","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.727672+0000","last_change":"2024-09-21T09:03:04.243723+0000","last_active":"2024-09-21T09:06:05.727672+0000","last_peered":"2024-09-21T09:06:05.727672+0000","last_clean":"2024-09-21T09:06:05.727672+0000","last_became_active":"2024-09-21T09:03:04.243076+0000","last_became_peered":"2024-09-21T09:03:04.243076+0000","last_unstale":"2024-09-21T09:06:05.727672+0000","last_undegraded":"2024-09-21T09:06:05.727672+0000","last_fullsized":"2024-09-21T09:06:05.727672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:19.628532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276013+0000","last_change":"2024-09-21T09:03:06.250792+0000","last_active":"2024-09-21T09:03:38.276013+0000","last_peered":"2024-09-21T09:03:38.276013+0000","last_clean":"2024-09-21T09:03:38.276013+0000","last_became_active":"2024-09-21T09:03:06.250530+0000","last_became_peered":"2024-09-21T09:03:06.250530+0000","last_unstale":"2024-09-21T09:03:38.276013+0000","last_undegraded":"2024-09-21T09:03:38.276013+0000","last_fullsized":"2024-09-21T09:03:38.276013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:33.277141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.492123+0000","last_change":"2024-09-21T09:03:08.262588+0000","last_active":"2024-09-21T09:05:05.492123+0000","last_peered":"2024-09-21T09:05:05.492123+0000","last_clean":"2024-09-21T09:05:05.492123+0000","last_became_active":"2024-09-21T09:03:08.262240+0000","last_became_peered":"2024-09-21T09:03:08.262240+0000","last_unstale":"2024-09-21T09:05:05.492123+0000","last_undegraded":"2024-09-21T09:05:05.492123+0000","last_fullsized":"2024-09-21T09:05:05.492123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:11.429927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363318+0000","last_change":"2024-09-21T09:03:00.227032+0000","last_active":"2024-09-21T09:06:06.363318+0000","last_peered":"2024-09-21T09:06:06.363318+0000","last_clean":"2024-09-21T09:06:06.363318+0000","last_became_active":"2024-09-21T09:03:00.224297+0000","last_became_peered":"2024-09-21T09:03:00.224297+0000","last_unstale":"2024-09-21T09:06:06.363318+0000","last_undegraded":"2024-09-21T09:06:06.363318+0000","last_fullsized":"2024-09-21T09:06:06.363318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:20.245983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274931+0000","last_change":"2024-09-21T09:02:58.207055+0000","last_active":"2024-09-21T09:03:38.274931+0000","last_peered":"2024-09-21T09:03:38.274931+0000","last_clean":"2024-09-21T09:03:38.274931+0000","last_became_active":"2024-09-21T09:02:58.206718+0000","last_became_peered":"2024-09-21T09:02:58.206718+0000","last_unstale":"2024-09-21T09:03:38.274931+0000","last_undegraded":"2024-09-21T09:03:38.274931+0000","last_fullsized":"2024-09-21T09:03:38.274931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:08.728738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466210+0000","last_change":"2024-09-21T09:02:51.498275+0000","last_active":"2024-09-21T09:03:38.466210+0000","last_peered":"2024-09-21T09:03:38.466210+0000","last_clean":"2024-09-21T09:03:38.466210+0000","last_became_active":"2024-09-21T09:02:49.493509+0000","last_became_peered":"2024-09-21T09:02:49.493509+0000","last_unstale":"2024-09-21T09:03:38.466210+0000","last_undegraded":"2024-09-21T09:03:38.466210+0000","last_fullsized":"2024-09-21T09:03:38.466210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:48.460775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038981200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453822+0000","last_change":"2024-09-21T09:03:02.221871+0000","last_active":"2024-09-21T09:05:07.453822+0000","last_peered":"2024-09-21T09:05:07.453822+0000","last_clean":"2024-09-21T09:05:07.453822+0000","last_became_active":"2024-09-21T09:03:02.221309+0000","last_became_peered":"2024-09-21T09:03:02.221309+0000","last_unstale":"2024-09-21T09:05:07.453822+0000","last_undegraded":"2024-09-21T09:05:07.453822+0000","last_fullsized":"2024-09-21T09:05:07.453822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:23.063609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'61","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453751+0000","last_change":"2024-09-21T09:03:04.243555+0000","last_active":"2024-09-21T09:05:07.453751+0000","last_peered":"2024-09-21T09:05:07.453751+0000","last_clean":"2024-09-21T09:05:07.453751+0000","last_became_active":"2024-09-21T09:03:04.243228+0000","last_became_peered":"2024-09-21T09:03:04.243228+0000","last_unstale":"2024-09-21T09:05:07.453751+0000","last_undegraded":"2024-09-21T09:05:07.453751+0000","last_fullsized":"2024-09-21T09:05:07.453751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:28.764693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272915+0000","last_change":"2024-09-21T09:03:06.246855+0000","last_active":"2024-09-21T09:03:38.272915+0000","last_peered":"2024-09-21T09:03:38.272915+0000","last_clean":"2024-09-21T09:03:38.272915+0000","last_became_active":"2024-09-21T09:03:06.246598+0000","last_became_peered":"2024-09-21T09:03:06.246598+0000","last_unstale":"2024-09-21T09:03:38.272915+0000","last_undegraded":"2024-09-21T09:03:38.272915+0000","last_fullsized":"2024-09-21T09:03:38.272915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:13.435386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.657366+0000","last_change":"2024-09-21T09:03:08.251063+0000","last_active":"2024-09-21T09:05:05.657366+0000","last_peered":"2024-09-21T09:05:05.657366+0000","last_clean":"2024-09-21T09:05:05.657366+0000","last_became_active":"2024-09-21T09:03:08.250714+0000","last_became_peered":"2024-09-21T09:03:08.250714+0000","last_unstale":"2024-09-21T09:05:05.657366+0000","last_undegraded":"2024-09-21T09:05:05.657366+0000","last_fullsized":"2024-09-21T09:05:05.657366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:01.596559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'10","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173544+0000","last_change":"2024-09-21T09:03:38.286969+0000","last_active":"2024-09-21T09:06:06.173544+0000","last_peered":"2024-09-21T09:06:06.173544+0000","last_clean":"2024-09-21T09:06:06.173544+0000","last_became_active":"2024-09-21T09:03:38.282889+0000","last_became_peered":"2024-09-21T09:03:38.282889+0000","last_unstale":"2024-09-21T09:06:06.173544+0000","last_undegraded":"2024-09-21T09:06:06.173544+0000","last_fullsized":"2024-09-21T09:06:06.173544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:56.518385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.752145+0000","last_change":"2024-09-21T09:02:58.208957+0000","last_active":"2024-09-21T09:03:38.752145+0000","last_peered":"2024-09-21T09:03:38.752145+0000","last_clean":"2024-09-21T09:03:38.752145+0000","last_became_active":"2024-09-21T09:02:58.208569+0000","last_became_peered":"2024-09-21T09:02:58.208569+0000","last_unstale":"2024-09-21T09:03:38.752145+0000","last_undegraded":"2024-09-21T09:03:38.752145+0000","last_fullsized":"2024-09-21T09:03:38.752145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:43:46.150242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278210+0000","last_change":"2024-09-21T09:02:51.501475+0000","last_active":"2024-09-21T09:03:38.278210+0000","last_peered":"2024-09-21T09:03:38.278210+0000","last_clean":"2024-09-21T09:03:38.278210+0000","last_became_active":"2024-09-21T09:02:49.493469+0000","last_became_peered":"2024-09-21T09:02:49.493469+0000","last_unstale":"2024-09-21T09:03:38.278210+0000","last_undegraded":"2024-09-21T09:03:38.278210+0000","last_fullsized":"2024-09-21T09:03:38.278210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:23.397410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001228114,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271668+0000","last_change":"2024-09-21T09:03:02.218570+0000","last_active":"2024-09-21T09:03:38.271668+0000","last_peered":"2024-09-21T09:03:38.271668+0000","last_clean":"2024-09-21T09:03:38.271668+0000","last_became_active":"2024-09-21T09:03:02.218232+0000","last_became_peered":"2024-09-21T09:03:02.218232+0000","last_unstale":"2024-09-21T09:03:38.271668+0000","last_undegraded":"2024-09-21T09:03:38.271668+0000","last_fullsized":"2024-09-21T09:03:38.271668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:18.210878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273881+0000","last_change":"2024-09-21T09:03:04.241792+0000","last_active":"2024-09-21T09:03:38.273881+0000","last_peered":"2024-09-21T09:03:38.273881+0000","last_clean":"2024-09-21T09:03:38.273881+0000","last_became_active":"2024-09-21T09:03:04.241500+0000","last_became_peered":"2024-09-21T09:03:04.241500+0000","last_unstale":"2024-09-21T09:03:38.273881+0000","last_undegraded":"2024-09-21T09:03:38.273881+0000","last_fullsized":"2024-09-21T09:03:38.273881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:13.085591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'282","reported_seq":354,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:02.304345+0000","last_change":"2024-09-21T09:03:06.249606+0000","last_active":"2024-09-21T09:06:02.304345+0000","last_peered":"2024-09-21T09:06:02.304345+0000","last_clean":"2024-09-21T09:06:02.304345+0000","last_became_active":"2024-09-21T09:03:06.249303+0000","last_became_peered":"2024-09-21T09:03:06.249303+0000","last_unstale":"2024-09-21T09:06:02.304345+0000","last_undegraded":"2024-09-21T09:06:02.304345+0000","last_fullsized":"2024-09-21T09:06:02.304345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.216872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275702+0000","last_change":"2024-09-21T09:03:08.264861+0000","last_active":"2024-09-21T09:03:38.275702+0000","last_peered":"2024-09-21T09:03:38.275702+0000","last_clean":"2024-09-21T09:03:38.275702+0000","last_became_active":"2024-09-21T09:03:08.264322+0000","last_became_peered":"2024-09-21T09:03:08.264322+0000","last_unstale":"2024-09-21T09:03:38.275702+0000","last_undegraded":"2024-09-21T09:03:38.275702+0000","last_fullsized":"2024-09-21T09:03:38.275702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:40.391041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.280043+0000","last_change":"2024-09-21T09:03:38.277961+0000","last_active":"2024-09-21T09:03:38.280043+0000","last_peered":"2024-09-21T09:03:38.280043+0000","last_clean":"2024-09-21T09:03:38.280043+0000","last_became_active":"2024-09-21T09:03:38.277629+0000","last_became_peered":"2024-09-21T09:03:38.277629+0000","last_unstale":"2024-09-21T09:03:38.280043+0000","last_undegraded":"2024-09-21T09:03:38.280043+0000","last_fullsized":"2024-09-21T09:03:38.280043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:59:16.786827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.670946+0000","last_change":"2024-09-21T09:02:58.223891+0000","last_active":"2024-09-21T09:05:05.670946+0000","last_peered":"2024-09-21T09:05:05.670946+0000","last_clean":"2024-09-21T09:05:05.670946+0000","last_became_active":"2024-09-21T09:02:58.223652+0000","last_became_peered":"2024-09-21T09:02:58.223652+0000","last_unstale":"2024-09-21T09:05:05.670946+0000","last_undegraded":"2024-09-21T09:05:05.670946+0000","last_fullsized":"2024-09-21T09:05:05.670946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:51.491682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465258+0000","last_change":"2024-09-21T09:02:51.498192+0000","last_active":"2024-09-21T09:03:38.465258+0000","last_peered":"2024-09-21T09:03:38.465258+0000","last_clean":"2024-09-21T09:03:38.465258+0000","last_became_active":"2024-09-21T09:02:49.493144+0000","last_became_peered":"2024-09-21T09:02:49.493144+0000","last_unstale":"2024-09-21T09:03:38.465258+0000","last_undegraded":"2024-09-21T09:03:38.465258+0000","last_fullsized":"2024-09-21T09:03:38.465258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:04.340866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042500699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271170+0000","last_change":"2024-09-21T09:03:02.219747+0000","last_active":"2024-09-21T09:03:38.271170+0000","last_peered":"2024-09-21T09:03:38.271170+0000","last_clean":"2024-09-21T09:03:38.271170+0000","last_became_active":"2024-09-21T09:03:02.219133+0000","last_became_peered":"2024-09-21T09:03:02.219133+0000","last_unstale":"2024-09-21T09:03:38.271170+0000","last_undegraded":"2024-09-21T09:03:38.271170+0000","last_fullsized":"2024-09-21T09:03:38.271170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:11.438389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273948+0000","last_change":"2024-09-21T09:03:04.241801+0000","last_active":"2024-09-21T09:03:38.273948+0000","last_peered":"2024-09-21T09:03:38.273948+0000","last_clean":"2024-09-21T09:03:38.273948+0000","last_became_active":"2024-09-21T09:03:04.241256+0000","last_became_peered":"2024-09-21T09:03:04.241256+0000","last_unstale":"2024-09-21T09:03:38.273948+0000","last_undegraded":"2024-09-21T09:03:38.273948+0000","last_fullsized":"2024-09-21T09:03:38.273948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:52.487954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'282","reported_seq":428,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.456684+0000","last_change":"2024-09-21T09:03:06.244206+0000","last_active":"2024-09-21T09:06:06.456684+0000","last_peered":"2024-09-21T09:06:06.456684+0000","last_clean":"2024-09-21T09:06:06.456684+0000","last_became_active":"2024-09-21T09:03:06.243566+0000","last_became_peered":"2024-09-21T09:03:06.243566+0000","last_unstale":"2024-09-21T09:06:06.456684+0000","last_undegraded":"2024-09-21T09:06:06.456684+0000","last_fullsized":"2024-09-21T09:06:06.456684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:40.536244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274538+0000","last_change":"2024-09-21T09:03:08.262736+0000","last_active":"2024-09-21T09:03:38.274538+0000","last_peered":"2024-09-21T09:03:38.274538+0000","last_clean":"2024-09-21T09:03:38.274538+0000","last_became_active":"2024-09-21T09:03:08.262460+0000","last_became_peered":"2024-09-21T09:03:08.262460+0000","last_unstale":"2024-09-21T09:03:38.274538+0000","last_undegraded":"2024-09-21T09:03:38.274538+0000","last_fullsized":"2024-09-21T09:03:38.274538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:09.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'14","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.081970+0000","last_change":"2024-09-21T09:03:00.218617+0000","last_active":"2024-09-21T09:06:06.081970+0000","last_peered":"2024-09-21T09:06:06.081970+0000","last_clean":"2024-09-21T09:06:06.081970+0000","last_became_active":"2024-09-21T09:03:00.216782+0000","last_became_peered":"2024-09-21T09:03:00.216782+0000","last_unstale":"2024-09-21T09:06:06.081970+0000","last_undegraded":"2024-09-21T09:06:06.081970+0000","last_fullsized":"2024-09-21T09:06:06.081970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:30.927993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276170+0000","last_change":"2024-09-21T09:02:58.213576+0000","last_active":"2024-09-21T09:03:38.276170+0000","last_peered":"2024-09-21T09:03:38.276170+0000","last_clean":"2024-09-21T09:03:38.276170+0000","last_became_active":"2024-09-21T09:02:58.213293+0000","last_became_peered":"2024-09-21T09:02:58.213293+0000","last_unstale":"2024-09-21T09:03:38.276170+0000","last_undegraded":"2024-09-21T09:03:38.276170+0000","last_fullsized":"2024-09-21T09:03:38.276170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:52.024304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276092+0000","last_change":"2024-09-21T09:02:51.501161+0000","last_active":"2024-09-21T09:03:38.276092+0000","last_peered":"2024-09-21T09:03:38.276092+0000","last_clean":"2024-09-21T09:03:38.276092+0000","last_became_active":"2024-09-21T09:02:49.542160+0000","last_became_peered":"2024-09-21T09:02:49.542160+0000","last_unstale":"2024-09-21T09:03:38.276092+0000","last_undegraded":"2024-09-21T09:03:38.276092+0000","last_fullsized":"2024-09-21T09:03:38.276092+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:18.503834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099618800000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271683+0000","last_change":"2024-09-21T09:03:02.218497+0000","last_active":"2024-09-21T09:03:38.271683+0000","last_peered":"2024-09-21T09:03:38.271683+0000","last_clean":"2024-09-21T09:03:38.271683+0000","last_became_active":"2024-09-21T09:03:02.218138+0000","last_became_peered":"2024-09-21T09:03:02.218138+0000","last_unstale":"2024-09-21T09:03:38.271683+0000","last_undegraded":"2024-09-21T09:03:38.271683+0000","last_fullsized":"2024-09-21T09:03:38.271683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:08.671338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'83","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455214+0000","last_change":"2024-09-21T09:03:04.232064+0000","last_active":"2024-09-21T09:05:12.455214+0000","last_peered":"2024-09-21T09:05:12.455214+0000","last_clean":"2024-09-21T09:05:12.455214+0000","last_became_active":"2024-09-21T09:03:04.231708+0000","last_became_peered":"2024-09-21T09:03:04.231708+0000","last_unstale":"2024-09-21T09:05:12.455214+0000","last_undegraded":"2024-09-21T09:05:12.455214+0000","last_fullsized":"2024-09-21T09:05:12.455214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:03.027213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6027,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463881+0000","last_change":"2024-09-21T09:03:06.249786+0000","last_active":"2024-09-21T09:03:38.463881+0000","last_peered":"2024-09-21T09:03:38.463881+0000","last_clean":"2024-09-21T09:03:38.463881+0000","last_became_active":"2024-09-21T09:03:06.249474+0000","last_became_peered":"2024-09-21T09:03:06.249474+0000","last_unstale":"2024-09-21T09:03:38.463881+0000","last_undegraded":"2024-09-21T09:03:38.463881+0000","last_fullsized":"2024-09-21T09:03:38.463881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.466336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273844+0000","last_change":"2024-09-21T09:03:08.252824+0000","last_active":"2024-09-21T09:03:38.273844+0000","last_peered":"2024-09-21T09:03:38.273844+0000","last_clean":"2024-09-21T09:03:38.273844+0000","last_became_active":"2024-09-21T09:03:08.252363+0000","last_became_peered":"2024-09-21T09:03:08.252363+0000","last_unstale":"2024-09-21T09:03:38.273844+0000","last_undegraded":"2024-09-21T09:03:38.273844+0000","last_fullsized":"2024-09-21T09:03:38.273844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:05.753776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.850611+0000","last_change":"2024-09-21T09:03:08.256842+0000","last_active":"2024-09-21T09:03:39.850611+0000","last_peered":"2024-09-21T09:03:39.850611+0000","last_clean":"2024-09-21T09:03:39.850611+0000","last_became_active":"2024-09-21T09:03:08.256571+0000","last_became_peered":"2024-09-21T09:03:08.256571+0000","last_unstale":"2024-09-21T09:03:39.850611+0000","last_undegraded":"2024-09-21T09:03:39.850611+0000","last_fullsized":"2024-09-21T09:03:39.850611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:39.409841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'12","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.301323+0000","last_change":"2024-09-21T09:03:38.470029+0000","last_active":"2024-09-21T09:03:39.301323+0000","last_peered":"2024-09-21T09:03:39.301323+0000","last_clean":"2024-09-21T09:03:39.301323+0000","last_became_active":"2024-09-21T09:03:38.466274+0000","last_became_peered":"2024-09-21T09:03:38.466274+0000","last_unstale":"2024-09-21T09:03:39.301323+0000","last_undegraded":"2024-09-21T09:03:39.301323+0000","last_fullsized":"2024-09-21T09:03:39.301323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:38.626004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275410+0000","last_change":"2024-09-21T09:02:58.221038+0000","last_active":"2024-09-21T09:03:38.275410+0000","last_peered":"2024-09-21T09:03:38.275410+0000","last_clean":"2024-09-21T09:03:38.275410+0000","last_became_active":"2024-09-21T09:02:58.220716+0000","last_became_peered":"2024-09-21T09:02:58.220716+0000","last_unstale":"2024-09-21T09:03:38.275410+0000","last_undegraded":"2024-09-21T09:03:38.275410+0000","last_fullsized":"2024-09-21T09:03:38.275410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:36.863978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274326+0000","last_change":"2024-09-21T09:03:02.220312+0000","last_active":"2024-09-21T09:03:38.274326+0000","last_peered":"2024-09-21T09:03:38.274326+0000","last_clean":"2024-09-21T09:03:38.274326+0000","last_became_active":"2024-09-21T09:03:02.219652+0000","last_became_peered":"2024-09-21T09:03:02.219652+0000","last_unstale":"2024-09-21T09:03:38.274326+0000","last_undegraded":"2024-09-21T09:03:38.274326+0000","last_fullsized":"2024-09-21T09:03:38.274326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:42.719585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'35","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:13.008979+0000","last_change":"2024-09-21T09:03:04.241932+0000","last_active":"2024-09-21T09:06:13.008979+0000","last_peered":"2024-09-21T09:06:13.008979+0000","last_clean":"2024-09-21T09:06:13.008979+0000","last_became_active":"2024-09-21T09:03:04.241612+0000","last_became_peered":"2024-09-21T09:03:04.241612+0000","last_unstale":"2024-09-21T09:06:13.008979+0000","last_undegraded":"2024-09-21T09:06:13.008979+0000","last_fullsized":"2024-09-21T09:06:13.008979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:31.245640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271493+0000","last_change":"2024-09-21T09:03:06.251100+0000","last_active":"2024-09-21T09:03:38.271493+0000","last_peered":"2024-09-21T09:03:38.271493+0000","last_clean":"2024-09-21T09:03:38.271493+0000","last_became_active":"2024-09-21T09:03:06.250750+0000","last_became_peered":"2024-09-21T09:03:06.250750+0000","last_unstale":"2024-09-21T09:03:38.271493+0000","last_undegraded":"2024-09-21T09:03:38.271493+0000","last_fullsized":"2024-09-21T09:03:38.271493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:22.776215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'11","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.068447+0000","last_change":"2024-09-21T09:03:08.259980+0000","last_active":"2024-09-21T09:05:04.068447+0000","last_peered":"2024-09-21T09:05:04.068447+0000","last_clean":"2024-09-21T09:05:04.068447+0000","last_became_active":"2024-09-21T09:03:08.259602+0000","last_became_peered":"2024-09-21T09:03:08.259602+0000","last_unstale":"2024-09-21T09:05:04.068447+0000","last_undegraded":"2024-09-21T09:05:04.068447+0000","last_fullsized":"2024-09-21T09:05:04.068447+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:33:24.939446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.257843+0000","last_change":"2024-09-21T09:03:00.227394+0000","last_active":"2024-09-21T09:04:22.257843+0000","last_peered":"2024-09-21T09:04:22.257843+0000","last_clean":"2024-09-21T09:04:22.257843+0000","last_became_active":"2024-09-21T09:03:00.225811+0000","last_became_peered":"2024-09-21T09:03:00.225811+0000","last_unstale":"2024-09-21T09:04:22.257843+0000","last_undegraded":"2024-09-21T09:04:22.257843+0000","last_fullsized":"2024-09-21T09:04:22.257843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:51.194693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.281638+0000","last_change":"2024-09-21T09:03:38.280883+0000","last_active":"2024-09-21T09:03:38.281638+0000","last_peered":"2024-09-21T09:03:38.281638+0000","last_clean":"2024-09-21T09:03:38.281638+0000","last_became_active":"2024-09-21T09:03:38.280539+0000","last_became_peered":"2024-09-21T09:03:38.280539+0000","last_unstale":"2024-09-21T09:03:38.281638+0000","last_undegraded":"2024-09-21T09:03:38.281638+0000","last_fullsized":"2024-09-21T09:03:38.281638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:13.642910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278296+0000","last_change":"2024-09-21T09:03:02.223011+0000","last_active":"2024-09-21T09:03:38.278296+0000","last_peered":"2024-09-21T09:03:38.278296+0000","last_clean":"2024-09-21T09:03:38.278296+0000","last_became_active":"2024-09-21T09:03:02.222474+0000","last_became_peered":"2024-09-21T09:03:02.222474+0000","last_unstale":"2024-09-21T09:03:38.278296+0000","last_undegraded":"2024-09-21T09:03:38.278296+0000","last_fullsized":"2024-09-21T09:03:38.278296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:54.497438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'6","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.732315+0000","last_change":"2024-09-21T09:03:04.232760+0000","last_active":"2024-09-21T09:06:05.732315+0000","last_peered":"2024-09-21T09:06:05.732315+0000","last_clean":"2024-09-21T09:06:05.732315+0000","last_became_active":"2024-09-21T09:03:04.232474+0000","last_became_peered":"2024-09-21T09:03:04.232474+0000","last_unstale":"2024-09-21T09:06:05.732315+0000","last_undegraded":"2024-09-21T09:06:05.732315+0000","last_fullsized":"2024-09-21T09:06:05.732315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:11.420156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272717+0000","last_change":"2024-09-21T09:03:06.251118+0000","last_active":"2024-09-21T09:03:38.272717+0000","last_peered":"2024-09-21T09:03:38.272717+0000","last_clean":"2024-09-21T09:03:38.272717+0000","last_became_active":"2024-09-21T09:03:06.250773+0000","last_became_peered":"2024-09-21T09:03:06.250773+0000","last_unstale":"2024-09-21T09:03:38.272717+0000","last_undegraded":"2024-09-21T09:03:38.272717+0000","last_fullsized":"2024-09-21T09:03:38.272717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:30.352901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464626+0000","last_change":"2024-09-21T09:03:08.250971+0000","last_active":"2024-09-21T09:03:38.464626+0000","last_peered":"2024-09-21T09:03:38.464626+0000","last_clean":"2024-09-21T09:03:38.464626+0000","last_became_active":"2024-09-21T09:03:08.250617+0000","last_became_peered":"2024-09-21T09:03:08.250617+0000","last_unstale":"2024-09-21T09:03:38.464626+0000","last_undegraded":"2024-09-21T09:03:38.464626+0000","last_fullsized":"2024-09-21T09:03:38.464626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:54.090547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363198+0000","last_change":"2024-09-21T09:03:00.216088+0000","last_active":"2024-09-21T09:06:06.363198+0000","last_peered":"2024-09-21T09:06:06.363198+0000","last_clean":"2024-09-21T09:06:06.363198+0000","last_became_active":"2024-09-21T09:03:00.215591+0000","last_became_peered":"2024-09-21T09:03:00.215591+0000","last_unstale":"2024-09-21T09:06:06.363198+0000","last_undegraded":"2024-09-21T09:06:06.363198+0000","last_fullsized":"2024-09-21T09:06:06.363198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:32.562147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.251242+0000","last_change":"2024-09-21T09:02:58.218920+0000","last_active":"2024-09-21T09:06:06.251242+0000","last_peered":"2024-09-21T09:06:06.251242+0000","last_clean":"2024-09-21T09:06:06.251242+0000","last_became_active":"2024-09-21T09:02:58.217931+0000","last_became_peered":"2024-09-21T09:02:58.217931+0000","last_unstale":"2024-09-21T09:06:06.251242+0000","last_undegraded":"2024-09-21T09:06:06.251242+0000","last_fullsized":"2024-09-21T09:06:06.251242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:07.674387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272263+0000","last_change":"2024-09-21T09:03:02.219569+0000","last_active":"2024-09-21T09:03:38.272263+0000","last_peered":"2024-09-21T09:03:38.272263+0000","last_clean":"2024-09-21T09:03:38.272263+0000","last_became_active":"2024-09-21T09:03:02.219265+0000","last_became_peered":"2024-09-21T09:03:02.219265+0000","last_unstale":"2024-09-21T09:03:38.272263+0000","last_undegraded":"2024-09-21T09:03:38.272263+0000","last_fullsized":"2024-09-21T09:03:38.272263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:22.253418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'40","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.788569+0000","last_change":"2024-09-21T09:03:04.233795+0000","last_active":"2024-09-21T09:06:05.788569+0000","last_peered":"2024-09-21T09:06:05.788569+0000","last_clean":"2024-09-21T09:06:05.788569+0000","last_became_active":"2024-09-21T09:03:04.233393+0000","last_became_peered":"2024-09-21T09:03:04.233393+0000","last_unstale":"2024-09-21T09:06:05.788569+0000","last_undegraded":"2024-09-21T09:06:05.788569+0000","last_fullsized":"2024-09-21T09:06:05.788569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:49.815772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.273436+0000","last_change":"2024-09-21T09:03:06.249268+0000","last_active":"2024-09-21T09:03:38.273436+0000","last_peered":"2024-09-21T09:03:38.273436+0000","last_clean":"2024-09-21T09:03:38.273436+0000","last_became_active":"2024-09-21T09:03:06.248954+0000","last_became_peered":"2024-09-21T09:03:06.248954+0000","last_unstale":"2024-09-21T09:03:38.273436+0000","last_undegraded":"2024-09-21T09:03:38.273436+0000","last_fullsized":"2024-09-21T09:03:38.273436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:09.672283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271808+0000","last_change":"2024-09-21T09:03:08.265248+0000","last_active":"2024-09-21T09:03:38.271808+0000","last_peered":"2024-09-21T09:03:38.271808+0000","last_clean":"2024-09-21T09:03:38.271808+0000","last_became_active":"2024-09-21T09:03:08.264778+0000","last_became_peered":"2024-09-21T09:03:08.264778+0000","last_unstale":"2024-09-21T09:03:38.271808+0000","last_undegraded":"2024-09-21T09:03:38.271808+0000","last_fullsized":"2024-09-21T09:03:38.271808+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:37.665220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271312+0000","last_change":"2024-09-21T09:03:00.218521+0000","last_active":"2024-09-21T09:03:38.271312+0000","last_peered":"2024-09-21T09:03:38.271312+0000","last_clean":"2024-09-21T09:03:38.271312+0000","last_became_active":"2024-09-21T09:03:00.218259+0000","last_became_peered":"2024-09-21T09:03:00.218259+0000","last_unstale":"2024-09-21T09:03:38.271312+0000","last_undegraded":"2024-09-21T09:03:38.271312+0000","last_fullsized":"2024-09-21T09:03:38.271312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:08.734463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.358977+0000","last_change":"2024-09-21T09:02:58.207817+0000","last_active":"2024-09-21T09:06:06.358977+0000","last_peered":"2024-09-21T09:06:06.358977+0000","last_clean":"2024-09-21T09:06:06.358977+0000","last_became_active":"2024-09-21T09:02:58.207533+0000","last_became_peered":"2024-09-21T09:02:58.207533+0000","last_unstale":"2024-09-21T09:06:06.358977+0000","last_undegraded":"2024-09-21T09:06:06.358977+0000","last_fullsized":"2024-09-21T09:06:06.358977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.813396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271267+0000","last_change":"2024-09-21T09:03:02.219788+0000","last_active":"2024-09-21T09:03:38.271267+0000","last_peered":"2024-09-21T09:03:38.271267+0000","last_clean":"2024-09-21T09:03:38.271267+0000","last_became_active":"2024-09-21T09:03:02.219509+0000","last_became_peered":"2024-09-21T09:03:02.219509+0000","last_unstale":"2024-09-21T09:03:38.271267+0000","last_undegraded":"2024-09-21T09:03:38.271267+0000","last_fullsized":"2024-09-21T09:03:38.271267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:16.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.342422+0000","last_change":"2024-09-21T09:03:04.234223+0000","last_active":"2024-09-21T09:05:04.342422+0000","last_peered":"2024-09-21T09:05:04.342422+0000","last_clean":"2024-09-21T09:05:04.342422+0000","last_became_active":"2024-09-21T09:03:04.233913+0000","last_became_peered":"2024-09-21T09:03:04.233913+0000","last_unstale":"2024-09-21T09:05:04.342422+0000","last_undegraded":"2024-09-21T09:05:04.342422+0000","last_fullsized":"2024-09-21T09:05:04.342422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:42.001541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.279968+0000","last_change":"2024-09-21T09:03:06.241090+0000","last_active":"2024-09-21T09:03:38.279968+0000","last_peered":"2024-09-21T09:03:38.279968+0000","last_clean":"2024-09-21T09:03:38.279968+0000","last_became_active":"2024-09-21T09:03:06.240791+0000","last_became_peered":"2024-09-21T09:03:06.240791+0000","last_unstale":"2024-09-21T09:03:38.279968+0000","last_undegraded":"2024-09-21T09:03:38.279968+0000","last_fullsized":"2024-09-21T09:03:38.279968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:15.100821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260935+0000","last_change":"2024-09-21T09:03:00.216592+0000","last_active":"2024-09-21T09:06:06.260935+0000","last_peered":"2024-09-21T09:06:06.260935+0000","last_clean":"2024-09-21T09:06:06.260935+0000","last_became_active":"2024-09-21T09:03:00.216319+0000","last_became_peered":"2024-09-21T09:03:00.216319+0000","last_unstale":"2024-09-21T09:06:06.260935+0000","last_undegraded":"2024-09-21T09:06:06.260935+0000","last_fullsized":"2024-09-21T09:06:06.260935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:47.869465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270661+0000","last_change":"2024-09-21T09:02:58.214752+0000","last_active":"2024-09-21T09:03:38.270661+0000","last_peered":"2024-09-21T09:03:38.270661+0000","last_clean":"2024-09-21T09:03:38.270661+0000","last_became_active":"2024-09-21T09:02:58.214494+0000","last_became_peered":"2024-09-21T09:02:58.214494+0000","last_unstale":"2024-09-21T09:03:38.270661+0000","last_undegraded":"2024-09-21T09:03:38.270661+0000","last_fullsized":"2024-09-21T09:03:38.270661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:10.892304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"31'4","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.368025+0000","last_change":"2024-09-21T09:03:02.222025+0000","last_active":"2024-09-21T09:05:05.368025+0000","last_peered":"2024-09-21T09:05:05.368025+0000","last_clean":"2024-09-21T09:05:05.368025+0000","last_became_active":"2024-09-21T09:03:02.221586+0000","last_became_peered":"2024-09-21T09:03:02.221586+0000","last_unstale":"2024-09-21T09:05:05.368025+0000","last_undegraded":"2024-09-21T09:05:05.368025+0000","last_fullsized":"2024-09-21T09:05:05.368025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:39.990777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'55","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:37.458245+0000","last_change":"2024-09-21T09:03:04.234015+0000","last_active":"2024-09-21T09:05:37.458245+0000","last_peered":"2024-09-21T09:05:37.458245+0000","last_clean":"2024-09-21T09:05:37.458245+0000","last_became_active":"2024-09-21T09:03:04.233734+0000","last_became_peered":"2024-09-21T09:03:04.233734+0000","last_unstale":"2024-09-21T09:05:37.458245+0000","last_undegraded":"2024-09-21T09:05:37.458245+0000","last_fullsized":"2024-09-21T09:05:37.458245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:48.554737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276740+0000","last_change":"2024-09-21T09:03:06.241254+0000","last_active":"2024-09-21T09:03:38.276740+0000","last_peered":"2024-09-21T09:03:38.276740+0000","last_clean":"2024-09-21T09:03:38.276740+0000","last_became_active":"2024-09-21T09:03:06.240975+0000","last_became_peered":"2024-09-21T09:03:06.240975+0000","last_unstale":"2024-09-21T09:03:38.276740+0000","last_undegraded":"2024-09-21T09:03:38.276740+0000","last_fullsized":"2024-09-21T09:03:38.276740+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:50.569967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'18","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.287382+0000","last_change":"2024-09-21T09:03:08.254283+0000","last_active":"2024-09-21T09:06:06.287382+0000","last_peered":"2024-09-21T09:06:06.287382+0000","last_clean":"2024-09-21T09:06:06.287382+0000","last_became_active":"2024-09-21T09:03:08.253904+0000","last_became_peered":"2024-09-21T09:03:08.253904+0000","last_unstale":"2024-09-21T09:06:06.287382+0000","last_undegraded":"2024-09-21T09:06:06.287382+0000","last_fullsized":"2024-09-21T09:06:06.287382+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:42.273122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'10","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.173892+0000","last_change":"2024-09-21T09:03:00.216793+0000","last_active":"2024-09-21T09:06:06.173892+0000","last_peered":"2024-09-21T09:06:06.173892+0000","last_clean":"2024-09-21T09:06:06.173892+0000","last_became_active":"2024-09-21T09:03:00.216238+0000","last_became_peered":"2024-09-21T09:03:00.216238+0000","last_unstale":"2024-09-21T09:06:06.173892+0000","last_undegraded":"2024-09-21T09:06:06.173892+0000","last_fullsized":"2024-09-21T09:06:06.173892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:39.266159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456857+0000","last_change":"2024-09-21T09:02:58.207174+0000","last_active":"2024-09-21T09:05:22.456857+0000","last_peered":"2024-09-21T09:05:22.456857+0000","last_clean":"2024-09-21T09:05:22.456857+0000","last_became_active":"2024-09-21T09:02:58.206879+0000","last_became_peered":"2024-09-21T09:02:58.206879+0000","last_unstale":"2024-09-21T09:05:22.456857+0000","last_undegraded":"2024-09-21T09:05:22.456857+0000","last_fullsized":"2024-09-21T09:05:22.456857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:51.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.280797+0000","last_change":"2024-09-21T09:03:02.218652+0000","last_active":"2024-09-21T09:03:38.280797+0000","last_peered":"2024-09-21T09:03:38.280797+0000","last_clean":"2024-09-21T09:03:38.280797+0000","last_became_active":"2024-09-21T09:03:02.218381+0000","last_became_peered":"2024-09-21T09:03:02.218381+0000","last_unstale":"2024-09-21T09:03:38.280797+0000","last_undegraded":"2024-09-21T09:03:38.280797+0000","last_fullsized":"2024-09-21T09:03:38.280797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:00.802033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'40","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.963940+0000","last_change":"2024-09-21T09:03:04.241328+0000","last_active":"2024-09-21T09:06:12.963940+0000","last_peered":"2024-09-21T09:06:12.963940+0000","last_clean":"2024-09-21T09:06:12.963940+0000","last_became_active":"2024-09-21T09:03:04.240933+0000","last_became_peered":"2024-09-21T09:03:04.240933+0000","last_unstale":"2024-09-21T09:06:12.963940+0000","last_undegraded":"2024-09-21T09:06:12.963940+0000","last_fullsized":"2024-09-21T09:06:12.963940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:37.814664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277445+0000","last_change":"2024-09-21T09:03:06.247452+0000","last_active":"2024-09-21T09:03:38.277445+0000","last_peered":"2024-09-21T09:03:38.277445+0000","last_clean":"2024-09-21T09:03:38.277445+0000","last_became_active":"2024-09-21T09:03:06.247153+0000","last_became_peered":"2024-09-21T09:03:06.247153+0000","last_unstale":"2024-09-21T09:03:38.277445+0000","last_undegraded":"2024-09-21T09:03:38.277445+0000","last_fullsized":"2024-09-21T09:03:38.277445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:41.912327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.104216+0000","last_change":"2024-09-21T09:03:08.262999+0000","last_active":"2024-09-21T09:06:06.104216+0000","last_peered":"2024-09-21T09:06:06.104216+0000","last_clean":"2024-09-21T09:06:06.104216+0000","last_became_active":"2024-09-21T09:03:08.262680+0000","last_became_peered":"2024-09-21T09:03:08.262680+0000","last_unstale":"2024-09-21T09:06:06.104216+0000","last_undegraded":"2024-09-21T09:06:06.104216+0000","last_fullsized":"2024-09-21T09:06:06.104216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:50.139788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278824+0000","last_change":"2024-09-21T09:03:00.224630+0000","last_active":"2024-09-21T09:03:38.278824+0000","last_peered":"2024-09-21T09:03:38.278824+0000","last_clean":"2024-09-21T09:03:38.278824+0000","last_became_active":"2024-09-21T09:03:00.219653+0000","last_became_peered":"2024-09-21T09:03:00.219653+0000","last_unstale":"2024-09-21T09:03:38.278824+0000","last_undegraded":"2024-09-21T09:03:38.278824+0000","last_fullsized":"2024-09-21T09:03:38.278824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:46.305418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'3","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.062776+0000","last_change":"2024-09-21T09:02:58.202783+0000","last_active":"2024-09-21T09:04:22.062776+0000","last_peered":"2024-09-21T09:04:22.062776+0000","last_clean":"2024-09-21T09:04:22.062776+0000","last_became_active":"2024-09-21T09:02:58.202431+0000","last_became_peered":"2024-09-21T09:02:58.202431+0000","last_unstale":"2024-09-21T09:04:22.062776+0000","last_undegraded":"2024-09-21T09:04:22.062776+0000","last_fullsized":"2024-09-21T09:04:22.062776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:19.013606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276494+0000","last_change":"2024-09-21T09:03:02.221261+0000","last_active":"2024-09-21T09:03:38.276494+0000","last_peered":"2024-09-21T09:03:38.276494+0000","last_clean":"2024-09-21T09:03:38.276494+0000","last_became_active":"2024-09-21T09:03:02.220940+0000","last_became_peered":"2024-09-21T09:03:02.220940+0000","last_unstale":"2024-09-21T09:03:38.276494+0000","last_undegraded":"2024-09-21T09:03:38.276494+0000","last_fullsized":"2024-09-21T09:03:38.276494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:24.472177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.360394+0000","last_change":"2024-09-21T09:03:04.239297+0000","last_active":"2024-09-21T09:05:04.360394+0000","last_peered":"2024-09-21T09:05:04.360394+0000","last_clean":"2024-09-21T09:05:04.360394+0000","last_became_active":"2024-09-21T09:03:04.239023+0000","last_became_peered":"2024-09-21T09:03:04.239023+0000","last_unstale":"2024-09-21T09:05:04.360394+0000","last_undegraded":"2024-09-21T09:05:04.360394+0000","last_fullsized":"2024-09-21T09:05:04.360394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:11.019831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465048+0000","last_change":"2024-09-21T09:03:06.244208+0000","last_active":"2024-09-21T09:03:38.465048+0000","last_peered":"2024-09-21T09:03:38.465048+0000","last_clean":"2024-09-21T09:03:38.465048+0000","last_became_active":"2024-09-21T09:03:06.243451+0000","last_became_peered":"2024-09-21T09:03:06.243451+0000","last_unstale":"2024-09-21T09:03:38.465048+0000","last_undegraded":"2024-09-21T09:03:38.465048+0000","last_fullsized":"2024-09-21T09:03:38.465048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:57.268665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.713189+0000","last_change":"2024-09-21T09:03:08.260334+0000","last_active":"2024-09-21T09:05:05.713189+0000","last_peered":"2024-09-21T09:05:05.713189+0000","last_clean":"2024-09-21T09:05:05.713189+0000","last_became_active":"2024-09-21T09:03:08.260047+0000","last_became_peered":"2024-09-21T09:03:08.260047+0000","last_unstale":"2024-09-21T09:05:05.713189+0000","last_undegraded":"2024-09-21T09:05:05.713189+0000","last_fullsized":"2024-09-21T09:05:05.713189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:49.086371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'7","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.457562+0000","last_change":"2024-09-21T09:03:00.221676+0000","last_active":"2024-09-21T09:05:32.457562+0000","last_peered":"2024-09-21T09:05:32.457562+0000","last_clean":"2024-09-21T09:05:32.457562+0000","last_became_active":"2024-09-21T09:03:00.221332+0000","last_became_peered":"2024-09-21T09:03:00.221332+0000","last_unstale":"2024-09-21T09:05:32.457562+0000","last_undegraded":"2024-09-21T09:05:32.457562+0000","last_fullsized":"2024-09-21T09:05:32.457562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:09.836796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.752914+0000","last_change":"2024-09-21T09:02:58.210805+0000","last_active":"2024-09-21T09:03:38.752914+0000","last_peered":"2024-09-21T09:03:38.752914+0000","last_clean":"2024-09-21T09:03:38.752914+0000","last_became_active":"2024-09-21T09:02:58.210511+0000","last_became_peered":"2024-09-21T09:02:58.210511+0000","last_unstale":"2024-09-21T09:03:38.752914+0000","last_undegraded":"2024-09-21T09:03:38.752914+0000","last_fullsized":"2024-09-21T09:03:38.752914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:47.903446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.277189+0000","last_change":"2024-09-21T09:03:02.219262+0000","last_active":"2024-09-21T09:03:38.277189+0000","last_peered":"2024-09-21T09:03:38.277189+0000","last_clean":"2024-09-21T09:03:38.277189+0000","last_became_active":"2024-09-21T09:03:02.218979+0000","last_became_peered":"2024-09-21T09:03:02.218979+0000","last_unstale":"2024-09-21T09:03:38.277189+0000","last_undegraded":"2024-09-21T09:03:38.277189+0000","last_fullsized":"2024-09-21T09:03:38.277189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:07.127926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.259516+0000","last_change":"2024-09-21T09:03:04.242314+0000","last_active":"2024-09-21T09:04:22.259516+0000","last_peered":"2024-09-21T09:04:22.259516+0000","last_clean":"2024-09-21T09:04:22.259516+0000","last_became_active":"2024-09-21T09:03:04.241974+0000","last_became_peered":"2024-09-21T09:03:04.241974+0000","last_unstale":"2024-09-21T09:04:22.259516+0000","last_undegraded":"2024-09-21T09:04:22.259516+0000","last_fullsized":"2024-09-21T09:04:22.259516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:52.828027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'282","reported_seq":416,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.368023+0000","last_change":"2024-09-21T09:03:06.244451+0000","last_active":"2024-09-21T09:06:06.368023+0000","last_peered":"2024-09-21T09:06:06.368023+0000","last_clean":"2024-09-21T09:06:06.368023+0000","last_became_active":"2024-09-21T09:03:06.244103+0000","last_became_peered":"2024-09-21T09:03:06.244103+0000","last_unstale":"2024-09-21T09:06:06.368023+0000","last_undegraded":"2024-09-21T09:06:06.368023+0000","last_fullsized":"2024-09-21T09:06:06.368023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:13.035061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"31'6","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.806010+0000","last_change":"2024-09-21T09:03:08.260304+0000","last_active":"2024-09-21T09:06:05.806010+0000","last_peered":"2024-09-21T09:06:05.806010+0000","last_clean":"2024-09-21T09:06:05.806010+0000","last_became_active":"2024-09-21T09:03:08.259638+0000","last_became_peered":"2024-09-21T09:03:08.259638+0000","last_unstale":"2024-09-21T09:06:05.806010+0000","last_undegraded":"2024-09-21T09:06:05.806010+0000","last_fullsized":"2024-09-21T09:06:05.806010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:33.635905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:22.258397+0000","last_change":"2024-09-21T09:03:00.220803+0000","last_active":"2024-09-21T09:04:22.258397+0000","last_peered":"2024-09-21T09:04:22.258397+0000","last_clean":"2024-09-21T09:04:22.258397+0000","last_became_active":"2024-09-21T09:03:00.220426+0000","last_became_peered":"2024-09-21T09:03:00.220426+0000","last_unstale":"2024-09-21T09:04:22.258397+0000","last_undegraded":"2024-09-21T09:04:22.258397+0000","last_fullsized":"2024-09-21T09:04:22.258397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:15.584421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275873+0000","last_change":"2024-09-21T09:02:58.207718+0000","last_active":"2024-09-21T09:03:38.275873+0000","last_peered":"2024-09-21T09:03:38.275873+0000","last_clean":"2024-09-21T09:03:38.275873+0000","last_became_active":"2024-09-21T09:02:58.207424+0000","last_became_peered":"2024-09-21T09:02:58.207424+0000","last_unstale":"2024-09-21T09:03:38.275873+0000","last_undegraded":"2024-09-21T09:03:38.275873+0000","last_fullsized":"2024-09-21T09:03:38.275873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:03.460514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.282215+0000","last_change":"2024-09-21T09:03:38.280977+0000","last_active":"2024-09-21T09:03:38.282215+0000","last_peered":"2024-09-21T09:03:38.282215+0000","last_clean":"2024-09-21T09:03:38.282215+0000","last_became_active":"2024-09-21T09:03:38.280616+0000","last_became_peered":"2024-09-21T09:03:38.280616+0000","last_unstale":"2024-09-21T09:03:38.282215+0000","last_undegraded":"2024-09-21T09:03:38.282215+0000","last_fullsized":"2024-09-21T09:03:38.282215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:02:41.978323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'38","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.458395+0000","last_change":"2024-09-21T09:03:04.234179+0000","last_active":"2024-09-21T09:05:32.458395+0000","last_peered":"2024-09-21T09:05:32.458395+0000","last_clean":"2024-09-21T09:05:32.458395+0000","last_became_active":"2024-09-21T09:03:04.233878+0000","last_became_peered":"2024-09-21T09:03:04.233878+0000","last_unstale":"2024-09-21T09:05:32.458395+0000","last_undegraded":"2024-09-21T09:05:32.458395+0000","last_fullsized":"2024-09-21T09:05:32.458395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:11.019831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463002+0000","last_change":"2024-09-21T09:03:06.248010+0000","last_active":"2024-09-21T09:03:38.463002+0000","last_peered":"2024-09-21T09:03:38.463002+0000","last_clean":"2024-09-21T09:03:38.463002+0000","last_became_active":"2024-09-21T09:03:06.247609+0000","last_became_peered":"2024-09-21T09:03:06.247609+0000","last_unstale":"2024-09-21T09:03:38.463002+0000","last_undegraded":"2024-09-21T09:03:38.463002+0000","last_fullsized":"2024-09-21T09:03:38.463002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:03.746735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.276162+0000","last_change":"2024-09-21T09:03:08.256301+0000","last_active":"2024-09-21T09:03:38.276162+0000","last_peered":"2024-09-21T09:03:38.276162+0000","last_clean":"2024-09-21T09:03:38.276162+0000","last_became_active":"2024-09-21T09:03:08.255717+0000","last_became_peered":"2024-09-21T09:03:08.255717+0000","last_unstale":"2024-09-21T09:03:38.276162+0000","last_undegraded":"2024-09-21T09:03:38.276162+0000","last_fullsized":"2024-09-21T09:03:38.276162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:09:51.274693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'10","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.176725+0000","last_change":"2024-09-21T09:03:00.216086+0000","last_active":"2024-09-21T09:06:06.176725+0000","last_peered":"2024-09-21T09:06:06.176725+0000","last_clean":"2024-09-21T09:06:06.176725+0000","last_became_active":"2024-09-21T09:03:00.215804+0000","last_became_peered":"2024-09-21T09:03:00.215804+0000","last_unstale":"2024-09-21T09:06:06.176725+0000","last_undegraded":"2024-09-21T09:06:06.176725+0000","last_fullsized":"2024-09-21T09:06:06.176725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:43.259240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.278524+0000","last_change":"2024-09-21T09:02:58.221563+0000","last_active":"2024-09-21T09:03:38.278524+0000","last_peered":"2024-09-21T09:03:38.278524+0000","last_clean":"2024-09-21T09:03:38.278524+0000","last_became_active":"2024-09-21T09:02:58.221286+0000","last_became_peered":"2024-09-21T09:02:58.221286+0000","last_unstale":"2024-09-21T09:03:38.278524+0000","last_undegraded":"2024-09-21T09:03:38.278524+0000","last_fullsized":"2024-09-21T09:03:38.278524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:01.926039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.279861+0000","last_change":"2024-09-21T09:03:02.225192+0000","last_active":"2024-09-21T09:03:38.279861+0000","last_peered":"2024-09-21T09:03:38.279861+0000","last_clean":"2024-09-21T09:03:38.279861+0000","last_became_active":"2024-09-21T09:03:02.224879+0000","last_became_peered":"2024-09-21T09:03:02.224879+0000","last_unstale":"2024-09-21T09:03:38.279861+0000","last_undegraded":"2024-09-21T09:03:38.279861+0000","last_fullsized":"2024-09-21T09:03:38.279861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:58.107921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.335448+0000","last_change":"2024-09-21T09:03:04.239378+0000","last_active":"2024-09-21T09:05:04.335448+0000","last_peered":"2024-09-21T09:05:04.335448+0000","last_clean":"2024-09-21T09:05:04.335448+0000","last_became_active":"2024-09-21T09:03:04.239112+0000","last_became_peered":"2024-09-21T09:03:04.239112+0000","last_unstale":"2024-09-21T09:05:04.335448+0000","last_undegraded":"2024-09-21T09:05:04.335448+0000","last_fullsized":"2024-09-21T09:05:04.335448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:28.337671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.270452+0000","last_change":"2024-09-21T09:03:06.251033+0000","last_active":"2024-09-21T09:03:38.270452+0000","last_peered":"2024-09-21T09:03:38.270452+0000","last_clean":"2024-09-21T09:03:38.270452+0000","last_became_active":"2024-09-21T09:03:06.250729+0000","last_became_peered":"2024-09-21T09:03:06.250729+0000","last_unstale":"2024-09-21T09:03:38.270452+0000","last_undegraded":"2024-09-21T09:03:38.270452+0000","last_fullsized":"2024-09-21T09:03:38.270452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:49.094483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274381+0000","last_change":"2024-09-21T09:03:08.264701+0000","last_active":"2024-09-21T09:03:38.274381+0000","last_peered":"2024-09-21T09:03:38.274381+0000","last_clean":"2024-09-21T09:03:38.274381+0000","last_became_active":"2024-09-21T09:03:08.264160+0000","last_became_peered":"2024-09-21T09:03:08.264160+0000","last_unstale":"2024-09-21T09:03:38.274381+0000","last_undegraded":"2024-09-21T09:03:38.274381+0000","last_fullsized":"2024-09-21T09:03:38.274381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:02:11.297538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.298677+0000","last_change":"2024-09-21T09:03:00.208934+0000","last_active":"2024-09-21T09:06:06.298677+0000","last_peered":"2024-09-21T09:06:06.298677+0000","last_clean":"2024-09-21T09:06:06.298677+0000","last_became_active":"2024-09-21T09:03:00.208673+0000","last_became_peered":"2024-09-21T09:03:00.208673+0000","last_unstale":"2024-09-21T09:06:06.298677+0000","last_undegraded":"2024-09-21T09:06:06.298677+0000","last_fullsized":"2024-09-21T09:06:06.298677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:08:35.801498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465585+0000","last_change":"2024-09-21T09:02:58.213090+0000","last_active":"2024-09-21T09:03:38.465585+0000","last_peered":"2024-09-21T09:03:38.465585+0000","last_clean":"2024-09-21T09:03:38.465585+0000","last_became_active":"2024-09-21T09:02:58.212751+0000","last_became_peered":"2024-09-21T09:02:58.212751+0000","last_unstale":"2024-09-21T09:03:38.465585+0000","last_undegraded":"2024-09-21T09:03:38.465585+0000","last_fullsized":"2024-09-21T09:03:38.465585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:42:59.411200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275293+0000","last_change":"2024-09-21T09:03:02.223254+0000","last_active":"2024-09-21T09:03:38.275293+0000","last_peered":"2024-09-21T09:03:38.275293+0000","last_clean":"2024-09-21T09:03:38.275293+0000","last_became_active":"2024-09-21T09:03:02.222965+0000","last_became_peered":"2024-09-21T09:03:02.222965+0000","last_unstale":"2024-09-21T09:03:38.275293+0000","last_undegraded":"2024-09-21T09:03:38.275293+0000","last_fullsized":"2024-09-21T09:03:38.275293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:51.746643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'29","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:13.014451+0000","last_change":"2024-09-21T09:03:04.244000+0000","last_active":"2024-09-21T09:06:13.014451+0000","last_peered":"2024-09-21T09:06:13.014451+0000","last_clean":"2024-09-21T09:06:13.014451+0000","last_became_active":"2024-09-21T09:03:04.243686+0000","last_became_peered":"2024-09-21T09:03:04.243686+0000","last_unstale":"2024-09-21T09:06:13.014451+0000","last_undegraded":"2024-09-21T09:06:13.014451+0000","last_fullsized":"2024-09-21T09:06:13.014451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:23.844395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271117+0000","last_change":"2024-09-21T09:03:06.250256+0000","last_active":"2024-09-21T09:03:38.271117+0000","last_peered":"2024-09-21T09:03:38.271117+0000","last_clean":"2024-09-21T09:03:38.271117+0000","last_became_active":"2024-09-21T09:03:06.249959+0000","last_became_peered":"2024-09-21T09:03:06.249959+0000","last_unstale":"2024-09-21T09:03:38.271117+0000","last_undegraded":"2024-09-21T09:03:38.271117+0000","last_fullsized":"2024-09-21T09:03:38.271117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:36:47.765082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'6","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.714631+0000","last_change":"2024-09-21T09:03:08.264668+0000","last_active":"2024-09-21T09:05:05.714631+0000","last_peered":"2024-09-21T09:05:05.714631+0000","last_clean":"2024-09-21T09:05:05.714631+0000","last_became_active":"2024-09-21T09:03:08.264395+0000","last_became_peered":"2024-09-21T09:03:08.264395+0000","last_unstale":"2024-09-21T09:05:05.714631+0000","last_undegraded":"2024-09-21T09:05:05.714631+0000","last_fullsized":"2024-09-21T09:05:05.714631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:33.997831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'14","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.176335+0000","last_change":"2024-09-21T09:03:00.216032+0000","last_active":"2024-09-21T09:06:06.176335+0000","last_peered":"2024-09-21T09:06:06.176335+0000","last_clean":"2024-09-21T09:06:06.176335+0000","last_became_active":"2024-09-21T09:03:00.215748+0000","last_became_peered":"2024-09-21T09:03:00.215748+0000","last_unstale":"2024-09-21T09:06:06.176335+0000","last_undegraded":"2024-09-21T09:06:06.176335+0000","last_fullsized":"2024-09-21T09:06:06.176335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:26.084899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453896+0000","last_change":"2024-09-21T09:02:58.204247+0000","last_active":"2024-09-21T09:05:02.453896+0000","last_peered":"2024-09-21T09:05:02.453896+0000","last_clean":"2024-09-21T09:05:02.453896+0000","last_became_active":"2024-09-21T09:02:58.203973+0000","last_became_peered":"2024-09-21T09:02:58.203973+0000","last_unstale":"2024-09-21T09:05:02.453896+0000","last_undegraded":"2024-09-21T09:05:02.453896+0000","last_fullsized":"2024-09-21T09:05:02.453896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:07.674387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'2","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:03.073883+0000","last_change":"2024-09-21T09:03:02.221130+0000","last_active":"2024-09-21T09:05:03.073883+0000","last_peered":"2024-09-21T09:05:03.073883+0000","last_clean":"2024-09-21T09:05:03.073883+0000","last_became_active":"2024-09-21T09:03:02.220801+0000","last_became_peered":"2024-09-21T09:03:02.220801+0000","last_unstale":"2024-09-21T09:05:03.073883+0000","last_undegraded":"2024-09-21T09:05:03.073883+0000","last_fullsized":"2024-09-21T09:05:03.073883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:02.648349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'35","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:13.023368+0000","last_change":"2024-09-21T09:03:04.241567+0000","last_active":"2024-09-21T09:06:13.023368+0000","last_peered":"2024-09-21T09:06:13.023368+0000","last_clean":"2024-09-21T09:06:13.023368+0000","last_became_active":"2024-09-21T09:03:04.240857+0000","last_became_peered":"2024-09-21T09:03:04.240857+0000","last_unstale":"2024-09-21T09:06:13.023368+0000","last_undegraded":"2024-09-21T09:06:13.023368+0000","last_fullsized":"2024-09-21T09:06:13.023368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:48.722144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464241+0000","last_change":"2024-09-21T09:03:06.248388+0000","last_active":"2024-09-21T09:03:38.464241+0000","last_peered":"2024-09-21T09:03:38.464241+0000","last_clean":"2024-09-21T09:03:38.464241+0000","last_became_active":"2024-09-21T09:03:06.248030+0000","last_became_peered":"2024-09-21T09:03:06.248030+0000","last_unstale":"2024-09-21T09:03:38.464241+0000","last_undegraded":"2024-09-21T09:03:38.464241+0000","last_fullsized":"2024-09-21T09:03:38.464241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.216872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'4","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:04.370491+0000","last_change":"2024-09-21T09:03:08.264618+0000","last_active":"2024-09-21T09:05:04.370491+0000","last_peered":"2024-09-21T09:05:04.370491+0000","last_clean":"2024-09-21T09:05:04.370491+0000","last_became_active":"2024-09-21T09:03:08.264304+0000","last_became_peered":"2024-09-21T09:03:08.264304+0000","last_unstale":"2024-09-21T09:05:04.370491+0000","last_undegraded":"2024-09-21T09:05:04.370491+0000","last_fullsized":"2024-09-21T09:05:04.370491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:59.938730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'22","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.084081+0000","last_change":"2024-09-21T09:03:00.226200+0000","last_active":"2024-09-21T09:06:06.084081+0000","last_peered":"2024-09-21T09:06:06.084081+0000","last_clean":"2024-09-21T09:06:06.084081+0000","last_became_active":"2024-09-21T09:03:00.225936+0000","last_became_peered":"2024-09-21T09:03:00.225936+0000","last_unstale":"2024-09-21T09:06:06.084081+0000","last_undegraded":"2024-09-21T09:06:06.084081+0000","last_fullsized":"2024-09-21T09:06:06.084081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:56.100485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.272693+0000","last_change":"2024-09-21T09:02:58.206450+0000","last_active":"2024-09-21T09:03:38.272693+0000","last_peered":"2024-09-21T09:03:38.272693+0000","last_clean":"2024-09-21T09:03:38.272693+0000","last_became_active":"2024-09-21T09:02:58.206163+0000","last_became_peered":"2024-09-21T09:02:58.206163+0000","last_unstale":"2024-09-21T09:03:38.272693+0000","last_undegraded":"2024-09-21T09:03:38.272693+0000","last_fullsized":"2024-09-21T09:03:38.272693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:19.013606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'5","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304064+0000","last_change":"2024-09-21T09:03:00.221286+0000","last_active":"2024-09-21T09:06:06.304064+0000","last_peered":"2024-09-21T09:06:06.304064+0000","last_clean":"2024-09-21T09:06:06.304064+0000","last_became_active":"2024-09-21T09:03:00.220860+0000","last_became_peered":"2024-09-21T09:03:00.220860+0000","last_unstale":"2024-09-21T09:06:06.304064+0000","last_undegraded":"2024-09-21T09:06:06.304064+0000","last_fullsized":"2024-09-21T09:06:06.304064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:47.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.245757+0000","last_change":"2024-09-21T09:02:58.202869+0000","last_active":"2024-09-21T09:06:06.245757+0000","last_peered":"2024-09-21T09:06:06.245757+0000","last_clean":"2024-09-21T09:06:06.245757+0000","last_became_active":"2024-09-21T09:02:58.202579+0000","last_became_peered":"2024-09-21T09:02:58.202579+0000","last_unstale":"2024-09-21T09:06:06.245757+0000","last_undegraded":"2024-09-21T09:06:06.245757+0000","last_fullsized":"2024-09-21T09:06:06.245757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:51.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'3","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304856+0000","last_change":"2024-09-21T09:03:00.221384+0000","last_active":"2024-09-21T09:06:06.304856+0000","last_peered":"2024-09-21T09:06:06.304856+0000","last_clean":"2024-09-21T09:06:06.304856+0000","last_became_active":"2024-09-21T09:03:00.219281+0000","last_became_peered":"2024-09-21T09:03:00.219281+0000","last_unstale":"2024-09-21T09:06:06.304856+0000","last_undegraded":"2024-09-21T09:06:06.304856+0000","last_fullsized":"2024-09-21T09:06:06.304856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:53.670241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271976+0000","last_change":"2024-09-21T09:02:58.223127+0000","last_active":"2024-09-21T09:03:38.271976+0000","last_peered":"2024-09-21T09:03:38.271976+0000","last_clean":"2024-09-21T09:03:38.271976+0000","last_became_active":"2024-09-21T09:02:58.222856+0000","last_became_peered":"2024-09-21T09:02:58.222856+0000","last_unstale":"2024-09-21T09:03:38.271976+0000","last_undegraded":"2024-09-21T09:03:38.271976+0000","last_fullsized":"2024-09-21T09:03:38.271976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:55.695152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.466314+0000","last_change":"2024-09-21T09:03:00.221392+0000","last_active":"2024-09-21T09:03:38.466314+0000","last_peered":"2024-09-21T09:03:38.466314+0000","last_clean":"2024-09-21T09:03:38.466314+0000","last_became_active":"2024-09-21T09:03:00.220755+0000","last_became_peered":"2024-09-21T09:03:00.220755+0000","last_unstale":"2024-09-21T09:03:38.466314+0000","last_undegraded":"2024-09-21T09:03:38.466314+0000","last_fullsized":"2024-09-21T09:03:38.466314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:52:42.557402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.464613+0000","last_change":"2024-09-21T09:02:58.208737+0000","last_active":"2024-09-21T09:03:38.464613+0000","last_peered":"2024-09-21T09:03:38.464613+0000","last_clean":"2024-09-21T09:03:38.464613+0000","last_became_active":"2024-09-21T09:02:58.208329+0000","last_became_peered":"2024-09-21T09:02:58.208329+0000","last_unstale":"2024-09-21T09:03:38.464613+0000","last_undegraded":"2024-09-21T09:03:38.464613+0000","last_fullsized":"2024-09-21T09:03:38.464613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:57.584638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'16","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.260871+0000","last_change":"2024-09-21T09:03:00.216032+0000","last_active":"2024-09-21T09:06:06.260871+0000","last_peered":"2024-09-21T09:06:06.260871+0000","last_clean":"2024-09-21T09:06:06.260871+0000","last_became_active":"2024-09-21T09:03:00.215554+0000","last_became_peered":"2024-09-21T09:03:00.215554+0000","last_unstale":"2024-09-21T09:06:06.260871+0000","last_undegraded":"2024-09-21T09:06:06.260871+0000","last_fullsized":"2024-09-21T09:06:06.260871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:18.875227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.752662+0000","last_change":"2024-09-21T09:02:58.202254+0000","last_active":"2024-09-21T09:03:38.752662+0000","last_peered":"2024-09-21T09:03:38.752662+0000","last_clean":"2024-09-21T09:03:38.752662+0000","last_became_active":"2024-09-21T09:02:58.201482+0000","last_became_peered":"2024-09-21T09:02:58.201482+0000","last_unstale":"2024-09-21T09:03:38.752662+0000","last_undegraded":"2024-09-21T09:03:38.752662+0000","last_fullsized":"2024-09-21T09:03:38.752662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.813396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'11","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.370735+0000","last_change":"2024-09-21T09:03:00.224630+0000","last_active":"2024-09-21T09:06:06.370735+0000","last_peered":"2024-09-21T09:06:06.370735+0000","last_clean":"2024-09-21T09:06:06.370735+0000","last_became_active":"2024-09-21T09:03:00.223740+0000","last_became_peered":"2024-09-21T09:03:00.223740+0000","last_unstale":"2024-09-21T09:06:06.370735+0000","last_undegraded":"2024-09-21T09:06:06.370735+0000","last_fullsized":"2024-09-21T09:06:06.370735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:58.794598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.454567+0000","last_change":"2024-09-21T09:02:58.210714+0000","last_active":"2024-09-21T09:05:07.454567+0000","last_peered":"2024-09-21T09:05:07.454567+0000","last_clean":"2024-09-21T09:05:07.454567+0000","last_became_active":"2024-09-21T09:02:58.210442+0000","last_became_peered":"2024-09-21T09:02:58.210442+0000","last_unstale":"2024-09-21T09:05:07.454567+0000","last_undegraded":"2024-09-21T09:05:07.454567+0000","last_fullsized":"2024-09-21T09:05:07.454567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:57.584638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'14","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.717387+0000","last_change":"2024-09-21T09:03:00.216820+0000","last_active":"2024-09-21T09:05:05.717387+0000","last_peered":"2024-09-21T09:05:05.717387+0000","last_clean":"2024-09-21T09:05:05.717387+0000","last_became_active":"2024-09-21T09:03:00.216462+0000","last_became_peered":"2024-09-21T09:03:00.216462+0000","last_unstale":"2024-09-21T09:05:05.717387+0000","last_undegraded":"2024-09-21T09:05:05.717387+0000","last_fullsized":"2024-09-21T09:05:05.717387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:43.259240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.833842+0000","last_change":"2024-09-21T09:02:58.220184+0000","last_active":"2024-09-21T09:03:39.833842+0000","last_peered":"2024-09-21T09:03:39.833842+0000","last_clean":"2024-09-21T09:03:39.833842+0000","last_became_active":"2024-09-21T09:02:58.218407+0000","last_became_peered":"2024-09-21T09:02:58.218407+0000","last_unstale":"2024-09-21T09:03:39.833842+0000","last_undegraded":"2024-09-21T09:03:39.833842+0000","last_fullsized":"2024-09-21T09:03:39.833842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:44.533015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.299204+0000","last_change":"2024-09-21T09:03:00.213244+0000","last_active":"2024-09-21T09:06:06.299204+0000","last_peered":"2024-09-21T09:06:06.299204+0000","last_clean":"2024-09-21T09:06:06.299204+0000","last_became_active":"2024-09-21T09:03:00.212503+0000","last_became_peered":"2024-09-21T09:03:00.212503+0000","last_unstale":"2024-09-21T09:06:06.299204+0000","last_undegraded":"2024-09-21T09:06:06.299204+0000","last_fullsized":"2024-09-21T09:06:06.299204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:52.154699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.465557+0000","last_change":"2024-09-21T09:02:58.202455+0000","last_active":"2024-09-21T09:03:38.465557+0000","last_peered":"2024-09-21T09:03:38.465557+0000","last_clean":"2024-09-21T09:03:38.465557+0000","last_became_active":"2024-09-21T09:02:58.201812+0000","last_became_peered":"2024-09-21T09:02:58.201812+0000","last_unstale":"2024-09-21T09:03:38.465557+0000","last_undegraded":"2024-09-21T09:03:38.465557+0000","last_fullsized":"2024-09-21T09:03:38.465557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:33.880917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'6","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.853327+0000","last_change":"2024-09-21T09:03:00.225519+0000","last_active":"2024-09-21T09:03:39.853327+0000","last_peered":"2024-09-21T09:03:39.853327+0000","last_clean":"2024-09-21T09:03:39.853327+0000","last_became_active":"2024-09-21T09:03:00.224456+0000","last_became_peered":"2024-09-21T09:03:00.224456+0000","last_unstale":"2024-09-21T09:03:39.853327+0000","last_undegraded":"2024-09-21T09:03:39.853327+0000","last_fullsized":"2024-09-21T09:03:39.853327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:22.464742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'6","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.012043+0000","last_change":"2024-09-21T09:02:58.222445+0000","last_active":"2024-09-21T09:06:06.012043+0000","last_peered":"2024-09-21T09:06:06.012043+0000","last_clean":"2024-09-21T09:06:06.012043+0000","last_became_active":"2024-09-21T09:02:58.222191+0000","last_became_peered":"2024-09-21T09:02:58.222191+0000","last_unstale":"2024-09-21T09:06:06.012043+0000","last_undegraded":"2024-09-21T09:06:06.012043+0000","last_fullsized":"2024-09-21T09:06:06.012043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:50.343858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'6","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.363119+0000","last_change":"2024-09-21T09:03:00.220918+0000","last_active":"2024-09-21T09:06:06.363119+0000","last_peered":"2024-09-21T09:06:06.363119+0000","last_clean":"2024-09-21T09:06:06.363119+0000","last_became_active":"2024-09-21T09:03:00.220639+0000","last_became_peered":"2024-09-21T09:03:00.220639+0000","last_unstale":"2024-09-21T09:06:06.363119+0000","last_undegraded":"2024-09-21T09:06:06.363119+0000","last_fullsized":"2024-09-21T09:06:06.363119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:26.629707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463882+0000","last_change":"2024-09-21T09:02:58.208759+0000","last_active":"2024-09-21T09:03:38.463882+0000","last_peered":"2024-09-21T09:03:38.463882+0000","last_clean":"2024-09-21T09:03:38.463882+0000","last_became_active":"2024-09-21T09:02:58.208346+0000","last_became_peered":"2024-09-21T09:02:58.208346+0000","last_unstale":"2024-09-21T09:03:38.463882+0000","last_undegraded":"2024-09-21T09:03:38.463882+0000","last_fullsized":"2024-09-21T09:03:38.463882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:44.533015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.711493+0000","last_change":"2024-09-21T09:03:00.223002+0000","last_active":"2024-09-21T09:05:02.711493+0000","last_peered":"2024-09-21T09:05:02.711493+0000","last_clean":"2024-09-21T09:05:02.711493+0000","last_became_active":"2024-09-21T09:03:00.222651+0000","last_became_peered":"2024-09-21T09:03:00.222651+0000","last_unstale":"2024-09-21T09:05:02.711493+0000","last_undegraded":"2024-09-21T09:05:02.711493+0000","last_fullsized":"2024-09-21T09:05:02.711493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:24.133336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.274353+0000","last_change":"2024-09-21T09:02:58.209919+0000","last_active":"2024-09-21T09:03:38.274353+0000","last_peered":"2024-09-21T09:03:38.274353+0000","last_clean":"2024-09-21T09:03:38.274353+0000","last_became_active":"2024-09-21T09:02:58.208495+0000","last_became_peered":"2024-09-21T09:02:58.208495+0000","last_unstale":"2024-09-21T09:03:38.274353+0000","last_undegraded":"2024-09-21T09:03:38.274353+0000","last_fullsized":"2024-09-21T09:03:38.274353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:14.606085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'4","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275450+0000","last_change":"2024-09-21T09:03:00.222862+0000","last_active":"2024-09-21T09:03:38.275450+0000","last_peered":"2024-09-21T09:03:38.275450+0000","last_clean":"2024-09-21T09:03:38.275450+0000","last_became_active":"2024-09-21T09:03:00.222343+0000","last_became_peered":"2024-09-21T09:03:00.222343+0000","last_unstale":"2024-09-21T09:03:38.275450+0000","last_undegraded":"2024-09-21T09:03:38.275450+0000","last_fullsized":"2024-09-21T09:03:38.275450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:06.215821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455383+0000","last_change":"2024-09-21T09:02:58.210097+0000","last_active":"2024-09-21T09:05:12.455383+0000","last_peered":"2024-09-21T09:05:12.455383+0000","last_clean":"2024-09-21T09:05:12.455383+0000","last_became_active":"2024-09-21T09:02:58.208630+0000","last_became_peered":"2024-09-21T09:02:58.208630+0000","last_unstale":"2024-09-21T09:05:12.455383+0000","last_undegraded":"2024-09-21T09:05:12.455383+0000","last_fullsized":"2024-09-21T09:05:12.455383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.754217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'18","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:39.853440+0000","last_change":"2024-09-21T09:03:38.286564+0000","last_active":"2024-09-21T09:03:39.853440+0000","last_peered":"2024-09-21T09:03:39.853440+0000","last_clean":"2024-09-21T09:03:39.853440+0000","last_became_active":"2024-09-21T09:03:38.282951+0000","last_became_peered":"2024-09-21T09:03:38.282951+0000","last_unstale":"2024-09-21T09:03:39.853440+0000","last_undegraded":"2024-09-21T09:03:39.853440+0000","last_fullsized":"2024-09-21T09:03:39.853440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:00.987047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.063131+0000","last_change":"2024-09-21T09:02:58.214989+0000","last_active":"2024-09-21T09:06:06.063131+0000","last_peered":"2024-09-21T09:06:06.063131+0000","last_clean":"2024-09-21T09:06:06.063131+0000","last_became_active":"2024-09-21T09:02:58.214717+0000","last_became_peered":"2024-09-21T09:02:58.214717+0000","last_unstale":"2024-09-21T09:06:06.063131+0000","last_undegraded":"2024-09-21T09:06:06.063131+0000","last_fullsized":"2024-09-21T09:06:06.063131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:03.101113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.456132+0000","last_change":"2024-09-21T09:03:00.227362+0000","last_active":"2024-09-21T09:05:17.456132+0000","last_peered":"2024-09-21T09:05:17.456132+0000","last_clean":"2024-09-21T09:05:17.456132+0000","last_became_active":"2024-09-21T09:03:00.226411+0000","last_became_peered":"2024-09-21T09:03:00.226411+0000","last_unstale":"2024-09-21T09:05:17.456132+0000","last_undegraded":"2024-09-21T09:05:17.456132+0000","last_fullsized":"2024-09-21T09:05:17.456132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:47.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.753111+0000","last_change":"2024-09-21T09:02:58.224258+0000","last_active":"2024-09-21T09:03:38.753111+0000","last_peered":"2024-09-21T09:03:38.753111+0000","last_clean":"2024-09-21T09:03:38.753111+0000","last_became_active":"2024-09-21T09:02:58.224058+0000","last_became_peered":"2024-09-21T09:02:58.224058+0000","last_unstale":"2024-09-21T09:03:38.753111+0000","last_undegraded":"2024-09-21T09:03:38.753111+0000","last_fullsized":"2024-09-21T09:03:38.753111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:40.099948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.080511+0000","last_change":"2024-09-21T09:03:00.220552+0000","last_active":"2024-09-21T09:06:06.080511+0000","last_peered":"2024-09-21T09:06:06.080511+0000","last_clean":"2024-09-21T09:06:06.080511+0000","last_became_active":"2024-09-21T09:03:00.218422+0000","last_became_peered":"2024-09-21T09:03:00.218422+0000","last_unstale":"2024-09-21T09:06:06.080511+0000","last_undegraded":"2024-09-21T09:06:06.080511+0000","last_fullsized":"2024-09-21T09:06:06.080511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:11.245837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.275596+0000","last_change":"2024-09-21T09:02:58.219338+0000","last_active":"2024-09-21T09:03:38.275596+0000","last_peered":"2024-09-21T09:03:38.275596+0000","last_clean":"2024-09-21T09:03:38.275596+0000","last_became_active":"2024-09-21T09:02:58.218299+0000","last_became_peered":"2024-09-21T09:02:58.218299+0000","last_unstale":"2024-09-21T09:03:38.275596+0000","last_undegraded":"2024-09-21T09:03:38.275596+0000","last_fullsized":"2024-09-21T09:03:38.275596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:52.024304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'11","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455220+0000","last_change":"2024-09-21T09:03:00.213716+0000","last_active":"2024-09-21T09:05:12.455220+0000","last_peered":"2024-09-21T09:05:12.455220+0000","last_clean":"2024-09-21T09:05:12.455220+0000","last_became_active":"2024-09-21T09:03:00.212838+0000","last_became_peered":"2024-09-21T09:03:00.212838+0000","last_unstale":"2024-09-21T09:05:12.455220+0000","last_undegraded":"2024-09-21T09:05:12.455220+0000","last_fullsized":"2024-09-21T09:05:12.455220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:30.357859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.025680+0000","last_change":"2024-09-21T09:02:58.219134+0000","last_active":"2024-09-21T09:06:06.025680+0000","last_peered":"2024-09-21T09:06:06.025680+0000","last_clean":"2024-09-21T09:06:06.025680+0000","last_became_active":"2024-09-21T09:02:58.218776+0000","last_became_peered":"2024-09-21T09:02:58.218776+0000","last_unstale":"2024-09-21T09:06:06.025680+0000","last_undegraded":"2024-09-21T09:06:06.025680+0000","last_fullsized":"2024-09-21T09:06:06.025680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:24.476268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.271062+0000","last_change":"2024-09-21T09:02:58.219078+0000","last_active":"2024-09-21T09:03:38.271062+0000","last_peered":"2024-09-21T09:03:38.271062+0000","last_clean":"2024-09-21T09:03:38.271062+0000","last_became_active":"2024-09-21T09:02:58.218757+0000","last_became_peered":"2024-09-21T09:02:58.218757+0000","last_unstale":"2024-09-21T09:03:38.271062+0000","last_undegraded":"2024-09-21T09:03:38.271062+0000","last_fullsized":"2024-09-21T09:03:38.271062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:37:41.056206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'6","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.299232+0000","last_change":"2024-09-21T09:03:00.216883+0000","last_active":"2024-09-21T09:06:06.299232+0000","last_peered":"2024-09-21T09:06:06.299232+0000","last_clean":"2024-09-21T09:06:06.299232+0000","last_became_active":"2024-09-21T09:03:00.216424+0000","last_became_peered":"2024-09-21T09:03:00.216424+0000","last_unstale":"2024-09-21T09:06:06.299232+0000","last_undegraded":"2024-09-21T09:06:06.299232+0000","last_fullsized":"2024-09-21T09:06:06.299232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:50.802476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:03:38.463675+0000","last_change":"2024-09-21T09:02:58.209061+0000","last_active":"2024-09-21T09:03:38.463675+0000","last_peered":"2024-09-21T09:03:38.463675+0000","last_clean":"2024-09-21T09:03:38.463675+0000","last_became_active":"2024-09-21T09:02:58.208437+0000","last_became_peered":"2024-09-21T09:02:58.208437+0000","last_unstale":"2024-09-21T09:03:38.463675+0000","last_undegraded":"2024-09-21T09:03:38.463675+0000","last_fullsized":"2024-09-21T09:03:38.463675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:12.355792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'3","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.089579+0000","last_change":"2024-09-21T09:03:00.219307+0000","last_active":"2024-09-21T09:06:06.089579+0000","last_peered":"2024-09-21T09:06:06.089579+0000","last_clean":"2024-09-21T09:06:06.089579+0000","last_became_active":"2024-09-21T09:03:00.219010+0000","last_became_peered":"2024-09-21T09:03:00.219010+0000","last_unstale":"2024-09-21T09:06:06.089579+0000","last_undegraded":"2024-09-21T09:06:06.089579+0000","last_fullsized":"2024-09-21T09:06:06.089579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:19.412009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2259,"ondisk_log_size":2259,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1474,"num_read_kb":1263,"num_write":555,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1311,"ondisk_log_size":1311,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":132,"num_read_kb":83,"num_write":311,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38391808,"data_stored":38388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":136073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36796,"kb_used_data":9772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":10006528,"data_stored":9752500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61028,"kb_used_data":17364,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94310812,"statfs":{"total":96636764160,"available":96574271488,"internally_reserved":0,"allocated":17780736,"data_stored":17500718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52200,"kb_used_data":12696,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319640,"statfs":{"total":96636764160,"available":96583311360,"internally_reserved":0,"allocated":13000704,"data_stored":12717132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:06:17.579 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.580 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.580 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.580 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.580 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.580 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.580 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.580 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.580 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.580 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.580 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.581 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.581 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.581 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.581 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.581 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.581 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.581 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.581 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.581 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.582 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.582 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.582 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.582 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.582 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.582 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.582 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.582 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.582 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.582 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.583 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.583 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.583 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.583 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.583 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.583 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.583 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.583 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.583 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.583 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.584 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.584 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.584 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.584 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.584 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.584 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.584 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.584 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.584 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.585 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.585 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.585 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.585 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.585 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.585 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.585 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.585 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.585 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.585 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.586 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.586 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.586 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.586 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.586 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.586 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.586 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.586 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.586 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.586 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.587 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.587 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.587 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.587 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.587 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.587 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.587 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.587 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.587 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.588 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.588 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.588 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.588 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.588 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.588 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.588 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.588 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.588 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.588 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.589 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.589 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.589 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.589 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.589 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.589 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.589 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.589 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.589 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.590 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.590 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.590 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.590 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.590 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T09:02:42.466256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=42, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.590 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.590 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.590 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.590 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.590 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.591 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.591 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.591 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.591 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.591 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.591 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.591 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.591 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.591 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.592 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.592 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.592 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.592 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.592 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.592 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.592 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.592 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.592 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.592 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.593 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.593 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.593 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.593 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.593 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.593 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.593 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.593 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.593 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.594 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.594 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.594 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.594 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.594 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.594 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.594 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.594 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.594 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.594 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.595 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.595 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.595 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.595 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.595 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.595 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.595 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.595 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.595 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.596 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.596 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.596 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.596 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.596 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.596 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.596 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.596 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.596 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.596 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.597 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.597 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.597 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.597 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.597 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.597 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.597 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.597 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.597 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.598 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.598 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.598 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.598 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.598 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.598 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.598 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.598 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.598 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.598 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.599 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.599 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.599 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.599 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.599 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.599 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.599 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.599 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.599 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.600 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.600 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.600 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.600 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.600 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.600 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.600 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.600 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.600 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.600 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.601 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.601 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.601 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.601 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.601 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.601 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.601 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.601 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.601 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.602 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.602 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.602 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.602 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.602 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.602 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.602 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.602 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.602 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.603 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.603 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.603 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.603 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.603 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.603 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.603 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.603 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.603 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.603 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.604 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.604 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.604 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.604 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.604 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.604 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.604 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.604 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.604 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.604 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.605 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.605 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.605 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.605 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.605 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.605 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.605 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.605 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.605 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.605 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.606 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.606 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.606 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.606 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.606 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.606 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.606 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.606 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.607 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.607 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.607 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.607 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.607 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.607 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.607 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:17.607 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T09:06:37.608 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:06:37.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.721+0000 7f66b4a15640 1 Processor -- start 2024-09-21T09:06:37.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.721+0000 7f66b4a15640 1 -- start start 2024-09-21T09:06:37.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.722+0000 7f66b4a15640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f66b012f740 0x7f66b0131b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:37.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.722+0000 7f66b4a15640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66b012c550 con 0x7f66b012c750 2024-09-21T09:06:37.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.722+0000 7f66b4a15640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f66b0071eb0 con 0x7f66b012f740 2024-09-21T09:06:37.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.722+0000 7f66add9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f66b012f740 0x7f66b0131b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:37.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.722+0000 7f66ae59c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f66b012c750 0x7f66b012cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:34414/0 (socket says 172.21.15.44:34414) 2024-09-21T09:06:37.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.722+0000 7f66ae59c640 1 -- 172.21.15.44:0/445111270 learned_addr learned my addr 172.21.15.44:0/445111270 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:37.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.722+0000 7f66add9b640 1 -- 172.21.15.44:0/445111270 >> v1:172.21.15.44:6789/0 conn(0x7f66b012c750 legacy=0x7f66b012cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:37.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.722+0000 7f66add9b640 1 -- 172.21.15.44:0/445111270 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b006bd80 con 0x7f66b012f740 2024-09-21T09:06:37.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.722+0000 7f66ad59a640 1 -- 172.21.15.44:0/445111270 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3572001566 0 0) 0x7f66b012c550 con 0x7f66b012c750 2024-09-21T09:06:37.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.723+0000 7f66add9b640 1 --2- 172.21.15.44:0/445111270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b012f740 0x7f66b0131b30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009720 tx=0x7f66a402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ba0200e2ce80f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:37.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.723+0000 7f66ad59a640 1 -- 172.21.15.44:0/445111270 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66a4037070 con 0x7f66b012f740 2024-09-21T09:06:37.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.723+0000 7f66ad59a640 1 -- 172.21.15.44:0/445111270 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a402ad90 con 0x7f66b012f740 2024-09-21T09:06:37.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.723+0000 7f66ad59a640 1 -- 172.21.15.44:0/445111270 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66a4032590 con 0x7f66b012f740 2024-09-21T09:06:37.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.723+0000 7f66b4a15640 1 -- 172.21.15.44:0/445111270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b012f740 msgr2=0x7f66b0131b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:37.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.723+0000 7f66b4a15640 1 --2- 172.21.15.44:0/445111270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b012f740 0x7f66b0131b30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009720 tx=0x7f66a402a110 comp rx=0 tx=0).stop 2024-09-21T09:06:37.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.724+0000 7f66b4a15640 1 -- 172.21.15.44:0/445111270 shutdown_connections 2024-09-21T09:06:37.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.724+0000 7f66b4a15640 1 --2- 172.21.15.44:0/445111270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b012f740 0x7f66b0131b30 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:37.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.724+0000 7f66b4a15640 1 -- 172.21.15.44:0/445111270 >> 172.21.15.44:0/445111270 conn(0x7f66b009dd40 msgr2=0x7f66b009e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:37.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.724+0000 7f66b4a15640 1 -- 172.21.15.44:0/445111270 shutdown_connections 2024-09-21T09:06:37.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.724+0000 7f66b4a15640 1 -- 172.21.15.44:0/445111270 wait complete. 2024-09-21T09:06:37.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.725+0000 7f66b4a15640 1 Processor -- start 2024-09-21T09:06:37.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.725+0000 7f66b4a15640 1 -- start start 2024-09-21T09:06:37.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.725+0000 7f66b4a15640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b012c750 0x7f66b0123f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:37.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.725+0000 7f66b4a15640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66b0071bf0 con 0x7f66b012c750 2024-09-21T09:06:37.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.725+0000 7f66ae59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b012c750 0x7f66b0123f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:37.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.725+0000 7f66ae59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b012c750 0x7f66b0123f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59088/0 (socket says 172.21.15.44:59088) 2024-09-21T09:06:37.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.725+0000 7f66ae59c640 1 -- 172.21.15.44:0/2297334596 learned_addr learned my addr 172.21.15.44:0/2297334596 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:37.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.726+0000 7f66ae59c640 1 -- 172.21.15.44:0/2297334596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b0125820 con 0x7f66b012c750 2024-09-21T09:06:37.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.726+0000 7f66ae59c640 1 --2- 172.21.15.44:0/2297334596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b012c750 0x7f66b0123f10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f66a000c420 tx=0x7f66a000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:37.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.726+0000 7f669effd640 1 -- 172.21.15.44:0/2297334596 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66a0018070 con 0x7f66b012c750 2024-09-21T09:06:37.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.726+0000 7f669effd640 1 -- 172.21.15.44:0/2297334596 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a00074d0 con 0x7f66b012c750 2024-09-21T09:06:37.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.726+0000 7f669effd640 1 -- 172.21.15.44:0/2297334596 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66a0004950 con 0x7f66b012c750 2024-09-21T09:06:37.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.726+0000 7f66b4a15640 1 -- 172.21.15.44:0/2297334596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b0126300 con 0x7f66b012c750 2024-09-21T09:06:37.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.726+0000 7f66b4a15640 1 -- 172.21.15.44:0/2297334596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b0124450 con 0x7f66b012c750 2024-09-21T09:06:37.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.727+0000 7f669effd640 1 -- 172.21.15.44:0/2297334596 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f66a001b070 con 0x7f66b012c750 2024-09-21T09:06:37.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.727+0000 7f66b4a15640 1 -- 172.21.15.44:0/2297334596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b012cb30 con 0x7f66b012c750 2024-09-21T09:06:37.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.727+0000 7f669effd640 1 --2- 172.21.15.44:0/2297334596 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f66900382a0 0x7f669003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:37.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.727+0000 7f669effd640 1 -- 172.21.15.44:0/2297334596 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f66a004afe0 con 0x7f66b012c750 2024-09-21T09:06:37.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.728+0000 7f66add9b640 1 --2- 172.21.15.44:0/2297334596 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f66900382a0 0x7f669003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:37.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.728+0000 7f66add9b640 1 --2- 172.21.15.44:0/2297334596 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f66900382a0 0x7f669003a760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f66a4034000 tx=0x7f66a402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:37.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.732+0000 7f669effd640 1 -- 172.21.15.44:0/2297334596 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f66a0011980 con 0x7f66b012c750 2024-09-21T09:06:37.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.910+0000 7f66b4a15640 1 -- 172.21.15.44:0/2297334596 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f66b0126ba0 con 0x7f66900382a0 2024-09-21T09:06:37.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.925+0000 7f669effd640 1 -- 172.21.15.44:0/2297334596 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658236 (secure 0 0 0) 0x7f66b0126ba0 con 0x7f66900382a0 2024-09-21T09:06:37.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:06:37.939 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-21T09:06:37.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.930+0000 7f66b4a15640 1 -- 172.21.15.44:0/2297334596 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f66900382a0 msgr2=0x7f669003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:37.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.930+0000 7f66b4a15640 1 --2- 172.21.15.44:0/2297334596 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f66900382a0 0x7f669003a760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f66a4034000 tx=0x7f66a402e000 comp rx=0 tx=0).stop 2024-09-21T09:06:37.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.930+0000 7f66b4a15640 1 -- 172.21.15.44:0/2297334596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b012c750 msgr2=0x7f66b0123f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:37.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.930+0000 7f66b4a15640 1 --2- 172.21.15.44:0/2297334596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b012c750 0x7f66b0123f10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f66a000c420 tx=0x7f66a000c8e0 comp rx=0 tx=0).stop 2024-09-21T09:06:37.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.931+0000 7f66b4a15640 1 -- 172.21.15.44:0/2297334596 shutdown_connections 2024-09-21T09:06:37.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.931+0000 7f66b4a15640 1 --2- 172.21.15.44:0/2297334596 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f66900382a0 0x7f669003a760 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:37.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.931+0000 7f66b4a15640 1 --2- 172.21.15.44:0/2297334596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b012c750 0x7f66b0123f10 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:37.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.931+0000 7f66b4a15640 1 -- 172.21.15.44:0/2297334596 >> 172.21.15.44:0/2297334596 conn(0x7f66b009dd40 msgr2=0x7f66b009a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:37.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.931+0000 7f66b4a15640 1 -- 172.21.15.44:0/2297334596 shutdown_connections 2024-09-21T09:06:37.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:37.931+0000 7f66b4a15640 1 -- 172.21.15.44:0/2297334596 wait complete. 2024-09-21T09:06:37.943 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-09-21T09:06:36.491900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5097,"num_read_kb":4682,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4722,"ondisk_log_size":4722,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":123360,"kb_used_data":2784,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377364000,"statfs":{"total":386547056640,"available":386420736000,"internally_reserved":0,"allocated":2850816,"data_stored":1716104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":123397911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004098"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.695646+0000","last_change":"2024-09-21T09:03:38.283847+0000","last_active":"2024-09-21T09:05:05.695646+0000","last_peered":"2024-09-21T09:05:05.695646+0000","last_clean":"2024-09-21T09:05:05.695646+0000","last_became_active":"2024-09-21T09:03:38.283357+0000","last_became_peered":"2024-09-21T09:03:38.283357+0000","last_unstale":"2024-09-21T09:05:05.695646+0000","last_undegraded":"2024-09-21T09:05:05.695646+0000","last_fullsized":"2024-09-21T09:05:05.695646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'20","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304060+0000","last_change":"2024-09-21T09:03:00.226390+0000","last_active":"2024-09-21T09:06:06.304060+0000","last_peered":"2024-09-21T09:06:06.304060+0000","last_clean":"2024-09-21T09:06:06.304060+0000","last_became_active":"2024-09-21T09:03:00.226067+0000","last_became_peered":"2024-09-21T09:03:00.226067+0000","last_unstale":"2024-09-21T09:06:06.304060+0000","last_undegraded":"2024-09-21T09:06:06.304060+0000","last_fullsized":"2024-09-21T09:06:06.304060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453196+0000","last_change":"2024-09-21T09:02:58.213108+0000","last_active":"2024-09-21T09:05:02.453196+0000","last_peered":"2024-09-21T09:05:02.453196+0000","last_clean":"2024-09-21T09:05:02.453196+0000","last_became_active":"2024-09-21T09:02:58.212828+0000","last_became_peered":"2024-09-21T09:02:58.212828+0000","last_unstale":"2024-09-21T09:05:02.453196+0000","last_undegraded":"2024-09-21T09:05:02.453196+0000","last_fullsized":"2024-09-21T09:05:02.453196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.265814+0000","last_change":"2024-09-21T09:06:30.265847+0000","last_active":"2024-09-21T09:06:30.265814+0000","last_peered":"2024-09-21T09:06:30.265814+0000","last_clean":"2024-09-21T09:06:30.265814+0000","last_became_active":"2024-09-21T09:03:00.222333+0000","last_became_peered":"2024-09-21T09:03:00.222333+0000","last_unstale":"2024-09-21T09:06:30.265814+0000","last_undegraded":"2024-09-21T09:06:30.265814+0000","last_fullsized":"2024-09-21T09:06:30.265814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:30.265727+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:30.265727+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.265727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:36.517568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:03.457257+0000","last_change":"2024-09-21T09:02:58.221389+0000","last_active":"2024-09-21T09:05:03.457257+0000","last_peered":"2024-09-21T09:05:03.457257+0000","last_clean":"2024-09-21T09:05:03.457257+0000","last_became_active":"2024-09-21T09:02:58.221214+0000","last_became_peered":"2024-09-21T09:02:58.221214+0000","last_unstale":"2024-09-21T09:05:03.457257+0000","last_undegraded":"2024-09-21T09:05:03.457257+0000","last_fullsized":"2024-09-21T09:05:03.457257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.182039+0000","last_change":"2024-09-21T09:03:00.221728+0000","last_active":"2024-09-21T09:06:06.182039+0000","last_peered":"2024-09-21T09:06:06.182039+0000","last_clean":"2024-09-21T09:06:06.182039+0000","last_became_active":"2024-09-21T09:03:00.221451+0000","last_became_peered":"2024-09-21T09:03:00.221451+0000","last_unstale":"2024-09-21T09:06:06.182039+0000","last_undegraded":"2024-09-21T09:06:06.182039+0000","last_fullsized":"2024-09-21T09:06:06.182039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.969982+0000","last_change":"2024-09-21T09:02:58.208725+0000","last_active":"2024-09-21T09:06:12.969982+0000","last_peered":"2024-09-21T09:06:12.969982+0000","last_clean":"2024-09-21T09:06:12.969982+0000","last_became_active":"2024-09-21T09:02:58.207683+0000","last_became_peered":"2024-09-21T09:02:58.207683+0000","last_unstale":"2024-09-21T09:06:12.969982+0000","last_undegraded":"2024-09-21T09:06:12.969982+0000","last_fullsized":"2024-09-21T09:06:12.969982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'9","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.413504+0000","last_change":"2024-09-21T09:03:00.212574+0000","last_active":"2024-09-21T09:06:06.413504+0000","last_peered":"2024-09-21T09:06:06.413504+0000","last_clean":"2024-09-21T09:06:06.413504+0000","last_became_active":"2024-09-21T09:03:00.210589+0000","last_became_peered":"2024-09-21T09:03:00.210589+0000","last_unstale":"2024-09-21T09:06:06.413504+0000","last_undegraded":"2024-09-21T09:06:06.413504+0000","last_fullsized":"2024-09-21T09:06:06.413504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"31'6","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.256245+0000","last_change":"2024-09-21T09:02:58.224906+0000","last_active":"2024-09-21T09:06:06.256245+0000","last_peered":"2024-09-21T09:06:06.256245+0000","last_clean":"2024-09-21T09:06:06.256245+0000","last_became_active":"2024-09-21T09:02:58.224630+0000","last_became_peered":"2024-09-21T09:02:58.224630+0000","last_unstale":"2024-09-21T09:06:06.256245+0000","last_undegraded":"2024-09-21T09:06:06.256245+0000","last_fullsized":"2024-09-21T09:06:06.256245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'6","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304050+0000","last_change":"2024-09-21T09:03:00.223960+0000","last_active":"2024-09-21T09:06:06.304050+0000","last_peered":"2024-09-21T09:06:06.304050+0000","last_clean":"2024-09-21T09:06:06.304050+0000","last_became_active":"2024-09-21T09:03:00.217048+0000","last_became_peered":"2024-09-21T09:03:00.217048+0000","last_unstale":"2024-09-21T09:06:06.304050+0000","last_undegraded":"2024-09-21T09:06:06.304050+0000","last_fullsized":"2024-09-21T09:06:06.304050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:27.457294+0000","last_change":"2024-09-21T09:02:58.205801+0000","last_active":"2024-09-21T09:05:27.457294+0000","last_peered":"2024-09-21T09:05:27.457294+0000","last_clean":"2024-09-21T09:05:27.457294+0000","last_became_active":"2024-09-21T09:02:58.205515+0000","last_became_peered":"2024-09-21T09:02:58.205515+0000","last_unstale":"2024-09-21T09:05:27.457294+0000","last_undegraded":"2024-09-21T09:05:27.457294+0000","last_fullsized":"2024-09-21T09:05:27.457294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'14","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.235166+0000","last_change":"2024-09-21T09:06:32.235193+0000","last_active":"2024-09-21T09:06:32.235166+0000","last_peered":"2024-09-21T09:06:32.235166+0000","last_clean":"2024-09-21T09:06:32.235166+0000","last_became_active":"2024-09-21T09:03:00.221117+0000","last_became_peered":"2024-09-21T09:03:00.221117+0000","last_unstale":"2024-09-21T09:06:32.235166+0000","last_undegraded":"2024-09-21T09:06:32.235166+0000","last_fullsized":"2024-09-21T09:06:32.235166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:32.235081+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:32.235081+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.235081+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:09.067914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.250827+0000","last_change":"2024-09-21T09:02:58.211066+0000","last_active":"2024-09-21T09:06:06.250827+0000","last_peered":"2024-09-21T09:06:06.250827+0000","last_clean":"2024-09-21T09:06:06.250827+0000","last_became_active":"2024-09-21T09:02:58.210702+0000","last_became_peered":"2024-09-21T09:02:58.210702+0000","last_unstale":"2024-09-21T09:06:06.250827+0000","last_undegraded":"2024-09-21T09:06:06.250827+0000","last_fullsized":"2024-09-21T09:06:06.250827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.369991+0000","last_change":"2024-09-21T09:03:00.221039+0000","last_active":"2024-09-21T09:06:06.369991+0000","last_peered":"2024-09-21T09:06:06.369991+0000","last_clean":"2024-09-21T09:06:06.369991+0000","last_became_active":"2024-09-21T09:03:00.220725+0000","last_became_peered":"2024-09-21T09:03:00.220725+0000","last_unstale":"2024-09-21T09:06:06.369991+0000","last_undegraded":"2024-09-21T09:06:06.369991+0000","last_fullsized":"2024-09-21T09:06:06.369991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.258840+0000","last_change":"2024-09-21T09:02:58.217016+0000","last_active":"2024-09-21T09:06:06.258840+0000","last_peered":"2024-09-21T09:06:06.258840+0000","last_clean":"2024-09-21T09:06:06.258840+0000","last_became_active":"2024-09-21T09:02:58.216712+0000","last_became_peered":"2024-09-21T09:02:58.216712+0000","last_unstale":"2024-09-21T09:06:06.258840+0000","last_undegraded":"2024-09-21T09:06:06.258840+0000","last_fullsized":"2024-09-21T09:06:06.258840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.370117+0000","last_change":"2024-09-21T09:03:00.222904+0000","last_active":"2024-09-21T09:06:06.370117+0000","last_peered":"2024-09-21T09:06:06.370117+0000","last_clean":"2024-09-21T09:06:06.370117+0000","last_became_active":"2024-09-21T09:03:00.222593+0000","last_became_peered":"2024-09-21T09:03:00.222593+0000","last_unstale":"2024-09-21T09:06:06.370117+0000","last_undegraded":"2024-09-21T09:06:06.370117+0000","last_fullsized":"2024-09-21T09:06:06.370117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'11","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.413929+0000","last_change":"2024-09-21T09:03:00.220191+0000","last_active":"2024-09-21T09:06:06.413929+0000","last_peered":"2024-09-21T09:06:06.413929+0000","last_clean":"2024-09-21T09:06:06.413929+0000","last_became_active":"2024-09-21T09:03:00.219923+0000","last_became_peered":"2024-09-21T09:03:00.219923+0000","last_unstale":"2024-09-21T09:06:06.413929+0000","last_undegraded":"2024-09-21T09:06:06.413929+0000","last_fullsized":"2024-09-21T09:06:06.413929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.457141+0000","last_change":"2024-09-21T09:02:58.212942+0000","last_active":"2024-09-21T09:05:22.457141+0000","last_peered":"2024-09-21T09:05:22.457141+0000","last_clean":"2024-09-21T09:05:22.457141+0000","last_became_active":"2024-09-21T09:02:58.210936+0000","last_became_peered":"2024-09-21T09:02:58.210936+0000","last_unstale":"2024-09-21T09:05:22.457141+0000","last_undegraded":"2024-09-21T09:05:22.457141+0000","last_fullsized":"2024-09-21T09:05:22.457141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456882+0000","last_change":"2024-09-21T09:03:00.225223+0000","last_active":"2024-09-21T09:05:22.456882+0000","last_peered":"2024-09-21T09:05:22.456882+0000","last_clean":"2024-09-21T09:05:22.456882+0000","last_became_active":"2024-09-21T09:03:00.224695+0000","last_became_peered":"2024-09-21T09:03:00.224695+0000","last_unstale":"2024-09-21T09:05:22.456882+0000","last_undegraded":"2024-09-21T09:05:22.456882+0000","last_fullsized":"2024-09-21T09:05:22.456882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456702+0000","last_change":"2024-09-21T09:02:58.220090+0000","last_active":"2024-09-21T09:05:22.456702+0000","last_peered":"2024-09-21T09:05:22.456702+0000","last_clean":"2024-09-21T09:05:22.456702+0000","last_became_active":"2024-09-21T09:02:58.218643+0000","last_became_peered":"2024-09-21T09:02:58.218643+0000","last_unstale":"2024-09-21T09:05:22.456702+0000","last_undegraded":"2024-09-21T09:05:22.456702+0000","last_fullsized":"2024-09-21T09:05:22.456702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.370089+0000","last_change":"2024-09-21T09:03:00.227634+0000","last_active":"2024-09-21T09:06:06.370089+0000","last_peered":"2024-09-21T09:06:06.370089+0000","last_clean":"2024-09-21T09:06:06.370089+0000","last_became_active":"2024-09-21T09:03:00.226738+0000","last_became_peered":"2024-09-21T09:03:00.226738+0000","last_unstale":"2024-09-21T09:06:06.370089+0000","last_undegraded":"2024-09-21T09:06:06.370089+0000","last_fullsized":"2024-09-21T09:06:06.370089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.046927+0000","last_change":"2024-09-21T09:02:58.208501+0000","last_active":"2024-09-21T09:06:06.046927+0000","last_peered":"2024-09-21T09:06:06.046927+0000","last_clean":"2024-09-21T09:06:06.046927+0000","last_became_active":"2024-09-21T09:02:58.208220+0000","last_became_peered":"2024-09-21T09:02:58.208220+0000","last_unstale":"2024-09-21T09:06:06.046927+0000","last_undegraded":"2024-09-21T09:06:06.046927+0000","last_fullsized":"2024-09-21T09:06:06.046927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'16","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.267369+0000","last_change":"2024-09-21T09:03:00.216019+0000","last_active":"2024-09-21T09:06:06.267369+0000","last_peered":"2024-09-21T09:06:06.267369+0000","last_clean":"2024-09-21T09:06:06.267369+0000","last_became_active":"2024-09-21T09:03:00.215637+0000","last_became_peered":"2024-09-21T09:03:00.215637+0000","last_unstale":"2024-09-21T09:06:06.267369+0000","last_undegraded":"2024-09-21T09:06:06.267369+0000","last_fullsized":"2024-09-21T09:06:06.267369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.457016+0000","last_change":"2024-09-21T09:02:58.206160+0000","last_active":"2024-09-21T09:05:22.457016+0000","last_peered":"2024-09-21T09:05:22.457016+0000","last_clean":"2024-09-21T09:05:22.457016+0000","last_became_active":"2024-09-21T09:02:58.204603+0000","last_became_peered":"2024-09-21T09:02:58.204603+0000","last_unstale":"2024-09-21T09:05:22.457016+0000","last_undegraded":"2024-09-21T09:05:22.457016+0000","last_fullsized":"2024-09-21T09:05:22.457016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:27.457355+0000","last_change":"2024-09-21T09:03:00.223258+0000","last_active":"2024-09-21T09:05:27.457355+0000","last_peered":"2024-09-21T09:05:27.457355+0000","last_clean":"2024-09-21T09:05:27.457355+0000","last_became_active":"2024-09-21T09:03:00.222972+0000","last_became_peered":"2024-09-21T09:03:00.222972+0000","last_unstale":"2024-09-21T09:05:27.457355+0000","last_undegraded":"2024-09-21T09:05:27.457355+0000","last_fullsized":"2024-09-21T09:05:27.457355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456004+0000","last_change":"2024-09-21T09:02:58.208852+0000","last_active":"2024-09-21T09:05:22.456004+0000","last_peered":"2024-09-21T09:05:22.456004+0000","last_clean":"2024-09-21T09:05:22.456004+0000","last_became_active":"2024-09-21T09:02:58.208383+0000","last_became_peered":"2024-09-21T09:02:58.208383+0000","last_unstale":"2024-09-21T09:05:22.456004+0000","last_undegraded":"2024-09-21T09:05:22.456004+0000","last_fullsized":"2024-09-21T09:05:22.456004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.369488+0000","last_change":"2024-09-21T09:03:00.212288+0000","last_active":"2024-09-21T09:06:06.369488+0000","last_peered":"2024-09-21T09:06:06.369488+0000","last_clean":"2024-09-21T09:06:06.369488+0000","last_became_active":"2024-09-21T09:03:00.211942+0000","last_became_peered":"2024-09-21T09:03:00.211942+0000","last_unstale":"2024-09-21T09:06:06.369488+0000","last_undegraded":"2024-09-21T09:06:06.369488+0000","last_fullsized":"2024-09-21T09:06:06.369488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.459903+0000","last_change":"2024-09-21T09:02:58.214186+0000","last_active":"2024-09-21T09:05:18.459903+0000","last_peered":"2024-09-21T09:05:18.459903+0000","last_clean":"2024-09-21T09:05:18.459903+0000","last_became_active":"2024-09-21T09:02:58.213548+0000","last_became_peered":"2024-09-21T09:02:58.213548+0000","last_unstale":"2024-09-21T09:05:18.459903+0000","last_undegraded":"2024-09-21T09:05:18.459903+0000","last_fullsized":"2024-09-21T09:05:18.459903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.379275+0000","last_change":"2024-09-21T09:03:08.262655+0000","last_active":"2024-09-21T09:06:06.379275+0000","last_peered":"2024-09-21T09:06:06.379275+0000","last_clean":"2024-09-21T09:06:06.379275+0000","last_became_active":"2024-09-21T09:03:08.262362+0000","last_became_peered":"2024-09-21T09:03:08.262362+0000","last_unstale":"2024-09-21T09:06:06.379275+0000","last_undegraded":"2024-09-21T09:06:06.379275+0000","last_fullsized":"2024-09-21T09:06:06.379275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460724+0000","last_change":"2024-09-21T09:03:00.212668+0000","last_active":"2024-09-21T09:05:23.460724+0000","last_peered":"2024-09-21T09:05:23.460724+0000","last_clean":"2024-09-21T09:05:23.460724+0000","last_became_active":"2024-09-21T09:03:00.209346+0000","last_became_peered":"2024-09-21T09:03:00.209346+0000","last_unstale":"2024-09-21T09:05:23.460724+0000","last_undegraded":"2024-09-21T09:05:23.460724+0000","last_fullsized":"2024-09-21T09:05:23.460724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.459935+0000","last_change":"2024-09-21T09:02:58.221478+0000","last_active":"2024-09-21T09:05:18.459935+0000","last_peered":"2024-09-21T09:05:18.459935+0000","last_clean":"2024-09-21T09:05:18.459935+0000","last_became_active":"2024-09-21T09:02:58.221187+0000","last_became_peered":"2024-09-21T09:02:58.221187+0000","last_unstale":"2024-09-21T09:05:18.459935+0000","last_undegraded":"2024-09-21T09:05:18.459935+0000","last_fullsized":"2024-09-21T09:05:18.459935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.340714+0000","last_change":"2024-09-21T09:06:20.340738+0000","last_active":"2024-09-21T09:06:20.340714+0000","last_peered":"2024-09-21T09:06:20.340714+0000","last_clean":"2024-09-21T09:06:20.340714+0000","last_became_active":"2024-09-21T09:03:02.220370+0000","last_became_peered":"2024-09-21T09:03:02.220370+0000","last_unstale":"2024-09-21T09:06:20.340714+0000","last_undegraded":"2024-09-21T09:06:20.340714+0000","last_fullsized":"2024-09-21T09:06:20.340714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:20.340586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:20.340586+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.340586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:30.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'33","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.994746+0000","last_change":"2024-09-21T09:03:04.243245+0000","last_active":"2024-09-21T09:06:12.994746+0000","last_peered":"2024-09-21T09:06:12.994746+0000","last_clean":"2024-09-21T09:06:12.994746+0000","last_became_active":"2024-09-21T09:03:04.242637+0000","last_became_peered":"2024-09-21T09:03:04.242637+0000","last_unstale":"2024-09-21T09:06:12.994746+0000","last_undegraded":"2024-09-21T09:06:12.994746+0000","last_fullsized":"2024-09-21T09:06:12.994746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.513447+0000","last_change":"2024-09-21T09:06:16.513487+0000","last_active":"2024-09-21T09:06:16.513447+0000","last_peered":"2024-09-21T09:06:16.513447+0000","last_clean":"2024-09-21T09:06:16.513447+0000","last_became_active":"2024-09-21T09:03:06.247203+0000","last_became_peered":"2024-09-21T09:03:06.247203+0000","last_unstale":"2024-09-21T09:06:16.513447+0000","last_undegraded":"2024-09-21T09:06:16.513447+0000","last_fullsized":"2024-09-21T09:06:16.513447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.513331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.513331+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.513331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:05:45.010706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.468926+0000","last_change":"2024-09-21T09:03:08.262677+0000","last_active":"2024-09-21T09:06:06.468926+0000","last_peered":"2024-09-21T09:06:06.468926+0000","last_clean":"2024-09-21T09:06:06.468926+0000","last_became_active":"2024-09-21T09:03:08.262384+0000","last_became_peered":"2024-09-21T09:03:08.262384+0000","last_unstale":"2024-09-21T09:06:06.468926+0000","last_undegraded":"2024-09-21T09:06:06.468926+0000","last_fullsized":"2024-09-21T09:06:06.468926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'8","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304828+0000","last_change":"2024-09-21T09:03:00.218848+0000","last_active":"2024-09-21T09:06:06.304828+0000","last_peered":"2024-09-21T09:06:06.304828+0000","last_clean":"2024-09-21T09:06:06.304828+0000","last_became_active":"2024-09-21T09:03:00.217658+0000","last_became_peered":"2024-09-21T09:03:00.217658+0000","last_unstale":"2024-09-21T09:06:06.304828+0000","last_undegraded":"2024-09-21T09:06:06.304828+0000","last_fullsized":"2024-09-21T09:06:06.304828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.455834+0000","last_change":"2024-09-21T09:02:58.218614+0000","last_active":"2024-09-21T09:05:17.455834+0000","last_peered":"2024-09-21T09:05:17.455834+0000","last_clean":"2024-09-21T09:05:17.455834+0000","last_became_active":"2024-09-21T09:02:58.218086+0000","last_became_peered":"2024-09-21T09:02:58.218086+0000","last_unstale":"2024-09-21T09:05:17.455834+0000","last_undegraded":"2024-09-21T09:05:17.455834+0000","last_fullsized":"2024-09-21T09:05:17.455834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456021+0000","last_change":"2024-09-21T09:03:02.220885+0000","last_active":"2024-09-21T09:05:22.456021+0000","last_peered":"2024-09-21T09:05:22.456021+0000","last_clean":"2024-09-21T09:05:22.456021+0000","last_became_active":"2024-09-21T09:03:02.220557+0000","last_became_peered":"2024-09-21T09:03:02.220557+0000","last_unstale":"2024-09-21T09:05:22.456021+0000","last_undegraded":"2024-09-21T09:05:22.456021+0000","last_fullsized":"2024-09-21T09:05:22.456021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'9","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.494942+0000","last_change":"2024-09-21T09:06:22.495014+0000","last_active":"2024-09-21T09:06:22.494942+0000","last_peered":"2024-09-21T09:06:22.494942+0000","last_clean":"2024-09-21T09:06:22.494942+0000","last_became_active":"2024-09-21T09:03:04.236037+0000","last_became_peered":"2024-09-21T09:03:04.236037+0000","last_unstale":"2024-09-21T09:06:22.494942+0000","last_undegraded":"2024-09-21T09:06:22.494942+0000","last_fullsized":"2024-09-21T09:06:22.494942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-21T09:06:22.494847+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-21T09:06:22.494847+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.494847+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:55.904900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.478799+0000","last_change":"2024-09-21T09:06:18.478831+0000","last_active":"2024-09-21T09:06:18.478799+0000","last_peered":"2024-09-21T09:06:18.478799+0000","last_clean":"2024-09-21T09:06:18.478799+0000","last_became_active":"2024-09-21T09:03:06.243901+0000","last_became_peered":"2024-09-21T09:03:06.243901+0000","last_unstale":"2024-09-21T09:06:18.478799+0000","last_undegraded":"2024-09-21T09:06:18.478799+0000","last_fullsized":"2024-09-21T09:06:18.478799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.478706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.478706+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.478706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:41.502223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:37.458160+0000","last_change":"2024-09-21T09:03:08.250364+0000","last_active":"2024-09-21T09:05:37.458160+0000","last_peered":"2024-09-21T09:05:37.458160+0000","last_clean":"2024-09-21T09:05:37.458160+0000","last_became_active":"2024-09-21T09:03:08.250029+0000","last_became_peered":"2024-09-21T09:03:08.250029+0000","last_unstale":"2024-09-21T09:05:37.458160+0000","last_undegraded":"2024-09-21T09:05:37.458160+0000","last_fullsized":"2024-09-21T09:05:37.458160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.267380+0000","last_change":"2024-09-21T09:03:00.217928+0000","last_active":"2024-09-21T09:06:06.267380+0000","last_peered":"2024-09-21T09:06:06.267380+0000","last_clean":"2024-09-21T09:06:06.267380+0000","last_became_active":"2024-09-21T09:03:00.217633+0000","last_became_peered":"2024-09-21T09:03:00.217633+0000","last_unstale":"2024-09-21T09:06:06.267380+0000","last_undegraded":"2024-09-21T09:06:06.267380+0000","last_fullsized":"2024-09-21T09:06:06.267380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.459862+0000","last_change":"2024-09-21T09:02:58.220432+0000","last_active":"2024-09-21T09:05:18.459862+0000","last_peered":"2024-09-21T09:05:18.459862+0000","last_clean":"2024-09-21T09:05:18.459862+0000","last_became_active":"2024-09-21T09:02:58.220133+0000","last_became_peered":"2024-09-21T09:02:58.220133+0000","last_unstale":"2024-09-21T09:05:18.459862+0000","last_undegraded":"2024-09-21T09:05:18.459862+0000","last_fullsized":"2024-09-21T09:05:18.459862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:27.456914+0000","last_change":"2024-09-21T09:03:02.220223+0000","last_active":"2024-09-21T09:05:27.456914+0000","last_peered":"2024-09-21T09:05:27.456914+0000","last_clean":"2024-09-21T09:05:27.456914+0000","last_became_active":"2024-09-21T09:03:02.219457+0000","last_became_peered":"2024-09-21T09:03:02.219457+0000","last_unstale":"2024-09-21T09:05:27.456914+0000","last_undegraded":"2024-09-21T09:05:27.456914+0000","last_fullsized":"2024-09-21T09:05:27.456914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.828407+0000","last_change":"2024-09-21T09:06:24.828475+0000","last_active":"2024-09-21T09:06:24.828407+0000","last_peered":"2024-09-21T09:06:24.828407+0000","last_clean":"2024-09-21T09:06:24.828407+0000","last_became_active":"2024-09-21T09:03:04.239187+0000","last_became_peered":"2024-09-21T09:03:04.239187+0000","last_unstale":"2024-09-21T09:06:24.828407+0000","last_undegraded":"2024-09-21T09:06:24.828407+0000","last_fullsized":"2024-09-21T09:06:24.828407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-21T09:06:24.828300+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-21T09:06:24.828300+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.828300+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:54.045825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'285","reported_seq":388,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:13.043119+0000","last_change":"2024-09-21T09:03:06.248028+0000","last_active":"2024-09-21T09:06:13.043119+0000","last_peered":"2024-09-21T09:06:13.043119+0000","last_clean":"2024-09-21T09:06:13.043119+0000","last_became_active":"2024-09-21T09:03:06.247441+0000","last_became_peered":"2024-09-21T09:03:06.247441+0000","last_unstale":"2024-09-21T09:06:13.043119+0000","last_undegraded":"2024-09-21T09:06:13.043119+0000","last_fullsized":"2024-09-21T09:06:13.043119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'6","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.183061+0000","last_change":"2024-09-21T09:03:08.255550+0000","last_active":"2024-09-21T09:06:06.183061+0000","last_peered":"2024-09-21T09:06:06.183061+0000","last_clean":"2024-09-21T09:06:06.183061+0000","last_became_active":"2024-09-21T09:03:08.255274+0000","last_became_peered":"2024-09-21T09:03:08.255274+0000","last_unstale":"2024-09-21T09:06:06.183061+0000","last_undegraded":"2024-09-21T09:06:06.183061+0000","last_fullsized":"2024-09-21T09:06:06.183061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.181754+0000","last_change":"2024-09-21T09:03:00.216751+0000","last_active":"2024-09-21T09:06:06.181754+0000","last_peered":"2024-09-21T09:06:06.181754+0000","last_clean":"2024-09-21T09:06:06.181754+0000","last_became_active":"2024-09-21T09:03:00.216382+0000","last_became_peered":"2024-09-21T09:03:00.216382+0000","last_unstale":"2024-09-21T09:06:06.181754+0000","last_undegraded":"2024-09-21T09:06:06.181754+0000","last_fullsized":"2024-09-21T09:06:06.181754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.456029+0000","last_change":"2024-09-21T09:02:58.210831+0000","last_active":"2024-09-21T09:05:17.456029+0000","last_peered":"2024-09-21T09:05:17.456029+0000","last_clean":"2024-09-21T09:05:17.456029+0000","last_became_active":"2024-09-21T09:02:58.210560+0000","last_became_peered":"2024-09-21T09:02:58.210560+0000","last_unstale":"2024-09-21T09:05:17.456029+0000","last_undegraded":"2024-09-21T09:05:17.456029+0000","last_fullsized":"2024-09-21T09:05:17.456029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.409747+0000","last_change":"2024-09-21T09:06:18.409771+0000","last_active":"2024-09-21T09:06:18.409747+0000","last_peered":"2024-09-21T09:06:18.409747+0000","last_clean":"2024-09-21T09:06:18.409747+0000","last_became_active":"2024-09-21T09:03:02.220551+0000","last_became_peered":"2024-09-21T09:03:02.220551+0000","last_unstale":"2024-09-21T09:06:18.409747+0000","last_undegraded":"2024-09-21T09:06:18.409747+0000","last_fullsized":"2024-09-21T09:06:18.409747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.409649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.409649+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.409649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:27:47.530462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.771634+0000","last_change":"2024-09-21T09:06:28.771672+0000","last_active":"2024-09-21T09:06:28.771634+0000","last_peered":"2024-09-21T09:06:28.771634+0000","last_clean":"2024-09-21T09:06:28.771634+0000","last_became_active":"2024-09-21T09:03:04.233848+0000","last_became_peered":"2024-09-21T09:03:04.233848+0000","last_unstale":"2024-09-21T09:06:28.771634+0000","last_undegraded":"2024-09-21T09:06:28.771634+0000","last_fullsized":"2024-09-21T09:06:28.771634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-21T09:06:28.771549+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-21T09:06:28.771549+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.771549+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:21.809857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'285","reported_seq":412,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.666749+0000","last_change":"2024-09-21T09:06:20.666787+0000","last_active":"2024-09-21T09:06:20.666749+0000","last_peered":"2024-09-21T09:06:20.666749+0000","last_clean":"2024-09-21T09:06:20.666749+0000","last_became_active":"2024-09-21T09:03:06.243576+0000","last_became_peered":"2024-09-21T09:03:06.243576+0000","last_unstale":"2024-09-21T09:06:20.666749+0000","last_undegraded":"2024-09-21T09:06:20.666749+0000","last_fullsized":"2024-09-21T09:06:20.666749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:20.666653+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:20.666653+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.666653+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:13.704961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:13.458902+0000","last_change":"2024-09-21T09:03:00.217801+0000","last_active":"2024-09-21T09:05:13.458902+0000","last_peered":"2024-09-21T09:05:13.458902+0000","last_clean":"2024-09-21T09:05:13.458902+0000","last_became_active":"2024-09-21T09:03:00.217545+0000","last_became_peered":"2024-09-21T09:03:00.217545+0000","last_unstale":"2024-09-21T09:05:13.458902+0000","last_undegraded":"2024-09-21T09:05:13.458902+0000","last_fullsized":"2024-09-21T09:05:13.458902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455345+0000","last_change":"2024-09-21T09:02:58.209991+0000","last_active":"2024-09-21T09:05:12.455345+0000","last_peered":"2024-09-21T09:05:12.455345+0000","last_clean":"2024-09-21T09:05:12.455345+0000","last_became_active":"2024-09-21T09:02:58.209712+0000","last_became_peered":"2024-09-21T09:02:58.209712+0000","last_unstale":"2024-09-21T09:05:12.455345+0000","last_undegraded":"2024-09-21T09:05:12.455345+0000","last_fullsized":"2024-09-21T09:05:12.455345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"31'2","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.322589+0000","last_change":"2024-09-21T09:06:32.322635+0000","last_active":"2024-09-21T09:06:32.322589+0000","last_peered":"2024-09-21T09:06:32.322589+0000","last_clean":"2024-09-21T09:06:32.322589+0000","last_became_active":"2024-09-21T09:03:02.220629+0000","last_became_peered":"2024-09-21T09:03:02.220629+0000","last_unstale":"2024-09-21T09:06:32.322589+0000","last_undegraded":"2024-09-21T09:06:32.322589+0000","last_fullsized":"2024-09-21T09:06:32.322589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:32.322492+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:32.322492+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.322492+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:05.196838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'51","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.776033+0000","last_change":"2024-09-21T09:06:30.776075+0000","last_active":"2024-09-21T09:06:30.776033+0000","last_peered":"2024-09-21T09:06:30.776033+0000","last_clean":"2024-09-21T09:06:30.776033+0000","last_became_active":"2024-09-21T09:03:04.232394+0000","last_became_peered":"2024-09-21T09:03:04.232394+0000","last_unstale":"2024-09-21T09:06:30.776033+0000","last_undegraded":"2024-09-21T09:06:30.776033+0000","last_fullsized":"2024-09-21T09:06:30.776033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2024-09-21T09:06:30.775947+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2024-09-21T09:06:30.775947+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.775947+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:12.569145+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.694297+0000","last_change":"2024-09-21T09:06:18.694322+0000","last_active":"2024-09-21T09:06:18.694297+0000","last_peered":"2024-09-21T09:06:18.694297+0000","last_clean":"2024-09-21T09:06:18.694297+0000","last_became_active":"2024-09-21T09:03:06.244259+0000","last_became_peered":"2024-09-21T09:03:06.244259+0000","last_unstale":"2024-09-21T09:06:18.694297+0000","last_undegraded":"2024-09-21T09:06:18.694297+0000","last_fullsized":"2024-09-21T09:06:18.694297+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.694207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.694207+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.694207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:38.655887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'3","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455232+0000","last_change":"2024-09-21T09:03:08.261530+0000","last_active":"2024-09-21T09:05:12.455232+0000","last_peered":"2024-09-21T09:05:12.455232+0000","last_clean":"2024-09-21T09:05:12.455232+0000","last_became_active":"2024-09-21T09:03:08.261035+0000","last_became_peered":"2024-09-21T09:03:08.261035+0000","last_unstale":"2024-09-21T09:05:12.455232+0000","last_undegraded":"2024-09-21T09:05:12.455232+0000","last_fullsized":"2024-09-21T09:05:12.455232+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455261+0000","last_change":"2024-09-21T09:03:00.220087+0000","last_active":"2024-09-21T09:05:12.455261+0000","last_peered":"2024-09-21T09:05:12.455261+0000","last_clean":"2024-09-21T09:05:12.455261+0000","last_became_active":"2024-09-21T09:03:00.219765+0000","last_became_peered":"2024-09-21T09:03:00.219765+0000","last_unstale":"2024-09-21T09:05:12.455261+0000","last_undegraded":"2024-09-21T09:05:12.455261+0000","last_fullsized":"2024-09-21T09:05:12.455261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455300+0000","last_change":"2024-09-21T09:02:58.214776+0000","last_active":"2024-09-21T09:05:12.455300+0000","last_peered":"2024-09-21T09:05:12.455300+0000","last_clean":"2024-09-21T09:05:12.455300+0000","last_became_active":"2024-09-21T09:02:58.214392+0000","last_became_peered":"2024-09-21T09:02:58.214392+0000","last_unstale":"2024-09-21T09:05:12.455300+0000","last_undegraded":"2024-09-21T09:05:12.455300+0000","last_fullsized":"2024-09-21T09:05:12.455300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.778703+0000","last_change":"2024-09-21T09:06:31.778729+0000","last_active":"2024-09-21T09:06:31.778703+0000","last_peered":"2024-09-21T09:06:31.778703+0000","last_clean":"2024-09-21T09:06:31.778703+0000","last_became_active":"2024-09-21T09:03:02.223123+0000","last_became_peered":"2024-09-21T09:03:02.223123+0000","last_unstale":"2024-09-21T09:06:31.778703+0000","last_undegraded":"2024-09-21T09:06:31.778703+0000","last_fullsized":"2024-09-21T09:06:31.778703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:31.778616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:31.778616+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.778616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:58.139384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'34","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.943178+0000","last_change":"2024-09-21T09:03:04.242739+0000","last_active":"2024-09-21T09:06:12.943178+0000","last_peered":"2024-09-21T09:06:12.943178+0000","last_clean":"2024-09-21T09:06:12.943178+0000","last_became_active":"2024-09-21T09:03:04.242404+0000","last_became_peered":"2024-09-21T09:03:04.242404+0000","last_unstale":"2024-09-21T09:06:12.943178+0000","last_undegraded":"2024-09-21T09:06:12.943178+0000","last_fullsized":"2024-09-21T09:06:12.943178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.680859+0000","last_change":"2024-09-21T09:06:21.680884+0000","last_active":"2024-09-21T09:06:21.680859+0000","last_peered":"2024-09-21T09:06:21.680859+0000","last_clean":"2024-09-21T09:06:21.680859+0000","last_became_active":"2024-09-21T09:03:06.247504+0000","last_became_peered":"2024-09-21T09:03:06.247504+0000","last_unstale":"2024-09-21T09:06:21.680859+0000","last_undegraded":"2024-09-21T09:06:21.680859+0000","last_fullsized":"2024-09-21T09:06:21.680859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:21.680751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:21.680751+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.680751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:07.979811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455431+0000","last_change":"2024-09-21T09:03:08.256372+0000","last_active":"2024-09-21T09:05:12.455431+0000","last_peered":"2024-09-21T09:05:12.455431+0000","last_clean":"2024-09-21T09:05:12.455431+0000","last_became_active":"2024-09-21T09:03:08.255814+0000","last_became_peered":"2024-09-21T09:03:08.255814+0000","last_unstale":"2024-09-21T09:05:12.455431+0000","last_undegraded":"2024-09-21T09:05:12.455431+0000","last_fullsized":"2024-09-21T09:05:12.455431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455175+0000","last_change":"2024-09-21T09:03:00.223110+0000","last_active":"2024-09-21T09:05:12.455175+0000","last_peered":"2024-09-21T09:05:12.455175+0000","last_clean":"2024-09-21T09:05:12.455175+0000","last_became_active":"2024-09-21T09:03:00.222650+0000","last_became_peered":"2024-09-21T09:03:00.222650+0000","last_unstale":"2024-09-21T09:05:12.455175+0000","last_undegraded":"2024-09-21T09:05:12.455175+0000","last_fullsized":"2024-09-21T09:05:12.455175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:13.459036+0000","last_change":"2024-09-21T09:02:58.213931+0000","last_active":"2024-09-21T09:05:13.459036+0000","last_peered":"2024-09-21T09:05:13.459036+0000","last_clean":"2024-09-21T09:05:13.459036+0000","last_became_active":"2024-09-21T09:02:58.213652+0000","last_became_peered":"2024-09-21T09:02:58.213652+0000","last_unstale":"2024-09-21T09:05:13.459036+0000","last_undegraded":"2024-09-21T09:05:13.459036+0000","last_fullsized":"2024-09-21T09:05:13.459036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:52.460743+0000","last_change":"2024-09-21T09:03:38.281879+0000","last_active":"2024-09-21T09:05:52.460743+0000","last_peered":"2024-09-21T09:05:52.460743+0000","last_clean":"2024-09-21T09:05:52.460743+0000","last_became_active":"2024-09-21T09:03:38.281497+0000","last_became_peered":"2024-09-21T09:03:38.281497+0000","last_unstale":"2024-09-21T09:05:52.460743+0000","last_undegraded":"2024-09-21T09:05:52.460743+0000","last_fullsized":"2024-09-21T09:05:52.460743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"31'45","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.362380+0000","last_change":"2024-09-21T09:06:25.362435+0000","last_active":"2024-09-21T09:06:25.362380+0000","last_peered":"2024-09-21T09:06:25.362380+0000","last_clean":"2024-09-21T09:06:25.362380+0000","last_became_active":"2024-09-21T09:03:04.240144+0000","last_became_peered":"2024-09-21T09:03:04.240144+0000","last_unstale":"2024-09-21T09:06:25.362380+0000","last_undegraded":"2024-09-21T09:06:25.362380+0000","last_fullsized":"2024-09-21T09:06:25.362380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-09-21T09:06:25.362285+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-09-21T09:06:25.362285+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.362285+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:00.748484+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'285","reported_seq":351,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:13.048536+0000","last_change":"2024-09-21T09:03:06.251119+0000","last_active":"2024-09-21T09:06:13.048536+0000","last_peered":"2024-09-21T09:06:13.048536+0000","last_clean":"2024-09-21T09:06:13.048536+0000","last_became_active":"2024-09-21T09:03:06.250807+0000","last_became_peered":"2024-09-21T09:03:06.250807+0000","last_unstale":"2024-09-21T09:06:13.048536+0000","last_undegraded":"2024-09-21T09:06:13.048536+0000","last_fullsized":"2024-09-21T09:06:13.048536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.455358+0000","last_change":"2024-09-21T09:03:08.250308+0000","last_active":"2024-09-21T09:05:17.455358+0000","last_peered":"2024-09-21T09:05:17.455358+0000","last_clean":"2024-09-21T09:05:17.455358+0000","last_became_active":"2024-09-21T09:03:08.250063+0000","last_became_peered":"2024-09-21T09:03:08.250063+0000","last_unstale":"2024-09-21T09:05:17.455358+0000","last_undegraded":"2024-09-21T09:05:17.455358+0000","last_fullsized":"2024-09-21T09:05:17.455358+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'14","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.092187+0000","last_change":"2024-09-21T09:03:00.217929+0000","last_active":"2024-09-21T09:06:06.092187+0000","last_peered":"2024-09-21T09:06:06.092187+0000","last_clean":"2024-09-21T09:06:06.092187+0000","last_became_active":"2024-09-21T09:03:00.216544+0000","last_became_peered":"2024-09-21T09:03:00.216544+0000","last_unstale":"2024-09-21T09:06:06.092187+0000","last_undegraded":"2024-09-21T09:06:06.092187+0000","last_fullsized":"2024-09-21T09:06:06.092187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:13.458994+0000","last_change":"2024-09-21T09:02:58.224993+0000","last_active":"2024-09-21T09:05:13.458994+0000","last_peered":"2024-09-21T09:05:13.458994+0000","last_clean":"2024-09-21T09:05:13.458994+0000","last_became_active":"2024-09-21T09:02:58.224675+0000","last_became_peered":"2024-09-21T09:02:58.224675+0000","last_unstale":"2024-09-21T09:05:13.458994+0000","last_undegraded":"2024-09-21T09:05:13.458994+0000","last_fullsized":"2024-09-21T09:05:13.458994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.454539+0000","last_change":"2024-09-21T09:03:02.223199+0000","last_active":"2024-09-21T09:05:12.454539+0000","last_peered":"2024-09-21T09:05:12.454539+0000","last_clean":"2024-09-21T09:05:12.454539+0000","last_became_active":"2024-09-21T09:03:02.222904+0000","last_became_peered":"2024-09-21T09:03:02.222904+0000","last_unstale":"2024-09-21T09:05:12.454539+0000","last_undegraded":"2024-09-21T09:05:12.454539+0000","last_fullsized":"2024-09-21T09:05:12.454539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'62","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:13.018078+0000","last_change":"2024-09-21T09:03:04.241974+0000","last_active":"2024-09-21T09:06:13.018078+0000","last_peered":"2024-09-21T09:06:13.018078+0000","last_clean":"2024-09-21T09:06:13.018078+0000","last_became_active":"2024-09-21T09:03:04.241679+0000","last_became_peered":"2024-09-21T09:03:04.241679+0000","last_unstale":"2024-09-21T09:06:13.018078+0000","last_undegraded":"2024-09-21T09:06:13.018078+0000","last_fullsized":"2024-09-21T09:06:13.018078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.455225+0000","last_change":"2024-09-21T09:03:06.249590+0000","last_active":"2024-09-21T09:05:17.455225+0000","last_peered":"2024-09-21T09:05:17.455225+0000","last_clean":"2024-09-21T09:05:17.455225+0000","last_became_active":"2024-09-21T09:03:06.249377+0000","last_became_peered":"2024-09-21T09:03:06.249377+0000","last_unstale":"2024-09-21T09:05:17.455225+0000","last_undegraded":"2024-09-21T09:05:17.455225+0000","last_fullsized":"2024-09-21T09:05:17.455225+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'22","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.459659+0000","last_change":"2024-09-21T09:03:08.260431+0000","last_active":"2024-09-21T09:06:06.459659+0000","last_peered":"2024-09-21T09:06:06.459659+0000","last_clean":"2024-09-21T09:06:06.459659+0000","last_became_active":"2024-09-21T09:03:08.260071+0000","last_became_peered":"2024-09-21T09:03:08.260071+0000","last_unstale":"2024-09-21T09:06:06.459659+0000","last_undegraded":"2024-09-21T09:06:06.459659+0000","last_fullsized":"2024-09-21T09:06:06.459659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.456204+0000","last_change":"2024-09-21T09:03:00.223450+0000","last_active":"2024-09-21T09:05:17.456204+0000","last_peered":"2024-09-21T09:05:17.456204+0000","last_clean":"2024-09-21T09:05:17.456204+0000","last_became_active":"2024-09-21T09:03:00.223184+0000","last_became_peered":"2024-09-21T09:03:00.223184+0000","last_unstale":"2024-09-21T09:05:17.456204+0000","last_undegraded":"2024-09-21T09:05:17.456204+0000","last_fullsized":"2024-09-21T09:05:17.456204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.454561+0000","last_change":"2024-09-21T09:02:58.216900+0000","last_active":"2024-09-21T09:05:12.454561+0000","last_peered":"2024-09-21T09:05:12.454561+0000","last_clean":"2024-09-21T09:05:12.454561+0000","last_became_active":"2024-09-21T09:02:58.216545+0000","last_became_peered":"2024-09-21T09:02:58.216545+0000","last_unstale":"2024-09-21T09:05:12.454561+0000","last_undegraded":"2024-09-21T09:05:12.454561+0000","last_fullsized":"2024-09-21T09:05:12.454561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.455924+0000","last_change":"2024-09-21T09:03:02.221720+0000","last_active":"2024-09-21T09:05:17.455924+0000","last_peered":"2024-09-21T09:05:17.455924+0000","last_clean":"2024-09-21T09:05:17.455924+0000","last_became_active":"2024-09-21T09:03:02.221352+0000","last_became_peered":"2024-09-21T09:03:02.221352+0000","last_unstale":"2024-09-21T09:05:17.455924+0000","last_undegraded":"2024-09-21T09:05:17.455924+0000","last_fullsized":"2024-09-21T09:05:17.455924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'39","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.403363+0000","last_change":"2024-09-21T09:06:25.403421+0000","last_active":"2024-09-21T09:06:25.403363+0000","last_peered":"2024-09-21T09:06:25.403363+0000","last_clean":"2024-09-21T09:06:25.403363+0000","last_became_active":"2024-09-21T09:03:04.234750+0000","last_became_peered":"2024-09-21T09:03:04.234750+0000","last_unstale":"2024-09-21T09:06:25.403363+0000","last_undegraded":"2024-09-21T09:06:25.403363+0000","last_fullsized":"2024-09-21T09:06:25.403363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-21T09:06:25.403243+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-21T09:06:25.403243+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.403243+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:10.523882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460797+0000","last_change":"2024-09-21T09:03:06.248717+0000","last_active":"2024-09-21T09:05:23.460797+0000","last_peered":"2024-09-21T09:05:23.460797+0000","last_clean":"2024-09-21T09:05:23.460797+0000","last_became_active":"2024-09-21T09:03:06.248453+0000","last_became_peered":"2024-09-21T09:03:06.248453+0000","last_unstale":"2024-09-21T09:05:23.460797+0000","last_undegraded":"2024-09-21T09:05:23.460797+0000","last_fullsized":"2024-09-21T09:05:23.460797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.416855+0000","last_change":"2024-09-21T09:03:08.260732+0000","last_active":"2024-09-21T09:06:06.416855+0000","last_peered":"2024-09-21T09:06:06.416855+0000","last_clean":"2024-09-21T09:06:06.416855+0000","last_became_active":"2024-09-21T09:03:08.260016+0000","last_became_peered":"2024-09-21T09:03:08.260016+0000","last_unstale":"2024-09-21T09:06:06.416855+0000","last_undegraded":"2024-09-21T09:06:06.416855+0000","last_fullsized":"2024-09-21T09:06:06.416855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'10","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.370284+0000","last_change":"2024-09-21T09:03:00.221963+0000","last_active":"2024-09-21T09:06:06.370284+0000","last_peered":"2024-09-21T09:06:06.370284+0000","last_clean":"2024-09-21T09:06:06.370284+0000","last_became_active":"2024-09-21T09:03:00.220384+0000","last_became_peered":"2024-09-21T09:03:00.220384+0000","last_unstale":"2024-09-21T09:06:06.370284+0000","last_undegraded":"2024-09-21T09:06:06.370284+0000","last_fullsized":"2024-09-21T09:06:06.370284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458165+0000","last_change":"2024-09-21T09:02:58.214415+0000","last_active":"2024-09-21T09:05:08.458165+0000","last_peered":"2024-09-21T09:05:08.458165+0000","last_clean":"2024-09-21T09:05:08.458165+0000","last_became_active":"2024-09-21T09:02:58.213920+0000","last_became_peered":"2024-09-21T09:02:58.213920+0000","last_unstale":"2024-09-21T09:05:08.458165+0000","last_undegraded":"2024-09-21T09:05:08.458165+0000","last_fullsized":"2024-09-21T09:05:08.458165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.455327+0000","last_change":"2024-09-21T09:03:02.220182+0000","last_active":"2024-09-21T09:05:17.455327+0000","last_peered":"2024-09-21T09:05:17.455327+0000","last_clean":"2024-09-21T09:05:17.455327+0000","last_became_active":"2024-09-21T09:03:02.217917+0000","last_became_peered":"2024-09-21T09:03:02.217917+0000","last_unstale":"2024-09-21T09:05:17.455327+0000","last_undegraded":"2024-09-21T09:05:17.455327+0000","last_fullsized":"2024-09-21T09:05:17.455327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.798062+0000","last_change":"2024-09-21T09:06:26.798098+0000","last_active":"2024-09-21T09:06:26.798062+0000","last_peered":"2024-09-21T09:06:26.798062+0000","last_clean":"2024-09-21T09:06:26.798062+0000","last_became_active":"2024-09-21T09:03:04.235199+0000","last_became_peered":"2024-09-21T09:03:04.235199+0000","last_unstale":"2024-09-21T09:06:26.798062+0000","last_undegraded":"2024-09-21T09:06:26.798062+0000","last_fullsized":"2024-09-21T09:06:26.798062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-21T09:06:26.797980+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-21T09:06:26.797980+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.797980+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:46.759660+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'285","reported_seq":414,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.872442+0000","last_change":"2024-09-21T09:06:19.872473+0000","last_active":"2024-09-21T09:06:19.872442+0000","last_peered":"2024-09-21T09:06:19.872442+0000","last_clean":"2024-09-21T09:06:19.872442+0000","last_became_active":"2024-09-21T09:03:06.245904+0000","last_became_peered":"2024-09-21T09:03:06.245904+0000","last_unstale":"2024-09-21T09:06:19.872442+0000","last_undegraded":"2024-09-21T09:06:19.872442+0000","last_fullsized":"2024-09-21T09:06:19.872442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:19.872353+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:19.872353+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.872353+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:08.095534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.419249+0000","last_change":"2024-09-21T09:03:08.253968+0000","last_active":"2024-09-21T09:06:06.419249+0000","last_peered":"2024-09-21T09:06:06.419249+0000","last_clean":"2024-09-21T09:06:06.419249+0000","last_became_active":"2024-09-21T09:03:08.253648+0000","last_became_peered":"2024-09-21T09:03:08.253648+0000","last_unstale":"2024-09-21T09:06:06.419249+0000","last_undegraded":"2024-09-21T09:06:06.419249+0000","last_fullsized":"2024-09-21T09:06:06.419249+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'5","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.414129+0000","last_change":"2024-09-21T09:03:00.225003+0000","last_active":"2024-09-21T09:06:06.414129+0000","last_peered":"2024-09-21T09:06:06.414129+0000","last_clean":"2024-09-21T09:06:06.414129+0000","last_became_active":"2024-09-21T09:03:00.222983+0000","last_became_peered":"2024-09-21T09:03:00.222983+0000","last_unstale":"2024-09-21T09:06:06.414129+0000","last_undegraded":"2024-09-21T09:06:06.414129+0000","last_fullsized":"2024-09-21T09:06:06.414129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458099+0000","last_change":"2024-09-21T09:02:58.222294+0000","last_active":"2024-09-21T09:05:08.458099+0000","last_peered":"2024-09-21T09:05:08.458099+0000","last_clean":"2024-09-21T09:05:08.458099+0000","last_became_active":"2024-09-21T09:02:58.221805+0000","last_became_peered":"2024-09-21T09:02:58.221805+0000","last_unstale":"2024-09-21T09:05:08.458099+0000","last_undegraded":"2024-09-21T09:05:08.458099+0000","last_fullsized":"2024-09-21T09:05:08.458099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'5","reported_seq":428,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.332881+0000","last_change":"2024-09-21T09:06:29.332947+0000","last_active":"2024-09-21T09:06:29.332881+0000","last_peered":"2024-09-21T09:06:29.332881+0000","last_clean":"2024-09-21T09:06:29.332881+0000","last_became_active":"2024-09-21T09:03:02.222002+0000","last_became_peered":"2024-09-21T09:03:02.222002+0000","last_unstale":"2024-09-21T09:06:29.332881+0000","last_undegraded":"2024-09-21T09:06:29.332881+0000","last_fullsized":"2024-09-21T09:06:29.332881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-21T09:06:29.332773+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-21T09:06:29.332773+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.332773+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:09.966077+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.459969+0000","last_change":"2024-09-21T09:03:04.243079+0000","last_active":"2024-09-21T09:05:18.459969+0000","last_peered":"2024-09-21T09:05:18.459969+0000","last_clean":"2024-09-21T09:05:18.459969+0000","last_became_active":"2024-09-21T09:03:04.242702+0000","last_became_peered":"2024-09-21T09:03:04.242702+0000","last_unstale":"2024-09-21T09:05:18.459969+0000","last_undegraded":"2024-09-21T09:05:18.459969+0000","last_fullsized":"2024-09-21T09:05:18.459969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'285","reported_seq":476,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.472438+0000","last_change":"2024-09-21T09:06:23.472499+0000","last_active":"2024-09-21T09:06:23.472438+0000","last_peered":"2024-09-21T09:06:23.472438+0000","last_clean":"2024-09-21T09:06:23.472438+0000","last_became_active":"2024-09-21T09:03:06.248991+0000","last_became_peered":"2024-09-21T09:03:06.248991+0000","last_unstale":"2024-09-21T09:06:23.472438+0000","last_undegraded":"2024-09-21T09:06:23.472438+0000","last_fullsized":"2024-09-21T09:06:23.472438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:23.472342+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:23.472342+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.472342+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:12:45.159682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.737124+0000","last_change":"2024-09-21T09:06:29.737148+0000","last_active":"2024-09-21T09:06:29.737124+0000","last_peered":"2024-09-21T09:06:29.737124+0000","last_clean":"2024-09-21T09:06:29.737124+0000","last_became_active":"2024-09-21T09:03:08.252549+0000","last_became_peered":"2024-09-21T09:03:08.252549+0000","last_unstale":"2024-09-21T09:06:29.737124+0000","last_undegraded":"2024-09-21T09:06:29.737124+0000","last_fullsized":"2024-09-21T09:06:29.737124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:29.737036+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:29.737036+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.737036+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:16.036097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.267285+0000","last_change":"2024-09-21T09:03:00.223988+0000","last_active":"2024-09-21T09:06:06.267285+0000","last_peered":"2024-09-21T09:06:06.267285+0000","last_clean":"2024-09-21T09:06:06.267285+0000","last_became_active":"2024-09-21T09:03:00.223719+0000","last_became_peered":"2024-09-21T09:03:00.223719+0000","last_unstale":"2024-09-21T09:06:06.267285+0000","last_undegraded":"2024-09-21T09:06:06.267285+0000","last_fullsized":"2024-09-21T09:06:06.267285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458055+0000","last_change":"2024-09-21T09:02:58.214335+0000","last_active":"2024-09-21T09:05:08.458055+0000","last_peered":"2024-09-21T09:05:08.458055+0000","last_clean":"2024-09-21T09:05:08.458055+0000","last_became_active":"2024-09-21T09:02:58.214074+0000","last_became_peered":"2024-09-21T09:02:58.214074+0000","last_unstale":"2024-09-21T09:05:08.458055+0000","last_undegraded":"2024-09-21T09:05:08.458055+0000","last_fullsized":"2024-09-21T09:05:08.458055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.434384+0000","last_change":"2024-09-21T09:06:17.434407+0000","last_active":"2024-09-21T09:06:17.434384+0000","last_peered":"2024-09-21T09:06:17.434384+0000","last_clean":"2024-09-21T09:06:17.434384+0000","last_became_active":"2024-09-21T09:03:02.222095+0000","last_became_peered":"2024-09-21T09:03:02.222095+0000","last_unstale":"2024-09-21T09:06:17.434384+0000","last_undegraded":"2024-09-21T09:06:17.434384+0000","last_fullsized":"2024-09-21T09:06:17.434384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.434249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.434249+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.434249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:39.005942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'48","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.432681+0000","last_change":"2024-09-21T09:06:24.432715+0000","last_active":"2024-09-21T09:06:24.432681+0000","last_peered":"2024-09-21T09:06:24.432681+0000","last_clean":"2024-09-21T09:06:24.432681+0000","last_became_active":"2024-09-21T09:03:04.235633+0000","last_became_peered":"2024-09-21T09:03:04.235633+0000","last_unstale":"2024-09-21T09:06:24.432681+0000","last_undegraded":"2024-09-21T09:06:24.432681+0000","last_fullsized":"2024-09-21T09:06:24.432681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-09-21T09:06:24.432601+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-09-21T09:06:24.432601+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.432601+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:09.424036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.767356+0000","last_change":"2024-09-21T09:06:16.767379+0000","last_active":"2024-09-21T09:06:16.767356+0000","last_peered":"2024-09-21T09:06:16.767356+0000","last_clean":"2024-09-21T09:06:16.767356+0000","last_became_active":"2024-09-21T09:03:06.247977+0000","last_became_peered":"2024-09-21T09:03:06.247977+0000","last_unstale":"2024-09-21T09:06:16.767356+0000","last_undegraded":"2024-09-21T09:06:16.767356+0000","last_fullsized":"2024-09-21T09:06:16.767356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.767232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.767232+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.767232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:11.816433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.332895+0000","last_change":"2024-09-21T09:06:31.332932+0000","last_active":"2024-09-21T09:06:31.332895+0000","last_peered":"2024-09-21T09:06:31.332895+0000","last_clean":"2024-09-21T09:06:31.332895+0000","last_became_active":"2024-09-21T09:03:08.251985+0000","last_became_peered":"2024-09-21T09:03:08.251985+0000","last_unstale":"2024-09-21T09:06:31.332895+0000","last_undegraded":"2024-09-21T09:06:31.332895+0000","last_fullsized":"2024-09-21T09:06:31.332895+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:31.332791+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:31.332791+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.332791+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:00.603145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.089873+0000","last_change":"2024-09-21T09:03:00.221674+0000","last_active":"2024-09-21T09:06:06.089873+0000","last_peered":"2024-09-21T09:06:06.089873+0000","last_clean":"2024-09-21T09:06:06.089873+0000","last_became_active":"2024-09-21T09:03:00.219428+0000","last_became_peered":"2024-09-21T09:03:00.219428+0000","last_unstale":"2024-09-21T09:06:06.089873+0000","last_undegraded":"2024-09-21T09:06:06.089873+0000","last_fullsized":"2024-09-21T09:06:06.089873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":202,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:47.451646+0000","last_change":"2024-09-21T09:02:44.107999+0000","last_active":"2024-09-21T09:04:47.451646+0000","last_peered":"2024-09-21T09:04:47.451646+0000","last_clean":"2024-09-21T09:04:47.451646+0000","last_became_active":"2024-09-21T09:02:44.107052+0000","last_became_peered":"2024-09-21T09:02:44.107052+0000","last_unstale":"2024-09-21T09:04:47.451646+0000","last_undegraded":"2024-09-21T09:04:47.451646+0000","last_fullsized":"2024-09-21T09:04:47.451646+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_clean_scrub_stamp":"2024-09-21T09:02:42.466256+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:58.456535+0000","last_change":"2024-09-21T09:02:51.501401+0000","last_active":"2024-09-21T09:04:58.456535+0000","last_peered":"2024-09-21T09:04:58.456535+0000","last_clean":"2024-09-21T09:04:58.456535+0000","last_became_active":"2024-09-21T09:02:49.492504+0000","last_became_peered":"2024-09-21T09:02:49.492504+0000","last_unstale":"2024-09-21T09:04:58.456535+0000","last_undegraded":"2024-09-21T09:04:58.456535+0000","last_fullsized":"2024-09-21T09:04:58.456535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001229291,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:03.457177+0000","last_change":"2024-09-21T09:02:58.222148+0000","last_active":"2024-09-21T09:05:03.457177+0000","last_peered":"2024-09-21T09:05:03.457177+0000","last_clean":"2024-09-21T09:05:03.457177+0000","last_became_active":"2024-09-21T09:02:58.221874+0000","last_became_peered":"2024-09-21T09:02:58.221874+0000","last_unstale":"2024-09-21T09:05:03.457177+0000","last_undegraded":"2024-09-21T09:05:03.457177+0000","last_fullsized":"2024-09-21T09:05:03.457177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.454544+0000","last_change":"2024-09-21T09:03:38.280004+0000","last_active":"2024-09-21T09:05:07.454544+0000","last_peered":"2024-09-21T09:05:07.454544+0000","last_clean":"2024-09-21T09:05:07.454544+0000","last_became_active":"2024-09-21T09:03:38.279694+0000","last_became_peered":"2024-09-21T09:03:38.279694+0000","last_unstale":"2024-09-21T09:05:07.454544+0000","last_undegraded":"2024-09-21T09:05:07.454544+0000","last_fullsized":"2024-09-21T09:05:07.454544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'87","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.362494+0000","last_change":"2024-09-21T09:06:23.362531+0000","last_active":"2024-09-21T09:06:23.362494+0000","last_peered":"2024-09-21T09:06:23.362494+0000","last_clean":"2024-09-21T09:06:23.362494+0000","last_became_active":"2024-09-21T09:03:04.240327+0000","last_became_peered":"2024-09-21T09:03:04.240327+0000","last_unstale":"2024-09-21T09:06:23.362494+0000","last_undegraded":"2024-09-21T09:06:23.362494+0000","last_fullsized":"2024-09-21T09:06:23.362494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2024-09-21T09:06:23.362409+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2024-09-21T09:06:23.362409+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.362409+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:12.872538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.754019+0000","last_change":"2024-09-21T09:06:16.754043+0000","last_active":"2024-09-21T09:06:16.754019+0000","last_peered":"2024-09-21T09:06:16.754019+0000","last_clean":"2024-09-21T09:06:16.754019+0000","last_became_active":"2024-09-21T09:03:06.247593+0000","last_became_peered":"2024-09-21T09:03:06.247593+0000","last_unstale":"2024-09-21T09:06:16.754019+0000","last_undegraded":"2024-09-21T09:06:16.754019+0000","last_fullsized":"2024-09-21T09:06:16.754019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.753939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.753939+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.753939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:45.971463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'83","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.853304+0000","last_change":"2024-09-21T09:06:21.853332+0000","last_active":"2024-09-21T09:06:21.853304+0000","last_peered":"2024-09-21T09:06:21.853304+0000","last_clean":"2024-09-21T09:06:21.853304+0000","last_became_active":"2024-09-21T09:03:08.251416+0000","last_became_peered":"2024-09-21T09:03:08.251416+0000","last_unstale":"2024-09-21T09:06:21.853304+0000","last_undegraded":"2024-09-21T09:06:21.853304+0000","last_fullsized":"2024-09-21T09:06:21.853304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'83","last_scrub_stamp":"2024-09-21T09:06:21.853181+0000","last_deep_scrub":"31'83","last_deep_scrub_stamp":"2024-09-21T09:06:21.853181+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.853181+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:35.867187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:13.459087+0000","last_change":"2024-09-21T09:03:00.217299+0000","last_active":"2024-09-21T09:05:13.459087+0000","last_peered":"2024-09-21T09:05:13.459087+0000","last_clean":"2024-09-21T09:05:13.459087+0000","last_became_active":"2024-09-21T09:03:00.217018+0000","last_became_peered":"2024-09-21T09:03:00.217018+0000","last_unstale":"2024-09-21T09:05:13.459087+0000","last_undegraded":"2024-09-21T09:05:13.459087+0000","last_fullsized":"2024-09-21T09:05:13.459087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:53.455542+0000","last_change":"2024-09-21T09:02:51.500609+0000","last_active":"2024-09-21T09:04:53.455542+0000","last_peered":"2024-09-21T09:04:53.455542+0000","last_clean":"2024-09-21T09:04:53.455542+0000","last_became_active":"2024-09-21T09:02:49.493239+0000","last_became_peered":"2024-09-21T09:02:49.493239+0000","last_unstale":"2024-09-21T09:04:53.455542+0000","last_undegraded":"2024-09-21T09:04:53.455542+0000","last_fullsized":"2024-09-21T09:04:53.455542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046437600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453059+0000","last_change":"2024-09-21T09:02:58.209258+0000","last_active":"2024-09-21T09:05:02.453059+0000","last_peered":"2024-09-21T09:05:02.453059+0000","last_clean":"2024-09-21T09:05:02.453059+0000","last_became_active":"2024-09-21T09:02:58.208819+0000","last_became_peered":"2024-09-21T09:02:58.208819+0000","last_unstale":"2024-09-21T09:05:02.453059+0000","last_undegraded":"2024-09-21T09:05:02.453059+0000","last_fullsized":"2024-09-21T09:05:02.453059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.385967+0000","last_change":"2024-09-21T09:06:19.385992+0000","last_active":"2024-09-21T09:06:19.385967+0000","last_peered":"2024-09-21T09:06:19.385967+0000","last_clean":"2024-09-21T09:06:19.385967+0000","last_became_active":"2024-09-21T09:03:02.220903+0000","last_became_peered":"2024-09-21T09:03:02.220903+0000","last_unstale":"2024-09-21T09:06:19.385967+0000","last_undegraded":"2024-09-21T09:06:19.385967+0000","last_fullsized":"2024-09-21T09:06:19.385967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.385871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.385871+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.385871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:53.002346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'290","reported_seq":514,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.477114+0000","last_change":"2024-09-21T09:06:21.477160+0000","last_active":"2024-09-21T09:06:21.477114+0000","last_peered":"2024-09-21T09:06:21.477114+0000","last_clean":"2024-09-21T09:06:21.477114+0000","last_became_active":"2024-09-21T09:03:04.240433+0000","last_became_peered":"2024-09-21T09:03:04.240433+0000","last_unstale":"2024-09-21T09:06:21.477114+0000","last_undegraded":"2024-09-21T09:06:21.477114+0000","last_fullsized":"2024-09-21T09:06:21.477114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'290","last_scrub_stamp":"2024-09-21T09:06:21.477013+0000","last_deep_scrub":"31'290","last_deep_scrub_stamp":"2024-09-21T09:06:21.477013+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.477013+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:50.761111+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:13.459021+0000","last_change":"2024-09-21T09:03:06.248226+0000","last_active":"2024-09-21T09:05:13.459021+0000","last_peered":"2024-09-21T09:05:13.459021+0000","last_clean":"2024-09-21T09:05:13.459021+0000","last_became_active":"2024-09-21T09:03:06.247746+0000","last_became_peered":"2024-09-21T09:03:06.247746+0000","last_unstale":"2024-09-21T09:05:13.459021+0000","last_undegraded":"2024-09-21T09:05:13.459021+0000","last_fullsized":"2024-09-21T09:05:13.459021+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.305903+0000","last_change":"2024-09-21T09:03:08.259029+0000","last_active":"2024-09-21T09:06:06.305903+0000","last_peered":"2024-09-21T09:06:06.305903+0000","last_clean":"2024-09-21T09:06:06.305903+0000","last_became_active":"2024-09-21T09:03:08.258104+0000","last_became_peered":"2024-09-21T09:03:08.258104+0000","last_unstale":"2024-09-21T09:06:06.305903+0000","last_undegraded":"2024-09-21T09:06:06.305903+0000","last_fullsized":"2024-09-21T09:06:06.305903+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.454653+0000","last_change":"2024-09-21T09:03:00.227553+0000","last_active":"2024-09-21T09:05:12.454653+0000","last_peered":"2024-09-21T09:05:12.454653+0000","last_clean":"2024-09-21T09:05:12.454653+0000","last_became_active":"2024-09-21T09:03:00.227191+0000","last_became_peered":"2024-09-21T09:03:00.227191+0000","last_unstale":"2024-09-21T09:05:12.454653+0000","last_undegraded":"2024-09-21T09:05:12.454653+0000","last_fullsized":"2024-09-21T09:05:12.454653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:57.452836+0000","last_change":"2024-09-21T09:02:51.506704+0000","last_active":"2024-09-21T09:04:57.452836+0000","last_peered":"2024-09-21T09:04:57.452836+0000","last_clean":"2024-09-21T09:04:57.452836+0000","last_became_active":"2024-09-21T09:02:49.493605+0000","last_became_peered":"2024-09-21T09:02:49.493605+0000","last_unstale":"2024-09-21T09:04:57.452836+0000","last_undegraded":"2024-09-21T09:04:57.452836+0000","last_fullsized":"2024-09-21T09:04:57.452836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033020199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:57.452297+0000","last_change":"2024-09-21T09:02:58.209627+0000","last_active":"2024-09-21T09:04:57.452297+0000","last_peered":"2024-09-21T09:04:57.452297+0000","last_clean":"2024-09-21T09:04:57.452297+0000","last_became_active":"2024-09-21T09:02:58.209343+0000","last_became_peered":"2024-09-21T09:02:58.209343+0000","last_unstale":"2024-09-21T09:04:57.452297+0000","last_undegraded":"2024-09-21T09:04:57.452297+0000","last_fullsized":"2024-09-21T09:04:57.452297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455310+0000","last_change":"2024-09-21T09:03:02.219332+0000","last_active":"2024-09-21T09:05:12.455310+0000","last_peered":"2024-09-21T09:05:12.455310+0000","last_clean":"2024-09-21T09:05:12.455310+0000","last_became_active":"2024-09-21T09:03:02.219067+0000","last_became_peered":"2024-09-21T09:03:02.219067+0000","last_unstale":"2024-09-21T09:05:12.455310+0000","last_undegraded":"2024-09-21T09:05:12.455310+0000","last_fullsized":"2024-09-21T09:05:12.455310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'17","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.495791+0000","last_change":"2024-09-21T09:03:04.231010+0000","last_active":"2024-09-21T09:06:06.495791+0000","last_peered":"2024-09-21T09:06:06.495791+0000","last_clean":"2024-09-21T09:06:06.495791+0000","last_became_active":"2024-09-21T09:03:04.230686+0000","last_became_peered":"2024-09-21T09:03:04.230686+0000","last_unstale":"2024-09-21T09:06:06.495791+0000","last_undegraded":"2024-09-21T09:06:06.495791+0000","last_fullsized":"2024-09-21T09:06:06.495791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.712950+0000","last_change":"2024-09-21T09:06:25.712994+0000","last_active":"2024-09-21T09:06:25.712950+0000","last_peered":"2024-09-21T09:06:25.712950+0000","last_clean":"2024-09-21T09:06:25.712950+0000","last_became_active":"2024-09-21T09:03:06.248087+0000","last_became_peered":"2024-09-21T09:03:06.248087+0000","last_unstale":"2024-09-21T09:06:25.712950+0000","last_undegraded":"2024-09-21T09:06:25.712950+0000","last_fullsized":"2024-09-21T09:06:25.712950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:25.712851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:25.712851+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.712851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:31.193094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460679+0000","last_change":"2024-09-21T09:03:08.259295+0000","last_active":"2024-09-21T09:05:23.460679+0000","last_peered":"2024-09-21T09:05:23.460679+0000","last_clean":"2024-09-21T09:05:23.460679+0000","last_became_active":"2024-09-21T09:03:08.258974+0000","last_became_peered":"2024-09-21T09:03:08.258974+0000","last_unstale":"2024-09-21T09:05:23.460679+0000","last_undegraded":"2024-09-21T09:05:23.460679+0000","last_fullsized":"2024-09-21T09:05:23.460679+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'7","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.413836+0000","last_change":"2024-09-21T09:03:00.221607+0000","last_active":"2024-09-21T09:06:06.413836+0000","last_peered":"2024-09-21T09:06:06.413836+0000","last_clean":"2024-09-21T09:06:06.413836+0000","last_became_active":"2024-09-21T09:03:00.221080+0000","last_became_peered":"2024-09-21T09:03:00.221080+0000","last_unstale":"2024-09-21T09:06:06.413836+0000","last_undegraded":"2024-09-21T09:06:06.413836+0000","last_fullsized":"2024-09-21T09:06:06.413836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:58.456481+0000","last_change":"2024-09-21T09:02:51.501105+0000","last_active":"2024-09-21T09:04:58.456481+0000","last_peered":"2024-09-21T09:04:58.456481+0000","last_clean":"2024-09-21T09:04:58.456481+0000","last_became_active":"2024-09-21T09:02:49.493348+0000","last_became_peered":"2024-09-21T09:02:49.493348+0000","last_unstale":"2024-09-21T09:04:58.456481+0000","last_undegraded":"2024-09-21T09:04:58.456481+0000","last_fullsized":"2024-09-21T09:04:58.456481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096028300000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453422+0000","last_change":"2024-09-21T09:02:58.207996+0000","last_active":"2024-09-21T09:05:02.453422+0000","last_peered":"2024-09-21T09:05:02.453422+0000","last_clean":"2024-09-21T09:05:02.453422+0000","last_became_active":"2024-09-21T09:02:58.207236+0000","last_became_peered":"2024-09-21T09:02:58.207236+0000","last_unstale":"2024-09-21T09:05:02.453422+0000","last_undegraded":"2024-09-21T09:05:02.453422+0000","last_fullsized":"2024-09-21T09:05:02.453422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453886+0000","last_change":"2024-09-21T09:03:02.221735+0000","last_active":"2024-09-21T09:05:07.453886+0000","last_peered":"2024-09-21T09:05:07.453886+0000","last_clean":"2024-09-21T09:05:07.453886+0000","last_became_active":"2024-09-21T09:03:02.221310+0000","last_became_peered":"2024-09-21T09:03:02.221310+0000","last_unstale":"2024-09-21T09:05:07.453886+0000","last_undegraded":"2024-09-21T09:05:07.453886+0000","last_fullsized":"2024-09-21T09:05:07.453886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'13","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:05.744909+0000","last_change":"2024-09-21T09:03:04.243723+0000","last_active":"2024-09-21T09:06:05.744909+0000","last_peered":"2024-09-21T09:06:05.744909+0000","last_clean":"2024-09-21T09:06:05.744909+0000","last_became_active":"2024-09-21T09:03:04.243076+0000","last_became_peered":"2024-09-21T09:03:04.243076+0000","last_unstale":"2024-09-21T09:06:05.744909+0000","last_undegraded":"2024-09-21T09:06:05.744909+0000","last_fullsized":"2024-09-21T09:06:05.744909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.460048+0000","last_change":"2024-09-21T09:03:06.250792+0000","last_active":"2024-09-21T09:05:18.460048+0000","last_peered":"2024-09-21T09:05:18.460048+0000","last_clean":"2024-09-21T09:05:18.460048+0000","last_became_active":"2024-09-21T09:03:06.250530+0000","last_became_peered":"2024-09-21T09:03:06.250530+0000","last_unstale":"2024-09-21T09:05:18.460048+0000","last_undegraded":"2024-09-21T09:05:18.460048+0000","last_fullsized":"2024-09-21T09:05:18.460048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.456066+0000","last_change":"2024-09-21T09:03:08.262588+0000","last_active":"2024-09-21T09:05:17.456066+0000","last_peered":"2024-09-21T09:05:17.456066+0000","last_clean":"2024-09-21T09:05:17.456066+0000","last_became_active":"2024-09-21T09:03:08.262240+0000","last_became_peered":"2024-09-21T09:03:08.262240+0000","last_unstale":"2024-09-21T09:05:17.456066+0000","last_undegraded":"2024-09-21T09:05:17.456066+0000","last_fullsized":"2024-09-21T09:05:17.456066+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.370434+0000","last_change":"2024-09-21T09:03:00.227032+0000","last_active":"2024-09-21T09:06:06.370434+0000","last_peered":"2024-09-21T09:06:06.370434+0000","last_clean":"2024-09-21T09:06:06.370434+0000","last_became_active":"2024-09-21T09:03:00.224297+0000","last_became_peered":"2024-09-21T09:03:00.224297+0000","last_unstale":"2024-09-21T09:06:06.370434+0000","last_undegraded":"2024-09-21T09:06:06.370434+0000","last_fullsized":"2024-09-21T09:06:06.370434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453460+0000","last_change":"2024-09-21T09:02:58.207055+0000","last_active":"2024-09-21T09:05:02.453460+0000","last_peered":"2024-09-21T09:05:02.453460+0000","last_clean":"2024-09-21T09:05:02.453460+0000","last_became_active":"2024-09-21T09:02:58.206718+0000","last_became_peered":"2024-09-21T09:02:58.206718+0000","last_unstale":"2024-09-21T09:05:02.453460+0000","last_undegraded":"2024-09-21T09:05:02.453460+0000","last_fullsized":"2024-09-21T09:05:02.453460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:57.452385+0000","last_change":"2024-09-21T09:02:51.498275+0000","last_active":"2024-09-21T09:04:57.452385+0000","last_peered":"2024-09-21T09:04:57.452385+0000","last_clean":"2024-09-21T09:04:57.452385+0000","last_became_active":"2024-09-21T09:02:49.493509+0000","last_became_peered":"2024-09-21T09:02:49.493509+0000","last_unstale":"2024-09-21T09:04:57.452385+0000","last_undegraded":"2024-09-21T09:04:57.452385+0000","last_fullsized":"2024-09-21T09:04:57.452385+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038981200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.885840+0000","last_change":"2024-09-21T09:03:02.221871+0000","last_active":"2024-09-21T09:06:12.885840+0000","last_peered":"2024-09-21T09:06:12.885840+0000","last_clean":"2024-09-21T09:06:12.885840+0000","last_became_active":"2024-09-21T09:03:02.221309+0000","last_became_peered":"2024-09-21T09:03:02.221309+0000","last_unstale":"2024-09-21T09:06:12.885840+0000","last_undegraded":"2024-09-21T09:06:12.885840+0000","last_fullsized":"2024-09-21T09:06:12.885840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'73","reported_seq":149,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.721482+0000","last_change":"2024-09-21T09:06:23.721519+0000","last_active":"2024-09-21T09:06:23.721482+0000","last_peered":"2024-09-21T09:06:23.721482+0000","last_clean":"2024-09-21T09:06:23.721482+0000","last_became_active":"2024-09-21T09:03:04.243228+0000","last_became_peered":"2024-09-21T09:03:04.243228+0000","last_unstale":"2024-09-21T09:06:23.721482+0000","last_undegraded":"2024-09-21T09:06:23.721482+0000","last_fullsized":"2024-09-21T09:06:23.721482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2024-09-21T09:06:23.721394+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2024-09-21T09:06:23.721394+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.721394+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:53.684792+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.826592+0000","last_change":"2024-09-21T09:06:18.826638+0000","last_active":"2024-09-21T09:06:18.826592+0000","last_peered":"2024-09-21T09:06:18.826592+0000","last_clean":"2024-09-21T09:06:18.826592+0000","last_became_active":"2024-09-21T09:03:06.246598+0000","last_became_peered":"2024-09-21T09:03:06.246598+0000","last_unstale":"2024-09-21T09:06:18.826592+0000","last_undegraded":"2024-09-21T09:06:18.826592+0000","last_fullsized":"2024-09-21T09:06:18.826592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.826477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.826477+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.826477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:07.103764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456055+0000","last_change":"2024-09-21T09:03:08.251063+0000","last_active":"2024-09-21T09:05:22.456055+0000","last_peered":"2024-09-21T09:05:22.456055+0000","last_clean":"2024-09-21T09:05:22.456055+0000","last_became_active":"2024-09-21T09:03:08.250714+0000","last_became_peered":"2024-09-21T09:03:08.250714+0000","last_unstale":"2024-09-21T09:05:22.456055+0000","last_undegraded":"2024-09-21T09:05:22.456055+0000","last_fullsized":"2024-09-21T09:05:22.456055+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'10","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.181705+0000","last_change":"2024-09-21T09:03:38.286969+0000","last_active":"2024-09-21T09:06:06.181705+0000","last_peered":"2024-09-21T09:06:06.181705+0000","last_clean":"2024-09-21T09:06:06.181705+0000","last_became_active":"2024-09-21T09:03:38.282889+0000","last_became_peered":"2024-09-21T09:03:38.282889+0000","last_unstale":"2024-09-21T09:06:06.181705+0000","last_undegraded":"2024-09-21T09:06:06.181705+0000","last_fullsized":"2024-09-21T09:06:06.181705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453138+0000","last_change":"2024-09-21T09:02:58.208957+0000","last_active":"2024-09-21T09:05:02.453138+0000","last_peered":"2024-09-21T09:05:02.453138+0000","last_clean":"2024-09-21T09:05:02.453138+0000","last_became_active":"2024-09-21T09:02:58.208569+0000","last_became_peered":"2024-09-21T09:02:58.208569+0000","last_unstale":"2024-09-21T09:05:02.453138+0000","last_undegraded":"2024-09-21T09:05:02.453138+0000","last_fullsized":"2024-09-21T09:05:02.453138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:58.456579+0000","last_change":"2024-09-21T09:02:51.501475+0000","last_active":"2024-09-21T09:04:58.456579+0000","last_peered":"2024-09-21T09:04:58.456579+0000","last_clean":"2024-09-21T09:04:58.456579+0000","last_became_active":"2024-09-21T09:02:49.493469+0000","last_became_peered":"2024-09-21T09:02:49.493469+0000","last_unstale":"2024-09-21T09:04:58.456579+0000","last_undegraded":"2024-09-21T09:04:58.456579+0000","last_fullsized":"2024-09-21T09:04:58.456579+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001228114,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.353318+0000","last_change":"2024-09-21T09:06:26.353354+0000","last_active":"2024-09-21T09:06:26.353318+0000","last_peered":"2024-09-21T09:06:26.353318+0000","last_clean":"2024-09-21T09:06:26.353318+0000","last_became_active":"2024-09-21T09:03:02.218232+0000","last_became_peered":"2024-09-21T09:03:02.218232+0000","last_unstale":"2024-09-21T09:06:26.353318+0000","last_undegraded":"2024-09-21T09:06:26.353318+0000","last_fullsized":"2024-09-21T09:06:26.353318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:26.353187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:26.353187+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.353187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:04.665812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'21","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.503937+0000","last_change":"2024-09-21T09:06:20.504016+0000","last_active":"2024-09-21T09:06:20.503937+0000","last_peered":"2024-09-21T09:06:20.503937+0000","last_clean":"2024-09-21T09:06:20.503937+0000","last_became_active":"2024-09-21T09:03:04.241500+0000","last_became_peered":"2024-09-21T09:03:04.241500+0000","last_unstale":"2024-09-21T09:06:20.503937+0000","last_undegraded":"2024-09-21T09:06:20.503937+0000","last_fullsized":"2024-09-21T09:06:20.503937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-09-21T09:06:20.503834+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-09-21T09:06:20.503834+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.503834+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:54.738751+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'285","reported_seq":366,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.375728+0000","last_change":"2024-09-21T09:06:27.375756+0000","last_active":"2024-09-21T09:06:27.375728+0000","last_peered":"2024-09-21T09:06:27.375728+0000","last_clean":"2024-09-21T09:06:27.375728+0000","last_became_active":"2024-09-21T09:03:06.249303+0000","last_became_peered":"2024-09-21T09:03:06.249303+0000","last_unstale":"2024-09-21T09:06:27.375728+0000","last_undegraded":"2024-09-21T09:06:27.375728+0000","last_fullsized":"2024-09-21T09:06:27.375728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:27.375647+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:27.375647+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.375647+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:46.869896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460788+0000","last_change":"2024-09-21T09:03:08.264861+0000","last_active":"2024-09-21T09:05:23.460788+0000","last_peered":"2024-09-21T09:05:23.460788+0000","last_clean":"2024-09-21T09:05:23.460788+0000","last_became_active":"2024-09-21T09:03:08.264322+0000","last_became_peered":"2024-09-21T09:03:08.264322+0000","last_unstale":"2024-09-21T09:05:23.460788+0000","last_undegraded":"2024-09-21T09:05:23.460788+0000","last_fullsized":"2024-09-21T09:05:23.460788+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:37.458764+0000","last_change":"2024-09-21T09:03:38.277961+0000","last_active":"2024-09-21T09:05:37.458764+0000","last_peered":"2024-09-21T09:05:37.458764+0000","last_clean":"2024-09-21T09:05:37.458764+0000","last_became_active":"2024-09-21T09:03:38.277629+0000","last_became_peered":"2024-09-21T09:03:38.277629+0000","last_unstale":"2024-09-21T09:05:37.458764+0000","last_undegraded":"2024-09-21T09:05:37.458764+0000","last_fullsized":"2024-09-21T09:05:37.458764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458272+0000","last_change":"2024-09-21T09:02:58.223891+0000","last_active":"2024-09-21T09:05:08.458272+0000","last_peered":"2024-09-21T09:05:08.458272+0000","last_clean":"2024-09-21T09:05:08.458272+0000","last_became_active":"2024-09-21T09:02:58.223652+0000","last_became_peered":"2024-09-21T09:02:58.223652+0000","last_unstale":"2024-09-21T09:05:08.458272+0000","last_undegraded":"2024-09-21T09:05:08.458272+0000","last_fullsized":"2024-09-21T09:05:08.458272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453181+0000","last_change":"2024-09-21T09:02:51.498192+0000","last_active":"2024-09-21T09:05:02.453181+0000","last_peered":"2024-09-21T09:05:02.453181+0000","last_clean":"2024-09-21T09:05:02.453181+0000","last_became_active":"2024-09-21T09:02:49.493144+0000","last_became_peered":"2024-09-21T09:02:49.493144+0000","last_unstale":"2024-09-21T09:05:02.453181+0000","last_undegraded":"2024-09-21T09:05:02.453181+0000","last_fullsized":"2024-09-21T09:05:02.453181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042500699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.311183+0000","last_change":"2024-09-21T09:06:24.311245+0000","last_active":"2024-09-21T09:06:24.311183+0000","last_peered":"2024-09-21T09:06:24.311183+0000","last_clean":"2024-09-21T09:06:24.311183+0000","last_became_active":"2024-09-21T09:03:02.219133+0000","last_became_peered":"2024-09-21T09:03:02.219133+0000","last_unstale":"2024-09-21T09:06:24.311183+0000","last_undegraded":"2024-09-21T09:06:24.311183+0000","last_fullsized":"2024-09-21T09:06:24.311183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:24.311064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:24.311064+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.311064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:35.086372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.279984+0000","last_change":"2024-09-21T09:06:33.280030+0000","last_active":"2024-09-21T09:06:33.279984+0000","last_peered":"2024-09-21T09:06:33.279984+0000","last_clean":"2024-09-21T09:06:33.279984+0000","last_became_active":"2024-09-21T09:03:04.241256+0000","last_became_peered":"2024-09-21T09:03:04.241256+0000","last_unstale":"2024-09-21T09:06:33.279984+0000","last_undegraded":"2024-09-21T09:06:33.279984+0000","last_fullsized":"2024-09-21T09:06:33.279984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-21T09:06:33.279879+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-21T09:06:33.279879+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.279879+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:01.162062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'285","reported_seq":440,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.712945+0000","last_change":"2024-09-21T09:06:22.713004+0000","last_active":"2024-09-21T09:06:22.712945+0000","last_peered":"2024-09-21T09:06:22.712945+0000","last_clean":"2024-09-21T09:06:22.712945+0000","last_became_active":"2024-09-21T09:03:06.243566+0000","last_became_peered":"2024-09-21T09:03:06.243566+0000","last_unstale":"2024-09-21T09:06:22.712945+0000","last_undegraded":"2024-09-21T09:06:22.712945+0000","last_fullsized":"2024-09-21T09:06:22.712945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:22.712831+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:22.712831+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.712831+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:04.506029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456988+0000","last_change":"2024-09-21T09:03:08.262736+0000","last_active":"2024-09-21T09:05:22.456988+0000","last_peered":"2024-09-21T09:05:22.456988+0000","last_clean":"2024-09-21T09:05:22.456988+0000","last_became_active":"2024-09-21T09:03:08.262460+0000","last_became_peered":"2024-09-21T09:03:08.262460+0000","last_unstale":"2024-09-21T09:05:22.456988+0000","last_undegraded":"2024-09-21T09:05:22.456988+0000","last_fullsized":"2024-09-21T09:05:22.456988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'14","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.089803+0000","last_change":"2024-09-21T09:03:00.218617+0000","last_active":"2024-09-21T09:06:06.089803+0000","last_peered":"2024-09-21T09:06:06.089803+0000","last_clean":"2024-09-21T09:06:06.089803+0000","last_became_active":"2024-09-21T09:03:00.216782+0000","last_became_peered":"2024-09-21T09:03:00.216782+0000","last_unstale":"2024-09-21T09:06:06.089803+0000","last_undegraded":"2024-09-21T09:06:06.089803+0000","last_fullsized":"2024-09-21T09:06:06.089803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.454589+0000","last_change":"2024-09-21T09:02:58.213576+0000","last_active":"2024-09-21T09:05:07.454589+0000","last_peered":"2024-09-21T09:05:07.454589+0000","last_clean":"2024-09-21T09:05:07.454589+0000","last_became_active":"2024-09-21T09:02:58.213293+0000","last_became_peered":"2024-09-21T09:02:58.213293+0000","last_unstale":"2024-09-21T09:05:07.454589+0000","last_undegraded":"2024-09-21T09:05:07.454589+0000","last_fullsized":"2024-09-21T09:05:07.454589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:03.457297+0000","last_change":"2024-09-21T09:02:51.501161+0000","last_active":"2024-09-21T09:05:03.457297+0000","last_peered":"2024-09-21T09:05:03.457297+0000","last_clean":"2024-09-21T09:05:03.457297+0000","last_became_active":"2024-09-21T09:02:49.542160+0000","last_became_peered":"2024-09-21T09:02:49.542160+0000","last_unstale":"2024-09-21T09:05:03.457297+0000","last_undegraded":"2024-09-21T09:05:03.457297+0000","last_fullsized":"2024-09-21T09:05:03.457297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099618800000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.306980+0000","last_change":"2024-09-21T09:06:27.307002+0000","last_active":"2024-09-21T09:06:27.306980+0000","last_peered":"2024-09-21T09:06:27.306980+0000","last_clean":"2024-09-21T09:06:27.306980+0000","last_became_active":"2024-09-21T09:03:02.218138+0000","last_became_peered":"2024-09-21T09:03:02.218138+0000","last_unstale":"2024-09-21T09:06:27.306980+0000","last_undegraded":"2024-09-21T09:06:27.306980+0000","last_fullsized":"2024-09-21T09:06:27.306980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:27.306889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:27.306889+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.306889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:50.637433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'98","reported_seq":191,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.794064+0000","last_change":"2024-09-21T09:06:31.794110+0000","last_active":"2024-09-21T09:06:31.794064+0000","last_peered":"2024-09-21T09:06:31.794064+0000","last_clean":"2024-09-21T09:06:31.794064+0000","last_became_active":"2024-09-21T09:03:04.231708+0000","last_became_peered":"2024-09-21T09:03:04.231708+0000","last_unstale":"2024-09-21T09:06:31.794064+0000","last_undegraded":"2024-09-21T09:06:31.794064+0000","last_fullsized":"2024-09-21T09:06:31.794064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2024-09-21T09:06:31.793976+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2024-09-21T09:06:31.793976+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.793976+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:01.757375+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":98,"num_read_kb":92,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.454528+0000","last_change":"2024-09-21T09:03:06.249786+0000","last_active":"2024-09-21T09:05:12.454528+0000","last_peered":"2024-09-21T09:05:12.454528+0000","last_clean":"2024-09-21T09:05:12.454528+0000","last_became_active":"2024-09-21T09:03:06.249474+0000","last_became_peered":"2024-09-21T09:03:06.249474+0000","last_unstale":"2024-09-21T09:05:12.454528+0000","last_undegraded":"2024-09-21T09:05:12.454528+0000","last_fullsized":"2024-09-21T09:05:12.454528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.780683+0000","last_change":"2024-09-21T09:06:25.780707+0000","last_active":"2024-09-21T09:06:25.780683+0000","last_peered":"2024-09-21T09:06:25.780683+0000","last_clean":"2024-09-21T09:06:25.780683+0000","last_became_active":"2024-09-21T09:03:08.252363+0000","last_became_peered":"2024-09-21T09:03:08.252363+0000","last_unstale":"2024-09-21T09:06:25.780683+0000","last_undegraded":"2024-09-21T09:06:25.780683+0000","last_fullsized":"2024-09-21T09:06:25.780683+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:25.780594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:25.780594+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.780594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:37.186890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455320+0000","last_change":"2024-09-21T09:03:08.256842+0000","last_active":"2024-09-21T09:05:12.455320+0000","last_peered":"2024-09-21T09:05:12.455320+0000","last_clean":"2024-09-21T09:05:12.455320+0000","last_became_active":"2024-09-21T09:03:08.256571+0000","last_became_peered":"2024-09-21T09:03:08.256571+0000","last_unstale":"2024-09-21T09:05:12.455320+0000","last_undegraded":"2024-09-21T09:05:12.455320+0000","last_fullsized":"2024-09-21T09:05:12.455320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'12","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456617+0000","last_change":"2024-09-21T09:03:38.470029+0000","last_active":"2024-09-21T09:05:22.456617+0000","last_peered":"2024-09-21T09:05:22.456617+0000","last_clean":"2024-09-21T09:05:22.456617+0000","last_became_active":"2024-09-21T09:03:38.466274+0000","last_became_peered":"2024-09-21T09:03:38.466274+0000","last_unstale":"2024-09-21T09:05:22.456617+0000","last_undegraded":"2024-09-21T09:05:22.456617+0000","last_fullsized":"2024-09-21T09:05:22.456617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.459960+0000","last_change":"2024-09-21T09:02:58.221038+0000","last_active":"2024-09-21T09:05:18.459960+0000","last_peered":"2024-09-21T09:05:18.459960+0000","last_clean":"2024-09-21T09:05:18.459960+0000","last_became_active":"2024-09-21T09:02:58.220716+0000","last_became_peered":"2024-09-21T09:02:58.220716+0000","last_unstale":"2024-09-21T09:05:18.459960+0000","last_undegraded":"2024-09-21T09:05:18.459960+0000","last_fullsized":"2024-09-21T09:05:18.459960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456936+0000","last_change":"2024-09-21T09:03:02.220312+0000","last_active":"2024-09-21T09:05:22.456936+0000","last_peered":"2024-09-21T09:05:22.456936+0000","last_clean":"2024-09-21T09:05:22.456936+0000","last_became_active":"2024-09-21T09:03:02.219652+0000","last_became_peered":"2024-09-21T09:03:02.219652+0000","last_unstale":"2024-09-21T09:05:22.456936+0000","last_undegraded":"2024-09-21T09:05:22.456936+0000","last_fullsized":"2024-09-21T09:05:22.456936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'35","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:13.009800+0000","last_change":"2024-09-21T09:03:04.241932+0000","last_active":"2024-09-21T09:06:13.009800+0000","last_peered":"2024-09-21T09:06:13.009800+0000","last_clean":"2024-09-21T09:06:13.009800+0000","last_became_active":"2024-09-21T09:03:04.241612+0000","last_became_peered":"2024-09-21T09:03:04.241612+0000","last_unstale":"2024-09-21T09:06:13.009800+0000","last_undegraded":"2024-09-21T09:06:13.009800+0000","last_fullsized":"2024-09-21T09:06:13.009800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:28.461355+0000","last_change":"2024-09-21T09:03:06.251100+0000","last_active":"2024-09-21T09:05:28.461355+0000","last_peered":"2024-09-21T09:05:28.461355+0000","last_clean":"2024-09-21T09:05:28.461355+0000","last_became_active":"2024-09-21T09:03:06.250750+0000","last_became_peered":"2024-09-21T09:03:06.250750+0000","last_unstale":"2024-09-21T09:05:28.461355+0000","last_undegraded":"2024-09-21T09:05:28.461355+0000","last_fullsized":"2024-09-21T09:05:28.461355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'11","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453899+0000","last_change":"2024-09-21T09:03:08.259980+0000","last_active":"2024-09-21T09:05:07.453899+0000","last_peered":"2024-09-21T09:05:07.453899+0000","last_clean":"2024-09-21T09:05:07.453899+0000","last_became_active":"2024-09-21T09:03:08.259602+0000","last_became_peered":"2024-09-21T09:03:08.259602+0000","last_unstale":"2024-09-21T09:05:07.453899+0000","last_undegraded":"2024-09-21T09:05:07.453899+0000","last_fullsized":"2024-09-21T09:05:07.453899+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456951+0000","last_change":"2024-09-21T09:03:00.227394+0000","last_active":"2024-09-21T09:05:22.456951+0000","last_peered":"2024-09-21T09:05:22.456951+0000","last_clean":"2024-09-21T09:05:22.456951+0000","last_became_active":"2024-09-21T09:03:00.225811+0000","last_became_peered":"2024-09-21T09:03:00.225811+0000","last_unstale":"2024-09-21T09:05:22.456951+0000","last_undegraded":"2024-09-21T09:05:22.456951+0000","last_fullsized":"2024-09-21T09:05:22.456951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456671+0000","last_change":"2024-09-21T09:03:38.280883+0000","last_active":"2024-09-21T09:05:22.456671+0000","last_peered":"2024-09-21T09:05:22.456671+0000","last_clean":"2024-09-21T09:05:22.456671+0000","last_became_active":"2024-09-21T09:03:38.280539+0000","last_became_peered":"2024-09-21T09:03:38.280539+0000","last_unstale":"2024-09-21T09:05:22.456671+0000","last_undegraded":"2024-09-21T09:05:22.456671+0000","last_fullsized":"2024-09-21T09:05:22.456671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.390070+0000","last_change":"2024-09-21T09:06:21.390097+0000","last_active":"2024-09-21T09:06:21.390070+0000","last_peered":"2024-09-21T09:06:21.390070+0000","last_clean":"2024-09-21T09:06:21.390070+0000","last_became_active":"2024-09-21T09:03:02.222474+0000","last_became_peered":"2024-09-21T09:03:02.222474+0000","last_unstale":"2024-09-21T09:06:21.390070+0000","last_undegraded":"2024-09-21T09:06:21.390070+0000","last_fullsized":"2024-09-21T09:06:21.390070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:21.389982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:21.389982+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.389982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:19.738715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'9","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.747218+0000","last_change":"2024-09-21T09:06:30.747258+0000","last_active":"2024-09-21T09:06:30.747218+0000","last_peered":"2024-09-21T09:06:30.747218+0000","last_clean":"2024-09-21T09:06:30.747218+0000","last_became_active":"2024-09-21T09:03:04.232474+0000","last_became_peered":"2024-09-21T09:03:04.232474+0000","last_unstale":"2024-09-21T09:06:30.747218+0000","last_undegraded":"2024-09-21T09:06:30.747218+0000","last_fullsized":"2024-09-21T09:06:30.747218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-21T09:06:30.747132+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-21T09:06:30.747132+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.747132+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:13:40.597960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.808656+0000","last_change":"2024-09-21T09:06:17.808683+0000","last_active":"2024-09-21T09:06:17.808656+0000","last_peered":"2024-09-21T09:06:17.808656+0000","last_clean":"2024-09-21T09:06:17.808656+0000","last_became_active":"2024-09-21T09:03:06.250773+0000","last_became_peered":"2024-09-21T09:03:06.250773+0000","last_unstale":"2024-09-21T09:06:17.808656+0000","last_undegraded":"2024-09-21T09:06:17.808656+0000","last_fullsized":"2024-09-21T09:06:17.808656+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.808555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.808555+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.808555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.180280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:37.458230+0000","last_change":"2024-09-21T09:03:08.250971+0000","last_active":"2024-09-21T09:05:37.458230+0000","last_peered":"2024-09-21T09:05:37.458230+0000","last_clean":"2024-09-21T09:05:37.458230+0000","last_became_active":"2024-09-21T09:03:08.250617+0000","last_became_peered":"2024-09-21T09:03:08.250617+0000","last_unstale":"2024-09-21T09:05:37.458230+0000","last_undegraded":"2024-09-21T09:05:37.458230+0000","last_fullsized":"2024-09-21T09:05:37.458230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'14","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.370632+0000","last_change":"2024-09-21T09:03:00.216088+0000","last_active":"2024-09-21T09:06:06.370632+0000","last_peered":"2024-09-21T09:06:06.370632+0000","last_clean":"2024-09-21T09:06:06.370632+0000","last_became_active":"2024-09-21T09:03:00.215591+0000","last_became_peered":"2024-09-21T09:03:00.215591+0000","last_unstale":"2024-09-21T09:06:06.370632+0000","last_undegraded":"2024-09-21T09:06:06.370632+0000","last_fullsized":"2024-09-21T09:06:06.370632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.253555+0000","last_change":"2024-09-21T09:02:58.218920+0000","last_active":"2024-09-21T09:06:06.253555+0000","last_peered":"2024-09-21T09:06:06.253555+0000","last_clean":"2024-09-21T09:06:06.253555+0000","last_became_active":"2024-09-21T09:02:58.217931+0000","last_became_peered":"2024-09-21T09:02:58.217931+0000","last_unstale":"2024-09-21T09:06:06.253555+0000","last_undegraded":"2024-09-21T09:06:06.253555+0000","last_fullsized":"2024-09-21T09:06:06.253555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456561+0000","last_change":"2024-09-21T09:03:02.219569+0000","last_active":"2024-09-21T09:05:22.456561+0000","last_peered":"2024-09-21T09:05:22.456561+0000","last_clean":"2024-09-21T09:05:22.456561+0000","last_became_active":"2024-09-21T09:03:02.219265+0000","last_became_peered":"2024-09-21T09:03:02.219265+0000","last_unstale":"2024-09-21T09:05:22.456561+0000","last_undegraded":"2024-09-21T09:05:22.456561+0000","last_fullsized":"2024-09-21T09:05:22.456561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'47","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.702301+0000","last_change":"2024-09-21T09:06:28.702348+0000","last_active":"2024-09-21T09:06:28.702301+0000","last_peered":"2024-09-21T09:06:28.702301+0000","last_clean":"2024-09-21T09:06:28.702301+0000","last_became_active":"2024-09-21T09:03:04.233393+0000","last_became_peered":"2024-09-21T09:03:04.233393+0000","last_unstale":"2024-09-21T09:06:28.702301+0000","last_undegraded":"2024-09-21T09:06:28.702301+0000","last_fullsized":"2024-09-21T09:06:28.702301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-09-21T09:06:28.702205+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-09-21T09:06:28.702205+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.702205+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:15.159343+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.509490+0000","last_change":"2024-09-21T09:06:19.509511+0000","last_active":"2024-09-21T09:06:19.509490+0000","last_peered":"2024-09-21T09:06:19.509490+0000","last_clean":"2024-09-21T09:06:19.509490+0000","last_became_active":"2024-09-21T09:03:06.248954+0000","last_became_peered":"2024-09-21T09:03:06.248954+0000","last_unstale":"2024-09-21T09:06:19.509490+0000","last_undegraded":"2024-09-21T09:06:19.509490+0000","last_fullsized":"2024-09-21T09:06:19.509490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.509370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.509370+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.509370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:08.185733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:38.462905+0000","last_change":"2024-09-21T09:03:08.265248+0000","last_active":"2024-09-21T09:05:38.462905+0000","last_peered":"2024-09-21T09:05:38.462905+0000","last_clean":"2024-09-21T09:05:38.462905+0000","last_became_active":"2024-09-21T09:03:08.264778+0000","last_became_peered":"2024-09-21T09:03:08.264778+0000","last_unstale":"2024-09-21T09:05:38.462905+0000","last_undegraded":"2024-09-21T09:05:38.462905+0000","last_fullsized":"2024-09-21T09:05:38.462905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460578+0000","last_change":"2024-09-21T09:03:00.218521+0000","last_active":"2024-09-21T09:05:23.460578+0000","last_peered":"2024-09-21T09:05:23.460578+0000","last_clean":"2024-09-21T09:05:23.460578+0000","last_became_active":"2024-09-21T09:03:00.218259+0000","last_became_peered":"2024-09-21T09:03:00.218259+0000","last_unstale":"2024-09-21T09:05:23.460578+0000","last_undegraded":"2024-09-21T09:05:23.460578+0000","last_fullsized":"2024-09-21T09:05:23.460578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.361149+0000","last_change":"2024-09-21T09:02:58.207817+0000","last_active":"2024-09-21T09:06:06.361149+0000","last_peered":"2024-09-21T09:06:06.361149+0000","last_clean":"2024-09-21T09:06:06.361149+0000","last_became_active":"2024-09-21T09:02:58.207533+0000","last_became_peered":"2024-09-21T09:02:58.207533+0000","last_unstale":"2024-09-21T09:06:06.361149+0000","last_undegraded":"2024-09-21T09:06:06.361149+0000","last_fullsized":"2024-09-21T09:06:06.361149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.403941+0000","last_change":"2024-09-21T09:06:22.403985+0000","last_active":"2024-09-21T09:06:22.403941+0000","last_peered":"2024-09-21T09:06:22.403941+0000","last_clean":"2024-09-21T09:06:22.403941+0000","last_became_active":"2024-09-21T09:03:02.219509+0000","last_became_peered":"2024-09-21T09:03:02.219509+0000","last_unstale":"2024-09-21T09:06:22.403941+0000","last_undegraded":"2024-09-21T09:06:22.403941+0000","last_fullsized":"2024-09-21T09:06:22.403941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:22.403839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:22.403839+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.403839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:58.125850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.809789+0000","last_change":"2024-09-21T09:06:27.809828+0000","last_active":"2024-09-21T09:06:27.809789+0000","last_peered":"2024-09-21T09:06:27.809789+0000","last_clean":"2024-09-21T09:06:27.809789+0000","last_became_active":"2024-09-21T09:03:04.233913+0000","last_became_peered":"2024-09-21T09:03:04.233913+0000","last_unstale":"2024-09-21T09:06:27.809789+0000","last_undegraded":"2024-09-21T09:06:27.809789+0000","last_fullsized":"2024-09-21T09:06:27.809789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-21T09:06:27.809708+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-21T09:06:27.809708+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.809708+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:02.044625+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.801339+0000","last_change":"2024-09-21T09:06:23.801364+0000","last_active":"2024-09-21T09:06:23.801339+0000","last_peered":"2024-09-21T09:06:23.801339+0000","last_clean":"2024-09-21T09:06:23.801339+0000","last_became_active":"2024-09-21T09:03:06.240791+0000","last_became_peered":"2024-09-21T09:03:06.240791+0000","last_unstale":"2024-09-21T09:06:23.801339+0000","last_undegraded":"2024-09-21T09:06:23.801339+0000","last_fullsized":"2024-09-21T09:06:23.801339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:23.801250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:23.801250+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.801250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:35.380708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.267403+0000","last_change":"2024-09-21T09:03:00.216592+0000","last_active":"2024-09-21T09:06:06.267403+0000","last_peered":"2024-09-21T09:06:06.267403+0000","last_clean":"2024-09-21T09:06:06.267403+0000","last_became_active":"2024-09-21T09:03:00.216319+0000","last_became_peered":"2024-09-21T09:03:00.216319+0000","last_unstale":"2024-09-21T09:06:06.267403+0000","last_undegraded":"2024-09-21T09:06:06.267403+0000","last_fullsized":"2024-09-21T09:06:06.267403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460553+0000","last_change":"2024-09-21T09:02:58.214752+0000","last_active":"2024-09-21T09:05:23.460553+0000","last_peered":"2024-09-21T09:05:23.460553+0000","last_clean":"2024-09-21T09:05:23.460553+0000","last_became_active":"2024-09-21T09:02:58.214494+0000","last_became_peered":"2024-09-21T09:02:58.214494+0000","last_unstale":"2024-09-21T09:05:23.460553+0000","last_undegraded":"2024-09-21T09:05:23.460553+0000","last_fullsized":"2024-09-21T09:05:23.460553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"31'4","reported_seq":229,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.875085+0000","last_change":"2024-09-21T09:03:02.222025+0000","last_active":"2024-09-21T09:06:12.875085+0000","last_peered":"2024-09-21T09:06:12.875085+0000","last_clean":"2024-09-21T09:06:12.875085+0000","last_became_active":"2024-09-21T09:03:02.221586+0000","last_became_peered":"2024-09-21T09:03:02.221586+0000","last_unstale":"2024-09-21T09:06:12.875085+0000","last_undegraded":"2024-09-21T09:06:12.875085+0000","last_fullsized":"2024-09-21T09:06:12.875085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'64","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.682081+0000","last_change":"2024-09-21T09:06:27.682121+0000","last_active":"2024-09-21T09:06:27.682081+0000","last_peered":"2024-09-21T09:06:27.682081+0000","last_clean":"2024-09-21T09:06:27.682081+0000","last_became_active":"2024-09-21T09:03:04.233734+0000","last_became_peered":"2024-09-21T09:03:04.233734+0000","last_unstale":"2024-09-21T09:06:27.682081+0000","last_undegraded":"2024-09-21T09:06:27.682081+0000","last_fullsized":"2024-09-21T09:06:27.682081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'64","last_scrub_stamp":"2024-09-21T09:06:27.681989+0000","last_deep_scrub":"31'64","last_deep_scrub_stamp":"2024-09-21T09:06:27.681989+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.681989+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:55.221898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.819887+0000","last_change":"2024-09-21T09:06:22.819910+0000","last_active":"2024-09-21T09:06:22.819887+0000","last_peered":"2024-09-21T09:06:22.819887+0000","last_clean":"2024-09-21T09:06:22.819887+0000","last_became_active":"2024-09-21T09:03:06.240975+0000","last_became_peered":"2024-09-21T09:03:06.240975+0000","last_unstale":"2024-09-21T09:06:22.819887+0000","last_undegraded":"2024-09-21T09:06:22.819887+0000","last_fullsized":"2024-09-21T09:06:22.819887+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:22.819794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:22.819794+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.819794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:09.790058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'18","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.367488+0000","last_change":"2024-09-21T09:03:08.254283+0000","last_active":"2024-09-21T09:06:06.367488+0000","last_peered":"2024-09-21T09:06:06.367488+0000","last_clean":"2024-09-21T09:06:06.367488+0000","last_became_active":"2024-09-21T09:03:08.253904+0000","last_became_peered":"2024-09-21T09:03:08.253904+0000","last_unstale":"2024-09-21T09:06:06.367488+0000","last_undegraded":"2024-09-21T09:06:06.367488+0000","last_fullsized":"2024-09-21T09:06:06.367488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.181481+0000","last_change":"2024-09-21T09:03:00.216793+0000","last_active":"2024-09-21T09:06:06.181481+0000","last_peered":"2024-09-21T09:06:06.181481+0000","last_clean":"2024-09-21T09:06:06.181481+0000","last_became_active":"2024-09-21T09:03:00.216238+0000","last_became_peered":"2024-09-21T09:03:00.216238+0000","last_unstale":"2024-09-21T09:06:06.181481+0000","last_undegraded":"2024-09-21T09:06:06.181481+0000","last_fullsized":"2024-09-21T09:06:06.181481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.969833+0000","last_change":"2024-09-21T09:02:58.207174+0000","last_active":"2024-09-21T09:06:12.969833+0000","last_peered":"2024-09-21T09:06:12.969833+0000","last_clean":"2024-09-21T09:06:12.969833+0000","last_became_active":"2024-09-21T09:02:58.206879+0000","last_became_peered":"2024-09-21T09:02:58.206879+0000","last_unstale":"2024-09-21T09:06:12.969833+0000","last_undegraded":"2024-09-21T09:06:12.969833+0000","last_fullsized":"2024-09-21T09:06:12.969833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.454227+0000","last_change":"2024-09-21T09:03:02.218652+0000","last_active":"2024-09-21T09:05:07.454227+0000","last_peered":"2024-09-21T09:05:07.454227+0000","last_clean":"2024-09-21T09:05:07.454227+0000","last_became_active":"2024-09-21T09:03:02.218381+0000","last_became_peered":"2024-09-21T09:03:02.218381+0000","last_unstale":"2024-09-21T09:05:07.454227+0000","last_undegraded":"2024-09-21T09:05:07.454227+0000","last_fullsized":"2024-09-21T09:05:07.454227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.290474+0000","last_change":"2024-09-21T09:06:29.290517+0000","last_active":"2024-09-21T09:06:29.290474+0000","last_peered":"2024-09-21T09:06:29.290474+0000","last_clean":"2024-09-21T09:06:29.290474+0000","last_became_active":"2024-09-21T09:03:04.240933+0000","last_became_peered":"2024-09-21T09:03:04.240933+0000","last_unstale":"2024-09-21T09:06:29.290474+0000","last_undegraded":"2024-09-21T09:06:29.290474+0000","last_fullsized":"2024-09-21T09:06:29.290474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-21T09:06:29.290368+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-21T09:06:29.290368+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.290368+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:29.068806+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.475284+0000","last_change":"2024-09-21T09:06:17.475308+0000","last_active":"2024-09-21T09:06:17.475284+0000","last_peered":"2024-09-21T09:06:17.475284+0000","last_clean":"2024-09-21T09:06:17.475284+0000","last_became_active":"2024-09-21T09:03:06.247153+0000","last_became_peered":"2024-09-21T09:03:06.247153+0000","last_unstale":"2024-09-21T09:06:17.475284+0000","last_undegraded":"2024-09-21T09:06:17.475284+0000","last_fullsized":"2024-09-21T09:06:17.475284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.475178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.475178+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.475178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:28.701561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.264738+0000","last_change":"2024-09-21T09:03:08.262999+0000","last_active":"2024-09-21T09:06:06.264738+0000","last_peered":"2024-09-21T09:06:06.264738+0000","last_clean":"2024-09-21T09:06:06.264738+0000","last_became_active":"2024-09-21T09:03:08.262680+0000","last_became_peered":"2024-09-21T09:03:08.262680+0000","last_unstale":"2024-09-21T09:06:06.264738+0000","last_undegraded":"2024-09-21T09:06:06.264738+0000","last_fullsized":"2024-09-21T09:06:06.264738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.325607+0000","last_change":"2024-09-21T09:06:28.325656+0000","last_active":"2024-09-21T09:06:28.325607+0000","last_peered":"2024-09-21T09:06:28.325607+0000","last_clean":"2024-09-21T09:06:28.325607+0000","last_became_active":"2024-09-21T09:03:00.219653+0000","last_became_peered":"2024-09-21T09:03:00.219653+0000","last_unstale":"2024-09-21T09:06:28.325607+0000","last_undegraded":"2024-09-21T09:06:28.325607+0000","last_fullsized":"2024-09-21T09:06:28.325607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:28.325504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:28.325504+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.325504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:07.739919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'3","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:27.457726+0000","last_change":"2024-09-21T09:02:58.202783+0000","last_active":"2024-09-21T09:05:27.457726+0000","last_peered":"2024-09-21T09:05:27.457726+0000","last_clean":"2024-09-21T09:05:27.457726+0000","last_became_active":"2024-09-21T09:02:58.202431+0000","last_became_peered":"2024-09-21T09:02:58.202431+0000","last_unstale":"2024-09-21T09:05:27.457726+0000","last_undegraded":"2024-09-21T09:05:27.457726+0000","last_fullsized":"2024-09-21T09:05:27.457726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.458066+0000","last_change":"2024-09-21T09:03:02.221261+0000","last_active":"2024-09-21T09:05:32.458066+0000","last_peered":"2024-09-21T09:05:32.458066+0000","last_clean":"2024-09-21T09:05:32.458066+0000","last_became_active":"2024-09-21T09:03:02.220940+0000","last_became_peered":"2024-09-21T09:03:02.220940+0000","last_unstale":"2024-09-21T09:05:32.458066+0000","last_undegraded":"2024-09-21T09:05:32.458066+0000","last_fullsized":"2024-09-21T09:05:32.458066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'40","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.706519+0000","last_change":"2024-09-21T09:06:26.706558+0000","last_active":"2024-09-21T09:06:26.706519+0000","last_peered":"2024-09-21T09:06:26.706519+0000","last_clean":"2024-09-21T09:06:26.706519+0000","last_became_active":"2024-09-21T09:03:04.239023+0000","last_became_peered":"2024-09-21T09:03:04.239023+0000","last_unstale":"2024-09-21T09:06:26.706519+0000","last_undegraded":"2024-09-21T09:06:26.706519+0000","last_fullsized":"2024-09-21T09:06:26.706519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-09-21T09:06:26.706429+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-09-21T09:06:26.706429+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.706429+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:10.421856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.646984+0000","last_change":"2024-09-21T09:06:19.647012+0000","last_active":"2024-09-21T09:06:19.646984+0000","last_peered":"2024-09-21T09:06:19.646984+0000","last_clean":"2024-09-21T09:06:19.646984+0000","last_became_active":"2024-09-21T09:03:06.243451+0000","last_became_peered":"2024-09-21T09:03:06.243451+0000","last_unstale":"2024-09-21T09:06:19.646984+0000","last_undegraded":"2024-09-21T09:06:19.646984+0000","last_fullsized":"2024-09-21T09:06:19.646984+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.646893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.646893+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.646893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:53.881810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:28.461370+0000","last_change":"2024-09-21T09:03:08.260334+0000","last_active":"2024-09-21T09:05:28.461370+0000","last_peered":"2024-09-21T09:05:28.461370+0000","last_clean":"2024-09-21T09:05:28.461370+0000","last_became_active":"2024-09-21T09:03:08.260047+0000","last_became_peered":"2024-09-21T09:03:08.260047+0000","last_unstale":"2024-09-21T09:05:28.461370+0000","last_undegraded":"2024-09-21T09:05:28.461370+0000","last_fullsized":"2024-09-21T09:05:28.461370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'7","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.413844+0000","last_change":"2024-09-21T09:03:00.221676+0000","last_active":"2024-09-21T09:06:06.413844+0000","last_peered":"2024-09-21T09:06:06.413844+0000","last_clean":"2024-09-21T09:06:06.413844+0000","last_became_active":"2024-09-21T09:03:00.221332+0000","last_became_peered":"2024-09-21T09:03:00.221332+0000","last_unstale":"2024-09-21T09:06:06.413844+0000","last_undegraded":"2024-09-21T09:06:06.413844+0000","last_fullsized":"2024-09-21T09:06:06.413844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:28.461450+0000","last_change":"2024-09-21T09:02:58.210805+0000","last_active":"2024-09-21T09:05:28.461450+0000","last_peered":"2024-09-21T09:05:28.461450+0000","last_clean":"2024-09-21T09:05:28.461450+0000","last_became_active":"2024-09-21T09:02:58.210511+0000","last_became_peered":"2024-09-21T09:02:58.210511+0000","last_unstale":"2024-09-21T09:05:28.461450+0000","last_undegraded":"2024-09-21T09:05:28.461450+0000","last_fullsized":"2024-09-21T09:05:28.461450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.458464+0000","last_change":"2024-09-21T09:03:02.219262+0000","last_active":"2024-09-21T09:05:32.458464+0000","last_peered":"2024-09-21T09:05:32.458464+0000","last_clean":"2024-09-21T09:05:32.458464+0000","last_became_active":"2024-09-21T09:03:02.218979+0000","last_became_peered":"2024-09-21T09:03:02.218979+0000","last_unstale":"2024-09-21T09:05:32.458464+0000","last_undegraded":"2024-09-21T09:05:32.458464+0000","last_fullsized":"2024-09-21T09:05:32.458464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'11","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:03.457280+0000","last_change":"2024-09-21T09:03:04.242314+0000","last_active":"2024-09-21T09:05:03.457280+0000","last_peered":"2024-09-21T09:05:03.457280+0000","last_clean":"2024-09-21T09:05:03.457280+0000","last_became_active":"2024-09-21T09:03:04.241974+0000","last_became_peered":"2024-09-21T09:03:04.241974+0000","last_unstale":"2024-09-21T09:05:03.457280+0000","last_undegraded":"2024-09-21T09:05:03.457280+0000","last_fullsized":"2024-09-21T09:05:03.457280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'285","reported_seq":428,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.869861+0000","last_change":"2024-09-21T09:06:20.869907+0000","last_active":"2024-09-21T09:06:20.869861+0000","last_peered":"2024-09-21T09:06:20.869861+0000","last_clean":"2024-09-21T09:06:20.869861+0000","last_became_active":"2024-09-21T09:03:06.244103+0000","last_became_peered":"2024-09-21T09:03:06.244103+0000","last_unstale":"2024-09-21T09:06:20.869861+0000","last_undegraded":"2024-09-21T09:06:20.869861+0000","last_fullsized":"2024-09-21T09:06:20.869861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:20.869741+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:20.869741+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.869741+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:41.358529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.087142+0000","last_change":"2024-09-21T09:03:08.260304+0000","last_active":"2024-09-21T09:06:06.087142+0000","last_peered":"2024-09-21T09:06:06.087142+0000","last_clean":"2024-09-21T09:06:06.087142+0000","last_became_active":"2024-09-21T09:03:08.259638+0000","last_became_peered":"2024-09-21T09:03:08.259638+0000","last_unstale":"2024-09-21T09:06:06.087142+0000","last_undegraded":"2024-09-21T09:06:06.087142+0000","last_fullsized":"2024-09-21T09:06:06.087142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.458019+0000","last_change":"2024-09-21T09:03:00.220803+0000","last_active":"2024-09-21T09:05:32.458019+0000","last_peered":"2024-09-21T09:05:32.458019+0000","last_clean":"2024-09-21T09:05:32.458019+0000","last_became_active":"2024-09-21T09:03:00.220426+0000","last_became_peered":"2024-09-21T09:03:00.220426+0000","last_unstale":"2024-09-21T09:05:32.458019+0000","last_undegraded":"2024-09-21T09:05:32.458019+0000","last_fullsized":"2024-09-21T09:05:32.458019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:27.457774+0000","last_change":"2024-09-21T09:02:58.207718+0000","last_active":"2024-09-21T09:05:27.457774+0000","last_peered":"2024-09-21T09:05:27.457774+0000","last_clean":"2024-09-21T09:05:27.457774+0000","last_became_active":"2024-09-21T09:02:58.207424+0000","last_became_peered":"2024-09-21T09:02:58.207424+0000","last_unstale":"2024-09-21T09:05:27.457774+0000","last_undegraded":"2024-09-21T09:05:27.457774+0000","last_fullsized":"2024-09-21T09:05:27.457774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.458425+0000","last_change":"2024-09-21T09:03:38.280977+0000","last_active":"2024-09-21T09:05:32.458425+0000","last_peered":"2024-09-21T09:05:32.458425+0000","last_clean":"2024-09-21T09:05:32.458425+0000","last_became_active":"2024-09-21T09:03:38.280616+0000","last_became_peered":"2024-09-21T09:03:38.280616+0000","last_unstale":"2024-09-21T09:05:32.458425+0000","last_undegraded":"2024-09-21T09:05:32.458425+0000","last_fullsized":"2024-09-21T09:05:32.458425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'47","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.397782+0000","last_change":"2024-09-21T09:06:26.397832+0000","last_active":"2024-09-21T09:06:26.397782+0000","last_peered":"2024-09-21T09:06:26.397782+0000","last_clean":"2024-09-21T09:06:26.397782+0000","last_became_active":"2024-09-21T09:03:04.233878+0000","last_became_peered":"2024-09-21T09:03:04.233878+0000","last_unstale":"2024-09-21T09:06:26.397782+0000","last_undegraded":"2024-09-21T09:06:26.397782+0000","last_fullsized":"2024-09-21T09:06:26.397782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-09-21T09:06:26.397701+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-09-21T09:06:26.397701+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.397701+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:42.069141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.708319+0000","last_change":"2024-09-21T09:06:17.708341+0000","last_active":"2024-09-21T09:06:17.708319+0000","last_peered":"2024-09-21T09:06:17.708319+0000","last_clean":"2024-09-21T09:06:17.708319+0000","last_became_active":"2024-09-21T09:03:06.247609+0000","last_became_peered":"2024-09-21T09:03:06.247609+0000","last_unstale":"2024-09-21T09:06:17.708319+0000","last_undegraded":"2024-09-21T09:06:17.708319+0000","last_fullsized":"2024-09-21T09:06:17.708319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.708240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.708240+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.708240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:29.114535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.458490+0000","last_change":"2024-09-21T09:03:08.256301+0000","last_active":"2024-09-21T09:05:32.458490+0000","last_peered":"2024-09-21T09:05:32.458490+0000","last_clean":"2024-09-21T09:05:32.458490+0000","last_became_active":"2024-09-21T09:03:08.255717+0000","last_became_peered":"2024-09-21T09:03:08.255717+0000","last_unstale":"2024-09-21T09:05:32.458490+0000","last_undegraded":"2024-09-21T09:05:32.458490+0000","last_fullsized":"2024-09-21T09:05:32.458490+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'10","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.181650+0000","last_change":"2024-09-21T09:03:00.216086+0000","last_active":"2024-09-21T09:06:06.181650+0000","last_peered":"2024-09-21T09:06:06.181650+0000","last_clean":"2024-09-21T09:06:06.181650+0000","last_became_active":"2024-09-21T09:03:00.215804+0000","last_became_peered":"2024-09-21T09:03:00.215804+0000","last_unstale":"2024-09-21T09:06:06.181650+0000","last_undegraded":"2024-09-21T09:06:06.181650+0000","last_fullsized":"2024-09-21T09:06:06.181650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:28.461519+0000","last_change":"2024-09-21T09:02:58.221563+0000","last_active":"2024-09-21T09:05:28.461519+0000","last_peered":"2024-09-21T09:05:28.461519+0000","last_clean":"2024-09-21T09:05:28.461519+0000","last_became_active":"2024-09-21T09:02:58.221286+0000","last_became_peered":"2024-09-21T09:02:58.221286+0000","last_unstale":"2024-09-21T09:05:28.461519+0000","last_undegraded":"2024-09-21T09:05:28.461519+0000","last_fullsized":"2024-09-21T09:05:28.461519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.458037+0000","last_change":"2024-09-21T09:03:02.225192+0000","last_active":"2024-09-21T09:05:32.458037+0000","last_peered":"2024-09-21T09:05:32.458037+0000","last_clean":"2024-09-21T09:05:32.458037+0000","last_became_active":"2024-09-21T09:03:02.224879+0000","last_became_peered":"2024-09-21T09:03:02.224879+0000","last_unstale":"2024-09-21T09:05:32.458037+0000","last_undegraded":"2024-09-21T09:05:32.458037+0000","last_fullsized":"2024-09-21T09:05:32.458037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.736574+0000","last_change":"2024-09-21T09:06:24.736614+0000","last_active":"2024-09-21T09:06:24.736574+0000","last_peered":"2024-09-21T09:06:24.736574+0000","last_clean":"2024-09-21T09:06:24.736574+0000","last_became_active":"2024-09-21T09:03:04.239112+0000","last_became_peered":"2024-09-21T09:03:04.239112+0000","last_unstale":"2024-09-21T09:06:24.736574+0000","last_undegraded":"2024-09-21T09:06:24.736574+0000","last_fullsized":"2024-09-21T09:06:24.736574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-09-21T09:06:24.736479+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-09-21T09:06:24.736479+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.736479+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:34.646980+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:33.462092+0000","last_change":"2024-09-21T09:03:06.251033+0000","last_active":"2024-09-21T09:05:33.462092+0000","last_peered":"2024-09-21T09:05:33.462092+0000","last_clean":"2024-09-21T09:05:33.462092+0000","last_became_active":"2024-09-21T09:03:06.250729+0000","last_became_peered":"2024-09-21T09:03:06.250729+0000","last_unstale":"2024-09-21T09:05:33.462092+0000","last_undegraded":"2024-09-21T09:05:33.462092+0000","last_fullsized":"2024-09-21T09:05:33.462092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:33.462299+0000","last_change":"2024-09-21T09:03:08.264701+0000","last_active":"2024-09-21T09:05:33.462299+0000","last_peered":"2024-09-21T09:05:33.462299+0000","last_clean":"2024-09-21T09:05:33.462299+0000","last_became_active":"2024-09-21T09:03:08.264160+0000","last_became_peered":"2024-09-21T09:03:08.264160+0000","last_unstale":"2024-09-21T09:05:33.462299+0000","last_undegraded":"2024-09-21T09:05:33.462299+0000","last_fullsized":"2024-09-21T09:05:33.462299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304673+0000","last_change":"2024-09-21T09:03:00.208934+0000","last_active":"2024-09-21T09:06:06.304673+0000","last_peered":"2024-09-21T09:06:06.304673+0000","last_clean":"2024-09-21T09:06:06.304673+0000","last_became_active":"2024-09-21T09:03:00.208673+0000","last_became_peered":"2024-09-21T09:03:00.208673+0000","last_unstale":"2024-09-21T09:06:06.304673+0000","last_undegraded":"2024-09-21T09:06:06.304673+0000","last_fullsized":"2024-09-21T09:06:06.304673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:57.452440+0000","last_change":"2024-09-21T09:02:58.213090+0000","last_active":"2024-09-21T09:04:57.452440+0000","last_peered":"2024-09-21T09:04:57.452440+0000","last_clean":"2024-09-21T09:04:57.452440+0000","last_became_active":"2024-09-21T09:02:58.212751+0000","last_became_peered":"2024-09-21T09:02:58.212751+0000","last_unstale":"2024-09-21T09:04:57.452440+0000","last_undegraded":"2024-09-21T09:04:57.452440+0000","last_fullsized":"2024-09-21T09:04:57.452440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.339319+0000","last_change":"2024-09-21T09:06:28.339342+0000","last_active":"2024-09-21T09:06:28.339319+0000","last_peered":"2024-09-21T09:06:28.339319+0000","last_clean":"2024-09-21T09:06:28.339319+0000","last_became_active":"2024-09-21T09:03:02.222965+0000","last_became_peered":"2024-09-21T09:03:02.222965+0000","last_unstale":"2024-09-21T09:06:28.339319+0000","last_undegraded":"2024-09-21T09:06:28.339319+0000","last_fullsized":"2024-09-21T09:06:28.339319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:28.339237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:28.339237+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.339237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:34.803750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'29","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:13.015318+0000","last_change":"2024-09-21T09:03:04.244000+0000","last_active":"2024-09-21T09:06:13.015318+0000","last_peered":"2024-09-21T09:06:13.015318+0000","last_clean":"2024-09-21T09:06:13.015318+0000","last_became_active":"2024-09-21T09:03:04.243686+0000","last_became_peered":"2024-09-21T09:03:04.243686+0000","last_unstale":"2024-09-21T09:06:13.015318+0000","last_undegraded":"2024-09-21T09:06:13.015318+0000","last_fullsized":"2024-09-21T09:06:13.015318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:03.213122+0000","last_clean_scrub_stamp":"2024-09-21T09:03:03.213122+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:38.462843+0000","last_change":"2024-09-21T09:03:06.250256+0000","last_active":"2024-09-21T09:05:38.462843+0000","last_peered":"2024-09-21T09:05:38.462843+0000","last_clean":"2024-09-21T09:05:38.462843+0000","last_became_active":"2024-09-21T09:03:06.249959+0000","last_became_peered":"2024-09-21T09:03:06.249959+0000","last_unstale":"2024-09-21T09:05:38.462843+0000","last_undegraded":"2024-09-21T09:05:38.462843+0000","last_fullsized":"2024-09-21T09:05:38.462843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:33.462261+0000","last_change":"2024-09-21T09:03:08.264668+0000","last_active":"2024-09-21T09:05:33.462261+0000","last_peered":"2024-09-21T09:05:33.462261+0000","last_clean":"2024-09-21T09:05:33.462261+0000","last_became_active":"2024-09-21T09:03:08.264395+0000","last_became_peered":"2024-09-21T09:03:08.264395+0000","last_unstale":"2024-09-21T09:05:33.462261+0000","last_undegraded":"2024-09-21T09:05:33.462261+0000","last_fullsized":"2024-09-21T09:05:33.462261+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'14","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.181827+0000","last_change":"2024-09-21T09:03:00.216032+0000","last_active":"2024-09-21T09:06:06.181827+0000","last_peered":"2024-09-21T09:06:06.181827+0000","last_clean":"2024-09-21T09:06:06.181827+0000","last_became_active":"2024-09-21T09:03:00.215748+0000","last_became_peered":"2024-09-21T09:03:00.215748+0000","last_unstale":"2024-09-21T09:06:06.181827+0000","last_undegraded":"2024-09-21T09:06:06.181827+0000","last_fullsized":"2024-09-21T09:06:06.181827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.969762+0000","last_change":"2024-09-21T09:02:58.204247+0000","last_active":"2024-09-21T09:06:12.969762+0000","last_peered":"2024-09-21T09:06:12.969762+0000","last_clean":"2024-09-21T09:06:12.969762+0000","last_became_active":"2024-09-21T09:02:58.203973+0000","last_became_peered":"2024-09-21T09:02:58.203973+0000","last_unstale":"2024-09-21T09:06:12.969762+0000","last_undegraded":"2024-09-21T09:06:12.969762+0000","last_fullsized":"2024-09-21T09:06:12.969762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.378455+0000","last_change":"2024-09-21T09:06:30.378485+0000","last_active":"2024-09-21T09:06:30.378455+0000","last_peered":"2024-09-21T09:06:30.378455+0000","last_clean":"2024-09-21T09:06:30.378455+0000","last_became_active":"2024-09-21T09:03:02.220801+0000","last_became_peered":"2024-09-21T09:03:02.220801+0000","last_unstale":"2024-09-21T09:06:30.378455+0000","last_undegraded":"2024-09-21T09:06:30.378455+0000","last_fullsized":"2024-09-21T09:06:30.378455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:06:30.378369+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:06:30.378369+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.378369+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:45.332862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'39","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.252315+0000","last_change":"2024-09-21T09:06:31.252360+0000","last_active":"2024-09-21T09:06:31.252315+0000","last_peered":"2024-09-21T09:06:31.252315+0000","last_clean":"2024-09-21T09:06:31.252315+0000","last_became_active":"2024-09-21T09:03:04.240857+0000","last_became_peered":"2024-09-21T09:03:04.240857+0000","last_unstale":"2024-09-21T09:06:31.252315+0000","last_undegraded":"2024-09-21T09:06:31.252315+0000","last_fullsized":"2024-09-21T09:06:31.252315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-21T09:06:31.252205+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-21T09:06:31.252205+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.252205+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.717765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.737294+0000","last_change":"2024-09-21T09:06:29.737330+0000","last_active":"2024-09-21T09:06:29.737294+0000","last_peered":"2024-09-21T09:06:29.737294+0000","last_clean":"2024-09-21T09:06:29.737294+0000","last_became_active":"2024-09-21T09:03:06.248030+0000","last_became_peered":"2024-09-21T09:03:06.248030+0000","last_unstale":"2024-09-21T09:06:29.737294+0000","last_undegraded":"2024-09-21T09:06:29.737294+0000","last_fullsized":"2024-09-21T09:06:29.737294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:29.737203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:29.737203+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.737203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:47.781194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'4","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:28.461477+0000","last_change":"2024-09-21T09:03:08.264618+0000","last_active":"2024-09-21T09:05:28.461477+0000","last_peered":"2024-09-21T09:05:28.461477+0000","last_clean":"2024-09-21T09:05:28.461477+0000","last_became_active":"2024-09-21T09:03:08.264304+0000","last_became_peered":"2024-09-21T09:03:08.264304+0000","last_unstale":"2024-09-21T09:05:28.461477+0000","last_undegraded":"2024-09-21T09:05:28.461477+0000","last_fullsized":"2024-09-21T09:05:28.461477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'22","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.089764+0000","last_change":"2024-09-21T09:03:00.226200+0000","last_active":"2024-09-21T09:06:06.089764+0000","last_peered":"2024-09-21T09:06:06.089764+0000","last_clean":"2024-09-21T09:06:06.089764+0000","last_became_active":"2024-09-21T09:03:00.225936+0000","last_became_peered":"2024-09-21T09:03:00.225936+0000","last_unstale":"2024-09-21T09:06:06.089764+0000","last_undegraded":"2024-09-21T09:06:06.089764+0000","last_fullsized":"2024-09-21T09:06:06.089764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453377+0000","last_change":"2024-09-21T09:02:58.206450+0000","last_active":"2024-09-21T09:05:02.453377+0000","last_peered":"2024-09-21T09:05:02.453377+0000","last_clean":"2024-09-21T09:05:02.453377+0000","last_became_active":"2024-09-21T09:02:58.206163+0000","last_became_peered":"2024-09-21T09:02:58.206163+0000","last_unstale":"2024-09-21T09:05:02.453377+0000","last_undegraded":"2024-09-21T09:05:02.453377+0000","last_fullsized":"2024-09-21T09:05:02.453377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.414031+0000","last_change":"2024-09-21T09:03:00.221286+0000","last_active":"2024-09-21T09:06:06.414031+0000","last_peered":"2024-09-21T09:06:06.414031+0000","last_clean":"2024-09-21T09:06:06.414031+0000","last_became_active":"2024-09-21T09:03:00.220860+0000","last_became_peered":"2024-09-21T09:03:00.220860+0000","last_unstale":"2024-09-21T09:06:06.414031+0000","last_undegraded":"2024-09-21T09:06:06.414031+0000","last_fullsized":"2024-09-21T09:06:06.414031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.248335+0000","last_change":"2024-09-21T09:02:58.202869+0000","last_active":"2024-09-21T09:06:06.248335+0000","last_peered":"2024-09-21T09:06:06.248335+0000","last_clean":"2024-09-21T09:06:06.248335+0000","last_became_active":"2024-09-21T09:02:58.202579+0000","last_became_peered":"2024-09-21T09:02:58.202579+0000","last_unstale":"2024-09-21T09:06:06.248335+0000","last_undegraded":"2024-09-21T09:06:06.248335+0000","last_fullsized":"2024-09-21T09:06:06.248335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'3","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.413592+0000","last_change":"2024-09-21T09:03:00.221384+0000","last_active":"2024-09-21T09:06:06.413592+0000","last_peered":"2024-09-21T09:06:06.413592+0000","last_clean":"2024-09-21T09:06:06.413592+0000","last_became_active":"2024-09-21T09:03:00.219281+0000","last_became_peered":"2024-09-21T09:03:00.219281+0000","last_unstale":"2024-09-21T09:06:06.413592+0000","last_undegraded":"2024-09-21T09:06:06.413592+0000","last_fullsized":"2024-09-21T09:06:06.413592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:03.457190+0000","last_change":"2024-09-21T09:02:58.223127+0000","last_active":"2024-09-21T09:05:03.457190+0000","last_peered":"2024-09-21T09:05:03.457190+0000","last_clean":"2024-09-21T09:05:03.457190+0000","last_became_active":"2024-09-21T09:02:58.222856+0000","last_became_peered":"2024-09-21T09:02:58.222856+0000","last_unstale":"2024-09-21T09:05:03.457190+0000","last_undegraded":"2024-09-21T09:05:03.457190+0000","last_fullsized":"2024-09-21T09:05:03.457190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.454594+0000","last_change":"2024-09-21T09:03:00.221392+0000","last_active":"2024-09-21T09:05:12.454594+0000","last_peered":"2024-09-21T09:05:12.454594+0000","last_clean":"2024-09-21T09:05:12.454594+0000","last_became_active":"2024-09-21T09:03:00.220755+0000","last_became_peered":"2024-09-21T09:03:00.220755+0000","last_unstale":"2024-09-21T09:05:12.454594+0000","last_undegraded":"2024-09-21T09:05:12.454594+0000","last_fullsized":"2024-09-21T09:05:12.454594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453099+0000","last_change":"2024-09-21T09:02:58.208737+0000","last_active":"2024-09-21T09:05:02.453099+0000","last_peered":"2024-09-21T09:05:02.453099+0000","last_clean":"2024-09-21T09:05:02.453099+0000","last_became_active":"2024-09-21T09:02:58.208329+0000","last_became_peered":"2024-09-21T09:02:58.208329+0000","last_unstale":"2024-09-21T09:05:02.453099+0000","last_undegraded":"2024-09-21T09:05:02.453099+0000","last_fullsized":"2024-09-21T09:05:02.453099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'16","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.267246+0000","last_change":"2024-09-21T09:03:00.216032+0000","last_active":"2024-09-21T09:06:06.267246+0000","last_peered":"2024-09-21T09:06:06.267246+0000","last_clean":"2024-09-21T09:06:06.267246+0000","last_became_active":"2024-09-21T09:03:00.215554+0000","last_became_peered":"2024-09-21T09:03:00.215554+0000","last_unstale":"2024-09-21T09:06:06.267246+0000","last_undegraded":"2024-09-21T09:06:06.267246+0000","last_fullsized":"2024-09-21T09:06:06.267246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453857+0000","last_change":"2024-09-21T09:02:58.202254+0000","last_active":"2024-09-21T09:05:07.453857+0000","last_peered":"2024-09-21T09:05:07.453857+0000","last_clean":"2024-09-21T09:05:07.453857+0000","last_became_active":"2024-09-21T09:02:58.201482+0000","last_became_peered":"2024-09-21T09:02:58.201482+0000","last_unstale":"2024-09-21T09:05:07.453857+0000","last_undegraded":"2024-09-21T09:05:07.453857+0000","last_fullsized":"2024-09-21T09:05:07.453857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'11","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.414128+0000","last_change":"2024-09-21T09:03:00.224630+0000","last_active":"2024-09-21T09:06:06.414128+0000","last_peered":"2024-09-21T09:06:06.414128+0000","last_clean":"2024-09-21T09:06:06.414128+0000","last_became_active":"2024-09-21T09:03:00.223740+0000","last_became_peered":"2024-09-21T09:03:00.223740+0000","last_unstale":"2024-09-21T09:06:06.414128+0000","last_undegraded":"2024-09-21T09:06:06.414128+0000","last_fullsized":"2024-09-21T09:06:06.414128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.969855+0000","last_change":"2024-09-21T09:02:58.210714+0000","last_active":"2024-09-21T09:06:12.969855+0000","last_peered":"2024-09-21T09:06:12.969855+0000","last_clean":"2024-09-21T09:06:12.969855+0000","last_became_active":"2024-09-21T09:02:58.210442+0000","last_became_peered":"2024-09-21T09:02:58.210442+0000","last_unstale":"2024-09-21T09:06:12.969855+0000","last_undegraded":"2024-09-21T09:06:12.969855+0000","last_fullsized":"2024-09-21T09:06:12.969855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'14","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453774+0000","last_change":"2024-09-21T09:03:00.216820+0000","last_active":"2024-09-21T09:05:07.453774+0000","last_peered":"2024-09-21T09:05:07.453774+0000","last_clean":"2024-09-21T09:05:07.453774+0000","last_became_active":"2024-09-21T09:03:00.216462+0000","last_became_peered":"2024-09-21T09:03:00.216462+0000","last_unstale":"2024-09-21T09:05:07.453774+0000","last_undegraded":"2024-09-21T09:05:07.453774+0000","last_fullsized":"2024-09-21T09:05:07.453774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.454170+0000","last_change":"2024-09-21T09:02:58.220184+0000","last_active":"2024-09-21T09:05:07.454170+0000","last_peered":"2024-09-21T09:05:07.454170+0000","last_clean":"2024-09-21T09:05:07.454170+0000","last_became_active":"2024-09-21T09:02:58.218407+0000","last_became_peered":"2024-09-21T09:02:58.218407+0000","last_unstale":"2024-09-21T09:05:07.454170+0000","last_undegraded":"2024-09-21T09:05:07.454170+0000","last_fullsized":"2024-09-21T09:05:07.454170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304024+0000","last_change":"2024-09-21T09:03:00.213244+0000","last_active":"2024-09-21T09:06:06.304024+0000","last_peered":"2024-09-21T09:06:06.304024+0000","last_clean":"2024-09-21T09:06:06.304024+0000","last_became_active":"2024-09-21T09:03:00.212503+0000","last_became_peered":"2024-09-21T09:03:00.212503+0000","last_unstale":"2024-09-21T09:06:06.304024+0000","last_undegraded":"2024-09-21T09:06:06.304024+0000","last_fullsized":"2024-09-21T09:06:06.304024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453936+0000","last_change":"2024-09-21T09:02:58.202455+0000","last_active":"2024-09-21T09:05:07.453936+0000","last_peered":"2024-09-21T09:05:07.453936+0000","last_clean":"2024-09-21T09:05:07.453936+0000","last_became_active":"2024-09-21T09:02:58.201812+0000","last_became_peered":"2024-09-21T09:02:58.201812+0000","last_unstale":"2024-09-21T09:05:07.453936+0000","last_undegraded":"2024-09-21T09:05:07.453936+0000","last_fullsized":"2024-09-21T09:05:07.453936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'6","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.457155+0000","last_change":"2024-09-21T09:03:00.225519+0000","last_active":"2024-09-21T09:05:22.457155+0000","last_peered":"2024-09-21T09:05:22.457155+0000","last_clean":"2024-09-21T09:05:22.457155+0000","last_became_active":"2024-09-21T09:03:00.224456+0000","last_became_peered":"2024-09-21T09:03:00.224456+0000","last_unstale":"2024-09-21T09:05:22.457155+0000","last_undegraded":"2024-09-21T09:05:22.457155+0000","last_fullsized":"2024-09-21T09:05:22.457155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.969407+0000","last_change":"2024-09-21T09:02:58.222445+0000","last_active":"2024-09-21T09:06:12.969407+0000","last_peered":"2024-09-21T09:06:12.969407+0000","last_clean":"2024-09-21T09:06:12.969407+0000","last_became_active":"2024-09-21T09:02:58.222191+0000","last_became_peered":"2024-09-21T09:02:58.222191+0000","last_unstale":"2024-09-21T09:06:12.969407+0000","last_undegraded":"2024-09-21T09:06:12.969407+0000","last_fullsized":"2024-09-21T09:06:12.969407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'6","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.370052+0000","last_change":"2024-09-21T09:03:00.220918+0000","last_active":"2024-09-21T09:06:06.370052+0000","last_peered":"2024-09-21T09:06:06.370052+0000","last_clean":"2024-09-21T09:06:06.370052+0000","last_became_active":"2024-09-21T09:03:00.220639+0000","last_became_peered":"2024-09-21T09:03:00.220639+0000","last_unstale":"2024-09-21T09:06:06.370052+0000","last_undegraded":"2024-09-21T09:06:06.370052+0000","last_fullsized":"2024-09-21T09:06:06.370052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.454498+0000","last_change":"2024-09-21T09:02:58.208759+0000","last_active":"2024-09-21T09:05:12.454498+0000","last_peered":"2024-09-21T09:05:12.454498+0000","last_clean":"2024-09-21T09:05:12.454498+0000","last_became_active":"2024-09-21T09:02:58.208346+0000","last_became_peered":"2024-09-21T09:02:58.208346+0000","last_unstale":"2024-09-21T09:05:12.454498+0000","last_undegraded":"2024-09-21T09:05:12.454498+0000","last_fullsized":"2024-09-21T09:05:12.454498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'6","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.455340+0000","last_change":"2024-09-21T09:03:00.223002+0000","last_active":"2024-09-21T09:05:17.455340+0000","last_peered":"2024-09-21T09:05:17.455340+0000","last_clean":"2024-09-21T09:05:17.455340+0000","last_became_active":"2024-09-21T09:03:00.222651+0000","last_became_peered":"2024-09-21T09:03:00.222651+0000","last_unstale":"2024-09-21T09:05:17.455340+0000","last_undegraded":"2024-09-21T09:05:17.455340+0000","last_fullsized":"2024-09-21T09:05:17.455340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455323+0000","last_change":"2024-09-21T09:02:58.209919+0000","last_active":"2024-09-21T09:05:12.455323+0000","last_peered":"2024-09-21T09:05:12.455323+0000","last_clean":"2024-09-21T09:05:12.455323+0000","last_became_active":"2024-09-21T09:02:58.208495+0000","last_became_peered":"2024-09-21T09:02:58.208495+0000","last_unstale":"2024-09-21T09:05:12.455323+0000","last_undegraded":"2024-09-21T09:05:12.455323+0000","last_fullsized":"2024-09-21T09:05:12.455323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.456186+0000","last_change":"2024-09-21T09:03:00.222862+0000","last_active":"2024-09-21T09:05:17.456186+0000","last_peered":"2024-09-21T09:05:17.456186+0000","last_clean":"2024-09-21T09:05:17.456186+0000","last_became_active":"2024-09-21T09:03:00.222343+0000","last_became_peered":"2024-09-21T09:03:00.222343+0000","last_unstale":"2024-09-21T09:05:17.456186+0000","last_undegraded":"2024-09-21T09:05:17.456186+0000","last_fullsized":"2024-09-21T09:05:17.456186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.969765+0000","last_change":"2024-09-21T09:02:58.210097+0000","last_active":"2024-09-21T09:06:12.969765+0000","last_peered":"2024-09-21T09:06:12.969765+0000","last_clean":"2024-09-21T09:06:12.969765+0000","last_became_active":"2024-09-21T09:02:58.208630+0000","last_became_peered":"2024-09-21T09:02:58.208630+0000","last_unstale":"2024-09-21T09:06:12.969765+0000","last_undegraded":"2024-09-21T09:06:12.969765+0000","last_fullsized":"2024-09-21T09:06:12.969765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'18","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:52.460724+0000","last_change":"2024-09-21T09:03:38.286564+0000","last_active":"2024-09-21T09:05:52.460724+0000","last_peered":"2024-09-21T09:05:52.460724+0000","last_clean":"2024-09-21T09:05:52.460724+0000","last_became_active":"2024-09-21T09:03:38.282951+0000","last_became_peered":"2024-09-21T09:03:38.282951+0000","last_unstale":"2024-09-21T09:05:52.460724+0000","last_undegraded":"2024-09-21T09:05:52.460724+0000","last_fullsized":"2024-09-21T09:05:52.460724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.065210+0000","last_change":"2024-09-21T09:02:58.214989+0000","last_active":"2024-09-21T09:06:06.065210+0000","last_peered":"2024-09-21T09:06:06.065210+0000","last_clean":"2024-09-21T09:06:06.065210+0000","last_became_active":"2024-09-21T09:02:58.214717+0000","last_became_peered":"2024-09-21T09:02:58.214717+0000","last_unstale":"2024-09-21T09:06:06.065210+0000","last_undegraded":"2024-09-21T09:06:06.065210+0000","last_fullsized":"2024-09-21T09:06:06.065210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'5","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.413792+0000","last_change":"2024-09-21T09:03:00.227362+0000","last_active":"2024-09-21T09:06:06.413792+0000","last_peered":"2024-09-21T09:06:06.413792+0000","last_clean":"2024-09-21T09:06:06.413792+0000","last_became_active":"2024-09-21T09:03:00.226411+0000","last_became_peered":"2024-09-21T09:03:00.226411+0000","last_unstale":"2024-09-21T09:06:06.413792+0000","last_undegraded":"2024-09-21T09:06:06.413792+0000","last_fullsized":"2024-09-21T09:06:06.413792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:13.459048+0000","last_change":"2024-09-21T09:02:58.224258+0000","last_active":"2024-09-21T09:05:13.459048+0000","last_peered":"2024-09-21T09:05:13.459048+0000","last_clean":"2024-09-21T09:05:13.459048+0000","last_became_active":"2024-09-21T09:02:58.224058+0000","last_became_peered":"2024-09-21T09:02:58.224058+0000","last_unstale":"2024-09-21T09:05:13.459048+0000","last_undegraded":"2024-09-21T09:05:13.459048+0000","last_fullsized":"2024-09-21T09:05:13.459048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'4","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.089435+0000","last_change":"2024-09-21T09:03:00.220552+0000","last_active":"2024-09-21T09:06:06.089435+0000","last_peered":"2024-09-21T09:06:06.089435+0000","last_clean":"2024-09-21T09:06:06.089435+0000","last_became_active":"2024-09-21T09:03:00.218422+0000","last_became_peered":"2024-09-21T09:03:00.218422+0000","last_unstale":"2024-09-21T09:06:06.089435+0000","last_undegraded":"2024-09-21T09:06:06.089435+0000","last_fullsized":"2024-09-21T09:06:06.089435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.455952+0000","last_change":"2024-09-21T09:02:58.219338+0000","last_active":"2024-09-21T09:05:17.455952+0000","last_peered":"2024-09-21T09:05:17.455952+0000","last_clean":"2024-09-21T09:05:17.455952+0000","last_became_active":"2024-09-21T09:02:58.218299+0000","last_became_peered":"2024-09-21T09:02:58.218299+0000","last_unstale":"2024-09-21T09:05:17.455952+0000","last_undegraded":"2024-09-21T09:05:17.455952+0000","last_fullsized":"2024-09-21T09:05:17.455952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'11","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.413670+0000","last_change":"2024-09-21T09:03:00.213716+0000","last_active":"2024-09-21T09:06:06.413670+0000","last_peered":"2024-09-21T09:06:06.413670+0000","last_clean":"2024-09-21T09:06:06.413670+0000","last_became_active":"2024-09-21T09:03:00.212838+0000","last_became_peered":"2024-09-21T09:03:00.212838+0000","last_unstale":"2024-09-21T09:06:06.413670+0000","last_undegraded":"2024-09-21T09:06:06.413670+0000","last_fullsized":"2024-09-21T09:06:06.413670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.969448+0000","last_change":"2024-09-21T09:02:58.219134+0000","last_active":"2024-09-21T09:06:12.969448+0000","last_peered":"2024-09-21T09:06:12.969448+0000","last_clean":"2024-09-21T09:06:12.969448+0000","last_became_active":"2024-09-21T09:02:58.218776+0000","last_became_peered":"2024-09-21T09:02:58.218776+0000","last_unstale":"2024-09-21T09:06:12.969448+0000","last_undegraded":"2024-09-21T09:06:12.969448+0000","last_fullsized":"2024-09-21T09:06:12.969448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.459817+0000","last_change":"2024-09-21T09:02:58.219078+0000","last_active":"2024-09-21T09:05:18.459817+0000","last_peered":"2024-09-21T09:05:18.459817+0000","last_clean":"2024-09-21T09:05:18.459817+0000","last_became_active":"2024-09-21T09:02:58.218757+0000","last_became_peered":"2024-09-21T09:02:58.218757+0000","last_unstale":"2024-09-21T09:05:18.459817+0000","last_undegraded":"2024-09-21T09:05:18.459817+0000","last_fullsized":"2024-09-21T09:05:18.459817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'6","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304271+0000","last_change":"2024-09-21T09:03:00.216883+0000","last_active":"2024-09-21T09:06:06.304271+0000","last_peered":"2024-09-21T09:06:06.304271+0000","last_clean":"2024-09-21T09:06:06.304271+0000","last_became_active":"2024-09-21T09:03:00.216424+0000","last_became_peered":"2024-09-21T09:03:00.216424+0000","last_unstale":"2024-09-21T09:06:06.304271+0000","last_undegraded":"2024-09-21T09:06:06.304271+0000","last_fullsized":"2024-09-21T09:06:06.304271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.455250+0000","last_change":"2024-09-21T09:02:58.209061+0000","last_active":"2024-09-21T09:05:17.455250+0000","last_peered":"2024-09-21T09:05:17.455250+0000","last_clean":"2024-09-21T09:05:17.455250+0000","last_became_active":"2024-09-21T09:02:58.208437+0000","last_became_peered":"2024-09-21T09:02:58.208437+0000","last_unstale":"2024-09-21T09:05:17.455250+0000","last_undegraded":"2024-09-21T09:05:17.455250+0000","last_fullsized":"2024-09-21T09:05:17.455250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'3","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.414096+0000","last_change":"2024-09-21T09:03:00.219307+0000","last_active":"2024-09-21T09:06:06.414096+0000","last_peered":"2024-09-21T09:06:06.414096+0000","last_clean":"2024-09-21T09:06:06.414096+0000","last_became_active":"2024-09-21T09:03:00.219010+0000","last_became_peered":"2024-09-21T09:03:00.219010+0000","last_unstale":"2024-09-21T09:06:06.414096+0000","last_undegraded":"2024-09-21T09:06:06.414096+0000","last_fullsized":"2024-09-21T09:06:06.414096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1483,"ondisk_log_size":1483,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673010,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":136073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705713,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":722309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705712,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":723502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705712,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":417792,"data_stored":134220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:06:37.952 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.952 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.952 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.953 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.953 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.953 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.953 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.953 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.953 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.953 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.953 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.953 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.954 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.954 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.954 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.954 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.954 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.954 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.954 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.954 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.954 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.955 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.955 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.955 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.955 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.955 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.955 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.955 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.955 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.955 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.955 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.956 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.956 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.956 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.956 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.956 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.956 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.956 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.956 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.956 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.957 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.957 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.957 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.957 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.957 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.957 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.957 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.957 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.957 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.958 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.958 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.958 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.958 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.958 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.958 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.958 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.958 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.958 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.959 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.959 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.959 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.959 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.959 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.959 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.959 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.959 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.959 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.960 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.960 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.960 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.960 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.960 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.960 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.960 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.960 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.961 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T09:02:42.466256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=42, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.961 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.961 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.961 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.961 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.961 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.961 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.961 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.961 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.961 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.962 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.962 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.962 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.962 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.962 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.962 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.962 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.962 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.962 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.963 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.963 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.963 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.963 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.963 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.963 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.963 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.963 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.963 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.963 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.964 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.964 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.964 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.964 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.964 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.964 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.964 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.964 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.964 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.965 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.965 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.965 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.965 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.965 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.965 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.965 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.965 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.965 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.965 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.966 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.966 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.966 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.966 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.966 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.966 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.966 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.966 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.967 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.967 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.967 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.967 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.967 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.967 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.967 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.967 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.967 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.968 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.968 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.968 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.968 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.968 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.968 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.968 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.968 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.968 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.969 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.969 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.969 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.969 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.969 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.969 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.969 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.969 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.969 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-21T09:03:03.213122+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.970 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.970 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.970 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.970 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.970 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.970 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.970 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.970 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.970 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.971 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.971 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.971 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.971 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.971 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.971 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.971 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.971 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.971 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.971 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.972 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.972 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.972 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.972 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.972 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.972 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.972 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.972 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.972 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.972 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.973 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.973 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.973 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.973 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.973 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.973 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.973 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.973 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.973 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.974 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.974 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.974 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:37.974 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T09:06:57.974 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:06:58.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.086+0000 7fdc99ff6640 1 Processor -- start 2024-09-21T09:06:58.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.086+0000 7fdc99ff6640 1 -- start start 2024-09-21T09:06:58.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.087+0000 7fdc99ff6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdc9409bd50 0x7fdc9409c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:58.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.087+0000 7fdc99ff6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9409d3b0 con 0x7fdc9409c670 2024-09-21T09:06:58.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.087+0000 7fdc99ff6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fdc94098230 con 0x7fdc9409bd50 2024-09-21T09:06:58.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.087+0000 7fdc937fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdc9409bd50 0x7fdc9409c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:58.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.087+0000 7fdc92ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdc9409c670 0x7fdc940990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47776/0 (socket says 172.21.15.44:47776) 2024-09-21T09:06:58.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.087+0000 7fdc937fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdc9409bd50 0x7fdc9409c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39782/0 (socket says 172.21.15.44:39782) 2024-09-21T09:06:58.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.087+0000 7fdc92ffd640 1 -- 172.21.15.44:0/256622219 learned_addr learned my addr 172.21.15.44:0/256622219 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:06:58.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.087+0000 7fdc937fe640 1 -- 172.21.15.44:0/256622219 >> v1:172.21.15.44:6789/0 conn(0x7fdc9409c670 legacy=0x7fdc940990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:58.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.087+0000 7fdc937fe640 1 -- 172.21.15.44:0/256622219 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc940983e0 con 0x7fdc9409bd50 2024-09-21T09:06:58.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.088+0000 7fdc937fe640 1 --2- 172.21.15.44:0/256622219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc9409bd50 0x7fdc9409c130 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009d90 tx=0x7fdc8402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cf96f4b0436b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:58.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.088+0000 7fdc927fc640 1 -- 172.21.15.44:0/256622219 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc84007670 con 0x7fdc9409bd50 2024-09-21T09:06:58.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.088+0000 7fdc927fc640 1 -- 172.21.15.44:0/256622219 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc84007810 con 0x7fdc9409bd50 2024-09-21T09:06:58.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.088+0000 7fdc927fc640 1 -- 172.21.15.44:0/256622219 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc84007b10 con 0x7fdc9409bd50 2024-09-21T09:06:58.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.089+0000 7fdc99ff6640 1 -- 172.21.15.44:0/256622219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc9409bd50 msgr2=0x7fdc9409c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:58.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.089+0000 7fdc99ff6640 1 --2- 172.21.15.44:0/256622219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc9409bd50 0x7fdc9409c130 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009d90 tx=0x7fdc8402a660 comp rx=0 tx=0).stop 2024-09-21T09:06:58.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.089+0000 7fdc99ff6640 1 -- 172.21.15.44:0/256622219 shutdown_connections 2024-09-21T09:06:58.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.089+0000 7fdc99ff6640 1 --2- 172.21.15.44:0/256622219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc9409bd50 0x7fdc9409c130 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:58.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.089+0000 7fdc99ff6640 1 -- 172.21.15.44:0/256622219 >> 172.21.15.44:0/256622219 conn(0x7fdc9406d4a0 msgr2=0x7fdc9406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:58.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.089+0000 7fdc99ff6640 1 -- 172.21.15.44:0/256622219 shutdown_connections 2024-09-21T09:06:58.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.089+0000 7fdc99ff6640 1 -- 172.21.15.44:0/256622219 wait complete. 2024-09-21T09:06:58.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.090+0000 7fdc99ff6640 1 Processor -- start 2024-09-21T09:06:58.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.090+0000 7fdc99ff6640 1 -- start start 2024-09-21T09:06:58.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.090+0000 7fdc99ff6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc9409bd50 0x7fdc94094270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:58.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.090+0000 7fdc99ff6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdc94099b90 con 0x7fdc9409bd50 2024-09-21T09:06:58.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.091+0000 7fdc937fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc9409bd50 0x7fdc94094270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:58.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.091+0000 7fdc937fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc9409bd50 0x7fdc94094270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39788/0 (socket says 172.21.15.44:39788) 2024-09-21T09:06:58.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.091+0000 7fdc937fe640 1 -- 172.21.15.44:0/3175284923 learned_addr learned my addr 172.21.15.44:0/3175284923 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:06:58.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.091+0000 7fdc937fe640 1 -- 172.21.15.44:0/3175284923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc94096200 con 0x7fdc9409bd50 2024-09-21T09:06:58.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.091+0000 7fdc937fe640 1 --2- 172.21.15.44:0/3175284923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc9409bd50 0x7fdc94094270 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009d90 tx=0x7fdc84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:58.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.091+0000 7fdc7bfff640 1 -- 172.21.15.44:0/3175284923 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc84040070 con 0x7fdc9409bd50 2024-09-21T09:06:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.091+0000 7fdc7bfff640 1 -- 172.21.15.44:0/3175284923 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc84031a90 con 0x7fdc9409bd50 2024-09-21T09:06:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.091+0000 7fdc99ff6640 1 -- 172.21.15.44:0/3175284923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9409a760 con 0x7fdc9409bd50 2024-09-21T09:06:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.091+0000 7fdc7bfff640 1 -- 172.21.15.44:0/3175284923 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc84031d70 con 0x7fdc9409bd50 2024-09-21T09:06:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.091+0000 7fdc99ff6640 1 -- 172.21.15.44:0/3175284923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9406f2f0 con 0x7fdc9409bd50 2024-09-21T09:06:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.092+0000 7fdc7bfff640 1 -- 172.21.15.44:0/3175284923 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdc84039040 con 0x7fdc9409bd50 2024-09-21T09:06:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.092+0000 7fdc99ff6640 1 -- 172.21.15.44:0/3175284923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc9409a130 con 0x7fdc9409bd50 2024-09-21T09:06:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.092+0000 7fdc7bfff640 1 --2- 172.21.15.44:0/3175284923 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdc800382d0 0x7fdc8003a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:06:58.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.092+0000 7fdc7bfff640 1 -- 172.21.15.44:0/3175284923 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fdc8402ae00 con 0x7fdc9409bd50 2024-09-21T09:06:58.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.093+0000 7fdc92ffd640 1 --2- 172.21.15.44:0/3175284923 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdc800382d0 0x7fdc8003a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:06:58.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.093+0000 7fdc92ffd640 1 --2- 172.21.15.44:0/3175284923 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdc800382d0 0x7fdc8003a790 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdc88007fd0 tx=0x7fdc88007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:06:58.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.097+0000 7fdc7bfff640 1 -- 172.21.15.44:0/3175284923 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdc8403a3b0 con 0x7fdc9409bd50 2024-09-21T09:06:58.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.270+0000 7fdc99ff6640 1 -- 172.21.15.44:0/3175284923 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdc94095d60 con 0x7fdc800382d0 2024-09-21T09:06:58.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.285+0000 7fdc7bfff640 1 -- 172.21.15.44:0/3175284923 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661327 (secure 0 0 0) 0x7fdc94095d60 con 0x7fdc800382d0 2024-09-21T09:06:58.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:06:58.301 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-21T09:06:58.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.290+0000 7fdc99ff6640 1 -- 172.21.15.44:0/3175284923 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdc800382d0 msgr2=0x7fdc8003a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:58.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.290+0000 7fdc99ff6640 1 --2- 172.21.15.44:0/3175284923 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdc800382d0 0x7fdc8003a790 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdc88007fd0 tx=0x7fdc88007ac0 comp rx=0 tx=0).stop 2024-09-21T09:06:58.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.290+0000 7fdc99ff6640 1 -- 172.21.15.44:0/3175284923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc9409bd50 msgr2=0x7fdc94094270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:06:58.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.290+0000 7fdc99ff6640 1 --2- 172.21.15.44:0/3175284923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc9409bd50 0x7fdc94094270 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009d90 tx=0x7fdc84004a40 comp rx=0 tx=0).stop 2024-09-21T09:06:58.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.290+0000 7fdc99ff6640 1 -- 172.21.15.44:0/3175284923 shutdown_connections 2024-09-21T09:06:58.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.290+0000 7fdc99ff6640 1 --2- 172.21.15.44:0/3175284923 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fdc800382d0 0x7fdc8003a790 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:58.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.290+0000 7fdc99ff6640 1 --2- 172.21.15.44:0/3175284923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc9409bd50 0x7fdc94094270 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:06:58.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.290+0000 7fdc99ff6640 1 -- 172.21.15.44:0/3175284923 >> 172.21.15.44:0/3175284923 conn(0x7fdc9406d4a0 msgr2=0x7fdc9409eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:06:58.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.290+0000 7fdc99ff6640 1 -- 172.21.15.44:0/3175284923 shutdown_connections 2024-09-21T09:06:58.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:06:58.290+0000 7fdc99ff6640 1 -- 172.21.15.44:0/3175284923 wait complete. 2024-09-21T09:06:58.305 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-21T09:06:56.499251+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5097,"num_read_kb":4682,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2861,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4773,"ondisk_log_size":4773,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":123360,"kb_used_data":2784,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377364000,"statfs":{"total":386547056640,"available":386420736000,"internally_reserved":0,"allocated":2850816,"data_stored":1716104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":123397911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004267"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:05.695646+0000","last_change":"2024-09-21T09:03:38.283847+0000","last_active":"2024-09-21T09:05:05.695646+0000","last_peered":"2024-09-21T09:05:05.695646+0000","last_clean":"2024-09-21T09:05:05.695646+0000","last_became_active":"2024-09-21T09:03:38.283357+0000","last_became_peered":"2024-09-21T09:03:38.283357+0000","last_unstale":"2024-09-21T09:05:05.695646+0000","last_undegraded":"2024-09-21T09:05:05.695646+0000","last_fullsized":"2024-09-21T09:05:05.695646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'20","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.326848+0000","last_change":"2024-09-21T09:06:41.326875+0000","last_active":"2024-09-21T09:06:41.326848+0000","last_peered":"2024-09-21T09:06:41.326848+0000","last_clean":"2024-09-21T09:06:41.326848+0000","last_became_active":"2024-09-21T09:03:00.226067+0000","last_became_peered":"2024-09-21T09:03:00.226067+0000","last_unstale":"2024-09-21T09:06:41.326848+0000","last_undegraded":"2024-09-21T09:06:41.326848+0000","last_fullsized":"2024-09-21T09:06:41.326848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-09-21T09:06:41.326750+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-09-21T09:06:41.326750+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.326750+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:11.322304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453196+0000","last_change":"2024-09-21T09:02:58.213108+0000","last_active":"2024-09-21T09:05:02.453196+0000","last_peered":"2024-09-21T09:05:02.453196+0000","last_clean":"2024-09-21T09:05:02.453196+0000","last_became_active":"2024-09-21T09:02:58.212828+0000","last_became_peered":"2024-09-21T09:02:58.212828+0000","last_unstale":"2024-09-21T09:05:02.453196+0000","last_undegraded":"2024-09-21T09:05:02.453196+0000","last_fullsized":"2024-09-21T09:05:02.453196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.265814+0000","last_change":"2024-09-21T09:06:30.265847+0000","last_active":"2024-09-21T09:06:30.265814+0000","last_peered":"2024-09-21T09:06:30.265814+0000","last_clean":"2024-09-21T09:06:30.265814+0000","last_became_active":"2024-09-21T09:03:00.222333+0000","last_became_peered":"2024-09-21T09:03:00.222333+0000","last_unstale":"2024-09-21T09:06:30.265814+0000","last_undegraded":"2024-09-21T09:06:30.265814+0000","last_fullsized":"2024-09-21T09:06:30.265814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:30.265727+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:30.265727+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.265727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:36.517568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:03.457257+0000","last_change":"2024-09-21T09:02:58.221389+0000","last_active":"2024-09-21T09:05:03.457257+0000","last_peered":"2024-09-21T09:05:03.457257+0000","last_clean":"2024-09-21T09:05:03.457257+0000","last_became_active":"2024-09-21T09:02:58.221214+0000","last_became_peered":"2024-09-21T09:02:58.221214+0000","last_unstale":"2024-09-21T09:05:03.457257+0000","last_undegraded":"2024-09-21T09:05:03.457257+0000","last_fullsized":"2024-09-21T09:05:03.457257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.250533+0000","last_change":"2024-09-21T09:06:35.250559+0000","last_active":"2024-09-21T09:06:35.250533+0000","last_peered":"2024-09-21T09:06:35.250533+0000","last_clean":"2024-09-21T09:06:35.250533+0000","last_became_active":"2024-09-21T09:03:00.221451+0000","last_became_peered":"2024-09-21T09:03:00.221451+0000","last_unstale":"2024-09-21T09:06:35.250533+0000","last_undegraded":"2024-09-21T09:06:35.250533+0000","last_fullsized":"2024-09-21T09:06:35.250533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:35.250442+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:35.250442+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.250442+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:20.257549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.969982+0000","last_change":"2024-09-21T09:02:58.208725+0000","last_active":"2024-09-21T09:06:12.969982+0000","last_peered":"2024-09-21T09:06:12.969982+0000","last_clean":"2024-09-21T09:06:12.969982+0000","last_became_active":"2024-09-21T09:02:58.207683+0000","last_became_peered":"2024-09-21T09:02:58.207683+0000","last_unstale":"2024-09-21T09:06:12.969982+0000","last_undegraded":"2024-09-21T09:06:12.969982+0000","last_fullsized":"2024-09-21T09:06:12.969982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'9","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.413504+0000","last_change":"2024-09-21T09:03:00.212574+0000","last_active":"2024-09-21T09:06:06.413504+0000","last_peered":"2024-09-21T09:06:06.413504+0000","last_clean":"2024-09-21T09:06:06.413504+0000","last_became_active":"2024-09-21T09:03:00.210589+0000","last_became_peered":"2024-09-21T09:03:00.210589+0000","last_unstale":"2024-09-21T09:06:06.413504+0000","last_undegraded":"2024-09-21T09:06:06.413504+0000","last_fullsized":"2024-09-21T09:06:06.413504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"31'6","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.256245+0000","last_change":"2024-09-21T09:02:58.224906+0000","last_active":"2024-09-21T09:06:06.256245+0000","last_peered":"2024-09-21T09:06:06.256245+0000","last_clean":"2024-09-21T09:06:06.256245+0000","last_became_active":"2024-09-21T09:02:58.224630+0000","last_became_peered":"2024-09-21T09:02:58.224630+0000","last_unstale":"2024-09-21T09:06:06.256245+0000","last_undegraded":"2024-09-21T09:06:06.256245+0000","last_fullsized":"2024-09-21T09:06:06.256245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'6","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304050+0000","last_change":"2024-09-21T09:03:00.223960+0000","last_active":"2024-09-21T09:06:06.304050+0000","last_peered":"2024-09-21T09:06:06.304050+0000","last_clean":"2024-09-21T09:06:06.304050+0000","last_became_active":"2024-09-21T09:03:00.217048+0000","last_became_peered":"2024-09-21T09:03:00.217048+0000","last_unstale":"2024-09-21T09:06:06.304050+0000","last_undegraded":"2024-09-21T09:06:06.304050+0000","last_fullsized":"2024-09-21T09:06:06.304050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:27.457294+0000","last_change":"2024-09-21T09:02:58.205801+0000","last_active":"2024-09-21T09:05:27.457294+0000","last_peered":"2024-09-21T09:05:27.457294+0000","last_clean":"2024-09-21T09:05:27.457294+0000","last_became_active":"2024-09-21T09:02:58.205515+0000","last_became_peered":"2024-09-21T09:02:58.205515+0000","last_unstale":"2024-09-21T09:05:27.457294+0000","last_undegraded":"2024-09-21T09:05:27.457294+0000","last_fullsized":"2024-09-21T09:05:27.457294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'14","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.235166+0000","last_change":"2024-09-21T09:06:32.235193+0000","last_active":"2024-09-21T09:06:32.235166+0000","last_peered":"2024-09-21T09:06:32.235166+0000","last_clean":"2024-09-21T09:06:32.235166+0000","last_became_active":"2024-09-21T09:03:00.221117+0000","last_became_peered":"2024-09-21T09:03:00.221117+0000","last_unstale":"2024-09-21T09:06:32.235166+0000","last_undegraded":"2024-09-21T09:06:32.235166+0000","last_fullsized":"2024-09-21T09:06:32.235166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:32.235081+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:32.235081+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.235081+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:09.067914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.250827+0000","last_change":"2024-09-21T09:02:58.211066+0000","last_active":"2024-09-21T09:06:06.250827+0000","last_peered":"2024-09-21T09:06:06.250827+0000","last_clean":"2024-09-21T09:06:06.250827+0000","last_became_active":"2024-09-21T09:02:58.210702+0000","last_became_peered":"2024-09-21T09:02:58.210702+0000","last_unstale":"2024-09-21T09:06:06.250827+0000","last_undegraded":"2024-09-21T09:06:06.250827+0000","last_fullsized":"2024-09-21T09:06:06.250827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'10","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.841425+0000","last_change":"2024-09-21T09:06:43.841450+0000","last_active":"2024-09-21T09:06:43.841425+0000","last_peered":"2024-09-21T09:06:43.841425+0000","last_clean":"2024-09-21T09:06:43.841425+0000","last_became_active":"2024-09-21T09:03:00.220725+0000","last_became_peered":"2024-09-21T09:03:00.220725+0000","last_unstale":"2024-09-21T09:06:43.841425+0000","last_undegraded":"2024-09-21T09:06:43.841425+0000","last_fullsized":"2024-09-21T09:06:43.841425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:43.841334+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:43.841334+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.841334+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:18.385562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.951181+0000","last_change":"2024-09-21T09:06:48.951210+0000","last_active":"2024-09-21T09:06:48.951181+0000","last_peered":"2024-09-21T09:06:48.951181+0000","last_clean":"2024-09-21T09:06:48.951181+0000","last_became_active":"2024-09-21T09:02:58.216712+0000","last_became_peered":"2024-09-21T09:02:58.216712+0000","last_unstale":"2024-09-21T09:06:48.951181+0000","last_undegraded":"2024-09-21T09:06:48.951181+0000","last_fullsized":"2024-09-21T09:06:48.951181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:48.951088+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:48.951088+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.951088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:39.255743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'14","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.817641+0000","last_change":"2024-09-21T09:06:45.817668+0000","last_active":"2024-09-21T09:06:45.817641+0000","last_peered":"2024-09-21T09:06:45.817641+0000","last_clean":"2024-09-21T09:06:45.817641+0000","last_became_active":"2024-09-21T09:03:00.222593+0000","last_became_peered":"2024-09-21T09:03:00.222593+0000","last_unstale":"2024-09-21T09:06:45.817641+0000","last_undegraded":"2024-09-21T09:06:45.817641+0000","last_fullsized":"2024-09-21T09:06:45.817641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:45.817550+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:45.817550+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.817550+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:37.374671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'11","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.413929+0000","last_change":"2024-09-21T09:03:00.220191+0000","last_active":"2024-09-21T09:06:06.413929+0000","last_peered":"2024-09-21T09:06:06.413929+0000","last_clean":"2024-09-21T09:06:06.413929+0000","last_became_active":"2024-09-21T09:03:00.219923+0000","last_became_peered":"2024-09-21T09:03:00.219923+0000","last_unstale":"2024-09-21T09:06:06.413929+0000","last_undegraded":"2024-09-21T09:06:06.413929+0000","last_fullsized":"2024-09-21T09:06:06.413929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.457141+0000","last_change":"2024-09-21T09:02:58.212942+0000","last_active":"2024-09-21T09:05:22.457141+0000","last_peered":"2024-09-21T09:05:22.457141+0000","last_clean":"2024-09-21T09:05:22.457141+0000","last_became_active":"2024-09-21T09:02:58.210936+0000","last_became_peered":"2024-09-21T09:02:58.210936+0000","last_unstale":"2024-09-21T09:05:22.457141+0000","last_undegraded":"2024-09-21T09:05:22.457141+0000","last_fullsized":"2024-09-21T09:05:22.457141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456882+0000","last_change":"2024-09-21T09:03:00.225223+0000","last_active":"2024-09-21T09:05:22.456882+0000","last_peered":"2024-09-21T09:05:22.456882+0000","last_clean":"2024-09-21T09:05:22.456882+0000","last_became_active":"2024-09-21T09:03:00.224695+0000","last_became_peered":"2024-09-21T09:03:00.224695+0000","last_unstale":"2024-09-21T09:05:22.456882+0000","last_undegraded":"2024-09-21T09:05:22.456882+0000","last_fullsized":"2024-09-21T09:05:22.456882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'4","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.798146+0000","last_change":"2024-09-21T09:06:48.798173+0000","last_active":"2024-09-21T09:06:48.798146+0000","last_peered":"2024-09-21T09:06:48.798146+0000","last_clean":"2024-09-21T09:06:48.798146+0000","last_became_active":"2024-09-21T09:02:58.218643+0000","last_became_peered":"2024-09-21T09:02:58.218643+0000","last_unstale":"2024-09-21T09:06:48.798146+0000","last_undegraded":"2024-09-21T09:06:48.798146+0000","last_fullsized":"2024-09-21T09:06:48.798146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:48.798053+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:48.798053+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.798053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:18.793607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.262860+0000","last_change":"2024-09-21T09:06:36.262904+0000","last_active":"2024-09-21T09:06:36.262860+0000","last_peered":"2024-09-21T09:06:36.262860+0000","last_clean":"2024-09-21T09:06:36.262860+0000","last_became_active":"2024-09-21T09:03:00.226738+0000","last_became_peered":"2024-09-21T09:03:00.226738+0000","last_unstale":"2024-09-21T09:06:36.262860+0000","last_undegraded":"2024-09-21T09:06:36.262860+0000","last_fullsized":"2024-09-21T09:06:36.262860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:36.262757+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:36.262757+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.262757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:35.824400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.046927+0000","last_change":"2024-09-21T09:02:58.208501+0000","last_active":"2024-09-21T09:06:06.046927+0000","last_peered":"2024-09-21T09:06:06.046927+0000","last_clean":"2024-09-21T09:06:06.046927+0000","last_became_active":"2024-09-21T09:02:58.208220+0000","last_became_peered":"2024-09-21T09:02:58.208220+0000","last_unstale":"2024-09-21T09:06:06.046927+0000","last_undegraded":"2024-09-21T09:06:06.046927+0000","last_fullsized":"2024-09-21T09:06:06.046927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'16","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.914907+0000","last_change":"2024-09-21T09:06:47.914935+0000","last_active":"2024-09-21T09:06:47.914907+0000","last_peered":"2024-09-21T09:06:47.914907+0000","last_clean":"2024-09-21T09:06:47.914907+0000","last_became_active":"2024-09-21T09:03:00.215637+0000","last_became_peered":"2024-09-21T09:03:00.215637+0000","last_unstale":"2024-09-21T09:06:47.914907+0000","last_undegraded":"2024-09-21T09:06:47.914907+0000","last_fullsized":"2024-09-21T09:06:47.914907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-21T09:06:47.914812+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-21T09:06:47.914812+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.914812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:54.745182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.457016+0000","last_change":"2024-09-21T09:02:58.206160+0000","last_active":"2024-09-21T09:05:22.457016+0000","last_peered":"2024-09-21T09:05:22.457016+0000","last_clean":"2024-09-21T09:05:22.457016+0000","last_became_active":"2024-09-21T09:02:58.204603+0000","last_became_peered":"2024-09-21T09:02:58.204603+0000","last_unstale":"2024-09-21T09:05:22.457016+0000","last_undegraded":"2024-09-21T09:05:22.457016+0000","last_fullsized":"2024-09-21T09:05:22.457016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.848398+0000","last_change":"2024-09-21T09:06:49.848438+0000","last_active":"2024-09-21T09:06:49.848398+0000","last_peered":"2024-09-21T09:06:49.848398+0000","last_clean":"2024-09-21T09:06:49.848398+0000","last_became_active":"2024-09-21T09:03:00.222972+0000","last_became_peered":"2024-09-21T09:03:00.222972+0000","last_unstale":"2024-09-21T09:06:49.848398+0000","last_undegraded":"2024-09-21T09:06:49.848398+0000","last_fullsized":"2024-09-21T09:06:49.848398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:49.848287+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:49.848287+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.848287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:12.844393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456004+0000","last_change":"2024-09-21T09:02:58.208852+0000","last_active":"2024-09-21T09:05:22.456004+0000","last_peered":"2024-09-21T09:05:22.456004+0000","last_clean":"2024-09-21T09:05:22.456004+0000","last_became_active":"2024-09-21T09:02:58.208383+0000","last_became_peered":"2024-09-21T09:02:58.208383+0000","last_unstale":"2024-09-21T09:05:22.456004+0000","last_undegraded":"2024-09-21T09:05:22.456004+0000","last_fullsized":"2024-09-21T09:05:22.456004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.392358+0000","last_change":"2024-09-21T09:06:48.392419+0000","last_active":"2024-09-21T09:06:48.392358+0000","last_peered":"2024-09-21T09:06:48.392358+0000","last_clean":"2024-09-21T09:06:48.392358+0000","last_became_active":"2024-09-21T09:03:00.211942+0000","last_became_peered":"2024-09-21T09:03:00.211942+0000","last_unstale":"2024-09-21T09:06:48.392358+0000","last_undegraded":"2024-09-21T09:06:48.392358+0000","last_fullsized":"2024-09-21T09:06:48.392358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:48.392256+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:48.392256+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.392256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:01:04.152702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.459903+0000","last_change":"2024-09-21T09:02:58.214186+0000","last_active":"2024-09-21T09:05:18.459903+0000","last_peered":"2024-09-21T09:05:18.459903+0000","last_clean":"2024-09-21T09:05:18.459903+0000","last_became_active":"2024-09-21T09:02:58.213548+0000","last_became_peered":"2024-09-21T09:02:58.213548+0000","last_unstale":"2024-09-21T09:05:18.459903+0000","last_undegraded":"2024-09-21T09:05:18.459903+0000","last_fullsized":"2024-09-21T09:05:18.459903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.379275+0000","last_change":"2024-09-21T09:03:08.262655+0000","last_active":"2024-09-21T09:06:06.379275+0000","last_peered":"2024-09-21T09:06:06.379275+0000","last_clean":"2024-09-21T09:06:06.379275+0000","last_became_active":"2024-09-21T09:03:08.262362+0000","last_became_peered":"2024-09-21T09:03:08.262362+0000","last_unstale":"2024-09-21T09:06:06.379275+0000","last_undegraded":"2024-09-21T09:06:06.379275+0000","last_fullsized":"2024-09-21T09:06:06.379275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460724+0000","last_change":"2024-09-21T09:03:00.212668+0000","last_active":"2024-09-21T09:05:23.460724+0000","last_peered":"2024-09-21T09:05:23.460724+0000","last_clean":"2024-09-21T09:05:23.460724+0000","last_became_active":"2024-09-21T09:03:00.209346+0000","last_became_peered":"2024-09-21T09:03:00.209346+0000","last_unstale":"2024-09-21T09:05:23.460724+0000","last_undegraded":"2024-09-21T09:05:23.460724+0000","last_fullsized":"2024-09-21T09:05:23.460724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.459935+0000","last_change":"2024-09-21T09:02:58.221478+0000","last_active":"2024-09-21T09:05:18.459935+0000","last_peered":"2024-09-21T09:05:18.459935+0000","last_clean":"2024-09-21T09:05:18.459935+0000","last_became_active":"2024-09-21T09:02:58.221187+0000","last_became_peered":"2024-09-21T09:02:58.221187+0000","last_unstale":"2024-09-21T09:05:18.459935+0000","last_undegraded":"2024-09-21T09:05:18.459935+0000","last_fullsized":"2024-09-21T09:05:18.459935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.340714+0000","last_change":"2024-09-21T09:06:20.340738+0000","last_active":"2024-09-21T09:06:20.340714+0000","last_peered":"2024-09-21T09:06:20.340714+0000","last_clean":"2024-09-21T09:06:20.340714+0000","last_became_active":"2024-09-21T09:03:02.220370+0000","last_became_peered":"2024-09-21T09:03:02.220370+0000","last_unstale":"2024-09-21T09:06:20.340714+0000","last_undegraded":"2024-09-21T09:06:20.340714+0000","last_fullsized":"2024-09-21T09:06:20.340714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:20.340586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:20.340586+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.340586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:30.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.319454+0000","last_change":"2024-09-21T09:06:44.319493+0000","last_active":"2024-09-21T09:06:44.319454+0000","last_peered":"2024-09-21T09:06:44.319454+0000","last_clean":"2024-09-21T09:06:44.319454+0000","last_became_active":"2024-09-21T09:03:04.242637+0000","last_became_peered":"2024-09-21T09:03:04.242637+0000","last_unstale":"2024-09-21T09:06:44.319454+0000","last_undegraded":"2024-09-21T09:06:44.319454+0000","last_fullsized":"2024-09-21T09:06:44.319454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-21T09:06:44.319357+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-21T09:06:44.319357+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.319357+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:39.099160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.513447+0000","last_change":"2024-09-21T09:06:16.513487+0000","last_active":"2024-09-21T09:06:16.513447+0000","last_peered":"2024-09-21T09:06:16.513447+0000","last_clean":"2024-09-21T09:06:16.513447+0000","last_became_active":"2024-09-21T09:03:06.247203+0000","last_became_peered":"2024-09-21T09:03:06.247203+0000","last_unstale":"2024-09-21T09:06:16.513447+0000","last_undegraded":"2024-09-21T09:06:16.513447+0000","last_fullsized":"2024-09-21T09:06:16.513447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.513331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.513331+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.513331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:05:45.010706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.468926+0000","last_change":"2024-09-21T09:03:08.262677+0000","last_active":"2024-09-21T09:06:06.468926+0000","last_peered":"2024-09-21T09:06:06.468926+0000","last_clean":"2024-09-21T09:06:06.468926+0000","last_became_active":"2024-09-21T09:03:08.262384+0000","last_became_peered":"2024-09-21T09:03:08.262384+0000","last_unstale":"2024-09-21T09:06:06.468926+0000","last_undegraded":"2024-09-21T09:06:06.468926+0000","last_fullsized":"2024-09-21T09:06:06.468926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'8","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304828+0000","last_change":"2024-09-21T09:03:00.218848+0000","last_active":"2024-09-21T09:06:06.304828+0000","last_peered":"2024-09-21T09:06:06.304828+0000","last_clean":"2024-09-21T09:06:06.304828+0000","last_became_active":"2024-09-21T09:03:00.217658+0000","last_became_peered":"2024-09-21T09:03:00.217658+0000","last_unstale":"2024-09-21T09:06:06.304828+0000","last_undegraded":"2024-09-21T09:06:06.304828+0000","last_fullsized":"2024-09-21T09:06:06.304828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.455834+0000","last_change":"2024-09-21T09:02:58.218614+0000","last_active":"2024-09-21T09:05:17.455834+0000","last_peered":"2024-09-21T09:05:17.455834+0000","last_clean":"2024-09-21T09:05:17.455834+0000","last_became_active":"2024-09-21T09:02:58.218086+0000","last_became_peered":"2024-09-21T09:02:58.218086+0000","last_unstale":"2024-09-21T09:05:17.455834+0000","last_undegraded":"2024-09-21T09:05:17.455834+0000","last_fullsized":"2024-09-21T09:05:17.455834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.944198+0000","last_change":"2024-09-21T09:06:38.944223+0000","last_active":"2024-09-21T09:06:38.944198+0000","last_peered":"2024-09-21T09:06:38.944198+0000","last_clean":"2024-09-21T09:06:38.944198+0000","last_became_active":"2024-09-21T09:03:02.220557+0000","last_became_peered":"2024-09-21T09:03:02.220557+0000","last_unstale":"2024-09-21T09:06:38.944198+0000","last_undegraded":"2024-09-21T09:06:38.944198+0000","last_fullsized":"2024-09-21T09:06:38.944198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:38.944114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:38.944114+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.944114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:28.572358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'9","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.494942+0000","last_change":"2024-09-21T09:06:22.495014+0000","last_active":"2024-09-21T09:06:22.494942+0000","last_peered":"2024-09-21T09:06:22.494942+0000","last_clean":"2024-09-21T09:06:22.494942+0000","last_became_active":"2024-09-21T09:03:04.236037+0000","last_became_peered":"2024-09-21T09:03:04.236037+0000","last_unstale":"2024-09-21T09:06:22.494942+0000","last_undegraded":"2024-09-21T09:06:22.494942+0000","last_fullsized":"2024-09-21T09:06:22.494942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-21T09:06:22.494847+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-21T09:06:22.494847+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.494847+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:55.904900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.478799+0000","last_change":"2024-09-21T09:06:18.478831+0000","last_active":"2024-09-21T09:06:18.478799+0000","last_peered":"2024-09-21T09:06:18.478799+0000","last_clean":"2024-09-21T09:06:18.478799+0000","last_became_active":"2024-09-21T09:03:06.243901+0000","last_became_peered":"2024-09-21T09:03:06.243901+0000","last_unstale":"2024-09-21T09:06:18.478799+0000","last_undegraded":"2024-09-21T09:06:18.478799+0000","last_fullsized":"2024-09-21T09:06:18.478799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.478706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.478706+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.478706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:41.502223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:37.458160+0000","last_change":"2024-09-21T09:03:08.250364+0000","last_active":"2024-09-21T09:05:37.458160+0000","last_peered":"2024-09-21T09:05:37.458160+0000","last_clean":"2024-09-21T09:05:37.458160+0000","last_became_active":"2024-09-21T09:03:08.250029+0000","last_became_peered":"2024-09-21T09:03:08.250029+0000","last_unstale":"2024-09-21T09:05:37.458160+0000","last_undegraded":"2024-09-21T09:05:37.458160+0000","last_fullsized":"2024-09-21T09:05:37.458160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.267380+0000","last_change":"2024-09-21T09:03:00.217928+0000","last_active":"2024-09-21T09:06:06.267380+0000","last_peered":"2024-09-21T09:06:06.267380+0000","last_clean":"2024-09-21T09:06:06.267380+0000","last_became_active":"2024-09-21T09:03:00.217633+0000","last_became_peered":"2024-09-21T09:03:00.217633+0000","last_unstale":"2024-09-21T09:06:06.267380+0000","last_undegraded":"2024-09-21T09:06:06.267380+0000","last_fullsized":"2024-09-21T09:06:06.267380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.459862+0000","last_change":"2024-09-21T09:02:58.220432+0000","last_active":"2024-09-21T09:05:18.459862+0000","last_peered":"2024-09-21T09:05:18.459862+0000","last_clean":"2024-09-21T09:05:18.459862+0000","last_became_active":"2024-09-21T09:02:58.220133+0000","last_became_peered":"2024-09-21T09:02:58.220133+0000","last_unstale":"2024-09-21T09:05:18.459862+0000","last_undegraded":"2024-09-21T09:05:18.459862+0000","last_fullsized":"2024-09-21T09:05:18.459862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.974441+0000","last_change":"2024-09-21T09:06:39.974481+0000","last_active":"2024-09-21T09:06:39.974441+0000","last_peered":"2024-09-21T09:06:39.974441+0000","last_clean":"2024-09-21T09:06:39.974441+0000","last_became_active":"2024-09-21T09:03:02.219457+0000","last_became_peered":"2024-09-21T09:03:02.219457+0000","last_unstale":"2024-09-21T09:06:39.974441+0000","last_undegraded":"2024-09-21T09:06:39.974441+0000","last_fullsized":"2024-09-21T09:06:39.974441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:39.974313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:39.974313+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.974313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:26.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.828407+0000","last_change":"2024-09-21T09:06:24.828475+0000","last_active":"2024-09-21T09:06:24.828407+0000","last_peered":"2024-09-21T09:06:24.828407+0000","last_clean":"2024-09-21T09:06:24.828407+0000","last_became_active":"2024-09-21T09:03:04.239187+0000","last_became_peered":"2024-09-21T09:03:04.239187+0000","last_unstale":"2024-09-21T09:06:24.828407+0000","last_undegraded":"2024-09-21T09:06:24.828407+0000","last_fullsized":"2024-09-21T09:06:24.828407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-21T09:06:24.828300+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-21T09:06:24.828300+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.828300+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:54.045825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'285","reported_seq":396,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.260343+0000","last_change":"2024-09-21T09:06:40.260368+0000","last_active":"2024-09-21T09:06:40.260343+0000","last_peered":"2024-09-21T09:06:40.260343+0000","last_clean":"2024-09-21T09:06:40.260343+0000","last_became_active":"2024-09-21T09:03:06.247441+0000","last_became_peered":"2024-09-21T09:03:06.247441+0000","last_unstale":"2024-09-21T09:06:40.260343+0000","last_undegraded":"2024-09-21T09:06:40.260343+0000","last_fullsized":"2024-09-21T09:06:40.260343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:40.260235+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:40.260235+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.260235+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:24.594105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.811807+0000","last_change":"2024-09-21T09:06:33.811859+0000","last_active":"2024-09-21T09:06:33.811807+0000","last_peered":"2024-09-21T09:06:33.811807+0000","last_clean":"2024-09-21T09:06:33.811807+0000","last_became_active":"2024-09-21T09:03:08.255274+0000","last_became_peered":"2024-09-21T09:03:08.255274+0000","last_unstale":"2024-09-21T09:06:33.811807+0000","last_undegraded":"2024-09-21T09:06:33.811807+0000","last_fullsized":"2024-09-21T09:06:33.811807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:33.811708+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:33.811708+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.811708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:39.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.181754+0000","last_change":"2024-09-21T09:03:00.216751+0000","last_active":"2024-09-21T09:06:06.181754+0000","last_peered":"2024-09-21T09:06:06.181754+0000","last_clean":"2024-09-21T09:06:06.181754+0000","last_became_active":"2024-09-21T09:03:00.216382+0000","last_became_peered":"2024-09-21T09:03:00.216382+0000","last_unstale":"2024-09-21T09:06:06.181754+0000","last_undegraded":"2024-09-21T09:06:06.181754+0000","last_fullsized":"2024-09-21T09:06:06.181754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.456029+0000","last_change":"2024-09-21T09:02:58.210831+0000","last_active":"2024-09-21T09:05:17.456029+0000","last_peered":"2024-09-21T09:05:17.456029+0000","last_clean":"2024-09-21T09:05:17.456029+0000","last_became_active":"2024-09-21T09:02:58.210560+0000","last_became_peered":"2024-09-21T09:02:58.210560+0000","last_unstale":"2024-09-21T09:05:17.456029+0000","last_undegraded":"2024-09-21T09:05:17.456029+0000","last_fullsized":"2024-09-21T09:05:17.456029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.409747+0000","last_change":"2024-09-21T09:06:18.409771+0000","last_active":"2024-09-21T09:06:18.409747+0000","last_peered":"2024-09-21T09:06:18.409747+0000","last_clean":"2024-09-21T09:06:18.409747+0000","last_became_active":"2024-09-21T09:03:02.220551+0000","last_became_peered":"2024-09-21T09:03:02.220551+0000","last_unstale":"2024-09-21T09:06:18.409747+0000","last_undegraded":"2024-09-21T09:06:18.409747+0000","last_fullsized":"2024-09-21T09:06:18.409747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.409649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.409649+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.409649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:27:47.530462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.771634+0000","last_change":"2024-09-21T09:06:28.771672+0000","last_active":"2024-09-21T09:06:28.771634+0000","last_peered":"2024-09-21T09:06:28.771634+0000","last_clean":"2024-09-21T09:06:28.771634+0000","last_became_active":"2024-09-21T09:03:04.233848+0000","last_became_peered":"2024-09-21T09:03:04.233848+0000","last_unstale":"2024-09-21T09:06:28.771634+0000","last_undegraded":"2024-09-21T09:06:28.771634+0000","last_fullsized":"2024-09-21T09:06:28.771634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-21T09:06:28.771549+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-21T09:06:28.771549+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.771549+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:21.809857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'285","reported_seq":412,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.666749+0000","last_change":"2024-09-21T09:06:20.666787+0000","last_active":"2024-09-21T09:06:20.666749+0000","last_peered":"2024-09-21T09:06:20.666749+0000","last_clean":"2024-09-21T09:06:20.666749+0000","last_became_active":"2024-09-21T09:03:06.243576+0000","last_became_peered":"2024-09-21T09:03:06.243576+0000","last_unstale":"2024-09-21T09:06:20.666749+0000","last_undegraded":"2024-09-21T09:06:20.666749+0000","last_fullsized":"2024-09-21T09:06:20.666749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:20.666653+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:20.666653+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.666653+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:13.704961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:13.458902+0000","last_change":"2024-09-21T09:03:00.217801+0000","last_active":"2024-09-21T09:05:13.458902+0000","last_peered":"2024-09-21T09:05:13.458902+0000","last_clean":"2024-09-21T09:05:13.458902+0000","last_became_active":"2024-09-21T09:03:00.217545+0000","last_became_peered":"2024-09-21T09:03:00.217545+0000","last_unstale":"2024-09-21T09:05:13.458902+0000","last_undegraded":"2024-09-21T09:05:13.458902+0000","last_fullsized":"2024-09-21T09:05:13.458902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455345+0000","last_change":"2024-09-21T09:02:58.209991+0000","last_active":"2024-09-21T09:05:12.455345+0000","last_peered":"2024-09-21T09:05:12.455345+0000","last_clean":"2024-09-21T09:05:12.455345+0000","last_became_active":"2024-09-21T09:02:58.209712+0000","last_became_peered":"2024-09-21T09:02:58.209712+0000","last_unstale":"2024-09-21T09:05:12.455345+0000","last_undegraded":"2024-09-21T09:05:12.455345+0000","last_fullsized":"2024-09-21T09:05:12.455345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"31'2","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.322589+0000","last_change":"2024-09-21T09:06:32.322635+0000","last_active":"2024-09-21T09:06:32.322589+0000","last_peered":"2024-09-21T09:06:32.322589+0000","last_clean":"2024-09-21T09:06:32.322589+0000","last_became_active":"2024-09-21T09:03:02.220629+0000","last_became_peered":"2024-09-21T09:03:02.220629+0000","last_unstale":"2024-09-21T09:06:32.322589+0000","last_undegraded":"2024-09-21T09:06:32.322589+0000","last_fullsized":"2024-09-21T09:06:32.322589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:32.322492+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:32.322492+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.322492+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:05.196838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'51","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.776033+0000","last_change":"2024-09-21T09:06:30.776075+0000","last_active":"2024-09-21T09:06:30.776033+0000","last_peered":"2024-09-21T09:06:30.776033+0000","last_clean":"2024-09-21T09:06:30.776033+0000","last_became_active":"2024-09-21T09:03:04.232394+0000","last_became_peered":"2024-09-21T09:03:04.232394+0000","last_unstale":"2024-09-21T09:06:30.776033+0000","last_undegraded":"2024-09-21T09:06:30.776033+0000","last_fullsized":"2024-09-21T09:06:30.776033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2024-09-21T09:06:30.775947+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2024-09-21T09:06:30.775947+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.775947+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:12.569145+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.694297+0000","last_change":"2024-09-21T09:06:18.694322+0000","last_active":"2024-09-21T09:06:18.694297+0000","last_peered":"2024-09-21T09:06:18.694297+0000","last_clean":"2024-09-21T09:06:18.694297+0000","last_became_active":"2024-09-21T09:03:06.244259+0000","last_became_peered":"2024-09-21T09:03:06.244259+0000","last_unstale":"2024-09-21T09:06:18.694297+0000","last_undegraded":"2024-09-21T09:06:18.694297+0000","last_fullsized":"2024-09-21T09:06:18.694297+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.694207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.694207+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.694207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:38.655887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'3","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455232+0000","last_change":"2024-09-21T09:03:08.261530+0000","last_active":"2024-09-21T09:05:12.455232+0000","last_peered":"2024-09-21T09:05:12.455232+0000","last_clean":"2024-09-21T09:05:12.455232+0000","last_became_active":"2024-09-21T09:03:08.261035+0000","last_became_peered":"2024-09-21T09:03:08.261035+0000","last_unstale":"2024-09-21T09:05:12.455232+0000","last_undegraded":"2024-09-21T09:05:12.455232+0000","last_fullsized":"2024-09-21T09:05:12.455232+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.375995+0000","last_change":"2024-09-21T09:06:49.376033+0000","last_active":"2024-09-21T09:06:49.375995+0000","last_peered":"2024-09-21T09:06:49.375995+0000","last_clean":"2024-09-21T09:06:49.375995+0000","last_became_active":"2024-09-21T09:03:00.219765+0000","last_became_peered":"2024-09-21T09:03:00.219765+0000","last_unstale":"2024-09-21T09:06:49.375995+0000","last_undegraded":"2024-09-21T09:06:49.375995+0000","last_fullsized":"2024-09-21T09:06:49.375995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:06:49.375904+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:06:49.375904+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.375904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:39.680559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455300+0000","last_change":"2024-09-21T09:02:58.214776+0000","last_active":"2024-09-21T09:05:12.455300+0000","last_peered":"2024-09-21T09:05:12.455300+0000","last_clean":"2024-09-21T09:05:12.455300+0000","last_became_active":"2024-09-21T09:02:58.214392+0000","last_became_peered":"2024-09-21T09:02:58.214392+0000","last_unstale":"2024-09-21T09:05:12.455300+0000","last_undegraded":"2024-09-21T09:05:12.455300+0000","last_fullsized":"2024-09-21T09:05:12.455300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.778703+0000","last_change":"2024-09-21T09:06:31.778729+0000","last_active":"2024-09-21T09:06:31.778703+0000","last_peered":"2024-09-21T09:06:31.778703+0000","last_clean":"2024-09-21T09:06:31.778703+0000","last_became_active":"2024-09-21T09:03:02.223123+0000","last_became_peered":"2024-09-21T09:03:02.223123+0000","last_unstale":"2024-09-21T09:06:31.778703+0000","last_undegraded":"2024-09-21T09:06:31.778703+0000","last_fullsized":"2024-09-21T09:06:31.778703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:31.778616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:31.778616+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.778616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:58.139384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'38","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.295721+0000","last_change":"2024-09-21T09:06:47.295753+0000","last_active":"2024-09-21T09:06:47.295721+0000","last_peered":"2024-09-21T09:06:47.295721+0000","last_clean":"2024-09-21T09:06:47.295721+0000","last_became_active":"2024-09-21T09:03:04.242404+0000","last_became_peered":"2024-09-21T09:03:04.242404+0000","last_unstale":"2024-09-21T09:06:47.295721+0000","last_undegraded":"2024-09-21T09:06:47.295721+0000","last_fullsized":"2024-09-21T09:06:47.295721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2024-09-21T09:06:47.295625+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2024-09-21T09:06:47.295625+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.295625+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:04.223317+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.680859+0000","last_change":"2024-09-21T09:06:21.680884+0000","last_active":"2024-09-21T09:06:21.680859+0000","last_peered":"2024-09-21T09:06:21.680859+0000","last_clean":"2024-09-21T09:06:21.680859+0000","last_became_active":"2024-09-21T09:03:06.247504+0000","last_became_peered":"2024-09-21T09:03:06.247504+0000","last_unstale":"2024-09-21T09:06:21.680859+0000","last_undegraded":"2024-09-21T09:06:21.680859+0000","last_fullsized":"2024-09-21T09:06:21.680859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:21.680751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:21.680751+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.680751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:07.979811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'4","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.320177+0000","last_change":"2024-09-21T09:06:39.320208+0000","last_active":"2024-09-21T09:06:39.320177+0000","last_peered":"2024-09-21T09:06:39.320177+0000","last_clean":"2024-09-21T09:06:39.320177+0000","last_became_active":"2024-09-21T09:03:08.255814+0000","last_became_peered":"2024-09-21T09:03:08.255814+0000","last_unstale":"2024-09-21T09:06:39.320177+0000","last_undegraded":"2024-09-21T09:06:39.320177+0000","last_fullsized":"2024-09-21T09:06:39.320177+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:39.320081+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:39.320081+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.320081+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:28.948326+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.796133+0000","last_change":"2024-09-21T09:06:47.796153+0000","last_active":"2024-09-21T09:06:47.796133+0000","last_peered":"2024-09-21T09:06:47.796133+0000","last_clean":"2024-09-21T09:06:47.796133+0000","last_became_active":"2024-09-21T09:03:00.222650+0000","last_became_peered":"2024-09-21T09:03:00.222650+0000","last_unstale":"2024-09-21T09:06:47.796133+0000","last_undegraded":"2024-09-21T09:06:47.796133+0000","last_fullsized":"2024-09-21T09:06:47.796133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:47.796026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:47.796026+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.796026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:34.626930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:13.459036+0000","last_change":"2024-09-21T09:02:58.213931+0000","last_active":"2024-09-21T09:05:13.459036+0000","last_peered":"2024-09-21T09:05:13.459036+0000","last_clean":"2024-09-21T09:05:13.459036+0000","last_became_active":"2024-09-21T09:02:58.213652+0000","last_became_peered":"2024-09-21T09:02:58.213652+0000","last_unstale":"2024-09-21T09:05:13.459036+0000","last_undegraded":"2024-09-21T09:05:13.459036+0000","last_fullsized":"2024-09-21T09:05:13.459036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:52.460743+0000","last_change":"2024-09-21T09:03:38.281879+0000","last_active":"2024-09-21T09:05:52.460743+0000","last_peered":"2024-09-21T09:05:52.460743+0000","last_clean":"2024-09-21T09:05:52.460743+0000","last_became_active":"2024-09-21T09:03:38.281497+0000","last_became_peered":"2024-09-21T09:03:38.281497+0000","last_unstale":"2024-09-21T09:05:52.460743+0000","last_undegraded":"2024-09-21T09:05:52.460743+0000","last_fullsized":"2024-09-21T09:05:52.460743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"31'45","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.362380+0000","last_change":"2024-09-21T09:06:25.362435+0000","last_active":"2024-09-21T09:06:25.362380+0000","last_peered":"2024-09-21T09:06:25.362380+0000","last_clean":"2024-09-21T09:06:25.362380+0000","last_became_active":"2024-09-21T09:03:04.240144+0000","last_became_peered":"2024-09-21T09:03:04.240144+0000","last_unstale":"2024-09-21T09:06:25.362380+0000","last_undegraded":"2024-09-21T09:06:25.362380+0000","last_fullsized":"2024-09-21T09:06:25.362380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-09-21T09:06:25.362285+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-09-21T09:06:25.362285+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.362285+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:00.748484+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'285","reported_seq":359,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.980231+0000","last_change":"2024-09-21T09:06:41.980274+0000","last_active":"2024-09-21T09:06:41.980231+0000","last_peered":"2024-09-21T09:06:41.980231+0000","last_clean":"2024-09-21T09:06:41.980231+0000","last_became_active":"2024-09-21T09:03:06.250807+0000","last_became_peered":"2024-09-21T09:03:06.250807+0000","last_unstale":"2024-09-21T09:06:41.980231+0000","last_undegraded":"2024-09-21T09:06:41.980231+0000","last_fullsized":"2024-09-21T09:06:41.980231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:41.980137+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:41.980137+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.980137+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:04.976243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.924367+0000","last_change":"2024-09-21T09:06:45.924395+0000","last_active":"2024-09-21T09:06:45.924367+0000","last_peered":"2024-09-21T09:06:45.924367+0000","last_clean":"2024-09-21T09:06:45.924367+0000","last_became_active":"2024-09-21T09:03:08.250063+0000","last_became_peered":"2024-09-21T09:03:08.250063+0000","last_unstale":"2024-09-21T09:06:45.924367+0000","last_undegraded":"2024-09-21T09:06:45.924367+0000","last_fullsized":"2024-09-21T09:06:45.924367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:45.924274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:45.924274+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.924274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:08.933691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'14","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.881288+0000","last_change":"2024-09-21T09:06:40.881315+0000","last_active":"2024-09-21T09:06:40.881288+0000","last_peered":"2024-09-21T09:06:40.881288+0000","last_clean":"2024-09-21T09:06:40.881288+0000","last_became_active":"2024-09-21T09:03:00.216544+0000","last_became_peered":"2024-09-21T09:03:00.216544+0000","last_unstale":"2024-09-21T09:06:40.881288+0000","last_undegraded":"2024-09-21T09:06:40.881288+0000","last_fullsized":"2024-09-21T09:06:40.881288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:40.881198+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:40.881198+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.881198+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:32:13.994520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:13.458994+0000","last_change":"2024-09-21T09:02:58.224993+0000","last_active":"2024-09-21T09:05:13.458994+0000","last_peered":"2024-09-21T09:05:13.458994+0000","last_clean":"2024-09-21T09:05:13.458994+0000","last_became_active":"2024-09-21T09:02:58.224675+0000","last_became_peered":"2024-09-21T09:02:58.224675+0000","last_unstale":"2024-09-21T09:05:13.458994+0000","last_undegraded":"2024-09-21T09:05:13.458994+0000","last_fullsized":"2024-09-21T09:05:13.458994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.771504+0000","last_change":"2024-09-21T09:06:32.771529+0000","last_active":"2024-09-21T09:06:32.771504+0000","last_peered":"2024-09-21T09:06:32.771504+0000","last_clean":"2024-09-21T09:06:32.771504+0000","last_became_active":"2024-09-21T09:03:02.222904+0000","last_became_peered":"2024-09-21T09:03:02.222904+0000","last_unstale":"2024-09-21T09:06:32.771504+0000","last_undegraded":"2024-09-21T09:06:32.771504+0000","last_fullsized":"2024-09-21T09:06:32.771504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:32.771408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:32.771408+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.771408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:47.808559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'67","reported_seq":140,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:50.298047+0000","last_change":"2024-09-21T09:06:50.298082+0000","last_active":"2024-09-21T09:06:50.298047+0000","last_peered":"2024-09-21T09:06:50.298047+0000","last_clean":"2024-09-21T09:06:50.298047+0000","last_became_active":"2024-09-21T09:03:04.241679+0000","last_became_peered":"2024-09-21T09:03:04.241679+0000","last_unstale":"2024-09-21T09:06:50.298047+0000","last_undegraded":"2024-09-21T09:06:50.298047+0000","last_fullsized":"2024-09-21T09:06:50.298047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'67","last_scrub_stamp":"2024-09-21T09:06:50.297956+0000","last_deep_scrub":"31'67","last_deep_scrub_stamp":"2024-09-21T09:06:50.297956+0000","last_clean_scrub_stamp":"2024-09-21T09:06:50.297956+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:04.079875+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.788871+0000","last_change":"2024-09-21T09:06:33.788942+0000","last_active":"2024-09-21T09:06:33.788871+0000","last_peered":"2024-09-21T09:06:33.788871+0000","last_clean":"2024-09-21T09:06:33.788871+0000","last_became_active":"2024-09-21T09:03:06.249377+0000","last_became_peered":"2024-09-21T09:03:06.249377+0000","last_unstale":"2024-09-21T09:06:33.788871+0000","last_undegraded":"2024-09-21T09:06:33.788871+0000","last_fullsized":"2024-09-21T09:06:33.788871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:33.788739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:33.788739+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.788739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:57.255671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'22","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.459659+0000","last_change":"2024-09-21T09:03:08.260431+0000","last_active":"2024-09-21T09:06:06.459659+0000","last_peered":"2024-09-21T09:06:06.459659+0000","last_clean":"2024-09-21T09:06:06.459659+0000","last_became_active":"2024-09-21T09:03:08.260071+0000","last_became_peered":"2024-09-21T09:03:08.260071+0000","last_unstale":"2024-09-21T09:06:06.459659+0000","last_undegraded":"2024-09-21T09:06:06.459659+0000","last_fullsized":"2024-09-21T09:06:06.459659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.456204+0000","last_change":"2024-09-21T09:03:00.223450+0000","last_active":"2024-09-21T09:05:17.456204+0000","last_peered":"2024-09-21T09:05:17.456204+0000","last_clean":"2024-09-21T09:05:17.456204+0000","last_became_active":"2024-09-21T09:03:00.223184+0000","last_became_peered":"2024-09-21T09:03:00.223184+0000","last_unstale":"2024-09-21T09:05:17.456204+0000","last_undegraded":"2024-09-21T09:05:17.456204+0000","last_fullsized":"2024-09-21T09:05:17.456204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.030686+0000","last_change":"2024-09-21T09:06:51.030713+0000","last_active":"2024-09-21T09:06:51.030686+0000","last_peered":"2024-09-21T09:06:51.030686+0000","last_clean":"2024-09-21T09:06:51.030686+0000","last_became_active":"2024-09-21T09:02:58.216545+0000","last_became_peered":"2024-09-21T09:02:58.216545+0000","last_unstale":"2024-09-21T09:06:51.030686+0000","last_undegraded":"2024-09-21T09:06:51.030686+0000","last_fullsized":"2024-09-21T09:06:51.030686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:51.030555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:51.030555+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.030555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.507576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.793683+0000","last_change":"2024-09-21T09:06:35.793708+0000","last_active":"2024-09-21T09:06:35.793683+0000","last_peered":"2024-09-21T09:06:35.793683+0000","last_clean":"2024-09-21T09:06:35.793683+0000","last_became_active":"2024-09-21T09:03:02.221352+0000","last_became_peered":"2024-09-21T09:03:02.221352+0000","last_unstale":"2024-09-21T09:06:35.793683+0000","last_undegraded":"2024-09-21T09:06:35.793683+0000","last_fullsized":"2024-09-21T09:06:35.793683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:35.793591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:35.793591+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.793591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:20:03.333500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'39","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.403363+0000","last_change":"2024-09-21T09:06:25.403421+0000","last_active":"2024-09-21T09:06:25.403363+0000","last_peered":"2024-09-21T09:06:25.403363+0000","last_clean":"2024-09-21T09:06:25.403363+0000","last_became_active":"2024-09-21T09:03:04.234750+0000","last_became_peered":"2024-09-21T09:03:04.234750+0000","last_unstale":"2024-09-21T09:06:25.403363+0000","last_undegraded":"2024-09-21T09:06:25.403363+0000","last_fullsized":"2024-09-21T09:06:25.403363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-21T09:06:25.403243+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-21T09:06:25.403243+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.403243+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:10.523882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.288196+0000","last_change":"2024-09-21T09:06:41.288220+0000","last_active":"2024-09-21T09:06:41.288196+0000","last_peered":"2024-09-21T09:06:41.288196+0000","last_clean":"2024-09-21T09:06:41.288196+0000","last_became_active":"2024-09-21T09:03:06.248453+0000","last_became_peered":"2024-09-21T09:03:06.248453+0000","last_unstale":"2024-09-21T09:06:41.288196+0000","last_undegraded":"2024-09-21T09:06:41.288196+0000","last_fullsized":"2024-09-21T09:06:41.288196+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:41.288107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:41.288107+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.288107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:34:02.945842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.416855+0000","last_change":"2024-09-21T09:03:08.260732+0000","last_active":"2024-09-21T09:06:06.416855+0000","last_peered":"2024-09-21T09:06:06.416855+0000","last_clean":"2024-09-21T09:06:06.416855+0000","last_became_active":"2024-09-21T09:03:08.260016+0000","last_became_peered":"2024-09-21T09:03:08.260016+0000","last_unstale":"2024-09-21T09:06:06.416855+0000","last_undegraded":"2024-09-21T09:06:06.416855+0000","last_fullsized":"2024-09-21T09:06:06.416855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'10","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.274976+0000","last_change":"2024-09-21T09:06:34.275028+0000","last_active":"2024-09-21T09:06:34.274976+0000","last_peered":"2024-09-21T09:06:34.274976+0000","last_clean":"2024-09-21T09:06:34.274976+0000","last_became_active":"2024-09-21T09:03:00.220384+0000","last_became_peered":"2024-09-21T09:03:00.220384+0000","last_unstale":"2024-09-21T09:06:34.274976+0000","last_undegraded":"2024-09-21T09:06:34.274976+0000","last_fullsized":"2024-09-21T09:06:34.274976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:34.274878+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:34.274878+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.274878+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:09.374069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458165+0000","last_change":"2024-09-21T09:02:58.214415+0000","last_active":"2024-09-21T09:05:08.458165+0000","last_peered":"2024-09-21T09:05:08.458165+0000","last_clean":"2024-09-21T09:05:08.458165+0000","last_became_active":"2024-09-21T09:02:58.213920+0000","last_became_peered":"2024-09-21T09:02:58.213920+0000","last_unstale":"2024-09-21T09:05:08.458165+0000","last_undegraded":"2024-09-21T09:05:08.458165+0000","last_fullsized":"2024-09-21T09:05:08.458165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.986320+0000","last_change":"2024-09-21T09:06:40.986345+0000","last_active":"2024-09-21T09:06:40.986320+0000","last_peered":"2024-09-21T09:06:40.986320+0000","last_clean":"2024-09-21T09:06:40.986320+0000","last_became_active":"2024-09-21T09:03:02.217917+0000","last_became_peered":"2024-09-21T09:03:02.217917+0000","last_unstale":"2024-09-21T09:06:40.986320+0000","last_undegraded":"2024-09-21T09:06:40.986320+0000","last_fullsized":"2024-09-21T09:06:40.986320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:40.986232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:40.986232+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.986232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:10.981786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.798062+0000","last_change":"2024-09-21T09:06:26.798098+0000","last_active":"2024-09-21T09:06:26.798062+0000","last_peered":"2024-09-21T09:06:26.798062+0000","last_clean":"2024-09-21T09:06:26.798062+0000","last_became_active":"2024-09-21T09:03:04.235199+0000","last_became_peered":"2024-09-21T09:03:04.235199+0000","last_unstale":"2024-09-21T09:06:26.798062+0000","last_undegraded":"2024-09-21T09:06:26.798062+0000","last_fullsized":"2024-09-21T09:06:26.798062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-21T09:06:26.797980+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-21T09:06:26.797980+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.797980+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:46.759660+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'285","reported_seq":414,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.872442+0000","last_change":"2024-09-21T09:06:19.872473+0000","last_active":"2024-09-21T09:06:19.872442+0000","last_peered":"2024-09-21T09:06:19.872442+0000","last_clean":"2024-09-21T09:06:19.872442+0000","last_became_active":"2024-09-21T09:03:06.245904+0000","last_became_peered":"2024-09-21T09:03:06.245904+0000","last_unstale":"2024-09-21T09:06:19.872442+0000","last_undegraded":"2024-09-21T09:06:19.872442+0000","last_fullsized":"2024-09-21T09:06:19.872442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:19.872353+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:19.872353+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.872353+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:08.095534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.419249+0000","last_change":"2024-09-21T09:03:08.253968+0000","last_active":"2024-09-21T09:06:06.419249+0000","last_peered":"2024-09-21T09:06:06.419249+0000","last_clean":"2024-09-21T09:06:06.419249+0000","last_became_active":"2024-09-21T09:03:08.253648+0000","last_became_peered":"2024-09-21T09:03:08.253648+0000","last_unstale":"2024-09-21T09:06:06.419249+0000","last_undegraded":"2024-09-21T09:06:06.419249+0000","last_fullsized":"2024-09-21T09:06:06.419249+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'6","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.912326+0000","last_change":"2024-09-21T09:06:51.912356+0000","last_active":"2024-09-21T09:06:51.912326+0000","last_peered":"2024-09-21T09:06:51.912326+0000","last_clean":"2024-09-21T09:06:51.912326+0000","last_became_active":"2024-09-21T09:03:00.222983+0000","last_became_peered":"2024-09-21T09:03:00.222983+0000","last_unstale":"2024-09-21T09:06:51.912326+0000","last_undegraded":"2024-09-21T09:06:51.912326+0000","last_fullsized":"2024-09-21T09:06:51.912326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:51.912243+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:51.912243+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.912243+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:02.222694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458099+0000","last_change":"2024-09-21T09:02:58.222294+0000","last_active":"2024-09-21T09:05:08.458099+0000","last_peered":"2024-09-21T09:05:08.458099+0000","last_clean":"2024-09-21T09:05:08.458099+0000","last_became_active":"2024-09-21T09:02:58.221805+0000","last_became_peered":"2024-09-21T09:02:58.221805+0000","last_unstale":"2024-09-21T09:05:08.458099+0000","last_undegraded":"2024-09-21T09:05:08.458099+0000","last_fullsized":"2024-09-21T09:05:08.458099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'5","reported_seq":428,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.332881+0000","last_change":"2024-09-21T09:06:29.332947+0000","last_active":"2024-09-21T09:06:29.332881+0000","last_peered":"2024-09-21T09:06:29.332881+0000","last_clean":"2024-09-21T09:06:29.332881+0000","last_became_active":"2024-09-21T09:03:02.222002+0000","last_became_peered":"2024-09-21T09:03:02.222002+0000","last_unstale":"2024-09-21T09:06:29.332881+0000","last_undegraded":"2024-09-21T09:06:29.332881+0000","last_fullsized":"2024-09-21T09:06:29.332881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-21T09:06:29.332773+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-21T09:06:29.332773+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.332773+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:09.966077+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.284616+0000","last_change":"2024-09-21T09:06:46.284654+0000","last_active":"2024-09-21T09:06:46.284616+0000","last_peered":"2024-09-21T09:06:46.284616+0000","last_clean":"2024-09-21T09:06:46.284616+0000","last_became_active":"2024-09-21T09:03:04.242702+0000","last_became_peered":"2024-09-21T09:03:04.242702+0000","last_unstale":"2024-09-21T09:06:46.284616+0000","last_undegraded":"2024-09-21T09:06:46.284616+0000","last_fullsized":"2024-09-21T09:06:46.284616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-21T09:06:46.284518+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-21T09:06:46.284518+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.284518+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:13.659340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'285","reported_seq":476,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.472438+0000","last_change":"2024-09-21T09:06:23.472499+0000","last_active":"2024-09-21T09:06:23.472438+0000","last_peered":"2024-09-21T09:06:23.472438+0000","last_clean":"2024-09-21T09:06:23.472438+0000","last_became_active":"2024-09-21T09:03:06.248991+0000","last_became_peered":"2024-09-21T09:03:06.248991+0000","last_unstale":"2024-09-21T09:06:23.472438+0000","last_undegraded":"2024-09-21T09:06:23.472438+0000","last_fullsized":"2024-09-21T09:06:23.472438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:23.472342+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:23.472342+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.472342+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:12:45.159682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.737124+0000","last_change":"2024-09-21T09:06:29.737148+0000","last_active":"2024-09-21T09:06:29.737124+0000","last_peered":"2024-09-21T09:06:29.737124+0000","last_clean":"2024-09-21T09:06:29.737124+0000","last_became_active":"2024-09-21T09:03:08.252549+0000","last_became_peered":"2024-09-21T09:03:08.252549+0000","last_unstale":"2024-09-21T09:06:29.737124+0000","last_undegraded":"2024-09-21T09:06:29.737124+0000","last_fullsized":"2024-09-21T09:06:29.737124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:29.737036+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:29.737036+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.737036+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:16.036097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.267285+0000","last_change":"2024-09-21T09:03:00.223988+0000","last_active":"2024-09-21T09:06:06.267285+0000","last_peered":"2024-09-21T09:06:06.267285+0000","last_clean":"2024-09-21T09:06:06.267285+0000","last_became_active":"2024-09-21T09:03:00.223719+0000","last_became_peered":"2024-09-21T09:03:00.223719+0000","last_unstale":"2024-09-21T09:06:06.267285+0000","last_undegraded":"2024-09-21T09:06:06.267285+0000","last_fullsized":"2024-09-21T09:06:06.267285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458055+0000","last_change":"2024-09-21T09:02:58.214335+0000","last_active":"2024-09-21T09:05:08.458055+0000","last_peered":"2024-09-21T09:05:08.458055+0000","last_clean":"2024-09-21T09:05:08.458055+0000","last_became_active":"2024-09-21T09:02:58.214074+0000","last_became_peered":"2024-09-21T09:02:58.214074+0000","last_unstale":"2024-09-21T09:05:08.458055+0000","last_undegraded":"2024-09-21T09:05:08.458055+0000","last_fullsized":"2024-09-21T09:05:08.458055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.434384+0000","last_change":"2024-09-21T09:06:17.434407+0000","last_active":"2024-09-21T09:06:17.434384+0000","last_peered":"2024-09-21T09:06:17.434384+0000","last_clean":"2024-09-21T09:06:17.434384+0000","last_became_active":"2024-09-21T09:03:02.222095+0000","last_became_peered":"2024-09-21T09:03:02.222095+0000","last_unstale":"2024-09-21T09:06:17.434384+0000","last_undegraded":"2024-09-21T09:06:17.434384+0000","last_fullsized":"2024-09-21T09:06:17.434384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.434249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.434249+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.434249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:39.005942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'48","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.432681+0000","last_change":"2024-09-21T09:06:24.432715+0000","last_active":"2024-09-21T09:06:24.432681+0000","last_peered":"2024-09-21T09:06:24.432681+0000","last_clean":"2024-09-21T09:06:24.432681+0000","last_became_active":"2024-09-21T09:03:04.235633+0000","last_became_peered":"2024-09-21T09:03:04.235633+0000","last_unstale":"2024-09-21T09:06:24.432681+0000","last_undegraded":"2024-09-21T09:06:24.432681+0000","last_fullsized":"2024-09-21T09:06:24.432681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-09-21T09:06:24.432601+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-09-21T09:06:24.432601+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.432601+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:09.424036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.767356+0000","last_change":"2024-09-21T09:06:16.767379+0000","last_active":"2024-09-21T09:06:16.767356+0000","last_peered":"2024-09-21T09:06:16.767356+0000","last_clean":"2024-09-21T09:06:16.767356+0000","last_became_active":"2024-09-21T09:03:06.247977+0000","last_became_peered":"2024-09-21T09:03:06.247977+0000","last_unstale":"2024-09-21T09:06:16.767356+0000","last_undegraded":"2024-09-21T09:06:16.767356+0000","last_fullsized":"2024-09-21T09:06:16.767356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.767232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.767232+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.767232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:11.816433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.332895+0000","last_change":"2024-09-21T09:06:31.332932+0000","last_active":"2024-09-21T09:06:31.332895+0000","last_peered":"2024-09-21T09:06:31.332895+0000","last_clean":"2024-09-21T09:06:31.332895+0000","last_became_active":"2024-09-21T09:03:08.251985+0000","last_became_peered":"2024-09-21T09:03:08.251985+0000","last_unstale":"2024-09-21T09:06:31.332895+0000","last_undegraded":"2024-09-21T09:06:31.332895+0000","last_fullsized":"2024-09-21T09:06:31.332895+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:31.332791+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:31.332791+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.332791+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:00.603145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.238562+0000","last_change":"2024-09-21T09:06:36.238589+0000","last_active":"2024-09-21T09:06:36.238562+0000","last_peered":"2024-09-21T09:06:36.238562+0000","last_clean":"2024-09-21T09:06:36.238562+0000","last_became_active":"2024-09-21T09:03:00.219428+0000","last_became_peered":"2024-09-21T09:03:00.219428+0000","last_unstale":"2024-09-21T09:06:36.238562+0000","last_undegraded":"2024-09-21T09:06:36.238562+0000","last_fullsized":"2024-09-21T09:06:36.238562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:36.238465+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:36.238465+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.238465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:33.483804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":203,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.324906+0000","last_change":"2024-09-21T09:02:44.107999+0000","last_active":"2024-09-21T09:06:16.324906+0000","last_peered":"2024-09-21T09:06:16.324906+0000","last_clean":"2024-09-21T09:06:16.324906+0000","last_became_active":"2024-09-21T09:02:44.107052+0000","last_became_peered":"2024-09-21T09:02:44.107052+0000","last_unstale":"2024-09-21T09:06:16.324906+0000","last_undegraded":"2024-09-21T09:06:16.324906+0000","last_fullsized":"2024-09-21T09:06:16.324906+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:42.466256+0000","last_clean_scrub_stamp":"2024-09-21T09:02:42.466256+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:58.456535+0000","last_change":"2024-09-21T09:02:51.501401+0000","last_active":"2024-09-21T09:04:58.456535+0000","last_peered":"2024-09-21T09:04:58.456535+0000","last_clean":"2024-09-21T09:04:58.456535+0000","last_became_active":"2024-09-21T09:02:49.492504+0000","last_became_peered":"2024-09-21T09:02:49.492504+0000","last_unstale":"2024-09-21T09:04:58.456535+0000","last_undegraded":"2024-09-21T09:04:58.456535+0000","last_fullsized":"2024-09-21T09:04:58.456535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001229291,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:03.457177+0000","last_change":"2024-09-21T09:02:58.222148+0000","last_active":"2024-09-21T09:05:03.457177+0000","last_peered":"2024-09-21T09:05:03.457177+0000","last_clean":"2024-09-21T09:05:03.457177+0000","last_became_active":"2024-09-21T09:02:58.221874+0000","last_became_peered":"2024-09-21T09:02:58.221874+0000","last_unstale":"2024-09-21T09:05:03.457177+0000","last_undegraded":"2024-09-21T09:05:03.457177+0000","last_fullsized":"2024-09-21T09:05:03.457177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.454544+0000","last_change":"2024-09-21T09:03:38.280004+0000","last_active":"2024-09-21T09:05:07.454544+0000","last_peered":"2024-09-21T09:05:07.454544+0000","last_clean":"2024-09-21T09:05:07.454544+0000","last_became_active":"2024-09-21T09:03:38.279694+0000","last_became_peered":"2024-09-21T09:03:38.279694+0000","last_unstale":"2024-09-21T09:05:07.454544+0000","last_undegraded":"2024-09-21T09:05:07.454544+0000","last_fullsized":"2024-09-21T09:05:07.454544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'87","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.362494+0000","last_change":"2024-09-21T09:06:23.362531+0000","last_active":"2024-09-21T09:06:23.362494+0000","last_peered":"2024-09-21T09:06:23.362494+0000","last_clean":"2024-09-21T09:06:23.362494+0000","last_became_active":"2024-09-21T09:03:04.240327+0000","last_became_peered":"2024-09-21T09:03:04.240327+0000","last_unstale":"2024-09-21T09:06:23.362494+0000","last_undegraded":"2024-09-21T09:06:23.362494+0000","last_fullsized":"2024-09-21T09:06:23.362494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2024-09-21T09:06:23.362409+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2024-09-21T09:06:23.362409+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.362409+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:12.872538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.754019+0000","last_change":"2024-09-21T09:06:16.754043+0000","last_active":"2024-09-21T09:06:16.754019+0000","last_peered":"2024-09-21T09:06:16.754019+0000","last_clean":"2024-09-21T09:06:16.754019+0000","last_became_active":"2024-09-21T09:03:06.247593+0000","last_became_peered":"2024-09-21T09:03:06.247593+0000","last_unstale":"2024-09-21T09:06:16.754019+0000","last_undegraded":"2024-09-21T09:06:16.754019+0000","last_fullsized":"2024-09-21T09:06:16.754019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.753939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.753939+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.753939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:45.971463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'83","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.853304+0000","last_change":"2024-09-21T09:06:21.853332+0000","last_active":"2024-09-21T09:06:21.853304+0000","last_peered":"2024-09-21T09:06:21.853304+0000","last_clean":"2024-09-21T09:06:21.853304+0000","last_became_active":"2024-09-21T09:03:08.251416+0000","last_became_peered":"2024-09-21T09:03:08.251416+0000","last_unstale":"2024-09-21T09:06:21.853304+0000","last_undegraded":"2024-09-21T09:06:21.853304+0000","last_fullsized":"2024-09-21T09:06:21.853304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'83","last_scrub_stamp":"2024-09-21T09:06:21.853181+0000","last_deep_scrub":"31'83","last_deep_scrub_stamp":"2024-09-21T09:06:21.853181+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.853181+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:35.867187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:13.459087+0000","last_change":"2024-09-21T09:03:00.217299+0000","last_active":"2024-09-21T09:05:13.459087+0000","last_peered":"2024-09-21T09:05:13.459087+0000","last_clean":"2024-09-21T09:05:13.459087+0000","last_became_active":"2024-09-21T09:03:00.217018+0000","last_became_peered":"2024-09-21T09:03:00.217018+0000","last_unstale":"2024-09-21T09:05:13.459087+0000","last_undegraded":"2024-09-21T09:05:13.459087+0000","last_fullsized":"2024-09-21T09:05:13.459087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.199641+0000","last_change":"2024-09-21T09:02:51.500609+0000","last_active":"2024-09-21T09:06:17.199641+0000","last_peered":"2024-09-21T09:06:17.199641+0000","last_clean":"2024-09-21T09:06:17.199641+0000","last_became_active":"2024-09-21T09:02:49.493239+0000","last_became_peered":"2024-09-21T09:02:49.493239+0000","last_unstale":"2024-09-21T09:06:17.199641+0000","last_undegraded":"2024-09-21T09:06:17.199641+0000","last_fullsized":"2024-09-21T09:06:17.199641+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046437600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453059+0000","last_change":"2024-09-21T09:02:58.209258+0000","last_active":"2024-09-21T09:05:02.453059+0000","last_peered":"2024-09-21T09:05:02.453059+0000","last_clean":"2024-09-21T09:05:02.453059+0000","last_became_active":"2024-09-21T09:02:58.208819+0000","last_became_peered":"2024-09-21T09:02:58.208819+0000","last_unstale":"2024-09-21T09:05:02.453059+0000","last_undegraded":"2024-09-21T09:05:02.453059+0000","last_fullsized":"2024-09-21T09:05:02.453059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.385967+0000","last_change":"2024-09-21T09:06:19.385992+0000","last_active":"2024-09-21T09:06:19.385967+0000","last_peered":"2024-09-21T09:06:19.385967+0000","last_clean":"2024-09-21T09:06:19.385967+0000","last_became_active":"2024-09-21T09:03:02.220903+0000","last_became_peered":"2024-09-21T09:03:02.220903+0000","last_unstale":"2024-09-21T09:06:19.385967+0000","last_undegraded":"2024-09-21T09:06:19.385967+0000","last_fullsized":"2024-09-21T09:06:19.385967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.385871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.385871+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.385871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:53.002346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'290","reported_seq":514,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.477114+0000","last_change":"2024-09-21T09:06:21.477160+0000","last_active":"2024-09-21T09:06:21.477114+0000","last_peered":"2024-09-21T09:06:21.477114+0000","last_clean":"2024-09-21T09:06:21.477114+0000","last_became_active":"2024-09-21T09:03:04.240433+0000","last_became_peered":"2024-09-21T09:03:04.240433+0000","last_unstale":"2024-09-21T09:06:21.477114+0000","last_undegraded":"2024-09-21T09:06:21.477114+0000","last_fullsized":"2024-09-21T09:06:21.477114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'290","last_scrub_stamp":"2024-09-21T09:06:21.477013+0000","last_deep_scrub":"31'290","last_deep_scrub_stamp":"2024-09-21T09:06:21.477013+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.477013+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:50.761111+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.283589+0000","last_change":"2024-09-21T09:06:39.283613+0000","last_active":"2024-09-21T09:06:39.283589+0000","last_peered":"2024-09-21T09:06:39.283589+0000","last_clean":"2024-09-21T09:06:39.283589+0000","last_became_active":"2024-09-21T09:03:06.247746+0000","last_became_peered":"2024-09-21T09:03:06.247746+0000","last_unstale":"2024-09-21T09:06:39.283589+0000","last_undegraded":"2024-09-21T09:06:39.283589+0000","last_fullsized":"2024-09-21T09:06:39.283589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:39.283500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:39.283500+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.283500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:45.304746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.321552+0000","last_change":"2024-09-21T09:06:43.321611+0000","last_active":"2024-09-21T09:06:43.321552+0000","last_peered":"2024-09-21T09:06:43.321552+0000","last_clean":"2024-09-21T09:06:43.321552+0000","last_became_active":"2024-09-21T09:03:08.258104+0000","last_became_peered":"2024-09-21T09:03:08.258104+0000","last_unstale":"2024-09-21T09:06:43.321552+0000","last_undegraded":"2024-09-21T09:06:43.321552+0000","last_fullsized":"2024-09-21T09:06:43.321552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-21T09:06:43.321436+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-21T09:06:43.321436+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.321436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:24.838301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.943960+0000","last_change":"2024-09-21T09:06:42.944005+0000","last_active":"2024-09-21T09:06:42.943960+0000","last_peered":"2024-09-21T09:06:42.943960+0000","last_clean":"2024-09-21T09:06:42.943960+0000","last_became_active":"2024-09-21T09:03:00.227191+0000","last_became_peered":"2024-09-21T09:03:00.227191+0000","last_unstale":"2024-09-21T09:06:42.943960+0000","last_undegraded":"2024-09-21T09:06:42.943960+0000","last_fullsized":"2024-09-21T09:06:42.943960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:06:42.943855+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:06:42.943855+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.943855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:23.983932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:57.452836+0000","last_change":"2024-09-21T09:02:51.506704+0000","last_active":"2024-09-21T09:04:57.452836+0000","last_peered":"2024-09-21T09:04:57.452836+0000","last_clean":"2024-09-21T09:04:57.452836+0000","last_became_active":"2024-09-21T09:02:49.493605+0000","last_became_peered":"2024-09-21T09:02:49.493605+0000","last_unstale":"2024-09-21T09:04:57.452836+0000","last_undegraded":"2024-09-21T09:04:57.452836+0000","last_fullsized":"2024-09-21T09:04:57.452836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033020199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:57.452297+0000","last_change":"2024-09-21T09:02:58.209627+0000","last_active":"2024-09-21T09:04:57.452297+0000","last_peered":"2024-09-21T09:04:57.452297+0000","last_clean":"2024-09-21T09:04:57.452297+0000","last_became_active":"2024-09-21T09:02:58.209343+0000","last_became_peered":"2024-09-21T09:02:58.209343+0000","last_unstale":"2024-09-21T09:04:57.452297+0000","last_undegraded":"2024-09-21T09:04:57.452297+0000","last_fullsized":"2024-09-21T09:04:57.452297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455310+0000","last_change":"2024-09-21T09:03:02.219332+0000","last_active":"2024-09-21T09:05:12.455310+0000","last_peered":"2024-09-21T09:05:12.455310+0000","last_clean":"2024-09-21T09:05:12.455310+0000","last_became_active":"2024-09-21T09:03:02.219067+0000","last_became_peered":"2024-09-21T09:03:02.219067+0000","last_unstale":"2024-09-21T09:05:12.455310+0000","last_undegraded":"2024-09-21T09:05:12.455310+0000","last_fullsized":"2024-09-21T09:05:12.455310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'24","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.772548+0000","last_change":"2024-09-21T09:06:32.772608+0000","last_active":"2024-09-21T09:06:32.772548+0000","last_peered":"2024-09-21T09:06:32.772548+0000","last_clean":"2024-09-21T09:06:32.772548+0000","last_became_active":"2024-09-21T09:03:04.230686+0000","last_became_peered":"2024-09-21T09:03:04.230686+0000","last_unstale":"2024-09-21T09:06:32.772548+0000","last_undegraded":"2024-09-21T09:06:32.772548+0000","last_fullsized":"2024-09-21T09:06:32.772548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-09-21T09:06:32.772444+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-09-21T09:06:32.772444+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.772444+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:42.682945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.712950+0000","last_change":"2024-09-21T09:06:25.712994+0000","last_active":"2024-09-21T09:06:25.712950+0000","last_peered":"2024-09-21T09:06:25.712950+0000","last_clean":"2024-09-21T09:06:25.712950+0000","last_became_active":"2024-09-21T09:03:06.248087+0000","last_became_peered":"2024-09-21T09:03:06.248087+0000","last_unstale":"2024-09-21T09:06:25.712950+0000","last_undegraded":"2024-09-21T09:06:25.712950+0000","last_fullsized":"2024-09-21T09:06:25.712950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:25.712851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:25.712851+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.712851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:31.193094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460679+0000","last_change":"2024-09-21T09:03:08.259295+0000","last_active":"2024-09-21T09:05:23.460679+0000","last_peered":"2024-09-21T09:05:23.460679+0000","last_clean":"2024-09-21T09:05:23.460679+0000","last_became_active":"2024-09-21T09:03:08.258974+0000","last_became_peered":"2024-09-21T09:03:08.258974+0000","last_unstale":"2024-09-21T09:05:23.460679+0000","last_undegraded":"2024-09-21T09:05:23.460679+0000","last_fullsized":"2024-09-21T09:05:23.460679+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.913135+0000","last_change":"2024-09-21T09:06:46.913163+0000","last_active":"2024-09-21T09:06:46.913135+0000","last_peered":"2024-09-21T09:06:46.913135+0000","last_clean":"2024-09-21T09:06:46.913135+0000","last_became_active":"2024-09-21T09:03:00.221080+0000","last_became_peered":"2024-09-21T09:03:00.221080+0000","last_unstale":"2024-09-21T09:06:46.913135+0000","last_undegraded":"2024-09-21T09:06:46.913135+0000","last_fullsized":"2024-09-21T09:06:46.913135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:46.913050+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:46.913050+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.913050+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:10.419981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:58.456481+0000","last_change":"2024-09-21T09:02:51.501105+0000","last_active":"2024-09-21T09:04:58.456481+0000","last_peered":"2024-09-21T09:04:58.456481+0000","last_clean":"2024-09-21T09:04:58.456481+0000","last_became_active":"2024-09-21T09:02:49.493348+0000","last_became_peered":"2024-09-21T09:02:49.493348+0000","last_unstale":"2024-09-21T09:04:58.456481+0000","last_undegraded":"2024-09-21T09:04:58.456481+0000","last_fullsized":"2024-09-21T09:04:58.456481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096028300000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453422+0000","last_change":"2024-09-21T09:02:58.207996+0000","last_active":"2024-09-21T09:05:02.453422+0000","last_peered":"2024-09-21T09:05:02.453422+0000","last_clean":"2024-09-21T09:05:02.453422+0000","last_became_active":"2024-09-21T09:02:58.207236+0000","last_became_peered":"2024-09-21T09:02:58.207236+0000","last_unstale":"2024-09-21T09:05:02.453422+0000","last_undegraded":"2024-09-21T09:05:02.453422+0000","last_fullsized":"2024-09-21T09:05:02.453422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.897538+0000","last_change":"2024-09-21T09:06:36.897587+0000","last_active":"2024-09-21T09:06:36.897538+0000","last_peered":"2024-09-21T09:06:36.897538+0000","last_clean":"2024-09-21T09:06:36.897538+0000","last_became_active":"2024-09-21T09:03:02.221310+0000","last_became_peered":"2024-09-21T09:03:02.221310+0000","last_unstale":"2024-09-21T09:06:36.897538+0000","last_undegraded":"2024-09-21T09:06:36.897538+0000","last_fullsized":"2024-09-21T09:06:36.897538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:36.897431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:36.897431+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.897431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.146414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'20","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.285611+0000","last_change":"2024-09-21T09:06:43.285705+0000","last_active":"2024-09-21T09:06:43.285611+0000","last_peered":"2024-09-21T09:06:43.285611+0000","last_clean":"2024-09-21T09:06:43.285611+0000","last_became_active":"2024-09-21T09:03:04.243076+0000","last_became_peered":"2024-09-21T09:03:04.243076+0000","last_unstale":"2024-09-21T09:06:43.285611+0000","last_undegraded":"2024-09-21T09:06:43.285611+0000","last_fullsized":"2024-09-21T09:06:43.285611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-09-21T09:06:43.285503+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-09-21T09:06:43.285503+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.285503+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:31.813485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.313817+0000","last_change":"2024-09-21T09:06:49.313875+0000","last_active":"2024-09-21T09:06:49.313817+0000","last_peered":"2024-09-21T09:06:49.313817+0000","last_clean":"2024-09-21T09:06:49.313817+0000","last_became_active":"2024-09-21T09:03:06.250530+0000","last_became_peered":"2024-09-21T09:03:06.250530+0000","last_unstale":"2024-09-21T09:06:49.313817+0000","last_undegraded":"2024-09-21T09:06:49.313817+0000","last_fullsized":"2024-09-21T09:06:49.313817+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:49.313729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:49.313729+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.313729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:37:17.387230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.456066+0000","last_change":"2024-09-21T09:03:08.262588+0000","last_active":"2024-09-21T09:05:17.456066+0000","last_peered":"2024-09-21T09:05:17.456066+0000","last_clean":"2024-09-21T09:05:17.456066+0000","last_became_active":"2024-09-21T09:03:08.262240+0000","last_became_peered":"2024-09-21T09:03:08.262240+0000","last_unstale":"2024-09-21T09:05:17.456066+0000","last_undegraded":"2024-09-21T09:05:17.456066+0000","last_fullsized":"2024-09-21T09:05:17.456066+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'2","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.322422+0000","last_change":"2024-09-21T09:06:40.322444+0000","last_active":"2024-09-21T09:06:40.322422+0000","last_peered":"2024-09-21T09:06:40.322422+0000","last_clean":"2024-09-21T09:06:40.322422+0000","last_became_active":"2024-09-21T09:03:00.224297+0000","last_became_peered":"2024-09-21T09:03:00.224297+0000","last_unstale":"2024-09-21T09:06:40.322422+0000","last_undegraded":"2024-09-21T09:06:40.322422+0000","last_fullsized":"2024-09-21T09:06:40.322422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:40.322322+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:40.322322+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.322322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453460+0000","last_change":"2024-09-21T09:02:58.207055+0000","last_active":"2024-09-21T09:05:02.453460+0000","last_peered":"2024-09-21T09:05:02.453460+0000","last_clean":"2024-09-21T09:05:02.453460+0000","last_became_active":"2024-09-21T09:02:58.206718+0000","last_became_peered":"2024-09-21T09:02:58.206718+0000","last_unstale":"2024-09-21T09:05:02.453460+0000","last_undegraded":"2024-09-21T09:05:02.453460+0000","last_fullsized":"2024-09-21T09:05:02.453460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:57.452385+0000","last_change":"2024-09-21T09:02:51.498275+0000","last_active":"2024-09-21T09:04:57.452385+0000","last_peered":"2024-09-21T09:04:57.452385+0000","last_clean":"2024-09-21T09:04:57.452385+0000","last_became_active":"2024-09-21T09:02:49.493509+0000","last_became_peered":"2024-09-21T09:02:49.493509+0000","last_unstale":"2024-09-21T09:04:57.452385+0000","last_undegraded":"2024-09-21T09:04:57.452385+0000","last_fullsized":"2024-09-21T09:04:57.452385+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038981200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.859402+0000","last_change":"2024-09-21T09:06:35.859438+0000","last_active":"2024-09-21T09:06:35.859402+0000","last_peered":"2024-09-21T09:06:35.859402+0000","last_clean":"2024-09-21T09:06:35.859402+0000","last_became_active":"2024-09-21T09:03:02.221309+0000","last_became_peered":"2024-09-21T09:03:02.221309+0000","last_unstale":"2024-09-21T09:06:35.859402+0000","last_undegraded":"2024-09-21T09:06:35.859402+0000","last_fullsized":"2024-09-21T09:06:35.859402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2024-09-21T09:06:35.859308+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2024-09-21T09:06:35.859308+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.859308+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:10.403536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'73","reported_seq":149,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.721482+0000","last_change":"2024-09-21T09:06:23.721519+0000","last_active":"2024-09-21T09:06:23.721482+0000","last_peered":"2024-09-21T09:06:23.721482+0000","last_clean":"2024-09-21T09:06:23.721482+0000","last_became_active":"2024-09-21T09:03:04.243228+0000","last_became_peered":"2024-09-21T09:03:04.243228+0000","last_unstale":"2024-09-21T09:06:23.721482+0000","last_undegraded":"2024-09-21T09:06:23.721482+0000","last_fullsized":"2024-09-21T09:06:23.721482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2024-09-21T09:06:23.721394+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2024-09-21T09:06:23.721394+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.721394+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:53.684792+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.826592+0000","last_change":"2024-09-21T09:06:18.826638+0000","last_active":"2024-09-21T09:06:18.826592+0000","last_peered":"2024-09-21T09:06:18.826592+0000","last_clean":"2024-09-21T09:06:18.826592+0000","last_became_active":"2024-09-21T09:03:06.246598+0000","last_became_peered":"2024-09-21T09:03:06.246598+0000","last_unstale":"2024-09-21T09:06:18.826592+0000","last_undegraded":"2024-09-21T09:06:18.826592+0000","last_fullsized":"2024-09-21T09:06:18.826592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.826477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.826477+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.826477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:07.103764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456055+0000","last_change":"2024-09-21T09:03:08.251063+0000","last_active":"2024-09-21T09:05:22.456055+0000","last_peered":"2024-09-21T09:05:22.456055+0000","last_clean":"2024-09-21T09:05:22.456055+0000","last_became_active":"2024-09-21T09:03:08.250714+0000","last_became_peered":"2024-09-21T09:03:08.250714+0000","last_unstale":"2024-09-21T09:05:22.456055+0000","last_undegraded":"2024-09-21T09:05:22.456055+0000","last_fullsized":"2024-09-21T09:05:22.456055+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'10","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.181705+0000","last_change":"2024-09-21T09:03:38.286969+0000","last_active":"2024-09-21T09:06:06.181705+0000","last_peered":"2024-09-21T09:06:06.181705+0000","last_clean":"2024-09-21T09:06:06.181705+0000","last_became_active":"2024-09-21T09:03:38.282889+0000","last_became_peered":"2024-09-21T09:03:38.282889+0000","last_unstale":"2024-09-21T09:06:06.181705+0000","last_undegraded":"2024-09-21T09:06:06.181705+0000","last_fullsized":"2024-09-21T09:06:06.181705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453138+0000","last_change":"2024-09-21T09:02:58.208957+0000","last_active":"2024-09-21T09:05:02.453138+0000","last_peered":"2024-09-21T09:05:02.453138+0000","last_clean":"2024-09-21T09:05:02.453138+0000","last_became_active":"2024-09-21T09:02:58.208569+0000","last_became_peered":"2024-09-21T09:02:58.208569+0000","last_unstale":"2024-09-21T09:05:02.453138+0000","last_undegraded":"2024-09-21T09:05:02.453138+0000","last_fullsized":"2024-09-21T09:05:02.453138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:58.456579+0000","last_change":"2024-09-21T09:02:51.501475+0000","last_active":"2024-09-21T09:04:58.456579+0000","last_peered":"2024-09-21T09:04:58.456579+0000","last_clean":"2024-09-21T09:04:58.456579+0000","last_became_active":"2024-09-21T09:02:49.493469+0000","last_became_peered":"2024-09-21T09:02:49.493469+0000","last_unstale":"2024-09-21T09:04:58.456579+0000","last_undegraded":"2024-09-21T09:04:58.456579+0000","last_fullsized":"2024-09-21T09:04:58.456579+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001228114,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.353318+0000","last_change":"2024-09-21T09:06:26.353354+0000","last_active":"2024-09-21T09:06:26.353318+0000","last_peered":"2024-09-21T09:06:26.353318+0000","last_clean":"2024-09-21T09:06:26.353318+0000","last_became_active":"2024-09-21T09:03:02.218232+0000","last_became_peered":"2024-09-21T09:03:02.218232+0000","last_unstale":"2024-09-21T09:06:26.353318+0000","last_undegraded":"2024-09-21T09:06:26.353318+0000","last_fullsized":"2024-09-21T09:06:26.353318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:26.353187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:26.353187+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.353187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:04.665812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'21","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.503937+0000","last_change":"2024-09-21T09:06:20.504016+0000","last_active":"2024-09-21T09:06:20.503937+0000","last_peered":"2024-09-21T09:06:20.503937+0000","last_clean":"2024-09-21T09:06:20.503937+0000","last_became_active":"2024-09-21T09:03:04.241500+0000","last_became_peered":"2024-09-21T09:03:04.241500+0000","last_unstale":"2024-09-21T09:06:20.503937+0000","last_undegraded":"2024-09-21T09:06:20.503937+0000","last_fullsized":"2024-09-21T09:06:20.503937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-09-21T09:06:20.503834+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-09-21T09:06:20.503834+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.503834+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:54.738751+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'285","reported_seq":366,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.375728+0000","last_change":"2024-09-21T09:06:27.375756+0000","last_active":"2024-09-21T09:06:27.375728+0000","last_peered":"2024-09-21T09:06:27.375728+0000","last_clean":"2024-09-21T09:06:27.375728+0000","last_became_active":"2024-09-21T09:03:06.249303+0000","last_became_peered":"2024-09-21T09:03:06.249303+0000","last_unstale":"2024-09-21T09:06:27.375728+0000","last_undegraded":"2024-09-21T09:06:27.375728+0000","last_fullsized":"2024-09-21T09:06:27.375728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:27.375647+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:27.375647+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.375647+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:46.869896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460788+0000","last_change":"2024-09-21T09:03:08.264861+0000","last_active":"2024-09-21T09:05:23.460788+0000","last_peered":"2024-09-21T09:05:23.460788+0000","last_clean":"2024-09-21T09:05:23.460788+0000","last_became_active":"2024-09-21T09:03:08.264322+0000","last_became_peered":"2024-09-21T09:03:08.264322+0000","last_unstale":"2024-09-21T09:05:23.460788+0000","last_undegraded":"2024-09-21T09:05:23.460788+0000","last_fullsized":"2024-09-21T09:05:23.460788+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:37.458764+0000","last_change":"2024-09-21T09:03:38.277961+0000","last_active":"2024-09-21T09:05:37.458764+0000","last_peered":"2024-09-21T09:05:37.458764+0000","last_clean":"2024-09-21T09:05:37.458764+0000","last_became_active":"2024-09-21T09:03:38.277629+0000","last_became_peered":"2024-09-21T09:03:38.277629+0000","last_unstale":"2024-09-21T09:05:37.458764+0000","last_undegraded":"2024-09-21T09:05:37.458764+0000","last_fullsized":"2024-09-21T09:05:37.458764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:08.458272+0000","last_change":"2024-09-21T09:02:58.223891+0000","last_active":"2024-09-21T09:05:08.458272+0000","last_peered":"2024-09-21T09:05:08.458272+0000","last_clean":"2024-09-21T09:05:08.458272+0000","last_became_active":"2024-09-21T09:02:58.223652+0000","last_became_peered":"2024-09-21T09:02:58.223652+0000","last_unstale":"2024-09-21T09:05:08.458272+0000","last_undegraded":"2024-09-21T09:05:08.458272+0000","last_fullsized":"2024-09-21T09:05:08.458272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453181+0000","last_change":"2024-09-21T09:02:51.498192+0000","last_active":"2024-09-21T09:05:02.453181+0000","last_peered":"2024-09-21T09:05:02.453181+0000","last_clean":"2024-09-21T09:05:02.453181+0000","last_became_active":"2024-09-21T09:02:49.493144+0000","last_became_peered":"2024-09-21T09:02:49.493144+0000","last_unstale":"2024-09-21T09:05:02.453181+0000","last_undegraded":"2024-09-21T09:05:02.453181+0000","last_fullsized":"2024-09-21T09:05:02.453181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042500699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.311183+0000","last_change":"2024-09-21T09:06:24.311245+0000","last_active":"2024-09-21T09:06:24.311183+0000","last_peered":"2024-09-21T09:06:24.311183+0000","last_clean":"2024-09-21T09:06:24.311183+0000","last_became_active":"2024-09-21T09:03:02.219133+0000","last_became_peered":"2024-09-21T09:03:02.219133+0000","last_unstale":"2024-09-21T09:06:24.311183+0000","last_undegraded":"2024-09-21T09:06:24.311183+0000","last_fullsized":"2024-09-21T09:06:24.311183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:24.311064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:24.311064+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.311064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:35.086372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.279984+0000","last_change":"2024-09-21T09:06:33.280030+0000","last_active":"2024-09-21T09:06:33.279984+0000","last_peered":"2024-09-21T09:06:33.279984+0000","last_clean":"2024-09-21T09:06:33.279984+0000","last_became_active":"2024-09-21T09:03:04.241256+0000","last_became_peered":"2024-09-21T09:03:04.241256+0000","last_unstale":"2024-09-21T09:06:33.279984+0000","last_undegraded":"2024-09-21T09:06:33.279984+0000","last_fullsized":"2024-09-21T09:06:33.279984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-21T09:06:33.279879+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-21T09:06:33.279879+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.279879+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:01.162062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'285","reported_seq":440,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.712945+0000","last_change":"2024-09-21T09:06:22.713004+0000","last_active":"2024-09-21T09:06:22.712945+0000","last_peered":"2024-09-21T09:06:22.712945+0000","last_clean":"2024-09-21T09:06:22.712945+0000","last_became_active":"2024-09-21T09:03:06.243566+0000","last_became_peered":"2024-09-21T09:03:06.243566+0000","last_unstale":"2024-09-21T09:06:22.712945+0000","last_undegraded":"2024-09-21T09:06:22.712945+0000","last_fullsized":"2024-09-21T09:06:22.712945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:22.712831+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:22.712831+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.712831+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:04.506029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456988+0000","last_change":"2024-09-21T09:03:08.262736+0000","last_active":"2024-09-21T09:05:22.456988+0000","last_peered":"2024-09-21T09:05:22.456988+0000","last_clean":"2024-09-21T09:05:22.456988+0000","last_became_active":"2024-09-21T09:03:08.262460+0000","last_became_peered":"2024-09-21T09:03:08.262460+0000","last_unstale":"2024-09-21T09:05:22.456988+0000","last_undegraded":"2024-09-21T09:05:22.456988+0000","last_fullsized":"2024-09-21T09:05:22.456988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'14","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.862273+0000","last_change":"2024-09-21T09:06:39.862325+0000","last_active":"2024-09-21T09:06:39.862273+0000","last_peered":"2024-09-21T09:06:39.862273+0000","last_clean":"2024-09-21T09:06:39.862273+0000","last_became_active":"2024-09-21T09:03:00.216782+0000","last_became_peered":"2024-09-21T09:03:00.216782+0000","last_unstale":"2024-09-21T09:06:39.862273+0000","last_undegraded":"2024-09-21T09:06:39.862273+0000","last_fullsized":"2024-09-21T09:06:39.862273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:39.862176+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:39.862176+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.862176+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:04:29.094210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:50.407318+0000","last_change":"2024-09-21T09:06:50.407358+0000","last_active":"2024-09-21T09:06:50.407318+0000","last_peered":"2024-09-21T09:06:50.407318+0000","last_clean":"2024-09-21T09:06:50.407318+0000","last_became_active":"2024-09-21T09:02:58.213293+0000","last_became_peered":"2024-09-21T09:02:58.213293+0000","last_unstale":"2024-09-21T09:06:50.407318+0000","last_undegraded":"2024-09-21T09:06:50.407318+0000","last_fullsized":"2024-09-21T09:06:50.407318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:50.407214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:50.407214+0000","last_clean_scrub_stamp":"2024-09-21T09:06:50.407214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:03:45.219496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:03.457297+0000","last_change":"2024-09-21T09:02:51.501161+0000","last_active":"2024-09-21T09:05:03.457297+0000","last_peered":"2024-09-21T09:05:03.457297+0000","last_clean":"2024-09-21T09:05:03.457297+0000","last_became_active":"2024-09-21T09:02:49.542160+0000","last_became_peered":"2024-09-21T09:02:49.542160+0000","last_unstale":"2024-09-21T09:05:03.457297+0000","last_undegraded":"2024-09-21T09:05:03.457297+0000","last_fullsized":"2024-09-21T09:05:03.457297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099618800000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.306980+0000","last_change":"2024-09-21T09:06:27.307002+0000","last_active":"2024-09-21T09:06:27.306980+0000","last_peered":"2024-09-21T09:06:27.306980+0000","last_clean":"2024-09-21T09:06:27.306980+0000","last_became_active":"2024-09-21T09:03:02.218138+0000","last_became_peered":"2024-09-21T09:03:02.218138+0000","last_unstale":"2024-09-21T09:06:27.306980+0000","last_undegraded":"2024-09-21T09:06:27.306980+0000","last_fullsized":"2024-09-21T09:06:27.306980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:27.306889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:27.306889+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.306889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:50.637433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'98","reported_seq":191,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.794064+0000","last_change":"2024-09-21T09:06:31.794110+0000","last_active":"2024-09-21T09:06:31.794064+0000","last_peered":"2024-09-21T09:06:31.794064+0000","last_clean":"2024-09-21T09:06:31.794064+0000","last_became_active":"2024-09-21T09:03:04.231708+0000","last_became_peered":"2024-09-21T09:03:04.231708+0000","last_unstale":"2024-09-21T09:06:31.794064+0000","last_undegraded":"2024-09-21T09:06:31.794064+0000","last_fullsized":"2024-09-21T09:06:31.794064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2024-09-21T09:06:31.793976+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2024-09-21T09:06:31.793976+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.793976+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:01.757375+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":98,"num_read_kb":92,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.935145+0000","last_change":"2024-09-21T09:06:37.935186+0000","last_active":"2024-09-21T09:06:37.935145+0000","last_peered":"2024-09-21T09:06:37.935145+0000","last_clean":"2024-09-21T09:06:37.935145+0000","last_became_active":"2024-09-21T09:03:06.249474+0000","last_became_peered":"2024-09-21T09:03:06.249474+0000","last_unstale":"2024-09-21T09:06:37.935145+0000","last_undegraded":"2024-09-21T09:06:37.935145+0000","last_fullsized":"2024-09-21T09:06:37.935145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:37.935053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:37.935053+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.935053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:29.492174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.780683+0000","last_change":"2024-09-21T09:06:25.780707+0000","last_active":"2024-09-21T09:06:25.780683+0000","last_peered":"2024-09-21T09:06:25.780683+0000","last_clean":"2024-09-21T09:06:25.780683+0000","last_became_active":"2024-09-21T09:03:08.252363+0000","last_became_peered":"2024-09-21T09:03:08.252363+0000","last_unstale":"2024-09-21T09:06:25.780683+0000","last_undegraded":"2024-09-21T09:06:25.780683+0000","last_fullsized":"2024-09-21T09:06:25.780683+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:25.780594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:25.780594+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.780594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:37.186890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.855265+0000","last_change":"2024-09-21T09:06:37.855293+0000","last_active":"2024-09-21T09:06:37.855265+0000","last_peered":"2024-09-21T09:06:37.855265+0000","last_clean":"2024-09-21T09:06:37.855265+0000","last_became_active":"2024-09-21T09:03:08.256571+0000","last_became_peered":"2024-09-21T09:03:08.256571+0000","last_unstale":"2024-09-21T09:06:37.855265+0000","last_undegraded":"2024-09-21T09:06:37.855265+0000","last_fullsized":"2024-09-21T09:06:37.855265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:37.855168+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:37.855168+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.855168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:52.809661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'12","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456617+0000","last_change":"2024-09-21T09:03:38.470029+0000","last_active":"2024-09-21T09:05:22.456617+0000","last_peered":"2024-09-21T09:05:22.456617+0000","last_clean":"2024-09-21T09:05:22.456617+0000","last_became_active":"2024-09-21T09:03:38.466274+0000","last_became_peered":"2024-09-21T09:03:38.466274+0000","last_unstale":"2024-09-21T09:05:22.456617+0000","last_undegraded":"2024-09-21T09:05:22.456617+0000","last_fullsized":"2024-09-21T09:05:22.456617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.459960+0000","last_change":"2024-09-21T09:02:58.221038+0000","last_active":"2024-09-21T09:05:18.459960+0000","last_peered":"2024-09-21T09:05:18.459960+0000","last_clean":"2024-09-21T09:05:18.459960+0000","last_became_active":"2024-09-21T09:02:58.220716+0000","last_became_peered":"2024-09-21T09:02:58.220716+0000","last_unstale":"2024-09-21T09:05:18.459960+0000","last_undegraded":"2024-09-21T09:05:18.459960+0000","last_fullsized":"2024-09-21T09:05:18.459960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.293135+0000","last_change":"2024-09-21T09:06:33.293155+0000","last_active":"2024-09-21T09:06:33.293135+0000","last_peered":"2024-09-21T09:06:33.293135+0000","last_clean":"2024-09-21T09:06:33.293135+0000","last_became_active":"2024-09-21T09:03:02.219652+0000","last_became_peered":"2024-09-21T09:03:02.219652+0000","last_unstale":"2024-09-21T09:06:33.293135+0000","last_undegraded":"2024-09-21T09:06:33.293135+0000","last_fullsized":"2024-09-21T09:06:33.293135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:33.293033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:33.293033+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.293033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:32:06.406355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'39","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.278436+0000","last_change":"2024-09-21T09:06:37.278476+0000","last_active":"2024-09-21T09:06:37.278436+0000","last_peered":"2024-09-21T09:06:37.278436+0000","last_clean":"2024-09-21T09:06:37.278436+0000","last_became_active":"2024-09-21T09:03:04.241612+0000","last_became_peered":"2024-09-21T09:03:04.241612+0000","last_unstale":"2024-09-21T09:06:37.278436+0000","last_undegraded":"2024-09-21T09:06:37.278436+0000","last_fullsized":"2024-09-21T09:06:37.278436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-21T09:06:37.278334+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-21T09:06:37.278334+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.278334+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:25.732945+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:28.461355+0000","last_change":"2024-09-21T09:03:06.251100+0000","last_active":"2024-09-21T09:05:28.461355+0000","last_peered":"2024-09-21T09:05:28.461355+0000","last_clean":"2024-09-21T09:05:28.461355+0000","last_became_active":"2024-09-21T09:03:06.250750+0000","last_became_peered":"2024-09-21T09:03:06.250750+0000","last_unstale":"2024-09-21T09:05:28.461355+0000","last_undegraded":"2024-09-21T09:05:28.461355+0000","last_fullsized":"2024-09-21T09:05:28.461355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:05.228352+0000","last_clean_scrub_stamp":"2024-09-21T09:03:05.228352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'11","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453899+0000","last_change":"2024-09-21T09:03:08.259980+0000","last_active":"2024-09-21T09:05:07.453899+0000","last_peered":"2024-09-21T09:05:07.453899+0000","last_clean":"2024-09-21T09:05:07.453899+0000","last_became_active":"2024-09-21T09:03:08.259602+0000","last_became_peered":"2024-09-21T09:03:08.259602+0000","last_unstale":"2024-09-21T09:05:07.453899+0000","last_undegraded":"2024-09-21T09:05:07.453899+0000","last_fullsized":"2024-09-21T09:05:07.453899+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.310950+0000","last_change":"2024-09-21T09:06:37.310974+0000","last_active":"2024-09-21T09:06:37.310950+0000","last_peered":"2024-09-21T09:06:37.310950+0000","last_clean":"2024-09-21T09:06:37.310950+0000","last_became_active":"2024-09-21T09:03:00.225811+0000","last_became_peered":"2024-09-21T09:03:00.225811+0000","last_unstale":"2024-09-21T09:06:37.310950+0000","last_undegraded":"2024-09-21T09:06:37.310950+0000","last_fullsized":"2024-09-21T09:06:37.310950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:37.310866+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:37.310866+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.310866+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.559849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:22.456671+0000","last_change":"2024-09-21T09:03:38.280883+0000","last_active":"2024-09-21T09:05:22.456671+0000","last_peered":"2024-09-21T09:05:22.456671+0000","last_clean":"2024-09-21T09:05:22.456671+0000","last_became_active":"2024-09-21T09:03:38.280539+0000","last_became_peered":"2024-09-21T09:03:38.280539+0000","last_unstale":"2024-09-21T09:05:22.456671+0000","last_undegraded":"2024-09-21T09:05:22.456671+0000","last_fullsized":"2024-09-21T09:05:22.456671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.390070+0000","last_change":"2024-09-21T09:06:21.390097+0000","last_active":"2024-09-21T09:06:21.390070+0000","last_peered":"2024-09-21T09:06:21.390070+0000","last_clean":"2024-09-21T09:06:21.390070+0000","last_became_active":"2024-09-21T09:03:02.222474+0000","last_became_peered":"2024-09-21T09:03:02.222474+0000","last_unstale":"2024-09-21T09:06:21.390070+0000","last_undegraded":"2024-09-21T09:06:21.390070+0000","last_fullsized":"2024-09-21T09:06:21.390070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:21.389982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:21.389982+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.389982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:19.738715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'9","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.747218+0000","last_change":"2024-09-21T09:06:30.747258+0000","last_active":"2024-09-21T09:06:30.747218+0000","last_peered":"2024-09-21T09:06:30.747218+0000","last_clean":"2024-09-21T09:06:30.747218+0000","last_became_active":"2024-09-21T09:03:04.232474+0000","last_became_peered":"2024-09-21T09:03:04.232474+0000","last_unstale":"2024-09-21T09:06:30.747218+0000","last_undegraded":"2024-09-21T09:06:30.747218+0000","last_fullsized":"2024-09-21T09:06:30.747218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-21T09:06:30.747132+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-21T09:06:30.747132+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.747132+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:13:40.597960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.808656+0000","last_change":"2024-09-21T09:06:17.808683+0000","last_active":"2024-09-21T09:06:17.808656+0000","last_peered":"2024-09-21T09:06:17.808656+0000","last_clean":"2024-09-21T09:06:17.808656+0000","last_became_active":"2024-09-21T09:03:06.250773+0000","last_became_peered":"2024-09-21T09:03:06.250773+0000","last_unstale":"2024-09-21T09:06:17.808656+0000","last_undegraded":"2024-09-21T09:06:17.808656+0000","last_fullsized":"2024-09-21T09:06:17.808656+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.808555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.808555+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.808555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.180280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:37.458230+0000","last_change":"2024-09-21T09:03:08.250971+0000","last_active":"2024-09-21T09:05:37.458230+0000","last_peered":"2024-09-21T09:05:37.458230+0000","last_clean":"2024-09-21T09:05:37.458230+0000","last_became_active":"2024-09-21T09:03:08.250617+0000","last_became_peered":"2024-09-21T09:03:08.250617+0000","last_unstale":"2024-09-21T09:05:37.458230+0000","last_undegraded":"2024-09-21T09:05:37.458230+0000","last_fullsized":"2024-09-21T09:05:37.458230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'14","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.994816+0000","last_change":"2024-09-21T09:06:49.994873+0000","last_active":"2024-09-21T09:06:49.994816+0000","last_peered":"2024-09-21T09:06:49.994816+0000","last_clean":"2024-09-21T09:06:49.994816+0000","last_became_active":"2024-09-21T09:03:00.215591+0000","last_became_peered":"2024-09-21T09:03:00.215591+0000","last_unstale":"2024-09-21T09:06:49.994816+0000","last_undegraded":"2024-09-21T09:06:49.994816+0000","last_fullsized":"2024-09-21T09:06:49.994816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:49.994677+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:49.994677+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.994677+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:34.312234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.253555+0000","last_change":"2024-09-21T09:02:58.218920+0000","last_active":"2024-09-21T09:06:06.253555+0000","last_peered":"2024-09-21T09:06:06.253555+0000","last_clean":"2024-09-21T09:06:06.253555+0000","last_became_active":"2024-09-21T09:02:58.217931+0000","last_became_peered":"2024-09-21T09:02:58.217931+0000","last_unstale":"2024-09-21T09:06:06.253555+0000","last_undegraded":"2024-09-21T09:06:06.253555+0000","last_fullsized":"2024-09-21T09:06:06.253555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.887441+0000","last_change":"2024-09-21T09:06:38.887465+0000","last_active":"2024-09-21T09:06:38.887441+0000","last_peered":"2024-09-21T09:06:38.887441+0000","last_clean":"2024-09-21T09:06:38.887441+0000","last_became_active":"2024-09-21T09:03:02.219265+0000","last_became_peered":"2024-09-21T09:03:02.219265+0000","last_unstale":"2024-09-21T09:06:38.887441+0000","last_undegraded":"2024-09-21T09:06:38.887441+0000","last_fullsized":"2024-09-21T09:06:38.887441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:38.887351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:38.887351+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.887351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:05.248119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'47","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.702301+0000","last_change":"2024-09-21T09:06:28.702348+0000","last_active":"2024-09-21T09:06:28.702301+0000","last_peered":"2024-09-21T09:06:28.702301+0000","last_clean":"2024-09-21T09:06:28.702301+0000","last_became_active":"2024-09-21T09:03:04.233393+0000","last_became_peered":"2024-09-21T09:03:04.233393+0000","last_unstale":"2024-09-21T09:06:28.702301+0000","last_undegraded":"2024-09-21T09:06:28.702301+0000","last_fullsized":"2024-09-21T09:06:28.702301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-09-21T09:06:28.702205+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-09-21T09:06:28.702205+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.702205+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:15.159343+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.509490+0000","last_change":"2024-09-21T09:06:19.509511+0000","last_active":"2024-09-21T09:06:19.509490+0000","last_peered":"2024-09-21T09:06:19.509490+0000","last_clean":"2024-09-21T09:06:19.509490+0000","last_became_active":"2024-09-21T09:03:06.248954+0000","last_became_peered":"2024-09-21T09:03:06.248954+0000","last_unstale":"2024-09-21T09:06:19.509490+0000","last_undegraded":"2024-09-21T09:06:19.509490+0000","last_fullsized":"2024-09-21T09:06:19.509490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.509370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.509370+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.509370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:08.185733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:38.462905+0000","last_change":"2024-09-21T09:03:08.265248+0000","last_active":"2024-09-21T09:05:38.462905+0000","last_peered":"2024-09-21T09:05:38.462905+0000","last_clean":"2024-09-21T09:05:38.462905+0000","last_became_active":"2024-09-21T09:03:08.264778+0000","last_became_peered":"2024-09-21T09:03:08.264778+0000","last_unstale":"2024-09-21T09:05:38.462905+0000","last_undegraded":"2024-09-21T09:05:38.462905+0000","last_fullsized":"2024-09-21T09:05:38.462905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460578+0000","last_change":"2024-09-21T09:03:00.218521+0000","last_active":"2024-09-21T09:05:23.460578+0000","last_peered":"2024-09-21T09:05:23.460578+0000","last_clean":"2024-09-21T09:05:23.460578+0000","last_became_active":"2024-09-21T09:03:00.218259+0000","last_became_peered":"2024-09-21T09:03:00.218259+0000","last_unstale":"2024-09-21T09:05:23.460578+0000","last_undegraded":"2024-09-21T09:05:23.460578+0000","last_fullsized":"2024-09-21T09:05:23.460578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.361149+0000","last_change":"2024-09-21T09:02:58.207817+0000","last_active":"2024-09-21T09:06:06.361149+0000","last_peered":"2024-09-21T09:06:06.361149+0000","last_clean":"2024-09-21T09:06:06.361149+0000","last_became_active":"2024-09-21T09:02:58.207533+0000","last_became_peered":"2024-09-21T09:02:58.207533+0000","last_unstale":"2024-09-21T09:06:06.361149+0000","last_undegraded":"2024-09-21T09:06:06.361149+0000","last_fullsized":"2024-09-21T09:06:06.361149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.403941+0000","last_change":"2024-09-21T09:06:22.403985+0000","last_active":"2024-09-21T09:06:22.403941+0000","last_peered":"2024-09-21T09:06:22.403941+0000","last_clean":"2024-09-21T09:06:22.403941+0000","last_became_active":"2024-09-21T09:03:02.219509+0000","last_became_peered":"2024-09-21T09:03:02.219509+0000","last_unstale":"2024-09-21T09:06:22.403941+0000","last_undegraded":"2024-09-21T09:06:22.403941+0000","last_fullsized":"2024-09-21T09:06:22.403941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:22.403839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:22.403839+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.403839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:58.125850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.809789+0000","last_change":"2024-09-21T09:06:27.809828+0000","last_active":"2024-09-21T09:06:27.809789+0000","last_peered":"2024-09-21T09:06:27.809789+0000","last_clean":"2024-09-21T09:06:27.809789+0000","last_became_active":"2024-09-21T09:03:04.233913+0000","last_became_peered":"2024-09-21T09:03:04.233913+0000","last_unstale":"2024-09-21T09:06:27.809789+0000","last_undegraded":"2024-09-21T09:06:27.809789+0000","last_fullsized":"2024-09-21T09:06:27.809789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-21T09:06:27.809708+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-21T09:06:27.809708+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.809708+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:02.044625+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.801339+0000","last_change":"2024-09-21T09:06:23.801364+0000","last_active":"2024-09-21T09:06:23.801339+0000","last_peered":"2024-09-21T09:06:23.801339+0000","last_clean":"2024-09-21T09:06:23.801339+0000","last_became_active":"2024-09-21T09:03:06.240791+0000","last_became_peered":"2024-09-21T09:03:06.240791+0000","last_unstale":"2024-09-21T09:06:23.801339+0000","last_undegraded":"2024-09-21T09:06:23.801339+0000","last_fullsized":"2024-09-21T09:06:23.801339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:23.801250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:23.801250+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.801250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:35.380708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.267403+0000","last_change":"2024-09-21T09:03:00.216592+0000","last_active":"2024-09-21T09:06:06.267403+0000","last_peered":"2024-09-21T09:06:06.267403+0000","last_clean":"2024-09-21T09:06:06.267403+0000","last_became_active":"2024-09-21T09:03:00.216319+0000","last_became_peered":"2024-09-21T09:03:00.216319+0000","last_unstale":"2024-09-21T09:06:06.267403+0000","last_undegraded":"2024-09-21T09:06:06.267403+0000","last_fullsized":"2024-09-21T09:06:06.267403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460553+0000","last_change":"2024-09-21T09:02:58.214752+0000","last_active":"2024-09-21T09:05:23.460553+0000","last_peered":"2024-09-21T09:05:23.460553+0000","last_clean":"2024-09-21T09:05:23.460553+0000","last_became_active":"2024-09-21T09:02:58.214494+0000","last_became_peered":"2024-09-21T09:02:58.214494+0000","last_unstale":"2024-09-21T09:05:23.460553+0000","last_undegraded":"2024-09-21T09:05:23.460553+0000","last_fullsized":"2024-09-21T09:05:23.460553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"31'5","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.825357+0000","last_change":"2024-09-21T09:06:34.825386+0000","last_active":"2024-09-21T09:06:34.825357+0000","last_peered":"2024-09-21T09:06:34.825357+0000","last_clean":"2024-09-21T09:06:34.825357+0000","last_became_active":"2024-09-21T09:03:02.221586+0000","last_became_peered":"2024-09-21T09:03:02.221586+0000","last_unstale":"2024-09-21T09:06:34.825357+0000","last_undegraded":"2024-09-21T09:06:34.825357+0000","last_fullsized":"2024-09-21T09:06:34.825357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-21T09:06:34.825259+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-21T09:06:34.825259+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.825259+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:27.576289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'64","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.682081+0000","last_change":"2024-09-21T09:06:27.682121+0000","last_active":"2024-09-21T09:06:27.682081+0000","last_peered":"2024-09-21T09:06:27.682081+0000","last_clean":"2024-09-21T09:06:27.682081+0000","last_became_active":"2024-09-21T09:03:04.233734+0000","last_became_peered":"2024-09-21T09:03:04.233734+0000","last_unstale":"2024-09-21T09:06:27.682081+0000","last_undegraded":"2024-09-21T09:06:27.682081+0000","last_fullsized":"2024-09-21T09:06:27.682081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'64","last_scrub_stamp":"2024-09-21T09:06:27.681989+0000","last_deep_scrub":"31'64","last_deep_scrub_stamp":"2024-09-21T09:06:27.681989+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.681989+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:55.221898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.819887+0000","last_change":"2024-09-21T09:06:22.819910+0000","last_active":"2024-09-21T09:06:22.819887+0000","last_peered":"2024-09-21T09:06:22.819887+0000","last_clean":"2024-09-21T09:06:22.819887+0000","last_became_active":"2024-09-21T09:03:06.240975+0000","last_became_peered":"2024-09-21T09:03:06.240975+0000","last_unstale":"2024-09-21T09:06:22.819887+0000","last_undegraded":"2024-09-21T09:06:22.819887+0000","last_fullsized":"2024-09-21T09:06:22.819887+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:22.819794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:22.819794+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.819794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:09.790058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'18","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.367488+0000","last_change":"2024-09-21T09:03:08.254283+0000","last_active":"2024-09-21T09:06:06.367488+0000","last_peered":"2024-09-21T09:06:06.367488+0000","last_clean":"2024-09-21T09:06:06.367488+0000","last_became_active":"2024-09-21T09:03:08.253904+0000","last_became_peered":"2024-09-21T09:03:08.253904+0000","last_unstale":"2024-09-21T09:06:06.367488+0000","last_undegraded":"2024-09-21T09:06:06.367488+0000","last_fullsized":"2024-09-21T09:06:06.367488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.181481+0000","last_change":"2024-09-21T09:03:00.216793+0000","last_active":"2024-09-21T09:06:06.181481+0000","last_peered":"2024-09-21T09:06:06.181481+0000","last_clean":"2024-09-21T09:06:06.181481+0000","last_became_active":"2024-09-21T09:03:00.216238+0000","last_became_peered":"2024-09-21T09:03:00.216238+0000","last_unstale":"2024-09-21T09:06:06.181481+0000","last_undegraded":"2024-09-21T09:06:06.181481+0000","last_fullsized":"2024-09-21T09:06:06.181481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.969833+0000","last_change":"2024-09-21T09:02:58.207174+0000","last_active":"2024-09-21T09:06:12.969833+0000","last_peered":"2024-09-21T09:06:12.969833+0000","last_clean":"2024-09-21T09:06:12.969833+0000","last_became_active":"2024-09-21T09:02:58.206879+0000","last_became_peered":"2024-09-21T09:02:58.206879+0000","last_unstale":"2024-09-21T09:06:12.969833+0000","last_undegraded":"2024-09-21T09:06:12.969833+0000","last_fullsized":"2024-09-21T09:06:12.969833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.454227+0000","last_change":"2024-09-21T09:03:02.218652+0000","last_active":"2024-09-21T09:05:07.454227+0000","last_peered":"2024-09-21T09:05:07.454227+0000","last_clean":"2024-09-21T09:05:07.454227+0000","last_became_active":"2024-09-21T09:03:02.218381+0000","last_became_peered":"2024-09-21T09:03:02.218381+0000","last_unstale":"2024-09-21T09:05:07.454227+0000","last_undegraded":"2024-09-21T09:05:07.454227+0000","last_fullsized":"2024-09-21T09:05:07.454227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.290474+0000","last_change":"2024-09-21T09:06:29.290517+0000","last_active":"2024-09-21T09:06:29.290474+0000","last_peered":"2024-09-21T09:06:29.290474+0000","last_clean":"2024-09-21T09:06:29.290474+0000","last_became_active":"2024-09-21T09:03:04.240933+0000","last_became_peered":"2024-09-21T09:03:04.240933+0000","last_unstale":"2024-09-21T09:06:29.290474+0000","last_undegraded":"2024-09-21T09:06:29.290474+0000","last_fullsized":"2024-09-21T09:06:29.290474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-21T09:06:29.290368+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-21T09:06:29.290368+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.290368+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:29.068806+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.475284+0000","last_change":"2024-09-21T09:06:17.475308+0000","last_active":"2024-09-21T09:06:17.475284+0000","last_peered":"2024-09-21T09:06:17.475284+0000","last_clean":"2024-09-21T09:06:17.475284+0000","last_became_active":"2024-09-21T09:03:06.247153+0000","last_became_peered":"2024-09-21T09:03:06.247153+0000","last_unstale":"2024-09-21T09:06:17.475284+0000","last_undegraded":"2024-09-21T09:06:17.475284+0000","last_fullsized":"2024-09-21T09:06:17.475284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.475178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.475178+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.475178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:28.701561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.264738+0000","last_change":"2024-09-21T09:03:08.262999+0000","last_active":"2024-09-21T09:06:06.264738+0000","last_peered":"2024-09-21T09:06:06.264738+0000","last_clean":"2024-09-21T09:06:06.264738+0000","last_became_active":"2024-09-21T09:03:08.262680+0000","last_became_peered":"2024-09-21T09:03:08.262680+0000","last_unstale":"2024-09-21T09:06:06.264738+0000","last_undegraded":"2024-09-21T09:06:06.264738+0000","last_fullsized":"2024-09-21T09:06:06.264738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.325607+0000","last_change":"2024-09-21T09:06:28.325656+0000","last_active":"2024-09-21T09:06:28.325607+0000","last_peered":"2024-09-21T09:06:28.325607+0000","last_clean":"2024-09-21T09:06:28.325607+0000","last_became_active":"2024-09-21T09:03:00.219653+0000","last_became_peered":"2024-09-21T09:03:00.219653+0000","last_unstale":"2024-09-21T09:06:28.325607+0000","last_undegraded":"2024-09-21T09:06:28.325607+0000","last_fullsized":"2024-09-21T09:06:28.325607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:28.325504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:28.325504+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.325504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:07.739919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'3","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:27.457726+0000","last_change":"2024-09-21T09:02:58.202783+0000","last_active":"2024-09-21T09:05:27.457726+0000","last_peered":"2024-09-21T09:05:27.457726+0000","last_clean":"2024-09-21T09:05:27.457726+0000","last_became_active":"2024-09-21T09:02:58.202431+0000","last_became_peered":"2024-09-21T09:02:58.202431+0000","last_unstale":"2024-09-21T09:05:27.457726+0000","last_undegraded":"2024-09-21T09:05:27.457726+0000","last_fullsized":"2024-09-21T09:05:27.457726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.809305+0000","last_change":"2024-09-21T09:06:36.809338+0000","last_active":"2024-09-21T09:06:36.809305+0000","last_peered":"2024-09-21T09:06:36.809305+0000","last_clean":"2024-09-21T09:06:36.809305+0000","last_became_active":"2024-09-21T09:03:02.220940+0000","last_became_peered":"2024-09-21T09:03:02.220940+0000","last_unstale":"2024-09-21T09:06:36.809305+0000","last_undegraded":"2024-09-21T09:06:36.809305+0000","last_fullsized":"2024-09-21T09:06:36.809305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:36.809163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:36.809163+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.809163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:23.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'40","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.706519+0000","last_change":"2024-09-21T09:06:26.706558+0000","last_active":"2024-09-21T09:06:26.706519+0000","last_peered":"2024-09-21T09:06:26.706519+0000","last_clean":"2024-09-21T09:06:26.706519+0000","last_became_active":"2024-09-21T09:03:04.239023+0000","last_became_peered":"2024-09-21T09:03:04.239023+0000","last_unstale":"2024-09-21T09:06:26.706519+0000","last_undegraded":"2024-09-21T09:06:26.706519+0000","last_fullsized":"2024-09-21T09:06:26.706519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-09-21T09:06:26.706429+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-09-21T09:06:26.706429+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.706429+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:10.421856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.646984+0000","last_change":"2024-09-21T09:06:19.647012+0000","last_active":"2024-09-21T09:06:19.646984+0000","last_peered":"2024-09-21T09:06:19.646984+0000","last_clean":"2024-09-21T09:06:19.646984+0000","last_became_active":"2024-09-21T09:03:06.243451+0000","last_became_peered":"2024-09-21T09:03:06.243451+0000","last_unstale":"2024-09-21T09:06:19.646984+0000","last_undegraded":"2024-09-21T09:06:19.646984+0000","last_fullsized":"2024-09-21T09:06:19.646984+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.646893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.646893+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.646893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:53.881810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:28.461370+0000","last_change":"2024-09-21T09:03:08.260334+0000","last_active":"2024-09-21T09:05:28.461370+0000","last_peered":"2024-09-21T09:05:28.461370+0000","last_clean":"2024-09-21T09:05:28.461370+0000","last_became_active":"2024-09-21T09:03:08.260047+0000","last_became_peered":"2024-09-21T09:03:08.260047+0000","last_unstale":"2024-09-21T09:05:28.461370+0000","last_undegraded":"2024-09-21T09:05:28.461370+0000","last_fullsized":"2024-09-21T09:05:28.461370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.961215+0000","last_change":"2024-09-21T09:06:44.961247+0000","last_active":"2024-09-21T09:06:44.961215+0000","last_peered":"2024-09-21T09:06:44.961215+0000","last_clean":"2024-09-21T09:06:44.961215+0000","last_became_active":"2024-09-21T09:03:00.221332+0000","last_became_peered":"2024-09-21T09:03:00.221332+0000","last_unstale":"2024-09-21T09:06:44.961215+0000","last_undegraded":"2024-09-21T09:06:44.961215+0000","last_fullsized":"2024-09-21T09:06:44.961215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:44.961118+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:44.961118+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.961118+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:44.503583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:28.461450+0000","last_change":"2024-09-21T09:02:58.210805+0000","last_active":"2024-09-21T09:05:28.461450+0000","last_peered":"2024-09-21T09:05:28.461450+0000","last_clean":"2024-09-21T09:05:28.461450+0000","last_became_active":"2024-09-21T09:02:58.210511+0000","last_became_peered":"2024-09-21T09:02:58.210511+0000","last_unstale":"2024-09-21T09:05:28.461450+0000","last_undegraded":"2024-09-21T09:05:28.461450+0000","last_fullsized":"2024-09-21T09:05:28.461450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.326237+0000","last_change":"2024-09-21T09:06:34.326260+0000","last_active":"2024-09-21T09:06:34.326237+0000","last_peered":"2024-09-21T09:06:34.326237+0000","last_clean":"2024-09-21T09:06:34.326237+0000","last_became_active":"2024-09-21T09:03:02.218979+0000","last_became_peered":"2024-09-21T09:03:02.218979+0000","last_unstale":"2024-09-21T09:06:34.326237+0000","last_undegraded":"2024-09-21T09:06:34.326237+0000","last_fullsized":"2024-09-21T09:06:34.326237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:34.326149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:34.326149+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.326149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:08.189282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.300802+0000","last_change":"2024-09-21T09:06:48.300849+0000","last_active":"2024-09-21T09:06:48.300802+0000","last_peered":"2024-09-21T09:06:48.300802+0000","last_clean":"2024-09-21T09:06:48.300802+0000","last_became_active":"2024-09-21T09:03:04.241974+0000","last_became_peered":"2024-09-21T09:03:04.241974+0000","last_unstale":"2024-09-21T09:06:48.300802+0000","last_undegraded":"2024-09-21T09:06:48.300802+0000","last_fullsized":"2024-09-21T09:06:48.300802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-21T09:06:48.300709+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-21T09:06:48.300709+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.300709+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:28.450871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'285","reported_seq":428,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.869861+0000","last_change":"2024-09-21T09:06:20.869907+0000","last_active":"2024-09-21T09:06:20.869861+0000","last_peered":"2024-09-21T09:06:20.869861+0000","last_clean":"2024-09-21T09:06:20.869861+0000","last_became_active":"2024-09-21T09:03:06.244103+0000","last_became_peered":"2024-09-21T09:03:06.244103+0000","last_unstale":"2024-09-21T09:06:20.869861+0000","last_undegraded":"2024-09-21T09:06:20.869861+0000","last_fullsized":"2024-09-21T09:06:20.869861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:20.869741+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:20.869741+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.869741+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:41.358529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.087142+0000","last_change":"2024-09-21T09:03:08.260304+0000","last_active":"2024-09-21T09:06:06.087142+0000","last_peered":"2024-09-21T09:06:06.087142+0000","last_clean":"2024-09-21T09:06:06.087142+0000","last_became_active":"2024-09-21T09:03:08.259638+0000","last_became_peered":"2024-09-21T09:03:08.259638+0000","last_unstale":"2024-09-21T09:06:06.087142+0000","last_undegraded":"2024-09-21T09:06:06.087142+0000","last_fullsized":"2024-09-21T09:06:06.087142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.840388+0000","last_change":"2024-09-21T09:06:41.840414+0000","last_active":"2024-09-21T09:06:41.840388+0000","last_peered":"2024-09-21T09:06:41.840388+0000","last_clean":"2024-09-21T09:06:41.840388+0000","last_became_active":"2024-09-21T09:03:00.220426+0000","last_became_peered":"2024-09-21T09:03:00.220426+0000","last_unstale":"2024-09-21T09:06:41.840388+0000","last_undegraded":"2024-09-21T09:06:41.840388+0000","last_fullsized":"2024-09-21T09:06:41.840388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:41.840277+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:41.840277+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.840277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:15.703410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:27.457774+0000","last_change":"2024-09-21T09:02:58.207718+0000","last_active":"2024-09-21T09:05:27.457774+0000","last_peered":"2024-09-21T09:05:27.457774+0000","last_clean":"2024-09-21T09:05:27.457774+0000","last_became_active":"2024-09-21T09:02:58.207424+0000","last_became_peered":"2024-09-21T09:02:58.207424+0000","last_unstale":"2024-09-21T09:05:27.457774+0000","last_undegraded":"2024-09-21T09:05:27.457774+0000","last_fullsized":"2024-09-21T09:05:27.457774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:32.458425+0000","last_change":"2024-09-21T09:03:38.280977+0000","last_active":"2024-09-21T09:05:32.458425+0000","last_peered":"2024-09-21T09:05:32.458425+0000","last_clean":"2024-09-21T09:05:32.458425+0000","last_became_active":"2024-09-21T09:03:38.280616+0000","last_became_peered":"2024-09-21T09:03:38.280616+0000","last_unstale":"2024-09-21T09:05:32.458425+0000","last_undegraded":"2024-09-21T09:05:32.458425+0000","last_fullsized":"2024-09-21T09:05:32.458425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:01.202359+0000","last_clean_scrub_stamp":"2024-09-21T09:03:01.202359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'47","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.397782+0000","last_change":"2024-09-21T09:06:26.397832+0000","last_active":"2024-09-21T09:06:26.397782+0000","last_peered":"2024-09-21T09:06:26.397782+0000","last_clean":"2024-09-21T09:06:26.397782+0000","last_became_active":"2024-09-21T09:03:04.233878+0000","last_became_peered":"2024-09-21T09:03:04.233878+0000","last_unstale":"2024-09-21T09:06:26.397782+0000","last_undegraded":"2024-09-21T09:06:26.397782+0000","last_fullsized":"2024-09-21T09:06:26.397782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-09-21T09:06:26.397701+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-09-21T09:06:26.397701+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.397701+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:42.069141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.708319+0000","last_change":"2024-09-21T09:06:17.708341+0000","last_active":"2024-09-21T09:06:17.708319+0000","last_peered":"2024-09-21T09:06:17.708319+0000","last_clean":"2024-09-21T09:06:17.708319+0000","last_became_active":"2024-09-21T09:03:06.247609+0000","last_became_peered":"2024-09-21T09:03:06.247609+0000","last_unstale":"2024-09-21T09:06:17.708319+0000","last_undegraded":"2024-09-21T09:06:17.708319+0000","last_fullsized":"2024-09-21T09:06:17.708319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.708240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.708240+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.708240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:29.114535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.282800+0000","last_change":"2024-09-21T09:06:35.282851+0000","last_active":"2024-09-21T09:06:35.282800+0000","last_peered":"2024-09-21T09:06:35.282800+0000","last_clean":"2024-09-21T09:06:35.282800+0000","last_became_active":"2024-09-21T09:03:08.255717+0000","last_became_peered":"2024-09-21T09:03:08.255717+0000","last_unstale":"2024-09-21T09:06:35.282800+0000","last_undegraded":"2024-09-21T09:06:35.282800+0000","last_fullsized":"2024-09-21T09:06:35.282800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:35.282702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:35.282702+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.282702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:28.033731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.817710+0000","last_change":"2024-09-21T09:06:44.817735+0000","last_active":"2024-09-21T09:06:44.817710+0000","last_peered":"2024-09-21T09:06:44.817710+0000","last_clean":"2024-09-21T09:06:44.817710+0000","last_became_active":"2024-09-21T09:03:00.215804+0000","last_became_peered":"2024-09-21T09:03:00.215804+0000","last_unstale":"2024-09-21T09:06:44.817710+0000","last_undegraded":"2024-09-21T09:06:44.817710+0000","last_fullsized":"2024-09-21T09:06:44.817710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:44.817622+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:44.817622+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.817622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:06.066605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:28.461519+0000","last_change":"2024-09-21T09:02:58.221563+0000","last_active":"2024-09-21T09:05:28.461519+0000","last_peered":"2024-09-21T09:05:28.461519+0000","last_clean":"2024-09-21T09:05:28.461519+0000","last_became_active":"2024-09-21T09:02:58.221286+0000","last_became_peered":"2024-09-21T09:02:58.221286+0000","last_unstale":"2024-09-21T09:05:28.461519+0000","last_undegraded":"2024-09-21T09:05:28.461519+0000","last_fullsized":"2024-09-21T09:05:28.461519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.811610+0000","last_change":"2024-09-21T09:06:34.811636+0000","last_active":"2024-09-21T09:06:34.811610+0000","last_peered":"2024-09-21T09:06:34.811610+0000","last_clean":"2024-09-21T09:06:34.811610+0000","last_became_active":"2024-09-21T09:03:02.224879+0000","last_became_peered":"2024-09-21T09:03:02.224879+0000","last_unstale":"2024-09-21T09:06:34.811610+0000","last_undegraded":"2024-09-21T09:06:34.811610+0000","last_fullsized":"2024-09-21T09:06:34.811610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:34.811505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:34.811505+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.811505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:18.526932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.736574+0000","last_change":"2024-09-21T09:06:24.736614+0000","last_active":"2024-09-21T09:06:24.736574+0000","last_peered":"2024-09-21T09:06:24.736574+0000","last_clean":"2024-09-21T09:06:24.736574+0000","last_became_active":"2024-09-21T09:03:04.239112+0000","last_became_peered":"2024-09-21T09:03:04.239112+0000","last_unstale":"2024-09-21T09:06:24.736574+0000","last_undegraded":"2024-09-21T09:06:24.736574+0000","last_fullsized":"2024-09-21T09:06:24.736574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-09-21T09:06:24.736479+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-09-21T09:06:24.736479+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.736479+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:34.646980+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:53.276661+0000","last_change":"2024-09-21T09:06:53.276683+0000","last_active":"2024-09-21T09:06:53.276661+0000","last_peered":"2024-09-21T09:06:53.276661+0000","last_clean":"2024-09-21T09:06:53.276661+0000","last_became_active":"2024-09-21T09:03:06.250729+0000","last_became_peered":"2024-09-21T09:03:06.250729+0000","last_unstale":"2024-09-21T09:06:53.276661+0000","last_undegraded":"2024-09-21T09:06:53.276661+0000","last_fullsized":"2024-09-21T09:06:53.276661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:53.276571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:53.276571+0000","last_clean_scrub_stamp":"2024-09-21T09:06:53.276571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:56.962969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:33.462299+0000","last_change":"2024-09-21T09:03:08.264701+0000","last_active":"2024-09-21T09:05:33.462299+0000","last_peered":"2024-09-21T09:05:33.462299+0000","last_clean":"2024-09-21T09:05:33.462299+0000","last_became_active":"2024-09-21T09:03:08.264160+0000","last_became_peered":"2024-09-21T09:03:08.264160+0000","last_unstale":"2024-09-21T09:05:33.462299+0000","last_undegraded":"2024-09-21T09:05:33.462299+0000","last_fullsized":"2024-09-21T09:05:33.462299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304673+0000","last_change":"2024-09-21T09:03:00.208934+0000","last_active":"2024-09-21T09:06:06.304673+0000","last_peered":"2024-09-21T09:06:06.304673+0000","last_clean":"2024-09-21T09:06:06.304673+0000","last_became_active":"2024-09-21T09:03:00.208673+0000","last_became_peered":"2024-09-21T09:03:00.208673+0000","last_unstale":"2024-09-21T09:06:06.304673+0000","last_undegraded":"2024-09-21T09:06:06.304673+0000","last_fullsized":"2024-09-21T09:06:06.304673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:04:57.452440+0000","last_change":"2024-09-21T09:02:58.213090+0000","last_active":"2024-09-21T09:04:57.452440+0000","last_peered":"2024-09-21T09:04:57.452440+0000","last_clean":"2024-09-21T09:04:57.452440+0000","last_became_active":"2024-09-21T09:02:58.212751+0000","last_became_peered":"2024-09-21T09:02:58.212751+0000","last_unstale":"2024-09-21T09:04:57.452440+0000","last_undegraded":"2024-09-21T09:04:57.452440+0000","last_fullsized":"2024-09-21T09:04:57.452440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.339319+0000","last_change":"2024-09-21T09:06:28.339342+0000","last_active":"2024-09-21T09:06:28.339319+0000","last_peered":"2024-09-21T09:06:28.339319+0000","last_clean":"2024-09-21T09:06:28.339319+0000","last_became_active":"2024-09-21T09:03:02.222965+0000","last_became_peered":"2024-09-21T09:03:02.222965+0000","last_unstale":"2024-09-21T09:06:28.339319+0000","last_undegraded":"2024-09-21T09:06:28.339319+0000","last_fullsized":"2024-09-21T09:06:28.339319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:28.339237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:28.339237+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.339237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:34.803750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'30","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.308727+0000","last_change":"2024-09-21T09:06:42.308759+0000","last_active":"2024-09-21T09:06:42.308727+0000","last_peered":"2024-09-21T09:06:42.308727+0000","last_clean":"2024-09-21T09:06:42.308727+0000","last_became_active":"2024-09-21T09:03:04.243686+0000","last_became_peered":"2024-09-21T09:03:04.243686+0000","last_unstale":"2024-09-21T09:06:42.308727+0000","last_undegraded":"2024-09-21T09:06:42.308727+0000","last_fullsized":"2024-09-21T09:06:42.308727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2024-09-21T09:06:42.308640+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2024-09-21T09:06:42.308640+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.308640+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:02:38.998283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.330394+0000","last_change":"2024-09-21T09:06:45.330435+0000","last_active":"2024-09-21T09:06:45.330394+0000","last_peered":"2024-09-21T09:06:45.330394+0000","last_clean":"2024-09-21T09:06:45.330394+0000","last_became_active":"2024-09-21T09:03:06.249959+0000","last_became_peered":"2024-09-21T09:03:06.249959+0000","last_unstale":"2024-09-21T09:06:45.330394+0000","last_undegraded":"2024-09-21T09:06:45.330394+0000","last_fullsized":"2024-09-21T09:06:45.330394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:45.330289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:45.330289+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.330289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:06.828858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:33.462261+0000","last_change":"2024-09-21T09:03:08.264668+0000","last_active":"2024-09-21T09:05:33.462261+0000","last_peered":"2024-09-21T09:05:33.462261+0000","last_clean":"2024-09-21T09:05:33.462261+0000","last_became_active":"2024-09-21T09:03:08.264395+0000","last_became_peered":"2024-09-21T09:03:08.264395+0000","last_unstale":"2024-09-21T09:05:33.462261+0000","last_undegraded":"2024-09-21T09:05:33.462261+0000","last_fullsized":"2024-09-21T09:05:33.462261+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'14","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.866133+0000","last_change":"2024-09-21T09:06:42.866158+0000","last_active":"2024-09-21T09:06:42.866133+0000","last_peered":"2024-09-21T09:06:42.866133+0000","last_clean":"2024-09-21T09:06:42.866133+0000","last_became_active":"2024-09-21T09:03:00.215748+0000","last_became_peered":"2024-09-21T09:03:00.215748+0000","last_unstale":"2024-09-21T09:06:42.866133+0000","last_undegraded":"2024-09-21T09:06:42.866133+0000","last_fullsized":"2024-09-21T09:06:42.866133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:42.866045+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:42.866045+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.866045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:35.617075+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.969762+0000","last_change":"2024-09-21T09:02:58.204247+0000","last_active":"2024-09-21T09:06:12.969762+0000","last_peered":"2024-09-21T09:06:12.969762+0000","last_clean":"2024-09-21T09:06:12.969762+0000","last_became_active":"2024-09-21T09:02:58.203973+0000","last_became_peered":"2024-09-21T09:02:58.203973+0000","last_unstale":"2024-09-21T09:06:12.969762+0000","last_undegraded":"2024-09-21T09:06:12.969762+0000","last_fullsized":"2024-09-21T09:06:12.969762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.378455+0000","last_change":"2024-09-21T09:06:30.378485+0000","last_active":"2024-09-21T09:06:30.378455+0000","last_peered":"2024-09-21T09:06:30.378455+0000","last_clean":"2024-09-21T09:06:30.378455+0000","last_became_active":"2024-09-21T09:03:02.220801+0000","last_became_peered":"2024-09-21T09:03:02.220801+0000","last_unstale":"2024-09-21T09:06:30.378455+0000","last_undegraded":"2024-09-21T09:06:30.378455+0000","last_fullsized":"2024-09-21T09:06:30.378455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:06:30.378369+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:06:30.378369+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.378369+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:45.332862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'39","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.252315+0000","last_change":"2024-09-21T09:06:31.252360+0000","last_active":"2024-09-21T09:06:31.252315+0000","last_peered":"2024-09-21T09:06:31.252315+0000","last_clean":"2024-09-21T09:06:31.252315+0000","last_became_active":"2024-09-21T09:03:04.240857+0000","last_became_peered":"2024-09-21T09:03:04.240857+0000","last_unstale":"2024-09-21T09:06:31.252315+0000","last_undegraded":"2024-09-21T09:06:31.252315+0000","last_fullsized":"2024-09-21T09:06:31.252315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-21T09:06:31.252205+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-21T09:06:31.252205+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.252205+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.717765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.737294+0000","last_change":"2024-09-21T09:06:29.737330+0000","last_active":"2024-09-21T09:06:29.737294+0000","last_peered":"2024-09-21T09:06:29.737294+0000","last_clean":"2024-09-21T09:06:29.737294+0000","last_became_active":"2024-09-21T09:03:06.248030+0000","last_became_peered":"2024-09-21T09:03:06.248030+0000","last_unstale":"2024-09-21T09:06:29.737294+0000","last_undegraded":"2024-09-21T09:06:29.737294+0000","last_fullsized":"2024-09-21T09:06:29.737294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:29.737203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:29.737203+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.737203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:47.781194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'4","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:28.461477+0000","last_change":"2024-09-21T09:03:08.264618+0000","last_active":"2024-09-21T09:05:28.461477+0000","last_peered":"2024-09-21T09:05:28.461477+0000","last_clean":"2024-09-21T09:05:28.461477+0000","last_became_active":"2024-09-21T09:03:08.264304+0000","last_became_peered":"2024-09-21T09:03:08.264304+0000","last_unstale":"2024-09-21T09:05:28.461477+0000","last_undegraded":"2024-09-21T09:05:28.461477+0000","last_fullsized":"2024-09-21T09:05:28.461477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'22","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.309371+0000","last_change":"2024-09-21T09:06:42.309421+0000","last_active":"2024-09-21T09:06:42.309371+0000","last_peered":"2024-09-21T09:06:42.309371+0000","last_clean":"2024-09-21T09:06:42.309371+0000","last_became_active":"2024-09-21T09:03:00.225936+0000","last_became_peered":"2024-09-21T09:03:00.225936+0000","last_unstale":"2024-09-21T09:06:42.309371+0000","last_undegraded":"2024-09-21T09:06:42.309371+0000","last_fullsized":"2024-09-21T09:06:42.309371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-09-21T09:06:42.309272+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-09-21T09:06:42.309272+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.309272+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:05.305378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453377+0000","last_change":"2024-09-21T09:02:58.206450+0000","last_active":"2024-09-21T09:05:02.453377+0000","last_peered":"2024-09-21T09:05:02.453377+0000","last_clean":"2024-09-21T09:05:02.453377+0000","last_became_active":"2024-09-21T09:02:58.206163+0000","last_became_peered":"2024-09-21T09:02:58.206163+0000","last_unstale":"2024-09-21T09:05:02.453377+0000","last_undegraded":"2024-09-21T09:05:02.453377+0000","last_fullsized":"2024-09-21T09:05:02.453377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.414031+0000","last_change":"2024-09-21T09:03:00.221286+0000","last_active":"2024-09-21T09:06:06.414031+0000","last_peered":"2024-09-21T09:06:06.414031+0000","last_clean":"2024-09-21T09:06:06.414031+0000","last_became_active":"2024-09-21T09:03:00.220860+0000","last_became_peered":"2024-09-21T09:03:00.220860+0000","last_unstale":"2024-09-21T09:06:06.414031+0000","last_undegraded":"2024-09-21T09:06:06.414031+0000","last_fullsized":"2024-09-21T09:06:06.414031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.248335+0000","last_change":"2024-09-21T09:02:58.202869+0000","last_active":"2024-09-21T09:06:06.248335+0000","last_peered":"2024-09-21T09:06:06.248335+0000","last_clean":"2024-09-21T09:06:06.248335+0000","last_became_active":"2024-09-21T09:02:58.202579+0000","last_became_peered":"2024-09-21T09:02:58.202579+0000","last_unstale":"2024-09-21T09:06:06.248335+0000","last_undegraded":"2024-09-21T09:06:06.248335+0000","last_fullsized":"2024-09-21T09:06:06.248335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.266144+0000","last_change":"2024-09-21T09:06:38.266173+0000","last_active":"2024-09-21T09:06:38.266144+0000","last_peered":"2024-09-21T09:06:38.266144+0000","last_clean":"2024-09-21T09:06:38.266144+0000","last_became_active":"2024-09-21T09:03:00.219281+0000","last_became_peered":"2024-09-21T09:03:00.219281+0000","last_unstale":"2024-09-21T09:06:38.266144+0000","last_undegraded":"2024-09-21T09:06:38.266144+0000","last_fullsized":"2024-09-21T09:06:38.266144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:38.266051+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:38.266051+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.266051+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:15.525190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:03.457190+0000","last_change":"2024-09-21T09:02:58.223127+0000","last_active":"2024-09-21T09:05:03.457190+0000","last_peered":"2024-09-21T09:05:03.457190+0000","last_clean":"2024-09-21T09:05:03.457190+0000","last_became_active":"2024-09-21T09:02:58.222856+0000","last_became_peered":"2024-09-21T09:02:58.222856+0000","last_unstale":"2024-09-21T09:05:03.457190+0000","last_undegraded":"2024-09-21T09:05:03.457190+0000","last_fullsized":"2024-09-21T09:05:03.457190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.454594+0000","last_change":"2024-09-21T09:03:00.221392+0000","last_active":"2024-09-21T09:05:12.454594+0000","last_peered":"2024-09-21T09:05:12.454594+0000","last_clean":"2024-09-21T09:05:12.454594+0000","last_became_active":"2024-09-21T09:03:00.220755+0000","last_became_peered":"2024-09-21T09:03:00.220755+0000","last_unstale":"2024-09-21T09:05:12.454594+0000","last_undegraded":"2024-09-21T09:05:12.454594+0000","last_fullsized":"2024-09-21T09:05:12.454594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:02.453099+0000","last_change":"2024-09-21T09:02:58.208737+0000","last_active":"2024-09-21T09:05:02.453099+0000","last_peered":"2024-09-21T09:05:02.453099+0000","last_clean":"2024-09-21T09:05:02.453099+0000","last_became_active":"2024-09-21T09:02:58.208329+0000","last_became_peered":"2024-09-21T09:02:58.208329+0000","last_unstale":"2024-09-21T09:05:02.453099+0000","last_undegraded":"2024-09-21T09:05:02.453099+0000","last_fullsized":"2024-09-21T09:05:02.453099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'16","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:52.034168+0000","last_change":"2024-09-21T09:06:52.034234+0000","last_active":"2024-09-21T09:06:52.034168+0000","last_peered":"2024-09-21T09:06:52.034168+0000","last_clean":"2024-09-21T09:06:52.034168+0000","last_became_active":"2024-09-21T09:03:00.215554+0000","last_became_peered":"2024-09-21T09:03:00.215554+0000","last_unstale":"2024-09-21T09:06:52.034168+0000","last_undegraded":"2024-09-21T09:06:52.034168+0000","last_fullsized":"2024-09-21T09:06:52.034168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-21T09:06:52.034066+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-21T09:06:52.034066+0000","last_clean_scrub_stamp":"2024-09-21T09:06:52.034066+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:54.024587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453857+0000","last_change":"2024-09-21T09:02:58.202254+0000","last_active":"2024-09-21T09:05:07.453857+0000","last_peered":"2024-09-21T09:05:07.453857+0000","last_clean":"2024-09-21T09:05:07.453857+0000","last_became_active":"2024-09-21T09:02:58.201482+0000","last_became_peered":"2024-09-21T09:02:58.201482+0000","last_unstale":"2024-09-21T09:05:07.453857+0000","last_undegraded":"2024-09-21T09:05:07.453857+0000","last_fullsized":"2024-09-21T09:05:07.453857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'11","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.414128+0000","last_change":"2024-09-21T09:03:00.224630+0000","last_active":"2024-09-21T09:06:06.414128+0000","last_peered":"2024-09-21T09:06:06.414128+0000","last_clean":"2024-09-21T09:06:06.414128+0000","last_became_active":"2024-09-21T09:03:00.223740+0000","last_became_peered":"2024-09-21T09:03:00.223740+0000","last_unstale":"2024-09-21T09:06:06.414128+0000","last_undegraded":"2024-09-21T09:06:06.414128+0000","last_fullsized":"2024-09-21T09:06:06.414128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.969855+0000","last_change":"2024-09-21T09:02:58.210714+0000","last_active":"2024-09-21T09:06:12.969855+0000","last_peered":"2024-09-21T09:06:12.969855+0000","last_clean":"2024-09-21T09:06:12.969855+0000","last_became_active":"2024-09-21T09:02:58.210442+0000","last_became_peered":"2024-09-21T09:02:58.210442+0000","last_unstale":"2024-09-21T09:06:12.969855+0000","last_undegraded":"2024-09-21T09:06:12.969855+0000","last_fullsized":"2024-09-21T09:06:12.969855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'14","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453774+0000","last_change":"2024-09-21T09:03:00.216820+0000","last_active":"2024-09-21T09:05:07.453774+0000","last_peered":"2024-09-21T09:05:07.453774+0000","last_clean":"2024-09-21T09:05:07.453774+0000","last_became_active":"2024-09-21T09:03:00.216462+0000","last_became_peered":"2024-09-21T09:03:00.216462+0000","last_unstale":"2024-09-21T09:05:07.453774+0000","last_undegraded":"2024-09-21T09:05:07.453774+0000","last_fullsized":"2024-09-21T09:05:07.453774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.809287+0000","last_change":"2024-09-21T09:06:46.809331+0000","last_active":"2024-09-21T09:06:46.809287+0000","last_peered":"2024-09-21T09:06:46.809287+0000","last_clean":"2024-09-21T09:06:46.809287+0000","last_became_active":"2024-09-21T09:02:58.218407+0000","last_became_peered":"2024-09-21T09:02:58.218407+0000","last_unstale":"2024-09-21T09:06:46.809287+0000","last_undegraded":"2024-09-21T09:06:46.809287+0000","last_fullsized":"2024-09-21T09:06:46.809287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:46.809183+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:46.809183+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.809183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:36.437428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.367907+0000","last_change":"2024-09-21T09:06:46.367934+0000","last_active":"2024-09-21T09:06:46.367907+0000","last_peered":"2024-09-21T09:06:46.367907+0000","last_clean":"2024-09-21T09:06:46.367907+0000","last_became_active":"2024-09-21T09:03:00.212503+0000","last_became_peered":"2024-09-21T09:03:00.212503+0000","last_unstale":"2024-09-21T09:06:46.367907+0000","last_undegraded":"2024-09-21T09:06:46.367907+0000","last_fullsized":"2024-09-21T09:06:46.367907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:46.367803+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:46.367803+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.367803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:25:59.172888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:07.453936+0000","last_change":"2024-09-21T09:02:58.202455+0000","last_active":"2024-09-21T09:05:07.453936+0000","last_peered":"2024-09-21T09:05:07.453936+0000","last_clean":"2024-09-21T09:05:07.453936+0000","last_became_active":"2024-09-21T09:02:58.201812+0000","last_became_peered":"2024-09-21T09:02:58.201812+0000","last_unstale":"2024-09-21T09:05:07.453936+0000","last_undegraded":"2024-09-21T09:05:07.453936+0000","last_fullsized":"2024-09-21T09:05:07.453936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'6","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.362863+0000","last_change":"2024-09-21T09:06:44.362915+0000","last_active":"2024-09-21T09:06:44.362863+0000","last_peered":"2024-09-21T09:06:44.362863+0000","last_clean":"2024-09-21T09:06:44.362863+0000","last_became_active":"2024-09-21T09:03:00.224456+0000","last_became_peered":"2024-09-21T09:03:00.224456+0000","last_unstale":"2024-09-21T09:06:44.362863+0000","last_undegraded":"2024-09-21T09:06:44.362863+0000","last_fullsized":"2024-09-21T09:06:44.362863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:44.362734+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:44.362734+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.362734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:35.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.969407+0000","last_change":"2024-09-21T09:02:58.222445+0000","last_active":"2024-09-21T09:06:12.969407+0000","last_peered":"2024-09-21T09:06:12.969407+0000","last_clean":"2024-09-21T09:06:12.969407+0000","last_became_active":"2024-09-21T09:02:58.222191+0000","last_became_peered":"2024-09-21T09:02:58.222191+0000","last_unstale":"2024-09-21T09:06:12.969407+0000","last_undegraded":"2024-09-21T09:06:12.969407+0000","last_fullsized":"2024-09-21T09:06:12.969407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'6","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.249744+0000","last_change":"2024-09-21T09:06:51.249772+0000","last_active":"2024-09-21T09:06:51.249744+0000","last_peered":"2024-09-21T09:06:51.249744+0000","last_clean":"2024-09-21T09:06:51.249744+0000","last_became_active":"2024-09-21T09:03:00.220639+0000","last_became_peered":"2024-09-21T09:03:00.220639+0000","last_unstale":"2024-09-21T09:06:51.249744+0000","last_undegraded":"2024-09-21T09:06:51.249744+0000","last_fullsized":"2024-09-21T09:06:51.249744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:51.249657+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:51.249657+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.249657+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:04.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.454498+0000","last_change":"2024-09-21T09:02:58.208759+0000","last_active":"2024-09-21T09:05:12.454498+0000","last_peered":"2024-09-21T09:05:12.454498+0000","last_clean":"2024-09-21T09:05:12.454498+0000","last_became_active":"2024-09-21T09:02:58.208346+0000","last_became_peered":"2024-09-21T09:02:58.208346+0000","last_unstale":"2024-09-21T09:05:12.454498+0000","last_undegraded":"2024-09-21T09:05:12.454498+0000","last_fullsized":"2024-09-21T09:05:12.454498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.941232+0000","last_change":"2024-09-21T09:06:43.941260+0000","last_active":"2024-09-21T09:06:43.941232+0000","last_peered":"2024-09-21T09:06:43.941232+0000","last_clean":"2024-09-21T09:06:43.941232+0000","last_became_active":"2024-09-21T09:03:00.222651+0000","last_became_peered":"2024-09-21T09:03:00.222651+0000","last_unstale":"2024-09-21T09:06:43.941232+0000","last_undegraded":"2024-09-21T09:06:43.941232+0000","last_fullsized":"2024-09-21T09:06:43.941232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:43.941138+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:43.941138+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.941138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:54.251590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:12.455323+0000","last_change":"2024-09-21T09:02:58.209919+0000","last_active":"2024-09-21T09:05:12.455323+0000","last_peered":"2024-09-21T09:05:12.455323+0000","last_clean":"2024-09-21T09:05:12.455323+0000","last_became_active":"2024-09-21T09:02:58.208495+0000","last_became_peered":"2024-09-21T09:02:58.208495+0000","last_unstale":"2024-09-21T09:05:12.455323+0000","last_undegraded":"2024-09-21T09:05:12.455323+0000","last_fullsized":"2024-09-21T09:05:12.455323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.446615+0000","last_change":"2024-09-21T09:06:51.446658+0000","last_active":"2024-09-21T09:06:51.446615+0000","last_peered":"2024-09-21T09:06:51.446615+0000","last_clean":"2024-09-21T09:06:51.446615+0000","last_became_active":"2024-09-21T09:03:00.222343+0000","last_became_peered":"2024-09-21T09:03:00.222343+0000","last_unstale":"2024-09-21T09:06:51.446615+0000","last_undegraded":"2024-09-21T09:06:51.446615+0000","last_fullsized":"2024-09-21T09:06:51.446615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-21T09:06:51.446466+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-21T09:06:51.446466+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.446466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.923486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.969765+0000","last_change":"2024-09-21T09:02:58.210097+0000","last_active":"2024-09-21T09:06:12.969765+0000","last_peered":"2024-09-21T09:06:12.969765+0000","last_clean":"2024-09-21T09:06:12.969765+0000","last_became_active":"2024-09-21T09:02:58.208630+0000","last_became_peered":"2024-09-21T09:02:58.208630+0000","last_unstale":"2024-09-21T09:06:12.969765+0000","last_undegraded":"2024-09-21T09:06:12.969765+0000","last_fullsized":"2024-09-21T09:06:12.969765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'18","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:52.460724+0000","last_change":"2024-09-21T09:03:38.286564+0000","last_active":"2024-09-21T09:05:52.460724+0000","last_peered":"2024-09-21T09:05:52.460724+0000","last_clean":"2024-09-21T09:05:52.460724+0000","last_became_active":"2024-09-21T09:03:38.282951+0000","last_became_peered":"2024-09-21T09:03:38.282951+0000","last_unstale":"2024-09-21T09:05:52.460724+0000","last_undegraded":"2024-09-21T09:05:52.460724+0000","last_fullsized":"2024-09-21T09:05:52.460724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.065210+0000","last_change":"2024-09-21T09:02:58.214989+0000","last_active":"2024-09-21T09:06:06.065210+0000","last_peered":"2024-09-21T09:06:06.065210+0000","last_clean":"2024-09-21T09:06:06.065210+0000","last_became_active":"2024-09-21T09:02:58.214717+0000","last_became_peered":"2024-09-21T09:02:58.214717+0000","last_unstale":"2024-09-21T09:06:06.065210+0000","last_undegraded":"2024-09-21T09:06:06.065210+0000","last_fullsized":"2024-09-21T09:06:06.065210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.344725+0000","last_change":"2024-09-21T09:06:38.344758+0000","last_active":"2024-09-21T09:06:38.344725+0000","last_peered":"2024-09-21T09:06:38.344725+0000","last_clean":"2024-09-21T09:06:38.344725+0000","last_became_active":"2024-09-21T09:03:00.226411+0000","last_became_peered":"2024-09-21T09:03:00.226411+0000","last_unstale":"2024-09-21T09:06:38.344725+0000","last_undegraded":"2024-09-21T09:06:38.344725+0000","last_fullsized":"2024-09-21T09:06:38.344725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:38.344633+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:38.344633+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.344633+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:29.901754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:13.459048+0000","last_change":"2024-09-21T09:02:58.224258+0000","last_active":"2024-09-21T09:05:13.459048+0000","last_peered":"2024-09-21T09:05:13.459048+0000","last_clean":"2024-09-21T09:05:13.459048+0000","last_became_active":"2024-09-21T09:02:58.224058+0000","last_became_peered":"2024-09-21T09:02:58.224058+0000","last_unstale":"2024-09-21T09:05:13.459048+0000","last_undegraded":"2024-09-21T09:05:13.459048+0000","last_fullsized":"2024-09-21T09:05:13.459048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'4","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:52.260701+0000","last_change":"2024-09-21T09:06:52.260743+0000","last_active":"2024-09-21T09:06:52.260701+0000","last_peered":"2024-09-21T09:06:52.260701+0000","last_clean":"2024-09-21T09:06:52.260701+0000","last_became_active":"2024-09-21T09:03:00.218422+0000","last_became_peered":"2024-09-21T09:03:00.218422+0000","last_unstale":"2024-09-21T09:06:52.260701+0000","last_undegraded":"2024-09-21T09:06:52.260701+0000","last_fullsized":"2024-09-21T09:06:52.260701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:52.260581+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:52.260581+0000","last_clean_scrub_stamp":"2024-09-21T09:06:52.260581+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:19.039754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:50.894205+0000","last_change":"2024-09-21T09:06:50.894242+0000","last_active":"2024-09-21T09:06:50.894205+0000","last_peered":"2024-09-21T09:06:50.894205+0000","last_clean":"2024-09-21T09:06:50.894205+0000","last_became_active":"2024-09-21T09:02:58.218299+0000","last_became_peered":"2024-09-21T09:02:58.218299+0000","last_unstale":"2024-09-21T09:06:50.894205+0000","last_undegraded":"2024-09-21T09:06:50.894205+0000","last_fullsized":"2024-09-21T09:06:50.894205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:50.894097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:50.894097+0000","last_clean_scrub_stamp":"2024-09-21T09:06:50.894097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:31.934174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'12","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.393535+0000","last_change":"2024-09-21T09:06:45.393566+0000","last_active":"2024-09-21T09:06:45.393535+0000","last_peered":"2024-09-21T09:06:45.393535+0000","last_clean":"2024-09-21T09:06:45.393535+0000","last_became_active":"2024-09-21T09:03:00.212838+0000","last_became_peered":"2024-09-21T09:03:00.212838+0000","last_unstale":"2024-09-21T09:06:45.393535+0000","last_undegraded":"2024-09-21T09:06:45.393535+0000","last_fullsized":"2024-09-21T09:06:45.393535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:06:45.393449+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:06:45.393449+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.393449+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:43.161382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:12.969448+0000","last_change":"2024-09-21T09:02:58.219134+0000","last_active":"2024-09-21T09:06:12.969448+0000","last_peered":"2024-09-21T09:06:12.969448+0000","last_clean":"2024-09-21T09:06:12.969448+0000","last_became_active":"2024-09-21T09:02:58.218776+0000","last_became_peered":"2024-09-21T09:02:58.218776+0000","last_unstale":"2024-09-21T09:06:12.969448+0000","last_undegraded":"2024-09-21T09:06:12.969448+0000","last_fullsized":"2024-09-21T09:06:12.969448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.459817+0000","last_change":"2024-09-21T09:02:58.219078+0000","last_active":"2024-09-21T09:05:18.459817+0000","last_peered":"2024-09-21T09:05:18.459817+0000","last_clean":"2024-09-21T09:05:18.459817+0000","last_became_active":"2024-09-21T09:02:58.218757+0000","last_became_peered":"2024-09-21T09:02:58.218757+0000","last_unstale":"2024-09-21T09:05:18.459817+0000","last_undegraded":"2024-09-21T09:05:18.459817+0000","last_fullsized":"2024-09-21T09:05:18.459817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'6","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.304271+0000","last_change":"2024-09-21T09:03:00.216883+0000","last_active":"2024-09-21T09:06:06.304271+0000","last_peered":"2024-09-21T09:06:06.304271+0000","last_clean":"2024-09-21T09:06:06.304271+0000","last_became_active":"2024-09-21T09:03:00.216424+0000","last_became_peered":"2024-09-21T09:03:00.216424+0000","last_unstale":"2024-09-21T09:06:06.304271+0000","last_undegraded":"2024-09-21T09:06:06.304271+0000","last_fullsized":"2024-09-21T09:06:06.304271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:59.194923+0000","last_clean_scrub_stamp":"2024-09-21T09:02:59.194923+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:17.455250+0000","last_change":"2024-09-21T09:02:58.209061+0000","last_active":"2024-09-21T09:05:17.455250+0000","last_peered":"2024-09-21T09:05:17.455250+0000","last_clean":"2024-09-21T09:05:17.455250+0000","last_became_active":"2024-09-21T09:02:58.208437+0000","last_became_peered":"2024-09-21T09:02:58.208437+0000","last_unstale":"2024-09-21T09:05:17.455250+0000","last_undegraded":"2024-09-21T09:05:17.455250+0000","last_fullsized":"2024-09-21T09:05:17.455250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.386389+0000","last_change":"2024-09-21T09:06:47.386417+0000","last_active":"2024-09-21T09:06:47.386389+0000","last_peered":"2024-09-21T09:06:47.386389+0000","last_clean":"2024-09-21T09:06:47.386389+0000","last_became_active":"2024-09-21T09:03:00.219010+0000","last_became_peered":"2024-09-21T09:03:00.219010+0000","last_unstale":"2024-09-21T09:06:47.386389+0000","last_undegraded":"2024-09-21T09:06:47.386389+0000","last_fullsized":"2024-09-21T09:06:47.386389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:47.386301+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:47.386301+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.386301+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:10.395718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673014,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":136073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705717,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":722309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705716,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":723502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":417792,"data_stored":134220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:06:58.316 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.317 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.317 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.317 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.317 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.318 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.318 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.318 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.318 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.318 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.319 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.319 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.319 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.319 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.319 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.320 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.320 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.320 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.320 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.320 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.321 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.321 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.321 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.321 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.321 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.322 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.322 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.322 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.322 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.323 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.323 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.323 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.323 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.324 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.324 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.324 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.325 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.325 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.325 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.325 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.326 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.326 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.326 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T09:02:42.466256+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=42, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.326 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.326 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.327 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.327 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.327 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.327 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.328 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.328 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.328 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.328 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.328 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.329 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.329 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.329 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.329 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.330 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.330 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.330 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.330 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.330 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.331 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.331 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.331 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.331 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.331 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.332 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.332 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.332 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-21T09:03:05.228352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.332 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.332 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.333 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.333 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.333 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.333 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.334 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.334 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.334 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.334 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.335 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.335 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.335 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.335 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.335 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.336 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.336 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.336 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.336 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.336 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-21T09:03:01.202359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.337 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.337 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.337 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.337 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.338 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.338 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.338 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.338 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.339 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.339 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.339 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.339 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.339 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.339 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.340 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.340 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.340 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.340 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.340 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.341 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.341 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.341 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.341 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.341 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.341 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.341 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.342 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.342 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-21T09:02:59.194923+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.342 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:06:58.342 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T09:07:18.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:07:18.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.456+0000 7f507f0a6640 1 Processor -- start 2024-09-21T09:07:18.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.457+0000 7f507f0a6640 1 -- start start 2024-09-21T09:07:18.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.457+0000 7f507f0a6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f507809a100 0x7f5078133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:07:18.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.457+0000 7f507f0a6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f507809d3b0 con 0x7f507809bd50 2024-09-21T09:07:18.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.457+0000 7f507f0a6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f507809c840 con 0x7f507809a100 2024-09-21T09:07:18.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.457+0000 7f5077fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f507809a100 0x7f5078133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:07:18.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.457+0000 7f507ce42640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f507809bd50 0x7f507809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46044/0 (socket says 172.21.15.44:46044) 2024-09-21T09:07:18.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.457+0000 7f507ce42640 1 -- 172.21.15.44:0/4277049002 learned_addr learned my addr 172.21.15.44:0/4277049002 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:07:18.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.458+0000 7f5077fff640 1 -- 172.21.15.44:0/4277049002 >> v1:172.21.15.44:6789/0 conn(0x7f507809bd50 legacy=0x7f507809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:18.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.458+0000 7f50777fe640 1 -- 172.21.15.44:0/4277049002 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610360097 0 0) 0x7f506c001110 con 0x7f507809bd50 2024-09-21T09:07:18.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.458+0000 7f5077fff640 1 -- 172.21.15.44:0/4277049002 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5078098230 con 0x7f507809a100 2024-09-21T09:07:18.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.458+0000 7f5077fff640 1 --2- 172.21.15.44:0/4277049002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f507809a100 0x7f5078133da0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5064009720 tx=0x7f506402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956974fa275a2311 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:07:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.458+0000 7f50777fe640 1 -- 172.21.15.44:0/4277049002 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5064037070 con 0x7f507809a100 2024-09-21T09:07:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.458+0000 7f50777fe640 1 -- 172.21.15.44:0/4277049002 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f506402ad90 con 0x7f507809a100 2024-09-21T09:07:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.459+0000 7f50777fe640 1 -- 172.21.15.44:0/4277049002 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5064032590 con 0x7f507809a100 2024-09-21T09:07:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.459+0000 7f507f0a6640 1 -- 172.21.15.44:0/4277049002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f507809a100 msgr2=0x7f5078133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.459+0000 7f507f0a6640 1 --2- 172.21.15.44:0/4277049002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f507809a100 0x7f5078133da0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5064009720 tx=0x7f506402a110 comp rx=0 tx=0).stop 2024-09-21T09:07:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.459+0000 7f507f0a6640 1 -- 172.21.15.44:0/4277049002 shutdown_connections 2024-09-21T09:07:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.459+0000 7f507f0a6640 1 --2- 172.21.15.44:0/4277049002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f507809a100 0x7f5078133da0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:07:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.459+0000 7f507f0a6640 1 -- 172.21.15.44:0/4277049002 >> 172.21.15.44:0/4277049002 conn(0x7f507806d4a0 msgr2=0x7f507806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:07:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.459+0000 7f507f0a6640 1 -- 172.21.15.44:0/4277049002 shutdown_connections 2024-09-21T09:07:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.459+0000 7f507f0a6640 1 -- 172.21.15.44:0/4277049002 wait complete. 2024-09-21T09:07:18.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.460+0000 7f507f0a6640 1 Processor -- start 2024-09-21T09:07:18.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.460+0000 7f507f0a6640 1 -- start start 2024-09-21T09:07:18.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.461+0000 7f507f0a6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f507809a100 0x7f5078132a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:07:18.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.461+0000 7f507f0a6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5078134670 con 0x7f507809a100 2024-09-21T09:07:18.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.461+0000 7f507ce42640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f507809a100 0x7f5078132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:07:18.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.461+0000 7f507ce42640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f507809a100 0x7f5078132a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44136/0 (socket says 172.21.15.44:44136) 2024-09-21T09:07:18.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.461+0000 7f507ce42640 1 -- 172.21.15.44:0/1457730332 learned_addr learned my addr 172.21.15.44:0/1457730332 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:07:18.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.461+0000 7f507ce42640 1 -- 172.21.15.44:0/1457730332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5078125fc0 con 0x7f507809a100 2024-09-21T09:07:18.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.461+0000 7f507ce42640 1 --2- 172.21.15.44:0/1457730332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f507809a100 0x7f5078132a40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f506c00c700 tx=0x7f506c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:07:18.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.461+0000 7f50757fa640 1 -- 172.21.15.44:0/1457730332 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f506c018070 con 0x7f507809a100 2024-09-21T09:07:18.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.461+0000 7f50757fa640 1 -- 172.21.15.44:0/1457730332 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f506c0070d0 con 0x7f507809a100 2024-09-21T09:07:18.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.461+0000 7f507f0a6640 1 -- 172.21.15.44:0/1457730332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5078096570 con 0x7f507809a100 2024-09-21T09:07:18.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.461+0000 7f50757fa640 1 -- 172.21.15.44:0/1457730332 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f506c0073f0 con 0x7f507809a100 2024-09-21T09:07:18.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.461+0000 7f507f0a6640 1 -- 172.21.15.44:0/1457730332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5078096f80 con 0x7f507809a100 2024-09-21T09:07:18.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.462+0000 7f50757fa640 1 -- 172.21.15.44:0/1457730332 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f506c01b070 con 0x7f507809a100 2024-09-21T09:07:18.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.462+0000 7f507f0a6640 1 -- 172.21.15.44:0/1457730332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5078126360 con 0x7f507809a100 2024-09-21T09:07:18.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.463+0000 7f50757fa640 1 --2- 172.21.15.44:0/1457730332 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f505c0382a0 0x7f505c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:07:18.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.463+0000 7f50757fa640 1 -- 172.21.15.44:0/1457730332 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f506c04af70 con 0x7f507809a100 2024-09-21T09:07:18.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.463+0000 7f5077fff640 1 --2- 172.21.15.44:0/1457730332 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f505c0382a0 0x7f505c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:07:18.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.464+0000 7f5077fff640 1 --2- 172.21.15.44:0/1457730332 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f505c0382a0 0x7f505c03a760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5064034000 tx=0x7f506402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:07:18.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.468+0000 7f50757fa640 1 -- 172.21.15.44:0/1457730332 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5078125fc0 con 0x7f507809a100 2024-09-21T09:07:18.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.642+0000 7f507f0a6640 1 -- 172.21.15.44:0/1457730332 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f507809d020 con 0x7f505c0382a0 2024-09-21T09:07:18.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.657+0000 7f50757fa640 1 -- 172.21.15.44:0/1457730332 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664953 (secure 0 0 0) 0x7f507809d020 con 0x7f505c0382a0 2024-09-21T09:07:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:07:18.670 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-21T09:07:18.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.661+0000 7f507f0a6640 1 -- 172.21.15.44:0/1457730332 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f505c0382a0 msgr2=0x7f505c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:18.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.662+0000 7f507f0a6640 1 --2- 172.21.15.44:0/1457730332 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f505c0382a0 0x7f505c03a760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5064034000 tx=0x7f506402e000 comp rx=0 tx=0).stop 2024-09-21T09:07:18.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.662+0000 7f507f0a6640 1 -- 172.21.15.44:0/1457730332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f507809a100 msgr2=0x7f5078132a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:18.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.662+0000 7f507f0a6640 1 --2- 172.21.15.44:0/1457730332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f507809a100 0x7f5078132a40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f506c00c700 tx=0x7f506c00cbc0 comp rx=0 tx=0).stop 2024-09-21T09:07:18.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.662+0000 7f507f0a6640 1 -- 172.21.15.44:0/1457730332 shutdown_connections 2024-09-21T09:07:18.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.662+0000 7f507f0a6640 1 --2- 172.21.15.44:0/1457730332 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f505c0382a0 0x7f505c03a760 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:07:18.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.662+0000 7f507f0a6640 1 --2- 172.21.15.44:0/1457730332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f507809a100 0x7f5078132a40 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:07:18.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.662+0000 7f507f0a6640 1 -- 172.21.15.44:0/1457730332 >> 172.21.15.44:0/1457730332 conn(0x7f507806d4a0 msgr2=0x7f507808d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:07:18.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.662+0000 7f507f0a6640 1 -- 172.21.15.44:0/1457730332 shutdown_connections 2024-09-21T09:07:18.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:18.662+0000 7f507f0a6640 1 -- 172.21.15.44:0/1457730332 wait complete. 2024-09-21T09:07:18.674 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-09-21T09:07:18.506219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5097,"num_read_kb":4682,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4783,"ondisk_log_size":4783,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":123360,"kb_used_data":2784,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377364000,"statfs":{"total":386547056640,"available":386420736000,"internally_reserved":0,"allocated":2850816,"data_stored":1716104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":123397911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003595"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:08.844076+0000","last_change":"2024-09-21T09:07:08.844101+0000","last_active":"2024-09-21T09:07:08.844076+0000","last_peered":"2024-09-21T09:07:08.844076+0000","last_clean":"2024-09-21T09:07:08.844076+0000","last_became_active":"2024-09-21T09:03:38.283357+0000","last_became_peered":"2024-09-21T09:03:38.283357+0000","last_unstale":"2024-09-21T09:07:08.844076+0000","last_undegraded":"2024-09-21T09:07:08.844076+0000","last_fullsized":"2024-09-21T09:07:08.844076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:08.843993+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:08.843993+0000","last_clean_scrub_stamp":"2024-09-21T09:07:08.843993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:08.569217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'20","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.326848+0000","last_change":"2024-09-21T09:06:41.326875+0000","last_active":"2024-09-21T09:06:41.326848+0000","last_peered":"2024-09-21T09:06:41.326848+0000","last_clean":"2024-09-21T09:06:41.326848+0000","last_became_active":"2024-09-21T09:03:00.226067+0000","last_became_peered":"2024-09-21T09:03:00.226067+0000","last_unstale":"2024-09-21T09:06:41.326848+0000","last_undegraded":"2024-09-21T09:06:41.326848+0000","last_fullsized":"2024-09-21T09:06:41.326848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-09-21T09:06:41.326750+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-09-21T09:06:41.326750+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.326750+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:11.322304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:53.042423+0000","last_change":"2024-09-21T09:06:53.042423+0000","last_active":"2024-09-21T09:06:53.042423+0000","last_peered":"2024-09-21T09:06:53.042423+0000","last_clean":"2024-09-21T09:06:53.042423+0000","last_became_active":"2024-09-21T09:02:58.212828+0000","last_became_peered":"2024-09-21T09:02:58.212828+0000","last_unstale":"2024-09-21T09:06:53.042423+0000","last_undegraded":"2024-09-21T09:06:53.042423+0000","last_fullsized":"2024-09-21T09:06:53.042423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:53.042305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:53.042305+0000","last_clean_scrub_stamp":"2024-09-21T09:06:53.042305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:10.826523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.265814+0000","last_change":"2024-09-21T09:06:30.265847+0000","last_active":"2024-09-21T09:06:30.265814+0000","last_peered":"2024-09-21T09:06:30.265814+0000","last_clean":"2024-09-21T09:06:30.265814+0000","last_became_active":"2024-09-21T09:03:00.222333+0000","last_became_peered":"2024-09-21T09:03:00.222333+0000","last_unstale":"2024-09-21T09:06:30.265814+0000","last_undegraded":"2024-09-21T09:06:30.265814+0000","last_fullsized":"2024-09-21T09:06:30.265814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:30.265727+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:30.265727+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.265727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:36.517568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:13.369349+0000","last_change":"2024-09-21T09:07:13.369370+0000","last_active":"2024-09-21T09:07:13.369349+0000","last_peered":"2024-09-21T09:07:13.369349+0000","last_clean":"2024-09-21T09:07:13.369349+0000","last_became_active":"2024-09-21T09:02:58.221214+0000","last_became_peered":"2024-09-21T09:02:58.221214+0000","last_unstale":"2024-09-21T09:07:13.369349+0000","last_undegraded":"2024-09-21T09:07:13.369349+0000","last_fullsized":"2024-09-21T09:07:13.369349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:13.369253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:13.369253+0000","last_clean_scrub_stamp":"2024-09-21T09:07:13.369253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:49.626494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.250533+0000","last_change":"2024-09-21T09:06:35.250559+0000","last_active":"2024-09-21T09:06:35.250533+0000","last_peered":"2024-09-21T09:06:35.250533+0000","last_clean":"2024-09-21T09:06:35.250533+0000","last_became_active":"2024-09-21T09:03:00.221451+0000","last_became_peered":"2024-09-21T09:03:00.221451+0000","last_unstale":"2024-09-21T09:06:35.250533+0000","last_undegraded":"2024-09-21T09:06:35.250533+0000","last_fullsized":"2024-09-21T09:06:35.250533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:35.250442+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:35.250442+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.250442+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:20.257549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.754424+0000","last_change":"2024-09-21T09:07:00.754467+0000","last_active":"2024-09-21T09:07:00.754424+0000","last_peered":"2024-09-21T09:07:00.754424+0000","last_clean":"2024-09-21T09:07:00.754424+0000","last_became_active":"2024-09-21T09:02:58.207683+0000","last_became_peered":"2024-09-21T09:02:58.207683+0000","last_unstale":"2024-09-21T09:07:00.754424+0000","last_undegraded":"2024-09-21T09:07:00.754424+0000","last_fullsized":"2024-09-21T09:07:00.754424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:00.754339+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:00.754339+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.754339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:18.538557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'10","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:04.189682+0000","last_change":"2024-09-21T09:07:04.189715+0000","last_active":"2024-09-21T09:07:04.189682+0000","last_peered":"2024-09-21T09:07:04.189682+0000","last_clean":"2024-09-21T09:07:04.189682+0000","last_became_active":"2024-09-21T09:03:00.210589+0000","last_became_peered":"2024-09-21T09:03:00.210589+0000","last_unstale":"2024-09-21T09:07:04.189682+0000","last_undegraded":"2024-09-21T09:07:04.189682+0000","last_fullsized":"2024-09-21T09:07:04.189682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:07:04.189564+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:07:04.189564+0000","last_clean_scrub_stamp":"2024-09-21T09:07:04.189564+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:36.569469+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:08.284884+0000","last_change":"2024-09-21T09:07:08.284930+0000","last_active":"2024-09-21T09:07:08.284884+0000","last_peered":"2024-09-21T09:07:08.284884+0000","last_clean":"2024-09-21T09:07:08.284884+0000","last_became_active":"2024-09-21T09:02:58.224630+0000","last_became_peered":"2024-09-21T09:02:58.224630+0000","last_unstale":"2024-09-21T09:07:08.284884+0000","last_undegraded":"2024-09-21T09:07:08.284884+0000","last_fullsized":"2024-09-21T09:07:08.284884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:08.284770+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:08.284770+0000","last_clean_scrub_stamp":"2024-09-21T09:07:08.284770+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:56.353696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'6","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:55.505244+0000","last_change":"2024-09-21T09:06:55.505244+0000","last_active":"2024-09-21T09:06:55.505244+0000","last_peered":"2024-09-21T09:06:55.505244+0000","last_clean":"2024-09-21T09:06:55.505244+0000","last_became_active":"2024-09-21T09:03:00.217048+0000","last_became_peered":"2024-09-21T09:03:00.217048+0000","last_unstale":"2024-09-21T09:06:55.505244+0000","last_undegraded":"2024-09-21T09:06:55.505244+0000","last_fullsized":"2024-09-21T09:06:55.505244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:55.505082+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:55.505082+0000","last_clean_scrub_stamp":"2024-09-21T09:06:55.505082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:44.261254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:56.842134+0000","last_change":"2024-09-21T09:06:56.842183+0000","last_active":"2024-09-21T09:06:56.842134+0000","last_peered":"2024-09-21T09:06:56.842134+0000","last_clean":"2024-09-21T09:06:56.842134+0000","last_became_active":"2024-09-21T09:02:58.205515+0000","last_became_peered":"2024-09-21T09:02:58.205515+0000","last_unstale":"2024-09-21T09:06:56.842134+0000","last_undegraded":"2024-09-21T09:06:56.842134+0000","last_fullsized":"2024-09-21T09:06:56.842134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:56.841999+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:56.841999+0000","last_clean_scrub_stamp":"2024-09-21T09:06:56.841999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:47.146653+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'14","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.235193+0000","last_change":"2024-09-21T09:06:32.235193+0000","last_active":"2024-09-21T09:06:32.235193+0000","last_peered":"2024-09-21T09:06:32.235193+0000","last_clean":"2024-09-21T09:06:32.235193+0000","last_became_active":"2024-09-21T09:03:00.221117+0000","last_became_peered":"2024-09-21T09:03:00.221117+0000","last_unstale":"2024-09-21T09:06:32.235193+0000","last_undegraded":"2024-09-21T09:06:32.235193+0000","last_fullsized":"2024-09-21T09:06:32.235193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:32.235081+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:32.235081+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.235081+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:09.067914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.250827+0000","last_change":"2024-09-21T09:02:58.211066+0000","last_active":"2024-09-21T09:06:06.250827+0000","last_peered":"2024-09-21T09:06:06.250827+0000","last_clean":"2024-09-21T09:06:06.250827+0000","last_became_active":"2024-09-21T09:02:58.210702+0000","last_became_peered":"2024-09-21T09:02:58.210702+0000","last_unstale":"2024-09-21T09:06:06.250827+0000","last_undegraded":"2024-09-21T09:06:06.250827+0000","last_fullsized":"2024-09-21T09:06:06.250827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.841450+0000","last_change":"2024-09-21T09:06:43.841450+0000","last_active":"2024-09-21T09:06:43.841450+0000","last_peered":"2024-09-21T09:06:43.841450+0000","last_clean":"2024-09-21T09:06:43.841450+0000","last_became_active":"2024-09-21T09:03:00.220725+0000","last_became_peered":"2024-09-21T09:03:00.220725+0000","last_unstale":"2024-09-21T09:06:43.841450+0000","last_undegraded":"2024-09-21T09:06:43.841450+0000","last_fullsized":"2024-09-21T09:06:43.841450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:43.841334+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:43.841334+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.841334+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:18.385562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.951181+0000","last_change":"2024-09-21T09:06:48.951210+0000","last_active":"2024-09-21T09:06:48.951181+0000","last_peered":"2024-09-21T09:06:48.951181+0000","last_clean":"2024-09-21T09:06:48.951181+0000","last_became_active":"2024-09-21T09:02:58.216712+0000","last_became_peered":"2024-09-21T09:02:58.216712+0000","last_unstale":"2024-09-21T09:06:48.951181+0000","last_undegraded":"2024-09-21T09:06:48.951181+0000","last_fullsized":"2024-09-21T09:06:48.951181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:48.951088+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:48.951088+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.951088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:39.255743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'14","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.817668+0000","last_change":"2024-09-21T09:06:45.817668+0000","last_active":"2024-09-21T09:06:45.817668+0000","last_peered":"2024-09-21T09:06:45.817668+0000","last_clean":"2024-09-21T09:06:45.817668+0000","last_became_active":"2024-09-21T09:03:00.222593+0000","last_became_peered":"2024-09-21T09:03:00.222593+0000","last_unstale":"2024-09-21T09:06:45.817668+0000","last_undegraded":"2024-09-21T09:06:45.817668+0000","last_fullsized":"2024-09-21T09:06:45.817668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:45.817550+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:45.817550+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.817550+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:37.374671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'12","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:54.260760+0000","last_change":"2024-09-21T09:06:54.260803+0000","last_active":"2024-09-21T09:06:54.260760+0000","last_peered":"2024-09-21T09:06:54.260760+0000","last_clean":"2024-09-21T09:06:54.260760+0000","last_became_active":"2024-09-21T09:03:00.219923+0000","last_became_peered":"2024-09-21T09:03:00.219923+0000","last_unstale":"2024-09-21T09:06:54.260760+0000","last_undegraded":"2024-09-21T09:06:54.260760+0000","last_fullsized":"2024-09-21T09:06:54.260760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:06:54.260650+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:06:54.260650+0000","last_clean_scrub_stamp":"2024-09-21T09:06:54.260650+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:57.689493+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:52.471683+0000","last_change":"2024-09-21T09:06:52.471725+0000","last_active":"2024-09-21T09:06:52.471683+0000","last_peered":"2024-09-21T09:06:52.471683+0000","last_clean":"2024-09-21T09:06:52.471683+0000","last_became_active":"2024-09-21T09:02:58.210936+0000","last_became_peered":"2024-09-21T09:02:58.210936+0000","last_unstale":"2024-09-21T09:06:52.471683+0000","last_undegraded":"2024-09-21T09:06:52.471683+0000","last_fullsized":"2024-09-21T09:06:52.471683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:52.471565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:52.471565+0000","last_clean_scrub_stamp":"2024-09-21T09:06:52.471565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:54.462085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:09.435009+0000","last_change":"2024-09-21T09:07:09.435075+0000","last_active":"2024-09-21T09:07:09.435009+0000","last_peered":"2024-09-21T09:07:09.435009+0000","last_clean":"2024-09-21T09:07:09.435009+0000","last_became_active":"2024-09-21T09:03:00.224695+0000","last_became_peered":"2024-09-21T09:03:00.224695+0000","last_unstale":"2024-09-21T09:07:09.435009+0000","last_undegraded":"2024-09-21T09:07:09.435009+0000","last_fullsized":"2024-09-21T09:07:09.435009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:07:09.434895+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:07:09.434895+0000","last_clean_scrub_stamp":"2024-09-21T09:07:09.434895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:52.485628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'4","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.798146+0000","last_change":"2024-09-21T09:06:48.798173+0000","last_active":"2024-09-21T09:06:48.798146+0000","last_peered":"2024-09-21T09:06:48.798146+0000","last_clean":"2024-09-21T09:06:48.798146+0000","last_became_active":"2024-09-21T09:02:58.218643+0000","last_became_peered":"2024-09-21T09:02:58.218643+0000","last_unstale":"2024-09-21T09:06:48.798146+0000","last_undegraded":"2024-09-21T09:06:48.798146+0000","last_fullsized":"2024-09-21T09:06:48.798146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:48.798053+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:48.798053+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.798053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:18.793607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.262860+0000","last_change":"2024-09-21T09:06:36.262904+0000","last_active":"2024-09-21T09:06:36.262860+0000","last_peered":"2024-09-21T09:06:36.262860+0000","last_clean":"2024-09-21T09:06:36.262860+0000","last_became_active":"2024-09-21T09:03:00.226738+0000","last_became_peered":"2024-09-21T09:03:00.226738+0000","last_unstale":"2024-09-21T09:06:36.262860+0000","last_undegraded":"2024-09-21T09:06:36.262860+0000","last_fullsized":"2024-09-21T09:06:36.262860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:36.262757+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:36.262757+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.262757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:35.824400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:08.479089+0000","last_change":"2024-09-21T09:07:08.479116+0000","last_active":"2024-09-21T09:07:08.479089+0000","last_peered":"2024-09-21T09:07:08.479089+0000","last_clean":"2024-09-21T09:07:08.479089+0000","last_became_active":"2024-09-21T09:02:58.208220+0000","last_became_peered":"2024-09-21T09:02:58.208220+0000","last_unstale":"2024-09-21T09:07:08.479089+0000","last_undegraded":"2024-09-21T09:07:08.479089+0000","last_fullsized":"2024-09-21T09:07:08.479089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:08.479000+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:08.479000+0000","last_clean_scrub_stamp":"2024-09-21T09:07:08.479000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:25.854120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'16","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.914907+0000","last_change":"2024-09-21T09:06:47.914935+0000","last_active":"2024-09-21T09:06:47.914907+0000","last_peered":"2024-09-21T09:06:47.914907+0000","last_clean":"2024-09-21T09:06:47.914907+0000","last_became_active":"2024-09-21T09:03:00.215637+0000","last_became_peered":"2024-09-21T09:03:00.215637+0000","last_unstale":"2024-09-21T09:06:47.914907+0000","last_undegraded":"2024-09-21T09:06:47.914907+0000","last_fullsized":"2024-09-21T09:06:47.914907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-21T09:06:47.914812+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-21T09:06:47.914812+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.914812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:54.745182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:04.512320+0000","last_change":"2024-09-21T09:07:04.512344+0000","last_active":"2024-09-21T09:07:04.512320+0000","last_peered":"2024-09-21T09:07:04.512320+0000","last_clean":"2024-09-21T09:07:04.512320+0000","last_became_active":"2024-09-21T09:02:58.204603+0000","last_became_peered":"2024-09-21T09:02:58.204603+0000","last_unstale":"2024-09-21T09:07:04.512320+0000","last_undegraded":"2024-09-21T09:07:04.512320+0000","last_fullsized":"2024-09-21T09:07:04.512320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:04.512202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:04.512202+0000","last_clean_scrub_stamp":"2024-09-21T09:07:04.512202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:45.250702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.848398+0000","last_change":"2024-09-21T09:06:49.848438+0000","last_active":"2024-09-21T09:06:49.848398+0000","last_peered":"2024-09-21T09:06:49.848398+0000","last_clean":"2024-09-21T09:06:49.848398+0000","last_became_active":"2024-09-21T09:03:00.222972+0000","last_became_peered":"2024-09-21T09:03:00.222972+0000","last_unstale":"2024-09-21T09:06:49.848398+0000","last_undegraded":"2024-09-21T09:06:49.848398+0000","last_fullsized":"2024-09-21T09:06:49.848398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:49.848287+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:49.848287+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.848287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:12.844393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:11.124033+0000","last_change":"2024-09-21T09:07:11.124071+0000","last_active":"2024-09-21T09:07:11.124033+0000","last_peered":"2024-09-21T09:07:11.124033+0000","last_clean":"2024-09-21T09:07:11.124033+0000","last_became_active":"2024-09-21T09:02:58.208383+0000","last_became_peered":"2024-09-21T09:02:58.208383+0000","last_unstale":"2024-09-21T09:07:11.124033+0000","last_undegraded":"2024-09-21T09:07:11.124033+0000","last_fullsized":"2024-09-21T09:07:11.124033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:11.123939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:11.123939+0000","last_clean_scrub_stamp":"2024-09-21T09:07:11.123939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:23.577108+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.392358+0000","last_change":"2024-09-21T09:06:48.392419+0000","last_active":"2024-09-21T09:06:48.392358+0000","last_peered":"2024-09-21T09:06:48.392358+0000","last_clean":"2024-09-21T09:06:48.392358+0000","last_became_active":"2024-09-21T09:03:00.211942+0000","last_became_peered":"2024-09-21T09:03:00.211942+0000","last_unstale":"2024-09-21T09:06:48.392358+0000","last_undegraded":"2024-09-21T09:06:48.392358+0000","last_fullsized":"2024-09-21T09:06:48.392358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:48.392256+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:48.392256+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.392256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:01:04.152702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:18.459903+0000","last_change":"2024-09-21T09:02:58.214186+0000","last_active":"2024-09-21T09:05:18.459903+0000","last_peered":"2024-09-21T09:05:18.459903+0000","last_clean":"2024-09-21T09:05:18.459903+0000","last_became_active":"2024-09-21T09:02:58.213548+0000","last_became_peered":"2024-09-21T09:02:58.213548+0000","last_unstale":"2024-09-21T09:05:18.459903+0000","last_undegraded":"2024-09-21T09:05:18.459903+0000","last_fullsized":"2024-09-21T09:05:18.459903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'36","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:11.465399+0000","last_change":"2024-09-21T09:07:11.465449+0000","last_active":"2024-09-21T09:07:11.465399+0000","last_peered":"2024-09-21T09:07:11.465399+0000","last_clean":"2024-09-21T09:07:11.465399+0000","last_became_active":"2024-09-21T09:03:08.262362+0000","last_became_peered":"2024-09-21T09:03:08.262362+0000","last_unstale":"2024-09-21T09:07:11.465399+0000","last_undegraded":"2024-09-21T09:07:11.465399+0000","last_fullsized":"2024-09-21T09:07:11.465399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-09-21T09:07:11.465296+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-09-21T09:07:11.465296+0000","last_clean_scrub_stamp":"2024-09-21T09:07:11.465296+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:36.187129+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:03.169410+0000","last_change":"2024-09-21T09:07:03.169432+0000","last_active":"2024-09-21T09:07:03.169410+0000","last_peered":"2024-09-21T09:07:03.169410+0000","last_clean":"2024-09-21T09:07:03.169410+0000","last_became_active":"2024-09-21T09:03:00.209346+0000","last_became_peered":"2024-09-21T09:03:00.209346+0000","last_unstale":"2024-09-21T09:07:03.169410+0000","last_undegraded":"2024-09-21T09:07:03.169410+0000","last_fullsized":"2024-09-21T09:07:03.169410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:03.169305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:03.169305+0000","last_clean_scrub_stamp":"2024-09-21T09:07:03.169305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:21.767291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:15.364403+0000","last_change":"2024-09-21T09:07:15.364429+0000","last_active":"2024-09-21T09:07:15.364403+0000","last_peered":"2024-09-21T09:07:15.364403+0000","last_clean":"2024-09-21T09:07:15.364403+0000","last_became_active":"2024-09-21T09:02:58.221187+0000","last_became_peered":"2024-09-21T09:02:58.221187+0000","last_unstale":"2024-09-21T09:07:15.364403+0000","last_undegraded":"2024-09-21T09:07:15.364403+0000","last_fullsized":"2024-09-21T09:07:15.364403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:07:15.364310+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:07:15.364310+0000","last_clean_scrub_stamp":"2024-09-21T09:07:15.364310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:03.418130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.340714+0000","last_change":"2024-09-21T09:06:20.340738+0000","last_active":"2024-09-21T09:06:20.340714+0000","last_peered":"2024-09-21T09:06:20.340714+0000","last_clean":"2024-09-21T09:06:20.340714+0000","last_became_active":"2024-09-21T09:03:02.220370+0000","last_became_peered":"2024-09-21T09:03:02.220370+0000","last_unstale":"2024-09-21T09:06:20.340714+0000","last_undegraded":"2024-09-21T09:06:20.340714+0000","last_fullsized":"2024-09-21T09:06:20.340714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:20.340586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:20.340586+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.340586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:30.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.319454+0000","last_change":"2024-09-21T09:06:44.319493+0000","last_active":"2024-09-21T09:06:44.319454+0000","last_peered":"2024-09-21T09:06:44.319454+0000","last_clean":"2024-09-21T09:06:44.319454+0000","last_became_active":"2024-09-21T09:03:04.242637+0000","last_became_peered":"2024-09-21T09:03:04.242637+0000","last_unstale":"2024-09-21T09:06:44.319454+0000","last_undegraded":"2024-09-21T09:06:44.319454+0000","last_fullsized":"2024-09-21T09:06:44.319454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-21T09:06:44.319357+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-21T09:06:44.319357+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.319357+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:39.099160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.513447+0000","last_change":"2024-09-21T09:06:16.513487+0000","last_active":"2024-09-21T09:06:16.513447+0000","last_peered":"2024-09-21T09:06:16.513447+0000","last_clean":"2024-09-21T09:06:16.513447+0000","last_became_active":"2024-09-21T09:03:06.247203+0000","last_became_peered":"2024-09-21T09:03:06.247203+0000","last_unstale":"2024-09-21T09:06:16.513447+0000","last_undegraded":"2024-09-21T09:06:16.513447+0000","last_fullsized":"2024-09-21T09:06:16.513447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.513331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.513331+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.513331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:05:45.010706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'10","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:12.457918+0000","last_change":"2024-09-21T09:07:12.457954+0000","last_active":"2024-09-21T09:07:12.457918+0000","last_peered":"2024-09-21T09:07:12.457918+0000","last_clean":"2024-09-21T09:07:12.457918+0000","last_became_active":"2024-09-21T09:03:08.262384+0000","last_became_peered":"2024-09-21T09:03:08.262384+0000","last_unstale":"2024-09-21T09:07:12.457918+0000","last_undegraded":"2024-09-21T09:07:12.457918+0000","last_fullsized":"2024-09-21T09:07:12.457918+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:07:12.457810+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:07:12.457810+0000","last_clean_scrub_stamp":"2024-09-21T09:07:12.457810+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:50.329341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:55.255201+0000","last_change":"2024-09-21T09:06:55.255257+0000","last_active":"2024-09-21T09:06:55.255201+0000","last_peered":"2024-09-21T09:06:55.255201+0000","last_clean":"2024-09-21T09:06:55.255201+0000","last_became_active":"2024-09-21T09:03:00.217658+0000","last_became_peered":"2024-09-21T09:03:00.217658+0000","last_unstale":"2024-09-21T09:06:55.255201+0000","last_undegraded":"2024-09-21T09:06:55.255201+0000","last_fullsized":"2024-09-21T09:06:55.255201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:55.255084+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:55.255084+0000","last_clean_scrub_stamp":"2024-09-21T09:06:55.255084+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:47.433471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:54.827927+0000","last_change":"2024-09-21T09:06:54.827969+0000","last_active":"2024-09-21T09:06:54.827927+0000","last_peered":"2024-09-21T09:06:54.827927+0000","last_clean":"2024-09-21T09:06:54.827927+0000","last_became_active":"2024-09-21T09:02:58.218086+0000","last_became_peered":"2024-09-21T09:02:58.218086+0000","last_unstale":"2024-09-21T09:06:54.827927+0000","last_undegraded":"2024-09-21T09:06:54.827927+0000","last_fullsized":"2024-09-21T09:06:54.827927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:54.827813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:54.827813+0000","last_clean_scrub_stamp":"2024-09-21T09:06:54.827813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:18.334744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.944198+0000","last_change":"2024-09-21T09:06:38.944223+0000","last_active":"2024-09-21T09:06:38.944198+0000","last_peered":"2024-09-21T09:06:38.944198+0000","last_clean":"2024-09-21T09:06:38.944198+0000","last_became_active":"2024-09-21T09:03:02.220557+0000","last_became_peered":"2024-09-21T09:03:02.220557+0000","last_unstale":"2024-09-21T09:06:38.944198+0000","last_undegraded":"2024-09-21T09:06:38.944198+0000","last_fullsized":"2024-09-21T09:06:38.944198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:38.944114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:38.944114+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.944114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:28.572358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'9","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.494942+0000","last_change":"2024-09-21T09:06:22.495014+0000","last_active":"2024-09-21T09:06:22.494942+0000","last_peered":"2024-09-21T09:06:22.494942+0000","last_clean":"2024-09-21T09:06:22.494942+0000","last_became_active":"2024-09-21T09:03:04.236037+0000","last_became_peered":"2024-09-21T09:03:04.236037+0000","last_unstale":"2024-09-21T09:06:22.494942+0000","last_undegraded":"2024-09-21T09:06:22.494942+0000","last_fullsized":"2024-09-21T09:06:22.494942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-21T09:06:22.494847+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-21T09:06:22.494847+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.494847+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:55.904900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.478799+0000","last_change":"2024-09-21T09:06:18.478831+0000","last_active":"2024-09-21T09:06:18.478799+0000","last_peered":"2024-09-21T09:06:18.478799+0000","last_clean":"2024-09-21T09:06:18.478799+0000","last_became_active":"2024-09-21T09:03:06.243901+0000","last_became_peered":"2024-09-21T09:03:06.243901+0000","last_unstale":"2024-09-21T09:06:18.478799+0000","last_undegraded":"2024-09-21T09:06:18.478799+0000","last_fullsized":"2024-09-21T09:06:18.478799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.478706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.478706+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.478706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:41.502223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:13.145708+0000","last_change":"2024-09-21T09:07:13.145749+0000","last_active":"2024-09-21T09:07:13.145708+0000","last_peered":"2024-09-21T09:07:13.145708+0000","last_clean":"2024-09-21T09:07:13.145708+0000","last_became_active":"2024-09-21T09:03:08.250029+0000","last_became_peered":"2024-09-21T09:03:08.250029+0000","last_unstale":"2024-09-21T09:07:13.145708+0000","last_undegraded":"2024-09-21T09:07:13.145708+0000","last_fullsized":"2024-09-21T09:07:13.145708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:07:13.145614+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:07:13.145614+0000","last_clean_scrub_stamp":"2024-09-21T09:07:13.145614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:02.268505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:58.242283+0000","last_change":"2024-09-21T09:06:58.242309+0000","last_active":"2024-09-21T09:06:58.242283+0000","last_peered":"2024-09-21T09:06:58.242283+0000","last_clean":"2024-09-21T09:06:58.242283+0000","last_became_active":"2024-09-21T09:03:00.217633+0000","last_became_peered":"2024-09-21T09:03:00.217633+0000","last_unstale":"2024-09-21T09:06:58.242283+0000","last_undegraded":"2024-09-21T09:06:58.242283+0000","last_fullsized":"2024-09-21T09:06:58.242283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:58.242199+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:58.242199+0000","last_clean_scrub_stamp":"2024-09-21T09:06:58.242199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:33.728371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:12.355914+0000","last_change":"2024-09-21T09:07:12.355953+0000","last_active":"2024-09-21T09:07:12.355914+0000","last_peered":"2024-09-21T09:07:12.355914+0000","last_clean":"2024-09-21T09:07:12.355914+0000","last_became_active":"2024-09-21T09:02:58.220133+0000","last_became_peered":"2024-09-21T09:02:58.220133+0000","last_unstale":"2024-09-21T09:07:12.355914+0000","last_undegraded":"2024-09-21T09:07:12.355914+0000","last_fullsized":"2024-09-21T09:07:12.355914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:12.355798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:12.355798+0000","last_clean_scrub_stamp":"2024-09-21T09:07:12.355798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:24.081357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.974441+0000","last_change":"2024-09-21T09:06:39.974481+0000","last_active":"2024-09-21T09:06:39.974441+0000","last_peered":"2024-09-21T09:06:39.974441+0000","last_clean":"2024-09-21T09:06:39.974441+0000","last_became_active":"2024-09-21T09:03:02.219457+0000","last_became_peered":"2024-09-21T09:03:02.219457+0000","last_unstale":"2024-09-21T09:06:39.974441+0000","last_undegraded":"2024-09-21T09:06:39.974441+0000","last_fullsized":"2024-09-21T09:06:39.974441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:39.974313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:39.974313+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.974313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:26.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.828407+0000","last_change":"2024-09-21T09:06:24.828475+0000","last_active":"2024-09-21T09:06:24.828407+0000","last_peered":"2024-09-21T09:06:24.828407+0000","last_clean":"2024-09-21T09:06:24.828407+0000","last_became_active":"2024-09-21T09:03:04.239187+0000","last_became_peered":"2024-09-21T09:03:04.239187+0000","last_unstale":"2024-09-21T09:06:24.828407+0000","last_undegraded":"2024-09-21T09:06:24.828407+0000","last_fullsized":"2024-09-21T09:06:24.828407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-21T09:06:24.828300+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-21T09:06:24.828300+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.828300+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:54.045825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'285","reported_seq":396,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.260343+0000","last_change":"2024-09-21T09:06:40.260368+0000","last_active":"2024-09-21T09:06:40.260343+0000","last_peered":"2024-09-21T09:06:40.260343+0000","last_clean":"2024-09-21T09:06:40.260343+0000","last_became_active":"2024-09-21T09:03:06.247441+0000","last_became_peered":"2024-09-21T09:03:06.247441+0000","last_unstale":"2024-09-21T09:06:40.260343+0000","last_undegraded":"2024-09-21T09:06:40.260343+0000","last_fullsized":"2024-09-21T09:06:40.260343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:40.260235+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:40.260235+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.260235+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:24.594105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.811807+0000","last_change":"2024-09-21T09:06:33.811859+0000","last_active":"2024-09-21T09:06:33.811807+0000","last_peered":"2024-09-21T09:06:33.811807+0000","last_clean":"2024-09-21T09:06:33.811807+0000","last_became_active":"2024-09-21T09:03:08.255274+0000","last_became_peered":"2024-09-21T09:03:08.255274+0000","last_unstale":"2024-09-21T09:06:33.811807+0000","last_undegraded":"2024-09-21T09:06:33.811807+0000","last_fullsized":"2024-09-21T09:06:33.811807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:33.811708+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:33.811708+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.811708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:39.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:54.060908+0000","last_change":"2024-09-21T09:06:54.060934+0000","last_active":"2024-09-21T09:06:54.060908+0000","last_peered":"2024-09-21T09:06:54.060908+0000","last_clean":"2024-09-21T09:06:54.060908+0000","last_became_active":"2024-09-21T09:03:00.216382+0000","last_became_peered":"2024-09-21T09:03:00.216382+0000","last_unstale":"2024-09-21T09:06:54.060908+0000","last_undegraded":"2024-09-21T09:06:54.060908+0000","last_fullsized":"2024-09-21T09:06:54.060908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:54.060813+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:54.060813+0000","last_clean_scrub_stamp":"2024-09-21T09:06:54.060813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:26.364312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:54.468484+0000","last_change":"2024-09-21T09:06:54.468529+0000","last_active":"2024-09-21T09:06:54.468484+0000","last_peered":"2024-09-21T09:06:54.468484+0000","last_clean":"2024-09-21T09:06:54.468484+0000","last_became_active":"2024-09-21T09:02:58.210560+0000","last_became_peered":"2024-09-21T09:02:58.210560+0000","last_unstale":"2024-09-21T09:06:54.468484+0000","last_undegraded":"2024-09-21T09:06:54.468484+0000","last_fullsized":"2024-09-21T09:06:54.468484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:54.468377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:54.468377+0000","last_clean_scrub_stamp":"2024-09-21T09:06:54.468377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:26.771876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.409747+0000","last_change":"2024-09-21T09:06:18.409771+0000","last_active":"2024-09-21T09:06:18.409747+0000","last_peered":"2024-09-21T09:06:18.409747+0000","last_clean":"2024-09-21T09:06:18.409747+0000","last_became_active":"2024-09-21T09:03:02.220551+0000","last_became_peered":"2024-09-21T09:03:02.220551+0000","last_unstale":"2024-09-21T09:06:18.409747+0000","last_undegraded":"2024-09-21T09:06:18.409747+0000","last_fullsized":"2024-09-21T09:06:18.409747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.409649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.409649+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.409649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:27:47.530462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.771634+0000","last_change":"2024-09-21T09:06:28.771672+0000","last_active":"2024-09-21T09:06:28.771634+0000","last_peered":"2024-09-21T09:06:28.771634+0000","last_clean":"2024-09-21T09:06:28.771634+0000","last_became_active":"2024-09-21T09:03:04.233848+0000","last_became_peered":"2024-09-21T09:03:04.233848+0000","last_unstale":"2024-09-21T09:06:28.771634+0000","last_undegraded":"2024-09-21T09:06:28.771634+0000","last_fullsized":"2024-09-21T09:06:28.771634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-21T09:06:28.771549+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-21T09:06:28.771549+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.771549+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:21.809857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'285","reported_seq":412,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.666749+0000","last_change":"2024-09-21T09:06:20.666787+0000","last_active":"2024-09-21T09:06:20.666749+0000","last_peered":"2024-09-21T09:06:20.666749+0000","last_clean":"2024-09-21T09:06:20.666749+0000","last_became_active":"2024-09-21T09:03:06.243576+0000","last_became_peered":"2024-09-21T09:03:06.243576+0000","last_unstale":"2024-09-21T09:06:20.666749+0000","last_undegraded":"2024-09-21T09:06:20.666749+0000","last_fullsized":"2024-09-21T09:06:20.666749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:20.666653+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:20.666653+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.666653+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:13.704961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:59.197256+0000","last_change":"2024-09-21T09:06:59.197284+0000","last_active":"2024-09-21T09:06:59.197256+0000","last_peered":"2024-09-21T09:06:59.197256+0000","last_clean":"2024-09-21T09:06:59.197256+0000","last_became_active":"2024-09-21T09:03:00.217545+0000","last_became_peered":"2024-09-21T09:03:00.217545+0000","last_unstale":"2024-09-21T09:06:59.197256+0000","last_undegraded":"2024-09-21T09:06:59.197256+0000","last_fullsized":"2024-09-21T09:06:59.197256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:06:59.197146+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:06:59.197146+0000","last_clean_scrub_stamp":"2024-09-21T09:06:59.197146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:23.728828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:01.715721+0000","last_change":"2024-09-21T09:07:01.715743+0000","last_active":"2024-09-21T09:07:01.715721+0000","last_peered":"2024-09-21T09:07:01.715721+0000","last_clean":"2024-09-21T09:07:01.715721+0000","last_became_active":"2024-09-21T09:02:58.209712+0000","last_became_peered":"2024-09-21T09:02:58.209712+0000","last_unstale":"2024-09-21T09:07:01.715721+0000","last_undegraded":"2024-09-21T09:07:01.715721+0000","last_fullsized":"2024-09-21T09:07:01.715721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:01.715634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:01.715634+0000","last_clean_scrub_stamp":"2024-09-21T09:07:01.715634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:34.019133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"31'2","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.322589+0000","last_change":"2024-09-21T09:06:32.322635+0000","last_active":"2024-09-21T09:06:32.322589+0000","last_peered":"2024-09-21T09:06:32.322589+0000","last_clean":"2024-09-21T09:06:32.322589+0000","last_became_active":"2024-09-21T09:03:02.220629+0000","last_became_peered":"2024-09-21T09:03:02.220629+0000","last_unstale":"2024-09-21T09:06:32.322589+0000","last_undegraded":"2024-09-21T09:06:32.322589+0000","last_fullsized":"2024-09-21T09:06:32.322589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:32.322492+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:32.322492+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.322492+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:05.196838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'51","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.776033+0000","last_change":"2024-09-21T09:06:30.776075+0000","last_active":"2024-09-21T09:06:30.776033+0000","last_peered":"2024-09-21T09:06:30.776033+0000","last_clean":"2024-09-21T09:06:30.776033+0000","last_became_active":"2024-09-21T09:03:04.232394+0000","last_became_peered":"2024-09-21T09:03:04.232394+0000","last_unstale":"2024-09-21T09:06:30.776033+0000","last_undegraded":"2024-09-21T09:06:30.776033+0000","last_fullsized":"2024-09-21T09:06:30.776033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2024-09-21T09:06:30.775947+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2024-09-21T09:06:30.775947+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.775947+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:12.569145+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.694297+0000","last_change":"2024-09-21T09:06:18.694322+0000","last_active":"2024-09-21T09:06:18.694297+0000","last_peered":"2024-09-21T09:06:18.694297+0000","last_clean":"2024-09-21T09:06:18.694297+0000","last_became_active":"2024-09-21T09:03:06.244259+0000","last_became_peered":"2024-09-21T09:03:06.244259+0000","last_unstale":"2024-09-21T09:06:18.694297+0000","last_undegraded":"2024-09-21T09:06:18.694297+0000","last_fullsized":"2024-09-21T09:06:18.694297+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.694207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.694207+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.694207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:38.655887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'3","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:04.795472+0000","last_change":"2024-09-21T09:07:04.795472+0000","last_active":"2024-09-21T09:07:04.795472+0000","last_peered":"2024-09-21T09:07:04.795472+0000","last_clean":"2024-09-21T09:07:04.795472+0000","last_became_active":"2024-09-21T09:03:08.261035+0000","last_became_peered":"2024-09-21T09:03:08.261035+0000","last_unstale":"2024-09-21T09:07:04.795472+0000","last_undegraded":"2024-09-21T09:07:04.795472+0000","last_fullsized":"2024-09-21T09:07:04.795472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:07:04.795349+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:07:04.795349+0000","last_clean_scrub_stamp":"2024-09-21T09:07:04.795349+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:22.726619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.375995+0000","last_change":"2024-09-21T09:06:49.376033+0000","last_active":"2024-09-21T09:06:49.375995+0000","last_peered":"2024-09-21T09:06:49.375995+0000","last_clean":"2024-09-21T09:06:49.375995+0000","last_became_active":"2024-09-21T09:03:00.219765+0000","last_became_peered":"2024-09-21T09:03:00.219765+0000","last_unstale":"2024-09-21T09:06:49.375995+0000","last_undegraded":"2024-09-21T09:06:49.375995+0000","last_fullsized":"2024-09-21T09:06:49.375995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:06:49.375904+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:06:49.375904+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.375904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:39.680559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:02.723069+0000","last_change":"2024-09-21T09:07:02.723098+0000","last_active":"2024-09-21T09:07:02.723069+0000","last_peered":"2024-09-21T09:07:02.723069+0000","last_clean":"2024-09-21T09:07:02.723069+0000","last_became_active":"2024-09-21T09:02:58.214392+0000","last_became_peered":"2024-09-21T09:02:58.214392+0000","last_unstale":"2024-09-21T09:07:02.723069+0000","last_undegraded":"2024-09-21T09:07:02.723069+0000","last_fullsized":"2024-09-21T09:07:02.723069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:02.722972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:02.722972+0000","last_clean_scrub_stamp":"2024-09-21T09:07:02.722972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:02.907615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.778703+0000","last_change":"2024-09-21T09:06:31.778729+0000","last_active":"2024-09-21T09:06:31.778703+0000","last_peered":"2024-09-21T09:06:31.778703+0000","last_clean":"2024-09-21T09:06:31.778703+0000","last_became_active":"2024-09-21T09:03:02.223123+0000","last_became_peered":"2024-09-21T09:03:02.223123+0000","last_unstale":"2024-09-21T09:06:31.778703+0000","last_undegraded":"2024-09-21T09:06:31.778703+0000","last_fullsized":"2024-09-21T09:06:31.778703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:31.778616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:31.778616+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.778616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:58.139384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'38","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.295721+0000","last_change":"2024-09-21T09:06:47.295753+0000","last_active":"2024-09-21T09:06:47.295721+0000","last_peered":"2024-09-21T09:06:47.295721+0000","last_clean":"2024-09-21T09:06:47.295721+0000","last_became_active":"2024-09-21T09:03:04.242404+0000","last_became_peered":"2024-09-21T09:03:04.242404+0000","last_unstale":"2024-09-21T09:06:47.295721+0000","last_undegraded":"2024-09-21T09:06:47.295721+0000","last_fullsized":"2024-09-21T09:06:47.295721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2024-09-21T09:06:47.295625+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2024-09-21T09:06:47.295625+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.295625+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:04.223317+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.680859+0000","last_change":"2024-09-21T09:06:21.680884+0000","last_active":"2024-09-21T09:06:21.680859+0000","last_peered":"2024-09-21T09:06:21.680859+0000","last_clean":"2024-09-21T09:06:21.680859+0000","last_became_active":"2024-09-21T09:03:06.247504+0000","last_became_peered":"2024-09-21T09:03:06.247504+0000","last_unstale":"2024-09-21T09:06:21.680859+0000","last_undegraded":"2024-09-21T09:06:21.680859+0000","last_fullsized":"2024-09-21T09:06:21.680859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:21.680751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:21.680751+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.680751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:07.979811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'4","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.320208+0000","last_change":"2024-09-21T09:06:39.320208+0000","last_active":"2024-09-21T09:06:39.320208+0000","last_peered":"2024-09-21T09:06:39.320208+0000","last_clean":"2024-09-21T09:06:39.320208+0000","last_became_active":"2024-09-21T09:03:08.255814+0000","last_became_peered":"2024-09-21T09:03:08.255814+0000","last_unstale":"2024-09-21T09:06:39.320208+0000","last_undegraded":"2024-09-21T09:06:39.320208+0000","last_fullsized":"2024-09-21T09:06:39.320208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:39.320081+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:39.320081+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.320081+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:28.948326+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.796133+0000","last_change":"2024-09-21T09:06:47.796153+0000","last_active":"2024-09-21T09:06:47.796133+0000","last_peered":"2024-09-21T09:06:47.796133+0000","last_clean":"2024-09-21T09:06:47.796133+0000","last_became_active":"2024-09-21T09:03:00.222650+0000","last_became_peered":"2024-09-21T09:03:00.222650+0000","last_unstale":"2024-09-21T09:06:47.796133+0000","last_undegraded":"2024-09-21T09:06:47.796133+0000","last_fullsized":"2024-09-21T09:06:47.796133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:47.796026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:47.796026+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.796026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:34.626930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:13.459036+0000","last_change":"2024-09-21T09:02:58.213931+0000","last_active":"2024-09-21T09:05:13.459036+0000","last_peered":"2024-09-21T09:05:13.459036+0000","last_clean":"2024-09-21T09:05:13.459036+0000","last_became_active":"2024-09-21T09:02:58.213652+0000","last_became_peered":"2024-09-21T09:02:58.213652+0000","last_unstale":"2024-09-21T09:05:13.459036+0000","last_undegraded":"2024-09-21T09:05:13.459036+0000","last_fullsized":"2024-09-21T09:05:13.459036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:07.798877+0000","last_change":"2024-09-21T09:07:07.798919+0000","last_active":"2024-09-21T09:07:07.798877+0000","last_peered":"2024-09-21T09:07:07.798877+0000","last_clean":"2024-09-21T09:07:07.798877+0000","last_became_active":"2024-09-21T09:03:38.281497+0000","last_became_peered":"2024-09-21T09:03:38.281497+0000","last_unstale":"2024-09-21T09:07:07.798877+0000","last_undegraded":"2024-09-21T09:07:07.798877+0000","last_fullsized":"2024-09-21T09:07:07.798877+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:07.798726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:07.798726+0000","last_clean_scrub_stamp":"2024-09-21T09:07:07.798726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:18.979784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"31'45","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.362380+0000","last_change":"2024-09-21T09:06:25.362435+0000","last_active":"2024-09-21T09:06:25.362380+0000","last_peered":"2024-09-21T09:06:25.362380+0000","last_clean":"2024-09-21T09:06:25.362380+0000","last_became_active":"2024-09-21T09:03:04.240144+0000","last_became_peered":"2024-09-21T09:03:04.240144+0000","last_unstale":"2024-09-21T09:06:25.362380+0000","last_undegraded":"2024-09-21T09:06:25.362380+0000","last_fullsized":"2024-09-21T09:06:25.362380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-09-21T09:06:25.362285+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-09-21T09:06:25.362285+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.362285+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:00.748484+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'285","reported_seq":359,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.980231+0000","last_change":"2024-09-21T09:06:41.980274+0000","last_active":"2024-09-21T09:06:41.980231+0000","last_peered":"2024-09-21T09:06:41.980231+0000","last_clean":"2024-09-21T09:06:41.980231+0000","last_became_active":"2024-09-21T09:03:06.250807+0000","last_became_peered":"2024-09-21T09:03:06.250807+0000","last_unstale":"2024-09-21T09:06:41.980231+0000","last_undegraded":"2024-09-21T09:06:41.980231+0000","last_fullsized":"2024-09-21T09:06:41.980231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:41.980137+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:41.980137+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.980137+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:04.976243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.924367+0000","last_change":"2024-09-21T09:06:45.924395+0000","last_active":"2024-09-21T09:06:45.924367+0000","last_peered":"2024-09-21T09:06:45.924367+0000","last_clean":"2024-09-21T09:06:45.924367+0000","last_became_active":"2024-09-21T09:03:08.250063+0000","last_became_peered":"2024-09-21T09:03:08.250063+0000","last_unstale":"2024-09-21T09:06:45.924367+0000","last_undegraded":"2024-09-21T09:06:45.924367+0000","last_fullsized":"2024-09-21T09:06:45.924367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:45.924274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:45.924274+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.924274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:08.933691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'14","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.881288+0000","last_change":"2024-09-21T09:06:40.881315+0000","last_active":"2024-09-21T09:06:40.881288+0000","last_peered":"2024-09-21T09:06:40.881288+0000","last_clean":"2024-09-21T09:06:40.881288+0000","last_became_active":"2024-09-21T09:03:00.216544+0000","last_became_peered":"2024-09-21T09:03:00.216544+0000","last_unstale":"2024-09-21T09:06:40.881288+0000","last_undegraded":"2024-09-21T09:06:40.881288+0000","last_fullsized":"2024-09-21T09:06:40.881288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:40.881198+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:40.881198+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.881198+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:32:13.994520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:07.234845+0000","last_change":"2024-09-21T09:07:07.234868+0000","last_active":"2024-09-21T09:07:07.234845+0000","last_peered":"2024-09-21T09:07:07.234845+0000","last_clean":"2024-09-21T09:07:07.234845+0000","last_became_active":"2024-09-21T09:02:58.224675+0000","last_became_peered":"2024-09-21T09:02:58.224675+0000","last_unstale":"2024-09-21T09:07:07.234845+0000","last_undegraded":"2024-09-21T09:07:07.234845+0000","last_fullsized":"2024-09-21T09:07:07.234845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:07.234741+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:07.234741+0000","last_clean_scrub_stamp":"2024-09-21T09:07:07.234741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:34.342082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.771504+0000","last_change":"2024-09-21T09:06:32.771529+0000","last_active":"2024-09-21T09:06:32.771504+0000","last_peered":"2024-09-21T09:06:32.771504+0000","last_clean":"2024-09-21T09:06:32.771504+0000","last_became_active":"2024-09-21T09:03:02.222904+0000","last_became_peered":"2024-09-21T09:03:02.222904+0000","last_unstale":"2024-09-21T09:06:32.771504+0000","last_undegraded":"2024-09-21T09:06:32.771504+0000","last_fullsized":"2024-09-21T09:06:32.771504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:32.771408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:32.771408+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.771408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:47.808559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'67","reported_seq":140,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:50.298047+0000","last_change":"2024-09-21T09:06:50.298082+0000","last_active":"2024-09-21T09:06:50.298047+0000","last_peered":"2024-09-21T09:06:50.298047+0000","last_clean":"2024-09-21T09:06:50.298047+0000","last_became_active":"2024-09-21T09:03:04.241679+0000","last_became_peered":"2024-09-21T09:03:04.241679+0000","last_unstale":"2024-09-21T09:06:50.298047+0000","last_undegraded":"2024-09-21T09:06:50.298047+0000","last_fullsized":"2024-09-21T09:06:50.298047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'67","last_scrub_stamp":"2024-09-21T09:06:50.297956+0000","last_deep_scrub":"31'67","last_deep_scrub_stamp":"2024-09-21T09:06:50.297956+0000","last_clean_scrub_stamp":"2024-09-21T09:06:50.297956+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:04.079875+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.788871+0000","last_change":"2024-09-21T09:06:33.788942+0000","last_active":"2024-09-21T09:06:33.788871+0000","last_peered":"2024-09-21T09:06:33.788871+0000","last_clean":"2024-09-21T09:06:33.788871+0000","last_became_active":"2024-09-21T09:03:06.249377+0000","last_became_peered":"2024-09-21T09:03:06.249377+0000","last_unstale":"2024-09-21T09:06:33.788871+0000","last_undegraded":"2024-09-21T09:06:33.788871+0000","last_fullsized":"2024-09-21T09:06:33.788871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:33.788739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:33.788739+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.788739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:57.255671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'22","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.459659+0000","last_change":"2024-09-21T09:03:08.260431+0000","last_active":"2024-09-21T09:06:06.459659+0000","last_peered":"2024-09-21T09:06:06.459659+0000","last_clean":"2024-09-21T09:06:06.459659+0000","last_became_active":"2024-09-21T09:03:08.260071+0000","last_became_peered":"2024-09-21T09:03:08.260071+0000","last_unstale":"2024-09-21T09:06:06.459659+0000","last_undegraded":"2024-09-21T09:06:06.459659+0000","last_fullsized":"2024-09-21T09:06:06.459659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:53.473992+0000","last_change":"2024-09-21T09:06:53.474018+0000","last_active":"2024-09-21T09:06:53.473992+0000","last_peered":"2024-09-21T09:06:53.473992+0000","last_clean":"2024-09-21T09:06:53.473992+0000","last_became_active":"2024-09-21T09:03:00.223184+0000","last_became_peered":"2024-09-21T09:03:00.223184+0000","last_unstale":"2024-09-21T09:06:53.473992+0000","last_undegraded":"2024-09-21T09:06:53.473992+0000","last_fullsized":"2024-09-21T09:06:53.473992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:53.473903+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:53.473903+0000","last_clean_scrub_stamp":"2024-09-21T09:06:53.473903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:11.258122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.030686+0000","last_change":"2024-09-21T09:06:51.030713+0000","last_active":"2024-09-21T09:06:51.030686+0000","last_peered":"2024-09-21T09:06:51.030686+0000","last_clean":"2024-09-21T09:06:51.030686+0000","last_became_active":"2024-09-21T09:02:58.216545+0000","last_became_peered":"2024-09-21T09:02:58.216545+0000","last_unstale":"2024-09-21T09:06:51.030686+0000","last_undegraded":"2024-09-21T09:06:51.030686+0000","last_fullsized":"2024-09-21T09:06:51.030686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:51.030555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:51.030555+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.030555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.507576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.793683+0000","last_change":"2024-09-21T09:06:35.793708+0000","last_active":"2024-09-21T09:06:35.793683+0000","last_peered":"2024-09-21T09:06:35.793683+0000","last_clean":"2024-09-21T09:06:35.793683+0000","last_became_active":"2024-09-21T09:03:02.221352+0000","last_became_peered":"2024-09-21T09:03:02.221352+0000","last_unstale":"2024-09-21T09:06:35.793683+0000","last_undegraded":"2024-09-21T09:06:35.793683+0000","last_fullsized":"2024-09-21T09:06:35.793683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:35.793591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:35.793591+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.793591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:20:03.333500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'39","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.403363+0000","last_change":"2024-09-21T09:06:25.403421+0000","last_active":"2024-09-21T09:06:25.403363+0000","last_peered":"2024-09-21T09:06:25.403363+0000","last_clean":"2024-09-21T09:06:25.403363+0000","last_became_active":"2024-09-21T09:03:04.234750+0000","last_became_peered":"2024-09-21T09:03:04.234750+0000","last_unstale":"2024-09-21T09:06:25.403363+0000","last_undegraded":"2024-09-21T09:06:25.403363+0000","last_fullsized":"2024-09-21T09:06:25.403363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-21T09:06:25.403243+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-21T09:06:25.403243+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.403243+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:10.523882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.288196+0000","last_change":"2024-09-21T09:06:41.288220+0000","last_active":"2024-09-21T09:06:41.288196+0000","last_peered":"2024-09-21T09:06:41.288196+0000","last_clean":"2024-09-21T09:06:41.288196+0000","last_became_active":"2024-09-21T09:03:06.248453+0000","last_became_peered":"2024-09-21T09:03:06.248453+0000","last_unstale":"2024-09-21T09:06:41.288196+0000","last_undegraded":"2024-09-21T09:06:41.288196+0000","last_fullsized":"2024-09-21T09:06:41.288196+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:41.288107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:41.288107+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.288107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:34:02.945842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.201054+0000","last_change":"2024-09-21T09:03:08.260732+0000","last_active":"2024-09-21T09:06:17.201054+0000","last_peered":"2024-09-21T09:06:17.201054+0000","last_clean":"2024-09-21T09:06:17.201054+0000","last_became_active":"2024-09-21T09:03:08.260016+0000","last_became_peered":"2024-09-21T09:03:08.260016+0000","last_unstale":"2024-09-21T09:06:17.201054+0000","last_undegraded":"2024-09-21T09:06:17.201054+0000","last_fullsized":"2024-09-21T09:06:17.201054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'10","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.274976+0000","last_change":"2024-09-21T09:06:34.275028+0000","last_active":"2024-09-21T09:06:34.274976+0000","last_peered":"2024-09-21T09:06:34.274976+0000","last_clean":"2024-09-21T09:06:34.274976+0000","last_became_active":"2024-09-21T09:03:00.220384+0000","last_became_peered":"2024-09-21T09:03:00.220384+0000","last_unstale":"2024-09-21T09:06:34.274976+0000","last_undegraded":"2024-09-21T09:06:34.274976+0000","last_fullsized":"2024-09-21T09:06:34.274976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:34.274878+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:34.274878+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.274878+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:09.374069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'6","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.199832+0000","last_change":"2024-09-21T09:02:58.214415+0000","last_active":"2024-09-21T09:06:17.199832+0000","last_peered":"2024-09-21T09:06:17.199832+0000","last_clean":"2024-09-21T09:06:17.199832+0000","last_became_active":"2024-09-21T09:02:58.213920+0000","last_became_peered":"2024-09-21T09:02:58.213920+0000","last_unstale":"2024-09-21T09:06:17.199832+0000","last_undegraded":"2024-09-21T09:06:17.199832+0000","last_fullsized":"2024-09-21T09:06:17.199832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.986320+0000","last_change":"2024-09-21T09:06:40.986345+0000","last_active":"2024-09-21T09:06:40.986320+0000","last_peered":"2024-09-21T09:06:40.986320+0000","last_clean":"2024-09-21T09:06:40.986320+0000","last_became_active":"2024-09-21T09:03:02.217917+0000","last_became_peered":"2024-09-21T09:03:02.217917+0000","last_unstale":"2024-09-21T09:06:40.986320+0000","last_undegraded":"2024-09-21T09:06:40.986320+0000","last_fullsized":"2024-09-21T09:06:40.986320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:40.986232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:40.986232+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.986232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:10.981786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.798062+0000","last_change":"2024-09-21T09:06:26.798098+0000","last_active":"2024-09-21T09:06:26.798062+0000","last_peered":"2024-09-21T09:06:26.798062+0000","last_clean":"2024-09-21T09:06:26.798062+0000","last_became_active":"2024-09-21T09:03:04.235199+0000","last_became_peered":"2024-09-21T09:03:04.235199+0000","last_unstale":"2024-09-21T09:06:26.798062+0000","last_undegraded":"2024-09-21T09:06:26.798062+0000","last_fullsized":"2024-09-21T09:06:26.798062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-21T09:06:26.797980+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-21T09:06:26.797980+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.797980+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:46.759660+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'285","reported_seq":414,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.872442+0000","last_change":"2024-09-21T09:06:19.872473+0000","last_active":"2024-09-21T09:06:19.872442+0000","last_peered":"2024-09-21T09:06:19.872442+0000","last_clean":"2024-09-21T09:06:19.872442+0000","last_became_active":"2024-09-21T09:03:06.245904+0000","last_became_peered":"2024-09-21T09:03:06.245904+0000","last_unstale":"2024-09-21T09:06:19.872442+0000","last_undegraded":"2024-09-21T09:06:19.872442+0000","last_fullsized":"2024-09-21T09:06:19.872442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:19.872353+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:19.872353+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.872353+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:08.095534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'13","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:16.144340+0000","last_change":"2024-09-21T09:07:16.144340+0000","last_active":"2024-09-21T09:07:16.144340+0000","last_peered":"2024-09-21T09:07:16.144340+0000","last_clean":"2024-09-21T09:07:16.144340+0000","last_became_active":"2024-09-21T09:03:08.253648+0000","last_became_peered":"2024-09-21T09:03:08.253648+0000","last_unstale":"2024-09-21T09:07:16.144340+0000","last_undegraded":"2024-09-21T09:07:16.144340+0000","last_fullsized":"2024-09-21T09:07:16.144340+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-09-21T09:07:16.144218+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-09-21T09:07:16.144218+0000","last_clean_scrub_stamp":"2024-09-21T09:07:16.144218+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:32.982703+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'6","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.912326+0000","last_change":"2024-09-21T09:06:51.912356+0000","last_active":"2024-09-21T09:06:51.912326+0000","last_peered":"2024-09-21T09:06:51.912326+0000","last_clean":"2024-09-21T09:06:51.912326+0000","last_became_active":"2024-09-21T09:03:00.222983+0000","last_became_peered":"2024-09-21T09:03:00.222983+0000","last_unstale":"2024-09-21T09:06:51.912326+0000","last_undegraded":"2024-09-21T09:06:51.912326+0000","last_fullsized":"2024-09-21T09:06:51.912326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:51.912243+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:51.912243+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.912243+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:02.222694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.199880+0000","last_change":"2024-09-21T09:02:58.222294+0000","last_active":"2024-09-21T09:06:17.199880+0000","last_peered":"2024-09-21T09:06:17.199880+0000","last_clean":"2024-09-21T09:06:17.199880+0000","last_became_active":"2024-09-21T09:02:58.221805+0000","last_became_peered":"2024-09-21T09:02:58.221805+0000","last_unstale":"2024-09-21T09:06:17.199880+0000","last_undegraded":"2024-09-21T09:06:17.199880+0000","last_fullsized":"2024-09-21T09:06:17.199880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'5","reported_seq":428,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.332881+0000","last_change":"2024-09-21T09:06:29.332947+0000","last_active":"2024-09-21T09:06:29.332881+0000","last_peered":"2024-09-21T09:06:29.332881+0000","last_clean":"2024-09-21T09:06:29.332881+0000","last_became_active":"2024-09-21T09:03:02.222002+0000","last_became_peered":"2024-09-21T09:03:02.222002+0000","last_unstale":"2024-09-21T09:06:29.332881+0000","last_undegraded":"2024-09-21T09:06:29.332881+0000","last_fullsized":"2024-09-21T09:06:29.332881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-21T09:06:29.332773+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-21T09:06:29.332773+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.332773+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:09.966077+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.284616+0000","last_change":"2024-09-21T09:06:46.284654+0000","last_active":"2024-09-21T09:06:46.284616+0000","last_peered":"2024-09-21T09:06:46.284616+0000","last_clean":"2024-09-21T09:06:46.284616+0000","last_became_active":"2024-09-21T09:03:04.242702+0000","last_became_peered":"2024-09-21T09:03:04.242702+0000","last_unstale":"2024-09-21T09:06:46.284616+0000","last_undegraded":"2024-09-21T09:06:46.284616+0000","last_fullsized":"2024-09-21T09:06:46.284616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-21T09:06:46.284518+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-21T09:06:46.284518+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.284518+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:13.659340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'285","reported_seq":476,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.472438+0000","last_change":"2024-09-21T09:06:23.472499+0000","last_active":"2024-09-21T09:06:23.472438+0000","last_peered":"2024-09-21T09:06:23.472438+0000","last_clean":"2024-09-21T09:06:23.472438+0000","last_became_active":"2024-09-21T09:03:06.248991+0000","last_became_peered":"2024-09-21T09:03:06.248991+0000","last_unstale":"2024-09-21T09:06:23.472438+0000","last_undegraded":"2024-09-21T09:06:23.472438+0000","last_fullsized":"2024-09-21T09:06:23.472438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:23.472342+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:23.472342+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.472342+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:12:45.159682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.737148+0000","last_change":"2024-09-21T09:06:29.737148+0000","last_active":"2024-09-21T09:06:29.737148+0000","last_peered":"2024-09-21T09:06:29.737148+0000","last_clean":"2024-09-21T09:06:29.737148+0000","last_became_active":"2024-09-21T09:03:08.252549+0000","last_became_peered":"2024-09-21T09:03:08.252549+0000","last_unstale":"2024-09-21T09:06:29.737148+0000","last_undegraded":"2024-09-21T09:06:29.737148+0000","last_fullsized":"2024-09-21T09:06:29.737148+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:29.737036+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:29.737036+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.737036+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:16.036097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'6","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:57.545236+0000","last_change":"2024-09-21T09:06:57.545294+0000","last_active":"2024-09-21T09:06:57.545236+0000","last_peered":"2024-09-21T09:06:57.545236+0000","last_clean":"2024-09-21T09:06:57.545236+0000","last_became_active":"2024-09-21T09:03:00.223719+0000","last_became_peered":"2024-09-21T09:03:00.223719+0000","last_unstale":"2024-09-21T09:06:57.545236+0000","last_undegraded":"2024-09-21T09:06:57.545236+0000","last_fullsized":"2024-09-21T09:06:57.545236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:57.545132+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:57.545132+0000","last_clean_scrub_stamp":"2024-09-21T09:06:57.545132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:15.476402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.199739+0000","last_change":"2024-09-21T09:02:58.214335+0000","last_active":"2024-09-21T09:06:17.199739+0000","last_peered":"2024-09-21T09:06:17.199739+0000","last_clean":"2024-09-21T09:06:17.199739+0000","last_became_active":"2024-09-21T09:02:58.214074+0000","last_became_peered":"2024-09-21T09:02:58.214074+0000","last_unstale":"2024-09-21T09:06:17.199739+0000","last_undegraded":"2024-09-21T09:06:17.199739+0000","last_fullsized":"2024-09-21T09:06:17.199739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.434384+0000","last_change":"2024-09-21T09:06:17.434407+0000","last_active":"2024-09-21T09:06:17.434384+0000","last_peered":"2024-09-21T09:06:17.434384+0000","last_clean":"2024-09-21T09:06:17.434384+0000","last_became_active":"2024-09-21T09:03:02.222095+0000","last_became_peered":"2024-09-21T09:03:02.222095+0000","last_unstale":"2024-09-21T09:06:17.434384+0000","last_undegraded":"2024-09-21T09:06:17.434384+0000","last_fullsized":"2024-09-21T09:06:17.434384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.434249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.434249+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.434249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:39.005942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'48","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.432681+0000","last_change":"2024-09-21T09:06:24.432715+0000","last_active":"2024-09-21T09:06:24.432681+0000","last_peered":"2024-09-21T09:06:24.432681+0000","last_clean":"2024-09-21T09:06:24.432681+0000","last_became_active":"2024-09-21T09:03:04.235633+0000","last_became_peered":"2024-09-21T09:03:04.235633+0000","last_unstale":"2024-09-21T09:06:24.432681+0000","last_undegraded":"2024-09-21T09:06:24.432681+0000","last_fullsized":"2024-09-21T09:06:24.432681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-09-21T09:06:24.432601+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-09-21T09:06:24.432601+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.432601+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:09.424036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.767356+0000","last_change":"2024-09-21T09:06:16.767379+0000","last_active":"2024-09-21T09:06:16.767356+0000","last_peered":"2024-09-21T09:06:16.767356+0000","last_clean":"2024-09-21T09:06:16.767356+0000","last_became_active":"2024-09-21T09:03:06.247977+0000","last_became_peered":"2024-09-21T09:03:06.247977+0000","last_unstale":"2024-09-21T09:06:16.767356+0000","last_undegraded":"2024-09-21T09:06:16.767356+0000","last_fullsized":"2024-09-21T09:06:16.767356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.767232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.767232+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.767232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:11.816433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.332932+0000","last_change":"2024-09-21T09:06:31.332932+0000","last_active":"2024-09-21T09:06:31.332932+0000","last_peered":"2024-09-21T09:06:31.332932+0000","last_clean":"2024-09-21T09:06:31.332932+0000","last_became_active":"2024-09-21T09:03:08.251985+0000","last_became_peered":"2024-09-21T09:03:08.251985+0000","last_unstale":"2024-09-21T09:06:31.332932+0000","last_undegraded":"2024-09-21T09:06:31.332932+0000","last_fullsized":"2024-09-21T09:06:31.332932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:31.332791+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:31.332791+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.332791+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:00.603145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.238589+0000","last_change":"2024-09-21T09:06:36.238589+0000","last_active":"2024-09-21T09:06:36.238589+0000","last_peered":"2024-09-21T09:06:36.238589+0000","last_clean":"2024-09-21T09:06:36.238589+0000","last_became_active":"2024-09-21T09:03:00.219428+0000","last_became_peered":"2024-09-21T09:03:00.219428+0000","last_unstale":"2024-09-21T09:06:36.238589+0000","last_undegraded":"2024-09-21T09:06:36.238589+0000","last_fullsized":"2024-09-21T09:06:36.238589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:36.238465+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:36.238465+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.238465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:33.483804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":213,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:01.553491+0000","last_change":"2024-09-21T09:07:01.553525+0000","last_active":"2024-09-21T09:07:01.553491+0000","last_peered":"2024-09-21T09:07:01.553491+0000","last_clean":"2024-09-21T09:07:01.553491+0000","last_became_active":"2024-09-21T09:02:44.107052+0000","last_became_peered":"2024-09-21T09:02:44.107052+0000","last_unstale":"2024-09-21T09:07:01.553491+0000","last_undegraded":"2024-09-21T09:07:01.553491+0000","last_fullsized":"2024-09-21T09:07:01.553491+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2024-09-21T09:07:01.553404+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2024-09-21T09:07:01.553404+0000","last_clean_scrub_stamp":"2024-09-21T09:07:01.553404+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:01.278628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.199645+0000","last_change":"2024-09-21T09:02:51.501401+0000","last_active":"2024-09-21T09:06:17.199645+0000","last_peered":"2024-09-21T09:06:17.199645+0000","last_clean":"2024-09-21T09:06:17.199645+0000","last_became_active":"2024-09-21T09:02:49.492504+0000","last_became_peered":"2024-09-21T09:02:49.492504+0000","last_unstale":"2024-09-21T09:06:17.199645+0000","last_undegraded":"2024-09-21T09:06:17.199645+0000","last_fullsized":"2024-09-21T09:06:17.199645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001229291,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.199656+0000","last_change":"2024-09-21T09:02:58.222148+0000","last_active":"2024-09-21T09:06:17.199656+0000","last_peered":"2024-09-21T09:06:17.199656+0000","last_clean":"2024-09-21T09:06:17.199656+0000","last_became_active":"2024-09-21T09:02:58.221874+0000","last_became_peered":"2024-09-21T09:02:58.221874+0000","last_unstale":"2024-09-21T09:06:17.199656+0000","last_undegraded":"2024-09-21T09:06:17.199656+0000","last_fullsized":"2024-09-21T09:06:17.199656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:14.434324+0000","last_change":"2024-09-21T09:07:14.434346+0000","last_active":"2024-09-21T09:07:14.434324+0000","last_peered":"2024-09-21T09:07:14.434324+0000","last_clean":"2024-09-21T09:07:14.434324+0000","last_became_active":"2024-09-21T09:03:38.279694+0000","last_became_peered":"2024-09-21T09:03:38.279694+0000","last_unstale":"2024-09-21T09:07:14.434324+0000","last_undegraded":"2024-09-21T09:07:14.434324+0000","last_fullsized":"2024-09-21T09:07:14.434324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:14.434234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:14.434234+0000","last_clean_scrub_stamp":"2024-09-21T09:07:14.434234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:33.489032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'87","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.362494+0000","last_change":"2024-09-21T09:06:23.362531+0000","last_active":"2024-09-21T09:06:23.362494+0000","last_peered":"2024-09-21T09:06:23.362494+0000","last_clean":"2024-09-21T09:06:23.362494+0000","last_became_active":"2024-09-21T09:03:04.240327+0000","last_became_peered":"2024-09-21T09:03:04.240327+0000","last_unstale":"2024-09-21T09:06:23.362494+0000","last_undegraded":"2024-09-21T09:06:23.362494+0000","last_fullsized":"2024-09-21T09:06:23.362494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2024-09-21T09:06:23.362409+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2024-09-21T09:06:23.362409+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.362409+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:12.872538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.754019+0000","last_change":"2024-09-21T09:06:16.754043+0000","last_active":"2024-09-21T09:06:16.754019+0000","last_peered":"2024-09-21T09:06:16.754019+0000","last_clean":"2024-09-21T09:06:16.754019+0000","last_became_active":"2024-09-21T09:03:06.247593+0000","last_became_peered":"2024-09-21T09:03:06.247593+0000","last_unstale":"2024-09-21T09:06:16.754019+0000","last_undegraded":"2024-09-21T09:06:16.754019+0000","last_fullsized":"2024-09-21T09:06:16.754019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.753939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.753939+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.753939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:45.971463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'83","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.853304+0000","last_change":"2024-09-21T09:06:21.853332+0000","last_active":"2024-09-21T09:06:21.853304+0000","last_peered":"2024-09-21T09:06:21.853304+0000","last_clean":"2024-09-21T09:06:21.853304+0000","last_became_active":"2024-09-21T09:03:08.251416+0000","last_became_peered":"2024-09-21T09:03:08.251416+0000","last_unstale":"2024-09-21T09:06:21.853304+0000","last_undegraded":"2024-09-21T09:06:21.853304+0000","last_fullsized":"2024-09-21T09:06:21.853304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'83","last_scrub_stamp":"2024-09-21T09:06:21.853181+0000","last_deep_scrub":"31'83","last_deep_scrub_stamp":"2024-09-21T09:06:21.853181+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.853181+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:35.867187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.206594+0000","last_change":"2024-09-21T09:07:00.206620+0000","last_active":"2024-09-21T09:07:00.206594+0000","last_peered":"2024-09-21T09:07:00.206594+0000","last_clean":"2024-09-21T09:07:00.206594+0000","last_became_active":"2024-09-21T09:03:00.217018+0000","last_became_peered":"2024-09-21T09:03:00.217018+0000","last_unstale":"2024-09-21T09:07:00.206594+0000","last_undegraded":"2024-09-21T09:07:00.206594+0000","last_fullsized":"2024-09-21T09:07:00.206594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:00.206503+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:00.206503+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.206503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:29.029602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.199641+0000","last_change":"2024-09-21T09:02:51.500609+0000","last_active":"2024-09-21T09:06:17.199641+0000","last_peered":"2024-09-21T09:06:17.199641+0000","last_clean":"2024-09-21T09:06:17.199641+0000","last_became_active":"2024-09-21T09:02:49.493239+0000","last_became_peered":"2024-09-21T09:02:49.493239+0000","last_unstale":"2024-09-21T09:06:17.199641+0000","last_undegraded":"2024-09-21T09:06:17.199641+0000","last_fullsized":"2024-09-21T09:06:17.199641+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046437600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:59.048229+0000","last_change":"2024-09-21T09:06:59.048229+0000","last_active":"2024-09-21T09:06:59.048229+0000","last_peered":"2024-09-21T09:06:59.048229+0000","last_clean":"2024-09-21T09:06:59.048229+0000","last_became_active":"2024-09-21T09:02:58.208819+0000","last_became_peered":"2024-09-21T09:02:58.208819+0000","last_unstale":"2024-09-21T09:06:59.048229+0000","last_undegraded":"2024-09-21T09:06:59.048229+0000","last_fullsized":"2024-09-21T09:06:59.048229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:59.048112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:59.048112+0000","last_clean_scrub_stamp":"2024-09-21T09:06:59.048112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:54.468723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.385967+0000","last_change":"2024-09-21T09:06:19.385992+0000","last_active":"2024-09-21T09:06:19.385967+0000","last_peered":"2024-09-21T09:06:19.385967+0000","last_clean":"2024-09-21T09:06:19.385967+0000","last_became_active":"2024-09-21T09:03:02.220903+0000","last_became_peered":"2024-09-21T09:03:02.220903+0000","last_unstale":"2024-09-21T09:06:19.385967+0000","last_undegraded":"2024-09-21T09:06:19.385967+0000","last_fullsized":"2024-09-21T09:06:19.385967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.385871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.385871+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.385871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:53.002346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'290","reported_seq":515,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.477160+0000","last_change":"2024-09-21T09:06:21.477160+0000","last_active":"2024-09-21T09:06:21.477160+0000","last_peered":"2024-09-21T09:06:21.477160+0000","last_clean":"2024-09-21T09:06:21.477160+0000","last_became_active":"2024-09-21T09:03:04.240433+0000","last_became_peered":"2024-09-21T09:03:04.240433+0000","last_unstale":"2024-09-21T09:06:21.477160+0000","last_undegraded":"2024-09-21T09:06:21.477160+0000","last_fullsized":"2024-09-21T09:06:21.477160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'290","last_scrub_stamp":"2024-09-21T09:06:21.477013+0000","last_deep_scrub":"31'290","last_deep_scrub_stamp":"2024-09-21T09:06:21.477013+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.477013+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:50.761111+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.283613+0000","last_change":"2024-09-21T09:06:39.283613+0000","last_active":"2024-09-21T09:06:39.283613+0000","last_peered":"2024-09-21T09:06:39.283613+0000","last_clean":"2024-09-21T09:06:39.283613+0000","last_became_active":"2024-09-21T09:03:06.247746+0000","last_became_peered":"2024-09-21T09:03:06.247746+0000","last_unstale":"2024-09-21T09:06:39.283613+0000","last_undegraded":"2024-09-21T09:06:39.283613+0000","last_fullsized":"2024-09-21T09:06:39.283613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:39.283500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:39.283500+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.283500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:45.304746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.321552+0000","last_change":"2024-09-21T09:06:43.321611+0000","last_active":"2024-09-21T09:06:43.321552+0000","last_peered":"2024-09-21T09:06:43.321552+0000","last_clean":"2024-09-21T09:06:43.321552+0000","last_became_active":"2024-09-21T09:03:08.258104+0000","last_became_peered":"2024-09-21T09:03:08.258104+0000","last_unstale":"2024-09-21T09:06:43.321552+0000","last_undegraded":"2024-09-21T09:06:43.321552+0000","last_fullsized":"2024-09-21T09:06:43.321552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-21T09:06:43.321436+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-21T09:06:43.321436+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.321436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:24.838301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.943960+0000","last_change":"2024-09-21T09:06:42.944005+0000","last_active":"2024-09-21T09:06:42.943960+0000","last_peered":"2024-09-21T09:06:42.943960+0000","last_clean":"2024-09-21T09:06:42.943960+0000","last_became_active":"2024-09-21T09:03:00.227191+0000","last_became_peered":"2024-09-21T09:03:00.227191+0000","last_unstale":"2024-09-21T09:06:42.943960+0000","last_undegraded":"2024-09-21T09:06:42.943960+0000","last_fullsized":"2024-09-21T09:06:42.943960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:06:42.943855+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:06:42.943855+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.943855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:23.983932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:55.810947+0000","last_change":"2024-09-21T09:06:55.810947+0000","last_active":"2024-09-21T09:06:55.810947+0000","last_peered":"2024-09-21T09:06:55.810947+0000","last_clean":"2024-09-21T09:06:55.810947+0000","last_became_active":"2024-09-21T09:02:49.493605+0000","last_became_peered":"2024-09-21T09:02:49.493605+0000","last_unstale":"2024-09-21T09:06:55.810947+0000","last_undegraded":"2024-09-21T09:06:55.810947+0000","last_fullsized":"2024-09-21T09:06:55.810947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:55.810813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:55.810813+0000","last_clean_scrub_stamp":"2024-09-21T09:06:55.810813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:02.641183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033020199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:57.111509+0000","last_change":"2024-09-21T09:06:57.111509+0000","last_active":"2024-09-21T09:06:57.111509+0000","last_peered":"2024-09-21T09:06:57.111509+0000","last_clean":"2024-09-21T09:06:57.111509+0000","last_became_active":"2024-09-21T09:02:58.209343+0000","last_became_peered":"2024-09-21T09:02:58.209343+0000","last_unstale":"2024-09-21T09:06:57.111509+0000","last_undegraded":"2024-09-21T09:06:57.111509+0000","last_fullsized":"2024-09-21T09:06:57.111509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:57.111398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:57.111398+0000","last_clean_scrub_stamp":"2024-09-21T09:06:57.111398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:15.042668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:03.754535+0000","last_change":"2024-09-21T09:07:03.754564+0000","last_active":"2024-09-21T09:07:03.754535+0000","last_peered":"2024-09-21T09:07:03.754535+0000","last_clean":"2024-09-21T09:07:03.754535+0000","last_became_active":"2024-09-21T09:03:02.219067+0000","last_became_peered":"2024-09-21T09:03:02.219067+0000","last_unstale":"2024-09-21T09:07:03.754535+0000","last_undegraded":"2024-09-21T09:07:03.754535+0000","last_fullsized":"2024-09-21T09:07:03.754535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:03.754443+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:03.754443+0000","last_clean_scrub_stamp":"2024-09-21T09:07:03.754443+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:55.306780+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'24","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.772608+0000","last_change":"2024-09-21T09:06:32.772608+0000","last_active":"2024-09-21T09:06:32.772608+0000","last_peered":"2024-09-21T09:06:32.772608+0000","last_clean":"2024-09-21T09:06:32.772608+0000","last_became_active":"2024-09-21T09:03:04.230686+0000","last_became_peered":"2024-09-21T09:03:04.230686+0000","last_unstale":"2024-09-21T09:06:32.772608+0000","last_undegraded":"2024-09-21T09:06:32.772608+0000","last_fullsized":"2024-09-21T09:06:32.772608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-09-21T09:06:32.772444+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-09-21T09:06:32.772444+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.772444+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:42.682945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.712994+0000","last_change":"2024-09-21T09:06:25.712994+0000","last_active":"2024-09-21T09:06:25.712994+0000","last_peered":"2024-09-21T09:06:25.712994+0000","last_clean":"2024-09-21T09:06:25.712994+0000","last_became_active":"2024-09-21T09:03:06.248087+0000","last_became_peered":"2024-09-21T09:03:06.248087+0000","last_unstale":"2024-09-21T09:06:25.712994+0000","last_undegraded":"2024-09-21T09:06:25.712994+0000","last_fullsized":"2024-09-21T09:06:25.712994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:25.712851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:25.712851+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.712851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:31.193094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:01.207889+0000","last_change":"2024-09-21T09:07:01.207912+0000","last_active":"2024-09-21T09:07:01.207889+0000","last_peered":"2024-09-21T09:07:01.207889+0000","last_clean":"2024-09-21T09:07:01.207889+0000","last_became_active":"2024-09-21T09:03:08.258974+0000","last_became_peered":"2024-09-21T09:03:08.258974+0000","last_unstale":"2024-09-21T09:07:01.207889+0000","last_undegraded":"2024-09-21T09:07:01.207889+0000","last_fullsized":"2024-09-21T09:07:01.207889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:01.207775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:01.207775+0000","last_clean_scrub_stamp":"2024-09-21T09:07:01.207775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:33.638981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'8","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.913163+0000","last_change":"2024-09-21T09:06:46.913163+0000","last_active":"2024-09-21T09:06:46.913163+0000","last_peered":"2024-09-21T09:06:46.913163+0000","last_clean":"2024-09-21T09:06:46.913163+0000","last_became_active":"2024-09-21T09:03:00.221080+0000","last_became_peered":"2024-09-21T09:03:00.221080+0000","last_unstale":"2024-09-21T09:06:46.913163+0000","last_undegraded":"2024-09-21T09:06:46.913163+0000","last_fullsized":"2024-09-21T09:06:46.913163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:46.913050+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:46.913050+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.913050+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:10.419981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.199649+0000","last_change":"2024-09-21T09:02:51.501105+0000","last_active":"2024-09-21T09:06:17.199649+0000","last_peered":"2024-09-21T09:06:17.199649+0000","last_clean":"2024-09-21T09:06:17.199649+0000","last_became_active":"2024-09-21T09:02:49.493348+0000","last_became_peered":"2024-09-21T09:02:49.493348+0000","last_unstale":"2024-09-21T09:06:17.199649+0000","last_undegraded":"2024-09-21T09:06:17.199649+0000","last_fullsized":"2024-09-21T09:06:17.199649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096028300000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:59.799144+0000","last_change":"2024-09-21T09:06:59.799144+0000","last_active":"2024-09-21T09:06:59.799144+0000","last_peered":"2024-09-21T09:06:59.799144+0000","last_clean":"2024-09-21T09:06:59.799144+0000","last_became_active":"2024-09-21T09:02:58.207236+0000","last_became_peered":"2024-09-21T09:02:58.207236+0000","last_unstale":"2024-09-21T09:06:59.799144+0000","last_undegraded":"2024-09-21T09:06:59.799144+0000","last_fullsized":"2024-09-21T09:06:59.799144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:59.799035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:59.799035+0000","last_clean_scrub_stamp":"2024-09-21T09:06:59.799035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:01.789556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.897587+0000","last_change":"2024-09-21T09:06:36.897587+0000","last_active":"2024-09-21T09:06:36.897587+0000","last_peered":"2024-09-21T09:06:36.897587+0000","last_clean":"2024-09-21T09:06:36.897587+0000","last_became_active":"2024-09-21T09:03:02.221310+0000","last_became_peered":"2024-09-21T09:03:02.221310+0000","last_unstale":"2024-09-21T09:06:36.897587+0000","last_undegraded":"2024-09-21T09:06:36.897587+0000","last_fullsized":"2024-09-21T09:06:36.897587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:36.897431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:36.897431+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.897431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.146414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'20","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.285611+0000","last_change":"2024-09-21T09:06:43.285705+0000","last_active":"2024-09-21T09:06:43.285611+0000","last_peered":"2024-09-21T09:06:43.285611+0000","last_clean":"2024-09-21T09:06:43.285611+0000","last_became_active":"2024-09-21T09:03:04.243076+0000","last_became_peered":"2024-09-21T09:03:04.243076+0000","last_unstale":"2024-09-21T09:06:43.285611+0000","last_undegraded":"2024-09-21T09:06:43.285611+0000","last_fullsized":"2024-09-21T09:06:43.285611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-09-21T09:06:43.285503+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-09-21T09:06:43.285503+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.285503+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:31.813485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.313817+0000","last_change":"2024-09-21T09:06:49.313875+0000","last_active":"2024-09-21T09:06:49.313817+0000","last_peered":"2024-09-21T09:06:49.313817+0000","last_clean":"2024-09-21T09:06:49.313817+0000","last_became_active":"2024-09-21T09:03:06.250530+0000","last_became_peered":"2024-09-21T09:03:06.250530+0000","last_unstale":"2024-09-21T09:06:49.313817+0000","last_undegraded":"2024-09-21T09:06:49.313817+0000","last_fullsized":"2024-09-21T09:06:49.313817+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:49.313729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:49.313729+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.313729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:37:17.387230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:10.451215+0000","last_change":"2024-09-21T09:07:10.451255+0000","last_active":"2024-09-21T09:07:10.451215+0000","last_peered":"2024-09-21T09:07:10.451215+0000","last_clean":"2024-09-21T09:07:10.451215+0000","last_became_active":"2024-09-21T09:03:08.262240+0000","last_became_peered":"2024-09-21T09:03:08.262240+0000","last_unstale":"2024-09-21T09:07:10.451215+0000","last_undegraded":"2024-09-21T09:07:10.451215+0000","last_fullsized":"2024-09-21T09:07:10.451215+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:07:10.451100+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:07:10.451100+0000","last_clean_scrub_stamp":"2024-09-21T09:07:10.451100+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:50.493055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.322444+0000","last_change":"2024-09-21T09:06:40.322444+0000","last_active":"2024-09-21T09:06:40.322444+0000","last_peered":"2024-09-21T09:06:40.322444+0000","last_clean":"2024-09-21T09:06:40.322444+0000","last_became_active":"2024-09-21T09:03:00.224297+0000","last_became_peered":"2024-09-21T09:03:00.224297+0000","last_unstale":"2024-09-21T09:06:40.322444+0000","last_undegraded":"2024-09-21T09:06:40.322444+0000","last_fullsized":"2024-09-21T09:06:40.322444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:40.322322+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:40.322322+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.322322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:58.832458+0000","last_change":"2024-09-21T09:06:58.832458+0000","last_active":"2024-09-21T09:06:58.832458+0000","last_peered":"2024-09-21T09:06:58.832458+0000","last_clean":"2024-09-21T09:06:58.832458+0000","last_became_active":"2024-09-21T09:02:58.206718+0000","last_became_peered":"2024-09-21T09:02:58.206718+0000","last_unstale":"2024-09-21T09:06:58.832458+0000","last_undegraded":"2024-09-21T09:06:58.832458+0000","last_fullsized":"2024-09-21T09:06:58.832458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:58.832345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:58.832345+0000","last_clean_scrub_stamp":"2024-09-21T09:06:58.832345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:14.309366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:04.993328+0000","last_change":"2024-09-21T09:07:04.993355+0000","last_active":"2024-09-21T09:07:04.993328+0000","last_peered":"2024-09-21T09:07:04.993328+0000","last_clean":"2024-09-21T09:07:04.993328+0000","last_became_active":"2024-09-21T09:02:49.493509+0000","last_became_peered":"2024-09-21T09:02:49.493509+0000","last_unstale":"2024-09-21T09:07:04.993328+0000","last_undegraded":"2024-09-21T09:07:04.993328+0000","last_fullsized":"2024-09-21T09:07:04.993328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:04.993232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:04.993232+0000","last_clean_scrub_stamp":"2024-09-21T09:07:04.993232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:06.820978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038981200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.859438+0000","last_change":"2024-09-21T09:06:35.859438+0000","last_active":"2024-09-21T09:06:35.859438+0000","last_peered":"2024-09-21T09:06:35.859438+0000","last_clean":"2024-09-21T09:06:35.859438+0000","last_became_active":"2024-09-21T09:03:02.221309+0000","last_became_peered":"2024-09-21T09:03:02.221309+0000","last_unstale":"2024-09-21T09:06:35.859438+0000","last_undegraded":"2024-09-21T09:06:35.859438+0000","last_fullsized":"2024-09-21T09:06:35.859438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2024-09-21T09:06:35.859308+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2024-09-21T09:06:35.859308+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.859308+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:10.403536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'73","reported_seq":150,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.721519+0000","last_change":"2024-09-21T09:06:23.721519+0000","last_active":"2024-09-21T09:06:23.721519+0000","last_peered":"2024-09-21T09:06:23.721519+0000","last_clean":"2024-09-21T09:06:23.721519+0000","last_became_active":"2024-09-21T09:03:04.243228+0000","last_became_peered":"2024-09-21T09:03:04.243228+0000","last_unstale":"2024-09-21T09:06:23.721519+0000","last_undegraded":"2024-09-21T09:06:23.721519+0000","last_fullsized":"2024-09-21T09:06:23.721519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2024-09-21T09:06:23.721394+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2024-09-21T09:06:23.721394+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.721394+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:53.684792+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.826638+0000","last_change":"2024-09-21T09:06:18.826638+0000","last_active":"2024-09-21T09:06:18.826638+0000","last_peered":"2024-09-21T09:06:18.826638+0000","last_clean":"2024-09-21T09:06:18.826638+0000","last_became_active":"2024-09-21T09:03:06.246598+0000","last_became_peered":"2024-09-21T09:03:06.246598+0000","last_unstale":"2024-09-21T09:06:18.826638+0000","last_undegraded":"2024-09-21T09:06:18.826638+0000","last_fullsized":"2024-09-21T09:06:18.826638+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.826477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.826477+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.826477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:07.103764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:15.144598+0000","last_change":"2024-09-21T09:07:15.144630+0000","last_active":"2024-09-21T09:07:15.144598+0000","last_peered":"2024-09-21T09:07:15.144598+0000","last_clean":"2024-09-21T09:07:15.144598+0000","last_became_active":"2024-09-21T09:03:08.250714+0000","last_became_peered":"2024-09-21T09:03:08.250714+0000","last_unstale":"2024-09-21T09:07:15.144598+0000","last_undegraded":"2024-09-21T09:07:15.144598+0000","last_fullsized":"2024-09-21T09:07:15.144598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-21T09:07:15.144496+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-21T09:07:15.144496+0000","last_clean_scrub_stamp":"2024-09-21T09:07:15.144496+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:35.685007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'10","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:16.439534+0000","last_change":"2024-09-21T09:07:16.439559+0000","last_active":"2024-09-21T09:07:16.439534+0000","last_peered":"2024-09-21T09:07:16.439534+0000","last_clean":"2024-09-21T09:07:16.439534+0000","last_became_active":"2024-09-21T09:03:38.282889+0000","last_became_peered":"2024-09-21T09:03:38.282889+0000","last_unstale":"2024-09-21T09:07:16.439534+0000","last_undegraded":"2024-09-21T09:07:16.439534+0000","last_fullsized":"2024-09-21T09:07:16.439534+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:07:16.439446+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:07:16.439446+0000","last_clean_scrub_stamp":"2024-09-21T09:07:16.439446+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:07.428199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:02.944935+0000","last_change":"2024-09-21T09:07:02.944935+0000","last_active":"2024-09-21T09:07:02.944935+0000","last_peered":"2024-09-21T09:07:02.944935+0000","last_clean":"2024-09-21T09:07:02.944935+0000","last_became_active":"2024-09-21T09:02:58.208569+0000","last_became_peered":"2024-09-21T09:02:58.208569+0000","last_unstale":"2024-09-21T09:07:02.944935+0000","last_undegraded":"2024-09-21T09:07:02.944935+0000","last_fullsized":"2024-09-21T09:07:02.944935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:02.944798+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:02.944798+0000","last_clean_scrub_stamp":"2024-09-21T09:07:02.944798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:11:45.528934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.199662+0000","last_change":"2024-09-21T09:02:51.501475+0000","last_active":"2024-09-21T09:06:17.199662+0000","last_peered":"2024-09-21T09:06:17.199662+0000","last_clean":"2024-09-21T09:06:17.199662+0000","last_became_active":"2024-09-21T09:02:49.493469+0000","last_became_peered":"2024-09-21T09:02:49.493469+0000","last_unstale":"2024-09-21T09:06:17.199662+0000","last_undegraded":"2024-09-21T09:06:17.199662+0000","last_fullsized":"2024-09-21T09:06:17.199662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001228114,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.353354+0000","last_change":"2024-09-21T09:06:26.353354+0000","last_active":"2024-09-21T09:06:26.353354+0000","last_peered":"2024-09-21T09:06:26.353354+0000","last_clean":"2024-09-21T09:06:26.353354+0000","last_became_active":"2024-09-21T09:03:02.218232+0000","last_became_peered":"2024-09-21T09:03:02.218232+0000","last_unstale":"2024-09-21T09:06:26.353354+0000","last_undegraded":"2024-09-21T09:06:26.353354+0000","last_fullsized":"2024-09-21T09:06:26.353354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:26.353187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:26.353187+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.353187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:04.665812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'21","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.504016+0000","last_change":"2024-09-21T09:06:20.504016+0000","last_active":"2024-09-21T09:06:20.504016+0000","last_peered":"2024-09-21T09:06:20.504016+0000","last_clean":"2024-09-21T09:06:20.504016+0000","last_became_active":"2024-09-21T09:03:04.241500+0000","last_became_peered":"2024-09-21T09:03:04.241500+0000","last_unstale":"2024-09-21T09:06:20.504016+0000","last_undegraded":"2024-09-21T09:06:20.504016+0000","last_fullsized":"2024-09-21T09:06:20.504016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-09-21T09:06:20.503834+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-09-21T09:06:20.503834+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.503834+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:54.738751+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'285","reported_seq":367,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.375756+0000","last_change":"2024-09-21T09:06:27.375756+0000","last_active":"2024-09-21T09:06:27.375756+0000","last_peered":"2024-09-21T09:06:27.375756+0000","last_clean":"2024-09-21T09:06:27.375756+0000","last_became_active":"2024-09-21T09:03:06.249303+0000","last_became_peered":"2024-09-21T09:03:06.249303+0000","last_unstale":"2024-09-21T09:06:27.375756+0000","last_undegraded":"2024-09-21T09:06:27.375756+0000","last_fullsized":"2024-09-21T09:06:27.375756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:27.375647+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:27.375647+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.375647+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:46.869896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460788+0000","last_change":"2024-09-21T09:03:08.264861+0000","last_active":"2024-09-21T09:05:23.460788+0000","last_peered":"2024-09-21T09:05:23.460788+0000","last_clean":"2024-09-21T09:05:23.460788+0000","last_became_active":"2024-09-21T09:03:08.264322+0000","last_became_peered":"2024-09-21T09:03:08.264322+0000","last_unstale":"2024-09-21T09:05:23.460788+0000","last_undegraded":"2024-09-21T09:05:23.460788+0000","last_fullsized":"2024-09-21T09:05:23.460788+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:05.844477+0000","last_change":"2024-09-21T09:07:05.844502+0000","last_active":"2024-09-21T09:07:05.844477+0000","last_peered":"2024-09-21T09:07:05.844477+0000","last_clean":"2024-09-21T09:07:05.844477+0000","last_became_active":"2024-09-21T09:03:38.277629+0000","last_became_peered":"2024-09-21T09:03:38.277629+0000","last_unstale":"2024-09-21T09:07:05.844477+0000","last_undegraded":"2024-09-21T09:07:05.844477+0000","last_fullsized":"2024-09-21T09:07:05.844477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:05.844383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:05.844383+0000","last_clean_scrub_stamp":"2024-09-21T09:07:05.844383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:38.255577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.199700+0000","last_change":"2024-09-21T09:02:58.223891+0000","last_active":"2024-09-21T09:06:17.199700+0000","last_peered":"2024-09-21T09:06:17.199700+0000","last_clean":"2024-09-21T09:06:17.199700+0000","last_became_active":"2024-09-21T09:02:58.223652+0000","last_became_peered":"2024-09-21T09:02:58.223652+0000","last_unstale":"2024-09-21T09:06:17.199700+0000","last_undegraded":"2024-09-21T09:06:17.199700+0000","last_fullsized":"2024-09-21T09:06:17.199700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:03.982018+0000","last_change":"2024-09-21T09:07:03.982018+0000","last_active":"2024-09-21T09:07:03.982018+0000","last_peered":"2024-09-21T09:07:03.982018+0000","last_clean":"2024-09-21T09:07:03.982018+0000","last_became_active":"2024-09-21T09:02:49.493144+0000","last_became_peered":"2024-09-21T09:02:49.493144+0000","last_unstale":"2024-09-21T09:07:03.982018+0000","last_undegraded":"2024-09-21T09:07:03.982018+0000","last_fullsized":"2024-09-21T09:07:03.982018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:03.981903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:03.981903+0000","last_clean_scrub_stamp":"2024-09-21T09:07:03.981903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:44.720403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042500699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.311245+0000","last_change":"2024-09-21T09:06:24.311245+0000","last_active":"2024-09-21T09:06:24.311245+0000","last_peered":"2024-09-21T09:06:24.311245+0000","last_clean":"2024-09-21T09:06:24.311245+0000","last_became_active":"2024-09-21T09:03:02.219133+0000","last_became_peered":"2024-09-21T09:03:02.219133+0000","last_unstale":"2024-09-21T09:06:24.311245+0000","last_undegraded":"2024-09-21T09:06:24.311245+0000","last_fullsized":"2024-09-21T09:06:24.311245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:24.311064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:24.311064+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.311064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:35.086372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.280030+0000","last_change":"2024-09-21T09:06:33.280030+0000","last_active":"2024-09-21T09:06:33.280030+0000","last_peered":"2024-09-21T09:06:33.280030+0000","last_clean":"2024-09-21T09:06:33.280030+0000","last_became_active":"2024-09-21T09:03:04.241256+0000","last_became_peered":"2024-09-21T09:03:04.241256+0000","last_unstale":"2024-09-21T09:06:33.280030+0000","last_undegraded":"2024-09-21T09:06:33.280030+0000","last_fullsized":"2024-09-21T09:06:33.280030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-21T09:06:33.279879+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-21T09:06:33.279879+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.279879+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:01.162062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'285","reported_seq":441,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.713004+0000","last_change":"2024-09-21T09:06:22.713004+0000","last_active":"2024-09-21T09:06:22.713004+0000","last_peered":"2024-09-21T09:06:22.713004+0000","last_clean":"2024-09-21T09:06:22.713004+0000","last_became_active":"2024-09-21T09:03:06.243566+0000","last_became_peered":"2024-09-21T09:03:06.243566+0000","last_unstale":"2024-09-21T09:06:22.713004+0000","last_undegraded":"2024-09-21T09:06:22.713004+0000","last_fullsized":"2024-09-21T09:06:22.713004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:22.712831+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:22.712831+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.712831+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:04.506029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'5","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:13.413156+0000","last_change":"2024-09-21T09:07:13.413181+0000","last_active":"2024-09-21T09:07:13.413156+0000","last_peered":"2024-09-21T09:07:13.413156+0000","last_clean":"2024-09-21T09:07:13.413156+0000","last_became_active":"2024-09-21T09:03:08.262460+0000","last_became_peered":"2024-09-21T09:03:08.262460+0000","last_unstale":"2024-09-21T09:07:13.413156+0000","last_undegraded":"2024-09-21T09:07:13.413156+0000","last_fullsized":"2024-09-21T09:07:13.413156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-21T09:07:13.413059+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-21T09:07:13.413059+0000","last_clean_scrub_stamp":"2024-09-21T09:07:13.413059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:02.535950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'14","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.862325+0000","last_change":"2024-09-21T09:06:39.862325+0000","last_active":"2024-09-21T09:06:39.862325+0000","last_peered":"2024-09-21T09:06:39.862325+0000","last_clean":"2024-09-21T09:06:39.862325+0000","last_became_active":"2024-09-21T09:03:00.216782+0000","last_became_peered":"2024-09-21T09:03:00.216782+0000","last_unstale":"2024-09-21T09:06:39.862325+0000","last_undegraded":"2024-09-21T09:06:39.862325+0000","last_fullsized":"2024-09-21T09:06:39.862325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:39.862176+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:39.862176+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.862176+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:04:29.094210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:50.407358+0000","last_change":"2024-09-21T09:06:50.407358+0000","last_active":"2024-09-21T09:06:50.407358+0000","last_peered":"2024-09-21T09:06:50.407358+0000","last_clean":"2024-09-21T09:06:50.407358+0000","last_became_active":"2024-09-21T09:02:58.213293+0000","last_became_peered":"2024-09-21T09:02:58.213293+0000","last_unstale":"2024-09-21T09:06:50.407358+0000","last_undegraded":"2024-09-21T09:06:50.407358+0000","last_fullsized":"2024-09-21T09:06:50.407358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:50.407214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:50.407214+0000","last_clean_scrub_stamp":"2024-09-21T09:06:50.407214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:03:45.219496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.199659+0000","last_change":"2024-09-21T09:02:51.501161+0000","last_active":"2024-09-21T09:06:17.199659+0000","last_peered":"2024-09-21T09:06:17.199659+0000","last_clean":"2024-09-21T09:06:17.199659+0000","last_became_active":"2024-09-21T09:02:49.542160+0000","last_became_peered":"2024-09-21T09:02:49.542160+0000","last_unstale":"2024-09-21T09:06:17.199659+0000","last_undegraded":"2024-09-21T09:06:17.199659+0000","last_fullsized":"2024-09-21T09:06:17.199659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:48.483175+0000","last_clean_scrub_stamp":"2024-09-21T09:02:48.483175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099618800000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.307002+0000","last_change":"2024-09-21T09:06:27.307002+0000","last_active":"2024-09-21T09:06:27.307002+0000","last_peered":"2024-09-21T09:06:27.307002+0000","last_clean":"2024-09-21T09:06:27.307002+0000","last_became_active":"2024-09-21T09:03:02.218138+0000","last_became_peered":"2024-09-21T09:03:02.218138+0000","last_unstale":"2024-09-21T09:06:27.307002+0000","last_undegraded":"2024-09-21T09:06:27.307002+0000","last_fullsized":"2024-09-21T09:06:27.307002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:27.306889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:27.306889+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.306889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:50.637433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'98","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.794110+0000","last_change":"2024-09-21T09:06:31.794110+0000","last_active":"2024-09-21T09:06:31.794110+0000","last_peered":"2024-09-21T09:06:31.794110+0000","last_clean":"2024-09-21T09:06:31.794110+0000","last_became_active":"2024-09-21T09:03:04.231708+0000","last_became_peered":"2024-09-21T09:03:04.231708+0000","last_unstale":"2024-09-21T09:06:31.794110+0000","last_undegraded":"2024-09-21T09:06:31.794110+0000","last_fullsized":"2024-09-21T09:06:31.794110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2024-09-21T09:06:31.793976+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2024-09-21T09:06:31.793976+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.793976+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:01.757375+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":98,"num_read_kb":92,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.935186+0000","last_change":"2024-09-21T09:06:37.935186+0000","last_active":"2024-09-21T09:06:37.935186+0000","last_peered":"2024-09-21T09:06:37.935186+0000","last_clean":"2024-09-21T09:06:37.935186+0000","last_became_active":"2024-09-21T09:03:06.249474+0000","last_became_peered":"2024-09-21T09:03:06.249474+0000","last_unstale":"2024-09-21T09:06:37.935186+0000","last_undegraded":"2024-09-21T09:06:37.935186+0000","last_fullsized":"2024-09-21T09:06:37.935186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:37.935053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:37.935053+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.935053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:29.492174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.780683+0000","last_change":"2024-09-21T09:06:25.780707+0000","last_active":"2024-09-21T09:06:25.780683+0000","last_peered":"2024-09-21T09:06:25.780683+0000","last_clean":"2024-09-21T09:06:25.780683+0000","last_became_active":"2024-09-21T09:03:08.252363+0000","last_became_peered":"2024-09-21T09:03:08.252363+0000","last_unstale":"2024-09-21T09:06:25.780683+0000","last_undegraded":"2024-09-21T09:06:25.780683+0000","last_fullsized":"2024-09-21T09:06:25.780683+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:25.780594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:25.780594+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.780594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:37.186890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.855293+0000","last_change":"2024-09-21T09:06:37.855293+0000","last_active":"2024-09-21T09:06:37.855293+0000","last_peered":"2024-09-21T09:06:37.855293+0000","last_clean":"2024-09-21T09:06:37.855293+0000","last_became_active":"2024-09-21T09:03:08.256571+0000","last_became_peered":"2024-09-21T09:03:08.256571+0000","last_unstale":"2024-09-21T09:06:37.855293+0000","last_undegraded":"2024-09-21T09:06:37.855293+0000","last_fullsized":"2024-09-21T09:06:37.855293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:37.855168+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:37.855168+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.855168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:52.809661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'12","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:10.788069+0000","last_change":"2024-09-21T09:07:10.788096+0000","last_active":"2024-09-21T09:07:10.788069+0000","last_peered":"2024-09-21T09:07:10.788069+0000","last_clean":"2024-09-21T09:07:10.788069+0000","last_became_active":"2024-09-21T09:03:38.466274+0000","last_became_peered":"2024-09-21T09:03:38.466274+0000","last_unstale":"2024-09-21T09:07:10.788069+0000","last_undegraded":"2024-09-21T09:07:10.788069+0000","last_fullsized":"2024-09-21T09:07:10.788069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:07:10.787983+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:07:10.787983+0000","last_clean_scrub_stamp":"2024-09-21T09:07:10.787983+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:11:53.372119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:11.314632+0000","last_change":"2024-09-21T09:07:11.314665+0000","last_active":"2024-09-21T09:07:11.314632+0000","last_peered":"2024-09-21T09:07:11.314632+0000","last_clean":"2024-09-21T09:07:11.314632+0000","last_became_active":"2024-09-21T09:02:58.220716+0000","last_became_peered":"2024-09-21T09:02:58.220716+0000","last_unstale":"2024-09-21T09:07:11.314632+0000","last_undegraded":"2024-09-21T09:07:11.314632+0000","last_fullsized":"2024-09-21T09:07:11.314632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:11.314540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:11.314540+0000","last_clean_scrub_stamp":"2024-09-21T09:07:11.314540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:17.515915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.293135+0000","last_change":"2024-09-21T09:06:33.293155+0000","last_active":"2024-09-21T09:06:33.293135+0000","last_peered":"2024-09-21T09:06:33.293135+0000","last_clean":"2024-09-21T09:06:33.293135+0000","last_became_active":"2024-09-21T09:03:02.219652+0000","last_became_peered":"2024-09-21T09:03:02.219652+0000","last_unstale":"2024-09-21T09:06:33.293135+0000","last_undegraded":"2024-09-21T09:06:33.293135+0000","last_fullsized":"2024-09-21T09:06:33.293135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:33.293033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:33.293033+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.293033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:32:06.406355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'39","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.278436+0000","last_change":"2024-09-21T09:06:37.278476+0000","last_active":"2024-09-21T09:06:37.278436+0000","last_peered":"2024-09-21T09:06:37.278436+0000","last_clean":"2024-09-21T09:06:37.278436+0000","last_became_active":"2024-09-21T09:03:04.241612+0000","last_became_peered":"2024-09-21T09:03:04.241612+0000","last_unstale":"2024-09-21T09:06:37.278436+0000","last_undegraded":"2024-09-21T09:06:37.278436+0000","last_fullsized":"2024-09-21T09:06:37.278436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-21T09:06:37.278334+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-21T09:06:37.278334+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.278334+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:25.732945+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:57.255052+0000","last_change":"2024-09-21T09:06:57.255074+0000","last_active":"2024-09-21T09:06:57.255052+0000","last_peered":"2024-09-21T09:06:57.255052+0000","last_clean":"2024-09-21T09:06:57.255052+0000","last_became_active":"2024-09-21T09:03:06.250750+0000","last_became_peered":"2024-09-21T09:03:06.250750+0000","last_unstale":"2024-09-21T09:06:57.255052+0000","last_undegraded":"2024-09-21T09:06:57.255052+0000","last_fullsized":"2024-09-21T09:06:57.255052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:57.254961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:57.254961+0000","last_clean_scrub_stamp":"2024-09-21T09:06:57.254961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:57.736160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'11","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:15.886491+0000","last_change":"2024-09-21T09:03:08.259980+0000","last_active":"2024-09-21T09:06:15.886491+0000","last_peered":"2024-09-21T09:06:15.886491+0000","last_clean":"2024-09-21T09:06:15.886491+0000","last_became_active":"2024-09-21T09:03:08.259602+0000","last_became_peered":"2024-09-21T09:03:08.259602+0000","last_unstale":"2024-09-21T09:06:15.886491+0000","last_undegraded":"2024-09-21T09:06:15.886491+0000","last_fullsized":"2024-09-21T09:06:15.886491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.310950+0000","last_change":"2024-09-21T09:06:37.310974+0000","last_active":"2024-09-21T09:06:37.310950+0000","last_peered":"2024-09-21T09:06:37.310950+0000","last_clean":"2024-09-21T09:06:37.310950+0000","last_became_active":"2024-09-21T09:03:00.225811+0000","last_became_peered":"2024-09-21T09:03:00.225811+0000","last_unstale":"2024-09-21T09:06:37.310950+0000","last_undegraded":"2024-09-21T09:06:37.310950+0000","last_fullsized":"2024-09-21T09:06:37.310950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:37.310866+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:37.310866+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.310866+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.559849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:06.847416+0000","last_change":"2024-09-21T09:07:06.847440+0000","last_active":"2024-09-21T09:07:06.847416+0000","last_peered":"2024-09-21T09:07:06.847416+0000","last_clean":"2024-09-21T09:07:06.847416+0000","last_became_active":"2024-09-21T09:03:38.280539+0000","last_became_peered":"2024-09-21T09:03:38.280539+0000","last_unstale":"2024-09-21T09:07:06.847416+0000","last_undegraded":"2024-09-21T09:07:06.847416+0000","last_fullsized":"2024-09-21T09:07:06.847416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:06.847333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:06.847333+0000","last_clean_scrub_stamp":"2024-09-21T09:07:06.847333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:02.267944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.390070+0000","last_change":"2024-09-21T09:06:21.390097+0000","last_active":"2024-09-21T09:06:21.390070+0000","last_peered":"2024-09-21T09:06:21.390070+0000","last_clean":"2024-09-21T09:06:21.390070+0000","last_became_active":"2024-09-21T09:03:02.222474+0000","last_became_peered":"2024-09-21T09:03:02.222474+0000","last_unstale":"2024-09-21T09:06:21.390070+0000","last_undegraded":"2024-09-21T09:06:21.390070+0000","last_fullsized":"2024-09-21T09:06:21.390070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:21.389982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:21.389982+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.389982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:19.738715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'9","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.747218+0000","last_change":"2024-09-21T09:06:30.747258+0000","last_active":"2024-09-21T09:06:30.747218+0000","last_peered":"2024-09-21T09:06:30.747218+0000","last_clean":"2024-09-21T09:06:30.747218+0000","last_became_active":"2024-09-21T09:03:04.232474+0000","last_became_peered":"2024-09-21T09:03:04.232474+0000","last_unstale":"2024-09-21T09:06:30.747218+0000","last_undegraded":"2024-09-21T09:06:30.747218+0000","last_fullsized":"2024-09-21T09:06:30.747218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-21T09:06:30.747132+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-21T09:06:30.747132+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.747132+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:13:40.597960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.808656+0000","last_change":"2024-09-21T09:06:17.808683+0000","last_active":"2024-09-21T09:06:17.808656+0000","last_peered":"2024-09-21T09:06:17.808656+0000","last_clean":"2024-09-21T09:06:17.808656+0000","last_became_active":"2024-09-21T09:03:06.250773+0000","last_became_peered":"2024-09-21T09:03:06.250773+0000","last_unstale":"2024-09-21T09:06:17.808656+0000","last_undegraded":"2024-09-21T09:06:17.808656+0000","last_fullsized":"2024-09-21T09:06:17.808656+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.808555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.808555+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.808555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.180280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:14.140828+0000","last_change":"2024-09-21T09:07:14.140852+0000","last_active":"2024-09-21T09:07:14.140828+0000","last_peered":"2024-09-21T09:07:14.140828+0000","last_clean":"2024-09-21T09:07:14.140828+0000","last_became_active":"2024-09-21T09:03:08.250617+0000","last_became_peered":"2024-09-21T09:03:08.250617+0000","last_unstale":"2024-09-21T09:07:14.140828+0000","last_undegraded":"2024-09-21T09:07:14.140828+0000","last_fullsized":"2024-09-21T09:07:14.140828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:14.140714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:14.140714+0000","last_clean_scrub_stamp":"2024-09-21T09:07:14.140714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:33.195512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'14","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.994816+0000","last_change":"2024-09-21T09:06:49.994873+0000","last_active":"2024-09-21T09:06:49.994816+0000","last_peered":"2024-09-21T09:06:49.994816+0000","last_clean":"2024-09-21T09:06:49.994816+0000","last_became_active":"2024-09-21T09:03:00.215591+0000","last_became_peered":"2024-09-21T09:03:00.215591+0000","last_unstale":"2024-09-21T09:06:49.994816+0000","last_undegraded":"2024-09-21T09:06:49.994816+0000","last_fullsized":"2024-09-21T09:06:49.994816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:49.994677+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:49.994677+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.994677+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:34.312234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:52.874132+0000","last_change":"2024-09-21T09:06:52.874160+0000","last_active":"2024-09-21T09:06:52.874132+0000","last_peered":"2024-09-21T09:06:52.874132+0000","last_clean":"2024-09-21T09:06:52.874132+0000","last_became_active":"2024-09-21T09:02:58.217931+0000","last_became_peered":"2024-09-21T09:02:58.217931+0000","last_unstale":"2024-09-21T09:06:52.874132+0000","last_undegraded":"2024-09-21T09:06:52.874132+0000","last_fullsized":"2024-09-21T09:06:52.874132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:52.874045+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:52.874045+0000","last_clean_scrub_stamp":"2024-09-21T09:06:52.874045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:52.416511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.887441+0000","last_change":"2024-09-21T09:06:38.887465+0000","last_active":"2024-09-21T09:06:38.887441+0000","last_peered":"2024-09-21T09:06:38.887441+0000","last_clean":"2024-09-21T09:06:38.887441+0000","last_became_active":"2024-09-21T09:03:02.219265+0000","last_became_peered":"2024-09-21T09:03:02.219265+0000","last_unstale":"2024-09-21T09:06:38.887441+0000","last_undegraded":"2024-09-21T09:06:38.887441+0000","last_fullsized":"2024-09-21T09:06:38.887441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:38.887351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:38.887351+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.887351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:05.248119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'47","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.702301+0000","last_change":"2024-09-21T09:06:28.702348+0000","last_active":"2024-09-21T09:06:28.702301+0000","last_peered":"2024-09-21T09:06:28.702301+0000","last_clean":"2024-09-21T09:06:28.702301+0000","last_became_active":"2024-09-21T09:03:04.233393+0000","last_became_peered":"2024-09-21T09:03:04.233393+0000","last_unstale":"2024-09-21T09:06:28.702301+0000","last_undegraded":"2024-09-21T09:06:28.702301+0000","last_fullsized":"2024-09-21T09:06:28.702301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-09-21T09:06:28.702205+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-09-21T09:06:28.702205+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.702205+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:15.159343+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.509490+0000","last_change":"2024-09-21T09:06:19.509511+0000","last_active":"2024-09-21T09:06:19.509490+0000","last_peered":"2024-09-21T09:06:19.509490+0000","last_clean":"2024-09-21T09:06:19.509490+0000","last_became_active":"2024-09-21T09:03:06.248954+0000","last_became_peered":"2024-09-21T09:03:06.248954+0000","last_unstale":"2024-09-21T09:06:19.509490+0000","last_undegraded":"2024-09-21T09:06:19.509490+0000","last_fullsized":"2024-09-21T09:06:19.509490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.509370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.509370+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.509370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:08.185733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:38.462905+0000","last_change":"2024-09-21T09:03:08.265248+0000","last_active":"2024-09-21T09:05:38.462905+0000","last_peered":"2024-09-21T09:05:38.462905+0000","last_clean":"2024-09-21T09:05:38.462905+0000","last_became_active":"2024-09-21T09:03:08.264778+0000","last_became_peered":"2024-09-21T09:03:08.264778+0000","last_unstale":"2024-09-21T09:05:38.462905+0000","last_undegraded":"2024-09-21T09:05:38.462905+0000","last_fullsized":"2024-09-21T09:05:38.462905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:56.215379+0000","last_change":"2024-09-21T09:06:56.215434+0000","last_active":"2024-09-21T09:06:56.215379+0000","last_peered":"2024-09-21T09:06:56.215379+0000","last_clean":"2024-09-21T09:06:56.215379+0000","last_became_active":"2024-09-21T09:03:00.218259+0000","last_became_peered":"2024-09-21T09:03:00.218259+0000","last_unstale":"2024-09-21T09:06:56.215379+0000","last_undegraded":"2024-09-21T09:06:56.215379+0000","last_fullsized":"2024-09-21T09:06:56.215379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:56.215261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:56.215261+0000","last_clean_scrub_stamp":"2024-09-21T09:06:56.215261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:28.904607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:07.468862+0000","last_change":"2024-09-21T09:07:07.468919+0000","last_active":"2024-09-21T09:07:07.468862+0000","last_peered":"2024-09-21T09:07:07.468862+0000","last_clean":"2024-09-21T09:07:07.468862+0000","last_became_active":"2024-09-21T09:02:58.207533+0000","last_became_peered":"2024-09-21T09:02:58.207533+0000","last_unstale":"2024-09-21T09:07:07.468862+0000","last_undegraded":"2024-09-21T09:07:07.468862+0000","last_fullsized":"2024-09-21T09:07:07.468862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:07.468744+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:07.468744+0000","last_clean_scrub_stamp":"2024-09-21T09:07:07.468744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:52.083674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.403941+0000","last_change":"2024-09-21T09:06:22.403985+0000","last_active":"2024-09-21T09:06:22.403941+0000","last_peered":"2024-09-21T09:06:22.403941+0000","last_clean":"2024-09-21T09:06:22.403941+0000","last_became_active":"2024-09-21T09:03:02.219509+0000","last_became_peered":"2024-09-21T09:03:02.219509+0000","last_unstale":"2024-09-21T09:06:22.403941+0000","last_undegraded":"2024-09-21T09:06:22.403941+0000","last_fullsized":"2024-09-21T09:06:22.403941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:22.403839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:22.403839+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.403839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:58.125850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.809789+0000","last_change":"2024-09-21T09:06:27.809828+0000","last_active":"2024-09-21T09:06:27.809789+0000","last_peered":"2024-09-21T09:06:27.809789+0000","last_clean":"2024-09-21T09:06:27.809789+0000","last_became_active":"2024-09-21T09:03:04.233913+0000","last_became_peered":"2024-09-21T09:03:04.233913+0000","last_unstale":"2024-09-21T09:06:27.809789+0000","last_undegraded":"2024-09-21T09:06:27.809789+0000","last_fullsized":"2024-09-21T09:06:27.809789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-21T09:06:27.809708+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-21T09:06:27.809708+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.809708+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:02.044625+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.801339+0000","last_change":"2024-09-21T09:06:23.801364+0000","last_active":"2024-09-21T09:06:23.801339+0000","last_peered":"2024-09-21T09:06:23.801339+0000","last_clean":"2024-09-21T09:06:23.801339+0000","last_became_active":"2024-09-21T09:03:06.240791+0000","last_became_peered":"2024-09-21T09:03:06.240791+0000","last_unstale":"2024-09-21T09:06:23.801339+0000","last_undegraded":"2024-09-21T09:06:23.801339+0000","last_fullsized":"2024-09-21T09:06:23.801339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:23.801250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:23.801250+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.801250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:35.380708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:02.199604+0000","last_change":"2024-09-21T09:07:02.199604+0000","last_active":"2024-09-21T09:07:02.199604+0000","last_peered":"2024-09-21T09:07:02.199604+0000","last_clean":"2024-09-21T09:07:02.199604+0000","last_became_active":"2024-09-21T09:03:00.216319+0000","last_became_peered":"2024-09-21T09:03:00.216319+0000","last_unstale":"2024-09-21T09:07:02.199604+0000","last_undegraded":"2024-09-21T09:07:02.199604+0000","last_fullsized":"2024-09-21T09:07:02.199604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:07:02.199485+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:07:02.199485+0000","last_clean_scrub_stamp":"2024-09-21T09:07:02.199485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:23.809002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:23.460553+0000","last_change":"2024-09-21T09:02:58.214752+0000","last_active":"2024-09-21T09:05:23.460553+0000","last_peered":"2024-09-21T09:05:23.460553+0000","last_clean":"2024-09-21T09:05:23.460553+0000","last_became_active":"2024-09-21T09:02:58.214494+0000","last_became_peered":"2024-09-21T09:02:58.214494+0000","last_unstale":"2024-09-21T09:05:23.460553+0000","last_undegraded":"2024-09-21T09:05:23.460553+0000","last_fullsized":"2024-09-21T09:05:23.460553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"31'5","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.825386+0000","last_change":"2024-09-21T09:06:34.825386+0000","last_active":"2024-09-21T09:06:34.825386+0000","last_peered":"2024-09-21T09:06:34.825386+0000","last_clean":"2024-09-21T09:06:34.825386+0000","last_became_active":"2024-09-21T09:03:02.221586+0000","last_became_peered":"2024-09-21T09:03:02.221586+0000","last_unstale":"2024-09-21T09:06:34.825386+0000","last_undegraded":"2024-09-21T09:06:34.825386+0000","last_fullsized":"2024-09-21T09:06:34.825386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-21T09:06:34.825259+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-21T09:06:34.825259+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.825259+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:27.576289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'64","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.682081+0000","last_change":"2024-09-21T09:06:27.682121+0000","last_active":"2024-09-21T09:06:27.682081+0000","last_peered":"2024-09-21T09:06:27.682081+0000","last_clean":"2024-09-21T09:06:27.682081+0000","last_became_active":"2024-09-21T09:03:04.233734+0000","last_became_peered":"2024-09-21T09:03:04.233734+0000","last_unstale":"2024-09-21T09:06:27.682081+0000","last_undegraded":"2024-09-21T09:06:27.682081+0000","last_fullsized":"2024-09-21T09:06:27.682081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'64","last_scrub_stamp":"2024-09-21T09:06:27.681989+0000","last_deep_scrub":"31'64","last_deep_scrub_stamp":"2024-09-21T09:06:27.681989+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.681989+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:55.221898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.819887+0000","last_change":"2024-09-21T09:06:22.819910+0000","last_active":"2024-09-21T09:06:22.819887+0000","last_peered":"2024-09-21T09:06:22.819887+0000","last_clean":"2024-09-21T09:06:22.819887+0000","last_became_active":"2024-09-21T09:03:06.240975+0000","last_became_peered":"2024-09-21T09:03:06.240975+0000","last_unstale":"2024-09-21T09:06:22.819887+0000","last_undegraded":"2024-09-21T09:06:22.819887+0000","last_fullsized":"2024-09-21T09:06:22.819887+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:22.819794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:22.819794+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.819794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:09.790058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'18","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:17.175321+0000","last_change":"2024-09-21T09:07:17.175397+0000","last_active":"2024-09-21T09:07:17.175321+0000","last_peered":"2024-09-21T09:07:17.175321+0000","last_clean":"2024-09-21T09:07:17.175321+0000","last_became_active":"2024-09-21T09:03:08.253904+0000","last_became_peered":"2024-09-21T09:03:08.253904+0000","last_unstale":"2024-09-21T09:07:17.175321+0000","last_undegraded":"2024-09-21T09:07:17.175321+0000","last_fullsized":"2024-09-21T09:07:17.175321+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-21T09:07:17.175215+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-21T09:07:17.175215+0000","last_clean_scrub_stamp":"2024-09-21T09:07:17.175215+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:14.991180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:56.086932+0000","last_change":"2024-09-21T09:06:56.086932+0000","last_active":"2024-09-21T09:06:56.086932+0000","last_peered":"2024-09-21T09:06:56.086932+0000","last_clean":"2024-09-21T09:06:56.086932+0000","last_became_active":"2024-09-21T09:03:00.216238+0000","last_became_peered":"2024-09-21T09:03:00.216238+0000","last_unstale":"2024-09-21T09:06:56.086932+0000","last_undegraded":"2024-09-21T09:06:56.086932+0000","last_fullsized":"2024-09-21T09:06:56.086932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:56.086803+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:56.086803+0000","last_clean_scrub_stamp":"2024-09-21T09:06:56.086803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:47.639139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:05.472448+0000","last_change":"2024-09-21T09:07:05.472493+0000","last_active":"2024-09-21T09:07:05.472448+0000","last_peered":"2024-09-21T09:07:05.472448+0000","last_clean":"2024-09-21T09:07:05.472448+0000","last_became_active":"2024-09-21T09:02:58.206879+0000","last_became_peered":"2024-09-21T09:02:58.206879+0000","last_unstale":"2024-09-21T09:07:05.472448+0000","last_undegraded":"2024-09-21T09:07:05.472448+0000","last_fullsized":"2024-09-21T09:07:05.472448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:05.472355+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:05.472355+0000","last_clean_scrub_stamp":"2024-09-21T09:07:05.472355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:07.300100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:53.844325+0000","last_change":"2024-09-21T09:06:53.844325+0000","last_active":"2024-09-21T09:06:53.844325+0000","last_peered":"2024-09-21T09:06:53.844325+0000","last_clean":"2024-09-21T09:06:53.844325+0000","last_became_active":"2024-09-21T09:03:02.218381+0000","last_became_peered":"2024-09-21T09:03:02.218381+0000","last_unstale":"2024-09-21T09:06:53.844325+0000","last_undegraded":"2024-09-21T09:06:53.844325+0000","last_fullsized":"2024-09-21T09:06:53.844325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:53.844124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:53.844124+0000","last_clean_scrub_stamp":"2024-09-21T09:06:53.844124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:16.853541+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.290474+0000","last_change":"2024-09-21T09:06:29.290517+0000","last_active":"2024-09-21T09:06:29.290474+0000","last_peered":"2024-09-21T09:06:29.290474+0000","last_clean":"2024-09-21T09:06:29.290474+0000","last_became_active":"2024-09-21T09:03:04.240933+0000","last_became_peered":"2024-09-21T09:03:04.240933+0000","last_unstale":"2024-09-21T09:06:29.290474+0000","last_undegraded":"2024-09-21T09:06:29.290474+0000","last_fullsized":"2024-09-21T09:06:29.290474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-21T09:06:29.290368+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-21T09:06:29.290368+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.290368+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:29.068806+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.475284+0000","last_change":"2024-09-21T09:06:17.475308+0000","last_active":"2024-09-21T09:06:17.475284+0000","last_peered":"2024-09-21T09:06:17.475284+0000","last_clean":"2024-09-21T09:06:17.475284+0000","last_became_active":"2024-09-21T09:03:06.247153+0000","last_became_peered":"2024-09-21T09:03:06.247153+0000","last_unstale":"2024-09-21T09:06:17.475284+0000","last_undegraded":"2024-09-21T09:06:17.475284+0000","last_fullsized":"2024-09-21T09:06:17.475284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.475178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.475178+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.475178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:28.701561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:06.264738+0000","last_change":"2024-09-21T09:03:08.262999+0000","last_active":"2024-09-21T09:06:06.264738+0000","last_peered":"2024-09-21T09:06:06.264738+0000","last_clean":"2024-09-21T09:06:06.264738+0000","last_became_active":"2024-09-21T09:03:08.262680+0000","last_became_peered":"2024-09-21T09:03:08.262680+0000","last_unstale":"2024-09-21T09:06:06.264738+0000","last_undegraded":"2024-09-21T09:06:06.264738+0000","last_fullsized":"2024-09-21T09:06:06.264738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.325607+0000","last_change":"2024-09-21T09:06:28.325656+0000","last_active":"2024-09-21T09:06:28.325607+0000","last_peered":"2024-09-21T09:06:28.325607+0000","last_clean":"2024-09-21T09:06:28.325607+0000","last_became_active":"2024-09-21T09:03:00.219653+0000","last_became_peered":"2024-09-21T09:03:00.219653+0000","last_unstale":"2024-09-21T09:06:28.325607+0000","last_undegraded":"2024-09-21T09:06:28.325607+0000","last_fullsized":"2024-09-21T09:06:28.325607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:28.325504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:28.325504+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.325504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:07.739919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'3","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:02.576259+0000","last_change":"2024-09-21T09:07:02.576326+0000","last_active":"2024-09-21T09:07:02.576259+0000","last_peered":"2024-09-21T09:07:02.576259+0000","last_clean":"2024-09-21T09:07:02.576259+0000","last_became_active":"2024-09-21T09:02:58.202431+0000","last_became_peered":"2024-09-21T09:02:58.202431+0000","last_unstale":"2024-09-21T09:07:02.576259+0000","last_undegraded":"2024-09-21T09:07:02.576259+0000","last_fullsized":"2024-09-21T09:07:02.576259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:07:02.576143+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:07:02.576143+0000","last_clean_scrub_stamp":"2024-09-21T09:07:02.576143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:40.207102+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.809305+0000","last_change":"2024-09-21T09:06:36.809338+0000","last_active":"2024-09-21T09:06:36.809305+0000","last_peered":"2024-09-21T09:06:36.809305+0000","last_clean":"2024-09-21T09:06:36.809305+0000","last_became_active":"2024-09-21T09:03:02.220940+0000","last_became_peered":"2024-09-21T09:03:02.220940+0000","last_unstale":"2024-09-21T09:06:36.809305+0000","last_undegraded":"2024-09-21T09:06:36.809305+0000","last_fullsized":"2024-09-21T09:06:36.809305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:36.809163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:36.809163+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.809163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:23.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'40","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.706558+0000","last_change":"2024-09-21T09:06:26.706558+0000","last_active":"2024-09-21T09:06:26.706558+0000","last_peered":"2024-09-21T09:06:26.706558+0000","last_clean":"2024-09-21T09:06:26.706558+0000","last_became_active":"2024-09-21T09:03:04.239023+0000","last_became_peered":"2024-09-21T09:03:04.239023+0000","last_unstale":"2024-09-21T09:06:26.706558+0000","last_undegraded":"2024-09-21T09:06:26.706558+0000","last_fullsized":"2024-09-21T09:06:26.706558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-09-21T09:06:26.706429+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-09-21T09:06:26.706429+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.706429+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:10.421856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.647012+0000","last_change":"2024-09-21T09:06:19.647012+0000","last_active":"2024-09-21T09:06:19.647012+0000","last_peered":"2024-09-21T09:06:19.647012+0000","last_clean":"2024-09-21T09:06:19.647012+0000","last_became_active":"2024-09-21T09:03:06.243451+0000","last_became_peered":"2024-09-21T09:03:06.243451+0000","last_unstale":"2024-09-21T09:06:19.647012+0000","last_undegraded":"2024-09-21T09:06:19.647012+0000","last_fullsized":"2024-09-21T09:06:19.647012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.646893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.646893+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.646893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:53.881810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:09.304582+0000","last_change":"2024-09-21T09:07:09.304628+0000","last_active":"2024-09-21T09:07:09.304582+0000","last_peered":"2024-09-21T09:07:09.304582+0000","last_clean":"2024-09-21T09:07:09.304582+0000","last_became_active":"2024-09-21T09:03:08.260047+0000","last_became_peered":"2024-09-21T09:03:08.260047+0000","last_unstale":"2024-09-21T09:07:09.304582+0000","last_undegraded":"2024-09-21T09:07:09.304582+0000","last_fullsized":"2024-09-21T09:07:09.304582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:07:09.304481+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:07:09.304481+0000","last_clean_scrub_stamp":"2024-09-21T09:07:09.304481+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:04.837478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.961215+0000","last_change":"2024-09-21T09:06:44.961247+0000","last_active":"2024-09-21T09:06:44.961215+0000","last_peered":"2024-09-21T09:06:44.961215+0000","last_clean":"2024-09-21T09:06:44.961215+0000","last_became_active":"2024-09-21T09:03:00.221332+0000","last_became_peered":"2024-09-21T09:03:00.221332+0000","last_unstale":"2024-09-21T09:06:44.961215+0000","last_undegraded":"2024-09-21T09:06:44.961215+0000","last_fullsized":"2024-09-21T09:06:44.961215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:44.961118+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:44.961118+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.961118+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:44.503583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:28.461450+0000","last_change":"2024-09-21T09:02:58.210805+0000","last_active":"2024-09-21T09:05:28.461450+0000","last_peered":"2024-09-21T09:05:28.461450+0000","last_clean":"2024-09-21T09:05:28.461450+0000","last_became_active":"2024-09-21T09:02:58.210511+0000","last_became_peered":"2024-09-21T09:02:58.210511+0000","last_unstale":"2024-09-21T09:05:28.461450+0000","last_undegraded":"2024-09-21T09:05:28.461450+0000","last_fullsized":"2024-09-21T09:05:28.461450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.326237+0000","last_change":"2024-09-21T09:06:34.326260+0000","last_active":"2024-09-21T09:06:34.326237+0000","last_peered":"2024-09-21T09:06:34.326237+0000","last_clean":"2024-09-21T09:06:34.326237+0000","last_became_active":"2024-09-21T09:03:02.218979+0000","last_became_peered":"2024-09-21T09:03:02.218979+0000","last_unstale":"2024-09-21T09:06:34.326237+0000","last_undegraded":"2024-09-21T09:06:34.326237+0000","last_fullsized":"2024-09-21T09:06:34.326237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:34.326149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:34.326149+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.326149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:08.189282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.300849+0000","last_change":"2024-09-21T09:06:48.300849+0000","last_active":"2024-09-21T09:06:48.300849+0000","last_peered":"2024-09-21T09:06:48.300849+0000","last_clean":"2024-09-21T09:06:48.300849+0000","last_became_active":"2024-09-21T09:03:04.241974+0000","last_became_peered":"2024-09-21T09:03:04.241974+0000","last_unstale":"2024-09-21T09:06:48.300849+0000","last_undegraded":"2024-09-21T09:06:48.300849+0000","last_fullsized":"2024-09-21T09:06:48.300849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-21T09:06:48.300709+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-21T09:06:48.300709+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.300709+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:28.450871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'285","reported_seq":429,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.869907+0000","last_change":"2024-09-21T09:06:20.869907+0000","last_active":"2024-09-21T09:06:20.869907+0000","last_peered":"2024-09-21T09:06:20.869907+0000","last_clean":"2024-09-21T09:06:20.869907+0000","last_became_active":"2024-09-21T09:03:06.244103+0000","last_became_peered":"2024-09-21T09:03:06.244103+0000","last_unstale":"2024-09-21T09:06:20.869907+0000","last_undegraded":"2024-09-21T09:06:20.869907+0000","last_fullsized":"2024-09-21T09:06:20.869907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:20.869741+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:20.869741+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.869741+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:41.358529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"31'6","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:05.204190+0000","last_change":"2024-09-21T09:07:05.204223+0000","last_active":"2024-09-21T09:07:05.204190+0000","last_peered":"2024-09-21T09:07:05.204190+0000","last_clean":"2024-09-21T09:07:05.204190+0000","last_became_active":"2024-09-21T09:03:08.259638+0000","last_became_peered":"2024-09-21T09:03:08.259638+0000","last_unstale":"2024-09-21T09:07:05.204190+0000","last_undegraded":"2024-09-21T09:07:05.204190+0000","last_fullsized":"2024-09-21T09:07:05.204190+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:05.204085+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:05.204085+0000","last_clean_scrub_stamp":"2024-09-21T09:07:05.204085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:46.034899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.840388+0000","last_change":"2024-09-21T09:06:41.840414+0000","last_active":"2024-09-21T09:06:41.840388+0000","last_peered":"2024-09-21T09:06:41.840388+0000","last_clean":"2024-09-21T09:06:41.840388+0000","last_became_active":"2024-09-21T09:03:00.220426+0000","last_became_peered":"2024-09-21T09:03:00.220426+0000","last_unstale":"2024-09-21T09:06:41.840388+0000","last_undegraded":"2024-09-21T09:06:41.840388+0000","last_fullsized":"2024-09-21T09:06:41.840388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:41.840277+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:41.840277+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.840277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:15.703410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:06.486792+0000","last_change":"2024-09-21T09:07:06.486842+0000","last_active":"2024-09-21T09:07:06.486792+0000","last_peered":"2024-09-21T09:07:06.486792+0000","last_clean":"2024-09-21T09:07:06.486792+0000","last_became_active":"2024-09-21T09:02:58.207424+0000","last_became_peered":"2024-09-21T09:02:58.207424+0000","last_unstale":"2024-09-21T09:07:06.486792+0000","last_undegraded":"2024-09-21T09:07:06.486792+0000","last_fullsized":"2024-09-21T09:07:06.486792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:06.486677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:06.486677+0000","last_clean_scrub_stamp":"2024-09-21T09:07:06.486677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:09.583407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:15.483743+0000","last_change":"2024-09-21T09:07:15.483766+0000","last_active":"2024-09-21T09:07:15.483743+0000","last_peered":"2024-09-21T09:07:15.483743+0000","last_clean":"2024-09-21T09:07:15.483743+0000","last_became_active":"2024-09-21T09:03:38.280616+0000","last_became_peered":"2024-09-21T09:03:38.280616+0000","last_unstale":"2024-09-21T09:07:15.483743+0000","last_undegraded":"2024-09-21T09:07:15.483743+0000","last_fullsized":"2024-09-21T09:07:15.483743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:15.483655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:15.483655+0000","last_clean_scrub_stamp":"2024-09-21T09:07:15.483655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:29.737059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'47","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.397782+0000","last_change":"2024-09-21T09:06:26.397832+0000","last_active":"2024-09-21T09:06:26.397782+0000","last_peered":"2024-09-21T09:06:26.397782+0000","last_clean":"2024-09-21T09:06:26.397782+0000","last_became_active":"2024-09-21T09:03:04.233878+0000","last_became_peered":"2024-09-21T09:03:04.233878+0000","last_unstale":"2024-09-21T09:06:26.397782+0000","last_undegraded":"2024-09-21T09:06:26.397782+0000","last_fullsized":"2024-09-21T09:06:26.397782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-09-21T09:06:26.397701+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-09-21T09:06:26.397701+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.397701+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:42.069141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.708319+0000","last_change":"2024-09-21T09:06:17.708341+0000","last_active":"2024-09-21T09:06:17.708319+0000","last_peered":"2024-09-21T09:06:17.708319+0000","last_clean":"2024-09-21T09:06:17.708319+0000","last_became_active":"2024-09-21T09:03:06.247609+0000","last_became_peered":"2024-09-21T09:03:06.247609+0000","last_unstale":"2024-09-21T09:06:17.708319+0000","last_undegraded":"2024-09-21T09:06:17.708319+0000","last_fullsized":"2024-09-21T09:06:17.708319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.708240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.708240+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.708240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:29.114535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.282800+0000","last_change":"2024-09-21T09:06:35.282851+0000","last_active":"2024-09-21T09:06:35.282800+0000","last_peered":"2024-09-21T09:06:35.282800+0000","last_clean":"2024-09-21T09:06:35.282800+0000","last_became_active":"2024-09-21T09:03:08.255717+0000","last_became_peered":"2024-09-21T09:03:08.255717+0000","last_unstale":"2024-09-21T09:06:35.282800+0000","last_undegraded":"2024-09-21T09:06:35.282800+0000","last_fullsized":"2024-09-21T09:06:35.282800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:35.282702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:35.282702+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.282702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:28.033731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.817710+0000","last_change":"2024-09-21T09:06:44.817735+0000","last_active":"2024-09-21T09:06:44.817710+0000","last_peered":"2024-09-21T09:06:44.817710+0000","last_clean":"2024-09-21T09:06:44.817710+0000","last_became_active":"2024-09-21T09:03:00.215804+0000","last_became_peered":"2024-09-21T09:03:00.215804+0000","last_unstale":"2024-09-21T09:06:44.817710+0000","last_undegraded":"2024-09-21T09:06:44.817710+0000","last_fullsized":"2024-09-21T09:06:44.817710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:44.817622+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:44.817622+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.817622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:06.066605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:17.356635+0000","last_change":"2024-09-21T09:07:17.356658+0000","last_active":"2024-09-21T09:07:17.356635+0000","last_peered":"2024-09-21T09:07:17.356635+0000","last_clean":"2024-09-21T09:07:17.356635+0000","last_became_active":"2024-09-21T09:02:58.221286+0000","last_became_peered":"2024-09-21T09:02:58.221286+0000","last_unstale":"2024-09-21T09:07:17.356635+0000","last_undegraded":"2024-09-21T09:07:17.356635+0000","last_fullsized":"2024-09-21T09:07:17.356635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:17.356550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:17.356550+0000","last_clean_scrub_stamp":"2024-09-21T09:07:17.356550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:37.837673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.811610+0000","last_change":"2024-09-21T09:06:34.811636+0000","last_active":"2024-09-21T09:06:34.811610+0000","last_peered":"2024-09-21T09:06:34.811610+0000","last_clean":"2024-09-21T09:06:34.811610+0000","last_became_active":"2024-09-21T09:03:02.224879+0000","last_became_peered":"2024-09-21T09:03:02.224879+0000","last_unstale":"2024-09-21T09:06:34.811610+0000","last_undegraded":"2024-09-21T09:06:34.811610+0000","last_fullsized":"2024-09-21T09:06:34.811610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:34.811505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:34.811505+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.811505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:18.526932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.736574+0000","last_change":"2024-09-21T09:06:24.736614+0000","last_active":"2024-09-21T09:06:24.736574+0000","last_peered":"2024-09-21T09:06:24.736574+0000","last_clean":"2024-09-21T09:06:24.736574+0000","last_became_active":"2024-09-21T09:03:04.239112+0000","last_became_peered":"2024-09-21T09:03:04.239112+0000","last_unstale":"2024-09-21T09:06:24.736574+0000","last_undegraded":"2024-09-21T09:06:24.736574+0000","last_fullsized":"2024-09-21T09:06:24.736574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-09-21T09:06:24.736479+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-09-21T09:06:24.736479+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.736479+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:34.646980+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:53.276661+0000","last_change":"2024-09-21T09:06:53.276683+0000","last_active":"2024-09-21T09:06:53.276661+0000","last_peered":"2024-09-21T09:06:53.276661+0000","last_clean":"2024-09-21T09:06:53.276661+0000","last_became_active":"2024-09-21T09:03:06.250729+0000","last_became_peered":"2024-09-21T09:03:06.250729+0000","last_unstale":"2024-09-21T09:06:53.276661+0000","last_undegraded":"2024-09-21T09:06:53.276661+0000","last_fullsized":"2024-09-21T09:06:53.276661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:53.276571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:53.276571+0000","last_clean_scrub_stamp":"2024-09-21T09:06:53.276571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:56.962969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:33.462299+0000","last_change":"2024-09-21T09:03:08.264701+0000","last_active":"2024-09-21T09:05:33.462299+0000","last_peered":"2024-09-21T09:05:33.462299+0000","last_clean":"2024-09-21T09:05:33.462299+0000","last_became_active":"2024-09-21T09:03:08.264160+0000","last_became_peered":"2024-09-21T09:03:08.264160+0000","last_unstale":"2024-09-21T09:05:33.462299+0000","last_undegraded":"2024-09-21T09:05:33.462299+0000","last_fullsized":"2024-09-21T09:05:33.462299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:06.208497+0000","last_change":"2024-09-21T09:07:06.208522+0000","last_active":"2024-09-21T09:07:06.208497+0000","last_peered":"2024-09-21T09:07:06.208497+0000","last_clean":"2024-09-21T09:07:06.208497+0000","last_became_active":"2024-09-21T09:03:00.208673+0000","last_became_peered":"2024-09-21T09:03:00.208673+0000","last_unstale":"2024-09-21T09:07:06.208497+0000","last_undegraded":"2024-09-21T09:07:06.208497+0000","last_fullsized":"2024-09-21T09:07:06.208497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:07:06.208403+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:07:06.208403+0000","last_clean_scrub_stamp":"2024-09-21T09:07:06.208403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:01.240992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:55.037211+0000","last_change":"2024-09-21T09:06:55.037211+0000","last_active":"2024-09-21T09:06:55.037211+0000","last_peered":"2024-09-21T09:06:55.037211+0000","last_clean":"2024-09-21T09:06:55.037211+0000","last_became_active":"2024-09-21T09:02:58.212751+0000","last_became_peered":"2024-09-21T09:02:58.212751+0000","last_unstale":"2024-09-21T09:06:55.037211+0000","last_undegraded":"2024-09-21T09:06:55.037211+0000","last_fullsized":"2024-09-21T09:06:55.037211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:55.037086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:55.037086+0000","last_clean_scrub_stamp":"2024-09-21T09:06:55.037086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:55.221730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.339319+0000","last_change":"2024-09-21T09:06:28.339342+0000","last_active":"2024-09-21T09:06:28.339319+0000","last_peered":"2024-09-21T09:06:28.339319+0000","last_clean":"2024-09-21T09:06:28.339319+0000","last_became_active":"2024-09-21T09:03:02.222965+0000","last_became_peered":"2024-09-21T09:03:02.222965+0000","last_unstale":"2024-09-21T09:06:28.339319+0000","last_undegraded":"2024-09-21T09:06:28.339319+0000","last_fullsized":"2024-09-21T09:06:28.339319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:28.339237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:28.339237+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.339237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:34.803750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'30","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.308727+0000","last_change":"2024-09-21T09:06:42.308759+0000","last_active":"2024-09-21T09:06:42.308727+0000","last_peered":"2024-09-21T09:06:42.308727+0000","last_clean":"2024-09-21T09:06:42.308727+0000","last_became_active":"2024-09-21T09:03:04.243686+0000","last_became_peered":"2024-09-21T09:03:04.243686+0000","last_unstale":"2024-09-21T09:06:42.308727+0000","last_undegraded":"2024-09-21T09:06:42.308727+0000","last_fullsized":"2024-09-21T09:06:42.308727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2024-09-21T09:06:42.308640+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2024-09-21T09:06:42.308640+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.308640+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:02:38.998283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.330394+0000","last_change":"2024-09-21T09:06:45.330435+0000","last_active":"2024-09-21T09:06:45.330394+0000","last_peered":"2024-09-21T09:06:45.330394+0000","last_clean":"2024-09-21T09:06:45.330394+0000","last_became_active":"2024-09-21T09:03:06.249959+0000","last_became_peered":"2024-09-21T09:03:06.249959+0000","last_unstale":"2024-09-21T09:06:45.330394+0000","last_undegraded":"2024-09-21T09:06:45.330394+0000","last_fullsized":"2024-09-21T09:06:45.330394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:45.330289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:45.330289+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.330289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:06.828858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:33.462261+0000","last_change":"2024-09-21T09:03:08.264668+0000","last_active":"2024-09-21T09:05:33.462261+0000","last_peered":"2024-09-21T09:05:33.462261+0000","last_clean":"2024-09-21T09:05:33.462261+0000","last_became_active":"2024-09-21T09:03:08.264395+0000","last_became_peered":"2024-09-21T09:03:08.264395+0000","last_unstale":"2024-09-21T09:05:33.462261+0000","last_undegraded":"2024-09-21T09:05:33.462261+0000","last_fullsized":"2024-09-21T09:05:33.462261+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'14","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.866133+0000","last_change":"2024-09-21T09:06:42.866158+0000","last_active":"2024-09-21T09:06:42.866133+0000","last_peered":"2024-09-21T09:06:42.866133+0000","last_clean":"2024-09-21T09:06:42.866133+0000","last_became_active":"2024-09-21T09:03:00.215748+0000","last_became_peered":"2024-09-21T09:03:00.215748+0000","last_unstale":"2024-09-21T09:06:42.866133+0000","last_undegraded":"2024-09-21T09:06:42.866133+0000","last_fullsized":"2024-09-21T09:06:42.866133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:42.866045+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:42.866045+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.866045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:35.617075+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:03.532942+0000","last_change":"2024-09-21T09:07:03.532942+0000","last_active":"2024-09-21T09:07:03.532942+0000","last_peered":"2024-09-21T09:07:03.532942+0000","last_clean":"2024-09-21T09:07:03.532942+0000","last_became_active":"2024-09-21T09:02:58.203973+0000","last_became_peered":"2024-09-21T09:02:58.203973+0000","last_unstale":"2024-09-21T09:07:03.532942+0000","last_undegraded":"2024-09-21T09:07:03.532942+0000","last_fullsized":"2024-09-21T09:07:03.532942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:03.532761+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:03.532761+0000","last_clean_scrub_stamp":"2024-09-21T09:07:03.532761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:11:46.116897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.378455+0000","last_change":"2024-09-21T09:06:30.378485+0000","last_active":"2024-09-21T09:06:30.378455+0000","last_peered":"2024-09-21T09:06:30.378455+0000","last_clean":"2024-09-21T09:06:30.378455+0000","last_became_active":"2024-09-21T09:03:02.220801+0000","last_became_peered":"2024-09-21T09:03:02.220801+0000","last_unstale":"2024-09-21T09:06:30.378455+0000","last_undegraded":"2024-09-21T09:06:30.378455+0000","last_fullsized":"2024-09-21T09:06:30.378455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:06:30.378369+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:06:30.378369+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.378369+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:45.332862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'39","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.252315+0000","last_change":"2024-09-21T09:06:31.252360+0000","last_active":"2024-09-21T09:06:31.252315+0000","last_peered":"2024-09-21T09:06:31.252315+0000","last_clean":"2024-09-21T09:06:31.252315+0000","last_became_active":"2024-09-21T09:03:04.240857+0000","last_became_peered":"2024-09-21T09:03:04.240857+0000","last_unstale":"2024-09-21T09:06:31.252315+0000","last_undegraded":"2024-09-21T09:06:31.252315+0000","last_fullsized":"2024-09-21T09:06:31.252315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-21T09:06:31.252205+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-21T09:06:31.252205+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.252205+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.717765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.737294+0000","last_change":"2024-09-21T09:06:29.737330+0000","last_active":"2024-09-21T09:06:29.737294+0000","last_peered":"2024-09-21T09:06:29.737294+0000","last_clean":"2024-09-21T09:06:29.737294+0000","last_became_active":"2024-09-21T09:03:06.248030+0000","last_became_peered":"2024-09-21T09:03:06.248030+0000","last_unstale":"2024-09-21T09:06:29.737294+0000","last_undegraded":"2024-09-21T09:06:29.737294+0000","last_fullsized":"2024-09-21T09:06:29.737294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:29.737203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:29.737203+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.737203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:47.781194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'4","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:28.461477+0000","last_change":"2024-09-21T09:03:08.264618+0000","last_active":"2024-09-21T09:05:28.461477+0000","last_peered":"2024-09-21T09:05:28.461477+0000","last_clean":"2024-09-21T09:05:28.461477+0000","last_became_active":"2024-09-21T09:03:08.264304+0000","last_became_peered":"2024-09-21T09:03:08.264304+0000","last_unstale":"2024-09-21T09:05:28.461477+0000","last_undegraded":"2024-09-21T09:05:28.461477+0000","last_fullsized":"2024-09-21T09:05:28.461477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'22","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.309371+0000","last_change":"2024-09-21T09:06:42.309421+0000","last_active":"2024-09-21T09:06:42.309371+0000","last_peered":"2024-09-21T09:06:42.309371+0000","last_clean":"2024-09-21T09:06:42.309371+0000","last_became_active":"2024-09-21T09:03:00.225936+0000","last_became_peered":"2024-09-21T09:03:00.225936+0000","last_unstale":"2024-09-21T09:06:42.309371+0000","last_undegraded":"2024-09-21T09:06:42.309371+0000","last_fullsized":"2024-09-21T09:06:42.309371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-09-21T09:06:42.309272+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-09-21T09:06:42.309272+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.309272+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:05.305378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:57.825004+0000","last_change":"2024-09-21T09:06:57.825004+0000","last_active":"2024-09-21T09:06:57.825004+0000","last_peered":"2024-09-21T09:06:57.825004+0000","last_clean":"2024-09-21T09:06:57.825004+0000","last_became_active":"2024-09-21T09:02:58.206163+0000","last_became_peered":"2024-09-21T09:02:58.206163+0000","last_unstale":"2024-09-21T09:06:57.825004+0000","last_undegraded":"2024-09-21T09:06:57.825004+0000","last_fullsized":"2024-09-21T09:06:57.825004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:57.824824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:57.824824+0000","last_clean_scrub_stamp":"2024-09-21T09:06:57.824824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:42.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'6","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:01.952391+0000","last_change":"2024-09-21T09:07:01.952440+0000","last_active":"2024-09-21T09:07:01.952391+0000","last_peered":"2024-09-21T09:07:01.952391+0000","last_clean":"2024-09-21T09:07:01.952391+0000","last_became_active":"2024-09-21T09:03:00.220860+0000","last_became_peered":"2024-09-21T09:03:00.220860+0000","last_unstale":"2024-09-21T09:07:01.952391+0000","last_undegraded":"2024-09-21T09:07:01.952391+0000","last_fullsized":"2024-09-21T09:07:01.952391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:01.952257+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:01.952257+0000","last_clean_scrub_stamp":"2024-09-21T09:07:01.952257+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:39.583216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:08.074436+0000","last_change":"2024-09-21T09:07:08.074465+0000","last_active":"2024-09-21T09:07:08.074436+0000","last_peered":"2024-09-21T09:07:08.074436+0000","last_clean":"2024-09-21T09:07:08.074436+0000","last_became_active":"2024-09-21T09:02:58.202579+0000","last_became_peered":"2024-09-21T09:02:58.202579+0000","last_unstale":"2024-09-21T09:07:08.074436+0000","last_undegraded":"2024-09-21T09:07:08.074436+0000","last_fullsized":"2024-09-21T09:07:08.074436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:08.074342+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:08.074342+0000","last_clean_scrub_stamp":"2024-09-21T09:07:08.074342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:25.449462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.266144+0000","last_change":"2024-09-21T09:06:38.266173+0000","last_active":"2024-09-21T09:06:38.266144+0000","last_peered":"2024-09-21T09:06:38.266144+0000","last_clean":"2024-09-21T09:06:38.266144+0000","last_became_active":"2024-09-21T09:03:00.219281+0000","last_became_peered":"2024-09-21T09:03:00.219281+0000","last_unstale":"2024-09-21T09:06:38.266144+0000","last_undegraded":"2024-09-21T09:06:38.266144+0000","last_fullsized":"2024-09-21T09:06:38.266144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:38.266051+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:38.266051+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.266051+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:15.525190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.199997+0000","last_change":"2024-09-21T09:02:58.223127+0000","last_active":"2024-09-21T09:06:17.199997+0000","last_peered":"2024-09-21T09:06:17.199997+0000","last_clean":"2024-09-21T09:06:17.199997+0000","last_became_active":"2024-09-21T09:02:58.222856+0000","last_became_peered":"2024-09-21T09:02:58.222856+0000","last_unstale":"2024-09-21T09:06:17.199997+0000","last_undegraded":"2024-09-21T09:06:17.199997+0000","last_fullsized":"2024-09-21T09:06:17.199997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:12.164812+0000","last_change":"2024-09-21T09:07:12.164838+0000","last_active":"2024-09-21T09:07:12.164812+0000","last_peered":"2024-09-21T09:07:12.164812+0000","last_clean":"2024-09-21T09:07:12.164812+0000","last_became_active":"2024-09-21T09:03:00.220755+0000","last_became_peered":"2024-09-21T09:03:00.220755+0000","last_unstale":"2024-09-21T09:07:12.164812+0000","last_undegraded":"2024-09-21T09:07:12.164812+0000","last_fullsized":"2024-09-21T09:07:12.164812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:12.164709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:12.164709+0000","last_clean_scrub_stamp":"2024-09-21T09:07:12.164709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:50.036239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:09.116339+0000","last_change":"2024-09-21T09:07:09.116361+0000","last_active":"2024-09-21T09:07:09.116339+0000","last_peered":"2024-09-21T09:07:09.116339+0000","last_clean":"2024-09-21T09:07:09.116339+0000","last_became_active":"2024-09-21T09:02:58.208329+0000","last_became_peered":"2024-09-21T09:02:58.208329+0000","last_unstale":"2024-09-21T09:07:09.116339+0000","last_undegraded":"2024-09-21T09:07:09.116339+0000","last_fullsized":"2024-09-21T09:07:09.116339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:09.116244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:09.116244+0000","last_clean_scrub_stamp":"2024-09-21T09:07:09.116244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:52.166977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'16","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:52.034234+0000","last_change":"2024-09-21T09:06:52.034234+0000","last_active":"2024-09-21T09:06:52.034234+0000","last_peered":"2024-09-21T09:06:52.034234+0000","last_clean":"2024-09-21T09:06:52.034234+0000","last_became_active":"2024-09-21T09:03:00.215554+0000","last_became_peered":"2024-09-21T09:03:00.215554+0000","last_unstale":"2024-09-21T09:06:52.034234+0000","last_undegraded":"2024-09-21T09:06:52.034234+0000","last_fullsized":"2024-09-21T09:06:52.034234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-21T09:06:52.034066+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-21T09:06:52.034066+0000","last_clean_scrub_stamp":"2024-09-21T09:06:52.034066+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:54.024587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:06.021784+0000","last_change":"2024-09-21T09:07:06.021784+0000","last_active":"2024-09-21T09:07:06.021784+0000","last_peered":"2024-09-21T09:07:06.021784+0000","last_clean":"2024-09-21T09:07:06.021784+0000","last_became_active":"2024-09-21T09:02:58.201482+0000","last_became_peered":"2024-09-21T09:02:58.201482+0000","last_unstale":"2024-09-21T09:07:06.021784+0000","last_undegraded":"2024-09-21T09:07:06.021784+0000","last_fullsized":"2024-09-21T09:07:06.021784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:06.021641+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:06.021641+0000","last_clean_scrub_stamp":"2024-09-21T09:07:06.021641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:09.118371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'12","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:59.559444+0000","last_change":"2024-09-21T09:06:59.559444+0000","last_active":"2024-09-21T09:06:59.559444+0000","last_peered":"2024-09-21T09:06:59.559444+0000","last_clean":"2024-09-21T09:06:59.559444+0000","last_became_active":"2024-09-21T09:03:00.223740+0000","last_became_peered":"2024-09-21T09:03:00.223740+0000","last_unstale":"2024-09-21T09:06:59.559444+0000","last_undegraded":"2024-09-21T09:06:59.559444+0000","last_fullsized":"2024-09-21T09:06:59.559444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:06:59.559326+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:06:59.559326+0000","last_clean_scrub_stamp":"2024-09-21T09:06:59.559326+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:54.979937+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:56.502385+0000","last_change":"2024-09-21T09:06:56.502385+0000","last_active":"2024-09-21T09:06:56.502385+0000","last_peered":"2024-09-21T09:06:56.502385+0000","last_clean":"2024-09-21T09:06:56.502385+0000","last_became_active":"2024-09-21T09:02:58.210442+0000","last_became_peered":"2024-09-21T09:02:58.210442+0000","last_unstale":"2024-09-21T09:06:56.502385+0000","last_undegraded":"2024-09-21T09:06:56.502385+0000","last_fullsized":"2024-09-21T09:06:56.502385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:56.502267+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:56.502267+0000","last_clean_scrub_stamp":"2024-09-21T09:06:56.502267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:16.665604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'14","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:58.080667+0000","last_change":"2024-09-21T09:06:58.080667+0000","last_active":"2024-09-21T09:06:58.080667+0000","last_peered":"2024-09-21T09:06:58.080667+0000","last_clean":"2024-09-21T09:06:58.080667+0000","last_became_active":"2024-09-21T09:03:00.216462+0000","last_became_peered":"2024-09-21T09:03:00.216462+0000","last_unstale":"2024-09-21T09:06:58.080667+0000","last_undegraded":"2024-09-21T09:06:58.080667+0000","last_fullsized":"2024-09-21T09:06:58.080667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:58.080556+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:58.080556+0000","last_clean_scrub_stamp":"2024-09-21T09:06:58.080556+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:30.491750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.809331+0000","last_change":"2024-09-21T09:06:46.809331+0000","last_active":"2024-09-21T09:06:46.809331+0000","last_peered":"2024-09-21T09:06:46.809331+0000","last_clean":"2024-09-21T09:06:46.809331+0000","last_became_active":"2024-09-21T09:02:58.218407+0000","last_became_peered":"2024-09-21T09:02:58.218407+0000","last_unstale":"2024-09-21T09:06:46.809331+0000","last_undegraded":"2024-09-21T09:06:46.809331+0000","last_fullsized":"2024-09-21T09:06:46.809331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:46.809183+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:46.809183+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.809183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:36.437428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.367934+0000","last_change":"2024-09-21T09:06:46.367934+0000","last_active":"2024-09-21T09:06:46.367934+0000","last_peered":"2024-09-21T09:06:46.367934+0000","last_clean":"2024-09-21T09:06:46.367934+0000","last_became_active":"2024-09-21T09:03:00.212503+0000","last_became_peered":"2024-09-21T09:03:00.212503+0000","last_unstale":"2024-09-21T09:06:46.367934+0000","last_undegraded":"2024-09-21T09:06:46.367934+0000","last_fullsized":"2024-09-21T09:06:46.367934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:46.367803+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:46.367803+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.367803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:25:59.172888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:07.039659+0000","last_change":"2024-09-21T09:07:07.039659+0000","last_active":"2024-09-21T09:07:07.039659+0000","last_peered":"2024-09-21T09:07:07.039659+0000","last_clean":"2024-09-21T09:07:07.039659+0000","last_became_active":"2024-09-21T09:02:58.201812+0000","last_became_peered":"2024-09-21T09:02:58.201812+0000","last_unstale":"2024-09-21T09:07:07.039659+0000","last_undegraded":"2024-09-21T09:07:07.039659+0000","last_fullsized":"2024-09-21T09:07:07.039659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:07.039529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:07.039529+0000","last_clean_scrub_stamp":"2024-09-21T09:07:07.039529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:51.654459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'6","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.362863+0000","last_change":"2024-09-21T09:06:44.362915+0000","last_active":"2024-09-21T09:06:44.362863+0000","last_peered":"2024-09-21T09:06:44.362863+0000","last_clean":"2024-09-21T09:06:44.362863+0000","last_became_active":"2024-09-21T09:03:00.224456+0000","last_became_peered":"2024-09-21T09:03:00.224456+0000","last_unstale":"2024-09-21T09:06:44.362863+0000","last_undegraded":"2024-09-21T09:06:44.362863+0000","last_fullsized":"2024-09-21T09:06:44.362863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:44.362734+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:44.362734+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.362734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:35.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.200032+0000","last_change":"2024-09-21T09:02:58.222445+0000","last_active":"2024-09-21T09:06:17.200032+0000","last_peered":"2024-09-21T09:06:17.200032+0000","last_clean":"2024-09-21T09:06:17.200032+0000","last_became_active":"2024-09-21T09:02:58.222191+0000","last_became_peered":"2024-09-21T09:02:58.222191+0000","last_unstale":"2024-09-21T09:06:17.200032+0000","last_undegraded":"2024-09-21T09:06:17.200032+0000","last_fullsized":"2024-09-21T09:06:17.200032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:02:57.192421+0000","last_clean_scrub_stamp":"2024-09-21T09:02:57.192421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'6","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.249744+0000","last_change":"2024-09-21T09:06:51.249772+0000","last_active":"2024-09-21T09:06:51.249744+0000","last_peered":"2024-09-21T09:06:51.249744+0000","last_clean":"2024-09-21T09:06:51.249744+0000","last_became_active":"2024-09-21T09:03:00.220639+0000","last_became_peered":"2024-09-21T09:03:00.220639+0000","last_unstale":"2024-09-21T09:06:51.249744+0000","last_undegraded":"2024-09-21T09:06:51.249744+0000","last_fullsized":"2024-09-21T09:06:51.249744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:51.249657+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:51.249657+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.249657+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:04.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:10.109254+0000","last_change":"2024-09-21T09:07:10.109282+0000","last_active":"2024-09-21T09:07:10.109254+0000","last_peered":"2024-09-21T09:07:10.109254+0000","last_clean":"2024-09-21T09:07:10.109254+0000","last_became_active":"2024-09-21T09:02:58.208346+0000","last_became_peered":"2024-09-21T09:02:58.208346+0000","last_unstale":"2024-09-21T09:07:10.109254+0000","last_undegraded":"2024-09-21T09:07:10.109254+0000","last_fullsized":"2024-09-21T09:07:10.109254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:10.109160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:10.109160+0000","last_clean_scrub_stamp":"2024-09-21T09:07:10.109160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:50.151115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.941232+0000","last_change":"2024-09-21T09:06:43.941260+0000","last_active":"2024-09-21T09:06:43.941232+0000","last_peered":"2024-09-21T09:06:43.941232+0000","last_clean":"2024-09-21T09:06:43.941232+0000","last_became_active":"2024-09-21T09:03:00.222651+0000","last_became_peered":"2024-09-21T09:03:00.222651+0000","last_unstale":"2024-09-21T09:06:43.941232+0000","last_undegraded":"2024-09-21T09:06:43.941232+0000","last_fullsized":"2024-09-21T09:06:43.941232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:43.941138+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:43.941138+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.941138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:54.251590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.580086+0000","last_change":"2024-09-21T09:07:00.580125+0000","last_active":"2024-09-21T09:07:00.580086+0000","last_peered":"2024-09-21T09:07:00.580086+0000","last_clean":"2024-09-21T09:07:00.580086+0000","last_became_active":"2024-09-21T09:02:58.208495+0000","last_became_peered":"2024-09-21T09:02:58.208495+0000","last_unstale":"2024-09-21T09:07:00.580086+0000","last_undegraded":"2024-09-21T09:07:00.580086+0000","last_fullsized":"2024-09-21T09:07:00.580086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:00.579976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:00.579976+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.579976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:11.761034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.446615+0000","last_change":"2024-09-21T09:06:51.446658+0000","last_active":"2024-09-21T09:06:51.446615+0000","last_peered":"2024-09-21T09:06:51.446615+0000","last_clean":"2024-09-21T09:06:51.446615+0000","last_became_active":"2024-09-21T09:03:00.222343+0000","last_became_peered":"2024-09-21T09:03:00.222343+0000","last_unstale":"2024-09-21T09:06:51.446615+0000","last_undegraded":"2024-09-21T09:06:51.446615+0000","last_fullsized":"2024-09-21T09:06:51.446615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-21T09:06:51.446466+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-21T09:06:51.446466+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.446466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.923486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:58.567990+0000","last_change":"2024-09-21T09:06:58.568019+0000","last_active":"2024-09-21T09:06:58.567990+0000","last_peered":"2024-09-21T09:06:58.567990+0000","last_clean":"2024-09-21T09:06:58.567990+0000","last_became_active":"2024-09-21T09:02:58.208630+0000","last_became_peered":"2024-09-21T09:02:58.208630+0000","last_unstale":"2024-09-21T09:06:58.567990+0000","last_undegraded":"2024-09-21T09:06:58.567990+0000","last_fullsized":"2024-09-21T09:06:58.567990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:58.567895+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:58.567895+0000","last_clean_scrub_stamp":"2024-09-21T09:06:58.567895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:30.979089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'18","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:09.817950+0000","last_change":"2024-09-21T09:07:09.817973+0000","last_active":"2024-09-21T09:07:09.817950+0000","last_peered":"2024-09-21T09:07:09.817950+0000","last_clean":"2024-09-21T09:07:09.817950+0000","last_became_active":"2024-09-21T09:03:38.282951+0000","last_became_peered":"2024-09-21T09:03:38.282951+0000","last_unstale":"2024-09-21T09:07:09.817950+0000","last_undegraded":"2024-09-21T09:07:09.817950+0000","last_fullsized":"2024-09-21T09:07:09.817950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-21T09:07:09.817858+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-21T09:07:09.817858+0000","last_clean_scrub_stamp":"2024-09-21T09:07:09.817858+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:47.448817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:18.392728+0000","last_change":"2024-09-21T09:07:18.392755+0000","last_active":"2024-09-21T09:07:18.392728+0000","last_peered":"2024-09-21T09:07:18.392728+0000","last_clean":"2024-09-21T09:07:18.392728+0000","last_became_active":"2024-09-21T09:02:58.214717+0000","last_became_peered":"2024-09-21T09:02:58.214717+0000","last_unstale":"2024-09-21T09:07:18.392728+0000","last_undegraded":"2024-09-21T09:07:18.392728+0000","last_fullsized":"2024-09-21T09:07:18.392728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:18.392639+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:18.392639+0000","last_clean_scrub_stamp":"2024-09-21T09:07:18.392639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:11.253648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.344725+0000","last_change":"2024-09-21T09:06:38.344758+0000","last_active":"2024-09-21T09:06:38.344725+0000","last_peered":"2024-09-21T09:06:38.344725+0000","last_clean":"2024-09-21T09:06:38.344725+0000","last_became_active":"2024-09-21T09:03:00.226411+0000","last_became_peered":"2024-09-21T09:03:00.226411+0000","last_unstale":"2024-09-21T09:06:38.344725+0000","last_undegraded":"2024-09-21T09:06:38.344725+0000","last_fullsized":"2024-09-21T09:06:38.344725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:38.344633+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:38.344633+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.344633+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:29.901754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:10.317338+0000","last_change":"2024-09-21T09:07:10.317392+0000","last_active":"2024-09-21T09:07:10.317338+0000","last_peered":"2024-09-21T09:07:10.317338+0000","last_clean":"2024-09-21T09:07:10.317338+0000","last_became_active":"2024-09-21T09:02:58.224058+0000","last_became_peered":"2024-09-21T09:02:58.224058+0000","last_unstale":"2024-09-21T09:07:10.317338+0000","last_undegraded":"2024-09-21T09:07:10.317338+0000","last_fullsized":"2024-09-21T09:07:10.317338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:10.317229+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:10.317229+0000","last_clean_scrub_stamp":"2024-09-21T09:07:10.317229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:03:49.909565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'4","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:52.260701+0000","last_change":"2024-09-21T09:06:52.260743+0000","last_active":"2024-09-21T09:06:52.260701+0000","last_peered":"2024-09-21T09:06:52.260701+0000","last_clean":"2024-09-21T09:06:52.260701+0000","last_became_active":"2024-09-21T09:03:00.218422+0000","last_became_peered":"2024-09-21T09:03:00.218422+0000","last_unstale":"2024-09-21T09:06:52.260701+0000","last_undegraded":"2024-09-21T09:06:52.260701+0000","last_fullsized":"2024-09-21T09:06:52.260701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:52.260581+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:52.260581+0000","last_clean_scrub_stamp":"2024-09-21T09:06:52.260581+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:19.039754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:50.894205+0000","last_change":"2024-09-21T09:06:50.894242+0000","last_active":"2024-09-21T09:06:50.894205+0000","last_peered":"2024-09-21T09:06:50.894205+0000","last_clean":"2024-09-21T09:06:50.894205+0000","last_became_active":"2024-09-21T09:02:58.218299+0000","last_became_peered":"2024-09-21T09:02:58.218299+0000","last_unstale":"2024-09-21T09:06:50.894205+0000","last_undegraded":"2024-09-21T09:06:50.894205+0000","last_fullsized":"2024-09-21T09:06:50.894205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:50.894097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:50.894097+0000","last_clean_scrub_stamp":"2024-09-21T09:06:50.894097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:31.934174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'12","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.393535+0000","last_change":"2024-09-21T09:06:45.393566+0000","last_active":"2024-09-21T09:06:45.393535+0000","last_peered":"2024-09-21T09:06:45.393535+0000","last_clean":"2024-09-21T09:06:45.393535+0000","last_became_active":"2024-09-21T09:03:00.212838+0000","last_became_peered":"2024-09-21T09:03:00.212838+0000","last_unstale":"2024-09-21T09:06:45.393535+0000","last_undegraded":"2024-09-21T09:06:45.393535+0000","last_fullsized":"2024-09-21T09:06:45.393535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:06:45.393449+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:06:45.393449+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.393449+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:43.161382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:14.374168+0000","last_change":"2024-09-21T09:07:14.374192+0000","last_active":"2024-09-21T09:07:14.374168+0000","last_peered":"2024-09-21T09:07:14.374168+0000","last_clean":"2024-09-21T09:07:14.374168+0000","last_became_active":"2024-09-21T09:02:58.218776+0000","last_became_peered":"2024-09-21T09:02:58.218776+0000","last_unstale":"2024-09-21T09:07:14.374168+0000","last_undegraded":"2024-09-21T09:07:14.374168+0000","last_fullsized":"2024-09-21T09:07:14.374168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:14.374083+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:14.374083+0000","last_clean_scrub_stamp":"2024-09-21T09:07:14.374083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:25.732715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:16.322225+0000","last_change":"2024-09-21T09:07:16.322263+0000","last_active":"2024-09-21T09:07:16.322225+0000","last_peered":"2024-09-21T09:07:16.322225+0000","last_clean":"2024-09-21T09:07:16.322225+0000","last_became_active":"2024-09-21T09:02:58.218757+0000","last_became_peered":"2024-09-21T09:02:58.218757+0000","last_unstale":"2024-09-21T09:07:16.322225+0000","last_undegraded":"2024-09-21T09:07:16.322225+0000","last_fullsized":"2024-09-21T09:07:16.322225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:16.322131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:16.322131+0000","last_clean_scrub_stamp":"2024-09-21T09:07:16.322131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:55.648243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'6","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.021268+0000","last_change":"2024-09-21T09:07:00.021303+0000","last_active":"2024-09-21T09:07:00.021268+0000","last_peered":"2024-09-21T09:07:00.021268+0000","last_clean":"2024-09-21T09:07:00.021268+0000","last_became_active":"2024-09-21T09:03:00.216424+0000","last_became_peered":"2024-09-21T09:03:00.216424+0000","last_unstale":"2024-09-21T09:07:00.021268+0000","last_undegraded":"2024-09-21T09:07:00.021268+0000","last_fullsized":"2024-09-21T09:07:00.021268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:00.021180+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:00.021180+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.021180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:11.202238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.986065+0000","last_change":"2024-09-21T09:07:00.986094+0000","last_active":"2024-09-21T09:07:00.986065+0000","last_peered":"2024-09-21T09:07:00.986065+0000","last_clean":"2024-09-21T09:07:00.986065+0000","last_became_active":"2024-09-21T09:02:58.208437+0000","last_became_peered":"2024-09-21T09:02:58.208437+0000","last_unstale":"2024-09-21T09:07:00.986065+0000","last_undegraded":"2024-09-21T09:07:00.986065+0000","last_fullsized":"2024-09-21T09:07:00.986065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:00.985977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:00.985977+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.985977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:00.711201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.386389+0000","last_change":"2024-09-21T09:06:47.386417+0000","last_active":"2024-09-21T09:06:47.386389+0000","last_peered":"2024-09-21T09:06:47.386389+0000","last_clean":"2024-09-21T09:06:47.386389+0000","last_became_active":"2024-09-21T09:03:00.219010+0000","last_became_peered":"2024-09-21T09:03:00.219010+0000","last_unstale":"2024-09-21T09:06:47.386389+0000","last_undegraded":"2024-09-21T09:06:47.386389+0000","last_fullsized":"2024-09-21T09:06:47.386389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:47.386301+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:47.386301+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.386301+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:10.395718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":136073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705722,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":722309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705721,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":723502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":417792,"data_stored":134220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:07:18.684 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.684 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.685 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.685 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.685 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.685 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.685 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.686 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.686 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.686 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.686 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.686 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.687 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.687 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.687 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.687 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T09:02:48.483175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.687 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.688 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.688 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.688 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.688 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.688 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.689 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.689 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.689 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.689 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-21T09:02:57.192421+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=2, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:18.690 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T09:07:38.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:07:38.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.803+0000 7f0cdd653640 1 Processor -- start 2024-09-21T09:07:38.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.803+0000 7f0cdd653640 1 -- start start 2024-09-21T09:07:38.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.804+0000 7f0cdd653640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0cd812cca0 0x7f0cd812d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:07:38.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.804+0000 7f0cdd653640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cd812d5c0 con 0x7f0cd81290e0 2024-09-21T09:07:38.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.804+0000 7f0cdd653640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0cd806e350 con 0x7f0cd812cca0 2024-09-21T09:07:38.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.804+0000 7f0cd6ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0cd812cca0 0x7f0cd812d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:07:38.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.804+0000 7f0ccffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0cd81290e0 0x7f0cd8129530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52028/0 (socket says 172.21.15.44:52028) 2024-09-21T09:07:38.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.804+0000 7f0ccffff640 1 -- 172.21.15.44:0/2843674292 learned_addr learned my addr 172.21.15.44:0/2843674292 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:07:38.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.804+0000 7f0cd6ffd640 1 -- 172.21.15.44:0/2843674292 >> v1:172.21.15.44:6789/0 conn(0x7f0cd81290e0 legacy=0x7f0cd8129530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:38.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.804+0000 7f0cd6ffd640 1 -- 172.21.15.44:0/2843674292 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd8071f70 con 0x7f0cd812cca0 2024-09-21T09:07:38.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.804+0000 7f0cd67fc640 1 -- 172.21.15.44:0/2843674292 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472311382 0 0) 0x7f0cd812d5c0 con 0x7f0cd81290e0 2024-09-21T09:07:38.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.805+0000 7f0cd6ffd640 1 --2- 172.21.15.44:0/2843674292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd812cca0 0x7f0cd812d080 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009720 tx=0x7f0cc802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f99496e72e41db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:07:38.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.805+0000 7f0cd67fc640 1 -- 172.21.15.44:0/2843674292 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc8037070 con 0x7f0cd812cca0 2024-09-21T09:07:38.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.805+0000 7f0cd67fc640 1 -- 172.21.15.44:0/2843674292 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc802ad90 con 0x7f0cd812cca0 2024-09-21T09:07:38.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.805+0000 7f0cd67fc640 1 -- 172.21.15.44:0/2843674292 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc8032590 con 0x7f0cd812cca0 2024-09-21T09:07:38.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.806+0000 7f0cdd653640 1 -- 172.21.15.44:0/2843674292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd812cca0 msgr2=0x7f0cd812d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.806+0000 7f0cdd653640 1 --2- 172.21.15.44:0/2843674292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd812cca0 0x7f0cd812d080 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009720 tx=0x7f0cc802a110 comp rx=0 tx=0).stop 2024-09-21T09:07:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.806+0000 7f0cdd653640 1 -- 172.21.15.44:0/2843674292 shutdown_connections 2024-09-21T09:07:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.806+0000 7f0cdd653640 1 --2- 172.21.15.44:0/2843674292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd812cca0 0x7f0cd812d080 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:07:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.806+0000 7f0cdd653640 1 -- 172.21.15.44:0/2843674292 >> 172.21.15.44:0/2843674292 conn(0x7f0cd809a890 msgr2=0x7f0cd809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:07:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.806+0000 7f0cdd653640 1 -- 172.21.15.44:0/2843674292 shutdown_connections 2024-09-21T09:07:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.806+0000 7f0cdd653640 1 -- 172.21.15.44:0/2843674292 wait complete. 2024-09-21T09:07:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.806+0000 7f0cdd653640 1 Processor -- start 2024-09-21T09:07:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.807+0000 7f0cdd653640 1 -- start start 2024-09-21T09:07:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.807+0000 7f0cdd653640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd81290e0 0x7f0cd808afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:07:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.807+0000 7f0cdd653640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd8070e60 con 0x7f0cd81290e0 2024-09-21T09:07:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.807+0000 7f0cd6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd81290e0 0x7f0cd808afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:07:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.807+0000 7f0cd6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd81290e0 0x7f0cd808afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34008/0 (socket says 172.21.15.44:34008) 2024-09-21T09:07:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.807+0000 7f0cd6ffd640 1 -- 172.21.15.44:0/2770926428 learned_addr learned my addr 172.21.15.44:0/2770926428 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:07:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.807+0000 7f0cd6ffd640 1 -- 172.21.15.44:0/2770926428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd808c3f0 con 0x7f0cd81290e0 2024-09-21T09:07:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.807+0000 7f0cd6ffd640 1 --2- 172.21.15.44:0/2770926428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd81290e0 0x7f0cd808afc0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009840 tx=0x7f0cc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:07:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.808+0000 7f0ccf7fe640 1 -- 172.21.15.44:0/2770926428 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc8041070 con 0x7f0cd81290e0 2024-09-21T09:07:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.808+0000 7f0ccf7fe640 1 -- 172.21.15.44:0/2770926428 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc803c460 con 0x7f0cd81290e0 2024-09-21T09:07:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.808+0000 7f0ccf7fe640 1 -- 172.21.15.44:0/2770926428 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc8037040 con 0x7f0cd81290e0 2024-09-21T09:07:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.808+0000 7f0cdd653640 1 -- 172.21.15.44:0/2770926428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd81265a0 con 0x7f0cd81290e0 2024-09-21T09:07:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.808+0000 7f0cdd653640 1 -- 172.21.15.44:0/2770926428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd808d500 con 0x7f0cd81290e0 2024-09-21T09:07:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.808+0000 7f0ccf7fe640 1 -- 172.21.15.44:0/2770926428 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0cc8044070 con 0x7f0cd81290e0 2024-09-21T09:07:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.809+0000 7f0ccf7fe640 1 --2- 172.21.15.44:0/2770926428 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0cb80382a0 0x7f0cb803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:07:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.809+0000 7f0cdd653640 1 -- 172.21.15.44:0/2770926428 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd808e010 con 0x7f0cd81290e0 2024-09-21T09:07:38.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.809+0000 7f0ccf7fe640 1 -- 172.21.15.44:0/2770926428 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f0cc806c940 con 0x7f0cd81290e0 2024-09-21T09:07:38.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.809+0000 7f0ccffff640 1 --2- 172.21.15.44:0/2770926428 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0cb80382a0 0x7f0cb803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:07:38.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.810+0000 7f0ccffff640 1 --2- 172.21.15.44:0/2770926428 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0cb80382a0 0x7f0cb803a760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0000c00 tx=0x7f0cc0007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:07:38.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.814+0000 7f0ccf7fe640 1 -- 172.21.15.44:0/2770926428 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0cc8044e20 con 0x7f0cd81290e0 2024-09-21T09:07:38.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:38.986+0000 7f0cdd653640 1 -- 172.21.15.44:0/2770926428 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0cd808c870 con 0x7f0cb80382a0 2024-09-21T09:07:39.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:39.002+0000 7f0ccf7fe640 1 -- 172.21.15.44:0/2770926428 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665799 (secure 0 0 0) 0x7f0cd808c870 con 0x7f0cb80382a0 2024-09-21T09:07:39.011 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:07:39.017 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-21T09:07:39.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:39.007+0000 7f0cdd653640 1 -- 172.21.15.44:0/2770926428 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0cb80382a0 msgr2=0x7f0cb803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:39.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:39.007+0000 7f0cdd653640 1 --2- 172.21.15.44:0/2770926428 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0cb80382a0 0x7f0cb803a760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0000c00 tx=0x7f0cc0007a40 comp rx=0 tx=0).stop 2024-09-21T09:07:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:39.007+0000 7f0cdd653640 1 -- 172.21.15.44:0/2770926428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd81290e0 msgr2=0x7f0cd808afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:39.007+0000 7f0cdd653640 1 --2- 172.21.15.44:0/2770926428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd81290e0 0x7f0cd808afc0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009840 tx=0x7f0cc80046c0 comp rx=0 tx=0).stop 2024-09-21T09:07:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:39.007+0000 7f0cdd653640 1 -- 172.21.15.44:0/2770926428 shutdown_connections 2024-09-21T09:07:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:39.007+0000 7f0cdd653640 1 --2- 172.21.15.44:0/2770926428 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7f0cb80382a0 0x7f0cb803a760 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:07:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:39.007+0000 7f0cdd653640 1 --2- 172.21.15.44:0/2770926428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd81290e0 0x7f0cd808afc0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:07:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:39.007+0000 7f0cdd653640 1 -- 172.21.15.44:0/2770926428 >> 172.21.15.44:0/2770926428 conn(0x7f0cd809a890 msgr2=0x7f0cd8128980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:07:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:39.007+0000 7f0cdd653640 1 -- 172.21.15.44:0/2770926428 shutdown_connections 2024-09-21T09:07:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:39.007+0000 7f0cdd653640 1 -- 172.21.15.44:0/2770926428 wait complete. 2024-09-21T09:07:39.020 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-09-21T09:07:38.512569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5097,"num_read_kb":4682,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4789,"ondisk_log_size":4789,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":123360,"kb_used_data":2784,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377364000,"statfs":{"total":386547056640,"available":386420736000,"internally_reserved":0,"allocated":2850816,"data_stored":1716104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":123397911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003546"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:08.844076+0000","last_change":"2024-09-21T09:07:08.844101+0000","last_active":"2024-09-21T09:07:08.844076+0000","last_peered":"2024-09-21T09:07:08.844076+0000","last_clean":"2024-09-21T09:07:08.844076+0000","last_became_active":"2024-09-21T09:03:38.283357+0000","last_became_peered":"2024-09-21T09:03:38.283357+0000","last_unstale":"2024-09-21T09:07:08.844076+0000","last_undegraded":"2024-09-21T09:07:08.844076+0000","last_fullsized":"2024-09-21T09:07:08.844076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:08.843993+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:08.843993+0000","last_clean_scrub_stamp":"2024-09-21T09:07:08.843993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:08.569217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'20","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.326848+0000","last_change":"2024-09-21T09:06:41.326875+0000","last_active":"2024-09-21T09:06:41.326848+0000","last_peered":"2024-09-21T09:06:41.326848+0000","last_clean":"2024-09-21T09:06:41.326848+0000","last_became_active":"2024-09-21T09:03:00.226067+0000","last_became_peered":"2024-09-21T09:03:00.226067+0000","last_unstale":"2024-09-21T09:06:41.326848+0000","last_undegraded":"2024-09-21T09:06:41.326848+0000","last_fullsized":"2024-09-21T09:06:41.326848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-09-21T09:06:41.326750+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-09-21T09:06:41.326750+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.326750+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:11.322304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:53.042423+0000","last_change":"2024-09-21T09:06:53.042423+0000","last_active":"2024-09-21T09:06:53.042423+0000","last_peered":"2024-09-21T09:06:53.042423+0000","last_clean":"2024-09-21T09:06:53.042423+0000","last_became_active":"2024-09-21T09:02:58.212828+0000","last_became_peered":"2024-09-21T09:02:58.212828+0000","last_unstale":"2024-09-21T09:06:53.042423+0000","last_undegraded":"2024-09-21T09:06:53.042423+0000","last_fullsized":"2024-09-21T09:06:53.042423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:53.042305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:53.042305+0000","last_clean_scrub_stamp":"2024-09-21T09:06:53.042305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:10.826523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.265814+0000","last_change":"2024-09-21T09:06:30.265847+0000","last_active":"2024-09-21T09:06:30.265814+0000","last_peered":"2024-09-21T09:06:30.265814+0000","last_clean":"2024-09-21T09:06:30.265814+0000","last_became_active":"2024-09-21T09:03:00.222333+0000","last_became_peered":"2024-09-21T09:03:00.222333+0000","last_unstale":"2024-09-21T09:06:30.265814+0000","last_undegraded":"2024-09-21T09:06:30.265814+0000","last_fullsized":"2024-09-21T09:06:30.265814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:30.265727+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:30.265727+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.265727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:36.517568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:13.369349+0000","last_change":"2024-09-21T09:07:13.369370+0000","last_active":"2024-09-21T09:07:13.369349+0000","last_peered":"2024-09-21T09:07:13.369349+0000","last_clean":"2024-09-21T09:07:13.369349+0000","last_became_active":"2024-09-21T09:02:58.221214+0000","last_became_peered":"2024-09-21T09:02:58.221214+0000","last_unstale":"2024-09-21T09:07:13.369349+0000","last_undegraded":"2024-09-21T09:07:13.369349+0000","last_fullsized":"2024-09-21T09:07:13.369349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:13.369253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:13.369253+0000","last_clean_scrub_stamp":"2024-09-21T09:07:13.369253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:49.626494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.250533+0000","last_change":"2024-09-21T09:06:35.250559+0000","last_active":"2024-09-21T09:06:35.250533+0000","last_peered":"2024-09-21T09:06:35.250533+0000","last_clean":"2024-09-21T09:06:35.250533+0000","last_became_active":"2024-09-21T09:03:00.221451+0000","last_became_peered":"2024-09-21T09:03:00.221451+0000","last_unstale":"2024-09-21T09:06:35.250533+0000","last_undegraded":"2024-09-21T09:06:35.250533+0000","last_fullsized":"2024-09-21T09:06:35.250533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:35.250442+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:35.250442+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.250442+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:20.257549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.754424+0000","last_change":"2024-09-21T09:07:00.754467+0000","last_active":"2024-09-21T09:07:00.754424+0000","last_peered":"2024-09-21T09:07:00.754424+0000","last_clean":"2024-09-21T09:07:00.754424+0000","last_became_active":"2024-09-21T09:02:58.207683+0000","last_became_peered":"2024-09-21T09:02:58.207683+0000","last_unstale":"2024-09-21T09:07:00.754424+0000","last_undegraded":"2024-09-21T09:07:00.754424+0000","last_fullsized":"2024-09-21T09:07:00.754424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:00.754339+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:00.754339+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.754339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:18.538557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'10","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:04.189682+0000","last_change":"2024-09-21T09:07:04.189715+0000","last_active":"2024-09-21T09:07:04.189682+0000","last_peered":"2024-09-21T09:07:04.189682+0000","last_clean":"2024-09-21T09:07:04.189682+0000","last_became_active":"2024-09-21T09:03:00.210589+0000","last_became_peered":"2024-09-21T09:03:00.210589+0000","last_unstale":"2024-09-21T09:07:04.189682+0000","last_undegraded":"2024-09-21T09:07:04.189682+0000","last_fullsized":"2024-09-21T09:07:04.189682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:07:04.189564+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:07:04.189564+0000","last_clean_scrub_stamp":"2024-09-21T09:07:04.189564+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:36.569469+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:08.284884+0000","last_change":"2024-09-21T09:07:08.284930+0000","last_active":"2024-09-21T09:07:08.284884+0000","last_peered":"2024-09-21T09:07:08.284884+0000","last_clean":"2024-09-21T09:07:08.284884+0000","last_became_active":"2024-09-21T09:02:58.224630+0000","last_became_peered":"2024-09-21T09:02:58.224630+0000","last_unstale":"2024-09-21T09:07:08.284884+0000","last_undegraded":"2024-09-21T09:07:08.284884+0000","last_fullsized":"2024-09-21T09:07:08.284884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:08.284770+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:08.284770+0000","last_clean_scrub_stamp":"2024-09-21T09:07:08.284770+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:56.353696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'6","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:55.505244+0000","last_change":"2024-09-21T09:06:55.505244+0000","last_active":"2024-09-21T09:06:55.505244+0000","last_peered":"2024-09-21T09:06:55.505244+0000","last_clean":"2024-09-21T09:06:55.505244+0000","last_became_active":"2024-09-21T09:03:00.217048+0000","last_became_peered":"2024-09-21T09:03:00.217048+0000","last_unstale":"2024-09-21T09:06:55.505244+0000","last_undegraded":"2024-09-21T09:06:55.505244+0000","last_fullsized":"2024-09-21T09:06:55.505244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:55.505082+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:55.505082+0000","last_clean_scrub_stamp":"2024-09-21T09:06:55.505082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:44.261254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:56.842134+0000","last_change":"2024-09-21T09:06:56.842183+0000","last_active":"2024-09-21T09:06:56.842134+0000","last_peered":"2024-09-21T09:06:56.842134+0000","last_clean":"2024-09-21T09:06:56.842134+0000","last_became_active":"2024-09-21T09:02:58.205515+0000","last_became_peered":"2024-09-21T09:02:58.205515+0000","last_unstale":"2024-09-21T09:06:56.842134+0000","last_undegraded":"2024-09-21T09:06:56.842134+0000","last_fullsized":"2024-09-21T09:06:56.842134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:56.841999+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:56.841999+0000","last_clean_scrub_stamp":"2024-09-21T09:06:56.841999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:47.146653+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'14","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.235193+0000","last_change":"2024-09-21T09:06:32.235193+0000","last_active":"2024-09-21T09:06:32.235193+0000","last_peered":"2024-09-21T09:06:32.235193+0000","last_clean":"2024-09-21T09:06:32.235193+0000","last_became_active":"2024-09-21T09:03:00.221117+0000","last_became_peered":"2024-09-21T09:03:00.221117+0000","last_unstale":"2024-09-21T09:06:32.235193+0000","last_undegraded":"2024-09-21T09:06:32.235193+0000","last_fullsized":"2024-09-21T09:06:32.235193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:32.235081+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:32.235081+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.235081+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:09.067914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:33.466657+0000","last_change":"2024-09-21T09:07:33.466695+0000","last_active":"2024-09-21T09:07:33.466657+0000","last_peered":"2024-09-21T09:07:33.466657+0000","last_clean":"2024-09-21T09:07:33.466657+0000","last_became_active":"2024-09-21T09:02:58.210702+0000","last_became_peered":"2024-09-21T09:02:58.210702+0000","last_unstale":"2024-09-21T09:07:33.466657+0000","last_undegraded":"2024-09-21T09:07:33.466657+0000","last_fullsized":"2024-09-21T09:07:33.466657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:33.466551+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:33.466551+0000","last_clean_scrub_stamp":"2024-09-21T09:07:33.466551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:13.288063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.841450+0000","last_change":"2024-09-21T09:06:43.841450+0000","last_active":"2024-09-21T09:06:43.841450+0000","last_peered":"2024-09-21T09:06:43.841450+0000","last_clean":"2024-09-21T09:06:43.841450+0000","last_became_active":"2024-09-21T09:03:00.220725+0000","last_became_peered":"2024-09-21T09:03:00.220725+0000","last_unstale":"2024-09-21T09:06:43.841450+0000","last_undegraded":"2024-09-21T09:06:43.841450+0000","last_fullsized":"2024-09-21T09:06:43.841450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:43.841334+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:43.841334+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.841334+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:18.385562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.951181+0000","last_change":"2024-09-21T09:06:48.951210+0000","last_active":"2024-09-21T09:06:48.951181+0000","last_peered":"2024-09-21T09:06:48.951181+0000","last_clean":"2024-09-21T09:06:48.951181+0000","last_became_active":"2024-09-21T09:02:58.216712+0000","last_became_peered":"2024-09-21T09:02:58.216712+0000","last_unstale":"2024-09-21T09:06:48.951181+0000","last_undegraded":"2024-09-21T09:06:48.951181+0000","last_fullsized":"2024-09-21T09:06:48.951181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:48.951088+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:48.951088+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.951088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:39.255743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'14","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.817668+0000","last_change":"2024-09-21T09:06:45.817668+0000","last_active":"2024-09-21T09:06:45.817668+0000","last_peered":"2024-09-21T09:06:45.817668+0000","last_clean":"2024-09-21T09:06:45.817668+0000","last_became_active":"2024-09-21T09:03:00.222593+0000","last_became_peered":"2024-09-21T09:03:00.222593+0000","last_unstale":"2024-09-21T09:06:45.817668+0000","last_undegraded":"2024-09-21T09:06:45.817668+0000","last_fullsized":"2024-09-21T09:06:45.817668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:45.817550+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:45.817550+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.817550+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:37.374671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'12","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:54.260760+0000","last_change":"2024-09-21T09:06:54.260803+0000","last_active":"2024-09-21T09:06:54.260760+0000","last_peered":"2024-09-21T09:06:54.260760+0000","last_clean":"2024-09-21T09:06:54.260760+0000","last_became_active":"2024-09-21T09:03:00.219923+0000","last_became_peered":"2024-09-21T09:03:00.219923+0000","last_unstale":"2024-09-21T09:06:54.260760+0000","last_undegraded":"2024-09-21T09:06:54.260760+0000","last_fullsized":"2024-09-21T09:06:54.260760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:06:54.260650+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:06:54.260650+0000","last_clean_scrub_stamp":"2024-09-21T09:06:54.260650+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:57.689493+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:52.471683+0000","last_change":"2024-09-21T09:06:52.471725+0000","last_active":"2024-09-21T09:06:52.471683+0000","last_peered":"2024-09-21T09:06:52.471683+0000","last_clean":"2024-09-21T09:06:52.471683+0000","last_became_active":"2024-09-21T09:02:58.210936+0000","last_became_peered":"2024-09-21T09:02:58.210936+0000","last_unstale":"2024-09-21T09:06:52.471683+0000","last_undegraded":"2024-09-21T09:06:52.471683+0000","last_fullsized":"2024-09-21T09:06:52.471683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:52.471565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:52.471565+0000","last_clean_scrub_stamp":"2024-09-21T09:06:52.471565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:54.462085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:09.435009+0000","last_change":"2024-09-21T09:07:09.435075+0000","last_active":"2024-09-21T09:07:09.435009+0000","last_peered":"2024-09-21T09:07:09.435009+0000","last_clean":"2024-09-21T09:07:09.435009+0000","last_became_active":"2024-09-21T09:03:00.224695+0000","last_became_peered":"2024-09-21T09:03:00.224695+0000","last_unstale":"2024-09-21T09:07:09.435009+0000","last_undegraded":"2024-09-21T09:07:09.435009+0000","last_fullsized":"2024-09-21T09:07:09.435009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:07:09.434895+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:07:09.434895+0000","last_clean_scrub_stamp":"2024-09-21T09:07:09.434895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:52.485628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'4","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.798146+0000","last_change":"2024-09-21T09:06:48.798173+0000","last_active":"2024-09-21T09:06:48.798146+0000","last_peered":"2024-09-21T09:06:48.798146+0000","last_clean":"2024-09-21T09:06:48.798146+0000","last_became_active":"2024-09-21T09:02:58.218643+0000","last_became_peered":"2024-09-21T09:02:58.218643+0000","last_unstale":"2024-09-21T09:06:48.798146+0000","last_undegraded":"2024-09-21T09:06:48.798146+0000","last_fullsized":"2024-09-21T09:06:48.798146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:48.798053+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:48.798053+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.798053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:18.793607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.262860+0000","last_change":"2024-09-21T09:06:36.262904+0000","last_active":"2024-09-21T09:06:36.262860+0000","last_peered":"2024-09-21T09:06:36.262860+0000","last_clean":"2024-09-21T09:06:36.262860+0000","last_became_active":"2024-09-21T09:03:00.226738+0000","last_became_peered":"2024-09-21T09:03:00.226738+0000","last_unstale":"2024-09-21T09:06:36.262860+0000","last_undegraded":"2024-09-21T09:06:36.262860+0000","last_fullsized":"2024-09-21T09:06:36.262860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:36.262757+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:36.262757+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.262757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:35.824400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:08.479089+0000","last_change":"2024-09-21T09:07:08.479116+0000","last_active":"2024-09-21T09:07:08.479089+0000","last_peered":"2024-09-21T09:07:08.479089+0000","last_clean":"2024-09-21T09:07:08.479089+0000","last_became_active":"2024-09-21T09:02:58.208220+0000","last_became_peered":"2024-09-21T09:02:58.208220+0000","last_unstale":"2024-09-21T09:07:08.479089+0000","last_undegraded":"2024-09-21T09:07:08.479089+0000","last_fullsized":"2024-09-21T09:07:08.479089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:08.479000+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:08.479000+0000","last_clean_scrub_stamp":"2024-09-21T09:07:08.479000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:25.854120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'16","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.914907+0000","last_change":"2024-09-21T09:06:47.914935+0000","last_active":"2024-09-21T09:06:47.914907+0000","last_peered":"2024-09-21T09:06:47.914907+0000","last_clean":"2024-09-21T09:06:47.914907+0000","last_became_active":"2024-09-21T09:03:00.215637+0000","last_became_peered":"2024-09-21T09:03:00.215637+0000","last_unstale":"2024-09-21T09:06:47.914907+0000","last_undegraded":"2024-09-21T09:06:47.914907+0000","last_fullsized":"2024-09-21T09:06:47.914907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-21T09:06:47.914812+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-21T09:06:47.914812+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.914812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:54.745182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:04.512320+0000","last_change":"2024-09-21T09:07:04.512344+0000","last_active":"2024-09-21T09:07:04.512320+0000","last_peered":"2024-09-21T09:07:04.512320+0000","last_clean":"2024-09-21T09:07:04.512320+0000","last_became_active":"2024-09-21T09:02:58.204603+0000","last_became_peered":"2024-09-21T09:02:58.204603+0000","last_unstale":"2024-09-21T09:07:04.512320+0000","last_undegraded":"2024-09-21T09:07:04.512320+0000","last_fullsized":"2024-09-21T09:07:04.512320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:04.512202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:04.512202+0000","last_clean_scrub_stamp":"2024-09-21T09:07:04.512202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:45.250702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.848398+0000","last_change":"2024-09-21T09:06:49.848438+0000","last_active":"2024-09-21T09:06:49.848398+0000","last_peered":"2024-09-21T09:06:49.848398+0000","last_clean":"2024-09-21T09:06:49.848398+0000","last_became_active":"2024-09-21T09:03:00.222972+0000","last_became_peered":"2024-09-21T09:03:00.222972+0000","last_unstale":"2024-09-21T09:06:49.848398+0000","last_undegraded":"2024-09-21T09:06:49.848398+0000","last_fullsized":"2024-09-21T09:06:49.848398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:49.848287+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:49.848287+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.848287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:12.844393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:11.124033+0000","last_change":"2024-09-21T09:07:11.124071+0000","last_active":"2024-09-21T09:07:11.124033+0000","last_peered":"2024-09-21T09:07:11.124033+0000","last_clean":"2024-09-21T09:07:11.124033+0000","last_became_active":"2024-09-21T09:02:58.208383+0000","last_became_peered":"2024-09-21T09:02:58.208383+0000","last_unstale":"2024-09-21T09:07:11.124033+0000","last_undegraded":"2024-09-21T09:07:11.124033+0000","last_fullsized":"2024-09-21T09:07:11.124033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:11.123939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:11.123939+0000","last_clean_scrub_stamp":"2024-09-21T09:07:11.123939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:23.577108+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.392358+0000","last_change":"2024-09-21T09:06:48.392419+0000","last_active":"2024-09-21T09:06:48.392358+0000","last_peered":"2024-09-21T09:06:48.392358+0000","last_clean":"2024-09-21T09:06:48.392358+0000","last_became_active":"2024-09-21T09:03:00.211942+0000","last_became_peered":"2024-09-21T09:03:00.211942+0000","last_unstale":"2024-09-21T09:06:48.392358+0000","last_undegraded":"2024-09-21T09:06:48.392358+0000","last_fullsized":"2024-09-21T09:06:48.392358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:48.392256+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:48.392256+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.392256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:01:04.152702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:26.430080+0000","last_change":"2024-09-21T09:07:26.430080+0000","last_active":"2024-09-21T09:07:26.430080+0000","last_peered":"2024-09-21T09:07:26.430080+0000","last_clean":"2024-09-21T09:07:26.430080+0000","last_became_active":"2024-09-21T09:02:58.213548+0000","last_became_peered":"2024-09-21T09:02:58.213548+0000","last_unstale":"2024-09-21T09:07:26.430080+0000","last_undegraded":"2024-09-21T09:07:26.430080+0000","last_fullsized":"2024-09-21T09:07:26.430080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:26.429943+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:26.429943+0000","last_clean_scrub_stamp":"2024-09-21T09:07:26.429943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:07.034297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'36","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:11.465399+0000","last_change":"2024-09-21T09:07:11.465449+0000","last_active":"2024-09-21T09:07:11.465399+0000","last_peered":"2024-09-21T09:07:11.465399+0000","last_clean":"2024-09-21T09:07:11.465399+0000","last_became_active":"2024-09-21T09:03:08.262362+0000","last_became_peered":"2024-09-21T09:03:08.262362+0000","last_unstale":"2024-09-21T09:07:11.465399+0000","last_undegraded":"2024-09-21T09:07:11.465399+0000","last_fullsized":"2024-09-21T09:07:11.465399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-09-21T09:07:11.465296+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-09-21T09:07:11.465296+0000","last_clean_scrub_stamp":"2024-09-21T09:07:11.465296+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:36.187129+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:03.169410+0000","last_change":"2024-09-21T09:07:03.169432+0000","last_active":"2024-09-21T09:07:03.169410+0000","last_peered":"2024-09-21T09:07:03.169410+0000","last_clean":"2024-09-21T09:07:03.169410+0000","last_became_active":"2024-09-21T09:03:00.209346+0000","last_became_peered":"2024-09-21T09:03:00.209346+0000","last_unstale":"2024-09-21T09:07:03.169410+0000","last_undegraded":"2024-09-21T09:07:03.169410+0000","last_fullsized":"2024-09-21T09:07:03.169410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:03.169305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:03.169305+0000","last_clean_scrub_stamp":"2024-09-21T09:07:03.169305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:21.767291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:15.364429+0000","last_change":"2024-09-21T09:07:15.364429+0000","last_active":"2024-09-21T09:07:15.364429+0000","last_peered":"2024-09-21T09:07:15.364429+0000","last_clean":"2024-09-21T09:07:15.364429+0000","last_became_active":"2024-09-21T09:02:58.221187+0000","last_became_peered":"2024-09-21T09:02:58.221187+0000","last_unstale":"2024-09-21T09:07:15.364429+0000","last_undegraded":"2024-09-21T09:07:15.364429+0000","last_fullsized":"2024-09-21T09:07:15.364429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:07:15.364310+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:07:15.364310+0000","last_clean_scrub_stamp":"2024-09-21T09:07:15.364310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:03.418130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.340714+0000","last_change":"2024-09-21T09:06:20.340738+0000","last_active":"2024-09-21T09:06:20.340714+0000","last_peered":"2024-09-21T09:06:20.340714+0000","last_clean":"2024-09-21T09:06:20.340714+0000","last_became_active":"2024-09-21T09:03:02.220370+0000","last_became_peered":"2024-09-21T09:03:02.220370+0000","last_unstale":"2024-09-21T09:06:20.340714+0000","last_undegraded":"2024-09-21T09:06:20.340714+0000","last_fullsized":"2024-09-21T09:06:20.340714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:20.340586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:20.340586+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.340586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:30.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.319454+0000","last_change":"2024-09-21T09:06:44.319493+0000","last_active":"2024-09-21T09:06:44.319454+0000","last_peered":"2024-09-21T09:06:44.319454+0000","last_clean":"2024-09-21T09:06:44.319454+0000","last_became_active":"2024-09-21T09:03:04.242637+0000","last_became_peered":"2024-09-21T09:03:04.242637+0000","last_unstale":"2024-09-21T09:06:44.319454+0000","last_undegraded":"2024-09-21T09:06:44.319454+0000","last_fullsized":"2024-09-21T09:06:44.319454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-21T09:06:44.319357+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-21T09:06:44.319357+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.319357+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:39.099160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.513447+0000","last_change":"2024-09-21T09:06:16.513487+0000","last_active":"2024-09-21T09:06:16.513447+0000","last_peered":"2024-09-21T09:06:16.513447+0000","last_clean":"2024-09-21T09:06:16.513447+0000","last_became_active":"2024-09-21T09:03:06.247203+0000","last_became_peered":"2024-09-21T09:03:06.247203+0000","last_unstale":"2024-09-21T09:06:16.513447+0000","last_undegraded":"2024-09-21T09:06:16.513447+0000","last_fullsized":"2024-09-21T09:06:16.513447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.513331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.513331+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.513331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:05:45.010706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'10","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:12.457918+0000","last_change":"2024-09-21T09:07:12.457954+0000","last_active":"2024-09-21T09:07:12.457918+0000","last_peered":"2024-09-21T09:07:12.457918+0000","last_clean":"2024-09-21T09:07:12.457918+0000","last_became_active":"2024-09-21T09:03:08.262384+0000","last_became_peered":"2024-09-21T09:03:08.262384+0000","last_unstale":"2024-09-21T09:07:12.457918+0000","last_undegraded":"2024-09-21T09:07:12.457918+0000","last_fullsized":"2024-09-21T09:07:12.457918+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:07:12.457810+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:07:12.457810+0000","last_clean_scrub_stamp":"2024-09-21T09:07:12.457810+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:50.329341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:55.255201+0000","last_change":"2024-09-21T09:06:55.255257+0000","last_active":"2024-09-21T09:06:55.255201+0000","last_peered":"2024-09-21T09:06:55.255201+0000","last_clean":"2024-09-21T09:06:55.255201+0000","last_became_active":"2024-09-21T09:03:00.217658+0000","last_became_peered":"2024-09-21T09:03:00.217658+0000","last_unstale":"2024-09-21T09:06:55.255201+0000","last_undegraded":"2024-09-21T09:06:55.255201+0000","last_fullsized":"2024-09-21T09:06:55.255201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:55.255084+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:55.255084+0000","last_clean_scrub_stamp":"2024-09-21T09:06:55.255084+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:47.433471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:54.827969+0000","last_change":"2024-09-21T09:06:54.827969+0000","last_active":"2024-09-21T09:06:54.827969+0000","last_peered":"2024-09-21T09:06:54.827969+0000","last_clean":"2024-09-21T09:06:54.827969+0000","last_became_active":"2024-09-21T09:02:58.218086+0000","last_became_peered":"2024-09-21T09:02:58.218086+0000","last_unstale":"2024-09-21T09:06:54.827969+0000","last_undegraded":"2024-09-21T09:06:54.827969+0000","last_fullsized":"2024-09-21T09:06:54.827969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:54.827813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:54.827813+0000","last_clean_scrub_stamp":"2024-09-21T09:06:54.827813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:18.334744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.944198+0000","last_change":"2024-09-21T09:06:38.944223+0000","last_active":"2024-09-21T09:06:38.944198+0000","last_peered":"2024-09-21T09:06:38.944198+0000","last_clean":"2024-09-21T09:06:38.944198+0000","last_became_active":"2024-09-21T09:03:02.220557+0000","last_became_peered":"2024-09-21T09:03:02.220557+0000","last_unstale":"2024-09-21T09:06:38.944198+0000","last_undegraded":"2024-09-21T09:06:38.944198+0000","last_fullsized":"2024-09-21T09:06:38.944198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:38.944114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:38.944114+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.944114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:28.572358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'9","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.494942+0000","last_change":"2024-09-21T09:06:22.495014+0000","last_active":"2024-09-21T09:06:22.494942+0000","last_peered":"2024-09-21T09:06:22.494942+0000","last_clean":"2024-09-21T09:06:22.494942+0000","last_became_active":"2024-09-21T09:03:04.236037+0000","last_became_peered":"2024-09-21T09:03:04.236037+0000","last_unstale":"2024-09-21T09:06:22.494942+0000","last_undegraded":"2024-09-21T09:06:22.494942+0000","last_fullsized":"2024-09-21T09:06:22.494942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-21T09:06:22.494847+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-21T09:06:22.494847+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.494847+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:55.904900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.478799+0000","last_change":"2024-09-21T09:06:18.478831+0000","last_active":"2024-09-21T09:06:18.478799+0000","last_peered":"2024-09-21T09:06:18.478799+0000","last_clean":"2024-09-21T09:06:18.478799+0000","last_became_active":"2024-09-21T09:03:06.243901+0000","last_became_peered":"2024-09-21T09:03:06.243901+0000","last_unstale":"2024-09-21T09:06:18.478799+0000","last_undegraded":"2024-09-21T09:06:18.478799+0000","last_fullsized":"2024-09-21T09:06:18.478799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.478706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.478706+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.478706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:41.502223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:13.145708+0000","last_change":"2024-09-21T09:07:13.145749+0000","last_active":"2024-09-21T09:07:13.145708+0000","last_peered":"2024-09-21T09:07:13.145708+0000","last_clean":"2024-09-21T09:07:13.145708+0000","last_became_active":"2024-09-21T09:03:08.250029+0000","last_became_peered":"2024-09-21T09:03:08.250029+0000","last_unstale":"2024-09-21T09:07:13.145708+0000","last_undegraded":"2024-09-21T09:07:13.145708+0000","last_fullsized":"2024-09-21T09:07:13.145708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:07:13.145614+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:07:13.145614+0000","last_clean_scrub_stamp":"2024-09-21T09:07:13.145614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:02.268505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:58.242283+0000","last_change":"2024-09-21T09:06:58.242309+0000","last_active":"2024-09-21T09:06:58.242283+0000","last_peered":"2024-09-21T09:06:58.242283+0000","last_clean":"2024-09-21T09:06:58.242283+0000","last_became_active":"2024-09-21T09:03:00.217633+0000","last_became_peered":"2024-09-21T09:03:00.217633+0000","last_unstale":"2024-09-21T09:06:58.242283+0000","last_undegraded":"2024-09-21T09:06:58.242283+0000","last_fullsized":"2024-09-21T09:06:58.242283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:58.242199+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:58.242199+0000","last_clean_scrub_stamp":"2024-09-21T09:06:58.242199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:33.728371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:12.355953+0000","last_change":"2024-09-21T09:07:12.355953+0000","last_active":"2024-09-21T09:07:12.355953+0000","last_peered":"2024-09-21T09:07:12.355953+0000","last_clean":"2024-09-21T09:07:12.355953+0000","last_became_active":"2024-09-21T09:02:58.220133+0000","last_became_peered":"2024-09-21T09:02:58.220133+0000","last_unstale":"2024-09-21T09:07:12.355953+0000","last_undegraded":"2024-09-21T09:07:12.355953+0000","last_fullsized":"2024-09-21T09:07:12.355953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:12.355798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:12.355798+0000","last_clean_scrub_stamp":"2024-09-21T09:07:12.355798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:24.081357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.974441+0000","last_change":"2024-09-21T09:06:39.974481+0000","last_active":"2024-09-21T09:06:39.974441+0000","last_peered":"2024-09-21T09:06:39.974441+0000","last_clean":"2024-09-21T09:06:39.974441+0000","last_became_active":"2024-09-21T09:03:02.219457+0000","last_became_peered":"2024-09-21T09:03:02.219457+0000","last_unstale":"2024-09-21T09:06:39.974441+0000","last_undegraded":"2024-09-21T09:06:39.974441+0000","last_fullsized":"2024-09-21T09:06:39.974441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:39.974313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:39.974313+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.974313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:26.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.828407+0000","last_change":"2024-09-21T09:06:24.828475+0000","last_active":"2024-09-21T09:06:24.828407+0000","last_peered":"2024-09-21T09:06:24.828407+0000","last_clean":"2024-09-21T09:06:24.828407+0000","last_became_active":"2024-09-21T09:03:04.239187+0000","last_became_peered":"2024-09-21T09:03:04.239187+0000","last_unstale":"2024-09-21T09:06:24.828407+0000","last_undegraded":"2024-09-21T09:06:24.828407+0000","last_fullsized":"2024-09-21T09:06:24.828407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-21T09:06:24.828300+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-21T09:06:24.828300+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.828300+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:54.045825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'285","reported_seq":396,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.260343+0000","last_change":"2024-09-21T09:06:40.260368+0000","last_active":"2024-09-21T09:06:40.260343+0000","last_peered":"2024-09-21T09:06:40.260343+0000","last_clean":"2024-09-21T09:06:40.260343+0000","last_became_active":"2024-09-21T09:03:06.247441+0000","last_became_peered":"2024-09-21T09:03:06.247441+0000","last_unstale":"2024-09-21T09:06:40.260343+0000","last_undegraded":"2024-09-21T09:06:40.260343+0000","last_fullsized":"2024-09-21T09:06:40.260343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:40.260235+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:40.260235+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.260235+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:24.594105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.811807+0000","last_change":"2024-09-21T09:06:33.811859+0000","last_active":"2024-09-21T09:06:33.811807+0000","last_peered":"2024-09-21T09:06:33.811807+0000","last_clean":"2024-09-21T09:06:33.811807+0000","last_became_active":"2024-09-21T09:03:08.255274+0000","last_became_peered":"2024-09-21T09:03:08.255274+0000","last_unstale":"2024-09-21T09:06:33.811807+0000","last_undegraded":"2024-09-21T09:06:33.811807+0000","last_fullsized":"2024-09-21T09:06:33.811807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:33.811708+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:33.811708+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.811708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:39.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:54.060908+0000","last_change":"2024-09-21T09:06:54.060934+0000","last_active":"2024-09-21T09:06:54.060908+0000","last_peered":"2024-09-21T09:06:54.060908+0000","last_clean":"2024-09-21T09:06:54.060908+0000","last_became_active":"2024-09-21T09:03:00.216382+0000","last_became_peered":"2024-09-21T09:03:00.216382+0000","last_unstale":"2024-09-21T09:06:54.060908+0000","last_undegraded":"2024-09-21T09:06:54.060908+0000","last_fullsized":"2024-09-21T09:06:54.060908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:54.060813+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:54.060813+0000","last_clean_scrub_stamp":"2024-09-21T09:06:54.060813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:26.364312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:54.468529+0000","last_change":"2024-09-21T09:06:54.468529+0000","last_active":"2024-09-21T09:06:54.468529+0000","last_peered":"2024-09-21T09:06:54.468529+0000","last_clean":"2024-09-21T09:06:54.468529+0000","last_became_active":"2024-09-21T09:02:58.210560+0000","last_became_peered":"2024-09-21T09:02:58.210560+0000","last_unstale":"2024-09-21T09:06:54.468529+0000","last_undegraded":"2024-09-21T09:06:54.468529+0000","last_fullsized":"2024-09-21T09:06:54.468529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:54.468377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:54.468377+0000","last_clean_scrub_stamp":"2024-09-21T09:06:54.468377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:26.771876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.409747+0000","last_change":"2024-09-21T09:06:18.409771+0000","last_active":"2024-09-21T09:06:18.409747+0000","last_peered":"2024-09-21T09:06:18.409747+0000","last_clean":"2024-09-21T09:06:18.409747+0000","last_became_active":"2024-09-21T09:03:02.220551+0000","last_became_peered":"2024-09-21T09:03:02.220551+0000","last_unstale":"2024-09-21T09:06:18.409747+0000","last_undegraded":"2024-09-21T09:06:18.409747+0000","last_fullsized":"2024-09-21T09:06:18.409747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.409649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.409649+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.409649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:27:47.530462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.771634+0000","last_change":"2024-09-21T09:06:28.771672+0000","last_active":"2024-09-21T09:06:28.771634+0000","last_peered":"2024-09-21T09:06:28.771634+0000","last_clean":"2024-09-21T09:06:28.771634+0000","last_became_active":"2024-09-21T09:03:04.233848+0000","last_became_peered":"2024-09-21T09:03:04.233848+0000","last_unstale":"2024-09-21T09:06:28.771634+0000","last_undegraded":"2024-09-21T09:06:28.771634+0000","last_fullsized":"2024-09-21T09:06:28.771634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-21T09:06:28.771549+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-21T09:06:28.771549+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.771549+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:21.809857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'285","reported_seq":412,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.666749+0000","last_change":"2024-09-21T09:06:20.666787+0000","last_active":"2024-09-21T09:06:20.666749+0000","last_peered":"2024-09-21T09:06:20.666749+0000","last_clean":"2024-09-21T09:06:20.666749+0000","last_became_active":"2024-09-21T09:03:06.243576+0000","last_became_peered":"2024-09-21T09:03:06.243576+0000","last_unstale":"2024-09-21T09:06:20.666749+0000","last_undegraded":"2024-09-21T09:06:20.666749+0000","last_fullsized":"2024-09-21T09:06:20.666749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:20.666653+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:20.666653+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.666653+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:13.704961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:59.197284+0000","last_change":"2024-09-21T09:06:59.197284+0000","last_active":"2024-09-21T09:06:59.197284+0000","last_peered":"2024-09-21T09:06:59.197284+0000","last_clean":"2024-09-21T09:06:59.197284+0000","last_became_active":"2024-09-21T09:03:00.217545+0000","last_became_peered":"2024-09-21T09:03:00.217545+0000","last_unstale":"2024-09-21T09:06:59.197284+0000","last_undegraded":"2024-09-21T09:06:59.197284+0000","last_fullsized":"2024-09-21T09:06:59.197284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:06:59.197146+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:06:59.197146+0000","last_clean_scrub_stamp":"2024-09-21T09:06:59.197146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:23.728828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:01.715743+0000","last_change":"2024-09-21T09:07:01.715743+0000","last_active":"2024-09-21T09:07:01.715743+0000","last_peered":"2024-09-21T09:07:01.715743+0000","last_clean":"2024-09-21T09:07:01.715743+0000","last_became_active":"2024-09-21T09:02:58.209712+0000","last_became_peered":"2024-09-21T09:02:58.209712+0000","last_unstale":"2024-09-21T09:07:01.715743+0000","last_undegraded":"2024-09-21T09:07:01.715743+0000","last_fullsized":"2024-09-21T09:07:01.715743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:01.715634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:01.715634+0000","last_clean_scrub_stamp":"2024-09-21T09:07:01.715634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:34.019133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"31'2","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.322635+0000","last_change":"2024-09-21T09:06:32.322635+0000","last_active":"2024-09-21T09:06:32.322635+0000","last_peered":"2024-09-21T09:06:32.322635+0000","last_clean":"2024-09-21T09:06:32.322635+0000","last_became_active":"2024-09-21T09:03:02.220629+0000","last_became_peered":"2024-09-21T09:03:02.220629+0000","last_unstale":"2024-09-21T09:06:32.322635+0000","last_undegraded":"2024-09-21T09:06:32.322635+0000","last_fullsized":"2024-09-21T09:06:32.322635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:32.322492+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:32.322492+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.322492+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:05.196838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'51","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.776075+0000","last_change":"2024-09-21T09:06:30.776075+0000","last_active":"2024-09-21T09:06:30.776075+0000","last_peered":"2024-09-21T09:06:30.776075+0000","last_clean":"2024-09-21T09:06:30.776075+0000","last_became_active":"2024-09-21T09:03:04.232394+0000","last_became_peered":"2024-09-21T09:03:04.232394+0000","last_unstale":"2024-09-21T09:06:30.776075+0000","last_undegraded":"2024-09-21T09:06:30.776075+0000","last_fullsized":"2024-09-21T09:06:30.776075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2024-09-21T09:06:30.775947+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2024-09-21T09:06:30.775947+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.775947+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:12.569145+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.694322+0000","last_change":"2024-09-21T09:06:18.694322+0000","last_active":"2024-09-21T09:06:18.694322+0000","last_peered":"2024-09-21T09:06:18.694322+0000","last_clean":"2024-09-21T09:06:18.694322+0000","last_became_active":"2024-09-21T09:03:06.244259+0000","last_became_peered":"2024-09-21T09:03:06.244259+0000","last_unstale":"2024-09-21T09:06:18.694322+0000","last_undegraded":"2024-09-21T09:06:18.694322+0000","last_fullsized":"2024-09-21T09:06:18.694322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.694207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.694207+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.694207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:38.655887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'3","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:04.795472+0000","last_change":"2024-09-21T09:07:04.795472+0000","last_active":"2024-09-21T09:07:04.795472+0000","last_peered":"2024-09-21T09:07:04.795472+0000","last_clean":"2024-09-21T09:07:04.795472+0000","last_became_active":"2024-09-21T09:03:08.261035+0000","last_became_peered":"2024-09-21T09:03:08.261035+0000","last_unstale":"2024-09-21T09:07:04.795472+0000","last_undegraded":"2024-09-21T09:07:04.795472+0000","last_fullsized":"2024-09-21T09:07:04.795472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:07:04.795349+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:07:04.795349+0000","last_clean_scrub_stamp":"2024-09-21T09:07:04.795349+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:22.726619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.376033+0000","last_change":"2024-09-21T09:06:49.376033+0000","last_active":"2024-09-21T09:06:49.376033+0000","last_peered":"2024-09-21T09:06:49.376033+0000","last_clean":"2024-09-21T09:06:49.376033+0000","last_became_active":"2024-09-21T09:03:00.219765+0000","last_became_peered":"2024-09-21T09:03:00.219765+0000","last_unstale":"2024-09-21T09:06:49.376033+0000","last_undegraded":"2024-09-21T09:06:49.376033+0000","last_fullsized":"2024-09-21T09:06:49.376033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:06:49.375904+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:06:49.375904+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.375904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:39.680559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:02.723098+0000","last_change":"2024-09-21T09:07:02.723098+0000","last_active":"2024-09-21T09:07:02.723098+0000","last_peered":"2024-09-21T09:07:02.723098+0000","last_clean":"2024-09-21T09:07:02.723098+0000","last_became_active":"2024-09-21T09:02:58.214392+0000","last_became_peered":"2024-09-21T09:02:58.214392+0000","last_unstale":"2024-09-21T09:07:02.723098+0000","last_undegraded":"2024-09-21T09:07:02.723098+0000","last_fullsized":"2024-09-21T09:07:02.723098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:02.722972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:02.722972+0000","last_clean_scrub_stamp":"2024-09-21T09:07:02.722972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:02.907615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.778729+0000","last_change":"2024-09-21T09:06:31.778729+0000","last_active":"2024-09-21T09:06:31.778729+0000","last_peered":"2024-09-21T09:06:31.778729+0000","last_clean":"2024-09-21T09:06:31.778729+0000","last_became_active":"2024-09-21T09:03:02.223123+0000","last_became_peered":"2024-09-21T09:03:02.223123+0000","last_unstale":"2024-09-21T09:06:31.778729+0000","last_undegraded":"2024-09-21T09:06:31.778729+0000","last_fullsized":"2024-09-21T09:06:31.778729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:31.778616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:31.778616+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.778616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:58.139384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'38","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.295753+0000","last_change":"2024-09-21T09:06:47.295753+0000","last_active":"2024-09-21T09:06:47.295753+0000","last_peered":"2024-09-21T09:06:47.295753+0000","last_clean":"2024-09-21T09:06:47.295753+0000","last_became_active":"2024-09-21T09:03:04.242404+0000","last_became_peered":"2024-09-21T09:03:04.242404+0000","last_unstale":"2024-09-21T09:06:47.295753+0000","last_undegraded":"2024-09-21T09:06:47.295753+0000","last_fullsized":"2024-09-21T09:06:47.295753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2024-09-21T09:06:47.295625+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2024-09-21T09:06:47.295625+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.295625+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:04.223317+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.680884+0000","last_change":"2024-09-21T09:06:21.680884+0000","last_active":"2024-09-21T09:06:21.680884+0000","last_peered":"2024-09-21T09:06:21.680884+0000","last_clean":"2024-09-21T09:06:21.680884+0000","last_became_active":"2024-09-21T09:03:06.247504+0000","last_became_peered":"2024-09-21T09:03:06.247504+0000","last_unstale":"2024-09-21T09:06:21.680884+0000","last_undegraded":"2024-09-21T09:06:21.680884+0000","last_fullsized":"2024-09-21T09:06:21.680884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:21.680751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:21.680751+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.680751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:07.979811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'4","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.320208+0000","last_change":"2024-09-21T09:06:39.320208+0000","last_active":"2024-09-21T09:06:39.320208+0000","last_peered":"2024-09-21T09:06:39.320208+0000","last_clean":"2024-09-21T09:06:39.320208+0000","last_became_active":"2024-09-21T09:03:08.255814+0000","last_became_peered":"2024-09-21T09:03:08.255814+0000","last_unstale":"2024-09-21T09:06:39.320208+0000","last_undegraded":"2024-09-21T09:06:39.320208+0000","last_fullsized":"2024-09-21T09:06:39.320208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:39.320081+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:39.320081+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.320081+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:28.948326+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.796153+0000","last_change":"2024-09-21T09:06:47.796153+0000","last_active":"2024-09-21T09:06:47.796153+0000","last_peered":"2024-09-21T09:06:47.796153+0000","last_clean":"2024-09-21T09:06:47.796153+0000","last_became_active":"2024-09-21T09:03:00.222650+0000","last_became_peered":"2024-09-21T09:03:00.222650+0000","last_unstale":"2024-09-21T09:06:47.796153+0000","last_undegraded":"2024-09-21T09:06:47.796153+0000","last_fullsized":"2024-09-21T09:06:47.796153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:47.796026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:47.796026+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.796026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:34.626930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:34.466471+0000","last_change":"2024-09-21T09:07:34.466497+0000","last_active":"2024-09-21T09:07:34.466471+0000","last_peered":"2024-09-21T09:07:34.466471+0000","last_clean":"2024-09-21T09:07:34.466471+0000","last_became_active":"2024-09-21T09:02:58.213652+0000","last_became_peered":"2024-09-21T09:02:58.213652+0000","last_unstale":"2024-09-21T09:07:34.466471+0000","last_undegraded":"2024-09-21T09:07:34.466471+0000","last_fullsized":"2024-09-21T09:07:34.466471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:34.466357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:34.466357+0000","last_clean_scrub_stamp":"2024-09-21T09:07:34.466357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:53.522103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:07.798877+0000","last_change":"2024-09-21T09:07:07.798919+0000","last_active":"2024-09-21T09:07:07.798877+0000","last_peered":"2024-09-21T09:07:07.798877+0000","last_clean":"2024-09-21T09:07:07.798877+0000","last_became_active":"2024-09-21T09:03:38.281497+0000","last_became_peered":"2024-09-21T09:03:38.281497+0000","last_unstale":"2024-09-21T09:07:07.798877+0000","last_undegraded":"2024-09-21T09:07:07.798877+0000","last_fullsized":"2024-09-21T09:07:07.798877+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:07.798726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:07.798726+0000","last_clean_scrub_stamp":"2024-09-21T09:07:07.798726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:18.979784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"31'45","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.362435+0000","last_change":"2024-09-21T09:06:25.362435+0000","last_active":"2024-09-21T09:06:25.362435+0000","last_peered":"2024-09-21T09:06:25.362435+0000","last_clean":"2024-09-21T09:06:25.362435+0000","last_became_active":"2024-09-21T09:03:04.240144+0000","last_became_peered":"2024-09-21T09:03:04.240144+0000","last_unstale":"2024-09-21T09:06:25.362435+0000","last_undegraded":"2024-09-21T09:06:25.362435+0000","last_fullsized":"2024-09-21T09:06:25.362435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-09-21T09:06:25.362285+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-09-21T09:06:25.362285+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.362285+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:00.748484+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'285","reported_seq":360,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.980274+0000","last_change":"2024-09-21T09:06:41.980274+0000","last_active":"2024-09-21T09:06:41.980274+0000","last_peered":"2024-09-21T09:06:41.980274+0000","last_clean":"2024-09-21T09:06:41.980274+0000","last_became_active":"2024-09-21T09:03:06.250807+0000","last_became_peered":"2024-09-21T09:03:06.250807+0000","last_unstale":"2024-09-21T09:06:41.980274+0000","last_undegraded":"2024-09-21T09:06:41.980274+0000","last_fullsized":"2024-09-21T09:06:41.980274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:41.980137+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:41.980137+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.980137+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:04.976243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.924395+0000","last_change":"2024-09-21T09:06:45.924395+0000","last_active":"2024-09-21T09:06:45.924395+0000","last_peered":"2024-09-21T09:06:45.924395+0000","last_clean":"2024-09-21T09:06:45.924395+0000","last_became_active":"2024-09-21T09:03:08.250063+0000","last_became_peered":"2024-09-21T09:03:08.250063+0000","last_unstale":"2024-09-21T09:06:45.924395+0000","last_undegraded":"2024-09-21T09:06:45.924395+0000","last_fullsized":"2024-09-21T09:06:45.924395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:45.924274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:45.924274+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.924274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:08.933691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'14","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.881315+0000","last_change":"2024-09-21T09:06:40.881315+0000","last_active":"2024-09-21T09:06:40.881315+0000","last_peered":"2024-09-21T09:06:40.881315+0000","last_clean":"2024-09-21T09:06:40.881315+0000","last_became_active":"2024-09-21T09:03:00.216544+0000","last_became_peered":"2024-09-21T09:03:00.216544+0000","last_unstale":"2024-09-21T09:06:40.881315+0000","last_undegraded":"2024-09-21T09:06:40.881315+0000","last_fullsized":"2024-09-21T09:06:40.881315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:40.881198+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:40.881198+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.881198+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:32:13.994520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:07.234868+0000","last_change":"2024-09-21T09:07:07.234868+0000","last_active":"2024-09-21T09:07:07.234868+0000","last_peered":"2024-09-21T09:07:07.234868+0000","last_clean":"2024-09-21T09:07:07.234868+0000","last_became_active":"2024-09-21T09:02:58.224675+0000","last_became_peered":"2024-09-21T09:02:58.224675+0000","last_unstale":"2024-09-21T09:07:07.234868+0000","last_undegraded":"2024-09-21T09:07:07.234868+0000","last_fullsized":"2024-09-21T09:07:07.234868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:07.234741+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:07.234741+0000","last_clean_scrub_stamp":"2024-09-21T09:07:07.234741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:34.342082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.771529+0000","last_change":"2024-09-21T09:06:32.771529+0000","last_active":"2024-09-21T09:06:32.771529+0000","last_peered":"2024-09-21T09:06:32.771529+0000","last_clean":"2024-09-21T09:06:32.771529+0000","last_became_active":"2024-09-21T09:03:02.222904+0000","last_became_peered":"2024-09-21T09:03:02.222904+0000","last_unstale":"2024-09-21T09:06:32.771529+0000","last_undegraded":"2024-09-21T09:06:32.771529+0000","last_fullsized":"2024-09-21T09:06:32.771529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:32.771408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:32.771408+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.771408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:47.808559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'67","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:50.298082+0000","last_change":"2024-09-21T09:06:50.298082+0000","last_active":"2024-09-21T09:06:50.298082+0000","last_peered":"2024-09-21T09:06:50.298082+0000","last_clean":"2024-09-21T09:06:50.298082+0000","last_became_active":"2024-09-21T09:03:04.241679+0000","last_became_peered":"2024-09-21T09:03:04.241679+0000","last_unstale":"2024-09-21T09:06:50.298082+0000","last_undegraded":"2024-09-21T09:06:50.298082+0000","last_fullsized":"2024-09-21T09:06:50.298082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'67","last_scrub_stamp":"2024-09-21T09:06:50.297956+0000","last_deep_scrub":"31'67","last_deep_scrub_stamp":"2024-09-21T09:06:50.297956+0000","last_clean_scrub_stamp":"2024-09-21T09:06:50.297956+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:04.079875+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.788942+0000","last_change":"2024-09-21T09:06:33.788942+0000","last_active":"2024-09-21T09:06:33.788942+0000","last_peered":"2024-09-21T09:06:33.788942+0000","last_clean":"2024-09-21T09:06:33.788942+0000","last_became_active":"2024-09-21T09:03:06.249377+0000","last_became_peered":"2024-09-21T09:03:06.249377+0000","last_unstale":"2024-09-21T09:06:33.788942+0000","last_undegraded":"2024-09-21T09:06:33.788942+0000","last_fullsized":"2024-09-21T09:06:33.788942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:33.788739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:33.788739+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.788739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:57.255671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'25","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:19.185579+0000","last_change":"2024-09-21T09:07:19.185579+0000","last_active":"2024-09-21T09:07:19.185579+0000","last_peered":"2024-09-21T09:07:19.185579+0000","last_clean":"2024-09-21T09:07:19.185579+0000","last_became_active":"2024-09-21T09:03:08.260071+0000","last_became_peered":"2024-09-21T09:03:08.260071+0000","last_unstale":"2024-09-21T09:07:19.185579+0000","last_undegraded":"2024-09-21T09:07:19.185579+0000","last_fullsized":"2024-09-21T09:07:19.185579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2024-09-21T09:07:19.185408+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2024-09-21T09:07:19.185408+0000","last_clean_scrub_stamp":"2024-09-21T09:07:19.185408+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:15.285092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:53.474018+0000","last_change":"2024-09-21T09:06:53.474018+0000","last_active":"2024-09-21T09:06:53.474018+0000","last_peered":"2024-09-21T09:06:53.474018+0000","last_clean":"2024-09-21T09:06:53.474018+0000","last_became_active":"2024-09-21T09:03:00.223184+0000","last_became_peered":"2024-09-21T09:03:00.223184+0000","last_unstale":"2024-09-21T09:06:53.474018+0000","last_undegraded":"2024-09-21T09:06:53.474018+0000","last_fullsized":"2024-09-21T09:06:53.474018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:53.473903+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:53.473903+0000","last_clean_scrub_stamp":"2024-09-21T09:06:53.473903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:11.258122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.030713+0000","last_change":"2024-09-21T09:06:51.030713+0000","last_active":"2024-09-21T09:06:51.030713+0000","last_peered":"2024-09-21T09:06:51.030713+0000","last_clean":"2024-09-21T09:06:51.030713+0000","last_became_active":"2024-09-21T09:02:58.216545+0000","last_became_peered":"2024-09-21T09:02:58.216545+0000","last_unstale":"2024-09-21T09:06:51.030713+0000","last_undegraded":"2024-09-21T09:06:51.030713+0000","last_fullsized":"2024-09-21T09:06:51.030713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:51.030555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:51.030555+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.030555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.507576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.793708+0000","last_change":"2024-09-21T09:06:35.793708+0000","last_active":"2024-09-21T09:06:35.793708+0000","last_peered":"2024-09-21T09:06:35.793708+0000","last_clean":"2024-09-21T09:06:35.793708+0000","last_became_active":"2024-09-21T09:03:02.221352+0000","last_became_peered":"2024-09-21T09:03:02.221352+0000","last_unstale":"2024-09-21T09:06:35.793708+0000","last_undegraded":"2024-09-21T09:06:35.793708+0000","last_fullsized":"2024-09-21T09:06:35.793708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:35.793591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:35.793591+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.793591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:20:03.333500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'39","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.403421+0000","last_change":"2024-09-21T09:06:25.403421+0000","last_active":"2024-09-21T09:06:25.403421+0000","last_peered":"2024-09-21T09:06:25.403421+0000","last_clean":"2024-09-21T09:06:25.403421+0000","last_became_active":"2024-09-21T09:03:04.234750+0000","last_became_peered":"2024-09-21T09:03:04.234750+0000","last_unstale":"2024-09-21T09:06:25.403421+0000","last_undegraded":"2024-09-21T09:06:25.403421+0000","last_fullsized":"2024-09-21T09:06:25.403421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-21T09:06:25.403243+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-21T09:06:25.403243+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.403243+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:10.523882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.288220+0000","last_change":"2024-09-21T09:06:41.288220+0000","last_active":"2024-09-21T09:06:41.288220+0000","last_peered":"2024-09-21T09:06:41.288220+0000","last_clean":"2024-09-21T09:06:41.288220+0000","last_became_active":"2024-09-21T09:03:06.248453+0000","last_became_peered":"2024-09-21T09:03:06.248453+0000","last_unstale":"2024-09-21T09:06:41.288220+0000","last_undegraded":"2024-09-21T09:06:41.288220+0000","last_fullsized":"2024-09-21T09:06:41.288220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:41.288107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:41.288107+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.288107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:34:02.945842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:36.443760+0000","last_change":"2024-09-21T09:07:36.443790+0000","last_active":"2024-09-21T09:07:36.443760+0000","last_peered":"2024-09-21T09:07:36.443760+0000","last_clean":"2024-09-21T09:07:36.443760+0000","last_became_active":"2024-09-21T09:03:08.260016+0000","last_became_peered":"2024-09-21T09:03:08.260016+0000","last_unstale":"2024-09-21T09:07:36.443760+0000","last_undegraded":"2024-09-21T09:07:36.443760+0000","last_fullsized":"2024-09-21T09:07:36.443760+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:07:36.443671+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:07:36.443671+0000","last_clean_scrub_stamp":"2024-09-21T09:07:36.443671+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:10.078450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.275028+0000","last_change":"2024-09-21T09:06:34.275028+0000","last_active":"2024-09-21T09:06:34.275028+0000","last_peered":"2024-09-21T09:06:34.275028+0000","last_clean":"2024-09-21T09:06:34.275028+0000","last_became_active":"2024-09-21T09:03:00.220384+0000","last_became_peered":"2024-09-21T09:03:00.220384+0000","last_unstale":"2024-09-21T09:06:34.275028+0000","last_undegraded":"2024-09-21T09:06:34.275028+0000","last_fullsized":"2024-09-21T09:06:34.275028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:34.274878+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:34.274878+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.274878+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:09.374069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:22.395057+0000","last_change":"2024-09-21T09:07:22.395087+0000","last_active":"2024-09-21T09:07:22.395057+0000","last_peered":"2024-09-21T09:07:22.395057+0000","last_clean":"2024-09-21T09:07:22.395057+0000","last_became_active":"2024-09-21T09:02:58.213920+0000","last_became_peered":"2024-09-21T09:02:58.213920+0000","last_unstale":"2024-09-21T09:07:22.395057+0000","last_undegraded":"2024-09-21T09:07:22.395057+0000","last_fullsized":"2024-09-21T09:07:22.395057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:22.394962+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:22.394962+0000","last_clean_scrub_stamp":"2024-09-21T09:07:22.394962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:53.788547+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.986345+0000","last_change":"2024-09-21T09:06:40.986345+0000","last_active":"2024-09-21T09:06:40.986345+0000","last_peered":"2024-09-21T09:06:40.986345+0000","last_clean":"2024-09-21T09:06:40.986345+0000","last_became_active":"2024-09-21T09:03:02.217917+0000","last_became_peered":"2024-09-21T09:03:02.217917+0000","last_unstale":"2024-09-21T09:06:40.986345+0000","last_undegraded":"2024-09-21T09:06:40.986345+0000","last_fullsized":"2024-09-21T09:06:40.986345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:40.986232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:40.986232+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.986232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:10.981786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'46","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.798098+0000","last_change":"2024-09-21T09:06:26.798098+0000","last_active":"2024-09-21T09:06:26.798098+0000","last_peered":"2024-09-21T09:06:26.798098+0000","last_clean":"2024-09-21T09:06:26.798098+0000","last_became_active":"2024-09-21T09:03:04.235199+0000","last_became_peered":"2024-09-21T09:03:04.235199+0000","last_unstale":"2024-09-21T09:06:26.798098+0000","last_undegraded":"2024-09-21T09:06:26.798098+0000","last_fullsized":"2024-09-21T09:06:26.798098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-21T09:06:26.797980+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-21T09:06:26.797980+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.797980+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:46.759660+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'285","reported_seq":415,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.872473+0000","last_change":"2024-09-21T09:06:19.872473+0000","last_active":"2024-09-21T09:06:19.872473+0000","last_peered":"2024-09-21T09:06:19.872473+0000","last_clean":"2024-09-21T09:06:19.872473+0000","last_became_active":"2024-09-21T09:03:06.245904+0000","last_became_peered":"2024-09-21T09:03:06.245904+0000","last_unstale":"2024-09-21T09:06:19.872473+0000","last_undegraded":"2024-09-21T09:06:19.872473+0000","last_fullsized":"2024-09-21T09:06:19.872473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:19.872353+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:19.872353+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.872353+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:08.095534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'13","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:16.144340+0000","last_change":"2024-09-21T09:07:16.144340+0000","last_active":"2024-09-21T09:07:16.144340+0000","last_peered":"2024-09-21T09:07:16.144340+0000","last_clean":"2024-09-21T09:07:16.144340+0000","last_became_active":"2024-09-21T09:03:08.253648+0000","last_became_peered":"2024-09-21T09:03:08.253648+0000","last_unstale":"2024-09-21T09:07:16.144340+0000","last_undegraded":"2024-09-21T09:07:16.144340+0000","last_fullsized":"2024-09-21T09:07:16.144340+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-09-21T09:07:16.144218+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-09-21T09:07:16.144218+0000","last_clean_scrub_stamp":"2024-09-21T09:07:16.144218+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:32.982703+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'6","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.912356+0000","last_change":"2024-09-21T09:06:51.912356+0000","last_active":"2024-09-21T09:06:51.912356+0000","last_peered":"2024-09-21T09:06:51.912356+0000","last_clean":"2024-09-21T09:06:51.912356+0000","last_became_active":"2024-09-21T09:03:00.222983+0000","last_became_peered":"2024-09-21T09:03:00.222983+0000","last_unstale":"2024-09-21T09:06:51.912356+0000","last_undegraded":"2024-09-21T09:06:51.912356+0000","last_fullsized":"2024-09-21T09:06:51.912356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:51.912243+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:51.912243+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.912243+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:02.222694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:21.387746+0000","last_change":"2024-09-21T09:07:21.387771+0000","last_active":"2024-09-21T09:07:21.387746+0000","last_peered":"2024-09-21T09:07:21.387746+0000","last_clean":"2024-09-21T09:07:21.387746+0000","last_became_active":"2024-09-21T09:02:58.221805+0000","last_became_peered":"2024-09-21T09:02:58.221805+0000","last_unstale":"2024-09-21T09:07:21.387746+0000","last_undegraded":"2024-09-21T09:07:21.387746+0000","last_fullsized":"2024-09-21T09:07:21.387746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:21.387630+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:21.387630+0000","last_clean_scrub_stamp":"2024-09-21T09:07:21.387630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:04.776923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'5","reported_seq":429,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.332947+0000","last_change":"2024-09-21T09:06:29.332947+0000","last_active":"2024-09-21T09:06:29.332947+0000","last_peered":"2024-09-21T09:06:29.332947+0000","last_clean":"2024-09-21T09:06:29.332947+0000","last_became_active":"2024-09-21T09:03:02.222002+0000","last_became_peered":"2024-09-21T09:03:02.222002+0000","last_unstale":"2024-09-21T09:06:29.332947+0000","last_undegraded":"2024-09-21T09:06:29.332947+0000","last_fullsized":"2024-09-21T09:06:29.332947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-21T09:06:29.332773+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-21T09:06:29.332773+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.332773+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:09.966077+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.284654+0000","last_change":"2024-09-21T09:06:46.284654+0000","last_active":"2024-09-21T09:06:46.284654+0000","last_peered":"2024-09-21T09:06:46.284654+0000","last_clean":"2024-09-21T09:06:46.284654+0000","last_became_active":"2024-09-21T09:03:04.242702+0000","last_became_peered":"2024-09-21T09:03:04.242702+0000","last_unstale":"2024-09-21T09:06:46.284654+0000","last_undegraded":"2024-09-21T09:06:46.284654+0000","last_fullsized":"2024-09-21T09:06:46.284654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-21T09:06:46.284518+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-21T09:06:46.284518+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.284518+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:13.659340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'285","reported_seq":477,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.472499+0000","last_change":"2024-09-21T09:06:23.472499+0000","last_active":"2024-09-21T09:06:23.472499+0000","last_peered":"2024-09-21T09:06:23.472499+0000","last_clean":"2024-09-21T09:06:23.472499+0000","last_became_active":"2024-09-21T09:03:06.248991+0000","last_became_peered":"2024-09-21T09:03:06.248991+0000","last_unstale":"2024-09-21T09:06:23.472499+0000","last_undegraded":"2024-09-21T09:06:23.472499+0000","last_fullsized":"2024-09-21T09:06:23.472499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:23.472342+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:23.472342+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.472342+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:12:45.159682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.737148+0000","last_change":"2024-09-21T09:06:29.737148+0000","last_active":"2024-09-21T09:06:29.737148+0000","last_peered":"2024-09-21T09:06:29.737148+0000","last_clean":"2024-09-21T09:06:29.737148+0000","last_became_active":"2024-09-21T09:03:08.252549+0000","last_became_peered":"2024-09-21T09:03:08.252549+0000","last_unstale":"2024-09-21T09:06:29.737148+0000","last_undegraded":"2024-09-21T09:06:29.737148+0000","last_fullsized":"2024-09-21T09:06:29.737148+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:29.737036+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:29.737036+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.737036+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:16.036097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:57.545294+0000","last_change":"2024-09-21T09:06:57.545294+0000","last_active":"2024-09-21T09:06:57.545294+0000","last_peered":"2024-09-21T09:06:57.545294+0000","last_clean":"2024-09-21T09:06:57.545294+0000","last_became_active":"2024-09-21T09:03:00.223719+0000","last_became_peered":"2024-09-21T09:03:00.223719+0000","last_unstale":"2024-09-21T09:06:57.545294+0000","last_undegraded":"2024-09-21T09:06:57.545294+0000","last_fullsized":"2024-09-21T09:06:57.545294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:57.545132+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:57.545132+0000","last_clean_scrub_stamp":"2024-09-21T09:06:57.545132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:15.476402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:24.380207+0000","last_change":"2024-09-21T09:07:24.380246+0000","last_active":"2024-09-21T09:07:24.380207+0000","last_peered":"2024-09-21T09:07:24.380207+0000","last_clean":"2024-09-21T09:07:24.380207+0000","last_became_active":"2024-09-21T09:02:58.214074+0000","last_became_peered":"2024-09-21T09:02:58.214074+0000","last_unstale":"2024-09-21T09:07:24.380207+0000","last_undegraded":"2024-09-21T09:07:24.380207+0000","last_fullsized":"2024-09-21T09:07:24.380207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:24.380089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:24.380089+0000","last_clean_scrub_stamp":"2024-09-21T09:07:24.380089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.330523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.434407+0000","last_change":"2024-09-21T09:06:17.434407+0000","last_active":"2024-09-21T09:06:17.434407+0000","last_peered":"2024-09-21T09:06:17.434407+0000","last_clean":"2024-09-21T09:06:17.434407+0000","last_became_active":"2024-09-21T09:03:02.222095+0000","last_became_peered":"2024-09-21T09:03:02.222095+0000","last_unstale":"2024-09-21T09:06:17.434407+0000","last_undegraded":"2024-09-21T09:06:17.434407+0000","last_fullsized":"2024-09-21T09:06:17.434407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.434249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.434249+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.434249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:39.005942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'48","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.432715+0000","last_change":"2024-09-21T09:06:24.432715+0000","last_active":"2024-09-21T09:06:24.432715+0000","last_peered":"2024-09-21T09:06:24.432715+0000","last_clean":"2024-09-21T09:06:24.432715+0000","last_became_active":"2024-09-21T09:03:04.235633+0000","last_became_peered":"2024-09-21T09:03:04.235633+0000","last_unstale":"2024-09-21T09:06:24.432715+0000","last_undegraded":"2024-09-21T09:06:24.432715+0000","last_fullsized":"2024-09-21T09:06:24.432715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-09-21T09:06:24.432601+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-09-21T09:06:24.432601+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.432601+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:09.424036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.767379+0000","last_change":"2024-09-21T09:06:16.767379+0000","last_active":"2024-09-21T09:06:16.767379+0000","last_peered":"2024-09-21T09:06:16.767379+0000","last_clean":"2024-09-21T09:06:16.767379+0000","last_became_active":"2024-09-21T09:03:06.247977+0000","last_became_peered":"2024-09-21T09:03:06.247977+0000","last_unstale":"2024-09-21T09:06:16.767379+0000","last_undegraded":"2024-09-21T09:06:16.767379+0000","last_fullsized":"2024-09-21T09:06:16.767379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.767232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.767232+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.767232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:11.816433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.332932+0000","last_change":"2024-09-21T09:06:31.332932+0000","last_active":"2024-09-21T09:06:31.332932+0000","last_peered":"2024-09-21T09:06:31.332932+0000","last_clean":"2024-09-21T09:06:31.332932+0000","last_became_active":"2024-09-21T09:03:08.251985+0000","last_became_peered":"2024-09-21T09:03:08.251985+0000","last_unstale":"2024-09-21T09:06:31.332932+0000","last_undegraded":"2024-09-21T09:06:31.332932+0000","last_fullsized":"2024-09-21T09:06:31.332932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:31.332791+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:31.332791+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.332791+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:00.603145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.238589+0000","last_change":"2024-09-21T09:06:36.238589+0000","last_active":"2024-09-21T09:06:36.238589+0000","last_peered":"2024-09-21T09:06:36.238589+0000","last_clean":"2024-09-21T09:06:36.238589+0000","last_became_active":"2024-09-21T09:03:00.219428+0000","last_became_peered":"2024-09-21T09:03:00.219428+0000","last_unstale":"2024-09-21T09:06:36.238589+0000","last_undegraded":"2024-09-21T09:06:36.238589+0000","last_fullsized":"2024-09-21T09:06:36.238589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:36.238465+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:36.238465+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.238465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:33.483804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":213,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:01.553491+0000","last_change":"2024-09-21T09:07:01.553525+0000","last_active":"2024-09-21T09:07:01.553491+0000","last_peered":"2024-09-21T09:07:01.553491+0000","last_clean":"2024-09-21T09:07:01.553491+0000","last_became_active":"2024-09-21T09:02:44.107052+0000","last_became_peered":"2024-09-21T09:02:44.107052+0000","last_unstale":"2024-09-21T09:07:01.553491+0000","last_undegraded":"2024-09-21T09:07:01.553491+0000","last_fullsized":"2024-09-21T09:07:01.553491+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2024-09-21T09:07:01.553404+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2024-09-21T09:07:01.553404+0000","last_clean_scrub_stamp":"2024-09-21T09:07:01.553404+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:01.278628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"31'2","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:27.421322+0000","last_change":"2024-09-21T09:07:27.421350+0000","last_active":"2024-09-21T09:07:27.421322+0000","last_peered":"2024-09-21T09:07:27.421322+0000","last_clean":"2024-09-21T09:07:27.421322+0000","last_became_active":"2024-09-21T09:02:49.492504+0000","last_became_peered":"2024-09-21T09:02:49.492504+0000","last_unstale":"2024-09-21T09:07:27.421322+0000","last_undegraded":"2024-09-21T09:07:27.421322+0000","last_fullsized":"2024-09-21T09:07:27.421322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:27.421234+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:27.421234+0000","last_clean_scrub_stamp":"2024-09-21T09:07:27.421234+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:18.569943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001229291,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:19.376143+0000","last_change":"2024-09-21T09:07:19.376167+0000","last_active":"2024-09-21T09:07:19.376143+0000","last_peered":"2024-09-21T09:07:19.376143+0000","last_clean":"2024-09-21T09:07:19.376143+0000","last_became_active":"2024-09-21T09:02:58.221874+0000","last_became_peered":"2024-09-21T09:02:58.221874+0000","last_unstale":"2024-09-21T09:07:19.376143+0000","last_undegraded":"2024-09-21T09:07:19.376143+0000","last_fullsized":"2024-09-21T09:07:19.376143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:19.376050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:19.376050+0000","last_clean_scrub_stamp":"2024-09-21T09:07:19.376050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:47.489258+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:14.434324+0000","last_change":"2024-09-21T09:07:14.434346+0000","last_active":"2024-09-21T09:07:14.434324+0000","last_peered":"2024-09-21T09:07:14.434324+0000","last_clean":"2024-09-21T09:07:14.434324+0000","last_became_active":"2024-09-21T09:03:38.279694+0000","last_became_peered":"2024-09-21T09:03:38.279694+0000","last_unstale":"2024-09-21T09:07:14.434324+0000","last_undegraded":"2024-09-21T09:07:14.434324+0000","last_fullsized":"2024-09-21T09:07:14.434324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:14.434234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:14.434234+0000","last_clean_scrub_stamp":"2024-09-21T09:07:14.434234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:33.489032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'87","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.362531+0000","last_change":"2024-09-21T09:06:23.362531+0000","last_active":"2024-09-21T09:06:23.362531+0000","last_peered":"2024-09-21T09:06:23.362531+0000","last_clean":"2024-09-21T09:06:23.362531+0000","last_became_active":"2024-09-21T09:03:04.240327+0000","last_became_peered":"2024-09-21T09:03:04.240327+0000","last_unstale":"2024-09-21T09:06:23.362531+0000","last_undegraded":"2024-09-21T09:06:23.362531+0000","last_fullsized":"2024-09-21T09:06:23.362531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2024-09-21T09:06:23.362409+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2024-09-21T09:06:23.362409+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.362409+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:12.872538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.754043+0000","last_change":"2024-09-21T09:06:16.754043+0000","last_active":"2024-09-21T09:06:16.754043+0000","last_peered":"2024-09-21T09:06:16.754043+0000","last_clean":"2024-09-21T09:06:16.754043+0000","last_became_active":"2024-09-21T09:03:06.247593+0000","last_became_peered":"2024-09-21T09:03:06.247593+0000","last_unstale":"2024-09-21T09:06:16.754043+0000","last_undegraded":"2024-09-21T09:06:16.754043+0000","last_fullsized":"2024-09-21T09:06:16.754043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.753939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.753939+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.753939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:45.971463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'83","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.853332+0000","last_change":"2024-09-21T09:06:21.853332+0000","last_active":"2024-09-21T09:06:21.853332+0000","last_peered":"2024-09-21T09:06:21.853332+0000","last_clean":"2024-09-21T09:06:21.853332+0000","last_became_active":"2024-09-21T09:03:08.251416+0000","last_became_peered":"2024-09-21T09:03:08.251416+0000","last_unstale":"2024-09-21T09:06:21.853332+0000","last_undegraded":"2024-09-21T09:06:21.853332+0000","last_fullsized":"2024-09-21T09:06:21.853332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'83","last_scrub_stamp":"2024-09-21T09:06:21.853181+0000","last_deep_scrub":"31'83","last_deep_scrub_stamp":"2024-09-21T09:06:21.853181+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.853181+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:35.867187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.206620+0000","last_change":"2024-09-21T09:07:00.206620+0000","last_active":"2024-09-21T09:07:00.206620+0000","last_peered":"2024-09-21T09:07:00.206620+0000","last_clean":"2024-09-21T09:07:00.206620+0000","last_became_active":"2024-09-21T09:03:00.217018+0000","last_became_peered":"2024-09-21T09:03:00.217018+0000","last_unstale":"2024-09-21T09:07:00.206620+0000","last_undegraded":"2024-09-21T09:07:00.206620+0000","last_fullsized":"2024-09-21T09:07:00.206620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:00.206503+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:00.206503+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.206503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:29.029602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:28.418688+0000","last_change":"2024-09-21T09:07:28.418712+0000","last_active":"2024-09-21T09:07:28.418688+0000","last_peered":"2024-09-21T09:07:28.418688+0000","last_clean":"2024-09-21T09:07:28.418688+0000","last_became_active":"2024-09-21T09:02:49.493239+0000","last_became_peered":"2024-09-21T09:02:49.493239+0000","last_unstale":"2024-09-21T09:07:28.418688+0000","last_undegraded":"2024-09-21T09:07:28.418688+0000","last_fullsized":"2024-09-21T09:07:28.418688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:28.418561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:28.418561+0000","last_clean_scrub_stamp":"2024-09-21T09:07:28.418561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:37.283866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046437600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:59.048229+0000","last_change":"2024-09-21T09:06:59.048229+0000","last_active":"2024-09-21T09:06:59.048229+0000","last_peered":"2024-09-21T09:06:59.048229+0000","last_clean":"2024-09-21T09:06:59.048229+0000","last_became_active":"2024-09-21T09:02:58.208819+0000","last_became_peered":"2024-09-21T09:02:58.208819+0000","last_unstale":"2024-09-21T09:06:59.048229+0000","last_undegraded":"2024-09-21T09:06:59.048229+0000","last_fullsized":"2024-09-21T09:06:59.048229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:59.048112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:59.048112+0000","last_clean_scrub_stamp":"2024-09-21T09:06:59.048112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:54.468723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.385992+0000","last_change":"2024-09-21T09:06:19.385992+0000","last_active":"2024-09-21T09:06:19.385992+0000","last_peered":"2024-09-21T09:06:19.385992+0000","last_clean":"2024-09-21T09:06:19.385992+0000","last_became_active":"2024-09-21T09:03:02.220903+0000","last_became_peered":"2024-09-21T09:03:02.220903+0000","last_unstale":"2024-09-21T09:06:19.385992+0000","last_undegraded":"2024-09-21T09:06:19.385992+0000","last_fullsized":"2024-09-21T09:06:19.385992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.385871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.385871+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.385871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:53.002346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'290","reported_seq":515,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.477160+0000","last_change":"2024-09-21T09:06:21.477160+0000","last_active":"2024-09-21T09:06:21.477160+0000","last_peered":"2024-09-21T09:06:21.477160+0000","last_clean":"2024-09-21T09:06:21.477160+0000","last_became_active":"2024-09-21T09:03:04.240433+0000","last_became_peered":"2024-09-21T09:03:04.240433+0000","last_unstale":"2024-09-21T09:06:21.477160+0000","last_undegraded":"2024-09-21T09:06:21.477160+0000","last_fullsized":"2024-09-21T09:06:21.477160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'290","last_scrub_stamp":"2024-09-21T09:06:21.477013+0000","last_deep_scrub":"31'290","last_deep_scrub_stamp":"2024-09-21T09:06:21.477013+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.477013+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:50.761111+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.283613+0000","last_change":"2024-09-21T09:06:39.283613+0000","last_active":"2024-09-21T09:06:39.283613+0000","last_peered":"2024-09-21T09:06:39.283613+0000","last_clean":"2024-09-21T09:06:39.283613+0000","last_became_active":"2024-09-21T09:03:06.247746+0000","last_became_peered":"2024-09-21T09:03:06.247746+0000","last_unstale":"2024-09-21T09:06:39.283613+0000","last_undegraded":"2024-09-21T09:06:39.283613+0000","last_fullsized":"2024-09-21T09:06:39.283613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:39.283500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:39.283500+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.283500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:45.304746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.321611+0000","last_change":"2024-09-21T09:06:43.321611+0000","last_active":"2024-09-21T09:06:43.321611+0000","last_peered":"2024-09-21T09:06:43.321611+0000","last_clean":"2024-09-21T09:06:43.321611+0000","last_became_active":"2024-09-21T09:03:08.258104+0000","last_became_peered":"2024-09-21T09:03:08.258104+0000","last_unstale":"2024-09-21T09:06:43.321611+0000","last_undegraded":"2024-09-21T09:06:43.321611+0000","last_fullsized":"2024-09-21T09:06:43.321611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-21T09:06:43.321436+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-21T09:06:43.321436+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.321436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:24.838301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.944005+0000","last_change":"2024-09-21T09:06:42.944005+0000","last_active":"2024-09-21T09:06:42.944005+0000","last_peered":"2024-09-21T09:06:42.944005+0000","last_clean":"2024-09-21T09:06:42.944005+0000","last_became_active":"2024-09-21T09:03:00.227191+0000","last_became_peered":"2024-09-21T09:03:00.227191+0000","last_unstale":"2024-09-21T09:06:42.944005+0000","last_undegraded":"2024-09-21T09:06:42.944005+0000","last_fullsized":"2024-09-21T09:06:42.944005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:06:42.943855+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:06:42.943855+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.943855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:23.983932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:55.810947+0000","last_change":"2024-09-21T09:06:55.810947+0000","last_active":"2024-09-21T09:06:55.810947+0000","last_peered":"2024-09-21T09:06:55.810947+0000","last_clean":"2024-09-21T09:06:55.810947+0000","last_became_active":"2024-09-21T09:02:49.493605+0000","last_became_peered":"2024-09-21T09:02:49.493605+0000","last_unstale":"2024-09-21T09:06:55.810947+0000","last_undegraded":"2024-09-21T09:06:55.810947+0000","last_fullsized":"2024-09-21T09:06:55.810947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:55.810813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:55.810813+0000","last_clean_scrub_stamp":"2024-09-21T09:06:55.810813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:02.641183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033020199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:57.111509+0000","last_change":"2024-09-21T09:06:57.111509+0000","last_active":"2024-09-21T09:06:57.111509+0000","last_peered":"2024-09-21T09:06:57.111509+0000","last_clean":"2024-09-21T09:06:57.111509+0000","last_became_active":"2024-09-21T09:02:58.209343+0000","last_became_peered":"2024-09-21T09:02:58.209343+0000","last_unstale":"2024-09-21T09:06:57.111509+0000","last_undegraded":"2024-09-21T09:06:57.111509+0000","last_fullsized":"2024-09-21T09:06:57.111509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:57.111398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:57.111398+0000","last_clean_scrub_stamp":"2024-09-21T09:06:57.111398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:15.042668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:03.754564+0000","last_change":"2024-09-21T09:07:03.754564+0000","last_active":"2024-09-21T09:07:03.754564+0000","last_peered":"2024-09-21T09:07:03.754564+0000","last_clean":"2024-09-21T09:07:03.754564+0000","last_became_active":"2024-09-21T09:03:02.219067+0000","last_became_peered":"2024-09-21T09:03:02.219067+0000","last_unstale":"2024-09-21T09:07:03.754564+0000","last_undegraded":"2024-09-21T09:07:03.754564+0000","last_fullsized":"2024-09-21T09:07:03.754564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:03.754443+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:03.754443+0000","last_clean_scrub_stamp":"2024-09-21T09:07:03.754443+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:55.306780+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'24","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.772608+0000","last_change":"2024-09-21T09:06:32.772608+0000","last_active":"2024-09-21T09:06:32.772608+0000","last_peered":"2024-09-21T09:06:32.772608+0000","last_clean":"2024-09-21T09:06:32.772608+0000","last_became_active":"2024-09-21T09:03:04.230686+0000","last_became_peered":"2024-09-21T09:03:04.230686+0000","last_unstale":"2024-09-21T09:06:32.772608+0000","last_undegraded":"2024-09-21T09:06:32.772608+0000","last_fullsized":"2024-09-21T09:06:32.772608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-09-21T09:06:32.772444+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-09-21T09:06:32.772444+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.772444+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:42.682945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.712994+0000","last_change":"2024-09-21T09:06:25.712994+0000","last_active":"2024-09-21T09:06:25.712994+0000","last_peered":"2024-09-21T09:06:25.712994+0000","last_clean":"2024-09-21T09:06:25.712994+0000","last_became_active":"2024-09-21T09:03:06.248087+0000","last_became_peered":"2024-09-21T09:03:06.248087+0000","last_unstale":"2024-09-21T09:06:25.712994+0000","last_undegraded":"2024-09-21T09:06:25.712994+0000","last_fullsized":"2024-09-21T09:06:25.712994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:25.712851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:25.712851+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.712851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:31.193094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:01.207912+0000","last_change":"2024-09-21T09:07:01.207912+0000","last_active":"2024-09-21T09:07:01.207912+0000","last_peered":"2024-09-21T09:07:01.207912+0000","last_clean":"2024-09-21T09:07:01.207912+0000","last_became_active":"2024-09-21T09:03:08.258974+0000","last_became_peered":"2024-09-21T09:03:08.258974+0000","last_unstale":"2024-09-21T09:07:01.207912+0000","last_undegraded":"2024-09-21T09:07:01.207912+0000","last_fullsized":"2024-09-21T09:07:01.207912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:01.207775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:01.207775+0000","last_clean_scrub_stamp":"2024-09-21T09:07:01.207775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:33.638981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'8","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.913163+0000","last_change":"2024-09-21T09:06:46.913163+0000","last_active":"2024-09-21T09:06:46.913163+0000","last_peered":"2024-09-21T09:06:46.913163+0000","last_clean":"2024-09-21T09:06:46.913163+0000","last_became_active":"2024-09-21T09:03:00.221080+0000","last_became_peered":"2024-09-21T09:03:00.221080+0000","last_unstale":"2024-09-21T09:06:46.913163+0000","last_undegraded":"2024-09-21T09:06:46.913163+0000","last_fullsized":"2024-09-21T09:06:46.913163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:46.913050+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:46.913050+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.913050+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:10.419981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"31'3","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:29.373904+0000","last_change":"2024-09-21T09:07:29.373939+0000","last_active":"2024-09-21T09:07:29.373904+0000","last_peered":"2024-09-21T09:07:29.373904+0000","last_clean":"2024-09-21T09:07:29.373904+0000","last_became_active":"2024-09-21T09:02:49.493348+0000","last_became_peered":"2024-09-21T09:02:49.493348+0000","last_unstale":"2024-09-21T09:07:29.373904+0000","last_undegraded":"2024-09-21T09:07:29.373904+0000","last_fullsized":"2024-09-21T09:07:29.373904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:07:29.373807+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:07:29.373807+0000","last_clean_scrub_stamp":"2024-09-21T09:07:29.373807+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:35.416216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00096028300000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:59.799144+0000","last_change":"2024-09-21T09:06:59.799144+0000","last_active":"2024-09-21T09:06:59.799144+0000","last_peered":"2024-09-21T09:06:59.799144+0000","last_clean":"2024-09-21T09:06:59.799144+0000","last_became_active":"2024-09-21T09:02:58.207236+0000","last_became_peered":"2024-09-21T09:02:58.207236+0000","last_unstale":"2024-09-21T09:06:59.799144+0000","last_undegraded":"2024-09-21T09:06:59.799144+0000","last_fullsized":"2024-09-21T09:06:59.799144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:59.799035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:59.799035+0000","last_clean_scrub_stamp":"2024-09-21T09:06:59.799035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:01.789556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.897587+0000","last_change":"2024-09-21T09:06:36.897587+0000","last_active":"2024-09-21T09:06:36.897587+0000","last_peered":"2024-09-21T09:06:36.897587+0000","last_clean":"2024-09-21T09:06:36.897587+0000","last_became_active":"2024-09-21T09:03:02.221310+0000","last_became_peered":"2024-09-21T09:03:02.221310+0000","last_unstale":"2024-09-21T09:06:36.897587+0000","last_undegraded":"2024-09-21T09:06:36.897587+0000","last_fullsized":"2024-09-21T09:06:36.897587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:36.897431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:36.897431+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.897431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.146414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'20","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.285705+0000","last_change":"2024-09-21T09:06:43.285705+0000","last_active":"2024-09-21T09:06:43.285705+0000","last_peered":"2024-09-21T09:06:43.285705+0000","last_clean":"2024-09-21T09:06:43.285705+0000","last_became_active":"2024-09-21T09:03:04.243076+0000","last_became_peered":"2024-09-21T09:03:04.243076+0000","last_unstale":"2024-09-21T09:06:43.285705+0000","last_undegraded":"2024-09-21T09:06:43.285705+0000","last_fullsized":"2024-09-21T09:06:43.285705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-09-21T09:06:43.285503+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-09-21T09:06:43.285503+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.285503+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:31.813485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.313875+0000","last_change":"2024-09-21T09:06:49.313875+0000","last_active":"2024-09-21T09:06:49.313875+0000","last_peered":"2024-09-21T09:06:49.313875+0000","last_clean":"2024-09-21T09:06:49.313875+0000","last_became_active":"2024-09-21T09:03:06.250530+0000","last_became_peered":"2024-09-21T09:03:06.250530+0000","last_unstale":"2024-09-21T09:06:49.313875+0000","last_undegraded":"2024-09-21T09:06:49.313875+0000","last_fullsized":"2024-09-21T09:06:49.313875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:49.313729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:49.313729+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.313729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:37:17.387230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:10.451255+0000","last_change":"2024-09-21T09:07:10.451255+0000","last_active":"2024-09-21T09:07:10.451255+0000","last_peered":"2024-09-21T09:07:10.451255+0000","last_clean":"2024-09-21T09:07:10.451255+0000","last_became_active":"2024-09-21T09:03:08.262240+0000","last_became_peered":"2024-09-21T09:03:08.262240+0000","last_unstale":"2024-09-21T09:07:10.451255+0000","last_undegraded":"2024-09-21T09:07:10.451255+0000","last_fullsized":"2024-09-21T09:07:10.451255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:07:10.451100+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:07:10.451100+0000","last_clean_scrub_stamp":"2024-09-21T09:07:10.451100+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:50.493055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.322444+0000","last_change":"2024-09-21T09:06:40.322444+0000","last_active":"2024-09-21T09:06:40.322444+0000","last_peered":"2024-09-21T09:06:40.322444+0000","last_clean":"2024-09-21T09:06:40.322444+0000","last_became_active":"2024-09-21T09:03:00.224297+0000","last_became_peered":"2024-09-21T09:03:00.224297+0000","last_unstale":"2024-09-21T09:06:40.322444+0000","last_undegraded":"2024-09-21T09:06:40.322444+0000","last_fullsized":"2024-09-21T09:06:40.322444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:40.322322+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:40.322322+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.322322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:58.832458+0000","last_change":"2024-09-21T09:06:58.832458+0000","last_active":"2024-09-21T09:06:58.832458+0000","last_peered":"2024-09-21T09:06:58.832458+0000","last_clean":"2024-09-21T09:06:58.832458+0000","last_became_active":"2024-09-21T09:02:58.206718+0000","last_became_peered":"2024-09-21T09:02:58.206718+0000","last_unstale":"2024-09-21T09:06:58.832458+0000","last_undegraded":"2024-09-21T09:06:58.832458+0000","last_fullsized":"2024-09-21T09:06:58.832458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:58.832345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:58.832345+0000","last_clean_scrub_stamp":"2024-09-21T09:06:58.832345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:14.309366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:04.993328+0000","last_change":"2024-09-21T09:07:04.993355+0000","last_active":"2024-09-21T09:07:04.993328+0000","last_peered":"2024-09-21T09:07:04.993328+0000","last_clean":"2024-09-21T09:07:04.993328+0000","last_became_active":"2024-09-21T09:02:49.493509+0000","last_became_peered":"2024-09-21T09:02:49.493509+0000","last_unstale":"2024-09-21T09:07:04.993328+0000","last_undegraded":"2024-09-21T09:07:04.993328+0000","last_fullsized":"2024-09-21T09:07:04.993328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:04.993232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:04.993232+0000","last_clean_scrub_stamp":"2024-09-21T09:07:04.993232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:06.820978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038981200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.859438+0000","last_change":"2024-09-21T09:06:35.859438+0000","last_active":"2024-09-21T09:06:35.859438+0000","last_peered":"2024-09-21T09:06:35.859438+0000","last_clean":"2024-09-21T09:06:35.859438+0000","last_became_active":"2024-09-21T09:03:02.221309+0000","last_became_peered":"2024-09-21T09:03:02.221309+0000","last_unstale":"2024-09-21T09:06:35.859438+0000","last_undegraded":"2024-09-21T09:06:35.859438+0000","last_fullsized":"2024-09-21T09:06:35.859438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2024-09-21T09:06:35.859308+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2024-09-21T09:06:35.859308+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.859308+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:10.403536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'73","reported_seq":150,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.721519+0000","last_change":"2024-09-21T09:06:23.721519+0000","last_active":"2024-09-21T09:06:23.721519+0000","last_peered":"2024-09-21T09:06:23.721519+0000","last_clean":"2024-09-21T09:06:23.721519+0000","last_became_active":"2024-09-21T09:03:04.243228+0000","last_became_peered":"2024-09-21T09:03:04.243228+0000","last_unstale":"2024-09-21T09:06:23.721519+0000","last_undegraded":"2024-09-21T09:06:23.721519+0000","last_fullsized":"2024-09-21T09:06:23.721519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2024-09-21T09:06:23.721394+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2024-09-21T09:06:23.721394+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.721394+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:53.684792+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.826638+0000","last_change":"2024-09-21T09:06:18.826638+0000","last_active":"2024-09-21T09:06:18.826638+0000","last_peered":"2024-09-21T09:06:18.826638+0000","last_clean":"2024-09-21T09:06:18.826638+0000","last_became_active":"2024-09-21T09:03:06.246598+0000","last_became_peered":"2024-09-21T09:03:06.246598+0000","last_unstale":"2024-09-21T09:06:18.826638+0000","last_undegraded":"2024-09-21T09:06:18.826638+0000","last_fullsized":"2024-09-21T09:06:18.826638+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.826477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.826477+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.826477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:07.103764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:15.144630+0000","last_change":"2024-09-21T09:07:15.144630+0000","last_active":"2024-09-21T09:07:15.144630+0000","last_peered":"2024-09-21T09:07:15.144630+0000","last_clean":"2024-09-21T09:07:15.144630+0000","last_became_active":"2024-09-21T09:03:08.250714+0000","last_became_peered":"2024-09-21T09:03:08.250714+0000","last_unstale":"2024-09-21T09:07:15.144630+0000","last_undegraded":"2024-09-21T09:07:15.144630+0000","last_fullsized":"2024-09-21T09:07:15.144630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-21T09:07:15.144496+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-21T09:07:15.144496+0000","last_clean_scrub_stamp":"2024-09-21T09:07:15.144496+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:35.685007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'10","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:16.439534+0000","last_change":"2024-09-21T09:07:16.439559+0000","last_active":"2024-09-21T09:07:16.439534+0000","last_peered":"2024-09-21T09:07:16.439534+0000","last_clean":"2024-09-21T09:07:16.439534+0000","last_became_active":"2024-09-21T09:03:38.282889+0000","last_became_peered":"2024-09-21T09:03:38.282889+0000","last_unstale":"2024-09-21T09:07:16.439534+0000","last_undegraded":"2024-09-21T09:07:16.439534+0000","last_fullsized":"2024-09-21T09:07:16.439534+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:07:16.439446+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:07:16.439446+0000","last_clean_scrub_stamp":"2024-09-21T09:07:16.439446+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:07.428199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:02.944935+0000","last_change":"2024-09-21T09:07:02.944935+0000","last_active":"2024-09-21T09:07:02.944935+0000","last_peered":"2024-09-21T09:07:02.944935+0000","last_clean":"2024-09-21T09:07:02.944935+0000","last_became_active":"2024-09-21T09:02:58.208569+0000","last_became_peered":"2024-09-21T09:02:58.208569+0000","last_unstale":"2024-09-21T09:07:02.944935+0000","last_undegraded":"2024-09-21T09:07:02.944935+0000","last_fullsized":"2024-09-21T09:07:02.944935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:02.944798+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:02.944798+0000","last_clean_scrub_stamp":"2024-09-21T09:07:02.944798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:11:45.528934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:30.418082+0000","last_change":"2024-09-21T09:07:30.418105+0000","last_active":"2024-09-21T09:07:30.418082+0000","last_peered":"2024-09-21T09:07:30.418082+0000","last_clean":"2024-09-21T09:07:30.418082+0000","last_became_active":"2024-09-21T09:02:49.493469+0000","last_became_peered":"2024-09-21T09:02:49.493469+0000","last_unstale":"2024-09-21T09:07:30.418082+0000","last_undegraded":"2024-09-21T09:07:30.418082+0000","last_fullsized":"2024-09-21T09:07:30.418082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:30.417989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:30.417989+0000","last_clean_scrub_stamp":"2024-09-21T09:07:30.417989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:56.941500+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001228114,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.353354+0000","last_change":"2024-09-21T09:06:26.353354+0000","last_active":"2024-09-21T09:06:26.353354+0000","last_peered":"2024-09-21T09:06:26.353354+0000","last_clean":"2024-09-21T09:06:26.353354+0000","last_became_active":"2024-09-21T09:03:02.218232+0000","last_became_peered":"2024-09-21T09:03:02.218232+0000","last_unstale":"2024-09-21T09:06:26.353354+0000","last_undegraded":"2024-09-21T09:06:26.353354+0000","last_fullsized":"2024-09-21T09:06:26.353354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:26.353187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:26.353187+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.353187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:04.665812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'21","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.504016+0000","last_change":"2024-09-21T09:06:20.504016+0000","last_active":"2024-09-21T09:06:20.504016+0000","last_peered":"2024-09-21T09:06:20.504016+0000","last_clean":"2024-09-21T09:06:20.504016+0000","last_became_active":"2024-09-21T09:03:04.241500+0000","last_became_peered":"2024-09-21T09:03:04.241500+0000","last_unstale":"2024-09-21T09:06:20.504016+0000","last_undegraded":"2024-09-21T09:06:20.504016+0000","last_fullsized":"2024-09-21T09:06:20.504016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-09-21T09:06:20.503834+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-09-21T09:06:20.503834+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.503834+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:54.738751+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'285","reported_seq":367,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.375756+0000","last_change":"2024-09-21T09:06:27.375756+0000","last_active":"2024-09-21T09:06:27.375756+0000","last_peered":"2024-09-21T09:06:27.375756+0000","last_clean":"2024-09-21T09:06:27.375756+0000","last_became_active":"2024-09-21T09:03:06.249303+0000","last_became_peered":"2024-09-21T09:03:06.249303+0000","last_unstale":"2024-09-21T09:06:27.375756+0000","last_undegraded":"2024-09-21T09:06:27.375756+0000","last_fullsized":"2024-09-21T09:06:27.375756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:27.375647+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:27.375647+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.375647+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:46.869896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.201067+0000","last_change":"2024-09-21T09:03:08.264861+0000","last_active":"2024-09-21T09:06:17.201067+0000","last_peered":"2024-09-21T09:06:17.201067+0000","last_clean":"2024-09-21T09:06:17.201067+0000","last_became_active":"2024-09-21T09:03:08.264322+0000","last_became_peered":"2024-09-21T09:03:08.264322+0000","last_unstale":"2024-09-21T09:06:17.201067+0000","last_undegraded":"2024-09-21T09:06:17.201067+0000","last_fullsized":"2024-09-21T09:06:17.201067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:05.844502+0000","last_change":"2024-09-21T09:07:05.844502+0000","last_active":"2024-09-21T09:07:05.844502+0000","last_peered":"2024-09-21T09:07:05.844502+0000","last_clean":"2024-09-21T09:07:05.844502+0000","last_became_active":"2024-09-21T09:03:38.277629+0000","last_became_peered":"2024-09-21T09:03:38.277629+0000","last_unstale":"2024-09-21T09:07:05.844502+0000","last_undegraded":"2024-09-21T09:07:05.844502+0000","last_fullsized":"2024-09-21T09:07:05.844502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:05.844383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:05.844383+0000","last_clean_scrub_stamp":"2024-09-21T09:07:05.844383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:38.255577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:35.476354+0000","last_change":"2024-09-21T09:07:35.476383+0000","last_active":"2024-09-21T09:07:35.476354+0000","last_peered":"2024-09-21T09:07:35.476354+0000","last_clean":"2024-09-21T09:07:35.476354+0000","last_became_active":"2024-09-21T09:02:58.223652+0000","last_became_peered":"2024-09-21T09:02:58.223652+0000","last_unstale":"2024-09-21T09:07:35.476354+0000","last_undegraded":"2024-09-21T09:07:35.476354+0000","last_fullsized":"2024-09-21T09:07:35.476354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:35.476259+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:35.476259+0000","last_clean_scrub_stamp":"2024-09-21T09:07:35.476259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:54.110534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:03.982018+0000","last_change":"2024-09-21T09:07:03.982018+0000","last_active":"2024-09-21T09:07:03.982018+0000","last_peered":"2024-09-21T09:07:03.982018+0000","last_clean":"2024-09-21T09:07:03.982018+0000","last_became_active":"2024-09-21T09:02:49.493144+0000","last_became_peered":"2024-09-21T09:02:49.493144+0000","last_unstale":"2024-09-21T09:07:03.982018+0000","last_undegraded":"2024-09-21T09:07:03.982018+0000","last_fullsized":"2024-09-21T09:07:03.982018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:03.981903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:03.981903+0000","last_clean_scrub_stamp":"2024-09-21T09:07:03.981903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:44.720403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042500699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.311245+0000","last_change":"2024-09-21T09:06:24.311245+0000","last_active":"2024-09-21T09:06:24.311245+0000","last_peered":"2024-09-21T09:06:24.311245+0000","last_clean":"2024-09-21T09:06:24.311245+0000","last_became_active":"2024-09-21T09:03:02.219133+0000","last_became_peered":"2024-09-21T09:03:02.219133+0000","last_unstale":"2024-09-21T09:06:24.311245+0000","last_undegraded":"2024-09-21T09:06:24.311245+0000","last_fullsized":"2024-09-21T09:06:24.311245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:24.311064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:24.311064+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.311064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:35.086372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.280030+0000","last_change":"2024-09-21T09:06:33.280030+0000","last_active":"2024-09-21T09:06:33.280030+0000","last_peered":"2024-09-21T09:06:33.280030+0000","last_clean":"2024-09-21T09:06:33.280030+0000","last_became_active":"2024-09-21T09:03:04.241256+0000","last_became_peered":"2024-09-21T09:03:04.241256+0000","last_unstale":"2024-09-21T09:06:33.280030+0000","last_undegraded":"2024-09-21T09:06:33.280030+0000","last_fullsized":"2024-09-21T09:06:33.280030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-21T09:06:33.279879+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-21T09:06:33.279879+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.279879+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:01.162062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'285","reported_seq":441,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.713004+0000","last_change":"2024-09-21T09:06:22.713004+0000","last_active":"2024-09-21T09:06:22.713004+0000","last_peered":"2024-09-21T09:06:22.713004+0000","last_clean":"2024-09-21T09:06:22.713004+0000","last_became_active":"2024-09-21T09:03:06.243566+0000","last_became_peered":"2024-09-21T09:03:06.243566+0000","last_unstale":"2024-09-21T09:06:22.713004+0000","last_undegraded":"2024-09-21T09:06:22.713004+0000","last_fullsized":"2024-09-21T09:06:22.713004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:22.712831+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:22.712831+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.712831+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:04.506029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'5","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:13.413181+0000","last_change":"2024-09-21T09:07:13.413181+0000","last_active":"2024-09-21T09:07:13.413181+0000","last_peered":"2024-09-21T09:07:13.413181+0000","last_clean":"2024-09-21T09:07:13.413181+0000","last_became_active":"2024-09-21T09:03:08.262460+0000","last_became_peered":"2024-09-21T09:03:08.262460+0000","last_unstale":"2024-09-21T09:07:13.413181+0000","last_undegraded":"2024-09-21T09:07:13.413181+0000","last_fullsized":"2024-09-21T09:07:13.413181+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-21T09:07:13.413059+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-21T09:07:13.413059+0000","last_clean_scrub_stamp":"2024-09-21T09:07:13.413059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:02.535950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'14","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.862325+0000","last_change":"2024-09-21T09:06:39.862325+0000","last_active":"2024-09-21T09:06:39.862325+0000","last_peered":"2024-09-21T09:06:39.862325+0000","last_clean":"2024-09-21T09:06:39.862325+0000","last_became_active":"2024-09-21T09:03:00.216782+0000","last_became_peered":"2024-09-21T09:03:00.216782+0000","last_unstale":"2024-09-21T09:06:39.862325+0000","last_undegraded":"2024-09-21T09:06:39.862325+0000","last_fullsized":"2024-09-21T09:06:39.862325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:39.862176+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:39.862176+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.862176+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:04:29.094210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:50.407358+0000","last_change":"2024-09-21T09:06:50.407358+0000","last_active":"2024-09-21T09:06:50.407358+0000","last_peered":"2024-09-21T09:06:50.407358+0000","last_clean":"2024-09-21T09:06:50.407358+0000","last_became_active":"2024-09-21T09:02:58.213293+0000","last_became_peered":"2024-09-21T09:02:58.213293+0000","last_unstale":"2024-09-21T09:06:50.407358+0000","last_undegraded":"2024-09-21T09:06:50.407358+0000","last_fullsized":"2024-09-21T09:06:50.407358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:50.407214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:50.407214+0000","last_clean_scrub_stamp":"2024-09-21T09:06:50.407214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:03:45.219496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:31.467349+0000","last_change":"2024-09-21T09:07:31.467408+0000","last_active":"2024-09-21T09:07:31.467349+0000","last_peered":"2024-09-21T09:07:31.467349+0000","last_clean":"2024-09-21T09:07:31.467349+0000","last_became_active":"2024-09-21T09:02:49.542160+0000","last_became_peered":"2024-09-21T09:02:49.542160+0000","last_unstale":"2024-09-21T09:07:31.467349+0000","last_undegraded":"2024-09-21T09:07:31.467349+0000","last_fullsized":"2024-09-21T09:07:31.467349+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:31.467209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:31.467209+0000","last_clean_scrub_stamp":"2024-09-21T09:07:31.467209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:22.555676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099618800000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.307002+0000","last_change":"2024-09-21T09:06:27.307002+0000","last_active":"2024-09-21T09:06:27.307002+0000","last_peered":"2024-09-21T09:06:27.307002+0000","last_clean":"2024-09-21T09:06:27.307002+0000","last_became_active":"2024-09-21T09:03:02.218138+0000","last_became_peered":"2024-09-21T09:03:02.218138+0000","last_unstale":"2024-09-21T09:06:27.307002+0000","last_undegraded":"2024-09-21T09:06:27.307002+0000","last_fullsized":"2024-09-21T09:06:27.307002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:27.306889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:27.306889+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.306889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:50.637433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'98","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.794110+0000","last_change":"2024-09-21T09:06:31.794110+0000","last_active":"2024-09-21T09:06:31.794110+0000","last_peered":"2024-09-21T09:06:31.794110+0000","last_clean":"2024-09-21T09:06:31.794110+0000","last_became_active":"2024-09-21T09:03:04.231708+0000","last_became_peered":"2024-09-21T09:03:04.231708+0000","last_unstale":"2024-09-21T09:06:31.794110+0000","last_undegraded":"2024-09-21T09:06:31.794110+0000","last_fullsized":"2024-09-21T09:06:31.794110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2024-09-21T09:06:31.793976+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2024-09-21T09:06:31.793976+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.793976+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:01.757375+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":98,"num_read_kb":92,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.935186+0000","last_change":"2024-09-21T09:06:37.935186+0000","last_active":"2024-09-21T09:06:37.935186+0000","last_peered":"2024-09-21T09:06:37.935186+0000","last_clean":"2024-09-21T09:06:37.935186+0000","last_became_active":"2024-09-21T09:03:06.249474+0000","last_became_peered":"2024-09-21T09:03:06.249474+0000","last_unstale":"2024-09-21T09:06:37.935186+0000","last_undegraded":"2024-09-21T09:06:37.935186+0000","last_fullsized":"2024-09-21T09:06:37.935186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:37.935053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:37.935053+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.935053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:29.492174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.780707+0000","last_change":"2024-09-21T09:06:25.780707+0000","last_active":"2024-09-21T09:06:25.780707+0000","last_peered":"2024-09-21T09:06:25.780707+0000","last_clean":"2024-09-21T09:06:25.780707+0000","last_became_active":"2024-09-21T09:03:08.252363+0000","last_became_peered":"2024-09-21T09:03:08.252363+0000","last_unstale":"2024-09-21T09:06:25.780707+0000","last_undegraded":"2024-09-21T09:06:25.780707+0000","last_fullsized":"2024-09-21T09:06:25.780707+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:25.780594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:25.780594+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.780594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:37.186890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.855293+0000","last_change":"2024-09-21T09:06:37.855293+0000","last_active":"2024-09-21T09:06:37.855293+0000","last_peered":"2024-09-21T09:06:37.855293+0000","last_clean":"2024-09-21T09:06:37.855293+0000","last_became_active":"2024-09-21T09:03:08.256571+0000","last_became_peered":"2024-09-21T09:03:08.256571+0000","last_unstale":"2024-09-21T09:06:37.855293+0000","last_undegraded":"2024-09-21T09:06:37.855293+0000","last_fullsized":"2024-09-21T09:06:37.855293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:37.855168+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:37.855168+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.855168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:52.809661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'12","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:10.788069+0000","last_change":"2024-09-21T09:07:10.788096+0000","last_active":"2024-09-21T09:07:10.788069+0000","last_peered":"2024-09-21T09:07:10.788069+0000","last_clean":"2024-09-21T09:07:10.788069+0000","last_became_active":"2024-09-21T09:03:38.466274+0000","last_became_peered":"2024-09-21T09:03:38.466274+0000","last_unstale":"2024-09-21T09:07:10.788069+0000","last_undegraded":"2024-09-21T09:07:10.788069+0000","last_fullsized":"2024-09-21T09:07:10.788069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:07:10.787983+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:07:10.787983+0000","last_clean_scrub_stamp":"2024-09-21T09:07:10.787983+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:11:53.372119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:11.314665+0000","last_change":"2024-09-21T09:07:11.314665+0000","last_active":"2024-09-21T09:07:11.314665+0000","last_peered":"2024-09-21T09:07:11.314665+0000","last_clean":"2024-09-21T09:07:11.314665+0000","last_became_active":"2024-09-21T09:02:58.220716+0000","last_became_peered":"2024-09-21T09:02:58.220716+0000","last_unstale":"2024-09-21T09:07:11.314665+0000","last_undegraded":"2024-09-21T09:07:11.314665+0000","last_fullsized":"2024-09-21T09:07:11.314665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:11.314540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:11.314540+0000","last_clean_scrub_stamp":"2024-09-21T09:07:11.314540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:17.515915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.293135+0000","last_change":"2024-09-21T09:06:33.293155+0000","last_active":"2024-09-21T09:06:33.293135+0000","last_peered":"2024-09-21T09:06:33.293135+0000","last_clean":"2024-09-21T09:06:33.293135+0000","last_became_active":"2024-09-21T09:03:02.219652+0000","last_became_peered":"2024-09-21T09:03:02.219652+0000","last_unstale":"2024-09-21T09:06:33.293135+0000","last_undegraded":"2024-09-21T09:06:33.293135+0000","last_fullsized":"2024-09-21T09:06:33.293135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:33.293033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:33.293033+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.293033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:32:06.406355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'39","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.278436+0000","last_change":"2024-09-21T09:06:37.278476+0000","last_active":"2024-09-21T09:06:37.278436+0000","last_peered":"2024-09-21T09:06:37.278436+0000","last_clean":"2024-09-21T09:06:37.278436+0000","last_became_active":"2024-09-21T09:03:04.241612+0000","last_became_peered":"2024-09-21T09:03:04.241612+0000","last_unstale":"2024-09-21T09:06:37.278436+0000","last_undegraded":"2024-09-21T09:06:37.278436+0000","last_fullsized":"2024-09-21T09:06:37.278436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-21T09:06:37.278334+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-21T09:06:37.278334+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.278334+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:25.732945+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:57.255052+0000","last_change":"2024-09-21T09:06:57.255074+0000","last_active":"2024-09-21T09:06:57.255052+0000","last_peered":"2024-09-21T09:06:57.255052+0000","last_clean":"2024-09-21T09:06:57.255052+0000","last_became_active":"2024-09-21T09:03:06.250750+0000","last_became_peered":"2024-09-21T09:03:06.250750+0000","last_unstale":"2024-09-21T09:06:57.255052+0000","last_undegraded":"2024-09-21T09:06:57.255052+0000","last_fullsized":"2024-09-21T09:06:57.255052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:57.254961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:57.254961+0000","last_clean_scrub_stamp":"2024-09-21T09:06:57.254961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:57.736160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'11","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:18.211496+0000","last_change":"2024-09-21T09:07:18.211525+0000","last_active":"2024-09-21T09:07:18.211496+0000","last_peered":"2024-09-21T09:07:18.211496+0000","last_clean":"2024-09-21T09:07:18.211496+0000","last_became_active":"2024-09-21T09:03:08.259602+0000","last_became_peered":"2024-09-21T09:03:08.259602+0000","last_unstale":"2024-09-21T09:07:18.211496+0000","last_undegraded":"2024-09-21T09:07:18.211496+0000","last_fullsized":"2024-09-21T09:07:18.211496+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2024-09-21T09:07:18.211400+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2024-09-21T09:07:18.211400+0000","last_clean_scrub_stamp":"2024-09-21T09:07:18.211400+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:36.358906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.310950+0000","last_change":"2024-09-21T09:06:37.310974+0000","last_active":"2024-09-21T09:06:37.310950+0000","last_peered":"2024-09-21T09:06:37.310950+0000","last_clean":"2024-09-21T09:06:37.310950+0000","last_became_active":"2024-09-21T09:03:00.225811+0000","last_became_peered":"2024-09-21T09:03:00.225811+0000","last_unstale":"2024-09-21T09:06:37.310950+0000","last_undegraded":"2024-09-21T09:06:37.310950+0000","last_fullsized":"2024-09-21T09:06:37.310950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:37.310866+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:37.310866+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.310866+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.559849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:06.847416+0000","last_change":"2024-09-21T09:07:06.847440+0000","last_active":"2024-09-21T09:07:06.847416+0000","last_peered":"2024-09-21T09:07:06.847416+0000","last_clean":"2024-09-21T09:07:06.847416+0000","last_became_active":"2024-09-21T09:03:38.280539+0000","last_became_peered":"2024-09-21T09:03:38.280539+0000","last_unstale":"2024-09-21T09:07:06.847416+0000","last_undegraded":"2024-09-21T09:07:06.847416+0000","last_fullsized":"2024-09-21T09:07:06.847416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:06.847333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:06.847333+0000","last_clean_scrub_stamp":"2024-09-21T09:07:06.847333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:02.267944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.390070+0000","last_change":"2024-09-21T09:06:21.390097+0000","last_active":"2024-09-21T09:06:21.390070+0000","last_peered":"2024-09-21T09:06:21.390070+0000","last_clean":"2024-09-21T09:06:21.390070+0000","last_became_active":"2024-09-21T09:03:02.222474+0000","last_became_peered":"2024-09-21T09:03:02.222474+0000","last_unstale":"2024-09-21T09:06:21.390070+0000","last_undegraded":"2024-09-21T09:06:21.390070+0000","last_fullsized":"2024-09-21T09:06:21.390070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:21.389982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:21.389982+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.389982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:19.738715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'9","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.747218+0000","last_change":"2024-09-21T09:06:30.747258+0000","last_active":"2024-09-21T09:06:30.747218+0000","last_peered":"2024-09-21T09:06:30.747218+0000","last_clean":"2024-09-21T09:06:30.747218+0000","last_became_active":"2024-09-21T09:03:04.232474+0000","last_became_peered":"2024-09-21T09:03:04.232474+0000","last_unstale":"2024-09-21T09:06:30.747218+0000","last_undegraded":"2024-09-21T09:06:30.747218+0000","last_fullsized":"2024-09-21T09:06:30.747218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-21T09:06:30.747132+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-21T09:06:30.747132+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.747132+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:13:40.597960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.808656+0000","last_change":"2024-09-21T09:06:17.808683+0000","last_active":"2024-09-21T09:06:17.808656+0000","last_peered":"2024-09-21T09:06:17.808656+0000","last_clean":"2024-09-21T09:06:17.808656+0000","last_became_active":"2024-09-21T09:03:06.250773+0000","last_became_peered":"2024-09-21T09:03:06.250773+0000","last_unstale":"2024-09-21T09:06:17.808656+0000","last_undegraded":"2024-09-21T09:06:17.808656+0000","last_fullsized":"2024-09-21T09:06:17.808656+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.808555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.808555+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.808555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.180280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:14.140828+0000","last_change":"2024-09-21T09:07:14.140852+0000","last_active":"2024-09-21T09:07:14.140828+0000","last_peered":"2024-09-21T09:07:14.140828+0000","last_clean":"2024-09-21T09:07:14.140828+0000","last_became_active":"2024-09-21T09:03:08.250617+0000","last_became_peered":"2024-09-21T09:03:08.250617+0000","last_unstale":"2024-09-21T09:07:14.140828+0000","last_undegraded":"2024-09-21T09:07:14.140828+0000","last_fullsized":"2024-09-21T09:07:14.140828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:14.140714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:14.140714+0000","last_clean_scrub_stamp":"2024-09-21T09:07:14.140714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:33.195512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'14","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.994816+0000","last_change":"2024-09-21T09:06:49.994873+0000","last_active":"2024-09-21T09:06:49.994816+0000","last_peered":"2024-09-21T09:06:49.994816+0000","last_clean":"2024-09-21T09:06:49.994816+0000","last_became_active":"2024-09-21T09:03:00.215591+0000","last_became_peered":"2024-09-21T09:03:00.215591+0000","last_unstale":"2024-09-21T09:06:49.994816+0000","last_undegraded":"2024-09-21T09:06:49.994816+0000","last_fullsized":"2024-09-21T09:06:49.994816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:49.994677+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:49.994677+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.994677+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:34.312234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:52.874132+0000","last_change":"2024-09-21T09:06:52.874160+0000","last_active":"2024-09-21T09:06:52.874132+0000","last_peered":"2024-09-21T09:06:52.874132+0000","last_clean":"2024-09-21T09:06:52.874132+0000","last_became_active":"2024-09-21T09:02:58.217931+0000","last_became_peered":"2024-09-21T09:02:58.217931+0000","last_unstale":"2024-09-21T09:06:52.874132+0000","last_undegraded":"2024-09-21T09:06:52.874132+0000","last_fullsized":"2024-09-21T09:06:52.874132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:52.874045+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:52.874045+0000","last_clean_scrub_stamp":"2024-09-21T09:06:52.874045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:52.416511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.887441+0000","last_change":"2024-09-21T09:06:38.887465+0000","last_active":"2024-09-21T09:06:38.887441+0000","last_peered":"2024-09-21T09:06:38.887441+0000","last_clean":"2024-09-21T09:06:38.887441+0000","last_became_active":"2024-09-21T09:03:02.219265+0000","last_became_peered":"2024-09-21T09:03:02.219265+0000","last_unstale":"2024-09-21T09:06:38.887441+0000","last_undegraded":"2024-09-21T09:06:38.887441+0000","last_fullsized":"2024-09-21T09:06:38.887441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:38.887351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:38.887351+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.887351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:05.248119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'47","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.702301+0000","last_change":"2024-09-21T09:06:28.702348+0000","last_active":"2024-09-21T09:06:28.702301+0000","last_peered":"2024-09-21T09:06:28.702301+0000","last_clean":"2024-09-21T09:06:28.702301+0000","last_became_active":"2024-09-21T09:03:04.233393+0000","last_became_peered":"2024-09-21T09:03:04.233393+0000","last_unstale":"2024-09-21T09:06:28.702301+0000","last_undegraded":"2024-09-21T09:06:28.702301+0000","last_fullsized":"2024-09-21T09:06:28.702301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-09-21T09:06:28.702205+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-09-21T09:06:28.702205+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.702205+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:15.159343+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.509490+0000","last_change":"2024-09-21T09:06:19.509511+0000","last_active":"2024-09-21T09:06:19.509490+0000","last_peered":"2024-09-21T09:06:19.509490+0000","last_clean":"2024-09-21T09:06:19.509490+0000","last_became_active":"2024-09-21T09:03:06.248954+0000","last_became_peered":"2024-09-21T09:03:06.248954+0000","last_unstale":"2024-09-21T09:06:19.509490+0000","last_undegraded":"2024-09-21T09:06:19.509490+0000","last_fullsized":"2024-09-21T09:06:19.509490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.509370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.509370+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.509370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:08.185733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:38.462905+0000","last_change":"2024-09-21T09:03:08.265248+0000","last_active":"2024-09-21T09:05:38.462905+0000","last_peered":"2024-09-21T09:05:38.462905+0000","last_clean":"2024-09-21T09:05:38.462905+0000","last_became_active":"2024-09-21T09:03:08.264778+0000","last_became_peered":"2024-09-21T09:03:08.264778+0000","last_unstale":"2024-09-21T09:05:38.462905+0000","last_undegraded":"2024-09-21T09:05:38.462905+0000","last_fullsized":"2024-09-21T09:05:38.462905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:56.215379+0000","last_change":"2024-09-21T09:06:56.215434+0000","last_active":"2024-09-21T09:06:56.215379+0000","last_peered":"2024-09-21T09:06:56.215379+0000","last_clean":"2024-09-21T09:06:56.215379+0000","last_became_active":"2024-09-21T09:03:00.218259+0000","last_became_peered":"2024-09-21T09:03:00.218259+0000","last_unstale":"2024-09-21T09:06:56.215379+0000","last_undegraded":"2024-09-21T09:06:56.215379+0000","last_fullsized":"2024-09-21T09:06:56.215379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:56.215261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:56.215261+0000","last_clean_scrub_stamp":"2024-09-21T09:06:56.215261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:28.904607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:07.468862+0000","last_change":"2024-09-21T09:07:07.468919+0000","last_active":"2024-09-21T09:07:07.468862+0000","last_peered":"2024-09-21T09:07:07.468862+0000","last_clean":"2024-09-21T09:07:07.468862+0000","last_became_active":"2024-09-21T09:02:58.207533+0000","last_became_peered":"2024-09-21T09:02:58.207533+0000","last_unstale":"2024-09-21T09:07:07.468862+0000","last_undegraded":"2024-09-21T09:07:07.468862+0000","last_fullsized":"2024-09-21T09:07:07.468862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:07.468744+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:07.468744+0000","last_clean_scrub_stamp":"2024-09-21T09:07:07.468744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:52.083674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.403941+0000","last_change":"2024-09-21T09:06:22.403985+0000","last_active":"2024-09-21T09:06:22.403941+0000","last_peered":"2024-09-21T09:06:22.403941+0000","last_clean":"2024-09-21T09:06:22.403941+0000","last_became_active":"2024-09-21T09:03:02.219509+0000","last_became_peered":"2024-09-21T09:03:02.219509+0000","last_unstale":"2024-09-21T09:06:22.403941+0000","last_undegraded":"2024-09-21T09:06:22.403941+0000","last_fullsized":"2024-09-21T09:06:22.403941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:22.403839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:22.403839+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.403839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:58.125850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.809789+0000","last_change":"2024-09-21T09:06:27.809828+0000","last_active":"2024-09-21T09:06:27.809789+0000","last_peered":"2024-09-21T09:06:27.809789+0000","last_clean":"2024-09-21T09:06:27.809789+0000","last_became_active":"2024-09-21T09:03:04.233913+0000","last_became_peered":"2024-09-21T09:03:04.233913+0000","last_unstale":"2024-09-21T09:06:27.809789+0000","last_undegraded":"2024-09-21T09:06:27.809789+0000","last_fullsized":"2024-09-21T09:06:27.809789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-21T09:06:27.809708+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-21T09:06:27.809708+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.809708+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:02.044625+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.801339+0000","last_change":"2024-09-21T09:06:23.801364+0000","last_active":"2024-09-21T09:06:23.801339+0000","last_peered":"2024-09-21T09:06:23.801339+0000","last_clean":"2024-09-21T09:06:23.801339+0000","last_became_active":"2024-09-21T09:03:06.240791+0000","last_became_peered":"2024-09-21T09:03:06.240791+0000","last_unstale":"2024-09-21T09:06:23.801339+0000","last_undegraded":"2024-09-21T09:06:23.801339+0000","last_fullsized":"2024-09-21T09:06:23.801339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:23.801250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:23.801250+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.801250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:35.380708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:02.199604+0000","last_change":"2024-09-21T09:07:02.199604+0000","last_active":"2024-09-21T09:07:02.199604+0000","last_peered":"2024-09-21T09:07:02.199604+0000","last_clean":"2024-09-21T09:07:02.199604+0000","last_became_active":"2024-09-21T09:03:00.216319+0000","last_became_peered":"2024-09-21T09:03:00.216319+0000","last_unstale":"2024-09-21T09:07:02.199604+0000","last_undegraded":"2024-09-21T09:07:02.199604+0000","last_fullsized":"2024-09-21T09:07:02.199604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:07:02.199485+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:07:02.199485+0000","last_clean_scrub_stamp":"2024-09-21T09:07:02.199485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:23.809002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:20.392084+0000","last_change":"2024-09-21T09:07:20.392110+0000","last_active":"2024-09-21T09:07:20.392084+0000","last_peered":"2024-09-21T09:07:20.392084+0000","last_clean":"2024-09-21T09:07:20.392084+0000","last_became_active":"2024-09-21T09:02:58.214494+0000","last_became_peered":"2024-09-21T09:02:58.214494+0000","last_unstale":"2024-09-21T09:07:20.392084+0000","last_undegraded":"2024-09-21T09:07:20.392084+0000","last_fullsized":"2024-09-21T09:07:20.392084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:20.391988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:20.391988+0000","last_clean_scrub_stamp":"2024-09-21T09:07:20.391988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:23.708224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"31'5","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.825386+0000","last_change":"2024-09-21T09:06:34.825386+0000","last_active":"2024-09-21T09:06:34.825386+0000","last_peered":"2024-09-21T09:06:34.825386+0000","last_clean":"2024-09-21T09:06:34.825386+0000","last_became_active":"2024-09-21T09:03:02.221586+0000","last_became_peered":"2024-09-21T09:03:02.221586+0000","last_unstale":"2024-09-21T09:06:34.825386+0000","last_undegraded":"2024-09-21T09:06:34.825386+0000","last_fullsized":"2024-09-21T09:06:34.825386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-21T09:06:34.825259+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-21T09:06:34.825259+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.825259+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:27.576289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'64","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.682081+0000","last_change":"2024-09-21T09:06:27.682121+0000","last_active":"2024-09-21T09:06:27.682081+0000","last_peered":"2024-09-21T09:06:27.682081+0000","last_clean":"2024-09-21T09:06:27.682081+0000","last_became_active":"2024-09-21T09:03:04.233734+0000","last_became_peered":"2024-09-21T09:03:04.233734+0000","last_unstale":"2024-09-21T09:06:27.682081+0000","last_undegraded":"2024-09-21T09:06:27.682081+0000","last_fullsized":"2024-09-21T09:06:27.682081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'64","last_scrub_stamp":"2024-09-21T09:06:27.681989+0000","last_deep_scrub":"31'64","last_deep_scrub_stamp":"2024-09-21T09:06:27.681989+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.681989+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:55.221898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.819887+0000","last_change":"2024-09-21T09:06:22.819910+0000","last_active":"2024-09-21T09:06:22.819887+0000","last_peered":"2024-09-21T09:06:22.819887+0000","last_clean":"2024-09-21T09:06:22.819887+0000","last_became_active":"2024-09-21T09:03:06.240975+0000","last_became_peered":"2024-09-21T09:03:06.240975+0000","last_unstale":"2024-09-21T09:06:22.819887+0000","last_undegraded":"2024-09-21T09:06:22.819887+0000","last_fullsized":"2024-09-21T09:06:22.819887+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:22.819794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:22.819794+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.819794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:09.790058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'18","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:17.175321+0000","last_change":"2024-09-21T09:07:17.175397+0000","last_active":"2024-09-21T09:07:17.175321+0000","last_peered":"2024-09-21T09:07:17.175321+0000","last_clean":"2024-09-21T09:07:17.175321+0000","last_became_active":"2024-09-21T09:03:08.253904+0000","last_became_peered":"2024-09-21T09:03:08.253904+0000","last_unstale":"2024-09-21T09:07:17.175321+0000","last_undegraded":"2024-09-21T09:07:17.175321+0000","last_fullsized":"2024-09-21T09:07:17.175321+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-21T09:07:17.175215+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-21T09:07:17.175215+0000","last_clean_scrub_stamp":"2024-09-21T09:07:17.175215+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:14.991180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:56.086932+0000","last_change":"2024-09-21T09:06:56.086932+0000","last_active":"2024-09-21T09:06:56.086932+0000","last_peered":"2024-09-21T09:06:56.086932+0000","last_clean":"2024-09-21T09:06:56.086932+0000","last_became_active":"2024-09-21T09:03:00.216238+0000","last_became_peered":"2024-09-21T09:03:00.216238+0000","last_unstale":"2024-09-21T09:06:56.086932+0000","last_undegraded":"2024-09-21T09:06:56.086932+0000","last_fullsized":"2024-09-21T09:06:56.086932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:56.086803+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:56.086803+0000","last_clean_scrub_stamp":"2024-09-21T09:06:56.086803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:47.639139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:05.472448+0000","last_change":"2024-09-21T09:07:05.472493+0000","last_active":"2024-09-21T09:07:05.472448+0000","last_peered":"2024-09-21T09:07:05.472448+0000","last_clean":"2024-09-21T09:07:05.472448+0000","last_became_active":"2024-09-21T09:02:58.206879+0000","last_became_peered":"2024-09-21T09:02:58.206879+0000","last_unstale":"2024-09-21T09:07:05.472448+0000","last_undegraded":"2024-09-21T09:07:05.472448+0000","last_fullsized":"2024-09-21T09:07:05.472448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:05.472355+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:05.472355+0000","last_clean_scrub_stamp":"2024-09-21T09:07:05.472355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:07.300100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:53.844325+0000","last_change":"2024-09-21T09:06:53.844325+0000","last_active":"2024-09-21T09:06:53.844325+0000","last_peered":"2024-09-21T09:06:53.844325+0000","last_clean":"2024-09-21T09:06:53.844325+0000","last_became_active":"2024-09-21T09:03:02.218381+0000","last_became_peered":"2024-09-21T09:03:02.218381+0000","last_unstale":"2024-09-21T09:06:53.844325+0000","last_undegraded":"2024-09-21T09:06:53.844325+0000","last_fullsized":"2024-09-21T09:06:53.844325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:53.844124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:53.844124+0000","last_clean_scrub_stamp":"2024-09-21T09:06:53.844124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:16.853541+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.290474+0000","last_change":"2024-09-21T09:06:29.290517+0000","last_active":"2024-09-21T09:06:29.290474+0000","last_peered":"2024-09-21T09:06:29.290474+0000","last_clean":"2024-09-21T09:06:29.290474+0000","last_became_active":"2024-09-21T09:03:04.240933+0000","last_became_peered":"2024-09-21T09:03:04.240933+0000","last_unstale":"2024-09-21T09:06:29.290474+0000","last_undegraded":"2024-09-21T09:06:29.290474+0000","last_fullsized":"2024-09-21T09:06:29.290474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-21T09:06:29.290368+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-21T09:06:29.290368+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.290368+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:29.068806+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.475284+0000","last_change":"2024-09-21T09:06:17.475308+0000","last_active":"2024-09-21T09:06:17.475284+0000","last_peered":"2024-09-21T09:06:17.475284+0000","last_clean":"2024-09-21T09:06:17.475284+0000","last_became_active":"2024-09-21T09:03:06.247153+0000","last_became_peered":"2024-09-21T09:03:06.247153+0000","last_unstale":"2024-09-21T09:06:17.475284+0000","last_undegraded":"2024-09-21T09:06:17.475284+0000","last_fullsized":"2024-09-21T09:06:17.475284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.475178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.475178+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.475178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:28.701561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:37.397174+0000","last_change":"2024-09-21T09:07:37.397227+0000","last_active":"2024-09-21T09:07:37.397174+0000","last_peered":"2024-09-21T09:07:37.397174+0000","last_clean":"2024-09-21T09:07:37.397174+0000","last_became_active":"2024-09-21T09:03:08.262680+0000","last_became_peered":"2024-09-21T09:03:08.262680+0000","last_unstale":"2024-09-21T09:07:37.397174+0000","last_undegraded":"2024-09-21T09:07:37.397174+0000","last_fullsized":"2024-09-21T09:07:37.397174+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:37.397058+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:37.397058+0000","last_clean_scrub_stamp":"2024-09-21T09:07:37.397058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:05.089419+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.325607+0000","last_change":"2024-09-21T09:06:28.325656+0000","last_active":"2024-09-21T09:06:28.325607+0000","last_peered":"2024-09-21T09:06:28.325607+0000","last_clean":"2024-09-21T09:06:28.325607+0000","last_became_active":"2024-09-21T09:03:00.219653+0000","last_became_peered":"2024-09-21T09:03:00.219653+0000","last_unstale":"2024-09-21T09:06:28.325607+0000","last_undegraded":"2024-09-21T09:06:28.325607+0000","last_fullsized":"2024-09-21T09:06:28.325607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:28.325504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:28.325504+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.325504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:07.739919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'3","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:02.576259+0000","last_change":"2024-09-21T09:07:02.576326+0000","last_active":"2024-09-21T09:07:02.576259+0000","last_peered":"2024-09-21T09:07:02.576259+0000","last_clean":"2024-09-21T09:07:02.576259+0000","last_became_active":"2024-09-21T09:02:58.202431+0000","last_became_peered":"2024-09-21T09:02:58.202431+0000","last_unstale":"2024-09-21T09:07:02.576259+0000","last_undegraded":"2024-09-21T09:07:02.576259+0000","last_fullsized":"2024-09-21T09:07:02.576259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:07:02.576143+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:07:02.576143+0000","last_clean_scrub_stamp":"2024-09-21T09:07:02.576143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:40.207102+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.809305+0000","last_change":"2024-09-21T09:06:36.809338+0000","last_active":"2024-09-21T09:06:36.809305+0000","last_peered":"2024-09-21T09:06:36.809305+0000","last_clean":"2024-09-21T09:06:36.809305+0000","last_became_active":"2024-09-21T09:03:02.220940+0000","last_became_peered":"2024-09-21T09:03:02.220940+0000","last_unstale":"2024-09-21T09:06:36.809305+0000","last_undegraded":"2024-09-21T09:06:36.809305+0000","last_fullsized":"2024-09-21T09:06:36.809305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:36.809163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:36.809163+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.809163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:23.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'40","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.706558+0000","last_change":"2024-09-21T09:06:26.706558+0000","last_active":"2024-09-21T09:06:26.706558+0000","last_peered":"2024-09-21T09:06:26.706558+0000","last_clean":"2024-09-21T09:06:26.706558+0000","last_became_active":"2024-09-21T09:03:04.239023+0000","last_became_peered":"2024-09-21T09:03:04.239023+0000","last_unstale":"2024-09-21T09:06:26.706558+0000","last_undegraded":"2024-09-21T09:06:26.706558+0000","last_fullsized":"2024-09-21T09:06:26.706558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-09-21T09:06:26.706429+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-09-21T09:06:26.706429+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.706429+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:10.421856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.647012+0000","last_change":"2024-09-21T09:06:19.647012+0000","last_active":"2024-09-21T09:06:19.647012+0000","last_peered":"2024-09-21T09:06:19.647012+0000","last_clean":"2024-09-21T09:06:19.647012+0000","last_became_active":"2024-09-21T09:03:06.243451+0000","last_became_peered":"2024-09-21T09:03:06.243451+0000","last_unstale":"2024-09-21T09:06:19.647012+0000","last_undegraded":"2024-09-21T09:06:19.647012+0000","last_fullsized":"2024-09-21T09:06:19.647012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.646893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.646893+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.646893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:53.881810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:09.304582+0000","last_change":"2024-09-21T09:07:09.304628+0000","last_active":"2024-09-21T09:07:09.304582+0000","last_peered":"2024-09-21T09:07:09.304582+0000","last_clean":"2024-09-21T09:07:09.304582+0000","last_became_active":"2024-09-21T09:03:08.260047+0000","last_became_peered":"2024-09-21T09:03:08.260047+0000","last_unstale":"2024-09-21T09:07:09.304582+0000","last_undegraded":"2024-09-21T09:07:09.304582+0000","last_fullsized":"2024-09-21T09:07:09.304582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:07:09.304481+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:07:09.304481+0000","last_clean_scrub_stamp":"2024-09-21T09:07:09.304481+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:04.837478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.961215+0000","last_change":"2024-09-21T09:06:44.961247+0000","last_active":"2024-09-21T09:06:44.961215+0000","last_peered":"2024-09-21T09:06:44.961215+0000","last_clean":"2024-09-21T09:06:44.961215+0000","last_became_active":"2024-09-21T09:03:00.221332+0000","last_became_peered":"2024-09-21T09:03:00.221332+0000","last_unstale":"2024-09-21T09:06:44.961215+0000","last_undegraded":"2024-09-21T09:06:44.961215+0000","last_fullsized":"2024-09-21T09:06:44.961215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:44.961118+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:44.961118+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.961118+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:44.503583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:32.512347+0000","last_change":"2024-09-21T09:07:32.512379+0000","last_active":"2024-09-21T09:07:32.512347+0000","last_peered":"2024-09-21T09:07:32.512347+0000","last_clean":"2024-09-21T09:07:32.512347+0000","last_became_active":"2024-09-21T09:02:58.210511+0000","last_became_peered":"2024-09-21T09:02:58.210511+0000","last_unstale":"2024-09-21T09:07:32.512347+0000","last_undegraded":"2024-09-21T09:07:32.512347+0000","last_fullsized":"2024-09-21T09:07:32.512347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:32.512238+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:32.512238+0000","last_clean_scrub_stamp":"2024-09-21T09:07:32.512238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:51.713933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.326237+0000","last_change":"2024-09-21T09:06:34.326260+0000","last_active":"2024-09-21T09:06:34.326237+0000","last_peered":"2024-09-21T09:06:34.326237+0000","last_clean":"2024-09-21T09:06:34.326237+0000","last_became_active":"2024-09-21T09:03:02.218979+0000","last_became_peered":"2024-09-21T09:03:02.218979+0000","last_unstale":"2024-09-21T09:06:34.326237+0000","last_undegraded":"2024-09-21T09:06:34.326237+0000","last_fullsized":"2024-09-21T09:06:34.326237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:34.326149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:34.326149+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.326149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:08.189282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.300849+0000","last_change":"2024-09-21T09:06:48.300849+0000","last_active":"2024-09-21T09:06:48.300849+0000","last_peered":"2024-09-21T09:06:48.300849+0000","last_clean":"2024-09-21T09:06:48.300849+0000","last_became_active":"2024-09-21T09:03:04.241974+0000","last_became_peered":"2024-09-21T09:03:04.241974+0000","last_unstale":"2024-09-21T09:06:48.300849+0000","last_undegraded":"2024-09-21T09:06:48.300849+0000","last_fullsized":"2024-09-21T09:06:48.300849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-21T09:06:48.300709+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-21T09:06:48.300709+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.300709+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:28.450871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'285","reported_seq":429,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.869907+0000","last_change":"2024-09-21T09:06:20.869907+0000","last_active":"2024-09-21T09:06:20.869907+0000","last_peered":"2024-09-21T09:06:20.869907+0000","last_clean":"2024-09-21T09:06:20.869907+0000","last_became_active":"2024-09-21T09:03:06.244103+0000","last_became_peered":"2024-09-21T09:03:06.244103+0000","last_unstale":"2024-09-21T09:06:20.869907+0000","last_undegraded":"2024-09-21T09:06:20.869907+0000","last_fullsized":"2024-09-21T09:06:20.869907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:20.869741+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:20.869741+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.869741+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:41.358529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"31'6","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:05.204190+0000","last_change":"2024-09-21T09:07:05.204223+0000","last_active":"2024-09-21T09:07:05.204190+0000","last_peered":"2024-09-21T09:07:05.204190+0000","last_clean":"2024-09-21T09:07:05.204190+0000","last_became_active":"2024-09-21T09:03:08.259638+0000","last_became_peered":"2024-09-21T09:03:08.259638+0000","last_unstale":"2024-09-21T09:07:05.204190+0000","last_undegraded":"2024-09-21T09:07:05.204190+0000","last_fullsized":"2024-09-21T09:07:05.204190+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:05.204085+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:05.204085+0000","last_clean_scrub_stamp":"2024-09-21T09:07:05.204085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:46.034899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.840388+0000","last_change":"2024-09-21T09:06:41.840414+0000","last_active":"2024-09-21T09:06:41.840388+0000","last_peered":"2024-09-21T09:06:41.840388+0000","last_clean":"2024-09-21T09:06:41.840388+0000","last_became_active":"2024-09-21T09:03:00.220426+0000","last_became_peered":"2024-09-21T09:03:00.220426+0000","last_unstale":"2024-09-21T09:06:41.840388+0000","last_undegraded":"2024-09-21T09:06:41.840388+0000","last_fullsized":"2024-09-21T09:06:41.840388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:41.840277+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:41.840277+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.840277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:15.703410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:06.486792+0000","last_change":"2024-09-21T09:07:06.486842+0000","last_active":"2024-09-21T09:07:06.486792+0000","last_peered":"2024-09-21T09:07:06.486792+0000","last_clean":"2024-09-21T09:07:06.486792+0000","last_became_active":"2024-09-21T09:02:58.207424+0000","last_became_peered":"2024-09-21T09:02:58.207424+0000","last_unstale":"2024-09-21T09:07:06.486792+0000","last_undegraded":"2024-09-21T09:07:06.486792+0000","last_fullsized":"2024-09-21T09:07:06.486792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:06.486677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:06.486677+0000","last_clean_scrub_stamp":"2024-09-21T09:07:06.486677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:09.583407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:15.483743+0000","last_change":"2024-09-21T09:07:15.483766+0000","last_active":"2024-09-21T09:07:15.483743+0000","last_peered":"2024-09-21T09:07:15.483743+0000","last_clean":"2024-09-21T09:07:15.483743+0000","last_became_active":"2024-09-21T09:03:38.280616+0000","last_became_peered":"2024-09-21T09:03:38.280616+0000","last_unstale":"2024-09-21T09:07:15.483743+0000","last_undegraded":"2024-09-21T09:07:15.483743+0000","last_fullsized":"2024-09-21T09:07:15.483743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:15.483655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:15.483655+0000","last_clean_scrub_stamp":"2024-09-21T09:07:15.483655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:29.737059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'47","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.397782+0000","last_change":"2024-09-21T09:06:26.397832+0000","last_active":"2024-09-21T09:06:26.397782+0000","last_peered":"2024-09-21T09:06:26.397782+0000","last_clean":"2024-09-21T09:06:26.397782+0000","last_became_active":"2024-09-21T09:03:04.233878+0000","last_became_peered":"2024-09-21T09:03:04.233878+0000","last_unstale":"2024-09-21T09:06:26.397782+0000","last_undegraded":"2024-09-21T09:06:26.397782+0000","last_fullsized":"2024-09-21T09:06:26.397782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-09-21T09:06:26.397701+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-09-21T09:06:26.397701+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.397701+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:42.069141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.708319+0000","last_change":"2024-09-21T09:06:17.708341+0000","last_active":"2024-09-21T09:06:17.708319+0000","last_peered":"2024-09-21T09:06:17.708319+0000","last_clean":"2024-09-21T09:06:17.708319+0000","last_became_active":"2024-09-21T09:03:06.247609+0000","last_became_peered":"2024-09-21T09:03:06.247609+0000","last_unstale":"2024-09-21T09:06:17.708319+0000","last_undegraded":"2024-09-21T09:06:17.708319+0000","last_fullsized":"2024-09-21T09:06:17.708319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.708240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.708240+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.708240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:29.114535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.282800+0000","last_change":"2024-09-21T09:06:35.282851+0000","last_active":"2024-09-21T09:06:35.282800+0000","last_peered":"2024-09-21T09:06:35.282800+0000","last_clean":"2024-09-21T09:06:35.282800+0000","last_became_active":"2024-09-21T09:03:08.255717+0000","last_became_peered":"2024-09-21T09:03:08.255717+0000","last_unstale":"2024-09-21T09:06:35.282800+0000","last_undegraded":"2024-09-21T09:06:35.282800+0000","last_fullsized":"2024-09-21T09:06:35.282800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:35.282702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:35.282702+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.282702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:28.033731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.817710+0000","last_change":"2024-09-21T09:06:44.817735+0000","last_active":"2024-09-21T09:06:44.817710+0000","last_peered":"2024-09-21T09:06:44.817710+0000","last_clean":"2024-09-21T09:06:44.817710+0000","last_became_active":"2024-09-21T09:03:00.215804+0000","last_became_peered":"2024-09-21T09:03:00.215804+0000","last_unstale":"2024-09-21T09:06:44.817710+0000","last_undegraded":"2024-09-21T09:06:44.817710+0000","last_fullsized":"2024-09-21T09:06:44.817710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:44.817622+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:44.817622+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.817622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:06.066605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:17.356635+0000","last_change":"2024-09-21T09:07:17.356658+0000","last_active":"2024-09-21T09:07:17.356635+0000","last_peered":"2024-09-21T09:07:17.356635+0000","last_clean":"2024-09-21T09:07:17.356635+0000","last_became_active":"2024-09-21T09:02:58.221286+0000","last_became_peered":"2024-09-21T09:02:58.221286+0000","last_unstale":"2024-09-21T09:07:17.356635+0000","last_undegraded":"2024-09-21T09:07:17.356635+0000","last_fullsized":"2024-09-21T09:07:17.356635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:17.356550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:17.356550+0000","last_clean_scrub_stamp":"2024-09-21T09:07:17.356550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:37.837673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.811610+0000","last_change":"2024-09-21T09:06:34.811636+0000","last_active":"2024-09-21T09:06:34.811610+0000","last_peered":"2024-09-21T09:06:34.811610+0000","last_clean":"2024-09-21T09:06:34.811610+0000","last_became_active":"2024-09-21T09:03:02.224879+0000","last_became_peered":"2024-09-21T09:03:02.224879+0000","last_unstale":"2024-09-21T09:06:34.811610+0000","last_undegraded":"2024-09-21T09:06:34.811610+0000","last_fullsized":"2024-09-21T09:06:34.811610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:34.811505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:34.811505+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.811505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:18.526932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.736574+0000","last_change":"2024-09-21T09:06:24.736614+0000","last_active":"2024-09-21T09:06:24.736574+0000","last_peered":"2024-09-21T09:06:24.736574+0000","last_clean":"2024-09-21T09:06:24.736574+0000","last_became_active":"2024-09-21T09:03:04.239112+0000","last_became_peered":"2024-09-21T09:03:04.239112+0000","last_unstale":"2024-09-21T09:06:24.736574+0000","last_undegraded":"2024-09-21T09:06:24.736574+0000","last_fullsized":"2024-09-21T09:06:24.736574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-09-21T09:06:24.736479+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-09-21T09:06:24.736479+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.736479+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:34.646980+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:53.276661+0000","last_change":"2024-09-21T09:06:53.276683+0000","last_active":"2024-09-21T09:06:53.276661+0000","last_peered":"2024-09-21T09:06:53.276661+0000","last_clean":"2024-09-21T09:06:53.276661+0000","last_became_active":"2024-09-21T09:03:06.250729+0000","last_became_peered":"2024-09-21T09:03:06.250729+0000","last_unstale":"2024-09-21T09:06:53.276661+0000","last_undegraded":"2024-09-21T09:06:53.276661+0000","last_fullsized":"2024-09-21T09:06:53.276661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:53.276571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:53.276571+0000","last_clean_scrub_stamp":"2024-09-21T09:06:53.276571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:56.962969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:33.462299+0000","last_change":"2024-09-21T09:03:08.264701+0000","last_active":"2024-09-21T09:05:33.462299+0000","last_peered":"2024-09-21T09:05:33.462299+0000","last_clean":"2024-09-21T09:05:33.462299+0000","last_became_active":"2024-09-21T09:03:08.264160+0000","last_became_peered":"2024-09-21T09:03:08.264160+0000","last_unstale":"2024-09-21T09:05:33.462299+0000","last_undegraded":"2024-09-21T09:05:33.462299+0000","last_fullsized":"2024-09-21T09:05:33.462299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:06.208497+0000","last_change":"2024-09-21T09:07:06.208522+0000","last_active":"2024-09-21T09:07:06.208497+0000","last_peered":"2024-09-21T09:07:06.208497+0000","last_clean":"2024-09-21T09:07:06.208497+0000","last_became_active":"2024-09-21T09:03:00.208673+0000","last_became_peered":"2024-09-21T09:03:00.208673+0000","last_unstale":"2024-09-21T09:07:06.208497+0000","last_undegraded":"2024-09-21T09:07:06.208497+0000","last_fullsized":"2024-09-21T09:07:06.208497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:07:06.208403+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:07:06.208403+0000","last_clean_scrub_stamp":"2024-09-21T09:07:06.208403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:01.240992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:55.037211+0000","last_change":"2024-09-21T09:06:55.037211+0000","last_active":"2024-09-21T09:06:55.037211+0000","last_peered":"2024-09-21T09:06:55.037211+0000","last_clean":"2024-09-21T09:06:55.037211+0000","last_became_active":"2024-09-21T09:02:58.212751+0000","last_became_peered":"2024-09-21T09:02:58.212751+0000","last_unstale":"2024-09-21T09:06:55.037211+0000","last_undegraded":"2024-09-21T09:06:55.037211+0000","last_fullsized":"2024-09-21T09:06:55.037211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:55.037086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:55.037086+0000","last_clean_scrub_stamp":"2024-09-21T09:06:55.037086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:55.221730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.339319+0000","last_change":"2024-09-21T09:06:28.339342+0000","last_active":"2024-09-21T09:06:28.339319+0000","last_peered":"2024-09-21T09:06:28.339319+0000","last_clean":"2024-09-21T09:06:28.339319+0000","last_became_active":"2024-09-21T09:03:02.222965+0000","last_became_peered":"2024-09-21T09:03:02.222965+0000","last_unstale":"2024-09-21T09:06:28.339319+0000","last_undegraded":"2024-09-21T09:06:28.339319+0000","last_fullsized":"2024-09-21T09:06:28.339319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:28.339237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:28.339237+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.339237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:34.803750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'30","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.308727+0000","last_change":"2024-09-21T09:06:42.308759+0000","last_active":"2024-09-21T09:06:42.308727+0000","last_peered":"2024-09-21T09:06:42.308727+0000","last_clean":"2024-09-21T09:06:42.308727+0000","last_became_active":"2024-09-21T09:03:04.243686+0000","last_became_peered":"2024-09-21T09:03:04.243686+0000","last_unstale":"2024-09-21T09:06:42.308727+0000","last_undegraded":"2024-09-21T09:06:42.308727+0000","last_fullsized":"2024-09-21T09:06:42.308727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2024-09-21T09:06:42.308640+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2024-09-21T09:06:42.308640+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.308640+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:02:38.998283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.330394+0000","last_change":"2024-09-21T09:06:45.330435+0000","last_active":"2024-09-21T09:06:45.330394+0000","last_peered":"2024-09-21T09:06:45.330394+0000","last_clean":"2024-09-21T09:06:45.330394+0000","last_became_active":"2024-09-21T09:03:06.249959+0000","last_became_peered":"2024-09-21T09:03:06.249959+0000","last_unstale":"2024-09-21T09:06:45.330394+0000","last_undegraded":"2024-09-21T09:06:45.330394+0000","last_fullsized":"2024-09-21T09:06:45.330394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:45.330289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:45.330289+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.330289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:06.828858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'6","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:38.404848+0000","last_change":"2024-09-21T09:07:38.404875+0000","last_active":"2024-09-21T09:07:38.404848+0000","last_peered":"2024-09-21T09:07:38.404848+0000","last_clean":"2024-09-21T09:07:38.404848+0000","last_became_active":"2024-09-21T09:03:08.264395+0000","last_became_peered":"2024-09-21T09:03:08.264395+0000","last_unstale":"2024-09-21T09:07:38.404848+0000","last_undegraded":"2024-09-21T09:07:38.404848+0000","last_fullsized":"2024-09-21T09:07:38.404848+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:38.404739+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:38.404739+0000","last_clean_scrub_stamp":"2024-09-21T09:07:38.404739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:49.476870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'14","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.866133+0000","last_change":"2024-09-21T09:06:42.866158+0000","last_active":"2024-09-21T09:06:42.866133+0000","last_peered":"2024-09-21T09:06:42.866133+0000","last_clean":"2024-09-21T09:06:42.866133+0000","last_became_active":"2024-09-21T09:03:00.215748+0000","last_became_peered":"2024-09-21T09:03:00.215748+0000","last_unstale":"2024-09-21T09:06:42.866133+0000","last_undegraded":"2024-09-21T09:06:42.866133+0000","last_fullsized":"2024-09-21T09:06:42.866133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:42.866045+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:42.866045+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.866045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:35.617075+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:03.532942+0000","last_change":"2024-09-21T09:07:03.532942+0000","last_active":"2024-09-21T09:07:03.532942+0000","last_peered":"2024-09-21T09:07:03.532942+0000","last_clean":"2024-09-21T09:07:03.532942+0000","last_became_active":"2024-09-21T09:02:58.203973+0000","last_became_peered":"2024-09-21T09:02:58.203973+0000","last_unstale":"2024-09-21T09:07:03.532942+0000","last_undegraded":"2024-09-21T09:07:03.532942+0000","last_fullsized":"2024-09-21T09:07:03.532942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:03.532761+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:03.532761+0000","last_clean_scrub_stamp":"2024-09-21T09:07:03.532761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:11:46.116897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.378455+0000","last_change":"2024-09-21T09:06:30.378485+0000","last_active":"2024-09-21T09:06:30.378455+0000","last_peered":"2024-09-21T09:06:30.378455+0000","last_clean":"2024-09-21T09:06:30.378455+0000","last_became_active":"2024-09-21T09:03:02.220801+0000","last_became_peered":"2024-09-21T09:03:02.220801+0000","last_unstale":"2024-09-21T09:06:30.378455+0000","last_undegraded":"2024-09-21T09:06:30.378455+0000","last_fullsized":"2024-09-21T09:06:30.378455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:06:30.378369+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:06:30.378369+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.378369+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:45.332862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'39","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.252315+0000","last_change":"2024-09-21T09:06:31.252360+0000","last_active":"2024-09-21T09:06:31.252315+0000","last_peered":"2024-09-21T09:06:31.252315+0000","last_clean":"2024-09-21T09:06:31.252315+0000","last_became_active":"2024-09-21T09:03:04.240857+0000","last_became_peered":"2024-09-21T09:03:04.240857+0000","last_unstale":"2024-09-21T09:06:31.252315+0000","last_undegraded":"2024-09-21T09:06:31.252315+0000","last_fullsized":"2024-09-21T09:06:31.252315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-21T09:06:31.252205+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-21T09:06:31.252205+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.252205+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.717765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.737294+0000","last_change":"2024-09-21T09:06:29.737330+0000","last_active":"2024-09-21T09:06:29.737294+0000","last_peered":"2024-09-21T09:06:29.737294+0000","last_clean":"2024-09-21T09:06:29.737294+0000","last_became_active":"2024-09-21T09:03:06.248030+0000","last_became_peered":"2024-09-21T09:03:06.248030+0000","last_unstale":"2024-09-21T09:06:29.737294+0000","last_undegraded":"2024-09-21T09:06:29.737294+0000","last_fullsized":"2024-09-21T09:06:29.737294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:29.737203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:29.737203+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.737203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:47.781194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'4","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:05:28.461477+0000","last_change":"2024-09-21T09:03:08.264618+0000","last_active":"2024-09-21T09:05:28.461477+0000","last_peered":"2024-09-21T09:05:28.461477+0000","last_clean":"2024-09-21T09:05:28.461477+0000","last_became_active":"2024-09-21T09:03:08.264304+0000","last_became_peered":"2024-09-21T09:03:08.264304+0000","last_unstale":"2024-09-21T09:05:28.461477+0000","last_undegraded":"2024-09-21T09:05:28.461477+0000","last_fullsized":"2024-09-21T09:05:28.461477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:03:07.235392+0000","last_clean_scrub_stamp":"2024-09-21T09:03:07.235392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'22","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.309421+0000","last_change":"2024-09-21T09:06:42.309421+0000","last_active":"2024-09-21T09:06:42.309421+0000","last_peered":"2024-09-21T09:06:42.309421+0000","last_clean":"2024-09-21T09:06:42.309421+0000","last_became_active":"2024-09-21T09:03:00.225936+0000","last_became_peered":"2024-09-21T09:03:00.225936+0000","last_unstale":"2024-09-21T09:06:42.309421+0000","last_undegraded":"2024-09-21T09:06:42.309421+0000","last_fullsized":"2024-09-21T09:06:42.309421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-09-21T09:06:42.309272+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-09-21T09:06:42.309272+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.309272+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:05.305378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:57.825004+0000","last_change":"2024-09-21T09:06:57.825004+0000","last_active":"2024-09-21T09:06:57.825004+0000","last_peered":"2024-09-21T09:06:57.825004+0000","last_clean":"2024-09-21T09:06:57.825004+0000","last_became_active":"2024-09-21T09:02:58.206163+0000","last_became_peered":"2024-09-21T09:02:58.206163+0000","last_unstale":"2024-09-21T09:06:57.825004+0000","last_undegraded":"2024-09-21T09:06:57.825004+0000","last_fullsized":"2024-09-21T09:06:57.825004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:57.824824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:57.824824+0000","last_clean_scrub_stamp":"2024-09-21T09:06:57.824824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:42.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'6","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:01.952440+0000","last_change":"2024-09-21T09:07:01.952440+0000","last_active":"2024-09-21T09:07:01.952440+0000","last_peered":"2024-09-21T09:07:01.952440+0000","last_clean":"2024-09-21T09:07:01.952440+0000","last_became_active":"2024-09-21T09:03:00.220860+0000","last_became_peered":"2024-09-21T09:03:00.220860+0000","last_unstale":"2024-09-21T09:07:01.952440+0000","last_undegraded":"2024-09-21T09:07:01.952440+0000","last_fullsized":"2024-09-21T09:07:01.952440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:01.952257+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:01.952257+0000","last_clean_scrub_stamp":"2024-09-21T09:07:01.952257+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:39.583216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:08.074436+0000","last_change":"2024-09-21T09:07:08.074465+0000","last_active":"2024-09-21T09:07:08.074436+0000","last_peered":"2024-09-21T09:07:08.074436+0000","last_clean":"2024-09-21T09:07:08.074436+0000","last_became_active":"2024-09-21T09:02:58.202579+0000","last_became_peered":"2024-09-21T09:02:58.202579+0000","last_unstale":"2024-09-21T09:07:08.074436+0000","last_undegraded":"2024-09-21T09:07:08.074436+0000","last_fullsized":"2024-09-21T09:07:08.074436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:08.074342+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:08.074342+0000","last_clean_scrub_stamp":"2024-09-21T09:07:08.074342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:25.449462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.266173+0000","last_change":"2024-09-21T09:06:38.266173+0000","last_active":"2024-09-21T09:06:38.266173+0000","last_peered":"2024-09-21T09:06:38.266173+0000","last_clean":"2024-09-21T09:06:38.266173+0000","last_became_active":"2024-09-21T09:03:00.219281+0000","last_became_peered":"2024-09-21T09:03:00.219281+0000","last_unstale":"2024-09-21T09:06:38.266173+0000","last_undegraded":"2024-09-21T09:06:38.266173+0000","last_fullsized":"2024-09-21T09:06:38.266173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:38.266051+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:38.266051+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.266051+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:15.525190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:25.407598+0000","last_change":"2024-09-21T09:07:25.407658+0000","last_active":"2024-09-21T09:07:25.407598+0000","last_peered":"2024-09-21T09:07:25.407598+0000","last_clean":"2024-09-21T09:07:25.407598+0000","last_became_active":"2024-09-21T09:02:58.222856+0000","last_became_peered":"2024-09-21T09:02:58.222856+0000","last_unstale":"2024-09-21T09:07:25.407598+0000","last_undegraded":"2024-09-21T09:07:25.407598+0000","last_fullsized":"2024-09-21T09:07:25.407598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:07:25.407462+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:07:25.407462+0000","last_clean_scrub_stamp":"2024-09-21T09:07:25.407462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:35.672567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:12.164838+0000","last_change":"2024-09-21T09:07:12.164838+0000","last_active":"2024-09-21T09:07:12.164838+0000","last_peered":"2024-09-21T09:07:12.164838+0000","last_clean":"2024-09-21T09:07:12.164838+0000","last_became_active":"2024-09-21T09:03:00.220755+0000","last_became_peered":"2024-09-21T09:03:00.220755+0000","last_unstale":"2024-09-21T09:07:12.164838+0000","last_undegraded":"2024-09-21T09:07:12.164838+0000","last_fullsized":"2024-09-21T09:07:12.164838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:12.164709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:12.164709+0000","last_clean_scrub_stamp":"2024-09-21T09:07:12.164709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:50.036239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:09.116339+0000","last_change":"2024-09-21T09:07:09.116361+0000","last_active":"2024-09-21T09:07:09.116339+0000","last_peered":"2024-09-21T09:07:09.116339+0000","last_clean":"2024-09-21T09:07:09.116339+0000","last_became_active":"2024-09-21T09:02:58.208329+0000","last_became_peered":"2024-09-21T09:02:58.208329+0000","last_unstale":"2024-09-21T09:07:09.116339+0000","last_undegraded":"2024-09-21T09:07:09.116339+0000","last_fullsized":"2024-09-21T09:07:09.116339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:09.116244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:09.116244+0000","last_clean_scrub_stamp":"2024-09-21T09:07:09.116244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:52.166977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'16","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:52.034234+0000","last_change":"2024-09-21T09:06:52.034234+0000","last_active":"2024-09-21T09:06:52.034234+0000","last_peered":"2024-09-21T09:06:52.034234+0000","last_clean":"2024-09-21T09:06:52.034234+0000","last_became_active":"2024-09-21T09:03:00.215554+0000","last_became_peered":"2024-09-21T09:03:00.215554+0000","last_unstale":"2024-09-21T09:06:52.034234+0000","last_undegraded":"2024-09-21T09:06:52.034234+0000","last_fullsized":"2024-09-21T09:06:52.034234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-21T09:06:52.034066+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-21T09:06:52.034066+0000","last_clean_scrub_stamp":"2024-09-21T09:06:52.034066+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:54.024587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:06.021784+0000","last_change":"2024-09-21T09:07:06.021784+0000","last_active":"2024-09-21T09:07:06.021784+0000","last_peered":"2024-09-21T09:07:06.021784+0000","last_clean":"2024-09-21T09:07:06.021784+0000","last_became_active":"2024-09-21T09:02:58.201482+0000","last_became_peered":"2024-09-21T09:02:58.201482+0000","last_unstale":"2024-09-21T09:07:06.021784+0000","last_undegraded":"2024-09-21T09:07:06.021784+0000","last_fullsized":"2024-09-21T09:07:06.021784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:06.021641+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:06.021641+0000","last_clean_scrub_stamp":"2024-09-21T09:07:06.021641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:09.118371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'12","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:59.559444+0000","last_change":"2024-09-21T09:06:59.559444+0000","last_active":"2024-09-21T09:06:59.559444+0000","last_peered":"2024-09-21T09:06:59.559444+0000","last_clean":"2024-09-21T09:06:59.559444+0000","last_became_active":"2024-09-21T09:03:00.223740+0000","last_became_peered":"2024-09-21T09:03:00.223740+0000","last_unstale":"2024-09-21T09:06:59.559444+0000","last_undegraded":"2024-09-21T09:06:59.559444+0000","last_fullsized":"2024-09-21T09:06:59.559444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:06:59.559326+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:06:59.559326+0000","last_clean_scrub_stamp":"2024-09-21T09:06:59.559326+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:54.979937+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:56.502385+0000","last_change":"2024-09-21T09:06:56.502385+0000","last_active":"2024-09-21T09:06:56.502385+0000","last_peered":"2024-09-21T09:06:56.502385+0000","last_clean":"2024-09-21T09:06:56.502385+0000","last_became_active":"2024-09-21T09:02:58.210442+0000","last_became_peered":"2024-09-21T09:02:58.210442+0000","last_unstale":"2024-09-21T09:06:56.502385+0000","last_undegraded":"2024-09-21T09:06:56.502385+0000","last_fullsized":"2024-09-21T09:06:56.502385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:56.502267+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:56.502267+0000","last_clean_scrub_stamp":"2024-09-21T09:06:56.502267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:16.665604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'14","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:58.080667+0000","last_change":"2024-09-21T09:06:58.080667+0000","last_active":"2024-09-21T09:06:58.080667+0000","last_peered":"2024-09-21T09:06:58.080667+0000","last_clean":"2024-09-21T09:06:58.080667+0000","last_became_active":"2024-09-21T09:03:00.216462+0000","last_became_peered":"2024-09-21T09:03:00.216462+0000","last_unstale":"2024-09-21T09:06:58.080667+0000","last_undegraded":"2024-09-21T09:06:58.080667+0000","last_fullsized":"2024-09-21T09:06:58.080667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:58.080556+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:58.080556+0000","last_clean_scrub_stamp":"2024-09-21T09:06:58.080556+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:30.491750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.809331+0000","last_change":"2024-09-21T09:06:46.809331+0000","last_active":"2024-09-21T09:06:46.809331+0000","last_peered":"2024-09-21T09:06:46.809331+0000","last_clean":"2024-09-21T09:06:46.809331+0000","last_became_active":"2024-09-21T09:02:58.218407+0000","last_became_peered":"2024-09-21T09:02:58.218407+0000","last_unstale":"2024-09-21T09:06:46.809331+0000","last_undegraded":"2024-09-21T09:06:46.809331+0000","last_fullsized":"2024-09-21T09:06:46.809331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:46.809183+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:46.809183+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.809183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:36.437428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.367934+0000","last_change":"2024-09-21T09:06:46.367934+0000","last_active":"2024-09-21T09:06:46.367934+0000","last_peered":"2024-09-21T09:06:46.367934+0000","last_clean":"2024-09-21T09:06:46.367934+0000","last_became_active":"2024-09-21T09:03:00.212503+0000","last_became_peered":"2024-09-21T09:03:00.212503+0000","last_unstale":"2024-09-21T09:06:46.367934+0000","last_undegraded":"2024-09-21T09:06:46.367934+0000","last_fullsized":"2024-09-21T09:06:46.367934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:46.367803+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:46.367803+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.367803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:25:59.172888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:07.039659+0000","last_change":"2024-09-21T09:07:07.039659+0000","last_active":"2024-09-21T09:07:07.039659+0000","last_peered":"2024-09-21T09:07:07.039659+0000","last_clean":"2024-09-21T09:07:07.039659+0000","last_became_active":"2024-09-21T09:02:58.201812+0000","last_became_peered":"2024-09-21T09:02:58.201812+0000","last_unstale":"2024-09-21T09:07:07.039659+0000","last_undegraded":"2024-09-21T09:07:07.039659+0000","last_fullsized":"2024-09-21T09:07:07.039659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:07.039529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:07.039529+0000","last_clean_scrub_stamp":"2024-09-21T09:07:07.039529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:51.654459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'6","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.362863+0000","last_change":"2024-09-21T09:06:44.362915+0000","last_active":"2024-09-21T09:06:44.362863+0000","last_peered":"2024-09-21T09:06:44.362863+0000","last_clean":"2024-09-21T09:06:44.362863+0000","last_became_active":"2024-09-21T09:03:00.224456+0000","last_became_peered":"2024-09-21T09:03:00.224456+0000","last_unstale":"2024-09-21T09:06:44.362863+0000","last_undegraded":"2024-09-21T09:06:44.362863+0000","last_fullsized":"2024-09-21T09:06:44.362863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:44.362734+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:44.362734+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.362734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:35.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:23.397092+0000","last_change":"2024-09-21T09:07:23.397117+0000","last_active":"2024-09-21T09:07:23.397092+0000","last_peered":"2024-09-21T09:07:23.397092+0000","last_clean":"2024-09-21T09:07:23.397092+0000","last_became_active":"2024-09-21T09:02:58.222191+0000","last_became_peered":"2024-09-21T09:02:58.222191+0000","last_unstale":"2024-09-21T09:07:23.397092+0000","last_undegraded":"2024-09-21T09:07:23.397092+0000","last_fullsized":"2024-09-21T09:07:23.397092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:23.397000+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:23.397000+0000","last_clean_scrub_stamp":"2024-09-21T09:07:23.397000+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:53.755118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'6","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.249744+0000","last_change":"2024-09-21T09:06:51.249772+0000","last_active":"2024-09-21T09:06:51.249744+0000","last_peered":"2024-09-21T09:06:51.249744+0000","last_clean":"2024-09-21T09:06:51.249744+0000","last_became_active":"2024-09-21T09:03:00.220639+0000","last_became_peered":"2024-09-21T09:03:00.220639+0000","last_unstale":"2024-09-21T09:06:51.249744+0000","last_undegraded":"2024-09-21T09:06:51.249744+0000","last_fullsized":"2024-09-21T09:06:51.249744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:51.249657+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:51.249657+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.249657+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:04.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:10.109282+0000","last_change":"2024-09-21T09:07:10.109282+0000","last_active":"2024-09-21T09:07:10.109282+0000","last_peered":"2024-09-21T09:07:10.109282+0000","last_clean":"2024-09-21T09:07:10.109282+0000","last_became_active":"2024-09-21T09:02:58.208346+0000","last_became_peered":"2024-09-21T09:02:58.208346+0000","last_unstale":"2024-09-21T09:07:10.109282+0000","last_undegraded":"2024-09-21T09:07:10.109282+0000","last_fullsized":"2024-09-21T09:07:10.109282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:10.109160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:10.109160+0000","last_clean_scrub_stamp":"2024-09-21T09:07:10.109160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:50.151115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'6","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.941260+0000","last_change":"2024-09-21T09:06:43.941260+0000","last_active":"2024-09-21T09:06:43.941260+0000","last_peered":"2024-09-21T09:06:43.941260+0000","last_clean":"2024-09-21T09:06:43.941260+0000","last_became_active":"2024-09-21T09:03:00.222651+0000","last_became_peered":"2024-09-21T09:03:00.222651+0000","last_unstale":"2024-09-21T09:06:43.941260+0000","last_undegraded":"2024-09-21T09:06:43.941260+0000","last_fullsized":"2024-09-21T09:06:43.941260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:43.941138+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:43.941138+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.941138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:54.251590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.580125+0000","last_change":"2024-09-21T09:07:00.580125+0000","last_active":"2024-09-21T09:07:00.580125+0000","last_peered":"2024-09-21T09:07:00.580125+0000","last_clean":"2024-09-21T09:07:00.580125+0000","last_became_active":"2024-09-21T09:02:58.208495+0000","last_became_peered":"2024-09-21T09:02:58.208495+0000","last_unstale":"2024-09-21T09:07:00.580125+0000","last_undegraded":"2024-09-21T09:07:00.580125+0000","last_fullsized":"2024-09-21T09:07:00.580125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:00.579976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:00.579976+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.579976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:11.761034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'4","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.446658+0000","last_change":"2024-09-21T09:06:51.446658+0000","last_active":"2024-09-21T09:06:51.446658+0000","last_peered":"2024-09-21T09:06:51.446658+0000","last_clean":"2024-09-21T09:06:51.446658+0000","last_became_active":"2024-09-21T09:03:00.222343+0000","last_became_peered":"2024-09-21T09:03:00.222343+0000","last_unstale":"2024-09-21T09:06:51.446658+0000","last_undegraded":"2024-09-21T09:06:51.446658+0000","last_fullsized":"2024-09-21T09:06:51.446658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-21T09:06:51.446466+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-21T09:06:51.446466+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.446466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.923486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:58.568019+0000","last_change":"2024-09-21T09:06:58.568019+0000","last_active":"2024-09-21T09:06:58.568019+0000","last_peered":"2024-09-21T09:06:58.568019+0000","last_clean":"2024-09-21T09:06:58.568019+0000","last_became_active":"2024-09-21T09:02:58.208630+0000","last_became_peered":"2024-09-21T09:02:58.208630+0000","last_unstale":"2024-09-21T09:06:58.568019+0000","last_undegraded":"2024-09-21T09:06:58.568019+0000","last_fullsized":"2024-09-21T09:06:58.568019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:58.567895+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:58.567895+0000","last_clean_scrub_stamp":"2024-09-21T09:06:58.567895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:30.979089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'18","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:09.817950+0000","last_change":"2024-09-21T09:07:09.817973+0000","last_active":"2024-09-21T09:07:09.817950+0000","last_peered":"2024-09-21T09:07:09.817950+0000","last_clean":"2024-09-21T09:07:09.817950+0000","last_became_active":"2024-09-21T09:03:38.282951+0000","last_became_peered":"2024-09-21T09:03:38.282951+0000","last_unstale":"2024-09-21T09:07:09.817950+0000","last_undegraded":"2024-09-21T09:07:09.817950+0000","last_fullsized":"2024-09-21T09:07:09.817950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-21T09:07:09.817858+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-21T09:07:09.817858+0000","last_clean_scrub_stamp":"2024-09-21T09:07:09.817858+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:47.448817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:18.392755+0000","last_change":"2024-09-21T09:07:18.392755+0000","last_active":"2024-09-21T09:07:18.392755+0000","last_peered":"2024-09-21T09:07:18.392755+0000","last_clean":"2024-09-21T09:07:18.392755+0000","last_became_active":"2024-09-21T09:02:58.214717+0000","last_became_peered":"2024-09-21T09:02:58.214717+0000","last_unstale":"2024-09-21T09:07:18.392755+0000","last_undegraded":"2024-09-21T09:07:18.392755+0000","last_fullsized":"2024-09-21T09:07:18.392755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:18.392639+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:18.392639+0000","last_clean_scrub_stamp":"2024-09-21T09:07:18.392639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:11.253648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.344758+0000","last_change":"2024-09-21T09:06:38.344758+0000","last_active":"2024-09-21T09:06:38.344758+0000","last_peered":"2024-09-21T09:06:38.344758+0000","last_clean":"2024-09-21T09:06:38.344758+0000","last_became_active":"2024-09-21T09:03:00.226411+0000","last_became_peered":"2024-09-21T09:03:00.226411+0000","last_unstale":"2024-09-21T09:06:38.344758+0000","last_undegraded":"2024-09-21T09:06:38.344758+0000","last_fullsized":"2024-09-21T09:06:38.344758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:38.344633+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:38.344633+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.344633+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:29.901754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:10.317392+0000","last_change":"2024-09-21T09:07:10.317392+0000","last_active":"2024-09-21T09:07:10.317392+0000","last_peered":"2024-09-21T09:07:10.317392+0000","last_clean":"2024-09-21T09:07:10.317392+0000","last_became_active":"2024-09-21T09:02:58.224058+0000","last_became_peered":"2024-09-21T09:02:58.224058+0000","last_unstale":"2024-09-21T09:07:10.317392+0000","last_undegraded":"2024-09-21T09:07:10.317392+0000","last_fullsized":"2024-09-21T09:07:10.317392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:10.317229+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:10.317229+0000","last_clean_scrub_stamp":"2024-09-21T09:07:10.317229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:03:49.909565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'4","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:52.260743+0000","last_change":"2024-09-21T09:06:52.260743+0000","last_active":"2024-09-21T09:06:52.260743+0000","last_peered":"2024-09-21T09:06:52.260743+0000","last_clean":"2024-09-21T09:06:52.260743+0000","last_became_active":"2024-09-21T09:03:00.218422+0000","last_became_peered":"2024-09-21T09:03:00.218422+0000","last_unstale":"2024-09-21T09:06:52.260743+0000","last_undegraded":"2024-09-21T09:06:52.260743+0000","last_fullsized":"2024-09-21T09:06:52.260743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:52.260581+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:52.260581+0000","last_clean_scrub_stamp":"2024-09-21T09:06:52.260581+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:19.039754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:50.894242+0000","last_change":"2024-09-21T09:06:50.894242+0000","last_active":"2024-09-21T09:06:50.894242+0000","last_peered":"2024-09-21T09:06:50.894242+0000","last_clean":"2024-09-21T09:06:50.894242+0000","last_became_active":"2024-09-21T09:02:58.218299+0000","last_became_peered":"2024-09-21T09:02:58.218299+0000","last_unstale":"2024-09-21T09:06:50.894242+0000","last_undegraded":"2024-09-21T09:06:50.894242+0000","last_fullsized":"2024-09-21T09:06:50.894242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:50.894097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:50.894097+0000","last_clean_scrub_stamp":"2024-09-21T09:06:50.894097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:31.934174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'12","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.393566+0000","last_change":"2024-09-21T09:06:45.393566+0000","last_active":"2024-09-21T09:06:45.393566+0000","last_peered":"2024-09-21T09:06:45.393566+0000","last_clean":"2024-09-21T09:06:45.393566+0000","last_became_active":"2024-09-21T09:03:00.212838+0000","last_became_peered":"2024-09-21T09:03:00.212838+0000","last_unstale":"2024-09-21T09:06:45.393566+0000","last_undegraded":"2024-09-21T09:06:45.393566+0000","last_fullsized":"2024-09-21T09:06:45.393566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:06:45.393449+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:06:45.393449+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.393449+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:43.161382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:14.374192+0000","last_change":"2024-09-21T09:07:14.374192+0000","last_active":"2024-09-21T09:07:14.374192+0000","last_peered":"2024-09-21T09:07:14.374192+0000","last_clean":"2024-09-21T09:07:14.374192+0000","last_became_active":"2024-09-21T09:02:58.218776+0000","last_became_peered":"2024-09-21T09:02:58.218776+0000","last_unstale":"2024-09-21T09:07:14.374192+0000","last_undegraded":"2024-09-21T09:07:14.374192+0000","last_fullsized":"2024-09-21T09:07:14.374192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:14.374083+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:14.374083+0000","last_clean_scrub_stamp":"2024-09-21T09:07:14.374083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:25.732715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:16.322263+0000","last_change":"2024-09-21T09:07:16.322263+0000","last_active":"2024-09-21T09:07:16.322263+0000","last_peered":"2024-09-21T09:07:16.322263+0000","last_clean":"2024-09-21T09:07:16.322263+0000","last_became_active":"2024-09-21T09:02:58.218757+0000","last_became_peered":"2024-09-21T09:02:58.218757+0000","last_unstale":"2024-09-21T09:07:16.322263+0000","last_undegraded":"2024-09-21T09:07:16.322263+0000","last_fullsized":"2024-09-21T09:07:16.322263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:16.322131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:16.322131+0000","last_clean_scrub_stamp":"2024-09-21T09:07:16.322131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:55.648243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'6","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.021268+0000","last_change":"2024-09-21T09:07:00.021303+0000","last_active":"2024-09-21T09:07:00.021268+0000","last_peered":"2024-09-21T09:07:00.021268+0000","last_clean":"2024-09-21T09:07:00.021268+0000","last_became_active":"2024-09-21T09:03:00.216424+0000","last_became_peered":"2024-09-21T09:03:00.216424+0000","last_unstale":"2024-09-21T09:07:00.021268+0000","last_undegraded":"2024-09-21T09:07:00.021268+0000","last_fullsized":"2024-09-21T09:07:00.021268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:00.021180+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:00.021180+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.021180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:11.202238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.986094+0000","last_change":"2024-09-21T09:07:00.986094+0000","last_active":"2024-09-21T09:07:00.986094+0000","last_peered":"2024-09-21T09:07:00.986094+0000","last_clean":"2024-09-21T09:07:00.986094+0000","last_became_active":"2024-09-21T09:02:58.208437+0000","last_became_peered":"2024-09-21T09:02:58.208437+0000","last_unstale":"2024-09-21T09:07:00.986094+0000","last_undegraded":"2024-09-21T09:07:00.986094+0000","last_fullsized":"2024-09-21T09:07:00.986094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:00.985977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:00.985977+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.985977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:00.711201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.386389+0000","last_change":"2024-09-21T09:06:47.386417+0000","last_active":"2024-09-21T09:06:47.386389+0000","last_peered":"2024-09-21T09:06:47.386389+0000","last_clean":"2024-09-21T09:06:47.386389+0000","last_became_active":"2024-09-21T09:03:00.219010+0000","last_became_peered":"2024-09-21T09:03:00.219010+0000","last_unstale":"2024-09-21T09:06:47.386389+0000","last_undegraded":"2024-09-21T09:06:47.386389+0000","last_fullsized":"2024-09-21T09:06:47.386389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:47.386301+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:47.386301+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.386301+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:10.395718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673023,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":136073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705726,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":722309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705725,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":723502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":417792,"data_stored":134220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:07:39.032 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:39.032 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:39.033 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:39.033 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-21T09:03:07.235392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=3, tm_sec=7, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=6, tm_sec=14, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:07:39.034 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T09:07:59.035 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:07:59.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.147+0000 7fac46a65640 1 Processor -- start 2024-09-21T09:07:59.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.147+0000 7fac46a65640 1 -- start start 2024-09-21T09:07:59.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.148+0000 7fac46a65640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fac4012e940 0x7fac40130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:07:59.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.148+0000 7fac46a65640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac4006eba0 con 0x7fac4006eda0 2024-09-21T09:07:59.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.148+0000 7fac46a65640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fac4006d2f0 con 0x7fac4012e940 2024-09-21T09:07:59.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.148+0000 7fac3ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fac4012e940 0x7fac40130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:07:59.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.148+0000 7fac3ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fac4012e940 0x7fac40130d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60320/0 (socket says 172.21.15.44:60320) 2024-09-21T09:07:59.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.148+0000 7fac3ffff640 1 -- 172.21.15.44:0/3228698433 learned_addr learned my addr 172.21.15.44:0/3228698433 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:07:59.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.148+0000 7fac3ffff640 1 -- 172.21.15.44:0/3228698433 >> v1:172.21.15.44:6789/0 conn(0x7fac4006eda0 legacy=0x7fac4006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:59.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.148+0000 7fac3ffff640 1 -- 172.21.15.44:0/3228698433 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac40070d50 con 0x7fac4012e940 2024-09-21T09:07:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.149+0000 7fac3ffff640 1 --2- 172.21.15.44:0/3228698433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac4012e940 0x7fac40130d30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fac340097f0 tx=0x7fac3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41202e19cae5a945 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:07:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.149+0000 7fac3f7fe640 1 -- 172.21.15.44:0/3228698433 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac34037070 con 0x7fac4012e940 2024-09-21T09:07:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.149+0000 7fac3f7fe640 1 -- 172.21.15.44:0/3228698433 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac34032440 con 0x7fac4012e940 2024-09-21T09:07:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.149+0000 7fac3f7fe640 1 -- 172.21.15.44:0/3228698433 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac34032740 con 0x7fac4012e940 2024-09-21T09:07:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.150+0000 7fac46a65640 1 -- 172.21.15.44:0/3228698433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac4012e940 msgr2=0x7fac40130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.150+0000 7fac46a65640 1 --2- 172.21.15.44:0/3228698433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac4012e940 0x7fac40130d30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fac340097f0 tx=0x7fac3402a270 comp rx=0 tx=0).stop 2024-09-21T09:07:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.150+0000 7fac46a65640 1 -- 172.21.15.44:0/3228698433 shutdown_connections 2024-09-21T09:07:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.150+0000 7fac46a65640 1 --2- 172.21.15.44:0/3228698433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac4012e940 0x7fac40130d30 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:07:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.150+0000 7fac46a65640 1 -- 172.21.15.44:0/3228698433 >> 172.21.15.44:0/3228698433 conn(0x7fac4009a890 msgr2=0x7fac4009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:07:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.150+0000 7fac46a65640 1 -- 172.21.15.44:0/3228698433 shutdown_connections 2024-09-21T09:07:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.150+0000 7fac46a65640 1 -- 172.21.15.44:0/3228698433 wait complete. 2024-09-21T09:07:59.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.151+0000 7fac46a65640 1 Processor -- start 2024-09-21T09:07:59.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.151+0000 7fac46a65640 1 -- start start 2024-09-21T09:07:59.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.151+0000 7fac46a65640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac4006eda0 0x7fac400966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:07:59.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.151+0000 7fac46a65640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fac4006fcd0 con 0x7fac4006eda0 2024-09-21T09:07:59.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.151+0000 7fac44801640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac4006eda0 0x7fac400966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:07:59.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.151+0000 7fac44801640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac4006eda0 0x7fac400966e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60322/0 (socket says 172.21.15.44:60322) 2024-09-21T09:07:59.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.151+0000 7fac44801640 1 -- 172.21.15.44:0/866475440 learned_addr learned my addr 172.21.15.44:0/866475440 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:07:59.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.152+0000 7fac44801640 1 -- 172.21.15.44:0/866475440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4012b1b0 con 0x7fac4006eda0 2024-09-21T09:07:59.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.152+0000 7fac44801640 1 --2- 172.21.15.44:0/866475440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac4006eda0 0x7fac400966e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fac3000c380 tx=0x7fac3000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:07:59.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.152+0000 7fac3d7fa640 1 -- 172.21.15.44:0/866475440 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac30005200 con 0x7fac4006eda0 2024-09-21T09:07:59.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.152+0000 7fac3d7fa640 1 -- 172.21.15.44:0/866475440 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac300053c0 con 0x7fac4006eda0 2024-09-21T09:07:59.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.152+0000 7fac3d7fa640 1 -- 172.21.15.44:0/866475440 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac30007190 con 0x7fac4006eda0 2024-09-21T09:07:59.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.152+0000 7fac46a65640 1 -- 172.21.15.44:0/866475440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac401264f0 con 0x7fac4006eda0 2024-09-21T09:07:59.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.152+0000 7fac46a65640 1 -- 172.21.15.44:0/866475440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac40096c20 con 0x7fac4006eda0 2024-09-21T09:07:59.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.153+0000 7fac3d7fa640 1 -- 172.21.15.44:0/866475440 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fac30007330 con 0x7fac4006eda0 2024-09-21T09:07:59.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.153+0000 7fac46a65640 1 -- 172.21.15.44:0/866475440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac4006f180 con 0x7fac4006eda0 2024-09-21T09:07:59.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.153+0000 7fac3d7fa640 1 --2- 172.21.15.44:0/866475440 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fac2c0382a0 0x7fac2c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:07:59.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.153+0000 7fac3d7fa640 1 -- 172.21.15.44:0/866475440 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fac3004b080 con 0x7fac4006eda0 2024-09-21T09:07:59.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.154+0000 7fac3ffff640 1 --2- 172.21.15.44:0/866475440 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fac2c0382a0 0x7fac2c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:07:59.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.154+0000 7fac3ffff640 1 --2- 172.21.15.44:0/866475440 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fac2c0382a0 0x7fac2c03a760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fac34034000 tx=0x7fac3402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:07:59.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.158+0000 7fac3d7fa640 1 -- 172.21.15.44:0/866475440 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fac30007620 con 0x7fac4006eda0 2024-09-21T09:07:59.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.330+0000 7fac46a65640 1 -- 172.21.15.44:0/866475440 --> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac4012ad10 con 0x7fac2c0382a0 2024-09-21T09:07:59.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.345+0000 7fac3d7fa640 1 -- 172.21.15.44:0/866475440 <== mgr.4101 v2:172.21.15.178:6824/968828701 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665953 (secure 0 0 0) 0x7fac34032740 con 0x7fac2c0382a0 2024-09-21T09:07:59.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T09:07:59.360 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-21T09:07:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.350+0000 7fac46a65640 1 -- 172.21.15.44:0/866475440 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fac2c0382a0 msgr2=0x7fac2c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.350+0000 7fac46a65640 1 --2- 172.21.15.44:0/866475440 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fac2c0382a0 0x7fac2c03a760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fac34034000 tx=0x7fac3402e000 comp rx=0 tx=0).stop 2024-09-21T09:07:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.350+0000 7fac46a65640 1 -- 172.21.15.44:0/866475440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac4006eda0 msgr2=0x7fac400966e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.350+0000 7fac46a65640 1 --2- 172.21.15.44:0/866475440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac4006eda0 0x7fac400966e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fac3000c380 tx=0x7fac3000c840 comp rx=0 tx=0).stop 2024-09-21T09:07:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.350+0000 7fac46a65640 1 -- 172.21.15.44:0/866475440 shutdown_connections 2024-09-21T09:07:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.350+0000 7fac46a65640 1 --2- 172.21.15.44:0/866475440 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fac2c0382a0 0x7fac2c03a760 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:07:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.350+0000 7fac46a65640 1 --2- 172.21.15.44:0/866475440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac4006eda0 0x7fac400966e0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:07:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.350+0000 7fac46a65640 1 -- 172.21.15.44:0/866475440 >> 172.21.15.44:0/866475440 conn(0x7fac4009a890 msgr2=0x7fac40071300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:07:59.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.350+0000 7fac46a65640 1 -- 172.21.15.44:0/866475440 shutdown_connections 2024-09-21T09:07:59.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.350+0000 7fac46a65640 1 -- 172.21.15.44:0/866475440 wait complete. 2024-09-21T09:07:59.364 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-09-21T09:07:58.518842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5097,"num_read_kb":4682,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4789,"ondisk_log_size":4789,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":123360,"kb_used_data":2784,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377364000,"statfs":{"total":386547056640,"available":386420736000,"internally_reserved":0,"allocated":2850816,"data_stored":1716104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":123397911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003412"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:08.844076+0000","last_change":"2024-09-21T09:07:08.844101+0000","last_active":"2024-09-21T09:07:08.844076+0000","last_peered":"2024-09-21T09:07:08.844076+0000","last_clean":"2024-09-21T09:07:08.844076+0000","last_became_active":"2024-09-21T09:03:38.283357+0000","last_became_peered":"2024-09-21T09:03:38.283357+0000","last_unstale":"2024-09-21T09:07:08.844076+0000","last_undegraded":"2024-09-21T09:07:08.844076+0000","last_fullsized":"2024-09-21T09:07:08.844076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:08.843993+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:08.843993+0000","last_clean_scrub_stamp":"2024-09-21T09:07:08.843993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:08.569217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'20","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.326848+0000","last_change":"2024-09-21T09:06:41.326875+0000","last_active":"2024-09-21T09:06:41.326848+0000","last_peered":"2024-09-21T09:06:41.326848+0000","last_clean":"2024-09-21T09:06:41.326848+0000","last_became_active":"2024-09-21T09:03:00.226067+0000","last_became_peered":"2024-09-21T09:03:00.226067+0000","last_unstale":"2024-09-21T09:06:41.326848+0000","last_undegraded":"2024-09-21T09:06:41.326848+0000","last_fullsized":"2024-09-21T09:06:41.326848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-09-21T09:06:41.326750+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-09-21T09:06:41.326750+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.326750+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:11.322304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:53.042423+0000","last_change":"2024-09-21T09:06:53.042423+0000","last_active":"2024-09-21T09:06:53.042423+0000","last_peered":"2024-09-21T09:06:53.042423+0000","last_clean":"2024-09-21T09:06:53.042423+0000","last_became_active":"2024-09-21T09:02:58.212828+0000","last_became_peered":"2024-09-21T09:02:58.212828+0000","last_unstale":"2024-09-21T09:06:53.042423+0000","last_undegraded":"2024-09-21T09:06:53.042423+0000","last_fullsized":"2024-09-21T09:06:53.042423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:53.042305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:53.042305+0000","last_clean_scrub_stamp":"2024-09-21T09:06:53.042305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:10.826523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.265814+0000","last_change":"2024-09-21T09:06:30.265847+0000","last_active":"2024-09-21T09:06:30.265814+0000","last_peered":"2024-09-21T09:06:30.265814+0000","last_clean":"2024-09-21T09:06:30.265814+0000","last_became_active":"2024-09-21T09:03:00.222333+0000","last_became_peered":"2024-09-21T09:03:00.222333+0000","last_unstale":"2024-09-21T09:06:30.265814+0000","last_undegraded":"2024-09-21T09:06:30.265814+0000","last_fullsized":"2024-09-21T09:06:30.265814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:30.265727+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:30.265727+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.265727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:36.517568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:13.369349+0000","last_change":"2024-09-21T09:07:13.369370+0000","last_active":"2024-09-21T09:07:13.369349+0000","last_peered":"2024-09-21T09:07:13.369349+0000","last_clean":"2024-09-21T09:07:13.369349+0000","last_became_active":"2024-09-21T09:02:58.221214+0000","last_became_peered":"2024-09-21T09:02:58.221214+0000","last_unstale":"2024-09-21T09:07:13.369349+0000","last_undegraded":"2024-09-21T09:07:13.369349+0000","last_fullsized":"2024-09-21T09:07:13.369349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:13.369253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:13.369253+0000","last_clean_scrub_stamp":"2024-09-21T09:07:13.369253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:49.626494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.250533+0000","last_change":"2024-09-21T09:06:35.250559+0000","last_active":"2024-09-21T09:06:35.250533+0000","last_peered":"2024-09-21T09:06:35.250533+0000","last_clean":"2024-09-21T09:06:35.250533+0000","last_became_active":"2024-09-21T09:03:00.221451+0000","last_became_peered":"2024-09-21T09:03:00.221451+0000","last_unstale":"2024-09-21T09:06:35.250533+0000","last_undegraded":"2024-09-21T09:06:35.250533+0000","last_fullsized":"2024-09-21T09:06:35.250533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:35.250442+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:35.250442+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.250442+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:20.257549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.754424+0000","last_change":"2024-09-21T09:07:00.754467+0000","last_active":"2024-09-21T09:07:00.754424+0000","last_peered":"2024-09-21T09:07:00.754424+0000","last_clean":"2024-09-21T09:07:00.754424+0000","last_became_active":"2024-09-21T09:02:58.207683+0000","last_became_peered":"2024-09-21T09:02:58.207683+0000","last_unstale":"2024-09-21T09:07:00.754424+0000","last_undegraded":"2024-09-21T09:07:00.754424+0000","last_fullsized":"2024-09-21T09:07:00.754424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:00.754339+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:00.754339+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.754339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:18.538557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'10","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:04.189682+0000","last_change":"2024-09-21T09:07:04.189715+0000","last_active":"2024-09-21T09:07:04.189682+0000","last_peered":"2024-09-21T09:07:04.189682+0000","last_clean":"2024-09-21T09:07:04.189682+0000","last_became_active":"2024-09-21T09:03:00.210589+0000","last_became_peered":"2024-09-21T09:03:00.210589+0000","last_unstale":"2024-09-21T09:07:04.189682+0000","last_undegraded":"2024-09-21T09:07:04.189682+0000","last_fullsized":"2024-09-21T09:07:04.189682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:07:04.189564+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:07:04.189564+0000","last_clean_scrub_stamp":"2024-09-21T09:07:04.189564+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:36.569469+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"31'6","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:08.284930+0000","last_change":"2024-09-21T09:07:08.284930+0000","last_active":"2024-09-21T09:07:08.284930+0000","last_peered":"2024-09-21T09:07:08.284930+0000","last_clean":"2024-09-21T09:07:08.284930+0000","last_became_active":"2024-09-21T09:02:58.224630+0000","last_became_peered":"2024-09-21T09:02:58.224630+0000","last_unstale":"2024-09-21T09:07:08.284930+0000","last_undegraded":"2024-09-21T09:07:08.284930+0000","last_fullsized":"2024-09-21T09:07:08.284930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:08.284770+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:08.284770+0000","last_clean_scrub_stamp":"2024-09-21T09:07:08.284770+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:56.353696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'6","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:55.505244+0000","last_change":"2024-09-21T09:06:55.505244+0000","last_active":"2024-09-21T09:06:55.505244+0000","last_peered":"2024-09-21T09:06:55.505244+0000","last_clean":"2024-09-21T09:06:55.505244+0000","last_became_active":"2024-09-21T09:03:00.217048+0000","last_became_peered":"2024-09-21T09:03:00.217048+0000","last_unstale":"2024-09-21T09:06:55.505244+0000","last_undegraded":"2024-09-21T09:06:55.505244+0000","last_fullsized":"2024-09-21T09:06:55.505244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:55.505082+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:55.505082+0000","last_clean_scrub_stamp":"2024-09-21T09:06:55.505082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:44.261254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:56.842183+0000","last_change":"2024-09-21T09:06:56.842183+0000","last_active":"2024-09-21T09:06:56.842183+0000","last_peered":"2024-09-21T09:06:56.842183+0000","last_clean":"2024-09-21T09:06:56.842183+0000","last_became_active":"2024-09-21T09:02:58.205515+0000","last_became_peered":"2024-09-21T09:02:58.205515+0000","last_unstale":"2024-09-21T09:06:56.842183+0000","last_undegraded":"2024-09-21T09:06:56.842183+0000","last_fullsized":"2024-09-21T09:06:56.842183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:56.841999+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:56.841999+0000","last_clean_scrub_stamp":"2024-09-21T09:06:56.841999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:47.146653+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'14","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.235193+0000","last_change":"2024-09-21T09:06:32.235193+0000","last_active":"2024-09-21T09:06:32.235193+0000","last_peered":"2024-09-21T09:06:32.235193+0000","last_clean":"2024-09-21T09:06:32.235193+0000","last_became_active":"2024-09-21T09:03:00.221117+0000","last_became_peered":"2024-09-21T09:03:00.221117+0000","last_unstale":"2024-09-21T09:06:32.235193+0000","last_undegraded":"2024-09-21T09:06:32.235193+0000","last_fullsized":"2024-09-21T09:06:32.235193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:32.235081+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:32.235081+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.235081+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:09.067914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:33.466695+0000","last_change":"2024-09-21T09:07:33.466695+0000","last_active":"2024-09-21T09:07:33.466695+0000","last_peered":"2024-09-21T09:07:33.466695+0000","last_clean":"2024-09-21T09:07:33.466695+0000","last_became_active":"2024-09-21T09:02:58.210702+0000","last_became_peered":"2024-09-21T09:02:58.210702+0000","last_unstale":"2024-09-21T09:07:33.466695+0000","last_undegraded":"2024-09-21T09:07:33.466695+0000","last_fullsized":"2024-09-21T09:07:33.466695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:33.466551+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:33.466551+0000","last_clean_scrub_stamp":"2024-09-21T09:07:33.466551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:13.288063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.841450+0000","last_change":"2024-09-21T09:06:43.841450+0000","last_active":"2024-09-21T09:06:43.841450+0000","last_peered":"2024-09-21T09:06:43.841450+0000","last_clean":"2024-09-21T09:06:43.841450+0000","last_became_active":"2024-09-21T09:03:00.220725+0000","last_became_peered":"2024-09-21T09:03:00.220725+0000","last_unstale":"2024-09-21T09:06:43.841450+0000","last_undegraded":"2024-09-21T09:06:43.841450+0000","last_fullsized":"2024-09-21T09:06:43.841450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:43.841334+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:43.841334+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.841334+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:18.385562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.951210+0000","last_change":"2024-09-21T09:06:48.951210+0000","last_active":"2024-09-21T09:06:48.951210+0000","last_peered":"2024-09-21T09:06:48.951210+0000","last_clean":"2024-09-21T09:06:48.951210+0000","last_became_active":"2024-09-21T09:02:58.216712+0000","last_became_peered":"2024-09-21T09:02:58.216712+0000","last_unstale":"2024-09-21T09:06:48.951210+0000","last_undegraded":"2024-09-21T09:06:48.951210+0000","last_fullsized":"2024-09-21T09:06:48.951210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:48.951088+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:48.951088+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.951088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:39.255743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'14","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.817668+0000","last_change":"2024-09-21T09:06:45.817668+0000","last_active":"2024-09-21T09:06:45.817668+0000","last_peered":"2024-09-21T09:06:45.817668+0000","last_clean":"2024-09-21T09:06:45.817668+0000","last_became_active":"2024-09-21T09:03:00.222593+0000","last_became_peered":"2024-09-21T09:03:00.222593+0000","last_unstale":"2024-09-21T09:06:45.817668+0000","last_undegraded":"2024-09-21T09:06:45.817668+0000","last_fullsized":"2024-09-21T09:06:45.817668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:45.817550+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:45.817550+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.817550+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:37.374671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'12","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:54.260803+0000","last_change":"2024-09-21T09:06:54.260803+0000","last_active":"2024-09-21T09:06:54.260803+0000","last_peered":"2024-09-21T09:06:54.260803+0000","last_clean":"2024-09-21T09:06:54.260803+0000","last_became_active":"2024-09-21T09:03:00.219923+0000","last_became_peered":"2024-09-21T09:03:00.219923+0000","last_unstale":"2024-09-21T09:06:54.260803+0000","last_undegraded":"2024-09-21T09:06:54.260803+0000","last_fullsized":"2024-09-21T09:06:54.260803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:06:54.260650+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:06:54.260650+0000","last_clean_scrub_stamp":"2024-09-21T09:06:54.260650+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:57.689493+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:52.471725+0000","last_change":"2024-09-21T09:06:52.471725+0000","last_active":"2024-09-21T09:06:52.471725+0000","last_peered":"2024-09-21T09:06:52.471725+0000","last_clean":"2024-09-21T09:06:52.471725+0000","last_became_active":"2024-09-21T09:02:58.210936+0000","last_became_peered":"2024-09-21T09:02:58.210936+0000","last_unstale":"2024-09-21T09:06:52.471725+0000","last_undegraded":"2024-09-21T09:06:52.471725+0000","last_fullsized":"2024-09-21T09:06:52.471725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:52.471565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:52.471565+0000","last_clean_scrub_stamp":"2024-09-21T09:06:52.471565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:54.462085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'8","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:09.435075+0000","last_change":"2024-09-21T09:07:09.435075+0000","last_active":"2024-09-21T09:07:09.435075+0000","last_peered":"2024-09-21T09:07:09.435075+0000","last_clean":"2024-09-21T09:07:09.435075+0000","last_became_active":"2024-09-21T09:03:00.224695+0000","last_became_peered":"2024-09-21T09:03:00.224695+0000","last_unstale":"2024-09-21T09:07:09.435075+0000","last_undegraded":"2024-09-21T09:07:09.435075+0000","last_fullsized":"2024-09-21T09:07:09.435075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:07:09.434895+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:07:09.434895+0000","last_clean_scrub_stamp":"2024-09-21T09:07:09.434895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:52.485628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.798173+0000","last_change":"2024-09-21T09:06:48.798173+0000","last_active":"2024-09-21T09:06:48.798173+0000","last_peered":"2024-09-21T09:06:48.798173+0000","last_clean":"2024-09-21T09:06:48.798173+0000","last_became_active":"2024-09-21T09:02:58.218643+0000","last_became_peered":"2024-09-21T09:02:58.218643+0000","last_unstale":"2024-09-21T09:06:48.798173+0000","last_undegraded":"2024-09-21T09:06:48.798173+0000","last_fullsized":"2024-09-21T09:06:48.798173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:48.798053+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:48.798053+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.798053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:18.793607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'4","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.262904+0000","last_change":"2024-09-21T09:06:36.262904+0000","last_active":"2024-09-21T09:06:36.262904+0000","last_peered":"2024-09-21T09:06:36.262904+0000","last_clean":"2024-09-21T09:06:36.262904+0000","last_became_active":"2024-09-21T09:03:00.226738+0000","last_became_peered":"2024-09-21T09:03:00.226738+0000","last_unstale":"2024-09-21T09:06:36.262904+0000","last_undegraded":"2024-09-21T09:06:36.262904+0000","last_fullsized":"2024-09-21T09:06:36.262904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:36.262757+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:36.262757+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.262757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:35.824400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:08.479116+0000","last_change":"2024-09-21T09:07:08.479116+0000","last_active":"2024-09-21T09:07:08.479116+0000","last_peered":"2024-09-21T09:07:08.479116+0000","last_clean":"2024-09-21T09:07:08.479116+0000","last_became_active":"2024-09-21T09:02:58.208220+0000","last_became_peered":"2024-09-21T09:02:58.208220+0000","last_unstale":"2024-09-21T09:07:08.479116+0000","last_undegraded":"2024-09-21T09:07:08.479116+0000","last_fullsized":"2024-09-21T09:07:08.479116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:08.479000+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:08.479000+0000","last_clean_scrub_stamp":"2024-09-21T09:07:08.479000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:25.854120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'16","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.914935+0000","last_change":"2024-09-21T09:06:47.914935+0000","last_active":"2024-09-21T09:06:47.914935+0000","last_peered":"2024-09-21T09:06:47.914935+0000","last_clean":"2024-09-21T09:06:47.914935+0000","last_became_active":"2024-09-21T09:03:00.215637+0000","last_became_peered":"2024-09-21T09:03:00.215637+0000","last_unstale":"2024-09-21T09:06:47.914935+0000","last_undegraded":"2024-09-21T09:06:47.914935+0000","last_fullsized":"2024-09-21T09:06:47.914935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-21T09:06:47.914812+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-21T09:06:47.914812+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.914812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:54.745182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:04.512344+0000","last_change":"2024-09-21T09:07:04.512344+0000","last_active":"2024-09-21T09:07:04.512344+0000","last_peered":"2024-09-21T09:07:04.512344+0000","last_clean":"2024-09-21T09:07:04.512344+0000","last_became_active":"2024-09-21T09:02:58.204603+0000","last_became_peered":"2024-09-21T09:02:58.204603+0000","last_unstale":"2024-09-21T09:07:04.512344+0000","last_undegraded":"2024-09-21T09:07:04.512344+0000","last_fullsized":"2024-09-21T09:07:04.512344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:04.512202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:04.512202+0000","last_clean_scrub_stamp":"2024-09-21T09:07:04.512202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:45.250702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.848438+0000","last_change":"2024-09-21T09:06:49.848438+0000","last_active":"2024-09-21T09:06:49.848438+0000","last_peered":"2024-09-21T09:06:49.848438+0000","last_clean":"2024-09-21T09:06:49.848438+0000","last_became_active":"2024-09-21T09:03:00.222972+0000","last_became_peered":"2024-09-21T09:03:00.222972+0000","last_unstale":"2024-09-21T09:06:49.848438+0000","last_undegraded":"2024-09-21T09:06:49.848438+0000","last_fullsized":"2024-09-21T09:06:49.848438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:49.848287+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:49.848287+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.848287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:12.844393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:11.124071+0000","last_change":"2024-09-21T09:07:11.124071+0000","last_active":"2024-09-21T09:07:11.124071+0000","last_peered":"2024-09-21T09:07:11.124071+0000","last_clean":"2024-09-21T09:07:11.124071+0000","last_became_active":"2024-09-21T09:02:58.208383+0000","last_became_peered":"2024-09-21T09:02:58.208383+0000","last_unstale":"2024-09-21T09:07:11.124071+0000","last_undegraded":"2024-09-21T09:07:11.124071+0000","last_fullsized":"2024-09-21T09:07:11.124071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:11.123939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:11.123939+0000","last_clean_scrub_stamp":"2024-09-21T09:07:11.123939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:23.577108+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.392419+0000","last_change":"2024-09-21T09:06:48.392419+0000","last_active":"2024-09-21T09:06:48.392419+0000","last_peered":"2024-09-21T09:06:48.392419+0000","last_clean":"2024-09-21T09:06:48.392419+0000","last_became_active":"2024-09-21T09:03:00.211942+0000","last_became_peered":"2024-09-21T09:03:00.211942+0000","last_unstale":"2024-09-21T09:06:48.392419+0000","last_undegraded":"2024-09-21T09:06:48.392419+0000","last_fullsized":"2024-09-21T09:06:48.392419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:48.392256+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:48.392256+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.392256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:01:04.152702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:26.430080+0000","last_change":"2024-09-21T09:07:26.430080+0000","last_active":"2024-09-21T09:07:26.430080+0000","last_peered":"2024-09-21T09:07:26.430080+0000","last_clean":"2024-09-21T09:07:26.430080+0000","last_became_active":"2024-09-21T09:02:58.213548+0000","last_became_peered":"2024-09-21T09:02:58.213548+0000","last_unstale":"2024-09-21T09:07:26.430080+0000","last_undegraded":"2024-09-21T09:07:26.430080+0000","last_fullsized":"2024-09-21T09:07:26.430080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:26.429943+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:26.429943+0000","last_clean_scrub_stamp":"2024-09-21T09:07:26.429943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:07.034297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'36","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:11.465449+0000","last_change":"2024-09-21T09:07:11.465449+0000","last_active":"2024-09-21T09:07:11.465449+0000","last_peered":"2024-09-21T09:07:11.465449+0000","last_clean":"2024-09-21T09:07:11.465449+0000","last_became_active":"2024-09-21T09:03:08.262362+0000","last_became_peered":"2024-09-21T09:03:08.262362+0000","last_unstale":"2024-09-21T09:07:11.465449+0000","last_undegraded":"2024-09-21T09:07:11.465449+0000","last_fullsized":"2024-09-21T09:07:11.465449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-09-21T09:07:11.465296+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-09-21T09:07:11.465296+0000","last_clean_scrub_stamp":"2024-09-21T09:07:11.465296+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:36.187129+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:03.169432+0000","last_change":"2024-09-21T09:07:03.169432+0000","last_active":"2024-09-21T09:07:03.169432+0000","last_peered":"2024-09-21T09:07:03.169432+0000","last_clean":"2024-09-21T09:07:03.169432+0000","last_became_active":"2024-09-21T09:03:00.209346+0000","last_became_peered":"2024-09-21T09:03:00.209346+0000","last_unstale":"2024-09-21T09:07:03.169432+0000","last_undegraded":"2024-09-21T09:07:03.169432+0000","last_fullsized":"2024-09-21T09:07:03.169432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:03.169305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:03.169305+0000","last_clean_scrub_stamp":"2024-09-21T09:07:03.169305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:21.767291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:15.364429+0000","last_change":"2024-09-21T09:07:15.364429+0000","last_active":"2024-09-21T09:07:15.364429+0000","last_peered":"2024-09-21T09:07:15.364429+0000","last_clean":"2024-09-21T09:07:15.364429+0000","last_became_active":"2024-09-21T09:02:58.221187+0000","last_became_peered":"2024-09-21T09:02:58.221187+0000","last_unstale":"2024-09-21T09:07:15.364429+0000","last_undegraded":"2024-09-21T09:07:15.364429+0000","last_fullsized":"2024-09-21T09:07:15.364429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:07:15.364310+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:07:15.364310+0000","last_clean_scrub_stamp":"2024-09-21T09:07:15.364310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:03.418130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.340738+0000","last_change":"2024-09-21T09:06:20.340738+0000","last_active":"2024-09-21T09:06:20.340738+0000","last_peered":"2024-09-21T09:06:20.340738+0000","last_clean":"2024-09-21T09:06:20.340738+0000","last_became_active":"2024-09-21T09:03:02.220370+0000","last_became_peered":"2024-09-21T09:03:02.220370+0000","last_unstale":"2024-09-21T09:06:20.340738+0000","last_undegraded":"2024-09-21T09:06:20.340738+0000","last_fullsized":"2024-09-21T09:06:20.340738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:20.340586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:20.340586+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.340586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:30.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'37","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.319493+0000","last_change":"2024-09-21T09:06:44.319493+0000","last_active":"2024-09-21T09:06:44.319493+0000","last_peered":"2024-09-21T09:06:44.319493+0000","last_clean":"2024-09-21T09:06:44.319493+0000","last_became_active":"2024-09-21T09:03:04.242637+0000","last_became_peered":"2024-09-21T09:03:04.242637+0000","last_unstale":"2024-09-21T09:06:44.319493+0000","last_undegraded":"2024-09-21T09:06:44.319493+0000","last_fullsized":"2024-09-21T09:06:44.319493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-21T09:06:44.319357+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-21T09:06:44.319357+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.319357+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:39.099160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.513487+0000","last_change":"2024-09-21T09:06:16.513487+0000","last_active":"2024-09-21T09:06:16.513487+0000","last_peered":"2024-09-21T09:06:16.513487+0000","last_clean":"2024-09-21T09:06:16.513487+0000","last_became_active":"2024-09-21T09:03:06.247203+0000","last_became_peered":"2024-09-21T09:03:06.247203+0000","last_unstale":"2024-09-21T09:06:16.513487+0000","last_undegraded":"2024-09-21T09:06:16.513487+0000","last_fullsized":"2024-09-21T09:06:16.513487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.513331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.513331+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.513331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:05:45.010706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'10","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:12.457954+0000","last_change":"2024-09-21T09:07:12.457954+0000","last_active":"2024-09-21T09:07:12.457954+0000","last_peered":"2024-09-21T09:07:12.457954+0000","last_clean":"2024-09-21T09:07:12.457954+0000","last_became_active":"2024-09-21T09:03:08.262384+0000","last_became_peered":"2024-09-21T09:03:08.262384+0000","last_unstale":"2024-09-21T09:07:12.457954+0000","last_undegraded":"2024-09-21T09:07:12.457954+0000","last_fullsized":"2024-09-21T09:07:12.457954+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:07:12.457810+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:07:12.457810+0000","last_clean_scrub_stamp":"2024-09-21T09:07:12.457810+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:50.329341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:55.255257+0000","last_change":"2024-09-21T09:06:55.255257+0000","last_active":"2024-09-21T09:06:55.255257+0000","last_peered":"2024-09-21T09:06:55.255257+0000","last_clean":"2024-09-21T09:06:55.255257+0000","last_became_active":"2024-09-21T09:03:00.217658+0000","last_became_peered":"2024-09-21T09:03:00.217658+0000","last_unstale":"2024-09-21T09:06:55.255257+0000","last_undegraded":"2024-09-21T09:06:55.255257+0000","last_fullsized":"2024-09-21T09:06:55.255257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:55.255084+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:55.255084+0000","last_clean_scrub_stamp":"2024-09-21T09:06:55.255084+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:47.433471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:54.827969+0000","last_change":"2024-09-21T09:06:54.827969+0000","last_active":"2024-09-21T09:06:54.827969+0000","last_peered":"2024-09-21T09:06:54.827969+0000","last_clean":"2024-09-21T09:06:54.827969+0000","last_became_active":"2024-09-21T09:02:58.218086+0000","last_became_peered":"2024-09-21T09:02:58.218086+0000","last_unstale":"2024-09-21T09:06:54.827969+0000","last_undegraded":"2024-09-21T09:06:54.827969+0000","last_fullsized":"2024-09-21T09:06:54.827969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:54.827813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:54.827813+0000","last_clean_scrub_stamp":"2024-09-21T09:06:54.827813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:18.334744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.944223+0000","last_change":"2024-09-21T09:06:38.944223+0000","last_active":"2024-09-21T09:06:38.944223+0000","last_peered":"2024-09-21T09:06:38.944223+0000","last_clean":"2024-09-21T09:06:38.944223+0000","last_became_active":"2024-09-21T09:03:02.220557+0000","last_became_peered":"2024-09-21T09:03:02.220557+0000","last_unstale":"2024-09-21T09:06:38.944223+0000","last_undegraded":"2024-09-21T09:06:38.944223+0000","last_fullsized":"2024-09-21T09:06:38.944223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:38.944114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:38.944114+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.944114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:28.572358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'9","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.495014+0000","last_change":"2024-09-21T09:06:22.495014+0000","last_active":"2024-09-21T09:06:22.495014+0000","last_peered":"2024-09-21T09:06:22.495014+0000","last_clean":"2024-09-21T09:06:22.495014+0000","last_became_active":"2024-09-21T09:03:04.236037+0000","last_became_peered":"2024-09-21T09:03:04.236037+0000","last_unstale":"2024-09-21T09:06:22.495014+0000","last_undegraded":"2024-09-21T09:06:22.495014+0000","last_fullsized":"2024-09-21T09:06:22.495014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-21T09:06:22.494847+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-21T09:06:22.494847+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.494847+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:55.904900+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.478831+0000","last_change":"2024-09-21T09:06:18.478831+0000","last_active":"2024-09-21T09:06:18.478831+0000","last_peered":"2024-09-21T09:06:18.478831+0000","last_clean":"2024-09-21T09:06:18.478831+0000","last_became_active":"2024-09-21T09:03:06.243901+0000","last_became_peered":"2024-09-21T09:03:06.243901+0000","last_unstale":"2024-09-21T09:06:18.478831+0000","last_undegraded":"2024-09-21T09:06:18.478831+0000","last_fullsized":"2024-09-21T09:06:18.478831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.478706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.478706+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.478706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:41.502223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:13.145708+0000","last_change":"2024-09-21T09:07:13.145749+0000","last_active":"2024-09-21T09:07:13.145708+0000","last_peered":"2024-09-21T09:07:13.145708+0000","last_clean":"2024-09-21T09:07:13.145708+0000","last_became_active":"2024-09-21T09:03:08.250029+0000","last_became_peered":"2024-09-21T09:03:08.250029+0000","last_unstale":"2024-09-21T09:07:13.145708+0000","last_undegraded":"2024-09-21T09:07:13.145708+0000","last_fullsized":"2024-09-21T09:07:13.145708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:07:13.145614+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:07:13.145614+0000","last_clean_scrub_stamp":"2024-09-21T09:07:13.145614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:02.268505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:58.242309+0000","last_change":"2024-09-21T09:06:58.242309+0000","last_active":"2024-09-21T09:06:58.242309+0000","last_peered":"2024-09-21T09:06:58.242309+0000","last_clean":"2024-09-21T09:06:58.242309+0000","last_became_active":"2024-09-21T09:03:00.217633+0000","last_became_peered":"2024-09-21T09:03:00.217633+0000","last_unstale":"2024-09-21T09:06:58.242309+0000","last_undegraded":"2024-09-21T09:06:58.242309+0000","last_fullsized":"2024-09-21T09:06:58.242309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:58.242199+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:58.242199+0000","last_clean_scrub_stamp":"2024-09-21T09:06:58.242199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:33.728371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:12.355953+0000","last_change":"2024-09-21T09:07:12.355953+0000","last_active":"2024-09-21T09:07:12.355953+0000","last_peered":"2024-09-21T09:07:12.355953+0000","last_clean":"2024-09-21T09:07:12.355953+0000","last_became_active":"2024-09-21T09:02:58.220133+0000","last_became_peered":"2024-09-21T09:02:58.220133+0000","last_unstale":"2024-09-21T09:07:12.355953+0000","last_undegraded":"2024-09-21T09:07:12.355953+0000","last_fullsized":"2024-09-21T09:07:12.355953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:12.355798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:12.355798+0000","last_clean_scrub_stamp":"2024-09-21T09:07:12.355798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:24.081357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.974481+0000","last_change":"2024-09-21T09:06:39.974481+0000","last_active":"2024-09-21T09:06:39.974481+0000","last_peered":"2024-09-21T09:06:39.974481+0000","last_clean":"2024-09-21T09:06:39.974481+0000","last_became_active":"2024-09-21T09:03:02.219457+0000","last_became_peered":"2024-09-21T09:03:02.219457+0000","last_unstale":"2024-09-21T09:06:39.974481+0000","last_undegraded":"2024-09-21T09:06:39.974481+0000","last_fullsized":"2024-09-21T09:06:39.974481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:39.974313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:39.974313+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.974313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:26.805217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.828475+0000","last_change":"2024-09-21T09:06:24.828475+0000","last_active":"2024-09-21T09:06:24.828475+0000","last_peered":"2024-09-21T09:06:24.828475+0000","last_clean":"2024-09-21T09:06:24.828475+0000","last_became_active":"2024-09-21T09:03:04.239187+0000","last_became_peered":"2024-09-21T09:03:04.239187+0000","last_unstale":"2024-09-21T09:06:24.828475+0000","last_undegraded":"2024-09-21T09:06:24.828475+0000","last_fullsized":"2024-09-21T09:06:24.828475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-21T09:06:24.828300+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-21T09:06:24.828300+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.828300+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:54.045825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'285","reported_seq":397,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.260368+0000","last_change":"2024-09-21T09:06:40.260368+0000","last_active":"2024-09-21T09:06:40.260368+0000","last_peered":"2024-09-21T09:06:40.260368+0000","last_clean":"2024-09-21T09:06:40.260368+0000","last_became_active":"2024-09-21T09:03:06.247441+0000","last_became_peered":"2024-09-21T09:03:06.247441+0000","last_unstale":"2024-09-21T09:06:40.260368+0000","last_undegraded":"2024-09-21T09:06:40.260368+0000","last_fullsized":"2024-09-21T09:06:40.260368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:40.260235+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:40.260235+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.260235+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:24.594105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.811807+0000","last_change":"2024-09-21T09:06:33.811859+0000","last_active":"2024-09-21T09:06:33.811807+0000","last_peered":"2024-09-21T09:06:33.811807+0000","last_clean":"2024-09-21T09:06:33.811807+0000","last_became_active":"2024-09-21T09:03:08.255274+0000","last_became_peered":"2024-09-21T09:03:08.255274+0000","last_unstale":"2024-09-21T09:06:33.811807+0000","last_undegraded":"2024-09-21T09:06:33.811807+0000","last_fullsized":"2024-09-21T09:06:33.811807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:33.811708+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:33.811708+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.811708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:39.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:54.060934+0000","last_change":"2024-09-21T09:06:54.060934+0000","last_active":"2024-09-21T09:06:54.060934+0000","last_peered":"2024-09-21T09:06:54.060934+0000","last_clean":"2024-09-21T09:06:54.060934+0000","last_became_active":"2024-09-21T09:03:00.216382+0000","last_became_peered":"2024-09-21T09:03:00.216382+0000","last_unstale":"2024-09-21T09:06:54.060934+0000","last_undegraded":"2024-09-21T09:06:54.060934+0000","last_fullsized":"2024-09-21T09:06:54.060934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:54.060813+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:54.060813+0000","last_clean_scrub_stamp":"2024-09-21T09:06:54.060813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:26.364312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:54.468529+0000","last_change":"2024-09-21T09:06:54.468529+0000","last_active":"2024-09-21T09:06:54.468529+0000","last_peered":"2024-09-21T09:06:54.468529+0000","last_clean":"2024-09-21T09:06:54.468529+0000","last_became_active":"2024-09-21T09:02:58.210560+0000","last_became_peered":"2024-09-21T09:02:58.210560+0000","last_unstale":"2024-09-21T09:06:54.468529+0000","last_undegraded":"2024-09-21T09:06:54.468529+0000","last_fullsized":"2024-09-21T09:06:54.468529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:54.468377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:54.468377+0000","last_clean_scrub_stamp":"2024-09-21T09:06:54.468377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:26.771876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.409771+0000","last_change":"2024-09-21T09:06:18.409771+0000","last_active":"2024-09-21T09:06:18.409771+0000","last_peered":"2024-09-21T09:06:18.409771+0000","last_clean":"2024-09-21T09:06:18.409771+0000","last_became_active":"2024-09-21T09:03:02.220551+0000","last_became_peered":"2024-09-21T09:03:02.220551+0000","last_unstale":"2024-09-21T09:06:18.409771+0000","last_undegraded":"2024-09-21T09:06:18.409771+0000","last_fullsized":"2024-09-21T09:06:18.409771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.409649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.409649+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.409649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:27:47.530462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'37","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.771672+0000","last_change":"2024-09-21T09:06:28.771672+0000","last_active":"2024-09-21T09:06:28.771672+0000","last_peered":"2024-09-21T09:06:28.771672+0000","last_clean":"2024-09-21T09:06:28.771672+0000","last_became_active":"2024-09-21T09:03:04.233848+0000","last_became_peered":"2024-09-21T09:03:04.233848+0000","last_unstale":"2024-09-21T09:06:28.771672+0000","last_undegraded":"2024-09-21T09:06:28.771672+0000","last_fullsized":"2024-09-21T09:06:28.771672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-21T09:06:28.771549+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-21T09:06:28.771549+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.771549+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:21.809857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'285","reported_seq":413,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.666787+0000","last_change":"2024-09-21T09:06:20.666787+0000","last_active":"2024-09-21T09:06:20.666787+0000","last_peered":"2024-09-21T09:06:20.666787+0000","last_clean":"2024-09-21T09:06:20.666787+0000","last_became_active":"2024-09-21T09:03:06.243576+0000","last_became_peered":"2024-09-21T09:03:06.243576+0000","last_unstale":"2024-09-21T09:06:20.666787+0000","last_undegraded":"2024-09-21T09:06:20.666787+0000","last_fullsized":"2024-09-21T09:06:20.666787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:20.666653+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:20.666653+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.666653+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:13.704961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:59.197284+0000","last_change":"2024-09-21T09:06:59.197284+0000","last_active":"2024-09-21T09:06:59.197284+0000","last_peered":"2024-09-21T09:06:59.197284+0000","last_clean":"2024-09-21T09:06:59.197284+0000","last_became_active":"2024-09-21T09:03:00.217545+0000","last_became_peered":"2024-09-21T09:03:00.217545+0000","last_unstale":"2024-09-21T09:06:59.197284+0000","last_undegraded":"2024-09-21T09:06:59.197284+0000","last_fullsized":"2024-09-21T09:06:59.197284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:06:59.197146+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:06:59.197146+0000","last_clean_scrub_stamp":"2024-09-21T09:06:59.197146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:23.728828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:01.715743+0000","last_change":"2024-09-21T09:07:01.715743+0000","last_active":"2024-09-21T09:07:01.715743+0000","last_peered":"2024-09-21T09:07:01.715743+0000","last_clean":"2024-09-21T09:07:01.715743+0000","last_became_active":"2024-09-21T09:02:58.209712+0000","last_became_peered":"2024-09-21T09:02:58.209712+0000","last_unstale":"2024-09-21T09:07:01.715743+0000","last_undegraded":"2024-09-21T09:07:01.715743+0000","last_fullsized":"2024-09-21T09:07:01.715743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:01.715634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:01.715634+0000","last_clean_scrub_stamp":"2024-09-21T09:07:01.715634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:34.019133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"31'2","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.322635+0000","last_change":"2024-09-21T09:06:32.322635+0000","last_active":"2024-09-21T09:06:32.322635+0000","last_peered":"2024-09-21T09:06:32.322635+0000","last_clean":"2024-09-21T09:06:32.322635+0000","last_became_active":"2024-09-21T09:03:02.220629+0000","last_became_peered":"2024-09-21T09:03:02.220629+0000","last_unstale":"2024-09-21T09:06:32.322635+0000","last_undegraded":"2024-09-21T09:06:32.322635+0000","last_fullsized":"2024-09-21T09:06:32.322635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:32.322492+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:32.322492+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.322492+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:05.196838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'51","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.776075+0000","last_change":"2024-09-21T09:06:30.776075+0000","last_active":"2024-09-21T09:06:30.776075+0000","last_peered":"2024-09-21T09:06:30.776075+0000","last_clean":"2024-09-21T09:06:30.776075+0000","last_became_active":"2024-09-21T09:03:04.232394+0000","last_became_peered":"2024-09-21T09:03:04.232394+0000","last_unstale":"2024-09-21T09:06:30.776075+0000","last_undegraded":"2024-09-21T09:06:30.776075+0000","last_fullsized":"2024-09-21T09:06:30.776075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2024-09-21T09:06:30.775947+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2024-09-21T09:06:30.775947+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.775947+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:12.569145+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.694322+0000","last_change":"2024-09-21T09:06:18.694322+0000","last_active":"2024-09-21T09:06:18.694322+0000","last_peered":"2024-09-21T09:06:18.694322+0000","last_clean":"2024-09-21T09:06:18.694322+0000","last_became_active":"2024-09-21T09:03:06.244259+0000","last_became_peered":"2024-09-21T09:03:06.244259+0000","last_unstale":"2024-09-21T09:06:18.694322+0000","last_undegraded":"2024-09-21T09:06:18.694322+0000","last_fullsized":"2024-09-21T09:06:18.694322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.694207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.694207+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.694207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:38.655887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'3","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:04.795472+0000","last_change":"2024-09-21T09:07:04.795472+0000","last_active":"2024-09-21T09:07:04.795472+0000","last_peered":"2024-09-21T09:07:04.795472+0000","last_clean":"2024-09-21T09:07:04.795472+0000","last_became_active":"2024-09-21T09:03:08.261035+0000","last_became_peered":"2024-09-21T09:03:08.261035+0000","last_unstale":"2024-09-21T09:07:04.795472+0000","last_undegraded":"2024-09-21T09:07:04.795472+0000","last_fullsized":"2024-09-21T09:07:04.795472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:07:04.795349+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:07:04.795349+0000","last_clean_scrub_stamp":"2024-09-21T09:07:04.795349+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:22.726619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.376033+0000","last_change":"2024-09-21T09:06:49.376033+0000","last_active":"2024-09-21T09:06:49.376033+0000","last_peered":"2024-09-21T09:06:49.376033+0000","last_clean":"2024-09-21T09:06:49.376033+0000","last_became_active":"2024-09-21T09:03:00.219765+0000","last_became_peered":"2024-09-21T09:03:00.219765+0000","last_unstale":"2024-09-21T09:06:49.376033+0000","last_undegraded":"2024-09-21T09:06:49.376033+0000","last_fullsized":"2024-09-21T09:06:49.376033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:06:49.375904+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:06:49.375904+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.375904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:39.680559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:02.723098+0000","last_change":"2024-09-21T09:07:02.723098+0000","last_active":"2024-09-21T09:07:02.723098+0000","last_peered":"2024-09-21T09:07:02.723098+0000","last_clean":"2024-09-21T09:07:02.723098+0000","last_became_active":"2024-09-21T09:02:58.214392+0000","last_became_peered":"2024-09-21T09:02:58.214392+0000","last_unstale":"2024-09-21T09:07:02.723098+0000","last_undegraded":"2024-09-21T09:07:02.723098+0000","last_fullsized":"2024-09-21T09:07:02.723098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:02.722972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:02.722972+0000","last_clean_scrub_stamp":"2024-09-21T09:07:02.722972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:02.907615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.778729+0000","last_change":"2024-09-21T09:06:31.778729+0000","last_active":"2024-09-21T09:06:31.778729+0000","last_peered":"2024-09-21T09:06:31.778729+0000","last_clean":"2024-09-21T09:06:31.778729+0000","last_became_active":"2024-09-21T09:03:02.223123+0000","last_became_peered":"2024-09-21T09:03:02.223123+0000","last_unstale":"2024-09-21T09:06:31.778729+0000","last_undegraded":"2024-09-21T09:06:31.778729+0000","last_fullsized":"2024-09-21T09:06:31.778729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:31.778616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:31.778616+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.778616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:58.139384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'38","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.295753+0000","last_change":"2024-09-21T09:06:47.295753+0000","last_active":"2024-09-21T09:06:47.295753+0000","last_peered":"2024-09-21T09:06:47.295753+0000","last_clean":"2024-09-21T09:06:47.295753+0000","last_became_active":"2024-09-21T09:03:04.242404+0000","last_became_peered":"2024-09-21T09:03:04.242404+0000","last_unstale":"2024-09-21T09:06:47.295753+0000","last_undegraded":"2024-09-21T09:06:47.295753+0000","last_fullsized":"2024-09-21T09:06:47.295753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2024-09-21T09:06:47.295625+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2024-09-21T09:06:47.295625+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.295625+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:04.223317+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.680884+0000","last_change":"2024-09-21T09:06:21.680884+0000","last_active":"2024-09-21T09:06:21.680884+0000","last_peered":"2024-09-21T09:06:21.680884+0000","last_clean":"2024-09-21T09:06:21.680884+0000","last_became_active":"2024-09-21T09:03:06.247504+0000","last_became_peered":"2024-09-21T09:03:06.247504+0000","last_unstale":"2024-09-21T09:06:21.680884+0000","last_undegraded":"2024-09-21T09:06:21.680884+0000","last_fullsized":"2024-09-21T09:06:21.680884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:21.680751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:21.680751+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.680751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:07.979811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'4","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.320208+0000","last_change":"2024-09-21T09:06:39.320208+0000","last_active":"2024-09-21T09:06:39.320208+0000","last_peered":"2024-09-21T09:06:39.320208+0000","last_clean":"2024-09-21T09:06:39.320208+0000","last_became_active":"2024-09-21T09:03:08.255814+0000","last_became_peered":"2024-09-21T09:03:08.255814+0000","last_unstale":"2024-09-21T09:06:39.320208+0000","last_undegraded":"2024-09-21T09:06:39.320208+0000","last_fullsized":"2024-09-21T09:06:39.320208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:39.320081+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:39.320081+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.320081+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:28.948326+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.796153+0000","last_change":"2024-09-21T09:06:47.796153+0000","last_active":"2024-09-21T09:06:47.796153+0000","last_peered":"2024-09-21T09:06:47.796153+0000","last_clean":"2024-09-21T09:06:47.796153+0000","last_became_active":"2024-09-21T09:03:00.222650+0000","last_became_peered":"2024-09-21T09:03:00.222650+0000","last_unstale":"2024-09-21T09:06:47.796153+0000","last_undegraded":"2024-09-21T09:06:47.796153+0000","last_fullsized":"2024-09-21T09:06:47.796153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:47.796026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:47.796026+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.796026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:34.626930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:34.466471+0000","last_change":"2024-09-21T09:07:34.466497+0000","last_active":"2024-09-21T09:07:34.466471+0000","last_peered":"2024-09-21T09:07:34.466471+0000","last_clean":"2024-09-21T09:07:34.466471+0000","last_became_active":"2024-09-21T09:02:58.213652+0000","last_became_peered":"2024-09-21T09:02:58.213652+0000","last_unstale":"2024-09-21T09:07:34.466471+0000","last_undegraded":"2024-09-21T09:07:34.466471+0000","last_fullsized":"2024-09-21T09:07:34.466471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:34.466357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:34.466357+0000","last_clean_scrub_stamp":"2024-09-21T09:07:34.466357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:53.522103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:07.798877+0000","last_change":"2024-09-21T09:07:07.798919+0000","last_active":"2024-09-21T09:07:07.798877+0000","last_peered":"2024-09-21T09:07:07.798877+0000","last_clean":"2024-09-21T09:07:07.798877+0000","last_became_active":"2024-09-21T09:03:38.281497+0000","last_became_peered":"2024-09-21T09:03:38.281497+0000","last_unstale":"2024-09-21T09:07:07.798877+0000","last_undegraded":"2024-09-21T09:07:07.798877+0000","last_fullsized":"2024-09-21T09:07:07.798877+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:07.798726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:07.798726+0000","last_clean_scrub_stamp":"2024-09-21T09:07:07.798726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:18.979784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"31'45","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.362435+0000","last_change":"2024-09-21T09:06:25.362435+0000","last_active":"2024-09-21T09:06:25.362435+0000","last_peered":"2024-09-21T09:06:25.362435+0000","last_clean":"2024-09-21T09:06:25.362435+0000","last_became_active":"2024-09-21T09:03:04.240144+0000","last_became_peered":"2024-09-21T09:03:04.240144+0000","last_unstale":"2024-09-21T09:06:25.362435+0000","last_undegraded":"2024-09-21T09:06:25.362435+0000","last_fullsized":"2024-09-21T09:06:25.362435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-09-21T09:06:25.362285+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-09-21T09:06:25.362285+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.362285+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:00.748484+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'285","reported_seq":360,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.980274+0000","last_change":"2024-09-21T09:06:41.980274+0000","last_active":"2024-09-21T09:06:41.980274+0000","last_peered":"2024-09-21T09:06:41.980274+0000","last_clean":"2024-09-21T09:06:41.980274+0000","last_became_active":"2024-09-21T09:03:06.250807+0000","last_became_peered":"2024-09-21T09:03:06.250807+0000","last_unstale":"2024-09-21T09:06:41.980274+0000","last_undegraded":"2024-09-21T09:06:41.980274+0000","last_fullsized":"2024-09-21T09:06:41.980274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:41.980137+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:41.980137+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.980137+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:04.976243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.924395+0000","last_change":"2024-09-21T09:06:45.924395+0000","last_active":"2024-09-21T09:06:45.924395+0000","last_peered":"2024-09-21T09:06:45.924395+0000","last_clean":"2024-09-21T09:06:45.924395+0000","last_became_active":"2024-09-21T09:03:08.250063+0000","last_became_peered":"2024-09-21T09:03:08.250063+0000","last_unstale":"2024-09-21T09:06:45.924395+0000","last_undegraded":"2024-09-21T09:06:45.924395+0000","last_fullsized":"2024-09-21T09:06:45.924395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:45.924274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:45.924274+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.924274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:08.933691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'14","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.881315+0000","last_change":"2024-09-21T09:06:40.881315+0000","last_active":"2024-09-21T09:06:40.881315+0000","last_peered":"2024-09-21T09:06:40.881315+0000","last_clean":"2024-09-21T09:06:40.881315+0000","last_became_active":"2024-09-21T09:03:00.216544+0000","last_became_peered":"2024-09-21T09:03:00.216544+0000","last_unstale":"2024-09-21T09:06:40.881315+0000","last_undegraded":"2024-09-21T09:06:40.881315+0000","last_fullsized":"2024-09-21T09:06:40.881315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:40.881198+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:40.881198+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.881198+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:32:13.994520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:07.234868+0000","last_change":"2024-09-21T09:07:07.234868+0000","last_active":"2024-09-21T09:07:07.234868+0000","last_peered":"2024-09-21T09:07:07.234868+0000","last_clean":"2024-09-21T09:07:07.234868+0000","last_became_active":"2024-09-21T09:02:58.224675+0000","last_became_peered":"2024-09-21T09:02:58.224675+0000","last_unstale":"2024-09-21T09:07:07.234868+0000","last_undegraded":"2024-09-21T09:07:07.234868+0000","last_fullsized":"2024-09-21T09:07:07.234868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:07.234741+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:07.234741+0000","last_clean_scrub_stamp":"2024-09-21T09:07:07.234741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:34.342082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.771529+0000","last_change":"2024-09-21T09:06:32.771529+0000","last_active":"2024-09-21T09:06:32.771529+0000","last_peered":"2024-09-21T09:06:32.771529+0000","last_clean":"2024-09-21T09:06:32.771529+0000","last_became_active":"2024-09-21T09:03:02.222904+0000","last_became_peered":"2024-09-21T09:03:02.222904+0000","last_unstale":"2024-09-21T09:06:32.771529+0000","last_undegraded":"2024-09-21T09:06:32.771529+0000","last_fullsized":"2024-09-21T09:06:32.771529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:32.771408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:32.771408+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.771408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:47.808559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'67","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:50.298082+0000","last_change":"2024-09-21T09:06:50.298082+0000","last_active":"2024-09-21T09:06:50.298082+0000","last_peered":"2024-09-21T09:06:50.298082+0000","last_clean":"2024-09-21T09:06:50.298082+0000","last_became_active":"2024-09-21T09:03:04.241679+0000","last_became_peered":"2024-09-21T09:03:04.241679+0000","last_unstale":"2024-09-21T09:06:50.298082+0000","last_undegraded":"2024-09-21T09:06:50.298082+0000","last_fullsized":"2024-09-21T09:06:50.298082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'67","last_scrub_stamp":"2024-09-21T09:06:50.297956+0000","last_deep_scrub":"31'67","last_deep_scrub_stamp":"2024-09-21T09:06:50.297956+0000","last_clean_scrub_stamp":"2024-09-21T09:06:50.297956+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:04.079875+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.788942+0000","last_change":"2024-09-21T09:06:33.788942+0000","last_active":"2024-09-21T09:06:33.788942+0000","last_peered":"2024-09-21T09:06:33.788942+0000","last_clean":"2024-09-21T09:06:33.788942+0000","last_became_active":"2024-09-21T09:03:06.249377+0000","last_became_peered":"2024-09-21T09:03:06.249377+0000","last_unstale":"2024-09-21T09:06:33.788942+0000","last_undegraded":"2024-09-21T09:06:33.788942+0000","last_fullsized":"2024-09-21T09:06:33.788942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:33.788739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:33.788739+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.788739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:57.255671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'25","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:19.185579+0000","last_change":"2024-09-21T09:07:19.185579+0000","last_active":"2024-09-21T09:07:19.185579+0000","last_peered":"2024-09-21T09:07:19.185579+0000","last_clean":"2024-09-21T09:07:19.185579+0000","last_became_active":"2024-09-21T09:03:08.260071+0000","last_became_peered":"2024-09-21T09:03:08.260071+0000","last_unstale":"2024-09-21T09:07:19.185579+0000","last_undegraded":"2024-09-21T09:07:19.185579+0000","last_fullsized":"2024-09-21T09:07:19.185579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2024-09-21T09:07:19.185408+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2024-09-21T09:07:19.185408+0000","last_clean_scrub_stamp":"2024-09-21T09:07:19.185408+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:15.285092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'2","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:53.474018+0000","last_change":"2024-09-21T09:06:53.474018+0000","last_active":"2024-09-21T09:06:53.474018+0000","last_peered":"2024-09-21T09:06:53.474018+0000","last_clean":"2024-09-21T09:06:53.474018+0000","last_became_active":"2024-09-21T09:03:00.223184+0000","last_became_peered":"2024-09-21T09:03:00.223184+0000","last_unstale":"2024-09-21T09:06:53.474018+0000","last_undegraded":"2024-09-21T09:06:53.474018+0000","last_fullsized":"2024-09-21T09:06:53.474018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:53.473903+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:53.473903+0000","last_clean_scrub_stamp":"2024-09-21T09:06:53.473903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:11.258122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.030713+0000","last_change":"2024-09-21T09:06:51.030713+0000","last_active":"2024-09-21T09:06:51.030713+0000","last_peered":"2024-09-21T09:06:51.030713+0000","last_clean":"2024-09-21T09:06:51.030713+0000","last_became_active":"2024-09-21T09:02:58.216545+0000","last_became_peered":"2024-09-21T09:02:58.216545+0000","last_unstale":"2024-09-21T09:06:51.030713+0000","last_undegraded":"2024-09-21T09:06:51.030713+0000","last_fullsized":"2024-09-21T09:06:51.030713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:51.030555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:51.030555+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.030555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.507576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.793708+0000","last_change":"2024-09-21T09:06:35.793708+0000","last_active":"2024-09-21T09:06:35.793708+0000","last_peered":"2024-09-21T09:06:35.793708+0000","last_clean":"2024-09-21T09:06:35.793708+0000","last_became_active":"2024-09-21T09:03:02.221352+0000","last_became_peered":"2024-09-21T09:03:02.221352+0000","last_unstale":"2024-09-21T09:06:35.793708+0000","last_undegraded":"2024-09-21T09:06:35.793708+0000","last_fullsized":"2024-09-21T09:06:35.793708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:35.793591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:35.793591+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.793591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:20:03.333500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'39","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.403421+0000","last_change":"2024-09-21T09:06:25.403421+0000","last_active":"2024-09-21T09:06:25.403421+0000","last_peered":"2024-09-21T09:06:25.403421+0000","last_clean":"2024-09-21T09:06:25.403421+0000","last_became_active":"2024-09-21T09:03:04.234750+0000","last_became_peered":"2024-09-21T09:03:04.234750+0000","last_unstale":"2024-09-21T09:06:25.403421+0000","last_undegraded":"2024-09-21T09:06:25.403421+0000","last_fullsized":"2024-09-21T09:06:25.403421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-21T09:06:25.403243+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-21T09:06:25.403243+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.403243+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:10.523882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.288220+0000","last_change":"2024-09-21T09:06:41.288220+0000","last_active":"2024-09-21T09:06:41.288220+0000","last_peered":"2024-09-21T09:06:41.288220+0000","last_clean":"2024-09-21T09:06:41.288220+0000","last_became_active":"2024-09-21T09:03:06.248453+0000","last_became_peered":"2024-09-21T09:03:06.248453+0000","last_unstale":"2024-09-21T09:06:41.288220+0000","last_undegraded":"2024-09-21T09:06:41.288220+0000","last_fullsized":"2024-09-21T09:06:41.288220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:41.288107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:41.288107+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.288107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:34:02.945842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:36.443760+0000","last_change":"2024-09-21T09:07:36.443790+0000","last_active":"2024-09-21T09:07:36.443760+0000","last_peered":"2024-09-21T09:07:36.443760+0000","last_clean":"2024-09-21T09:07:36.443760+0000","last_became_active":"2024-09-21T09:03:08.260016+0000","last_became_peered":"2024-09-21T09:03:08.260016+0000","last_unstale":"2024-09-21T09:07:36.443760+0000","last_undegraded":"2024-09-21T09:07:36.443760+0000","last_fullsized":"2024-09-21T09:07:36.443760+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:07:36.443671+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:07:36.443671+0000","last_clean_scrub_stamp":"2024-09-21T09:07:36.443671+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:10.078450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.275028+0000","last_change":"2024-09-21T09:06:34.275028+0000","last_active":"2024-09-21T09:06:34.275028+0000","last_peered":"2024-09-21T09:06:34.275028+0000","last_clean":"2024-09-21T09:06:34.275028+0000","last_became_active":"2024-09-21T09:03:00.220384+0000","last_became_peered":"2024-09-21T09:03:00.220384+0000","last_unstale":"2024-09-21T09:06:34.275028+0000","last_undegraded":"2024-09-21T09:06:34.275028+0000","last_fullsized":"2024-09-21T09:06:34.275028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:34.274878+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:34.274878+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.274878+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:09.374069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:22.395057+0000","last_change":"2024-09-21T09:07:22.395087+0000","last_active":"2024-09-21T09:07:22.395057+0000","last_peered":"2024-09-21T09:07:22.395057+0000","last_clean":"2024-09-21T09:07:22.395057+0000","last_became_active":"2024-09-21T09:02:58.213920+0000","last_became_peered":"2024-09-21T09:02:58.213920+0000","last_unstale":"2024-09-21T09:07:22.395057+0000","last_undegraded":"2024-09-21T09:07:22.395057+0000","last_fullsized":"2024-09-21T09:07:22.395057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:22.394962+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:22.394962+0000","last_clean_scrub_stamp":"2024-09-21T09:07:22.394962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:53.788547+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.986345+0000","last_change":"2024-09-21T09:06:40.986345+0000","last_active":"2024-09-21T09:06:40.986345+0000","last_peered":"2024-09-21T09:06:40.986345+0000","last_clean":"2024-09-21T09:06:40.986345+0000","last_became_active":"2024-09-21T09:03:02.217917+0000","last_became_peered":"2024-09-21T09:03:02.217917+0000","last_unstale":"2024-09-21T09:06:40.986345+0000","last_undegraded":"2024-09-21T09:06:40.986345+0000","last_fullsized":"2024-09-21T09:06:40.986345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:40.986232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:40.986232+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.986232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:10.981786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'46","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.798098+0000","last_change":"2024-09-21T09:06:26.798098+0000","last_active":"2024-09-21T09:06:26.798098+0000","last_peered":"2024-09-21T09:06:26.798098+0000","last_clean":"2024-09-21T09:06:26.798098+0000","last_became_active":"2024-09-21T09:03:04.235199+0000","last_became_peered":"2024-09-21T09:03:04.235199+0000","last_unstale":"2024-09-21T09:06:26.798098+0000","last_undegraded":"2024-09-21T09:06:26.798098+0000","last_fullsized":"2024-09-21T09:06:26.798098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-21T09:06:26.797980+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-21T09:06:26.797980+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.797980+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:46.759660+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'285","reported_seq":415,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.872473+0000","last_change":"2024-09-21T09:06:19.872473+0000","last_active":"2024-09-21T09:06:19.872473+0000","last_peered":"2024-09-21T09:06:19.872473+0000","last_clean":"2024-09-21T09:06:19.872473+0000","last_became_active":"2024-09-21T09:03:06.245904+0000","last_became_peered":"2024-09-21T09:03:06.245904+0000","last_unstale":"2024-09-21T09:06:19.872473+0000","last_undegraded":"2024-09-21T09:06:19.872473+0000","last_fullsized":"2024-09-21T09:06:19.872473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:19.872353+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:19.872353+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.872353+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:08.095534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'13","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:16.144340+0000","last_change":"2024-09-21T09:07:16.144340+0000","last_active":"2024-09-21T09:07:16.144340+0000","last_peered":"2024-09-21T09:07:16.144340+0000","last_clean":"2024-09-21T09:07:16.144340+0000","last_became_active":"2024-09-21T09:03:08.253648+0000","last_became_peered":"2024-09-21T09:03:08.253648+0000","last_unstale":"2024-09-21T09:07:16.144340+0000","last_undegraded":"2024-09-21T09:07:16.144340+0000","last_fullsized":"2024-09-21T09:07:16.144340+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-09-21T09:07:16.144218+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-09-21T09:07:16.144218+0000","last_clean_scrub_stamp":"2024-09-21T09:07:16.144218+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:32.982703+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'6","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.912356+0000","last_change":"2024-09-21T09:06:51.912356+0000","last_active":"2024-09-21T09:06:51.912356+0000","last_peered":"2024-09-21T09:06:51.912356+0000","last_clean":"2024-09-21T09:06:51.912356+0000","last_became_active":"2024-09-21T09:03:00.222983+0000","last_became_peered":"2024-09-21T09:03:00.222983+0000","last_unstale":"2024-09-21T09:06:51.912356+0000","last_undegraded":"2024-09-21T09:06:51.912356+0000","last_fullsized":"2024-09-21T09:06:51.912356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:51.912243+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:51.912243+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.912243+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:02.222694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:21.387746+0000","last_change":"2024-09-21T09:07:21.387771+0000","last_active":"2024-09-21T09:07:21.387746+0000","last_peered":"2024-09-21T09:07:21.387746+0000","last_clean":"2024-09-21T09:07:21.387746+0000","last_became_active":"2024-09-21T09:02:58.221805+0000","last_became_peered":"2024-09-21T09:02:58.221805+0000","last_unstale":"2024-09-21T09:07:21.387746+0000","last_undegraded":"2024-09-21T09:07:21.387746+0000","last_fullsized":"2024-09-21T09:07:21.387746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:21.387630+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:21.387630+0000","last_clean_scrub_stamp":"2024-09-21T09:07:21.387630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:04.776923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'5","reported_seq":429,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.332947+0000","last_change":"2024-09-21T09:06:29.332947+0000","last_active":"2024-09-21T09:06:29.332947+0000","last_peered":"2024-09-21T09:06:29.332947+0000","last_clean":"2024-09-21T09:06:29.332947+0000","last_became_active":"2024-09-21T09:03:02.222002+0000","last_became_peered":"2024-09-21T09:03:02.222002+0000","last_unstale":"2024-09-21T09:06:29.332947+0000","last_undegraded":"2024-09-21T09:06:29.332947+0000","last_fullsized":"2024-09-21T09:06:29.332947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-21T09:06:29.332773+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-21T09:06:29.332773+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.332773+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:09.966077+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.284654+0000","last_change":"2024-09-21T09:06:46.284654+0000","last_active":"2024-09-21T09:06:46.284654+0000","last_peered":"2024-09-21T09:06:46.284654+0000","last_clean":"2024-09-21T09:06:46.284654+0000","last_became_active":"2024-09-21T09:03:04.242702+0000","last_became_peered":"2024-09-21T09:03:04.242702+0000","last_unstale":"2024-09-21T09:06:46.284654+0000","last_undegraded":"2024-09-21T09:06:46.284654+0000","last_fullsized":"2024-09-21T09:06:46.284654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-21T09:06:46.284518+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-21T09:06:46.284518+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.284518+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:13.659340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'285","reported_seq":477,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.472499+0000","last_change":"2024-09-21T09:06:23.472499+0000","last_active":"2024-09-21T09:06:23.472499+0000","last_peered":"2024-09-21T09:06:23.472499+0000","last_clean":"2024-09-21T09:06:23.472499+0000","last_became_active":"2024-09-21T09:03:06.248991+0000","last_became_peered":"2024-09-21T09:03:06.248991+0000","last_unstale":"2024-09-21T09:06:23.472499+0000","last_undegraded":"2024-09-21T09:06:23.472499+0000","last_fullsized":"2024-09-21T09:06:23.472499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:23.472342+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:23.472342+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.472342+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:12:45.159682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.737148+0000","last_change":"2024-09-21T09:06:29.737148+0000","last_active":"2024-09-21T09:06:29.737148+0000","last_peered":"2024-09-21T09:06:29.737148+0000","last_clean":"2024-09-21T09:06:29.737148+0000","last_became_active":"2024-09-21T09:03:08.252549+0000","last_became_peered":"2024-09-21T09:03:08.252549+0000","last_unstale":"2024-09-21T09:06:29.737148+0000","last_undegraded":"2024-09-21T09:06:29.737148+0000","last_fullsized":"2024-09-21T09:06:29.737148+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:29.737036+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:29.737036+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.737036+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:16.036097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:57.545294+0000","last_change":"2024-09-21T09:06:57.545294+0000","last_active":"2024-09-21T09:06:57.545294+0000","last_peered":"2024-09-21T09:06:57.545294+0000","last_clean":"2024-09-21T09:06:57.545294+0000","last_became_active":"2024-09-21T09:03:00.223719+0000","last_became_peered":"2024-09-21T09:03:00.223719+0000","last_unstale":"2024-09-21T09:06:57.545294+0000","last_undegraded":"2024-09-21T09:06:57.545294+0000","last_fullsized":"2024-09-21T09:06:57.545294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:57.545132+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:57.545132+0000","last_clean_scrub_stamp":"2024-09-21T09:06:57.545132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:15.476402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:24.380207+0000","last_change":"2024-09-21T09:07:24.380246+0000","last_active":"2024-09-21T09:07:24.380207+0000","last_peered":"2024-09-21T09:07:24.380207+0000","last_clean":"2024-09-21T09:07:24.380207+0000","last_became_active":"2024-09-21T09:02:58.214074+0000","last_became_peered":"2024-09-21T09:02:58.214074+0000","last_unstale":"2024-09-21T09:07:24.380207+0000","last_undegraded":"2024-09-21T09:07:24.380207+0000","last_fullsized":"2024-09-21T09:07:24.380207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:24.380089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:24.380089+0000","last_clean_scrub_stamp":"2024-09-21T09:07:24.380089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.330523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.434407+0000","last_change":"2024-09-21T09:06:17.434407+0000","last_active":"2024-09-21T09:06:17.434407+0000","last_peered":"2024-09-21T09:06:17.434407+0000","last_clean":"2024-09-21T09:06:17.434407+0000","last_became_active":"2024-09-21T09:03:02.222095+0000","last_became_peered":"2024-09-21T09:03:02.222095+0000","last_unstale":"2024-09-21T09:06:17.434407+0000","last_undegraded":"2024-09-21T09:06:17.434407+0000","last_fullsized":"2024-09-21T09:06:17.434407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.434249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.434249+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.434249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:39.005942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'48","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.432715+0000","last_change":"2024-09-21T09:06:24.432715+0000","last_active":"2024-09-21T09:06:24.432715+0000","last_peered":"2024-09-21T09:06:24.432715+0000","last_clean":"2024-09-21T09:06:24.432715+0000","last_became_active":"2024-09-21T09:03:04.235633+0000","last_became_peered":"2024-09-21T09:03:04.235633+0000","last_unstale":"2024-09-21T09:06:24.432715+0000","last_undegraded":"2024-09-21T09:06:24.432715+0000","last_fullsized":"2024-09-21T09:06:24.432715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-09-21T09:06:24.432601+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-09-21T09:06:24.432601+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.432601+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:09.424036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.767379+0000","last_change":"2024-09-21T09:06:16.767379+0000","last_active":"2024-09-21T09:06:16.767379+0000","last_peered":"2024-09-21T09:06:16.767379+0000","last_clean":"2024-09-21T09:06:16.767379+0000","last_became_active":"2024-09-21T09:03:06.247977+0000","last_became_peered":"2024-09-21T09:03:06.247977+0000","last_unstale":"2024-09-21T09:06:16.767379+0000","last_undegraded":"2024-09-21T09:06:16.767379+0000","last_fullsized":"2024-09-21T09:06:16.767379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.767232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.767232+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.767232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:11.816433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.332932+0000","last_change":"2024-09-21T09:06:31.332932+0000","last_active":"2024-09-21T09:06:31.332932+0000","last_peered":"2024-09-21T09:06:31.332932+0000","last_clean":"2024-09-21T09:06:31.332932+0000","last_became_active":"2024-09-21T09:03:08.251985+0000","last_became_peered":"2024-09-21T09:03:08.251985+0000","last_unstale":"2024-09-21T09:06:31.332932+0000","last_undegraded":"2024-09-21T09:06:31.332932+0000","last_fullsized":"2024-09-21T09:06:31.332932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:31.332791+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:31.332791+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.332791+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:00.603145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.238589+0000","last_change":"2024-09-21T09:06:36.238589+0000","last_active":"2024-09-21T09:06:36.238589+0000","last_peered":"2024-09-21T09:06:36.238589+0000","last_clean":"2024-09-21T09:06:36.238589+0000","last_became_active":"2024-09-21T09:03:00.219428+0000","last_became_peered":"2024-09-21T09:03:00.219428+0000","last_unstale":"2024-09-21T09:06:36.238589+0000","last_undegraded":"2024-09-21T09:06:36.238589+0000","last_fullsized":"2024-09-21T09:06:36.238589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:36.238465+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:36.238465+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.238465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:33.483804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":213,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:01.553491+0000","last_change":"2024-09-21T09:07:01.553525+0000","last_active":"2024-09-21T09:07:01.553491+0000","last_peered":"2024-09-21T09:07:01.553491+0000","last_clean":"2024-09-21T09:07:01.553491+0000","last_became_active":"2024-09-21T09:02:44.107052+0000","last_became_peered":"2024-09-21T09:02:44.107052+0000","last_unstale":"2024-09-21T09:07:01.553491+0000","last_undegraded":"2024-09-21T09:07:01.553491+0000","last_fullsized":"2024-09-21T09:07:01.553491+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2024-09-21T09:07:01.553404+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2024-09-21T09:07:01.553404+0000","last_clean_scrub_stamp":"2024-09-21T09:07:01.553404+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:01.278628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"31'2","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:27.421322+0000","last_change":"2024-09-21T09:07:27.421350+0000","last_active":"2024-09-21T09:07:27.421322+0000","last_peered":"2024-09-21T09:07:27.421322+0000","last_clean":"2024-09-21T09:07:27.421322+0000","last_became_active":"2024-09-21T09:02:49.492504+0000","last_became_peered":"2024-09-21T09:02:49.492504+0000","last_unstale":"2024-09-21T09:07:27.421322+0000","last_undegraded":"2024-09-21T09:07:27.421322+0000","last_fullsized":"2024-09-21T09:07:27.421322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:27.421234+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:27.421234+0000","last_clean_scrub_stamp":"2024-09-21T09:07:27.421234+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:18.569943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001229291,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:19.376143+0000","last_change":"2024-09-21T09:07:19.376167+0000","last_active":"2024-09-21T09:07:19.376143+0000","last_peered":"2024-09-21T09:07:19.376143+0000","last_clean":"2024-09-21T09:07:19.376143+0000","last_became_active":"2024-09-21T09:02:58.221874+0000","last_became_peered":"2024-09-21T09:02:58.221874+0000","last_unstale":"2024-09-21T09:07:19.376143+0000","last_undegraded":"2024-09-21T09:07:19.376143+0000","last_fullsized":"2024-09-21T09:07:19.376143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:19.376050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:19.376050+0000","last_clean_scrub_stamp":"2024-09-21T09:07:19.376050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:47.489258+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:14.434324+0000","last_change":"2024-09-21T09:07:14.434346+0000","last_active":"2024-09-21T09:07:14.434324+0000","last_peered":"2024-09-21T09:07:14.434324+0000","last_clean":"2024-09-21T09:07:14.434324+0000","last_became_active":"2024-09-21T09:03:38.279694+0000","last_became_peered":"2024-09-21T09:03:38.279694+0000","last_unstale":"2024-09-21T09:07:14.434324+0000","last_undegraded":"2024-09-21T09:07:14.434324+0000","last_fullsized":"2024-09-21T09:07:14.434324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:14.434234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:14.434234+0000","last_clean_scrub_stamp":"2024-09-21T09:07:14.434234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:33.489032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'87","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.362531+0000","last_change":"2024-09-21T09:06:23.362531+0000","last_active":"2024-09-21T09:06:23.362531+0000","last_peered":"2024-09-21T09:06:23.362531+0000","last_clean":"2024-09-21T09:06:23.362531+0000","last_became_active":"2024-09-21T09:03:04.240327+0000","last_became_peered":"2024-09-21T09:03:04.240327+0000","last_unstale":"2024-09-21T09:06:23.362531+0000","last_undegraded":"2024-09-21T09:06:23.362531+0000","last_fullsized":"2024-09-21T09:06:23.362531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2024-09-21T09:06:23.362409+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2024-09-21T09:06:23.362409+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.362409+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:12.872538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:16.754043+0000","last_change":"2024-09-21T09:06:16.754043+0000","last_active":"2024-09-21T09:06:16.754043+0000","last_peered":"2024-09-21T09:06:16.754043+0000","last_clean":"2024-09-21T09:06:16.754043+0000","last_became_active":"2024-09-21T09:03:06.247593+0000","last_became_peered":"2024-09-21T09:03:06.247593+0000","last_unstale":"2024-09-21T09:06:16.754043+0000","last_undegraded":"2024-09-21T09:06:16.754043+0000","last_fullsized":"2024-09-21T09:06:16.754043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:16.753939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:16.753939+0000","last_clean_scrub_stamp":"2024-09-21T09:06:16.753939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:45.971463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'83","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.853332+0000","last_change":"2024-09-21T09:06:21.853332+0000","last_active":"2024-09-21T09:06:21.853332+0000","last_peered":"2024-09-21T09:06:21.853332+0000","last_clean":"2024-09-21T09:06:21.853332+0000","last_became_active":"2024-09-21T09:03:08.251416+0000","last_became_peered":"2024-09-21T09:03:08.251416+0000","last_unstale":"2024-09-21T09:06:21.853332+0000","last_undegraded":"2024-09-21T09:06:21.853332+0000","last_fullsized":"2024-09-21T09:06:21.853332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'83","last_scrub_stamp":"2024-09-21T09:06:21.853181+0000","last_deep_scrub":"31'83","last_deep_scrub_stamp":"2024-09-21T09:06:21.853181+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.853181+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:35.867187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.206620+0000","last_change":"2024-09-21T09:07:00.206620+0000","last_active":"2024-09-21T09:07:00.206620+0000","last_peered":"2024-09-21T09:07:00.206620+0000","last_clean":"2024-09-21T09:07:00.206620+0000","last_became_active":"2024-09-21T09:03:00.217018+0000","last_became_peered":"2024-09-21T09:03:00.217018+0000","last_unstale":"2024-09-21T09:07:00.206620+0000","last_undegraded":"2024-09-21T09:07:00.206620+0000","last_fullsized":"2024-09-21T09:07:00.206620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:00.206503+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:00.206503+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.206503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:29.029602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:28.418688+0000","last_change":"2024-09-21T09:07:28.418712+0000","last_active":"2024-09-21T09:07:28.418688+0000","last_peered":"2024-09-21T09:07:28.418688+0000","last_clean":"2024-09-21T09:07:28.418688+0000","last_became_active":"2024-09-21T09:02:49.493239+0000","last_became_peered":"2024-09-21T09:02:49.493239+0000","last_unstale":"2024-09-21T09:07:28.418688+0000","last_undegraded":"2024-09-21T09:07:28.418688+0000","last_fullsized":"2024-09-21T09:07:28.418688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:28.418561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:28.418561+0000","last_clean_scrub_stamp":"2024-09-21T09:07:28.418561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:37.283866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046437600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:59.048229+0000","last_change":"2024-09-21T09:06:59.048229+0000","last_active":"2024-09-21T09:06:59.048229+0000","last_peered":"2024-09-21T09:06:59.048229+0000","last_clean":"2024-09-21T09:06:59.048229+0000","last_became_active":"2024-09-21T09:02:58.208819+0000","last_became_peered":"2024-09-21T09:02:58.208819+0000","last_unstale":"2024-09-21T09:06:59.048229+0000","last_undegraded":"2024-09-21T09:06:59.048229+0000","last_fullsized":"2024-09-21T09:06:59.048229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:59.048112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:59.048112+0000","last_clean_scrub_stamp":"2024-09-21T09:06:59.048112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:54.468723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.385992+0000","last_change":"2024-09-21T09:06:19.385992+0000","last_active":"2024-09-21T09:06:19.385992+0000","last_peered":"2024-09-21T09:06:19.385992+0000","last_clean":"2024-09-21T09:06:19.385992+0000","last_became_active":"2024-09-21T09:03:02.220903+0000","last_became_peered":"2024-09-21T09:03:02.220903+0000","last_unstale":"2024-09-21T09:06:19.385992+0000","last_undegraded":"2024-09-21T09:06:19.385992+0000","last_fullsized":"2024-09-21T09:06:19.385992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.385871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.385871+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.385871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:53.002346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'290","reported_seq":515,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.477160+0000","last_change":"2024-09-21T09:06:21.477160+0000","last_active":"2024-09-21T09:06:21.477160+0000","last_peered":"2024-09-21T09:06:21.477160+0000","last_clean":"2024-09-21T09:06:21.477160+0000","last_became_active":"2024-09-21T09:03:04.240433+0000","last_became_peered":"2024-09-21T09:03:04.240433+0000","last_unstale":"2024-09-21T09:06:21.477160+0000","last_undegraded":"2024-09-21T09:06:21.477160+0000","last_fullsized":"2024-09-21T09:06:21.477160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'290","last_scrub_stamp":"2024-09-21T09:06:21.477013+0000","last_deep_scrub":"31'290","last_deep_scrub_stamp":"2024-09-21T09:06:21.477013+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.477013+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:50.761111+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.283613+0000","last_change":"2024-09-21T09:06:39.283613+0000","last_active":"2024-09-21T09:06:39.283613+0000","last_peered":"2024-09-21T09:06:39.283613+0000","last_clean":"2024-09-21T09:06:39.283613+0000","last_became_active":"2024-09-21T09:03:06.247746+0000","last_became_peered":"2024-09-21T09:03:06.247746+0000","last_unstale":"2024-09-21T09:06:39.283613+0000","last_undegraded":"2024-09-21T09:06:39.283613+0000","last_fullsized":"2024-09-21T09:06:39.283613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:39.283500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:39.283500+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.283500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:45.304746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.321611+0000","last_change":"2024-09-21T09:06:43.321611+0000","last_active":"2024-09-21T09:06:43.321611+0000","last_peered":"2024-09-21T09:06:43.321611+0000","last_clean":"2024-09-21T09:06:43.321611+0000","last_became_active":"2024-09-21T09:03:08.258104+0000","last_became_peered":"2024-09-21T09:03:08.258104+0000","last_unstale":"2024-09-21T09:06:43.321611+0000","last_undegraded":"2024-09-21T09:06:43.321611+0000","last_fullsized":"2024-09-21T09:06:43.321611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-21T09:06:43.321436+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-21T09:06:43.321436+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.321436+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:24.838301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.944005+0000","last_change":"2024-09-21T09:06:42.944005+0000","last_active":"2024-09-21T09:06:42.944005+0000","last_peered":"2024-09-21T09:06:42.944005+0000","last_clean":"2024-09-21T09:06:42.944005+0000","last_became_active":"2024-09-21T09:03:00.227191+0000","last_became_peered":"2024-09-21T09:03:00.227191+0000","last_unstale":"2024-09-21T09:06:42.944005+0000","last_undegraded":"2024-09-21T09:06:42.944005+0000","last_fullsized":"2024-09-21T09:06:42.944005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:06:42.943855+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:06:42.943855+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.943855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:23.983932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:55.810947+0000","last_change":"2024-09-21T09:06:55.810947+0000","last_active":"2024-09-21T09:06:55.810947+0000","last_peered":"2024-09-21T09:06:55.810947+0000","last_clean":"2024-09-21T09:06:55.810947+0000","last_became_active":"2024-09-21T09:02:49.493605+0000","last_became_peered":"2024-09-21T09:02:49.493605+0000","last_unstale":"2024-09-21T09:06:55.810947+0000","last_undegraded":"2024-09-21T09:06:55.810947+0000","last_fullsized":"2024-09-21T09:06:55.810947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:55.810813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:55.810813+0000","last_clean_scrub_stamp":"2024-09-21T09:06:55.810813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:02.641183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033020199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:57.111509+0000","last_change":"2024-09-21T09:06:57.111509+0000","last_active":"2024-09-21T09:06:57.111509+0000","last_peered":"2024-09-21T09:06:57.111509+0000","last_clean":"2024-09-21T09:06:57.111509+0000","last_became_active":"2024-09-21T09:02:58.209343+0000","last_became_peered":"2024-09-21T09:02:58.209343+0000","last_unstale":"2024-09-21T09:06:57.111509+0000","last_undegraded":"2024-09-21T09:06:57.111509+0000","last_fullsized":"2024-09-21T09:06:57.111509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:57.111398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:57.111398+0000","last_clean_scrub_stamp":"2024-09-21T09:06:57.111398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:15.042668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:03.754564+0000","last_change":"2024-09-21T09:07:03.754564+0000","last_active":"2024-09-21T09:07:03.754564+0000","last_peered":"2024-09-21T09:07:03.754564+0000","last_clean":"2024-09-21T09:07:03.754564+0000","last_became_active":"2024-09-21T09:03:02.219067+0000","last_became_peered":"2024-09-21T09:03:02.219067+0000","last_unstale":"2024-09-21T09:07:03.754564+0000","last_undegraded":"2024-09-21T09:07:03.754564+0000","last_fullsized":"2024-09-21T09:07:03.754564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:03.754443+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:03.754443+0000","last_clean_scrub_stamp":"2024-09-21T09:07:03.754443+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:55.306780+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'24","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:32.772608+0000","last_change":"2024-09-21T09:06:32.772608+0000","last_active":"2024-09-21T09:06:32.772608+0000","last_peered":"2024-09-21T09:06:32.772608+0000","last_clean":"2024-09-21T09:06:32.772608+0000","last_became_active":"2024-09-21T09:03:04.230686+0000","last_became_peered":"2024-09-21T09:03:04.230686+0000","last_unstale":"2024-09-21T09:06:32.772608+0000","last_undegraded":"2024-09-21T09:06:32.772608+0000","last_fullsized":"2024-09-21T09:06:32.772608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-09-21T09:06:32.772444+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-09-21T09:06:32.772444+0000","last_clean_scrub_stamp":"2024-09-21T09:06:32.772444+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:42.682945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.712994+0000","last_change":"2024-09-21T09:06:25.712994+0000","last_active":"2024-09-21T09:06:25.712994+0000","last_peered":"2024-09-21T09:06:25.712994+0000","last_clean":"2024-09-21T09:06:25.712994+0000","last_became_active":"2024-09-21T09:03:06.248087+0000","last_became_peered":"2024-09-21T09:03:06.248087+0000","last_unstale":"2024-09-21T09:06:25.712994+0000","last_undegraded":"2024-09-21T09:06:25.712994+0000","last_fullsized":"2024-09-21T09:06:25.712994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:25.712851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:25.712851+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.712851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:31.193094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:01.207912+0000","last_change":"2024-09-21T09:07:01.207912+0000","last_active":"2024-09-21T09:07:01.207912+0000","last_peered":"2024-09-21T09:07:01.207912+0000","last_clean":"2024-09-21T09:07:01.207912+0000","last_became_active":"2024-09-21T09:03:08.258974+0000","last_became_peered":"2024-09-21T09:03:08.258974+0000","last_unstale":"2024-09-21T09:07:01.207912+0000","last_undegraded":"2024-09-21T09:07:01.207912+0000","last_fullsized":"2024-09-21T09:07:01.207912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:01.207775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:01.207775+0000","last_clean_scrub_stamp":"2024-09-21T09:07:01.207775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:33.638981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'8","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.913163+0000","last_change":"2024-09-21T09:06:46.913163+0000","last_active":"2024-09-21T09:06:46.913163+0000","last_peered":"2024-09-21T09:06:46.913163+0000","last_clean":"2024-09-21T09:06:46.913163+0000","last_became_active":"2024-09-21T09:03:00.221080+0000","last_became_peered":"2024-09-21T09:03:00.221080+0000","last_unstale":"2024-09-21T09:06:46.913163+0000","last_undegraded":"2024-09-21T09:06:46.913163+0000","last_fullsized":"2024-09-21T09:06:46.913163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:46.913050+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:46.913050+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.913050+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:10.419981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"31'3","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:29.373904+0000","last_change":"2024-09-21T09:07:29.373939+0000","last_active":"2024-09-21T09:07:29.373904+0000","last_peered":"2024-09-21T09:07:29.373904+0000","last_clean":"2024-09-21T09:07:29.373904+0000","last_became_active":"2024-09-21T09:02:49.493348+0000","last_became_peered":"2024-09-21T09:02:49.493348+0000","last_unstale":"2024-09-21T09:07:29.373904+0000","last_undegraded":"2024-09-21T09:07:29.373904+0000","last_fullsized":"2024-09-21T09:07:29.373904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:07:29.373807+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:07:29.373807+0000","last_clean_scrub_stamp":"2024-09-21T09:07:29.373807+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:35.416216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00096028300000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:59.799144+0000","last_change":"2024-09-21T09:06:59.799144+0000","last_active":"2024-09-21T09:06:59.799144+0000","last_peered":"2024-09-21T09:06:59.799144+0000","last_clean":"2024-09-21T09:06:59.799144+0000","last_became_active":"2024-09-21T09:02:58.207236+0000","last_became_peered":"2024-09-21T09:02:58.207236+0000","last_unstale":"2024-09-21T09:06:59.799144+0000","last_undegraded":"2024-09-21T09:06:59.799144+0000","last_fullsized":"2024-09-21T09:06:59.799144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:59.799035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:59.799035+0000","last_clean_scrub_stamp":"2024-09-21T09:06:59.799035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:01.789556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.897587+0000","last_change":"2024-09-21T09:06:36.897587+0000","last_active":"2024-09-21T09:06:36.897587+0000","last_peered":"2024-09-21T09:06:36.897587+0000","last_clean":"2024-09-21T09:06:36.897587+0000","last_became_active":"2024-09-21T09:03:02.221310+0000","last_became_peered":"2024-09-21T09:03:02.221310+0000","last_unstale":"2024-09-21T09:06:36.897587+0000","last_undegraded":"2024-09-21T09:06:36.897587+0000","last_fullsized":"2024-09-21T09:06:36.897587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:36.897431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:36.897431+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.897431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.146414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'20","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.285705+0000","last_change":"2024-09-21T09:06:43.285705+0000","last_active":"2024-09-21T09:06:43.285705+0000","last_peered":"2024-09-21T09:06:43.285705+0000","last_clean":"2024-09-21T09:06:43.285705+0000","last_became_active":"2024-09-21T09:03:04.243076+0000","last_became_peered":"2024-09-21T09:03:04.243076+0000","last_unstale":"2024-09-21T09:06:43.285705+0000","last_undegraded":"2024-09-21T09:06:43.285705+0000","last_fullsized":"2024-09-21T09:06:43.285705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-09-21T09:06:43.285503+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-09-21T09:06:43.285503+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.285503+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:31.813485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.313875+0000","last_change":"2024-09-21T09:06:49.313875+0000","last_active":"2024-09-21T09:06:49.313875+0000","last_peered":"2024-09-21T09:06:49.313875+0000","last_clean":"2024-09-21T09:06:49.313875+0000","last_became_active":"2024-09-21T09:03:06.250530+0000","last_became_peered":"2024-09-21T09:03:06.250530+0000","last_unstale":"2024-09-21T09:06:49.313875+0000","last_undegraded":"2024-09-21T09:06:49.313875+0000","last_fullsized":"2024-09-21T09:06:49.313875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:49.313729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:49.313729+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.313729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:37:17.387230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:10.451255+0000","last_change":"2024-09-21T09:07:10.451255+0000","last_active":"2024-09-21T09:07:10.451255+0000","last_peered":"2024-09-21T09:07:10.451255+0000","last_clean":"2024-09-21T09:07:10.451255+0000","last_became_active":"2024-09-21T09:03:08.262240+0000","last_became_peered":"2024-09-21T09:03:08.262240+0000","last_unstale":"2024-09-21T09:07:10.451255+0000","last_undegraded":"2024-09-21T09:07:10.451255+0000","last_fullsized":"2024-09-21T09:07:10.451255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:07:10.451100+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:07:10.451100+0000","last_clean_scrub_stamp":"2024-09-21T09:07:10.451100+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:50.493055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:40.322444+0000","last_change":"2024-09-21T09:06:40.322444+0000","last_active":"2024-09-21T09:06:40.322444+0000","last_peered":"2024-09-21T09:06:40.322444+0000","last_clean":"2024-09-21T09:06:40.322444+0000","last_became_active":"2024-09-21T09:03:00.224297+0000","last_became_peered":"2024-09-21T09:03:00.224297+0000","last_unstale":"2024-09-21T09:06:40.322444+0000","last_undegraded":"2024-09-21T09:06:40.322444+0000","last_fullsized":"2024-09-21T09:06:40.322444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:40.322322+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:40.322322+0000","last_clean_scrub_stamp":"2024-09-21T09:06:40.322322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.153226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:58.832458+0000","last_change":"2024-09-21T09:06:58.832458+0000","last_active":"2024-09-21T09:06:58.832458+0000","last_peered":"2024-09-21T09:06:58.832458+0000","last_clean":"2024-09-21T09:06:58.832458+0000","last_became_active":"2024-09-21T09:02:58.206718+0000","last_became_peered":"2024-09-21T09:02:58.206718+0000","last_unstale":"2024-09-21T09:06:58.832458+0000","last_undegraded":"2024-09-21T09:06:58.832458+0000","last_fullsized":"2024-09-21T09:06:58.832458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:58.832345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:58.832345+0000","last_clean_scrub_stamp":"2024-09-21T09:06:58.832345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:14.309366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:04.993328+0000","last_change":"2024-09-21T09:07:04.993355+0000","last_active":"2024-09-21T09:07:04.993328+0000","last_peered":"2024-09-21T09:07:04.993328+0000","last_clean":"2024-09-21T09:07:04.993328+0000","last_became_active":"2024-09-21T09:02:49.493509+0000","last_became_peered":"2024-09-21T09:02:49.493509+0000","last_unstale":"2024-09-21T09:07:04.993328+0000","last_undegraded":"2024-09-21T09:07:04.993328+0000","last_fullsized":"2024-09-21T09:07:04.993328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:04.993232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:04.993232+0000","last_clean_scrub_stamp":"2024-09-21T09:07:04.993232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:06.820978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038981200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.859438+0000","last_change":"2024-09-21T09:06:35.859438+0000","last_active":"2024-09-21T09:06:35.859438+0000","last_peered":"2024-09-21T09:06:35.859438+0000","last_clean":"2024-09-21T09:06:35.859438+0000","last_became_active":"2024-09-21T09:03:02.221309+0000","last_became_peered":"2024-09-21T09:03:02.221309+0000","last_unstale":"2024-09-21T09:06:35.859438+0000","last_undegraded":"2024-09-21T09:06:35.859438+0000","last_fullsized":"2024-09-21T09:06:35.859438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2024-09-21T09:06:35.859308+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2024-09-21T09:06:35.859308+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.859308+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:10.403536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'73","reported_seq":150,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.721519+0000","last_change":"2024-09-21T09:06:23.721519+0000","last_active":"2024-09-21T09:06:23.721519+0000","last_peered":"2024-09-21T09:06:23.721519+0000","last_clean":"2024-09-21T09:06:23.721519+0000","last_became_active":"2024-09-21T09:03:04.243228+0000","last_became_peered":"2024-09-21T09:03:04.243228+0000","last_unstale":"2024-09-21T09:06:23.721519+0000","last_undegraded":"2024-09-21T09:06:23.721519+0000","last_fullsized":"2024-09-21T09:06:23.721519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2024-09-21T09:06:23.721394+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2024-09-21T09:06:23.721394+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.721394+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:53.684792+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:18.826638+0000","last_change":"2024-09-21T09:06:18.826638+0000","last_active":"2024-09-21T09:06:18.826638+0000","last_peered":"2024-09-21T09:06:18.826638+0000","last_clean":"2024-09-21T09:06:18.826638+0000","last_became_active":"2024-09-21T09:03:06.246598+0000","last_became_peered":"2024-09-21T09:03:06.246598+0000","last_unstale":"2024-09-21T09:06:18.826638+0000","last_undegraded":"2024-09-21T09:06:18.826638+0000","last_fullsized":"2024-09-21T09:06:18.826638+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:18.826477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:18.826477+0000","last_clean_scrub_stamp":"2024-09-21T09:06:18.826477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:07.103764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:15.144630+0000","last_change":"2024-09-21T09:07:15.144630+0000","last_active":"2024-09-21T09:07:15.144630+0000","last_peered":"2024-09-21T09:07:15.144630+0000","last_clean":"2024-09-21T09:07:15.144630+0000","last_became_active":"2024-09-21T09:03:08.250714+0000","last_became_peered":"2024-09-21T09:03:08.250714+0000","last_unstale":"2024-09-21T09:07:15.144630+0000","last_undegraded":"2024-09-21T09:07:15.144630+0000","last_fullsized":"2024-09-21T09:07:15.144630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-21T09:07:15.144496+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-21T09:07:15.144496+0000","last_clean_scrub_stamp":"2024-09-21T09:07:15.144496+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:35.685007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'10","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:16.439534+0000","last_change":"2024-09-21T09:07:16.439559+0000","last_active":"2024-09-21T09:07:16.439534+0000","last_peered":"2024-09-21T09:07:16.439534+0000","last_clean":"2024-09-21T09:07:16.439534+0000","last_became_active":"2024-09-21T09:03:38.282889+0000","last_became_peered":"2024-09-21T09:03:38.282889+0000","last_unstale":"2024-09-21T09:07:16.439534+0000","last_undegraded":"2024-09-21T09:07:16.439534+0000","last_fullsized":"2024-09-21T09:07:16.439534+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:07:16.439446+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:07:16.439446+0000","last_clean_scrub_stamp":"2024-09-21T09:07:16.439446+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:07.428199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:02.944935+0000","last_change":"2024-09-21T09:07:02.944935+0000","last_active":"2024-09-21T09:07:02.944935+0000","last_peered":"2024-09-21T09:07:02.944935+0000","last_clean":"2024-09-21T09:07:02.944935+0000","last_became_active":"2024-09-21T09:02:58.208569+0000","last_became_peered":"2024-09-21T09:02:58.208569+0000","last_unstale":"2024-09-21T09:07:02.944935+0000","last_undegraded":"2024-09-21T09:07:02.944935+0000","last_fullsized":"2024-09-21T09:07:02.944935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:02.944798+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:02.944798+0000","last_clean_scrub_stamp":"2024-09-21T09:07:02.944798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:11:45.528934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:30.418082+0000","last_change":"2024-09-21T09:07:30.418105+0000","last_active":"2024-09-21T09:07:30.418082+0000","last_peered":"2024-09-21T09:07:30.418082+0000","last_clean":"2024-09-21T09:07:30.418082+0000","last_became_active":"2024-09-21T09:02:49.493469+0000","last_became_peered":"2024-09-21T09:02:49.493469+0000","last_unstale":"2024-09-21T09:07:30.418082+0000","last_undegraded":"2024-09-21T09:07:30.418082+0000","last_fullsized":"2024-09-21T09:07:30.418082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:30.417989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:30.417989+0000","last_clean_scrub_stamp":"2024-09-21T09:07:30.417989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:56.941500+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001228114,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.353354+0000","last_change":"2024-09-21T09:06:26.353354+0000","last_active":"2024-09-21T09:06:26.353354+0000","last_peered":"2024-09-21T09:06:26.353354+0000","last_clean":"2024-09-21T09:06:26.353354+0000","last_became_active":"2024-09-21T09:03:02.218232+0000","last_became_peered":"2024-09-21T09:03:02.218232+0000","last_unstale":"2024-09-21T09:06:26.353354+0000","last_undegraded":"2024-09-21T09:06:26.353354+0000","last_fullsized":"2024-09-21T09:06:26.353354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:26.353187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:26.353187+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.353187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:04.665812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'21","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.504016+0000","last_change":"2024-09-21T09:06:20.504016+0000","last_active":"2024-09-21T09:06:20.504016+0000","last_peered":"2024-09-21T09:06:20.504016+0000","last_clean":"2024-09-21T09:06:20.504016+0000","last_became_active":"2024-09-21T09:03:04.241500+0000","last_became_peered":"2024-09-21T09:03:04.241500+0000","last_unstale":"2024-09-21T09:06:20.504016+0000","last_undegraded":"2024-09-21T09:06:20.504016+0000","last_fullsized":"2024-09-21T09:06:20.504016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-09-21T09:06:20.503834+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-09-21T09:06:20.503834+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.503834+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:54.738751+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'285","reported_seq":367,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.375756+0000","last_change":"2024-09-21T09:06:27.375756+0000","last_active":"2024-09-21T09:06:27.375756+0000","last_peered":"2024-09-21T09:06:27.375756+0000","last_clean":"2024-09-21T09:06:27.375756+0000","last_became_active":"2024-09-21T09:03:06.249303+0000","last_became_peered":"2024-09-21T09:03:06.249303+0000","last_unstale":"2024-09-21T09:06:27.375756+0000","last_undegraded":"2024-09-21T09:06:27.375756+0000","last_fullsized":"2024-09-21T09:06:27.375756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:27.375647+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:27.375647+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.375647+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:46.869896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:40.459088+0000","last_change":"2024-09-21T09:07:40.459115+0000","last_active":"2024-09-21T09:07:40.459088+0000","last_peered":"2024-09-21T09:07:40.459088+0000","last_clean":"2024-09-21T09:07:40.459088+0000","last_became_active":"2024-09-21T09:03:08.264322+0000","last_became_peered":"2024-09-21T09:03:08.264322+0000","last_unstale":"2024-09-21T09:07:40.459088+0000","last_undegraded":"2024-09-21T09:07:40.459088+0000","last_fullsized":"2024-09-21T09:07:40.459088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:07:40.458987+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:07:40.458987+0000","last_clean_scrub_stamp":"2024-09-21T09:07:40.458987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:27.109944+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:05.844502+0000","last_change":"2024-09-21T09:07:05.844502+0000","last_active":"2024-09-21T09:07:05.844502+0000","last_peered":"2024-09-21T09:07:05.844502+0000","last_clean":"2024-09-21T09:07:05.844502+0000","last_became_active":"2024-09-21T09:03:38.277629+0000","last_became_peered":"2024-09-21T09:03:38.277629+0000","last_unstale":"2024-09-21T09:07:05.844502+0000","last_undegraded":"2024-09-21T09:07:05.844502+0000","last_fullsized":"2024-09-21T09:07:05.844502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:05.844383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:05.844383+0000","last_clean_scrub_stamp":"2024-09-21T09:07:05.844383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:38.255577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:35.476354+0000","last_change":"2024-09-21T09:07:35.476383+0000","last_active":"2024-09-21T09:07:35.476354+0000","last_peered":"2024-09-21T09:07:35.476354+0000","last_clean":"2024-09-21T09:07:35.476354+0000","last_became_active":"2024-09-21T09:02:58.223652+0000","last_became_peered":"2024-09-21T09:02:58.223652+0000","last_unstale":"2024-09-21T09:07:35.476354+0000","last_undegraded":"2024-09-21T09:07:35.476354+0000","last_fullsized":"2024-09-21T09:07:35.476354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:35.476259+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:35.476259+0000","last_clean_scrub_stamp":"2024-09-21T09:07:35.476259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:54.110534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:03.982018+0000","last_change":"2024-09-21T09:07:03.982018+0000","last_active":"2024-09-21T09:07:03.982018+0000","last_peered":"2024-09-21T09:07:03.982018+0000","last_clean":"2024-09-21T09:07:03.982018+0000","last_became_active":"2024-09-21T09:02:49.493144+0000","last_became_peered":"2024-09-21T09:02:49.493144+0000","last_unstale":"2024-09-21T09:07:03.982018+0000","last_undegraded":"2024-09-21T09:07:03.982018+0000","last_fullsized":"2024-09-21T09:07:03.982018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:03.981903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:03.981903+0000","last_clean_scrub_stamp":"2024-09-21T09:07:03.981903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:44.720403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042500699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.311245+0000","last_change":"2024-09-21T09:06:24.311245+0000","last_active":"2024-09-21T09:06:24.311245+0000","last_peered":"2024-09-21T09:06:24.311245+0000","last_clean":"2024-09-21T09:06:24.311245+0000","last_became_active":"2024-09-21T09:03:02.219133+0000","last_became_peered":"2024-09-21T09:03:02.219133+0000","last_unstale":"2024-09-21T09:06:24.311245+0000","last_undegraded":"2024-09-21T09:06:24.311245+0000","last_fullsized":"2024-09-21T09:06:24.311245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:24.311064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:24.311064+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.311064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:35.086372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.280030+0000","last_change":"2024-09-21T09:06:33.280030+0000","last_active":"2024-09-21T09:06:33.280030+0000","last_peered":"2024-09-21T09:06:33.280030+0000","last_clean":"2024-09-21T09:06:33.280030+0000","last_became_active":"2024-09-21T09:03:04.241256+0000","last_became_peered":"2024-09-21T09:03:04.241256+0000","last_unstale":"2024-09-21T09:06:33.280030+0000","last_undegraded":"2024-09-21T09:06:33.280030+0000","last_fullsized":"2024-09-21T09:06:33.280030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-21T09:06:33.279879+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-21T09:06:33.279879+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.279879+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:01.162062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'285","reported_seq":441,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.713004+0000","last_change":"2024-09-21T09:06:22.713004+0000","last_active":"2024-09-21T09:06:22.713004+0000","last_peered":"2024-09-21T09:06:22.713004+0000","last_clean":"2024-09-21T09:06:22.713004+0000","last_became_active":"2024-09-21T09:03:06.243566+0000","last_became_peered":"2024-09-21T09:03:06.243566+0000","last_unstale":"2024-09-21T09:06:22.713004+0000","last_undegraded":"2024-09-21T09:06:22.713004+0000","last_fullsized":"2024-09-21T09:06:22.713004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:22.712831+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:22.712831+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.712831+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:04.506029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'5","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:13.413181+0000","last_change":"2024-09-21T09:07:13.413181+0000","last_active":"2024-09-21T09:07:13.413181+0000","last_peered":"2024-09-21T09:07:13.413181+0000","last_clean":"2024-09-21T09:07:13.413181+0000","last_became_active":"2024-09-21T09:03:08.262460+0000","last_became_peered":"2024-09-21T09:03:08.262460+0000","last_unstale":"2024-09-21T09:07:13.413181+0000","last_undegraded":"2024-09-21T09:07:13.413181+0000","last_fullsized":"2024-09-21T09:07:13.413181+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-21T09:07:13.413059+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-21T09:07:13.413059+0000","last_clean_scrub_stamp":"2024-09-21T09:07:13.413059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:02.535950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'14","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:39.862325+0000","last_change":"2024-09-21T09:06:39.862325+0000","last_active":"2024-09-21T09:06:39.862325+0000","last_peered":"2024-09-21T09:06:39.862325+0000","last_clean":"2024-09-21T09:06:39.862325+0000","last_became_active":"2024-09-21T09:03:00.216782+0000","last_became_peered":"2024-09-21T09:03:00.216782+0000","last_unstale":"2024-09-21T09:06:39.862325+0000","last_undegraded":"2024-09-21T09:06:39.862325+0000","last_fullsized":"2024-09-21T09:06:39.862325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:39.862176+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:39.862176+0000","last_clean_scrub_stamp":"2024-09-21T09:06:39.862176+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:04:29.094210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:50.407358+0000","last_change":"2024-09-21T09:06:50.407358+0000","last_active":"2024-09-21T09:06:50.407358+0000","last_peered":"2024-09-21T09:06:50.407358+0000","last_clean":"2024-09-21T09:06:50.407358+0000","last_became_active":"2024-09-21T09:02:58.213293+0000","last_became_peered":"2024-09-21T09:02:58.213293+0000","last_unstale":"2024-09-21T09:06:50.407358+0000","last_undegraded":"2024-09-21T09:06:50.407358+0000","last_fullsized":"2024-09-21T09:06:50.407358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:50.407214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:50.407214+0000","last_clean_scrub_stamp":"2024-09-21T09:06:50.407214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:03:45.219496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:31.467349+0000","last_change":"2024-09-21T09:07:31.467408+0000","last_active":"2024-09-21T09:07:31.467349+0000","last_peered":"2024-09-21T09:07:31.467349+0000","last_clean":"2024-09-21T09:07:31.467349+0000","last_became_active":"2024-09-21T09:02:49.542160+0000","last_became_peered":"2024-09-21T09:02:49.542160+0000","last_unstale":"2024-09-21T09:07:31.467349+0000","last_undegraded":"2024-09-21T09:07:31.467349+0000","last_fullsized":"2024-09-21T09:07:31.467349+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:31.467209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:31.467209+0000","last_clean_scrub_stamp":"2024-09-21T09:07:31.467209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:22.555676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099618800000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.307002+0000","last_change":"2024-09-21T09:06:27.307002+0000","last_active":"2024-09-21T09:06:27.307002+0000","last_peered":"2024-09-21T09:06:27.307002+0000","last_clean":"2024-09-21T09:06:27.307002+0000","last_became_active":"2024-09-21T09:03:02.218138+0000","last_became_peered":"2024-09-21T09:03:02.218138+0000","last_unstale":"2024-09-21T09:06:27.307002+0000","last_undegraded":"2024-09-21T09:06:27.307002+0000","last_fullsized":"2024-09-21T09:06:27.307002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:27.306889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:27.306889+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.306889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:50.637433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'98","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.794110+0000","last_change":"2024-09-21T09:06:31.794110+0000","last_active":"2024-09-21T09:06:31.794110+0000","last_peered":"2024-09-21T09:06:31.794110+0000","last_clean":"2024-09-21T09:06:31.794110+0000","last_became_active":"2024-09-21T09:03:04.231708+0000","last_became_peered":"2024-09-21T09:03:04.231708+0000","last_unstale":"2024-09-21T09:06:31.794110+0000","last_undegraded":"2024-09-21T09:06:31.794110+0000","last_fullsized":"2024-09-21T09:06:31.794110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2024-09-21T09:06:31.793976+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2024-09-21T09:06:31.793976+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.793976+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:01.757375+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":98,"num_read_kb":92,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.935186+0000","last_change":"2024-09-21T09:06:37.935186+0000","last_active":"2024-09-21T09:06:37.935186+0000","last_peered":"2024-09-21T09:06:37.935186+0000","last_clean":"2024-09-21T09:06:37.935186+0000","last_became_active":"2024-09-21T09:03:06.249474+0000","last_became_peered":"2024-09-21T09:03:06.249474+0000","last_unstale":"2024-09-21T09:06:37.935186+0000","last_undegraded":"2024-09-21T09:06:37.935186+0000","last_fullsized":"2024-09-21T09:06:37.935186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:37.935053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:37.935053+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.935053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:29.492174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:25.780707+0000","last_change":"2024-09-21T09:06:25.780707+0000","last_active":"2024-09-21T09:06:25.780707+0000","last_peered":"2024-09-21T09:06:25.780707+0000","last_clean":"2024-09-21T09:06:25.780707+0000","last_became_active":"2024-09-21T09:03:08.252363+0000","last_became_peered":"2024-09-21T09:03:08.252363+0000","last_unstale":"2024-09-21T09:06:25.780707+0000","last_undegraded":"2024-09-21T09:06:25.780707+0000","last_fullsized":"2024-09-21T09:06:25.780707+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:25.780594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:25.780594+0000","last_clean_scrub_stamp":"2024-09-21T09:06:25.780594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:37.186890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.855293+0000","last_change":"2024-09-21T09:06:37.855293+0000","last_active":"2024-09-21T09:06:37.855293+0000","last_peered":"2024-09-21T09:06:37.855293+0000","last_clean":"2024-09-21T09:06:37.855293+0000","last_became_active":"2024-09-21T09:03:08.256571+0000","last_became_peered":"2024-09-21T09:03:08.256571+0000","last_unstale":"2024-09-21T09:06:37.855293+0000","last_undegraded":"2024-09-21T09:06:37.855293+0000","last_fullsized":"2024-09-21T09:06:37.855293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:37.855168+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:37.855168+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.855168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:52.809661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'12","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:10.788096+0000","last_change":"2024-09-21T09:07:10.788096+0000","last_active":"2024-09-21T09:07:10.788096+0000","last_peered":"2024-09-21T09:07:10.788096+0000","last_clean":"2024-09-21T09:07:10.788096+0000","last_became_active":"2024-09-21T09:03:38.466274+0000","last_became_peered":"2024-09-21T09:03:38.466274+0000","last_unstale":"2024-09-21T09:07:10.788096+0000","last_undegraded":"2024-09-21T09:07:10.788096+0000","last_fullsized":"2024-09-21T09:07:10.788096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:07:10.787983+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:07:10.787983+0000","last_clean_scrub_stamp":"2024-09-21T09:07:10.787983+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:11:53.372119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:11.314665+0000","last_change":"2024-09-21T09:07:11.314665+0000","last_active":"2024-09-21T09:07:11.314665+0000","last_peered":"2024-09-21T09:07:11.314665+0000","last_clean":"2024-09-21T09:07:11.314665+0000","last_became_active":"2024-09-21T09:02:58.220716+0000","last_became_peered":"2024-09-21T09:02:58.220716+0000","last_unstale":"2024-09-21T09:07:11.314665+0000","last_undegraded":"2024-09-21T09:07:11.314665+0000","last_fullsized":"2024-09-21T09:07:11.314665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:11.314540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:11.314540+0000","last_clean_scrub_stamp":"2024-09-21T09:07:11.314540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:17.515915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:33.293155+0000","last_change":"2024-09-21T09:06:33.293155+0000","last_active":"2024-09-21T09:06:33.293155+0000","last_peered":"2024-09-21T09:06:33.293155+0000","last_clean":"2024-09-21T09:06:33.293155+0000","last_became_active":"2024-09-21T09:03:02.219652+0000","last_became_peered":"2024-09-21T09:03:02.219652+0000","last_unstale":"2024-09-21T09:06:33.293155+0000","last_undegraded":"2024-09-21T09:06:33.293155+0000","last_fullsized":"2024-09-21T09:06:33.293155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:33.293033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:33.293033+0000","last_clean_scrub_stamp":"2024-09-21T09:06:33.293033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:32:06.406355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'39","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.278476+0000","last_change":"2024-09-21T09:06:37.278476+0000","last_active":"2024-09-21T09:06:37.278476+0000","last_peered":"2024-09-21T09:06:37.278476+0000","last_clean":"2024-09-21T09:06:37.278476+0000","last_became_active":"2024-09-21T09:03:04.241612+0000","last_became_peered":"2024-09-21T09:03:04.241612+0000","last_unstale":"2024-09-21T09:06:37.278476+0000","last_undegraded":"2024-09-21T09:06:37.278476+0000","last_fullsized":"2024-09-21T09:06:37.278476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-21T09:06:37.278334+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-21T09:06:37.278334+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.278334+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:25.732945+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:57.255074+0000","last_change":"2024-09-21T09:06:57.255074+0000","last_active":"2024-09-21T09:06:57.255074+0000","last_peered":"2024-09-21T09:06:57.255074+0000","last_clean":"2024-09-21T09:06:57.255074+0000","last_became_active":"2024-09-21T09:03:06.250750+0000","last_became_peered":"2024-09-21T09:03:06.250750+0000","last_unstale":"2024-09-21T09:06:57.255074+0000","last_undegraded":"2024-09-21T09:06:57.255074+0000","last_fullsized":"2024-09-21T09:06:57.255074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:57.254961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:57.254961+0000","last_clean_scrub_stamp":"2024-09-21T09:06:57.254961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:57.736160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'11","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:18.211496+0000","last_change":"2024-09-21T09:07:18.211525+0000","last_active":"2024-09-21T09:07:18.211496+0000","last_peered":"2024-09-21T09:07:18.211496+0000","last_clean":"2024-09-21T09:07:18.211496+0000","last_became_active":"2024-09-21T09:03:08.259602+0000","last_became_peered":"2024-09-21T09:03:08.259602+0000","last_unstale":"2024-09-21T09:07:18.211496+0000","last_undegraded":"2024-09-21T09:07:18.211496+0000","last_fullsized":"2024-09-21T09:07:18.211496+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2024-09-21T09:07:18.211400+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2024-09-21T09:07:18.211400+0000","last_clean_scrub_stamp":"2024-09-21T09:07:18.211400+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:36.358906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:37.310974+0000","last_change":"2024-09-21T09:06:37.310974+0000","last_active":"2024-09-21T09:06:37.310974+0000","last_peered":"2024-09-21T09:06:37.310974+0000","last_clean":"2024-09-21T09:06:37.310974+0000","last_became_active":"2024-09-21T09:03:00.225811+0000","last_became_peered":"2024-09-21T09:03:00.225811+0000","last_unstale":"2024-09-21T09:06:37.310974+0000","last_undegraded":"2024-09-21T09:06:37.310974+0000","last_fullsized":"2024-09-21T09:06:37.310974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:37.310866+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:37.310866+0000","last_clean_scrub_stamp":"2024-09-21T09:06:37.310866+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.559849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:06.847440+0000","last_change":"2024-09-21T09:07:06.847440+0000","last_active":"2024-09-21T09:07:06.847440+0000","last_peered":"2024-09-21T09:07:06.847440+0000","last_clean":"2024-09-21T09:07:06.847440+0000","last_became_active":"2024-09-21T09:03:38.280539+0000","last_became_peered":"2024-09-21T09:03:38.280539+0000","last_unstale":"2024-09-21T09:07:06.847440+0000","last_undegraded":"2024-09-21T09:07:06.847440+0000","last_fullsized":"2024-09-21T09:07:06.847440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:06.847333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:06.847333+0000","last_clean_scrub_stamp":"2024-09-21T09:07:06.847333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:02.267944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:21.390097+0000","last_change":"2024-09-21T09:06:21.390097+0000","last_active":"2024-09-21T09:06:21.390097+0000","last_peered":"2024-09-21T09:06:21.390097+0000","last_clean":"2024-09-21T09:06:21.390097+0000","last_became_active":"2024-09-21T09:03:02.222474+0000","last_became_peered":"2024-09-21T09:03:02.222474+0000","last_unstale":"2024-09-21T09:06:21.390097+0000","last_undegraded":"2024-09-21T09:06:21.390097+0000","last_fullsized":"2024-09-21T09:06:21.390097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:21.389982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:21.389982+0000","last_clean_scrub_stamp":"2024-09-21T09:06:21.389982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:19.738715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'9","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.747258+0000","last_change":"2024-09-21T09:06:30.747258+0000","last_active":"2024-09-21T09:06:30.747258+0000","last_peered":"2024-09-21T09:06:30.747258+0000","last_clean":"2024-09-21T09:06:30.747258+0000","last_became_active":"2024-09-21T09:03:04.232474+0000","last_became_peered":"2024-09-21T09:03:04.232474+0000","last_unstale":"2024-09-21T09:06:30.747258+0000","last_undegraded":"2024-09-21T09:06:30.747258+0000","last_fullsized":"2024-09-21T09:06:30.747258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-21T09:06:30.747132+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-21T09:06:30.747132+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.747132+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:13:40.597960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.808683+0000","last_change":"2024-09-21T09:06:17.808683+0000","last_active":"2024-09-21T09:06:17.808683+0000","last_peered":"2024-09-21T09:06:17.808683+0000","last_clean":"2024-09-21T09:06:17.808683+0000","last_became_active":"2024-09-21T09:03:06.250773+0000","last_became_peered":"2024-09-21T09:03:06.250773+0000","last_unstale":"2024-09-21T09:06:17.808683+0000","last_undegraded":"2024-09-21T09:06:17.808683+0000","last_fullsized":"2024-09-21T09:06:17.808683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.808555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.808555+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.808555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.180280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:14.140828+0000","last_change":"2024-09-21T09:07:14.140852+0000","last_active":"2024-09-21T09:07:14.140828+0000","last_peered":"2024-09-21T09:07:14.140828+0000","last_clean":"2024-09-21T09:07:14.140828+0000","last_became_active":"2024-09-21T09:03:08.250617+0000","last_became_peered":"2024-09-21T09:03:08.250617+0000","last_unstale":"2024-09-21T09:07:14.140828+0000","last_undegraded":"2024-09-21T09:07:14.140828+0000","last_fullsized":"2024-09-21T09:07:14.140828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:14.140714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:14.140714+0000","last_clean_scrub_stamp":"2024-09-21T09:07:14.140714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:33.195512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'14","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:49.994873+0000","last_change":"2024-09-21T09:06:49.994873+0000","last_active":"2024-09-21T09:06:49.994873+0000","last_peered":"2024-09-21T09:06:49.994873+0000","last_clean":"2024-09-21T09:06:49.994873+0000","last_became_active":"2024-09-21T09:03:00.215591+0000","last_became_peered":"2024-09-21T09:03:00.215591+0000","last_unstale":"2024-09-21T09:06:49.994873+0000","last_undegraded":"2024-09-21T09:06:49.994873+0000","last_fullsized":"2024-09-21T09:06:49.994873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:49.994677+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:49.994677+0000","last_clean_scrub_stamp":"2024-09-21T09:06:49.994677+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:34.312234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:52.874160+0000","last_change":"2024-09-21T09:06:52.874160+0000","last_active":"2024-09-21T09:06:52.874160+0000","last_peered":"2024-09-21T09:06:52.874160+0000","last_clean":"2024-09-21T09:06:52.874160+0000","last_became_active":"2024-09-21T09:02:58.217931+0000","last_became_peered":"2024-09-21T09:02:58.217931+0000","last_unstale":"2024-09-21T09:06:52.874160+0000","last_undegraded":"2024-09-21T09:06:52.874160+0000","last_fullsized":"2024-09-21T09:06:52.874160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:52.874045+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:52.874045+0000","last_clean_scrub_stamp":"2024-09-21T09:06:52.874045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:52.416511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.887465+0000","last_change":"2024-09-21T09:06:38.887465+0000","last_active":"2024-09-21T09:06:38.887465+0000","last_peered":"2024-09-21T09:06:38.887465+0000","last_clean":"2024-09-21T09:06:38.887465+0000","last_became_active":"2024-09-21T09:03:02.219265+0000","last_became_peered":"2024-09-21T09:03:02.219265+0000","last_unstale":"2024-09-21T09:06:38.887465+0000","last_undegraded":"2024-09-21T09:06:38.887465+0000","last_fullsized":"2024-09-21T09:06:38.887465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:38.887351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:38.887351+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.887351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:05.248119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'47","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.702348+0000","last_change":"2024-09-21T09:06:28.702348+0000","last_active":"2024-09-21T09:06:28.702348+0000","last_peered":"2024-09-21T09:06:28.702348+0000","last_clean":"2024-09-21T09:06:28.702348+0000","last_became_active":"2024-09-21T09:03:04.233393+0000","last_became_peered":"2024-09-21T09:03:04.233393+0000","last_unstale":"2024-09-21T09:06:28.702348+0000","last_undegraded":"2024-09-21T09:06:28.702348+0000","last_fullsized":"2024-09-21T09:06:28.702348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-09-21T09:06:28.702205+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-09-21T09:06:28.702205+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.702205+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:15.159343+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.509511+0000","last_change":"2024-09-21T09:06:19.509511+0000","last_active":"2024-09-21T09:06:19.509511+0000","last_peered":"2024-09-21T09:06:19.509511+0000","last_clean":"2024-09-21T09:06:19.509511+0000","last_became_active":"2024-09-21T09:03:06.248954+0000","last_became_peered":"2024-09-21T09:03:06.248954+0000","last_unstale":"2024-09-21T09:06:19.509511+0000","last_undegraded":"2024-09-21T09:06:19.509511+0000","last_fullsized":"2024-09-21T09:06:19.509511+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.509370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.509370+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.509370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:08.185733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:42.476178+0000","last_change":"2024-09-21T09:07:42.476200+0000","last_active":"2024-09-21T09:07:42.476178+0000","last_peered":"2024-09-21T09:07:42.476178+0000","last_clean":"2024-09-21T09:07:42.476178+0000","last_became_active":"2024-09-21T09:03:08.264778+0000","last_became_peered":"2024-09-21T09:03:08.264778+0000","last_unstale":"2024-09-21T09:07:42.476178+0000","last_undegraded":"2024-09-21T09:07:42.476178+0000","last_fullsized":"2024-09-21T09:07:42.476178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:42.476079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:42.476079+0000","last_clean_scrub_stamp":"2024-09-21T09:07:42.476079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:01:14.660319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:56.215434+0000","last_change":"2024-09-21T09:06:56.215434+0000","last_active":"2024-09-21T09:06:56.215434+0000","last_peered":"2024-09-21T09:06:56.215434+0000","last_clean":"2024-09-21T09:06:56.215434+0000","last_became_active":"2024-09-21T09:03:00.218259+0000","last_became_peered":"2024-09-21T09:03:00.218259+0000","last_unstale":"2024-09-21T09:06:56.215434+0000","last_undegraded":"2024-09-21T09:06:56.215434+0000","last_fullsized":"2024-09-21T09:06:56.215434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:56.215261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:56.215261+0000","last_clean_scrub_stamp":"2024-09-21T09:06:56.215261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:28.904607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:07.468919+0000","last_change":"2024-09-21T09:07:07.468919+0000","last_active":"2024-09-21T09:07:07.468919+0000","last_peered":"2024-09-21T09:07:07.468919+0000","last_clean":"2024-09-21T09:07:07.468919+0000","last_became_active":"2024-09-21T09:02:58.207533+0000","last_became_peered":"2024-09-21T09:02:58.207533+0000","last_unstale":"2024-09-21T09:07:07.468919+0000","last_undegraded":"2024-09-21T09:07:07.468919+0000","last_fullsized":"2024-09-21T09:07:07.468919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:07.468744+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:07.468744+0000","last_clean_scrub_stamp":"2024-09-21T09:07:07.468744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:52.083674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.403985+0000","last_change":"2024-09-21T09:06:22.403985+0000","last_active":"2024-09-21T09:06:22.403985+0000","last_peered":"2024-09-21T09:06:22.403985+0000","last_clean":"2024-09-21T09:06:22.403985+0000","last_became_active":"2024-09-21T09:03:02.219509+0000","last_became_peered":"2024-09-21T09:03:02.219509+0000","last_unstale":"2024-09-21T09:06:22.403985+0000","last_undegraded":"2024-09-21T09:06:22.403985+0000","last_fullsized":"2024-09-21T09:06:22.403985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:22.403839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:22.403839+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.403839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:58.125850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'37","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.809828+0000","last_change":"2024-09-21T09:06:27.809828+0000","last_active":"2024-09-21T09:06:27.809828+0000","last_peered":"2024-09-21T09:06:27.809828+0000","last_clean":"2024-09-21T09:06:27.809828+0000","last_became_active":"2024-09-21T09:03:04.233913+0000","last_became_peered":"2024-09-21T09:03:04.233913+0000","last_unstale":"2024-09-21T09:06:27.809828+0000","last_undegraded":"2024-09-21T09:06:27.809828+0000","last_fullsized":"2024-09-21T09:06:27.809828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-21T09:06:27.809708+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-21T09:06:27.809708+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.809708+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:02.044625+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:23.801364+0000","last_change":"2024-09-21T09:06:23.801364+0000","last_active":"2024-09-21T09:06:23.801364+0000","last_peered":"2024-09-21T09:06:23.801364+0000","last_clean":"2024-09-21T09:06:23.801364+0000","last_became_active":"2024-09-21T09:03:06.240791+0000","last_became_peered":"2024-09-21T09:03:06.240791+0000","last_unstale":"2024-09-21T09:06:23.801364+0000","last_undegraded":"2024-09-21T09:06:23.801364+0000","last_fullsized":"2024-09-21T09:06:23.801364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:23.801250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:23.801250+0000","last_clean_scrub_stamp":"2024-09-21T09:06:23.801250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:35.380708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:02.199604+0000","last_change":"2024-09-21T09:07:02.199604+0000","last_active":"2024-09-21T09:07:02.199604+0000","last_peered":"2024-09-21T09:07:02.199604+0000","last_clean":"2024-09-21T09:07:02.199604+0000","last_became_active":"2024-09-21T09:03:00.216319+0000","last_became_peered":"2024-09-21T09:03:00.216319+0000","last_unstale":"2024-09-21T09:07:02.199604+0000","last_undegraded":"2024-09-21T09:07:02.199604+0000","last_fullsized":"2024-09-21T09:07:02.199604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:07:02.199485+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:07:02.199485+0000","last_clean_scrub_stamp":"2024-09-21T09:07:02.199485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:23.809002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:20.392110+0000","last_change":"2024-09-21T09:07:20.392110+0000","last_active":"2024-09-21T09:07:20.392110+0000","last_peered":"2024-09-21T09:07:20.392110+0000","last_clean":"2024-09-21T09:07:20.392110+0000","last_became_active":"2024-09-21T09:02:58.214494+0000","last_became_peered":"2024-09-21T09:02:58.214494+0000","last_unstale":"2024-09-21T09:07:20.392110+0000","last_undegraded":"2024-09-21T09:07:20.392110+0000","last_fullsized":"2024-09-21T09:07:20.392110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:20.391988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:20.391988+0000","last_clean_scrub_stamp":"2024-09-21T09:07:20.391988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:23.708224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"31'5","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.825386+0000","last_change":"2024-09-21T09:06:34.825386+0000","last_active":"2024-09-21T09:06:34.825386+0000","last_peered":"2024-09-21T09:06:34.825386+0000","last_clean":"2024-09-21T09:06:34.825386+0000","last_became_active":"2024-09-21T09:03:02.221586+0000","last_became_peered":"2024-09-21T09:03:02.221586+0000","last_unstale":"2024-09-21T09:06:34.825386+0000","last_undegraded":"2024-09-21T09:06:34.825386+0000","last_fullsized":"2024-09-21T09:06:34.825386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-21T09:06:34.825259+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-21T09:06:34.825259+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.825259+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:27.576289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'64","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:27.682081+0000","last_change":"2024-09-21T09:06:27.682121+0000","last_active":"2024-09-21T09:06:27.682081+0000","last_peered":"2024-09-21T09:06:27.682081+0000","last_clean":"2024-09-21T09:06:27.682081+0000","last_became_active":"2024-09-21T09:03:04.233734+0000","last_became_peered":"2024-09-21T09:03:04.233734+0000","last_unstale":"2024-09-21T09:06:27.682081+0000","last_undegraded":"2024-09-21T09:06:27.682081+0000","last_fullsized":"2024-09-21T09:06:27.682081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'64","last_scrub_stamp":"2024-09-21T09:06:27.681989+0000","last_deep_scrub":"31'64","last_deep_scrub_stamp":"2024-09-21T09:06:27.681989+0000","last_clean_scrub_stamp":"2024-09-21T09:06:27.681989+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:55.221898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:22.819887+0000","last_change":"2024-09-21T09:06:22.819910+0000","last_active":"2024-09-21T09:06:22.819887+0000","last_peered":"2024-09-21T09:06:22.819887+0000","last_clean":"2024-09-21T09:06:22.819887+0000","last_became_active":"2024-09-21T09:03:06.240975+0000","last_became_peered":"2024-09-21T09:03:06.240975+0000","last_unstale":"2024-09-21T09:06:22.819887+0000","last_undegraded":"2024-09-21T09:06:22.819887+0000","last_fullsized":"2024-09-21T09:06:22.819887+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:22.819794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:22.819794+0000","last_clean_scrub_stamp":"2024-09-21T09:06:22.819794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:09.790058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'18","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:17.175397+0000","last_change":"2024-09-21T09:07:17.175397+0000","last_active":"2024-09-21T09:07:17.175397+0000","last_peered":"2024-09-21T09:07:17.175397+0000","last_clean":"2024-09-21T09:07:17.175397+0000","last_became_active":"2024-09-21T09:03:08.253904+0000","last_became_peered":"2024-09-21T09:03:08.253904+0000","last_unstale":"2024-09-21T09:07:17.175397+0000","last_undegraded":"2024-09-21T09:07:17.175397+0000","last_fullsized":"2024-09-21T09:07:17.175397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-21T09:07:17.175215+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-21T09:07:17.175215+0000","last_clean_scrub_stamp":"2024-09-21T09:07:17.175215+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:14.991180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:56.086932+0000","last_change":"2024-09-21T09:06:56.086932+0000","last_active":"2024-09-21T09:06:56.086932+0000","last_peered":"2024-09-21T09:06:56.086932+0000","last_clean":"2024-09-21T09:06:56.086932+0000","last_became_active":"2024-09-21T09:03:00.216238+0000","last_became_peered":"2024-09-21T09:03:00.216238+0000","last_unstale":"2024-09-21T09:06:56.086932+0000","last_undegraded":"2024-09-21T09:06:56.086932+0000","last_fullsized":"2024-09-21T09:06:56.086932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:56.086803+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:56.086803+0000","last_clean_scrub_stamp":"2024-09-21T09:06:56.086803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:47.639139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:05.472493+0000","last_change":"2024-09-21T09:07:05.472493+0000","last_active":"2024-09-21T09:07:05.472493+0000","last_peered":"2024-09-21T09:07:05.472493+0000","last_clean":"2024-09-21T09:07:05.472493+0000","last_became_active":"2024-09-21T09:02:58.206879+0000","last_became_peered":"2024-09-21T09:02:58.206879+0000","last_unstale":"2024-09-21T09:07:05.472493+0000","last_undegraded":"2024-09-21T09:07:05.472493+0000","last_fullsized":"2024-09-21T09:07:05.472493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:05.472355+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:05.472355+0000","last_clean_scrub_stamp":"2024-09-21T09:07:05.472355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:07.300100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:53.844325+0000","last_change":"2024-09-21T09:06:53.844325+0000","last_active":"2024-09-21T09:06:53.844325+0000","last_peered":"2024-09-21T09:06:53.844325+0000","last_clean":"2024-09-21T09:06:53.844325+0000","last_became_active":"2024-09-21T09:03:02.218381+0000","last_became_peered":"2024-09-21T09:03:02.218381+0000","last_unstale":"2024-09-21T09:06:53.844325+0000","last_undegraded":"2024-09-21T09:06:53.844325+0000","last_fullsized":"2024-09-21T09:06:53.844325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:53.844124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:53.844124+0000","last_clean_scrub_stamp":"2024-09-21T09:06:53.844124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:16.853541+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.290474+0000","last_change":"2024-09-21T09:06:29.290517+0000","last_active":"2024-09-21T09:06:29.290474+0000","last_peered":"2024-09-21T09:06:29.290474+0000","last_clean":"2024-09-21T09:06:29.290474+0000","last_became_active":"2024-09-21T09:03:04.240933+0000","last_became_peered":"2024-09-21T09:03:04.240933+0000","last_unstale":"2024-09-21T09:06:29.290474+0000","last_undegraded":"2024-09-21T09:06:29.290474+0000","last_fullsized":"2024-09-21T09:06:29.290474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-21T09:06:29.290368+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-21T09:06:29.290368+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.290368+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:29.068806+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.475284+0000","last_change":"2024-09-21T09:06:17.475308+0000","last_active":"2024-09-21T09:06:17.475284+0000","last_peered":"2024-09-21T09:06:17.475284+0000","last_clean":"2024-09-21T09:06:17.475284+0000","last_became_active":"2024-09-21T09:03:06.247153+0000","last_became_peered":"2024-09-21T09:03:06.247153+0000","last_unstale":"2024-09-21T09:06:17.475284+0000","last_undegraded":"2024-09-21T09:06:17.475284+0000","last_fullsized":"2024-09-21T09:06:17.475284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.475178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.475178+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.475178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:28.701561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:37.397227+0000","last_change":"2024-09-21T09:07:37.397227+0000","last_active":"2024-09-21T09:07:37.397227+0000","last_peered":"2024-09-21T09:07:37.397227+0000","last_clean":"2024-09-21T09:07:37.397227+0000","last_became_active":"2024-09-21T09:03:08.262680+0000","last_became_peered":"2024-09-21T09:03:08.262680+0000","last_unstale":"2024-09-21T09:07:37.397227+0000","last_undegraded":"2024-09-21T09:07:37.397227+0000","last_fullsized":"2024-09-21T09:07:37.397227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:37.397058+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:37.397058+0000","last_clean_scrub_stamp":"2024-09-21T09:07:37.397058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:05.089419+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.325607+0000","last_change":"2024-09-21T09:06:28.325656+0000","last_active":"2024-09-21T09:06:28.325607+0000","last_peered":"2024-09-21T09:06:28.325607+0000","last_clean":"2024-09-21T09:06:28.325607+0000","last_became_active":"2024-09-21T09:03:00.219653+0000","last_became_peered":"2024-09-21T09:03:00.219653+0000","last_unstale":"2024-09-21T09:06:28.325607+0000","last_undegraded":"2024-09-21T09:06:28.325607+0000","last_fullsized":"2024-09-21T09:06:28.325607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:28.325504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:28.325504+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.325504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:07.739919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'3","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:02.576326+0000","last_change":"2024-09-21T09:07:02.576326+0000","last_active":"2024-09-21T09:07:02.576326+0000","last_peered":"2024-09-21T09:07:02.576326+0000","last_clean":"2024-09-21T09:07:02.576326+0000","last_became_active":"2024-09-21T09:02:58.202431+0000","last_became_peered":"2024-09-21T09:02:58.202431+0000","last_unstale":"2024-09-21T09:07:02.576326+0000","last_undegraded":"2024-09-21T09:07:02.576326+0000","last_fullsized":"2024-09-21T09:07:02.576326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:07:02.576143+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:07:02.576143+0000","last_clean_scrub_stamp":"2024-09-21T09:07:02.576143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:40.207102+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:36.809305+0000","last_change":"2024-09-21T09:06:36.809338+0000","last_active":"2024-09-21T09:06:36.809305+0000","last_peered":"2024-09-21T09:06:36.809305+0000","last_clean":"2024-09-21T09:06:36.809305+0000","last_became_active":"2024-09-21T09:03:02.220940+0000","last_became_peered":"2024-09-21T09:03:02.220940+0000","last_unstale":"2024-09-21T09:06:36.809305+0000","last_undegraded":"2024-09-21T09:06:36.809305+0000","last_fullsized":"2024-09-21T09:06:36.809305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:36.809163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:36.809163+0000","last_clean_scrub_stamp":"2024-09-21T09:06:36.809163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:23.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'40","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.706558+0000","last_change":"2024-09-21T09:06:26.706558+0000","last_active":"2024-09-21T09:06:26.706558+0000","last_peered":"2024-09-21T09:06:26.706558+0000","last_clean":"2024-09-21T09:06:26.706558+0000","last_became_active":"2024-09-21T09:03:04.239023+0000","last_became_peered":"2024-09-21T09:03:04.239023+0000","last_unstale":"2024-09-21T09:06:26.706558+0000","last_undegraded":"2024-09-21T09:06:26.706558+0000","last_fullsized":"2024-09-21T09:06:26.706558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-09-21T09:06:26.706429+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-09-21T09:06:26.706429+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.706429+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:10.421856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:19.647012+0000","last_change":"2024-09-21T09:06:19.647012+0000","last_active":"2024-09-21T09:06:19.647012+0000","last_peered":"2024-09-21T09:06:19.647012+0000","last_clean":"2024-09-21T09:06:19.647012+0000","last_became_active":"2024-09-21T09:03:06.243451+0000","last_became_peered":"2024-09-21T09:03:06.243451+0000","last_unstale":"2024-09-21T09:06:19.647012+0000","last_undegraded":"2024-09-21T09:06:19.647012+0000","last_fullsized":"2024-09-21T09:06:19.647012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:19.646893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:19.646893+0000","last_clean_scrub_stamp":"2024-09-21T09:06:19.646893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:53.881810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:09.304628+0000","last_change":"2024-09-21T09:07:09.304628+0000","last_active":"2024-09-21T09:07:09.304628+0000","last_peered":"2024-09-21T09:07:09.304628+0000","last_clean":"2024-09-21T09:07:09.304628+0000","last_became_active":"2024-09-21T09:03:08.260047+0000","last_became_peered":"2024-09-21T09:03:08.260047+0000","last_unstale":"2024-09-21T09:07:09.304628+0000","last_undegraded":"2024-09-21T09:07:09.304628+0000","last_fullsized":"2024-09-21T09:07:09.304628+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:07:09.304481+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:07:09.304481+0000","last_clean_scrub_stamp":"2024-09-21T09:07:09.304481+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:04.837478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.961215+0000","last_change":"2024-09-21T09:06:44.961247+0000","last_active":"2024-09-21T09:06:44.961215+0000","last_peered":"2024-09-21T09:06:44.961215+0000","last_clean":"2024-09-21T09:06:44.961215+0000","last_became_active":"2024-09-21T09:03:00.221332+0000","last_became_peered":"2024-09-21T09:03:00.221332+0000","last_unstale":"2024-09-21T09:06:44.961215+0000","last_undegraded":"2024-09-21T09:06:44.961215+0000","last_fullsized":"2024-09-21T09:06:44.961215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-21T09:06:44.961118+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-21T09:06:44.961118+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.961118+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:44.503583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:32.512379+0000","last_change":"2024-09-21T09:07:32.512379+0000","last_active":"2024-09-21T09:07:32.512379+0000","last_peered":"2024-09-21T09:07:32.512379+0000","last_clean":"2024-09-21T09:07:32.512379+0000","last_became_active":"2024-09-21T09:02:58.210511+0000","last_became_peered":"2024-09-21T09:02:58.210511+0000","last_unstale":"2024-09-21T09:07:32.512379+0000","last_undegraded":"2024-09-21T09:07:32.512379+0000","last_fullsized":"2024-09-21T09:07:32.512379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:32.512238+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:32.512238+0000","last_clean_scrub_stamp":"2024-09-21T09:07:32.512238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:51.713933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.326237+0000","last_change":"2024-09-21T09:06:34.326260+0000","last_active":"2024-09-21T09:06:34.326237+0000","last_peered":"2024-09-21T09:06:34.326237+0000","last_clean":"2024-09-21T09:06:34.326237+0000","last_became_active":"2024-09-21T09:03:02.218979+0000","last_became_peered":"2024-09-21T09:03:02.218979+0000","last_unstale":"2024-09-21T09:06:34.326237+0000","last_undegraded":"2024-09-21T09:06:34.326237+0000","last_fullsized":"2024-09-21T09:06:34.326237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:34.326149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:34.326149+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.326149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:08.189282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:48.300849+0000","last_change":"2024-09-21T09:06:48.300849+0000","last_active":"2024-09-21T09:06:48.300849+0000","last_peered":"2024-09-21T09:06:48.300849+0000","last_clean":"2024-09-21T09:06:48.300849+0000","last_became_active":"2024-09-21T09:03:04.241974+0000","last_became_peered":"2024-09-21T09:03:04.241974+0000","last_unstale":"2024-09-21T09:06:48.300849+0000","last_undegraded":"2024-09-21T09:06:48.300849+0000","last_fullsized":"2024-09-21T09:06:48.300849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-21T09:06:48.300709+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-21T09:06:48.300709+0000","last_clean_scrub_stamp":"2024-09-21T09:06:48.300709+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:28.450871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'285","reported_seq":429,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:20.869907+0000","last_change":"2024-09-21T09:06:20.869907+0000","last_active":"2024-09-21T09:06:20.869907+0000","last_peered":"2024-09-21T09:06:20.869907+0000","last_clean":"2024-09-21T09:06:20.869907+0000","last_became_active":"2024-09-21T09:03:06.244103+0000","last_became_peered":"2024-09-21T09:03:06.244103+0000","last_unstale":"2024-09-21T09:06:20.869907+0000","last_undegraded":"2024-09-21T09:06:20.869907+0000","last_fullsized":"2024-09-21T09:06:20.869907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-09-21T09:06:20.869741+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-09-21T09:06:20.869741+0000","last_clean_scrub_stamp":"2024-09-21T09:06:20.869741+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:41.358529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"31'6","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:05.204223+0000","last_change":"2024-09-21T09:07:05.204223+0000","last_active":"2024-09-21T09:07:05.204223+0000","last_peered":"2024-09-21T09:07:05.204223+0000","last_clean":"2024-09-21T09:07:05.204223+0000","last_became_active":"2024-09-21T09:03:08.259638+0000","last_became_peered":"2024-09-21T09:03:08.259638+0000","last_unstale":"2024-09-21T09:07:05.204223+0000","last_undegraded":"2024-09-21T09:07:05.204223+0000","last_fullsized":"2024-09-21T09:07:05.204223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:05.204085+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:05.204085+0000","last_clean_scrub_stamp":"2024-09-21T09:07:05.204085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:46.034899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:41.840388+0000","last_change":"2024-09-21T09:06:41.840414+0000","last_active":"2024-09-21T09:06:41.840388+0000","last_peered":"2024-09-21T09:06:41.840388+0000","last_clean":"2024-09-21T09:06:41.840388+0000","last_became_active":"2024-09-21T09:03:00.220426+0000","last_became_peered":"2024-09-21T09:03:00.220426+0000","last_unstale":"2024-09-21T09:06:41.840388+0000","last_undegraded":"2024-09-21T09:06:41.840388+0000","last_fullsized":"2024-09-21T09:06:41.840388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:41.840277+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:41.840277+0000","last_clean_scrub_stamp":"2024-09-21T09:06:41.840277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:15.703410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:06.486842+0000","last_change":"2024-09-21T09:07:06.486842+0000","last_active":"2024-09-21T09:07:06.486842+0000","last_peered":"2024-09-21T09:07:06.486842+0000","last_clean":"2024-09-21T09:07:06.486842+0000","last_became_active":"2024-09-21T09:02:58.207424+0000","last_became_peered":"2024-09-21T09:02:58.207424+0000","last_unstale":"2024-09-21T09:07:06.486842+0000","last_undegraded":"2024-09-21T09:07:06.486842+0000","last_fullsized":"2024-09-21T09:07:06.486842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:06.486677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:06.486677+0000","last_clean_scrub_stamp":"2024-09-21T09:07:06.486677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:09.583407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:15.483743+0000","last_change":"2024-09-21T09:07:15.483766+0000","last_active":"2024-09-21T09:07:15.483743+0000","last_peered":"2024-09-21T09:07:15.483743+0000","last_clean":"2024-09-21T09:07:15.483743+0000","last_became_active":"2024-09-21T09:03:38.280616+0000","last_became_peered":"2024-09-21T09:03:38.280616+0000","last_unstale":"2024-09-21T09:07:15.483743+0000","last_undegraded":"2024-09-21T09:07:15.483743+0000","last_fullsized":"2024-09-21T09:07:15.483743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:15.483655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:15.483655+0000","last_clean_scrub_stamp":"2024-09-21T09:07:15.483655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:29.737059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'47","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:26.397832+0000","last_change":"2024-09-21T09:06:26.397832+0000","last_active":"2024-09-21T09:06:26.397832+0000","last_peered":"2024-09-21T09:06:26.397832+0000","last_clean":"2024-09-21T09:06:26.397832+0000","last_became_active":"2024-09-21T09:03:04.233878+0000","last_became_peered":"2024-09-21T09:03:04.233878+0000","last_unstale":"2024-09-21T09:06:26.397832+0000","last_undegraded":"2024-09-21T09:06:26.397832+0000","last_fullsized":"2024-09-21T09:06:26.397832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-09-21T09:06:26.397701+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-09-21T09:06:26.397701+0000","last_clean_scrub_stamp":"2024-09-21T09:06:26.397701+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:42.069141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:17.708341+0000","last_change":"2024-09-21T09:06:17.708341+0000","last_active":"2024-09-21T09:06:17.708341+0000","last_peered":"2024-09-21T09:06:17.708341+0000","last_clean":"2024-09-21T09:06:17.708341+0000","last_became_active":"2024-09-21T09:03:06.247609+0000","last_became_peered":"2024-09-21T09:03:06.247609+0000","last_unstale":"2024-09-21T09:06:17.708341+0000","last_undegraded":"2024-09-21T09:06:17.708341+0000","last_fullsized":"2024-09-21T09:06:17.708341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:17.708240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:17.708240+0000","last_clean_scrub_stamp":"2024-09-21T09:06:17.708240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:29.114535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:35.282851+0000","last_change":"2024-09-21T09:06:35.282851+0000","last_active":"2024-09-21T09:06:35.282851+0000","last_peered":"2024-09-21T09:06:35.282851+0000","last_clean":"2024-09-21T09:06:35.282851+0000","last_became_active":"2024-09-21T09:03:08.255717+0000","last_became_peered":"2024-09-21T09:03:08.255717+0000","last_unstale":"2024-09-21T09:06:35.282851+0000","last_undegraded":"2024-09-21T09:06:35.282851+0000","last_fullsized":"2024-09-21T09:06:35.282851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:35.282702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:35.282702+0000","last_clean_scrub_stamp":"2024-09-21T09:06:35.282702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:28.033731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.817710+0000","last_change":"2024-09-21T09:06:44.817735+0000","last_active":"2024-09-21T09:06:44.817710+0000","last_peered":"2024-09-21T09:06:44.817710+0000","last_clean":"2024-09-21T09:06:44.817710+0000","last_became_active":"2024-09-21T09:03:00.215804+0000","last_became_peered":"2024-09-21T09:03:00.215804+0000","last_unstale":"2024-09-21T09:06:44.817710+0000","last_undegraded":"2024-09-21T09:06:44.817710+0000","last_fullsized":"2024-09-21T09:06:44.817710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-21T09:06:44.817622+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-21T09:06:44.817622+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.817622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:06.066605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:17.356658+0000","last_change":"2024-09-21T09:07:17.356658+0000","last_active":"2024-09-21T09:07:17.356658+0000","last_peered":"2024-09-21T09:07:17.356658+0000","last_clean":"2024-09-21T09:07:17.356658+0000","last_became_active":"2024-09-21T09:02:58.221286+0000","last_became_peered":"2024-09-21T09:02:58.221286+0000","last_unstale":"2024-09-21T09:07:17.356658+0000","last_undegraded":"2024-09-21T09:07:17.356658+0000","last_fullsized":"2024-09-21T09:07:17.356658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:17.356550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:17.356550+0000","last_clean_scrub_stamp":"2024-09-21T09:07:17.356550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:37.837673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:34.811610+0000","last_change":"2024-09-21T09:06:34.811636+0000","last_active":"2024-09-21T09:06:34.811610+0000","last_peered":"2024-09-21T09:06:34.811610+0000","last_clean":"2024-09-21T09:06:34.811610+0000","last_became_active":"2024-09-21T09:03:02.224879+0000","last_became_peered":"2024-09-21T09:03:02.224879+0000","last_unstale":"2024-09-21T09:06:34.811610+0000","last_undegraded":"2024-09-21T09:06:34.811610+0000","last_fullsized":"2024-09-21T09:06:34.811610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:34.811505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:34.811505+0000","last_clean_scrub_stamp":"2024-09-21T09:06:34.811505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:18.526932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'36","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:24.736614+0000","last_change":"2024-09-21T09:06:24.736614+0000","last_active":"2024-09-21T09:06:24.736614+0000","last_peered":"2024-09-21T09:06:24.736614+0000","last_clean":"2024-09-21T09:06:24.736614+0000","last_became_active":"2024-09-21T09:03:04.239112+0000","last_became_peered":"2024-09-21T09:03:04.239112+0000","last_unstale":"2024-09-21T09:06:24.736614+0000","last_undegraded":"2024-09-21T09:06:24.736614+0000","last_fullsized":"2024-09-21T09:06:24.736614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-09-21T09:06:24.736479+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-09-21T09:06:24.736479+0000","last_clean_scrub_stamp":"2024-09-21T09:06:24.736479+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:34.646980+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:53.276683+0000","last_change":"2024-09-21T09:06:53.276683+0000","last_active":"2024-09-21T09:06:53.276683+0000","last_peered":"2024-09-21T09:06:53.276683+0000","last_clean":"2024-09-21T09:06:53.276683+0000","last_became_active":"2024-09-21T09:03:06.250729+0000","last_became_peered":"2024-09-21T09:03:06.250729+0000","last_unstale":"2024-09-21T09:06:53.276683+0000","last_undegraded":"2024-09-21T09:06:53.276683+0000","last_fullsized":"2024-09-21T09:06:53.276683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:53.276571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:53.276571+0000","last_clean_scrub_stamp":"2024-09-21T09:06:53.276571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:56.962969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:39.437605+0000","last_change":"2024-09-21T09:07:39.437605+0000","last_active":"2024-09-21T09:07:39.437605+0000","last_peered":"2024-09-21T09:07:39.437605+0000","last_clean":"2024-09-21T09:07:39.437605+0000","last_became_active":"2024-09-21T09:03:08.264160+0000","last_became_peered":"2024-09-21T09:03:08.264160+0000","last_unstale":"2024-09-21T09:07:39.437605+0000","last_undegraded":"2024-09-21T09:07:39.437605+0000","last_fullsized":"2024-09-21T09:07:39.437605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:07:39.437419+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:07:39.437419+0000","last_clean_scrub_stamp":"2024-09-21T09:07:39.437419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:11:43.055735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:06.208522+0000","last_change":"2024-09-21T09:07:06.208522+0000","last_active":"2024-09-21T09:07:06.208522+0000","last_peered":"2024-09-21T09:07:06.208522+0000","last_clean":"2024-09-21T09:07:06.208522+0000","last_became_active":"2024-09-21T09:03:00.208673+0000","last_became_peered":"2024-09-21T09:03:00.208673+0000","last_unstale":"2024-09-21T09:07:06.208522+0000","last_undegraded":"2024-09-21T09:07:06.208522+0000","last_fullsized":"2024-09-21T09:07:06.208522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:07:06.208403+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:07:06.208403+0000","last_clean_scrub_stamp":"2024-09-21T09:07:06.208403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:01.240992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:55.037211+0000","last_change":"2024-09-21T09:06:55.037211+0000","last_active":"2024-09-21T09:06:55.037211+0000","last_peered":"2024-09-21T09:06:55.037211+0000","last_clean":"2024-09-21T09:06:55.037211+0000","last_became_active":"2024-09-21T09:02:58.212751+0000","last_became_peered":"2024-09-21T09:02:58.212751+0000","last_unstale":"2024-09-21T09:06:55.037211+0000","last_undegraded":"2024-09-21T09:06:55.037211+0000","last_fullsized":"2024-09-21T09:06:55.037211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:55.037086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:55.037086+0000","last_clean_scrub_stamp":"2024-09-21T09:06:55.037086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:55.221730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:28.339342+0000","last_change":"2024-09-21T09:06:28.339342+0000","last_active":"2024-09-21T09:06:28.339342+0000","last_peered":"2024-09-21T09:06:28.339342+0000","last_clean":"2024-09-21T09:06:28.339342+0000","last_became_active":"2024-09-21T09:03:02.222965+0000","last_became_peered":"2024-09-21T09:03:02.222965+0000","last_unstale":"2024-09-21T09:06:28.339342+0000","last_undegraded":"2024-09-21T09:06:28.339342+0000","last_fullsized":"2024-09-21T09:06:28.339342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:28.339237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:28.339237+0000","last_clean_scrub_stamp":"2024-09-21T09:06:28.339237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:34.803750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'30","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.308727+0000","last_change":"2024-09-21T09:06:42.308759+0000","last_active":"2024-09-21T09:06:42.308727+0000","last_peered":"2024-09-21T09:06:42.308727+0000","last_clean":"2024-09-21T09:06:42.308727+0000","last_became_active":"2024-09-21T09:03:04.243686+0000","last_became_peered":"2024-09-21T09:03:04.243686+0000","last_unstale":"2024-09-21T09:06:42.308727+0000","last_undegraded":"2024-09-21T09:06:42.308727+0000","last_fullsized":"2024-09-21T09:06:42.308727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2024-09-21T09:06:42.308640+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2024-09-21T09:06:42.308640+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.308640+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:02:38.998283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.330394+0000","last_change":"2024-09-21T09:06:45.330435+0000","last_active":"2024-09-21T09:06:45.330394+0000","last_peered":"2024-09-21T09:06:45.330394+0000","last_clean":"2024-09-21T09:06:45.330394+0000","last_became_active":"2024-09-21T09:03:06.249959+0000","last_became_peered":"2024-09-21T09:03:06.249959+0000","last_unstale":"2024-09-21T09:06:45.330394+0000","last_undegraded":"2024-09-21T09:06:45.330394+0000","last_fullsized":"2024-09-21T09:06:45.330394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:45.330289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:45.330289+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.330289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:06.828858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'6","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:38.404875+0000","last_change":"2024-09-21T09:07:38.404875+0000","last_active":"2024-09-21T09:07:38.404875+0000","last_peered":"2024-09-21T09:07:38.404875+0000","last_clean":"2024-09-21T09:07:38.404875+0000","last_became_active":"2024-09-21T09:03:08.264395+0000","last_became_peered":"2024-09-21T09:03:08.264395+0000","last_unstale":"2024-09-21T09:07:38.404875+0000","last_undegraded":"2024-09-21T09:07:38.404875+0000","last_fullsized":"2024-09-21T09:07:38.404875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:38.404739+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:38.404739+0000","last_clean_scrub_stamp":"2024-09-21T09:07:38.404739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:49.476870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'14","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.866158+0000","last_change":"2024-09-21T09:06:42.866158+0000","last_active":"2024-09-21T09:06:42.866158+0000","last_peered":"2024-09-21T09:06:42.866158+0000","last_clean":"2024-09-21T09:06:42.866158+0000","last_became_active":"2024-09-21T09:03:00.215748+0000","last_became_peered":"2024-09-21T09:03:00.215748+0000","last_unstale":"2024-09-21T09:06:42.866158+0000","last_undegraded":"2024-09-21T09:06:42.866158+0000","last_fullsized":"2024-09-21T09:06:42.866158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:42.866045+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:42.866045+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.866045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:35.617075+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:03.532942+0000","last_change":"2024-09-21T09:07:03.532942+0000","last_active":"2024-09-21T09:07:03.532942+0000","last_peered":"2024-09-21T09:07:03.532942+0000","last_clean":"2024-09-21T09:07:03.532942+0000","last_became_active":"2024-09-21T09:02:58.203973+0000","last_became_peered":"2024-09-21T09:02:58.203973+0000","last_unstale":"2024-09-21T09:07:03.532942+0000","last_undegraded":"2024-09-21T09:07:03.532942+0000","last_fullsized":"2024-09-21T09:07:03.532942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:03.532761+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:03.532761+0000","last_clean_scrub_stamp":"2024-09-21T09:07:03.532761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:11:46.116897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:30.378485+0000","last_change":"2024-09-21T09:06:30.378485+0000","last_active":"2024-09-21T09:06:30.378485+0000","last_peered":"2024-09-21T09:06:30.378485+0000","last_clean":"2024-09-21T09:06:30.378485+0000","last_became_active":"2024-09-21T09:03:02.220801+0000","last_became_peered":"2024-09-21T09:03:02.220801+0000","last_unstale":"2024-09-21T09:06:30.378485+0000","last_undegraded":"2024-09-21T09:06:30.378485+0000","last_fullsized":"2024-09-21T09:06:30.378485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-21T09:06:30.378369+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-21T09:06:30.378369+0000","last_clean_scrub_stamp":"2024-09-21T09:06:30.378369+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:45.332862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'39","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:31.252315+0000","last_change":"2024-09-21T09:06:31.252360+0000","last_active":"2024-09-21T09:06:31.252315+0000","last_peered":"2024-09-21T09:06:31.252315+0000","last_clean":"2024-09-21T09:06:31.252315+0000","last_became_active":"2024-09-21T09:03:04.240857+0000","last_became_peered":"2024-09-21T09:03:04.240857+0000","last_unstale":"2024-09-21T09:06:31.252315+0000","last_undegraded":"2024-09-21T09:06:31.252315+0000","last_fullsized":"2024-09-21T09:06:31.252315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-21T09:06:31.252205+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-21T09:06:31.252205+0000","last_clean_scrub_stamp":"2024-09-21T09:06:31.252205+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.717765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:29.737294+0000","last_change":"2024-09-21T09:06:29.737330+0000","last_active":"2024-09-21T09:06:29.737294+0000","last_peered":"2024-09-21T09:06:29.737294+0000","last_clean":"2024-09-21T09:06:29.737294+0000","last_became_active":"2024-09-21T09:03:06.248030+0000","last_became_peered":"2024-09-21T09:03:06.248030+0000","last_unstale":"2024-09-21T09:06:29.737294+0000","last_undegraded":"2024-09-21T09:06:29.737294+0000","last_fullsized":"2024-09-21T09:06:29.737294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:29.737203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:29.737203+0000","last_clean_scrub_stamp":"2024-09-21T09:06:29.737203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:47.781194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'4","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:41.450213+0000","last_change":"2024-09-21T09:07:41.450213+0000","last_active":"2024-09-21T09:07:41.450213+0000","last_peered":"2024-09-21T09:07:41.450213+0000","last_clean":"2024-09-21T09:07:41.450213+0000","last_became_active":"2024-09-21T09:03:08.264304+0000","last_became_peered":"2024-09-21T09:03:08.264304+0000","last_unstale":"2024-09-21T09:07:41.450213+0000","last_undegraded":"2024-09-21T09:07:41.450213+0000","last_fullsized":"2024-09-21T09:07:41.450213+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:07:41.450058+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:07:41.450058+0000","last_clean_scrub_stamp":"2024-09-21T09:07:41.450058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:29.353511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'22","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:42.309421+0000","last_change":"2024-09-21T09:06:42.309421+0000","last_active":"2024-09-21T09:06:42.309421+0000","last_peered":"2024-09-21T09:06:42.309421+0000","last_clean":"2024-09-21T09:06:42.309421+0000","last_became_active":"2024-09-21T09:03:00.225936+0000","last_became_peered":"2024-09-21T09:03:00.225936+0000","last_unstale":"2024-09-21T09:06:42.309421+0000","last_undegraded":"2024-09-21T09:06:42.309421+0000","last_fullsized":"2024-09-21T09:06:42.309421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-09-21T09:06:42.309272+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-09-21T09:06:42.309272+0000","last_clean_scrub_stamp":"2024-09-21T09:06:42.309272+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:05.305378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:57.825004+0000","last_change":"2024-09-21T09:06:57.825004+0000","last_active":"2024-09-21T09:06:57.825004+0000","last_peered":"2024-09-21T09:06:57.825004+0000","last_clean":"2024-09-21T09:06:57.825004+0000","last_became_active":"2024-09-21T09:02:58.206163+0000","last_became_peered":"2024-09-21T09:02:58.206163+0000","last_unstale":"2024-09-21T09:06:57.825004+0000","last_undegraded":"2024-09-21T09:06:57.825004+0000","last_fullsized":"2024-09-21T09:06:57.825004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:57.824824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:57.824824+0000","last_clean_scrub_stamp":"2024-09-21T09:06:57.824824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:42.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'6","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:01.952440+0000","last_change":"2024-09-21T09:07:01.952440+0000","last_active":"2024-09-21T09:07:01.952440+0000","last_peered":"2024-09-21T09:07:01.952440+0000","last_clean":"2024-09-21T09:07:01.952440+0000","last_became_active":"2024-09-21T09:03:00.220860+0000","last_became_peered":"2024-09-21T09:03:00.220860+0000","last_unstale":"2024-09-21T09:07:01.952440+0000","last_undegraded":"2024-09-21T09:07:01.952440+0000","last_fullsized":"2024-09-21T09:07:01.952440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:01.952257+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:01.952257+0000","last_clean_scrub_stamp":"2024-09-21T09:07:01.952257+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:39.583216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:08.074436+0000","last_change":"2024-09-21T09:07:08.074465+0000","last_active":"2024-09-21T09:07:08.074436+0000","last_peered":"2024-09-21T09:07:08.074436+0000","last_clean":"2024-09-21T09:07:08.074436+0000","last_became_active":"2024-09-21T09:02:58.202579+0000","last_became_peered":"2024-09-21T09:02:58.202579+0000","last_unstale":"2024-09-21T09:07:08.074436+0000","last_undegraded":"2024-09-21T09:07:08.074436+0000","last_fullsized":"2024-09-21T09:07:08.074436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:08.074342+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:08.074342+0000","last_clean_scrub_stamp":"2024-09-21T09:07:08.074342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:25.449462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.266173+0000","last_change":"2024-09-21T09:06:38.266173+0000","last_active":"2024-09-21T09:06:38.266173+0000","last_peered":"2024-09-21T09:06:38.266173+0000","last_clean":"2024-09-21T09:06:38.266173+0000","last_became_active":"2024-09-21T09:03:00.219281+0000","last_became_peered":"2024-09-21T09:03:00.219281+0000","last_unstale":"2024-09-21T09:06:38.266173+0000","last_undegraded":"2024-09-21T09:06:38.266173+0000","last_fullsized":"2024-09-21T09:06:38.266173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:38.266051+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:38.266051+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.266051+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:15.525190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:25.407598+0000","last_change":"2024-09-21T09:07:25.407658+0000","last_active":"2024-09-21T09:07:25.407598+0000","last_peered":"2024-09-21T09:07:25.407598+0000","last_clean":"2024-09-21T09:07:25.407598+0000","last_became_active":"2024-09-21T09:02:58.222856+0000","last_became_peered":"2024-09-21T09:02:58.222856+0000","last_unstale":"2024-09-21T09:07:25.407598+0000","last_undegraded":"2024-09-21T09:07:25.407598+0000","last_fullsized":"2024-09-21T09:07:25.407598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-21T09:07:25.407462+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-21T09:07:25.407462+0000","last_clean_scrub_stamp":"2024-09-21T09:07:25.407462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:35.672567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:12.164838+0000","last_change":"2024-09-21T09:07:12.164838+0000","last_active":"2024-09-21T09:07:12.164838+0000","last_peered":"2024-09-21T09:07:12.164838+0000","last_clean":"2024-09-21T09:07:12.164838+0000","last_became_active":"2024-09-21T09:03:00.220755+0000","last_became_peered":"2024-09-21T09:03:00.220755+0000","last_unstale":"2024-09-21T09:07:12.164838+0000","last_undegraded":"2024-09-21T09:07:12.164838+0000","last_fullsized":"2024-09-21T09:07:12.164838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:12.164709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:12.164709+0000","last_clean_scrub_stamp":"2024-09-21T09:07:12.164709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:50.036239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:09.116339+0000","last_change":"2024-09-21T09:07:09.116361+0000","last_active":"2024-09-21T09:07:09.116339+0000","last_peered":"2024-09-21T09:07:09.116339+0000","last_clean":"2024-09-21T09:07:09.116339+0000","last_became_active":"2024-09-21T09:02:58.208329+0000","last_became_peered":"2024-09-21T09:02:58.208329+0000","last_unstale":"2024-09-21T09:07:09.116339+0000","last_undegraded":"2024-09-21T09:07:09.116339+0000","last_fullsized":"2024-09-21T09:07:09.116339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:09.116244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:09.116244+0000","last_clean_scrub_stamp":"2024-09-21T09:07:09.116244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:52.166977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'16","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:52.034234+0000","last_change":"2024-09-21T09:06:52.034234+0000","last_active":"2024-09-21T09:06:52.034234+0000","last_peered":"2024-09-21T09:06:52.034234+0000","last_clean":"2024-09-21T09:06:52.034234+0000","last_became_active":"2024-09-21T09:03:00.215554+0000","last_became_peered":"2024-09-21T09:03:00.215554+0000","last_unstale":"2024-09-21T09:06:52.034234+0000","last_undegraded":"2024-09-21T09:06:52.034234+0000","last_fullsized":"2024-09-21T09:06:52.034234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-21T09:06:52.034066+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-21T09:06:52.034066+0000","last_clean_scrub_stamp":"2024-09-21T09:06:52.034066+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:54.024587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:06.021784+0000","last_change":"2024-09-21T09:07:06.021784+0000","last_active":"2024-09-21T09:07:06.021784+0000","last_peered":"2024-09-21T09:07:06.021784+0000","last_clean":"2024-09-21T09:07:06.021784+0000","last_became_active":"2024-09-21T09:02:58.201482+0000","last_became_peered":"2024-09-21T09:02:58.201482+0000","last_unstale":"2024-09-21T09:07:06.021784+0000","last_undegraded":"2024-09-21T09:07:06.021784+0000","last_fullsized":"2024-09-21T09:07:06.021784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:06.021641+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:06.021641+0000","last_clean_scrub_stamp":"2024-09-21T09:07:06.021641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:09.118371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'12","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:59.559444+0000","last_change":"2024-09-21T09:06:59.559444+0000","last_active":"2024-09-21T09:06:59.559444+0000","last_peered":"2024-09-21T09:06:59.559444+0000","last_clean":"2024-09-21T09:06:59.559444+0000","last_became_active":"2024-09-21T09:03:00.223740+0000","last_became_peered":"2024-09-21T09:03:00.223740+0000","last_unstale":"2024-09-21T09:06:59.559444+0000","last_undegraded":"2024-09-21T09:06:59.559444+0000","last_fullsized":"2024-09-21T09:06:59.559444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:06:59.559326+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:06:59.559326+0000","last_clean_scrub_stamp":"2024-09-21T09:06:59.559326+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:54.979937+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:56.502385+0000","last_change":"2024-09-21T09:06:56.502385+0000","last_active":"2024-09-21T09:06:56.502385+0000","last_peered":"2024-09-21T09:06:56.502385+0000","last_clean":"2024-09-21T09:06:56.502385+0000","last_became_active":"2024-09-21T09:02:58.210442+0000","last_became_peered":"2024-09-21T09:02:58.210442+0000","last_unstale":"2024-09-21T09:06:56.502385+0000","last_undegraded":"2024-09-21T09:06:56.502385+0000","last_fullsized":"2024-09-21T09:06:56.502385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:56.502267+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:56.502267+0000","last_clean_scrub_stamp":"2024-09-21T09:06:56.502267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:16.665604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'14","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:58.080667+0000","last_change":"2024-09-21T09:06:58.080667+0000","last_active":"2024-09-21T09:06:58.080667+0000","last_peered":"2024-09-21T09:06:58.080667+0000","last_clean":"2024-09-21T09:06:58.080667+0000","last_became_active":"2024-09-21T09:03:00.216462+0000","last_became_peered":"2024-09-21T09:03:00.216462+0000","last_unstale":"2024-09-21T09:06:58.080667+0000","last_undegraded":"2024-09-21T09:06:58.080667+0000","last_fullsized":"2024-09-21T09:06:58.080667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-21T09:06:58.080556+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-21T09:06:58.080556+0000","last_clean_scrub_stamp":"2024-09-21T09:06:58.080556+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:30.491750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.809331+0000","last_change":"2024-09-21T09:06:46.809331+0000","last_active":"2024-09-21T09:06:46.809331+0000","last_peered":"2024-09-21T09:06:46.809331+0000","last_clean":"2024-09-21T09:06:46.809331+0000","last_became_active":"2024-09-21T09:02:58.218407+0000","last_became_peered":"2024-09-21T09:02:58.218407+0000","last_unstale":"2024-09-21T09:06:46.809331+0000","last_undegraded":"2024-09-21T09:06:46.809331+0000","last_fullsized":"2024-09-21T09:06:46.809331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:46.809183+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:46.809183+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.809183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:36.437428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:46.367934+0000","last_change":"2024-09-21T09:06:46.367934+0000","last_active":"2024-09-21T09:06:46.367934+0000","last_peered":"2024-09-21T09:06:46.367934+0000","last_clean":"2024-09-21T09:06:46.367934+0000","last_became_active":"2024-09-21T09:03:00.212503+0000","last_became_peered":"2024-09-21T09:03:00.212503+0000","last_unstale":"2024-09-21T09:06:46.367934+0000","last_undegraded":"2024-09-21T09:06:46.367934+0000","last_fullsized":"2024-09-21T09:06:46.367934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:06:46.367803+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:06:46.367803+0000","last_clean_scrub_stamp":"2024-09-21T09:06:46.367803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:25:59.172888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:07.039659+0000","last_change":"2024-09-21T09:07:07.039659+0000","last_active":"2024-09-21T09:07:07.039659+0000","last_peered":"2024-09-21T09:07:07.039659+0000","last_clean":"2024-09-21T09:07:07.039659+0000","last_became_active":"2024-09-21T09:02:58.201812+0000","last_became_peered":"2024-09-21T09:02:58.201812+0000","last_unstale":"2024-09-21T09:07:07.039659+0000","last_undegraded":"2024-09-21T09:07:07.039659+0000","last_fullsized":"2024-09-21T09:07:07.039659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:07.039529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:07.039529+0000","last_clean_scrub_stamp":"2024-09-21T09:07:07.039529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:51.654459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'6","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:44.362915+0000","last_change":"2024-09-21T09:06:44.362915+0000","last_active":"2024-09-21T09:06:44.362915+0000","last_peered":"2024-09-21T09:06:44.362915+0000","last_clean":"2024-09-21T09:06:44.362915+0000","last_became_active":"2024-09-21T09:03:00.224456+0000","last_became_peered":"2024-09-21T09:03:00.224456+0000","last_unstale":"2024-09-21T09:06:44.362915+0000","last_undegraded":"2024-09-21T09:06:44.362915+0000","last_fullsized":"2024-09-21T09:06:44.362915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:44.362734+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:44.362734+0000","last_clean_scrub_stamp":"2024-09-21T09:06:44.362734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:35.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:23.397092+0000","last_change":"2024-09-21T09:07:23.397117+0000","last_active":"2024-09-21T09:07:23.397092+0000","last_peered":"2024-09-21T09:07:23.397092+0000","last_clean":"2024-09-21T09:07:23.397092+0000","last_became_active":"2024-09-21T09:02:58.222191+0000","last_became_peered":"2024-09-21T09:02:58.222191+0000","last_unstale":"2024-09-21T09:07:23.397092+0000","last_undegraded":"2024-09-21T09:07:23.397092+0000","last_fullsized":"2024-09-21T09:07:23.397092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:23.397000+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:23.397000+0000","last_clean_scrub_stamp":"2024-09-21T09:07:23.397000+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:53.755118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'6","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.249772+0000","last_change":"2024-09-21T09:06:51.249772+0000","last_active":"2024-09-21T09:06:51.249772+0000","last_peered":"2024-09-21T09:06:51.249772+0000","last_clean":"2024-09-21T09:06:51.249772+0000","last_became_active":"2024-09-21T09:03:00.220639+0000","last_became_peered":"2024-09-21T09:03:00.220639+0000","last_unstale":"2024-09-21T09:06:51.249772+0000","last_undegraded":"2024-09-21T09:06:51.249772+0000","last_fullsized":"2024-09-21T09:06:51.249772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:51.249657+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:51.249657+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.249657+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:04.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:10.109282+0000","last_change":"2024-09-21T09:07:10.109282+0000","last_active":"2024-09-21T09:07:10.109282+0000","last_peered":"2024-09-21T09:07:10.109282+0000","last_clean":"2024-09-21T09:07:10.109282+0000","last_became_active":"2024-09-21T09:02:58.208346+0000","last_became_peered":"2024-09-21T09:02:58.208346+0000","last_unstale":"2024-09-21T09:07:10.109282+0000","last_undegraded":"2024-09-21T09:07:10.109282+0000","last_fullsized":"2024-09-21T09:07:10.109282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:10.109160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:10.109160+0000","last_clean_scrub_stamp":"2024-09-21T09:07:10.109160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:50.151115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'6","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:43.941260+0000","last_change":"2024-09-21T09:06:43.941260+0000","last_active":"2024-09-21T09:06:43.941260+0000","last_peered":"2024-09-21T09:06:43.941260+0000","last_clean":"2024-09-21T09:06:43.941260+0000","last_became_active":"2024-09-21T09:03:00.222651+0000","last_became_peered":"2024-09-21T09:03:00.222651+0000","last_unstale":"2024-09-21T09:06:43.941260+0000","last_undegraded":"2024-09-21T09:06:43.941260+0000","last_fullsized":"2024-09-21T09:06:43.941260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:43.941138+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:43.941138+0000","last_clean_scrub_stamp":"2024-09-21T09:06:43.941138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:54.251590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.580125+0000","last_change":"2024-09-21T09:07:00.580125+0000","last_active":"2024-09-21T09:07:00.580125+0000","last_peered":"2024-09-21T09:07:00.580125+0000","last_clean":"2024-09-21T09:07:00.580125+0000","last_became_active":"2024-09-21T09:02:58.208495+0000","last_became_peered":"2024-09-21T09:02:58.208495+0000","last_unstale":"2024-09-21T09:07:00.580125+0000","last_undegraded":"2024-09-21T09:07:00.580125+0000","last_fullsized":"2024-09-21T09:07:00.580125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:00.579976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:00.579976+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.579976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:11.761034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'4","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:51.446658+0000","last_change":"2024-09-21T09:06:51.446658+0000","last_active":"2024-09-21T09:06:51.446658+0000","last_peered":"2024-09-21T09:06:51.446658+0000","last_clean":"2024-09-21T09:06:51.446658+0000","last_became_active":"2024-09-21T09:03:00.222343+0000","last_became_peered":"2024-09-21T09:03:00.222343+0000","last_unstale":"2024-09-21T09:06:51.446658+0000","last_undegraded":"2024-09-21T09:06:51.446658+0000","last_fullsized":"2024-09-21T09:06:51.446658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-21T09:06:51.446466+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-21T09:06:51.446466+0000","last_clean_scrub_stamp":"2024-09-21T09:06:51.446466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.923486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:58.568019+0000","last_change":"2024-09-21T09:06:58.568019+0000","last_active":"2024-09-21T09:06:58.568019+0000","last_peered":"2024-09-21T09:06:58.568019+0000","last_clean":"2024-09-21T09:06:58.568019+0000","last_became_active":"2024-09-21T09:02:58.208630+0000","last_became_peered":"2024-09-21T09:02:58.208630+0000","last_unstale":"2024-09-21T09:06:58.568019+0000","last_undegraded":"2024-09-21T09:06:58.568019+0000","last_fullsized":"2024-09-21T09:06:58.568019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:58.567895+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:58.567895+0000","last_clean_scrub_stamp":"2024-09-21T09:06:58.567895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:30.979089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'18","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:09.817950+0000","last_change":"2024-09-21T09:07:09.817973+0000","last_active":"2024-09-21T09:07:09.817950+0000","last_peered":"2024-09-21T09:07:09.817950+0000","last_clean":"2024-09-21T09:07:09.817950+0000","last_became_active":"2024-09-21T09:03:38.282951+0000","last_became_peered":"2024-09-21T09:03:38.282951+0000","last_unstale":"2024-09-21T09:07:09.817950+0000","last_undegraded":"2024-09-21T09:07:09.817950+0000","last_fullsized":"2024-09-21T09:07:09.817950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-21T09:07:09.817858+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-21T09:07:09.817858+0000","last_clean_scrub_stamp":"2024-09-21T09:07:09.817858+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:47.448817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":65,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:18.392755+0000","last_change":"2024-09-21T09:07:18.392755+0000","last_active":"2024-09-21T09:07:18.392755+0000","last_peered":"2024-09-21T09:07:18.392755+0000","last_clean":"2024-09-21T09:07:18.392755+0000","last_became_active":"2024-09-21T09:02:58.214717+0000","last_became_peered":"2024-09-21T09:02:58.214717+0000","last_unstale":"2024-09-21T09:07:18.392755+0000","last_undegraded":"2024-09-21T09:07:18.392755+0000","last_fullsized":"2024-09-21T09:07:18.392755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:18.392639+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:18.392639+0000","last_clean_scrub_stamp":"2024-09-21T09:07:18.392639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:11.253648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:38.344758+0000","last_change":"2024-09-21T09:06:38.344758+0000","last_active":"2024-09-21T09:06:38.344758+0000","last_peered":"2024-09-21T09:06:38.344758+0000","last_clean":"2024-09-21T09:06:38.344758+0000","last_became_active":"2024-09-21T09:03:00.226411+0000","last_became_peered":"2024-09-21T09:03:00.226411+0000","last_unstale":"2024-09-21T09:06:38.344758+0000","last_undegraded":"2024-09-21T09:06:38.344758+0000","last_fullsized":"2024-09-21T09:06:38.344758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:06:38.344633+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:06:38.344633+0000","last_clean_scrub_stamp":"2024-09-21T09:06:38.344633+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:29.901754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:10.317392+0000","last_change":"2024-09-21T09:07:10.317392+0000","last_active":"2024-09-21T09:07:10.317392+0000","last_peered":"2024-09-21T09:07:10.317392+0000","last_clean":"2024-09-21T09:07:10.317392+0000","last_became_active":"2024-09-21T09:02:58.224058+0000","last_became_peered":"2024-09-21T09:02:58.224058+0000","last_unstale":"2024-09-21T09:07:10.317392+0000","last_undegraded":"2024-09-21T09:07:10.317392+0000","last_fullsized":"2024-09-21T09:07:10.317392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:10.317229+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:10.317229+0000","last_clean_scrub_stamp":"2024-09-21T09:07:10.317229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:03:49.909565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'4","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:52.260743+0000","last_change":"2024-09-21T09:06:52.260743+0000","last_active":"2024-09-21T09:06:52.260743+0000","last_peered":"2024-09-21T09:06:52.260743+0000","last_clean":"2024-09-21T09:06:52.260743+0000","last_became_active":"2024-09-21T09:03:00.218422+0000","last_became_peered":"2024-09-21T09:03:00.218422+0000","last_unstale":"2024-09-21T09:06:52.260743+0000","last_undegraded":"2024-09-21T09:06:52.260743+0000","last_fullsized":"2024-09-21T09:06:52.260743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:52.260581+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:52.260581+0000","last_clean_scrub_stamp":"2024-09-21T09:06:52.260581+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:19.039754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:50.894242+0000","last_change":"2024-09-21T09:06:50.894242+0000","last_active":"2024-09-21T09:06:50.894242+0000","last_peered":"2024-09-21T09:06:50.894242+0000","last_clean":"2024-09-21T09:06:50.894242+0000","last_became_active":"2024-09-21T09:02:58.218299+0000","last_became_peered":"2024-09-21T09:02:58.218299+0000","last_unstale":"2024-09-21T09:06:50.894242+0000","last_undegraded":"2024-09-21T09:06:50.894242+0000","last_fullsized":"2024-09-21T09:06:50.894242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:06:50.894097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:06:50.894097+0000","last_clean_scrub_stamp":"2024-09-21T09:06:50.894097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:31.934174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'12","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:45.393566+0000","last_change":"2024-09-21T09:06:45.393566+0000","last_active":"2024-09-21T09:06:45.393566+0000","last_peered":"2024-09-21T09:06:45.393566+0000","last_clean":"2024-09-21T09:06:45.393566+0000","last_became_active":"2024-09-21T09:03:00.212838+0000","last_became_peered":"2024-09-21T09:03:00.212838+0000","last_unstale":"2024-09-21T09:06:45.393566+0000","last_undegraded":"2024-09-21T09:06:45.393566+0000","last_fullsized":"2024-09-21T09:06:45.393566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-21T09:06:45.393449+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-21T09:06:45.393449+0000","last_clean_scrub_stamp":"2024-09-21T09:06:45.393449+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:43.161382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:14.374192+0000","last_change":"2024-09-21T09:07:14.374192+0000","last_active":"2024-09-21T09:07:14.374192+0000","last_peered":"2024-09-21T09:07:14.374192+0000","last_clean":"2024-09-21T09:07:14.374192+0000","last_became_active":"2024-09-21T09:02:58.218776+0000","last_became_peered":"2024-09-21T09:02:58.218776+0000","last_unstale":"2024-09-21T09:07:14.374192+0000","last_undegraded":"2024-09-21T09:07:14.374192+0000","last_fullsized":"2024-09-21T09:07:14.374192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-21T09:07:14.374083+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-21T09:07:14.374083+0000","last_clean_scrub_stamp":"2024-09-21T09:07:14.374083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:25.732715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:16.322263+0000","last_change":"2024-09-21T09:07:16.322263+0000","last_active":"2024-09-21T09:07:16.322263+0000","last_peered":"2024-09-21T09:07:16.322263+0000","last_clean":"2024-09-21T09:07:16.322263+0000","last_became_active":"2024-09-21T09:02:58.218757+0000","last_became_peered":"2024-09-21T09:02:58.218757+0000","last_unstale":"2024-09-21T09:07:16.322263+0000","last_undegraded":"2024-09-21T09:07:16.322263+0000","last_fullsized":"2024-09-21T09:07:16.322263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:16.322131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:16.322131+0000","last_clean_scrub_stamp":"2024-09-21T09:07:16.322131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:55.648243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'6","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.021303+0000","last_change":"2024-09-21T09:07:00.021303+0000","last_active":"2024-09-21T09:07:00.021303+0000","last_peered":"2024-09-21T09:07:00.021303+0000","last_clean":"2024-09-21T09:07:00.021303+0000","last_became_active":"2024-09-21T09:03:00.216424+0000","last_became_peered":"2024-09-21T09:03:00.216424+0000","last_unstale":"2024-09-21T09:07:00.021303+0000","last_undegraded":"2024-09-21T09:07:00.021303+0000","last_fullsized":"2024-09-21T09:07:00.021303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-21T09:07:00.021180+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-21T09:07:00.021180+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.021180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:11.202238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:07:00.986094+0000","last_change":"2024-09-21T09:07:00.986094+0000","last_active":"2024-09-21T09:07:00.986094+0000","last_peered":"2024-09-21T09:07:00.986094+0000","last_clean":"2024-09-21T09:07:00.986094+0000","last_became_active":"2024-09-21T09:02:58.208437+0000","last_became_peered":"2024-09-21T09:02:58.208437+0000","last_unstale":"2024-09-21T09:07:00.986094+0000","last_undegraded":"2024-09-21T09:07:00.986094+0000","last_fullsized":"2024-09-21T09:07:00.986094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:07:00.985977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:07:00.985977+0000","last_clean_scrub_stamp":"2024-09-21T09:07:00.985977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:00.711201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'4","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T09:06:47.386417+0000","last_change":"2024-09-21T09:06:47.386417+0000","last_active":"2024-09-21T09:06:47.386417+0000","last_peered":"2024-09-21T09:06:47.386417+0000","last_clean":"2024-09-21T09:06:47.386417+0000","last_became_active":"2024-09-21T09:03:00.219010+0000","last_became_peered":"2024-09-21T09:03:00.219010+0000","last_unstale":"2024-09-21T09:06:47.386417+0000","last_undegraded":"2024-09-21T09:06:47.386417+0000","last_fullsized":"2024-09-21T09:06:47.386417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-21T09:06:47.386301+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-21T09:06:47.386301+0000","last_clean_scrub_stamp":"2024-09-21T09:06:47.386301+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:10.395718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673027,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":136073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705730,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":722309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705729,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":723502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705729,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":417792,"data_stored":134220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:07:59.378 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T09:07:59.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.503+0000 7fb5a34c9640 1 Processor -- start 2024-09-21T09:07:59.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.503+0000 7fb5a34c9640 1 -- start start 2024-09-21T09:07:59.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.504+0000 7fb5a34c9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb59c06eda0 0x7fb59c06f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:07:59.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.504+0000 7fb5a34c9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb59c06eba0 con 0x7fb59c06f6c0 2024-09-21T09:07:59.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.504+0000 7fb5a34c9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb59c06d2f0 con 0x7fb59c06eda0 2024-09-21T09:07:59.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.504+0000 7fb5a1265640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb59c06eda0 0x7fb59c06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:07:59.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.504+0000 7fb5a0a64640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb59c06f6c0 0x7fb59c121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41066/0 (socket says 172.21.15.44:41066) 2024-09-21T09:07:59.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.504+0000 7fb5a0a64640 1 -- 172.21.15.44:0/691459590 learned_addr learned my addr 172.21.15.44:0/691459590 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-21T09:07:59.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.504+0000 7fb5a1265640 1 -- 172.21.15.44:0/691459590 >> v1:172.21.15.44:6789/0 conn(0x7fb59c06f6c0 legacy=0x7fb59c121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:59.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.504+0000 7fb5a1265640 1 -- 172.21.15.44:0/691459590 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59c070d50 con 0x7fb59c06eda0 2024-09-21T09:07:59.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.505+0000 7fb5a1265640 1 --2- 172.21.15.44:0/691459590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59c06eda0 0x7fb59c06f180 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb598009720 tx=0x7fb59802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938b567af38b187 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:07:59.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.505+0000 7fb593fff640 1 -- 172.21.15.44:0/691459590 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb598037070 con 0x7fb59c06eda0 2024-09-21T09:07:59.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.505+0000 7fb593fff640 1 -- 172.21.15.44:0/691459590 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb59802ae20 con 0x7fb59c06eda0 2024-09-21T09:07:59.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.505+0000 7fb593fff640 1 -- 172.21.15.44:0/691459590 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb598032590 con 0x7fb59c06eda0 2024-09-21T09:07:59.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.505+0000 7fb5a34c9640 1 -- 172.21.15.44:0/691459590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59c06eda0 msgr2=0x7fb59c06f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:59.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.505+0000 7fb5a34c9640 1 --2- 172.21.15.44:0/691459590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59c06eda0 0x7fb59c06f180 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb598009720 tx=0x7fb59802a1a0 comp rx=0 tx=0).stop 2024-09-21T09:07:59.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.505+0000 7fb5a34c9640 1 -- 172.21.15.44:0/691459590 shutdown_connections 2024-09-21T09:07:59.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.505+0000 7fb5a34c9640 1 --2- 172.21.15.44:0/691459590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59c06eda0 0x7fb59c06f180 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:07:59.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.505+0000 7fb5a34c9640 1 -- 172.21.15.44:0/691459590 >> 172.21.15.44:0/691459590 conn(0x7fb59c09a890 msgr2=0x7fb59c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:07:59.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.506+0000 7fb5a34c9640 1 -- 172.21.15.44:0/691459590 shutdown_connections 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.506+0000 7fb5a34c9640 1 -- 172.21.15.44:0/691459590 wait complete. 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.506+0000 7fb5a34c9640 1 Processor -- start 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.506+0000 7fb5a34c9640 1 -- start start 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.507+0000 7fb5a34c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59c06eda0 0x7fb59c1c17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.507+0000 7fb5a34c9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb59c122160 con 0x7fb59c06eda0 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.507+0000 7fb5a1265640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59c06eda0 0x7fb59c1c17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.507+0000 7fb5a1265640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59c06eda0 0x7fb59c1c17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60352/0 (socket says 172.21.15.44:60352) 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.507+0000 7fb5a1265640 1 -- 172.21.15.44:0/3143757987 learned_addr learned my addr 172.21.15.44:0/3143757987 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.507+0000 7fb5a1265640 1 -- 172.21.15.44:0/3143757987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59c08e1a0 con 0x7fb59c06eda0 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.507+0000 7fb5a1265640 1 --2- 172.21.15.44:0/3143757987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59c06eda0 0x7fb59c1c17a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb59802a1e0 tx=0x7fb5980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.507+0000 7fb591ffb640 1 -- 172.21.15.44:0/3143757987 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb598042070 con 0x7fb59c06eda0 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.508+0000 7fb591ffb640 1 -- 172.21.15.44:0/3143757987 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb59803e670 con 0x7fb59c06eda0 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.508+0000 7fb591ffb640 1 -- 172.21.15.44:0/3143757987 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb598037040 con 0x7fb59c06eda0 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.508+0000 7fb5a34c9640 1 -- 172.21.15.44:0/3143757987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb59c08e660 con 0x7fb59c06eda0 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.508+0000 7fb5a34c9640 1 -- 172.21.15.44:0/3143757987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb59c1c1ec0 con 0x7fb59c06eda0 2024-09-21T09:07:59.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.509+0000 7fb591ffb640 1 -- 172.21.15.44:0/3143757987 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb598045070 con 0x7fb59c06eda0 2024-09-21T09:07:59.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.509+0000 7fb5a34c9640 1 -- 172.21.15.44:0/3143757987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb59c08f090 con 0x7fb59c06eda0 2024-09-21T09:07:59.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.509+0000 7fb591ffb640 1 --2- 172.21.15.44:0/3143757987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5800382d0 0x7fb58003a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T09:07:59.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.509+0000 7fb591ffb640 1 -- 172.21.15.44:0/3143757987 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fb59806c5f0 con 0x7fb59c06eda0 2024-09-21T09:07:59.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.509+0000 7fb5a0a64640 1 --2- 172.21.15.44:0/3143757987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5800382d0 0x7fb58003a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T09:07:59.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.510+0000 7fb5a0a64640 1 --2- 172.21.15.44:0/3143757987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5800382d0 0x7fb58003a790 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb58c000f60 tx=0x7fb58c007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T09:07:59.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.514+0000 7fb591ffb640 1 -- 172.21.15.44:0/3143757987 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb59803c7b0 con 0x7fb59c06eda0 2024-09-21T09:07:59.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.690+0000 7fb5a34c9640 1 -- 172.21.15.44:0/3143757987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fb59c122670 con 0x7fb59c06eda0 2024-09-21T09:07:59.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.695+0000 7fb591ffb640 1 -- 172.21.15.44:0/3143757987 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fb59802ae20 con 0x7fb59c06eda0 2024-09-21T09:07:59.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.696+0000 7fb591ffb640 1 -- 172.21.15.44:0/3143757987 <== mon.0 v2:172.21.15.44:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb5980463b0 con 0x7fb59c06eda0 2024-09-21T09:07:59.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.698+0000 7fb5a34c9640 1 -- 172.21.15.44:0/3143757987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5800382d0 msgr2=0x7fb58003a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:59.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.698+0000 7fb5a34c9640 1 --2- 172.21.15.44:0/3143757987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5800382d0 0x7fb58003a790 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb58c000f60 tx=0x7fb58c007a80 comp rx=0 tx=0).stop 2024-09-21T09:07:59.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.698+0000 7fb5a34c9640 1 -- 172.21.15.44:0/3143757987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59c06eda0 msgr2=0x7fb59c1c17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T09:07:59.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.698+0000 7fb5a34c9640 1 --2- 172.21.15.44:0/3143757987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59c06eda0 0x7fb59c1c17a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb59802a1e0 tx=0x7fb5980046c0 comp rx=0 tx=0).stop 2024-09-21T09:07:59.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.698+0000 7fb5a34c9640 1 -- 172.21.15.44:0/3143757987 shutdown_connections 2024-09-21T09:07:59.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.698+0000 7fb5a34c9640 1 --2- 172.21.15.44:0/3143757987 >> [v2:172.21.15.178:6824/968828701,v1:172.21.15.178:6825/968828701] conn(0x7fb5800382d0 0x7fb58003a790 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:07:59.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.698+0000 7fb5a34c9640 1 --2- 172.21.15.44:0/3143757987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59c06eda0 0x7fb59c1c17a0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T09:07:59.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.698+0000 7fb5a34c9640 1 -- 172.21.15.44:0/3143757987 >> 172.21.15.44:0/3143757987 conn(0x7fb59c09a890 msgr2=0x7fb59c1293b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T09:07:59.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.698+0000 7fb5a34c9640 1 -- 172.21.15.44:0/3143757987 shutdown_connections 2024-09-21T09:07:59.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T09:07:59.698+0000 7fb5a34c9640 1 -- 172.21.15.44:0/3143757987 wait complete. 2024-09-21T09:07:59.711 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T09:07:59.711 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T09:07:59.711 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T09:07:59.711 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:07:59.747 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T09:07:59.747 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T09:07:59.747 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:07:59.777 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T09:07:59.777 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T09:07:59.777 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:07:59.844 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T09:07:59.844 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T09:07:59.844 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:07:59.912 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T09:07:59.912 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T09:07:59.912 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T09:07:59.912 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:07:59.980 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T09:07:59.981 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T09:07:59.981 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T09:07:59.981 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:07:59.992 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T09:07:59.992 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T09:07:59.992 DEBUG:teuthology.orchestra.run.smithi044:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-21T09:08:00.061 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-21T09:08:00.062 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T09:08:00.248 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-21T09:08:00.248 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T09:08:00.338 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-21T09:08:00.338 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T09:08:00.394 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-21T09:08:00.394 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T09:08:00.456 INFO:tasks.ceph:Archiving mon data... 2024-09-21T09:08:00.457 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913221/data/mon.a.tgz 2024-09-21T09:08:00.457 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-09-21T09:08:00.474 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.vCkmuRqXTX 2024-09-21T09:08:00.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vCkmuRqXTX 2024-09-21T09:08:00.612 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.vCkmuRqXTX 2024-09-21T09:08:00.697 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.vCkmuRqXTX is 262KB 2024-09-21T09:08:00.764 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.vCkmuRqXTX 2024-09-21T09:08:00.779 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T09:08:00.780 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T09:08:00.822 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T09:08:00.901 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T09:08:00.920 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T09:08:00.920 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T09:08:00.921 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913221/remote/smithi044/crash 2024-09-21T09:08:00.922 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T09:08:00.967 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913221/remote/smithi178/crash 2024-09-21T09:08:00.968 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T09:08:01.012 INFO:tasks.ceph:Compressing logs... 2024-09-21T09:08:01.013 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T09:08:01.015 DEBUG:teuthology.orchestra.run.smithi178:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T09:08:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-21T09:08:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31725.log 2024-09-21T09:08:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31704.log 2024-09-21T09:08:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32516.log 2024-09-21T09:08:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31725.log: /var/log/ceph/ceph-client.admin.31704.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31725.log.gz 2024-09-21T09:08:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31703.log 2024-09-21T09:08:01.040 INFO:teuthology.orchestra.run.smithi044.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31704.log.gz 2024-09-21T09:08:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32180.log 2024-09-21T09:08:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32516.log: /var/log/ceph/ceph-client.admin.31703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31916.log 2024-09-21T09:08:01.040 INFO:teuthology.orchestra.run.smithi044.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.32516.log.gz 2024-09-21T09:08:01.040 INFO:teuthology.orchestra.run.smithi044.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31703.log.gz 2024-09-21T09:08:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31832.log 2024-09-21T09:08:01.062 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32180.log: /var/log/ceph/ceph-client.admin.31916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32642.log 2024-09-21T09:08:01.062 INFO:teuthology.orchestra.run.smithi044.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32180.log.gz 2024-09-21T09:08:01.062 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31832.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31916.log.gz 2024-09-21T09:08:01.062 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31970.log 2024-09-21T09:08:01.063 INFO:teuthology.orchestra.run.smithi044.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31832.log.gz 2024-09-21T09:08:01.063 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32642.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27180.log 2024-09-21T09:08:01.063 INFO:teuthology.orchestra.run.smithi044.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32642.log.gz 2024-09-21T09:08:01.063 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32600.log 2024-09-21T09:08:01.063 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.tmp-client.admin.27180.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31970.log.gz 2024-09-21T09:08:01.063 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph.tmp-client.admin.27180.log.gz 2024-09-21T09:08:01.063 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.30958.log 2024-09-21T09:08:01.063 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.32600.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32012.log 2024-09-21T09:08:01.063 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30958.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32600.log.gz 2024-09-21T09:08:01.063 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32686.log 2024-09-21T09:08:01.063 INFO:teuthology.orchestra.run.smithi044.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30958.log.gz 2024-09-21T09:08:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32222.log 2024-09-21T09:08:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32686.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32012.log.gz 2024-09-21T09:08:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T09:08:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32222.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.32686.log.gz 2024-09-21T09:08:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32474.log 2024-09-21T09:08:01.064 INFO:teuthology.orchestra.run.smithi044.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32222.log.gz 2024-09-21T09:08:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30983.log 2024-09-21T09:08:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31566.log 2024-09-21T09:08:01.064 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T09:08:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30983.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32474.log.gz 2024-09-21T09:08:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32390.log 2024-09-21T09:08:01.064 INFO:teuthology.orchestra.run.smithi044.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30983.log.gz 2024-09-21T09:08:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32054.log 2024-09-21T09:08:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31566.log: /var/log/ceph/ceph-client.admin.32390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31076.log 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31566.log.gz 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32390.log.gz 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31219.log 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32054.log.gz 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31535.log 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31219.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.31076.log.gz 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31388.log 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31219.log.gz 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32558.log 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31535.log.gz 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28902.log 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32558.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31388.log.gz 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29020.log 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32558.log.gz 2024-09-21T09:08:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30476.log 2024-09-21T09:08:01.066 INFO:teuthology.orchestra.run.smithi044.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28902.log.gz 2024-09-21T09:08:01.066 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31664.log 2024-09-21T09:08:01.066 INFO:teuthology.orchestra.run.smithi044.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.29020.log.gz 2024-09-21T09:08:01.066 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32264.log 2024-09-21T09:08:01.066 INFO:teuthology.orchestra.run.smithi044.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.30476.log.gz 2024-09-21T09:08:01.066 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31218.log 2024-09-21T09:08:01.066 INFO:teuthology.orchestra.run.smithi044.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31664.log.gz 2024-09-21T09:08:01.066 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32264.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-21T09:08:01.066 INFO:teuthology.orchestra.run.smithi044.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32264.log.gz/var/log/ceph/ceph-client.admin.31218.log: 2024-09-21T09:08:01.066 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31220.log 2024-09-21T09:08:01.066 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31218.log.gz 2024-09-21T09:08:01.066 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32138.log 2024-09-21T09:08:01.066 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31118.log 2024-09-21T09:08:01.066 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32138.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31220.log.gz 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30902.log 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32138.log.gz 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31874.log 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31118.log: /var/log/ceph/ceph-client.admin.30902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31496.log 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31118.log.gz 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30902.log.gz 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31536.log 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31874.log.gz 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.31496.log: -- /var/log/ceph/ceph.log 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31496.log.gz 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31387.log 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31536.log.gz 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32726.log 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31034.log 2024-09-21T09:08:01.067 INFO:teuthology.orchestra.run.smithi044.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31387.log.gz 2024-09-21T09:08:01.068 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31386.log 2024-09-21T09:08:01.068 INFO:teuthology.orchestra.run.smithi044.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32726.log.gz 2024-09-21T09:08:01.068 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32348.log 2024-09-21T09:08:01.068 INFO:teuthology.orchestra.run.smithi044.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31034.log.gz 2024-09-21T09:08:01.068 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29062.log 2024-09-21T09:08:01.068 INFO:teuthology.orchestra.run.smithi044.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31386.log.gz 2024-09-21T09:08:01.068 INFO:teuthology.orchestra.run.smithi044.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T09:08:01.068 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32096.log 2024-09-21T09:08:01.068 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32348.log: /var/log/ceph/ceph-client.admin.29062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32432.log 2024-09-21T09:08:01.068 INFO:teuthology.orchestra.run.smithi044.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32348.log.gz 2024-09-21T09:08:01.068 INFO:teuthology.orchestra.run.smithi044.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.29062.log.gz 2024-09-21T09:08:01.068 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32306.log 2024-09-21T09:08:01.068 INFO:teuthology.orchestra.run.smithi044.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32096.log.gz 2024-09-21T09:08:01.068 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31217.log 2024-09-21T09:08:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32432.log: /var/log/ceph/ceph-client.admin.32306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31328.log 2024-09-21T09:08:01.069 INFO:teuthology.orchestra.run.smithi044.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32432.log.gz 2024-09-21T09:08:01.069 INFO:teuthology.orchestra.run.smithi044.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32306.log.gz 2024-09-21T09:08:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31217.log: /var/log/ceph/ceph-client.admin.31328.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31217.log.gz 2024-09-21T09:08:01.069 INFO:teuthology.orchestra.run.smithi044.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31328.log.gz 2024-09-21T09:08:01.106 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82578.log 2024-09-21T09:08:01.106 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87993.log 2024-09-21T09:08:01.107 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.82578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89808.log 2024-09-21T09:08:01.107 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.87993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37209.log 2024-09-21T09:08:01.107 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.89808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39024.log 2024-09-21T09:08:01.107 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.37209.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.82578.log.gz 2024-09-21T09:08:01.107 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86789.log 2024-09-21T09:08:01.107 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.39024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89203.log 2024-09-21T09:08:01.107 INFO:teuthology.orchestra.run.smithi178.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.87993.log.gz 2024-09-21T09:08:01.107 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.86789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95910.log 2024-09-21T09:08:01.107 INFO:teuthology.orchestra.run.smithi178.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.39024.log.gz 2024-09-21T09:08:01.107 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.89203.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.86789.log.gz 2024-09-21T09:08:01.107 INFO:teuthology.orchestra.run.smithi178.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89808.log.gz 2024-09-21T09:08:01.107 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78948.log 2024-09-21T09:08:01.107 INFO:teuthology.orchestra.run.smithi178.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37209.log.gz 2024-09-21T09:08:01.107 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.95910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55353.log 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.78948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60193.log 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.55353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50513.log 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89203.log.gz 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.60193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43858.log 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92228.log 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.50513.log: /var/log/ceph/ceph-client.0.43858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48698.log 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.92228.log: gzip 91.1% -- replaced with /var/log/ceph/ceph-client.0.78948.log.gz 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55353.log.gz 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.84992.log 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.60193.log.gz 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52328.log 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.50513.log.gz 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.0.95910.log.gz 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.48698.log: /var/log/ceph/ceph-client.0.84992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42043.log 2024-09-21T09:08:01.108 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.43858.log.gz 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.52328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58378.log 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92228.log.gz 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr:gzip 91.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.0.48698.log.gz -- 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr: /var/log/ceph/ceph-client.0.94043.log 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.42043.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.84992.log.gz 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.58378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31704.log 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.94043.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52328.log.gz 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64428.log 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.42043.log.gz 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.31704.log: /var/log/ceph/ceph-client.0.64428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69873.log 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.31704.log.gz 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.1.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.58378.log.gz 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-21T09:08:01.109 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.94043.log.gz 2024-09-21T09:08:01.110 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.69873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54748.log 2024-09-21T09:08:01.110 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81973.log 2024-09-21T09:08:01.110 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.54748.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64428.log.gz 2024-09-21T09:08:01.110 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44463.log 2024-09-21T09:08:01.110 INFO:teuthology.orchestra.run.smithi178.stderr: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-21T09:08:01.110 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.81973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78343.log 2024-09-21T09:08:01.110 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.44463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67453.log 2024-09-21T09:08:01.110 INFO:teuthology.orchestra.run.smithi178.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.69873.log.gz 2024-09-21T09:08:01.110 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.78343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91623.log 2024-09-21T09:08:01.110 INFO:teuthology.orchestra.run.smithi178.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54748.log.gz 2024-09-21T09:08:01.110 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.67453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65638.log 2024-09-21T09:08:01.110 INFO:teuthology.orchestra.run.smithi178.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.81973.log.gz 2024-09-21T09:08:01.110 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.91623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76528.log 2024-09-21T09:08:01.111 INFO:teuthology.orchestra.run.smithi178.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44463.log.gz 2024-09-21T09:08:01.111 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.65638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31624.log 2024-09-21T09:08:01.111 INFO:teuthology.orchestra.run.smithi178.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.78343.log.gz 2024-09-21T09:08:01.111 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.76528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46883.log 2024-09-21T09:08:01.111 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.67453.log.gz 2024-09-21T09:08:01.111 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.31624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83788.log 2024-09-21T09:08:01.111 INFO:teuthology.orchestra.run.smithi178.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31624.log.gz 2024-09-21T09:08:01.111 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.91623.log.gz 2024-09-21T09:08:01.111 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.46883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57168.log 2024-09-21T09:08:01.111 INFO:teuthology.orchestra.run.smithi178.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65638.log.gz 2024-09-21T09:08:01.112 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84393.log 2024-09-21T09:08:01.112 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.83788.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.76528.log.gz 2024-09-21T09:08:01.112 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.57168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40833.log 2024-09-21T09:08:01.112 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.84393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46278.log 2024-09-21T09:08:01.112 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.40833.log: 91.1%gzip -5 --verbose -- 90.6% /var/log/ceph/ceph-client.0.45068.log 2024-09-21T09:08:01.112 INFO:teuthology.orchestra.run.smithi178.stderr: -- replaced with /var/log/ceph/ceph-client.0.84393.log.gz 2024-09-21T09:08:01.112 INFO:teuthology.orchestra.run.smithi178.stderr: -- replaced with /var/log/ceph/ceph-client.0.46883.log.gz 2024-09-21T09:08:01.112 INFO:teuthology.orchestra.run.smithi178.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83788.log.gz 2024-09-21T09:08:01.112 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.46278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59588.log 2024-09-21T09:08:01.112 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.57168.log.gz 2024-09-21T09:08:01.112 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.45068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94648.log 2024-09-21T09:08:01.112 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.59588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63823.log 2024-09-21T09:08:01.113 INFO:teuthology.orchestra.run.smithi178.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40833.log.gz 2024-09-21T09:08:01.113 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.94648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62008.log 2024-09-21T09:08:01.113 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.46278.log.gz 2024-09-21T09:08:01.113 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.45068.log.gz 2024-09-21T09:08:01.113 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.63823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45673.log 2024-09-21T09:08:01.113 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.62008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35125.log 2024-09-21T09:08:01.113 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.45673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65033.log 2024-09-21T09:08:01.113 INFO:teuthology.orchestra.run.smithi178.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.59588.log.gz 2024-09-21T09:08:01.113 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63218.log 2024-09-21T09:08:01.113 INFO:teuthology.orchestra.run.smithi178.stderr: -- replaced with /var/log/ceph/ceph-client.0.94648.log.gz 2024-09-21T09:08:01.113 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.35125.log: /var/log/ceph/ceph-client.0.65033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37814.log 2024-09-21T09:08:01.113 INFO:teuthology.orchestra.run.smithi178.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.35125.log.gz 91.1% -- replaced with /var/log/ceph/ceph-client.0.63823.log.gz 2024-09-21T09:08:01.113 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-09-21T09:08:01.113 INFO:teuthology.orchestra.run.smithi178.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.62008.log.gz 2024-09-21T09:08:01.114 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68663.log 2024-09-21T09:08:01.114 INFO:teuthology.orchestra.run.smithi178.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.45673.log.gz 2024-09-21T09:08:01.114 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.63218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39623.log 2024-09-21T09:08:01.114 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.37814.log: /var/log/ceph/ceph-client.0.68663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61403.log 2024-09-21T09:08:01.114 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.39623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58983.log 2024-09-21T09:08:01.114 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.61403.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.65033.log.gz 2024-09-21T09:08:01.114 INFO:teuthology.orchestra.run.smithi178.stderr:gzip 91.3% -- replaced with /var/log/ceph/ceph-client.0.63218.log.gz 2024-09-21T09:08:01.114 INFO:teuthology.orchestra.run.smithi178.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.36604.log 2024-09-21T09:08:01.114 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.58983.log: gzip -5 --verbose -- 91.5% -- replaced with /var/log/ceph/ceph-client.0.37814.log.gz 2024-09-21T09:08:01.114 INFO:teuthology.orchestra.run.smithi178.stderr: /var/log/ceph/ceph-client.0.52933.log 2024-09-21T09:08:01.114 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.36604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55958.log 91.7% -- replaced with /var/log/ceph/ceph-client.0.39623.log.gz 2024-09-21T09:08:01.114 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-09-21T09:08:01.115 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.52933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31664.log 2024-09-21T09:08:01.115 INFO:teuthology.orchestra.run.smithi178.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.61403.log.gz 2024-09-21T09:08:01.115 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.55958.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.58983.log.gz 2024-09-21T09:08:01.115 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69268.log 2024-09-21T09:08:01.115 INFO:teuthology.orchestra.run.smithi178.stderr: 91.4% 93.3% -- replaced with /var/log/ceph/ceph-client.0.68663.log.gz 2024-09-21T09:08:01.115 INFO:teuthology.orchestra.run.smithi178.stderr: -- replaced with /var/log/ceph/ceph-client.0.36604.log.gz 2024-09-21T09:08:01.115 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73503.log 2024-09-21T09:08:01.115 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.31664.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52933.log.gz 2024-09-21T09:08:01.115 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.69268.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.31664.log.gzgzip 2024-09-21T09:08:01.115 INFO:teuthology.orchestra.run.smithi178.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.43253.log 2024-09-21T09:08:01.115 INFO:teuthology.orchestra.run.smithi178.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55958.log.gz 2024-09-21T09:08:01.115 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.73503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79553.log 2024-09-21T09:08:01.115 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.43253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77738.log 2024-09-21T09:08:01.116 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.79553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88598.log 2024-09-21T09:08:01.116 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.77738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77133.log 2024-09-21T09:08:01.116 INFO:teuthology.orchestra.run.smithi178.stderr: 91.2% 91.4% -- replaced with /var/log/ceph/ceph-client.0.73503.log.gz 2024-09-21T09:08:01.116 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.88598.log: -- replaced with /var/log/ceph/ceph-client.0.43253.log.gz 2024-09-21T09:08:01.116 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35205.log 2024-09-21T09:08:01.116 INFO:teuthology.orchestra.run.smithi178.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.69268.log.gz 2024-09-21T09:08:01.116 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.77133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60798.log 2024-09-21T09:08:01.116 INFO:teuthology.orchestra.run.smithi178.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79553.log.gz 2024-09-21T09:08:01.116 INFO:teuthology.orchestra.run.smithi178.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77738.log.gz 2024-09-21T09:08:01.116 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.35205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57773.log 2024-09-21T09:08:01.116 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.60798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85591.log 2024-09-21T09:08:01.117 INFO:teuthology.orchestra.run.smithi178.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.35205.log.gz 2024-09-21T09:08:01.117 INFO:teuthology.orchestra.run.smithi178.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.88598.log.gz 2024-09-21T09:08:01.117 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.57773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56563.log 2024-09-21T09:08:01.117 INFO:teuthology.orchestra.run.smithi178.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.77133.log.gz 2024-09-21T09:08:01.117 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.85591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91018.log 2024-09-21T09:08:01.117 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.56563.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-21T09:08:01.117 INFO:teuthology.orchestra.run.smithi178.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.85591.log.gz 2024-09-21T09:08:01.117 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.91018.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.57773.log.gz 2024-09-21T09:08:01.117 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.60798.log.gz 2024-09-21T09:08:01.117 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66243.log 2024-09-21T09:08:01.117 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81368.log 2024-09-21T09:08:01.117 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.0.66243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75923.log 2024-09-21T09:08:01.118 INFO:teuthology.orchestra.run.smithi178.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56563.log.gz 2024-09-21T09:08:01.118 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.81368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35999.log 2024-09-21T09:08:01.118 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.75923.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62613.log 2024-09-21T09:08:01.118 INFO:teuthology.orchestra.run.smithi178.stderr: -- replaced with /var/log/ceph/ceph-client.0.91018.log.gz 2024-09-21T09:08:01.118 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.35999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53538.log 2024-09-21T09:08:01.118 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- 91.7% -- replaced with /var/log/ceph/ceph-client.0.66243.log.gz 2024-09-21T09:08:01.118 INFO:teuthology.orchestra.run.smithi178.stderr: /var/log/ceph/ceph-client.0.74108.log 2024-09-21T09:08:01.118 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.53538.log: /var/log/ceph/ceph-client.0.62613.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66848.log 2024-09-21T09:08:01.118 INFO:teuthology.orchestra.run.smithi178.stderr: -- replaced with /var/log/ceph/ceph-client.0.75923.log.gz 2024-09-21T09:08:01.118 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.74108.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.81368.log.gz 2024-09-21T09:08:01.118 INFO:teuthology.orchestra.run.smithi178.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.35999.log.gz 2024-09-21T09:08:01.118 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38419.log 2024-09-21T09:08:01.118 INFO:teuthology.orchestra.run.smithi178.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.53538.log.gz 2024-09-21T09:08:01.118 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.66848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68058.log 2024-09-21T09:08:01.119 INFO:teuthology.orchestra.run.smithi178.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74108.log.gz 2024-09-21T09:08:01.119 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.62613.log.gz 2024-09-21T09:08:01.119 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.38419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54143.log 2024-09-21T09:08:01.119 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.68058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75318.log 2024-09-21T09:08:01.119 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.54143.log: gzip 91.0% -- replaced with /var/log/ceph/ceph-client.0.66848.log.gz 2024-09-21T09:08:01.119 INFO:teuthology.orchestra.run.smithi178.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.51723.log 2024-09-21T09:08:01.119 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.75318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71688.log 2024-09-21T09:08:01.119 INFO:teuthology.orchestra.run.smithi178.stderr: 91.4%/var/log/ceph/ceph-client.0.51723.log: -- replaced with /var/log/ceph/ceph-client.0.38419.log.gz 2024-09-21T09:08:01.119 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-21T09:08:01.119 INFO:teuthology.orchestra.run.smithi178.stderr:gzip 91.8% -- replaced with /var/log/ceph/ceph-client.0.54143.log.gz 2024-09-21T09:08:01.119 INFO:teuthology.orchestra.run.smithi178.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.48093.log 2024-09-21T09:08:01.119 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.71688.log: /var/log/ceph/ceph-mgr.x.log: 91.2% 92.6% -- replaced with /var/log/ceph/ceph-client.0.68058.log.gz 2024-09-21T09:08:01.119 INFO:teuthology.orchestra.run.smithi178.stderr: -- replaced with /var/log/ceph/ceph-client.0.75318.log.gz 2024-09-21T09:08:01.119 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70478.log 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.48093.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51723.log.gz 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47488.log 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93438.log/var/log/ceph/ceph-client.0.70478.log: 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.47488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31744.log 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.48093.log.gz/var/log/ceph/ceph-client.0.93438.log: 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.70478.log.gz 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.47488.log.gz 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.71688.log.gz 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71083.log 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93438.log.gz 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.31744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72293.log 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31744.log.gz 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.71083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92833.log 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.72293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83183.log 2024-09-21T09:08:01.120 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.92833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74713.log 2024-09-21T09:08:01.121 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.83183.log: gzip -5 --verbose 91.1% -- replaced with /var/log/ceph/ceph-client.0.71083.log.gz 2024-09-21T09:08:01.121 INFO:teuthology.orchestra.run.smithi178.stderr: -- /var/log/ceph/ceph-client.0.42648.log 2024-09-21T09:08:01.121 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.72293.log.gz 2024-09-21T09:08:01.121 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5/var/log/ceph/ceph-client.0.74713.log: --verbose -- /var/log/ceph/ceph-client.admin.35165.log 2024-09-21T09:08:01.121 INFO:teuthology.orchestra.run.smithi178.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92833.log.gz/var/log/ceph/ceph-client.0.42648.log: 2024-09-21T09:08:01.121 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49908.log 2024-09-21T09:08:01.121 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.35165.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-21T09:08:01.121 INFO:teuthology.orchestra.run.smithi178.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.35165.log.gz 2024-09-21T09:08:01.121 INFO:teuthology.orchestra.run.smithi178.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74713.log.gz 2024-09-21T09:08:01.121 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.49908.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.42648.log.gz 2024-09-21T09:08:01.121 INFO:teuthology.orchestra.run.smithi178.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.83183.log.gz 2024-09-21T09:08:01.121 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80763.log 2024-09-21T09:08:01.121 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41438.log 2024-09-21T09:08:01.121 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.80763.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95253.log 2024-09-21T09:08:01.122 INFO:teuthology.orchestra.run.smithi178.stderr: -- replaced with /var/log/ceph/ceph-client.0.49908.log.gz 2024-09-21T09:08:01.122 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.41438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40228.log 2024-09-21T09:08:01.122 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51118.log 2024-09-21T09:08:01.122 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.95253.log: /var/log/ceph/ceph-client.0.40228.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.41438.log.gz 2024-09-21T09:08:01.122 INFO:teuthology.orchestra.run.smithi178.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.80763.log.gz 2024-09-21T09:08:01.122 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.95253.log.gz 2024-09-21T09:08:01.122 INFO:teuthology.orchestra.run.smithi178.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40228.log.gz 2024-09-21T09:08:01.122 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86190.log 2024-09-21T09:08:01.122 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.51118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49303.log 2024-09-21T09:08:01.122 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.86190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87388.log 2024-09-21T09:08:01.122 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.49303.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-21T09:08:01.122 INFO:teuthology.orchestra.run.smithi178.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.86190.log.gz 2024-09-21T09:08:01.122 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35085.log 2024-09-21T09:08:01.122 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.51118.log.gz 2024-09-21T09:08:01.123 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.87388.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90413.log 2024-09-21T09:08:01.123 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.35085.log: 91.1% 86.3% -- replaced with /var/log/ceph/ceph-client.admin.35085.log.gz 2024-09-21T09:08:01.123 INFO:teuthology.orchestra.run.smithi178.stderr: -- replaced with /var/log/ceph/ceph-client.0.49303.log.gz 2024-09-21T09:08:01.123 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72898.log 2024-09-21T09:08:01.123 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.90413.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.87388.log.gz 2024-09-21T09:08:01.123 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80158.log 2024-09-21T09:08:01.123 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.0.72898.log: /var/log/ceph/ceph-client.0.80158.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.90413.log.gz 2024-09-21T09:08:01.123 INFO:teuthology.orchestra.run.smithi178.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72898.log.gz 2024-09-21T09:08:01.123 INFO:teuthology.orchestra.run.smithi178.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80158.log.gz 2024-09-21T09:08:01.123 INFO:teuthology.orchestra.run.smithi178.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-21T09:08:01.138 INFO:teuthology.orchestra.run.smithi178.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-21T09:08:01.226 INFO:teuthology.orchestra.run.smithi044.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-21T09:08:01.868 INFO:teuthology.orchestra.run.smithi178.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-21T09:08:01.986 INFO:teuthology.orchestra.run.smithi178.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-21T09:08:01.986 INFO:teuthology.orchestra.run.smithi178.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-21T09:08:01.989 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-09-21T09:08:01.989 INFO:teuthology.orchestra.run.smithi178.stderr:real 0m0.957s 2024-09-21T09:08:01.989 INFO:teuthology.orchestra.run.smithi178.stderr:user 0m2.773s 2024-09-21T09:08:01.989 INFO:teuthology.orchestra.run.smithi178.stderr:sys 0m0.210s 2024-09-21T09:08:01.991 INFO:teuthology.orchestra.run.smithi044.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-21T09:08:01.991 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-21T09:08:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m0.962s 2024-09-21T09:08:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:user 0m1.119s 2024-09-21T09:08:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m0.078s 2024-09-21T09:08:01.992 INFO:tasks.ceph:Archiving logs... 2024-09-21T09:08:01.992 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913221/remote/smithi044/log 2024-09-21T09:08:01.994 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T09:08:02.270 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913221/remote/smithi178/log 2024-09-21T09:08:02.270 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T09:08:02.768 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T09:08:02.777 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T09:08:02.777 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T09:08:02.780 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T09:08:02.864 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T09:08:02.873 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T09:08:02.873 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T09:08:02.876 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T09:08:02.890 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: ntpq: command not found 2024-09-21T09:08:02.891 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-09-21T09:08:02.894 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T09:08:02.894 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2024-09-21T09:08:02.894 INFO:teuthology.orchestra.run.smithi178.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 -4336ns[ +20us] +/- 50ms 2024-09-21T09:08:02.894 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 +281us[ +281us] +/- 60ms 2024-09-21T09:08:02.894 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 -326us[ -302us] +/- 79ms 2024-09-21T09:08:02.894 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T09:08:02.895 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T09:08:02.896 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-09-21T09:08:02.896 INFO:teuthology.orchestra.run.smithi044.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 -17us[+1400ns] +/- 50ms 2024-09-21T09:08:02.896 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 +290us[ +290us] +/- 60ms 2024-09-21T09:08:02.896 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 -339us[ -321us] +/- 79ms 2024-09-21T09:08:02.896 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T09:08:02.896 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T09:08:02.905 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T09:08:02.905 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T09:08:02.914 DEBUG:teuthology.orchestra.run.smithi044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T09:08:03.005 DEBUG:teuthology.orchestra.run.smithi178:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T09:08:03.065 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T09:08:03.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:08:03.096 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T09:08:03.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:08:03.124 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T09:08:03.133 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T09:08:03.141 INFO:teuthology.task.internal:Duration was 723.738207 seconds 2024-09-21T09:08:03.141 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T09:08:03.150 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T09:08:03.150 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T09:08:03.153 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T09:08:03.194 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T09:08:03.202 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T09:08:03.422 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T09:08:03.423 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-09-21T09:08:03.423 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T09:08:03.446 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2024-09-21T09:08:03.447 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T09:08:03.489 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T09:08:03.490 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T09:08:03.492 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T09:08:03.555 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T09:08:03.555 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T09:08:03.561 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T09:08:03.694 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T09:08:03.705 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T09:08:03.705 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T09:08:03.732 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T09:08:03.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T09:08:03.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T09:08:03.775 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T09:08:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-09-21T09:08:03.820 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2024-09-21T09:08:03.843 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T09:08:03.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:08:03.892 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T09:08:03.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:08:03.907 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T09:08:03.917 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T09:08:03.917 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913221/remote/smithi044 2024-09-21T09:08:03.918 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T09:08:03.967 DEBUG:teuthology.misc:Transferring archived files from smithi178:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913221/remote/smithi178 2024-09-21T09:08:03.967 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T09:08:03.999 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T09:08:04.000 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T09:08:04.004 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T09:08:04.050 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T09:08:04.061 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T09:08:04.061 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T09:08:04.071 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T09:08:04.071 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T09:08:04.073 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T09:08:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 09:08 /home/ubuntu/cephtest 2024-09-21T09:08:04.105 INFO:teuthology.orchestra.run.smithi178.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 09:08 /home/ubuntu/cephtest 2024-09-21T09:08:04.106 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T09:08:04.117 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T09:08:04.138 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} duration: 723.7382066249847 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-21T09:08:04.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T09:08:04.203 INFO:teuthology.run:pass